Validation Result

Report generated on 19-May-2020 at 15:20:12 by pytest-html v2.1.1

Environment

ANALYTICS View Report
ARTIFACTS Download Artifacts
BUILD_ID 12
BUILD_NUMBER 12
BUILD_TAG jenkins-validate-ck-arch=amd64,channel=edge,node=runner-validate,series=bionic,snap_version=1.18-edge-12
BUILD_URL https://jenkins.canonical.com/k8s/job/validate-ck/arch=amd64,channel=edge,node=runner-validate,series=bionic,snap_version=1.18%2Fedge/12/
EXECUTOR_NUMBER 3
GIT_BRANCH origin/master
GIT_COMMIT 228adf063651cac8a42a3bf8b2ba8a5ad30f2e47
GIT_URL https://github.com/charmed-kubernetes/jenkins.git
JENKINS_URL https://jenkins.canonical.com/k8s/
JOB_NAME validate-ck-amd64-bionic-1.18/edge
NODE_NAME jenkins-slave-3
Packages {"pluggy": "0.13.1", "py": "1.8.1", "pytest": "5.4.2"}
Platform Linux-4.4.0-154-generic-ppc64le-with-Ubuntu-16.04-xenial
Plugins {"asyncio": "0.12.0", "flaky": "3.6.1", "html": "2.1.1", "metadata": "1.9.0"}
Python 3.6.5
WORKSPACE /var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge

Summary

22 tests ran in 1696.63 seconds.

19 passed, 9 skipped, 3 failed, 1 errors, 0 expected failures, 0 unexpected passes

Results

Result Time Test Description Duration
Error 2020-05-19 15:20:12.908314 jobs/integration/validation.py::test_containerd_to_docker::teardown Assume we're starting with containerd, replace with Docker and then revert to containerd. :param model: Object :return: None 0.05
Traceback (most recent call last):
File "/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/.tox/py36/lib/python3.6/site-packages/pytest_asyncio/plugin.py", line 99, in finalizer
asyncio.get_event_loop().run_until_complete(async_finalizer())
File "/usr/lib/python3.6/asyncio/base_events.py", line 444, in run_until_complete
self._check_closed()
File "/usr/lib/python3.6/asyncio/base_events.py", line 358, in _check_closed
raise RuntimeError('Event loop is closed')
RuntimeError: Event loop is closed
Failed 2020-05-19 14:52:44.365048 jobs/integration/validation.py::test_status_messages Validate that the status messages are correct. 0.00
Traceback (most recent call last):
File "/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/validation.py", line 229, in test_status_messages
assert unit.workload_status_message == message
AssertionError: assert 'Stopped serv...er,kube-proxy' == 'Kubernetes master running.'
- Kubernetes master running.
+ Stopped services: kube-controller-manager,kube-proxy
Failed 2020-05-19 14:54:16.114994 jobs/integration/validation.py::test_rbac Validate RBAC is actually on 90.52
Traceback (most recent call last):
File "/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/validation.py", line 284, in test_rbac
await wait_for_process(model, "RBAC")
File "/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/validation.py", line 60, in wait_for_process
assert False
AssertionError: assert False
Failed 2020-05-19 14:56:52.396036 jobs/integration/validation.py::test_dashboard Validate that the dashboard is operational 1.80
Traceback (most recent call last):
File "/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/validation.py", line 343, in test_dashboard
user = config["users"][0]["user"]["username"]
KeyError: 'username'
Skipped 2020-05-19 14:56:57.328812 jobs/integration/validation.py::test_network_policies::setup Apply network policy and use two busyboxes to validate it. 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 198, "Skipped: skipped, no matching applications found: ['canal', 'calico', 'tigera-secure-ee']")
Skipped 2020-05-19 14:56:57.330701 jobs/integration/validation.py::test_worker_master_removal::setup None 0.00
('jobs/integration/validation.py', 520, 'Skipped: Unskip when this can be speed up considerably')
Skipped 2020-05-19 14:56:57.333394 jobs/integration/validation.py::test_gpu_support::setup Test gpu support. Should be disabled if hardware is not detected and functional if hardware is fine 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 208, 'Skipped: skipped on this model: validate-ck')
Skipped 2020-05-19 15:14:31.899382 jobs/integration/validation.py::test_keystone::setup None 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 208, 'Skipped: skipped on this model: validate-ck')
Skipped 2020-05-19 15:14:31.902276 jobs/integration/validation.py::test_encryption_at_rest::setup Testing integrating vault secrets into cluster 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 208, 'Skipped: skipped on this model: validate-ck')
Skipped 2020-05-19 15:20:12.843841 jobs/integration/validation.py::test_multus::setup None 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 252, 'Skipped: --addons-model not specified')
Skipped 2020-05-19 15:20:12.845551 jobs/integration/validation.py::test_series_upgrade::setup None 0.00
('jobs/integration/validation.py', 1875, 'Skipped: Closes the EV prematurely')
Skipped 2020-05-19 15:20:12.848169 jobs/integration/validation.py::test_cinder::setup None 0.00
('/var/lib/jenkins/slaves/jenkins-slave-3/workspace/validate-ck/arch/amd64/channel/edge/node/runner-validate/series/bionic/snap_version/1.18/edge/jobs/integration/conftest.py', 270, 'Skipped: skipped on this cloud: aws')
Skipped 2020-05-19 15:20:12.850010 jobs/integration/validation.py::test_containerd_to_docker::setup Assume we're starting with containerd, replace with Docker and then revert to containerd. :param model: Object :return: None 0.00
('jobs/integration/validation.py', 1931, 'Skipped: Closes the EV prematurely')
Passed 2020-05-19 14:52:44.339925 jobs/integration/validation.py::test_auth_file_propagation Validate that changes to /root/cdk/basic_auth.csv on the leader master unit are propagated to the other master units. 47.39
No log output captured.
Passed 2020-05-19 14:52:45.592172 jobs/integration/validation.py::test_snap_versions Validate that the installed snap versions are consistent with channel config on the charms. 1.22
No log output captured.
Passed 2020-05-19 14:55:45.830073 jobs/integration/validation.py::test_rbac_flag Switch between auth modes and check the apiserver follows 89.71
No log output captured.
Passed 2020-05-19 14:56:50.585573 jobs/integration/validation.py::test_microbot Validate the microbot action 64.75
No log output captured.
Passed 2020-05-19 14:56:57.325008 jobs/integration/validation.py::test_kubelet_anonymous_auth_disabled Validate that kubelet has anonymous auth disabled 4.93
No log output captured.
Passed 2020-05-19 14:59:02.554161 jobs/integration/validation.py::test_extra_args None 125.22
No log output captured.
Passed 2020-05-19 15:00:23.392973 jobs/integration/validation.py::test_kubelet_extra_config None 80.83
No log output captured.
Passed 2020-05-19 15:01:04.501614 jobs/integration/validation.py::test_service_cidr_expansion Expand the service cidr by 1 and verify if kubernetes service is updated with the new cluster IP. Note the cluster cannot be revert back to the oiriginal service cidr. 41.11
No log output captured.
Passed 2020-05-19 15:04:32.137592 jobs/integration/validation.py::test_sans None 207.63
No log output captured.
Passed 2020-05-19 15:04:34.407566 jobs/integration/validation.py::test_audit_default_config None 2.27
No log output captured.
Passed 2020-05-19 15:06:54.376796 jobs/integration/validation.py::test_toggle_metrics Turn metrics on/off via the 'enable-metrics' config on kubernetes-master, and check that workload status returns to 'active', and that the metrics-server svc is started and stopped appropriately. 139.97
No log output captured.
Passed 2020-05-19 15:09:13.379519 jobs/integration/validation.py::test_audit_empty_policy None 139.00
No log output captured.
Passed 2020-05-19 15:11:39.271873 jobs/integration/validation.py::test_audit_custom_policy None 145.89
No log output captured.
Passed 2020-05-19 15:14:31.896026 jobs/integration/validation.py::test_audit_webhook None 172.62
No log output captured.
Passed 2020-05-19 15:18:15.577725 jobs/integration/validation.py::test_dns_provider None 223.67
No log output captured.
Passed 2020-05-19 15:19:46.473570 jobs/integration/validation.py::test_sysctl None 90.89
No log output captured.
Passed 2020-05-19 15:20:12.835352 jobs/integration/validation.py::test_cloud_node_labels None 26.36
No log output captured.
Passed 2020-05-19 15:20:12.838618 jobs/integration/validation.py::test_preupgrade_stub None 0.00
No log output captured.
Passed 2020-05-19 15:20:12.841437 jobs/integration/validation.py::test_postupgrade_stub None 0.00
No log output captured.