Help
Description
[lavafed 2019.07.0001.g495d8423e] synquacer - health-check
Device-type
synquacer
Submitter
Rémi Duraffort
Created
3 months, 3 weeks ago
Priority
Medium
Visibility
Public
Required Tags
ledge.validation.linaro.org
#943
Canceled
Device
lng-synquacer-01@ledge.validation.linaro.org
Started
3 months, 3 weeks ago
Duration
6 days
Results
  
lava-dispatcher, installed at version: 2019.07.0001.g495d8423e+stretch start: 0 validate Start time: 2019-08-01 09:21:52.593975+00:00 (UTC) Validating that http://images.validation.linaro.org/synquacer/hc/initrd.img exists Validating that http://images.validation.linaro.org/synquacer/hc/vmlinuz exists Validating that http://images.validation.linaro.org/synquacer/hc/rootfs.tar.xz exists validate duration: 0.04 case: validate
case_id: 19444
definition: lava
result: pass
start: 1 tftp-deploy (timeout 00:10:00) [common] start: 1.1 download-retry (timeout 00:10:00) [common] start: 1.1.1 http-download (timeout 00:10:00) [common] Not decompressing ramdisk as can be used compressed. downloading http://images.validation.linaro.org/synquacer/hc/initrd.img saving as /var/lib/lava/dispatcher/tmp/lavafed-943/tftp-deploy-4ova_plp/ramdisk/initrd.img total size: 24973226 (23MB) No compression specified progress 0% (0MB) progress 5% (1MB) progress 10% (2MB) progress 15% (3MB) progress 20% (4MB) progress 25% (5MB) progress 30% (7MB) progress 35% (8MB) progress 40% (9MB) progress 45% (10MB) progress 50% (11MB) progress 55% (13MB) progress 60% (14MB) progress 65% (15MB) progress 70% (16MB) progress 75% (17MB) progress 80% (19MB) progress 85% (20MB) progress 90% (21MB) progress 95% (22MB) progress 100% (23MB) 23MB downloaded in 0.29s (81.71MB/s) end: 1.1.1 http-download (duration 00:00:00) [common] case: http-download
case_id: 19445
definition: lava
duration: 0.29
extra: ...
level: 1.1.1
namespace: common
result: pass
end: 1.1 download-retry (duration 00:00:00) [common] start: 1.2 download-retry (timeout 00:10:00) [common] start: 1.2.1 http-download (timeout 00:10:00) [common] downloading http://images.validation.linaro.org/synquacer/hc/vmlinuz saving as /var/lib/lava/dispatcher/tmp/lavafed-943/tftp-deploy-4ova_plp/kernel/vmlinuz total size: 18560880 (17MB) No compression specified progress 0% (0MB) progress 5% (0MB) progress 10% (1MB) progress 15% (2MB) progress 20% (3MB) progress 25% (4MB) progress 30% (5MB) progress 35% (6MB) progress 40% (7MB) progress 45% (7MB) progress 50% (8MB) progress 55% (9MB) progress 60% (10MB) progress 65% (11MB) progress 70% (12MB) progress 75% (13MB) progress 80% (14MB) progress 85% (15MB) progress 90% (15MB) progress 95% (16MB) progress 100% (17MB) 17MB downloaded in 0.25s (71.75MB/s) end: 1.2.1 http-download (duration 00:00:00) [common] case: http-download
case_id: 19445
definition: lava
duration: 0.25
extra: ...
level: 1.2.1
namespace: common
result: pass
end: 1.2 download-retry (duration 00:00:00) [common] start: 1.3 download-retry (timeout 00:09:59) [common] start: 1.3.1 http-download (timeout 00:09:59) [common] downloading http://images.validation.linaro.org/synquacer/hc/rootfs.tar.xz saving as /var/lib/lava/dispatcher/tmp/lavafed-943/tftp-deploy-4ova_plp/nfsrootfs/rootfs.tar total size: 265494196 (253MB) Using unxz to decompress xz progress 0% (0MB) progress 5% (12MB) progress 10% (25MB) progress 15% (38MB) progress 20% (50MB) progress 25% (63MB) progress 30% (75MB) progress 35% (88MB) progress 40% (101MB) progress 45% (113MB) progress 50% (126MB) progress 55% (139MB) progress 60% (151MB) progress 65% (164MB) progress 70% (177MB) progress 75% (189MB) progress 80% (202MB) progress 85% (215MB) progress 90% (227MB) progress 95% (240MB) progress 100% (253MB) 253MB downloaded in 25.88s (9.79MB/s) end: 1.3.1 http-download (duration 00:00:26) [common] case: http-download
case_id: 19445
definition: lava
duration: 25.88
extra: ...
level: 1.3.1
namespace: common
result: pass
end: 1.3 download-retry (duration 00:00:26) [common] start: 1.4 prepare-tftp-overlay (timeout 00:09:34) [common] start: 1.4.1 extract-nfsrootfs (timeout 00:09:34) [common] Extracted nfsroot to /var/lib/lava/dispatcher/tmp/lavafed-943/extract-nfsrootfs-gztbx5ft Adding 'binary/' prefix, any other content will not be visible. end: 1.4.1 extract-nfsrootfs (duration 00:00:19) [common] start: 1.4.2 lava-overlay (timeout 00:09:14) [common] [common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw makedir: /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin makedir: /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/tests makedir: /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/results Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-add-keys Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-add-sources Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-background-process-start Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-background-process-stop Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-common-functions Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-echo-ipv4 Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-install-packages Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-installed-packages Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-os-build Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-probe-channel Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-probe-ip Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-target-ip Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-target-mac Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-target-storage Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-case Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-event Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-feedback Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-raise Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-reference Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-runner Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-set Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-test-shell Updating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-add-keys (debian) Updating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-add-sources (debian) Updating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-install-packages (debian) Updating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-installed-packages (debian) Updating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/bin/lava-os-build (debian) Creating /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/environment start: 1.4.2.1 lava-vland-overlay (timeout 00:09:14) [common] skipped lava-vland-overlay end: 1.4.2.1 lava-vland-overlay (duration 00:00:00) [common] start: 1.4.2.2 lava-multinode-overlay (timeout 00:09:14) [common] skipped lava-multinode-overlay end: 1.4.2.2 lava-multinode-overlay (duration 00:00:00) [common] start: 1.4.2.3 test-definition (timeout 00:09:14) [common] Loading test definitions start: 1.4.2.3.1 git-repo-action (timeout 00:09:14) [common] Using /lava-943 at stage 0 Fetching tests from http://git.linaro.org/lava-team/lava-functional-tests.git Running '/usr/bin/git clone http://git.linaro.org/lava-team/lava-functional-tests.git /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/0/tests/0_smoke-tests --depth=1' Tests stored (tmp) in /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/0/tests/0_smoke-tests/lava-test-shell/smoke-tests-basic.yaml uuid=943_1.4.2.3.1 testdef=None end: 1.4.2.3.1 git-repo-action (duration 00:00:00) [common] case: git-repo-action
case_id: 19448
definition: lava
duration: 0.33
extra: ...
level: 1.4.2.3.1
namespace: common
result: pass
start: 1.4.2.3.2 test-overlay (timeout 00:09:14) [common] end: 1.4.2.3.2 test-overlay (duration 00:00:00) [common] case: test-overlay
case_id: 19449
definition: lava
duration: 0.01
extra: ...
level: 1.4.2.3.2
namespace: common
result: pass
start: 1.4.2.3.3 test-install-overlay (timeout 00:09:14) [common] end: 1.4.2.3.3 test-install-overlay (duration 00:00:00) [common] case: test-install-overlay
case_id: 19450
definition: lava
duration: 0.08
extra: ...
level: 1.4.2.3.3
namespace: common
result: pass
start: 1.4.2.3.4 test-runscript-overlay (timeout 00:09:14) [common] runner path: /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/0/tests/0_smoke-tests test_uuid 943_1.4.2.3.1 end: 1.4.2.3.4 test-runscript-overlay (duration 00:00:00) [common] case: test-runscript-overlay
case_id: 19451
definition: lava
duration: 0.17
extra: ...
level: 1.4.2.3.4
namespace: common
result: pass
Creating lava-test-runner.conf files Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/lavafed-943/lava-overlay-ix8owczw/lava-943/0 for stage 0 - 0_smoke-tests end: 1.4.2.3 test-definition (duration 00:00:01) [common] start: 1.4.2.4 compress-overlay (timeout 00:09:14) [common] end: 1.4.2.4 compress-overlay (duration 00:00:00) [common] start: 1.4.2.5 persistent-nfs-overlay (timeout 00:09:14) [common] end: 1.4.2.5 persistent-nfs-overlay (duration 00:00:00) [common] end: 1.4.2 lava-overlay (duration 00:00:01) [common] start: 1.4.3 extract-overlay-ramdisk (timeout 00:09:14) [common] nice cpio -iud -F /var/lib/lava/dispatcher/tmp/lavafed-943/extract-overlay-ramdisk-aqhx87a7/ramdisk.cpio output: 155989 blocks output: end: 1.4.3 extract-overlay-ramdisk (duration 00:00:02) [common] start: 1.4.4 extract-modules (timeout 00:09:11) [common] end: 1.4.4 extract-modules (duration 00:00:00) [common] start: 1.4.5 apply-overlay-tftp (timeout 00:09:11) [common] [common] Applying overlay to NFS [common] Applying overlay /var/lib/lava/dispatcher/tmp/lavafed-943/compress-overlay-rp5dm0sg/overlay-1.4.2.4.tar.gz to directory /var/lib/lava/dispatcher/tmp/lavafed-943/extract-nfsrootfs-gztbx5ft/binary/ end: 1.4.5 apply-overlay-tftp (duration 00:00:00) [common] start: 1.4.6 prepare-kernel (timeout 00:09:11) [common] end: 1.4.6 prepare-kernel (duration 00:00:00) [common] start: 1.4.7 configure-preseed-file (timeout 00:09:11) [common] end: 1.4.7 configure-preseed-file (duration 00:00:00) [common] start: 1.4.8 compress-ramdisk (timeout 00:09:11) [common] Building ramdisk /var/lib/lava/dispatcher/tmp/lavafed-943/extract-overlay-ramdisk-aqhx87a7/ramdisk.cpio containing /var/lib/lava/dispatcher/tmp/lavafed-943/extract-overlay-ramdisk-aqhx87a7/ramdisk find . | cpio --create --format='newc' > /var/lib/lava/dispatcher/tmp/lavafed-943/extract-overlay-ramdisk-aqhx87a7/ramdisk.cpio 155989 blocks rename /var/lib/lava/dispatcher/tmp/lavafed-943/extract-overlay-ramdisk-aqhx87a7/ramdisk.cpio.gz to /var/lib/lava/dispatcher/tmp/lavafed-943/tftp-deploy-4ova_plp/ramdisk/ramdisk.cpio.gz end: 1.4.8 compress-ramdisk (duration 00:00:05) [common] end: 1.4 prepare-tftp-overlay (duration 00:00:28) [common] start: 1.5 lxc-create-udev-rule-action (timeout 00:09:06) [common] No LXC device requested end: 1.5 lxc-create-udev-rule-action (duration 00:00:00) [common] start: 1.6 deploy-device-env (timeout 00:09:06) [common] end: 1.6 deploy-device-env (duration 00:00:00) [common] Checking files for TFTP limit of 4294967296 bytes. end: 1 tftp-deploy (duration 00:00:54) [common] start: 2 grub-main-action (timeout 00:14:06) [common] start: 2.1 bootloader-from-media (timeout 00:14:06) [common] end: 2.1 bootloader-from-media (duration 00:00:00) [common] start: 2.2 bootloader-overlay (timeout 00:14:06) [common] Parsed boot commands: insmod efinet; net_ls_addr; linux (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/kernel/vmlinuz root=/dev/nfs rw nfsroot=172.27.20.10:/var/lib/lava/dispatcher/tmp/lavafed-943/extract-nfsrootfs-gztbx5ft/binary/,tcp,hard,intr,vers=3 ip=dhcp ; initrd (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/ramdisk/ramdisk.cpio.gz; boot end: 2.2 bootloader-overlay (duration 00:00:00) [common] start: 2.3 connect-device (timeout 00:14:06) [common] [common] connect-device Connecting to device using 'telnet lngmaster 7336' end: 2.3 connect-device (duration 00:00:01) [common] start: 2.4 reset-device (timeout 00:14:05) [common] start: 2.4.1 pdu-reboot (timeout 00:14:05) [common] Calling: 'nice' '/usr/local/lab-scripts/snmp_pdu_control' '--hostname' 'lngpdu01' '--port' '1' '--command' 'reboot' >> lngpdu01 port 1 now powered off >> lngpdu01 port 1 now powered on >> lngpdu01 port 1 now power cycled Returned 0 in 15 seconds end: 2.4.1 pdu-reboot (duration 00:00:15) [common] case: pdu-reboot
case_id: 19452
definition: lava
duration: 15.25
extra: ...
level: 2.4.1
namespace: common
result: pass
end: 2.4 reset-device (duration 00:00:15) [common] start: 2.5 bootloader-interrupt (timeout 00:13:50) [common] bootloader-interrupt: Wait for prompt for a command-line (timeout 00:15:00) Trying 172.27.16.10... Connected to lngmaster.lnglab. Escape character is '^]'. ser2net LEDGE Synquacer 01 port 7336 speed 115200 N81 NOTICE: Booting Trusted Firmware NOTICE: BL1: v1.2(release):c6882acbdb71 NOTICE: BL1: Built : 18:09:32, Dec 9 2017 NOTICE: BL2: v1.2(release):c6882acbdb71 NOTICE: BL2: Built : 18:09:32, Dec 9 2017 NOTICE: BL1: Booting BL31 NOTICE: BL31: v1.2(release):28b9909e4617 NOTICE: BL31: Built : 09:51:33, Jan 4 2018 [2J[04D[=3h[2J[09D[2J[04D[=3h[2J[09D[2J[04D[=3h[2J[09D[0m[35m[40m[0m[37m[40mTianocore/EDK2 firmware version 22 Press ESCAPE for boot options ..... >>Start PXE over IPv4. Station IP address is 172.27.19.26 Server IP address is 172.27.16.5 NBP filename is /debian-installer/arm64/bootnetaa64.efi NBP filesize is 544768 Bytes Downloading NBP file... NBP file downloaded successfully. [0m[30m[40m[2J[01;01H[0m[37m[40m[02;25HGNU GRUB version 2.02+dfsg1-16 [0m[36m[44m[01C/----------------------------------------------------------------------------\[05;02H|[76C|[06;02H|[76C|[07;02H|[76C|[08;02H|[76C|[09;02H|[76C|[10;02H|[76C|[11;02H|[76C|[12;02H|[76C|[13;02H|[76C|[14;02H|[76C|[15;02H|[76C|[16;02H|[76C|[17;02H|[76C|[18;02H\----------------------------------------------------------------------------/[19;02H[20;02H[0m[37m[40m Use the ^ and v keys to select which entry is highlighted. Press enter to boot the selected OS, `e' to edit the commands end: 2.5 bootloader-interrupt (duration 00:00:17) [common] start: 2.6 bootloader-commands (timeout 00:13:33) [common] bootloader-commands: Wait for prompt ['grub>'] (timeout 00:13:33) before booting or `c' for a command-line. c [05;80H [1m[37m[44m[05;03H*Install [0m[36m[44m[01D[0m[37m[40m[0m[36m[44m[06;03H Advanced options ... [01D[0m[37m[40m[0m[36m[44m[07;03H Dark theme option... [01D[0m[37m[40m[0m[36m[44m[08;03H Install with speech synthesis [01D[0m[37m[40m[0m[36m[44m[09;03H [01D[0m[37m[40m[0m[36m[44m[10;03H [01D[0m[37m[40m[0m[36m[44m[11;03H [01D[0m[37m[40m[0m[36m[44m[12;03H [01D[0m[37m[40m[0m[36m[44m[13;03H [01D[0m[37m[40m[0m[36m[44m[14;03H [01D[0m[37m[40m[0m[36m[44m[15;03H [01D[0m[37m[40m[0m[36m[44m[16;03H [01D[0m[37m[40m[0m[36m[44m[17;03H [01D[0m[37m[40m[02C [05;78H[23;01H [24;01H [05;78H[0m[30m[40m[2J[01;01H[0m[37m[40m[0m[30m[40m[2J[04D[0m[37m[40m[02;25HGNU GRUB version 2.02+dfsg1-16 Minimal BASH-like line editing is supported. For the first word, TAB lists possible command completions. Anywhere else TAB lists possible device or file completions. ESC at any time exits. Sending with 1 millisecond of delay insmod efinet grub> insmod efinet bootloader-commands: Wait for prompt ['grub>', 'error: missing (.*) symbol.'] (timeout 00:13:32) insmod efinet Sending with 1 millisecond of delay net_ls_addr grub> net_ls_addr bootloader-commands: Wait for prompt ['grub>', 'error: missing (.*) symbol.'] (timeout 00:13:31) net_ls_addr efinet0 e0:d5:5e:65:ac:ad 172.27.19.26 Sending with 1 millisecond of delay linux (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/kernel/vmlinuz root=/dev/nfs rw nfsroot=172.27.20.10:/var/lib/lava/dispatcher/tmp/lavafed-943/extract-nfsrootfs-gztbx5ft/binary/,tcp,hard,intr,vers=3 ip=dhcp grub> linux (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/kernel/vmlinuz root=/dev/nfs rw nfsroot=172.27.20.10:/var/lib/lava/dispatcher/tmp/lavafed-943/extract-nfsrootfs-gztbx5ft/binary/,tcp,hard,intr,vers=3 ip=dhcp bootloader-commands: Wait for prompt ['grub>', 'error: missing (.*) symbol.'] (timeout 00:13:20) linux (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/kernel/vmlinuz [12;80H [13;01H root=/dev/nfs rw nfsroot=172.27.20.10:/var/lib/lava/dispatcher/tmp/lavafed-943 [13;80H/ [14;01Hextract-nfsrootfs-gztbx5ft/binary/,tcp,hard,intr,vers=3 ip=dhcp error: File not found. Sending with 1 millisecond of delay initrd (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/ramdisk/ramdisk.cpio.gz grub> initrd (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/ramdisk/ramdisk.cpio.gz bootloader-commands: Wait for prompt ['grub>', 'error: missing (.*) symbol.'] (timeout 00:13:16) initrd (tftp,172.27.20.10)/lavafed-943/tftp-deploy-4ova_plp/ramdisk/ramdi [16;80Hs [17;01Hk.cpio.gz error: you need to load the kernel first. Sending with 1 millisecond of delay boot grub> boot end: 2.6 bootloader-commands (duration 00:00:17) [common] start: 2.7 auto-login-action (timeout 00:13:15) [common] auto-login-action: Wait for prompt ['Linux version [0-9]', 'error: missing (.*) symbol.'] (timeout 00:15:00) boot error: you need to load the kernel first.

Top of page

Please read the triage guidelines for help on debugging failures in the test job, test definitions or in individual test cases.

Job Details YAML

Pipeline jobs use the job definition to generate a descriptive YAML file when the pipeline is validated. The file represents the data sent to the dispatcher at the start of the job, including details of the device as well as the job parameters and the details of the parameters sent to each of the deploy, boot and test actions in the job pipeline.

Click on the Metadata, Device or Job Actions headings below to see some of the information from the description file for this job or download the complete file as YAML using the link above.

device type
hostname
timeouts
device action methods
target
...
timeouts
...

Job Timings

This section helps test writers to check for actions with a duration which is much shorter than the requested timeout. Reducing these timeouts will allow failures to be identified more quickly.

The graph only shows actions that are longer than 1 second. The full list is anyway available in the table.

Loading the data...