Bug 4058

Summary: running multiple sanity tests via bitbake fails oddly
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Beth Flanagan <elizabeth.flanagan>
Component: coreAssignee: Saul Wold <sgw>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: meta.mr.watcher, meta.watcher
Version: unspecified   
Target Milestone: 1.4 M6   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: ---

Description Beth Flanagan 2013-03-19 16:47:18 UTC 
This is seen on the new autobuilder infrastructure. RP figured it out.

The old autobuilder ran qemuimagetest image by image: 

bitbake core-image-minimal -c qemuimagetest_standalone

bitbake core-image-sato -c qemuimagetest_standalone

The new code runs it all in a single bitbake line:

bitbake core-image-minimal core-image-sato -c qemuimagetest_standalone

The expected bahavior is that the results should be the same, however, tests sometimes end up failing:

Log data follows:
| DEBUG: Executing python function do_qemuimagetest_standalone
| NOTE: Run boot test in scenario sanity
| Copying rootfs /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/core-image-minimal-qemux86-64-20130319132914.rootfs.ext3 to /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3
| Running xterm -display localhost:1 -e 'OE_TMPDIR=/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/runqemu /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/bzImage-qemux86-64.bin /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3 || /bin/sleep 60' &
| 	Test_Info: Wait for qemu up...
| 	Test_Info: Wait for qemu up...
| 	Test_Info: No qemu process appeared to start, exiting
| 	Test_Info: Boot Test FAIL
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 228: kill: No: invalid signal specification
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 229: kill: 22489: invalid signal specification
| NOTE: 	Test Result for qemux86-64 core-image-minimal
| NOTE: 	Testcase       PASS           FAIL           NORESULT
| NOTE: 	Boot           0              1              0
| DEBUG: Python function do_qemuimagetest_standalone finished
| ERROR: Function failed: Some testcases fail, pls. check test result and test log!!!
NOTE: recipe core-image-minimal-1.0-r0: task do_qemuimagetest_standalone: Failed
ERROR: Task 0 (/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/meta/recipes-core/images/core-image-minimal.bb, do_qemuimagetest_standalone) failed with exit code '1'
NOTE: recipe core-image-sato-1.0-r0: task do_qemuimagetest_standalone: Succeeded
NOTE: Tasks Summary: Attempted 221 tasks of which 219 didn't need to be rerun and 1 failed.
Comment 1 Saul Wold 2013-03-21 00:28:42 UTC 
Richard is working with the sanity test.

Once we get a clean sanity test, i will close this.
Comment 2 Saul Wold 2013-03-21 15:13:35 UTC 
Richard has resolved this one