Bug 4058 - running multiple sanity tests via bitbake fails oddly
Summary: running multiple sanity tests via bitbake fails oddly
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 1.4 M6
Assignee: Saul Wold
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2013-03-19 16:47 UTC by Beth Flanagan
Modified: 2013-03-21 15:13 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: ---


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Beth Flanagan 2013-03-19 16:47:18 UTC
This is seen on the new autobuilder infrastructure. RP figured it out.

The old autobuilder ran qemuimagetest image by image: 

bitbake core-image-minimal -c qemuimagetest_standalone

bitbake core-image-sato -c qemuimagetest_standalone

The new code runs it all in a single bitbake line:

bitbake core-image-minimal core-image-sato -c qemuimagetest_standalone

The expected bahavior is that the results should be the same, however, tests sometimes end up failing:

Log data follows:
| DEBUG: Executing python function do_qemuimagetest_standalone
| NOTE: Run boot test in scenario sanity
| Copying rootfs /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/core-image-minimal-qemux86-64-20130319132914.rootfs.ext3 to /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3
| Running xterm -display localhost:1 -e 'OE_TMPDIR=/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/runqemu /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/bzImage-qemux86-64.bin /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3 || /bin/sleep 60' &
| 	Test_Info: Wait for qemu up...
| 	Test_Info: Wait for qemu up...
| 	Test_Info: No qemu process appeared to start, exiting
| 	Test_Info: Boot Test FAIL
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 228: kill: No: invalid signal specification
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 229: kill: 22489: invalid signal specification
| NOTE: 	Test Result for qemux86-64 core-image-minimal
| NOTE: 	Testcase       PASS           FAIL           NORESULT
| NOTE: 	Boot           0              1              0
| DEBUG: Python function do_qemuimagetest_standalone finished
| ERROR: Function failed: Some testcases fail, pls. check test result and test log!!!
NOTE: recipe core-image-minimal-1.0-r0: task do_qemuimagetest_standalone: Failed
ERROR: Task 0 (/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/meta/recipes-core/images/core-image-minimal.bb, do_qemuimagetest_standalone) failed with exit code '1'
NOTE: recipe core-image-sato-1.0-r0: task do_qemuimagetest_standalone: Succeeded
NOTE: Tasks Summary: Attempted 221 tasks of which 219 didn't need to be rerun and 1 failed.
Comment 1 Saul Wold 2013-03-21 00:28:42 UTC
Richard is working with the sanity test.

Once we get a clean sanity test, i will close this.
Comment 2 Saul Wold 2013-03-21 15:13:35 UTC
Richard has resolved this one