<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>4058</bug_id>
          
          <creation_ts>2013-03-19 16:47:18 +0000</creation_ts>
          <short_desc>running multiple sanity tests via bitbake fails oddly</short_desc>
          <delta_ts>2013-03-21 15:13:35 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>OE-Core</product>
          <component>core</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>1.4 M6</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Beth Flanagan">elizabeth.flanagan</reporter>
          <assigned_to name="Saul Wold">sgw</assigned_to>
          <cc>meta.mr.watcher</cc>
    
    <cc>meta.watcher</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>---</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>30860</commentid>
    <comment_count>0</comment_count>
    <who name="Beth Flanagan">elizabeth.flanagan</who>
    <bug_when>2013-03-19 16:47:18 +0000</bug_when>
    <thetext>This is seen on the new autobuilder infrastructure. RP figured it out.

The old autobuilder ran qemuimagetest image by image: 

bitbake core-image-minimal -c qemuimagetest_standalone

bitbake core-image-sato -c qemuimagetest_standalone

The new code runs it all in a single bitbake line:

bitbake core-image-minimal core-image-sato -c qemuimagetest_standalone

The expected bahavior is that the results should be the same, however, tests sometimes end up failing:

Log data follows:
| DEBUG: Executing python function do_qemuimagetest_standalone
| NOTE: Run boot test in scenario sanity
| Copying rootfs /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/core-image-minimal-qemux86-64-20130319132914.rootfs.ext3 to /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3
| Running xterm -display localhost:1 -e &apos;OE_TMPDIR=/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/runqemu /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/deploy/images/bzImage-qemux86-64.bin /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/build/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/qemuimagetest/tmp/core-image-minimal-qemux86-64-test.ext3 || /bin/sleep 60&apos; &amp;
| 	Test_Info: Wait for qemu up...
| 	Test_Info: Wait for qemu up...
| 	Test_Info: No qemu process appeared to start, exiting
| 	Test_Info: Boot Test FAIL
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 228: kill: No: invalid signal specification
| /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/scripts/qemuimage-testlib: line 229: kill: 22489: invalid signal specification
| NOTE: 	Test Result for qemux86-64 core-image-minimal
| NOTE: 	Testcase       PASS           FAIL           NORESULT
| NOTE: 	Boot           0              1              0
| DEBUG: Python function do_qemuimagetest_standalone finished
| ERROR: Function failed: Some testcases fail, pls. check test result and test log!!!
NOTE: recipe core-image-minimal-1.0-r0: task do_qemuimagetest_standalone: Failed
ERROR: Task 0 (/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-x86-64/build/meta/recipes-core/images/core-image-minimal.bb, do_qemuimagetest_standalone) failed with exit code &apos;1&apos;
NOTE: recipe core-image-sato-1.0-r0: task do_qemuimagetest_standalone: Succeeded
NOTE: Tasks Summary: Attempted 221 tasks of which 219 didn&apos;t need to be rerun and 1 failed.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>30940</commentid>
    <comment_count>1</comment_count>
    <who name="Saul Wold">sgw</who>
    <bug_when>2013-03-21 00:28:42 +0000</bug_when>
    <thetext>Richard is working with the sanity test.

Once we get a clean sanity test, i will close this.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>30988</commentid>
    <comment_count>2</comment_count>
    <who name="Saul Wold">sgw</who>
    <bug_when>2013-03-21 15:13:35 +0000</bug_when>
    <thetext>Richard has resolved this one</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>