<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>8478</bug_id>
          
          <creation_ts>2015-10-11 13:28:05 +0000</creation_ts>
          <short_desc>Decoupling export test with Yocto build environment</short_desc>
          <delta_ts>2016-06-20 13:33:34 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>general</component>
          <version>2.1</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.2 M1</target_milestone>
          
          <blocked>7850</blocked>
          <everconfirmed>1</everconfirmed>
          <reporter name="Cathy Shen">cathy.shen</reporter>
          <assigned_to name="Mariano Lopez">mariano.lopez</assigned_to>
          <cc>alexandru.c.georgescu</cc>
    
    <cc>cathy.shen</cc>
    
    <cc>costin.c.constantin</cc>
    
    <cc>jing.j.wang</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>leonardo.sandoval.gonzalez</cc>
    
    <cc>mariano.lopez</cc>
          
          <qa_contact name="Cathy Shen">cathy.shen</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Yes (doc changes required)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>55144</commentid>
    <comment_count>0</comment_count>
    <who name="Cathy Shen">cathy.shen</who>
    <bug_when>2015-10-11 13:28:05 +0000</bug_when>
    <thetext>For export test, we&apos;d like to have test tar balls with only simple runner, controller and test cases. No need to include build information and build tools in it.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>55177</commentid>
    <comment_count>1</comment_count>
    <who name="Costin">costin.c.constantin</who>
    <bug_when>2015-10-12 12:59:35 +0000</bug_when>
    <thetext>Hi Cathy,

To be clear, the way tests with binaries (both native and DUT specific) are exported now is by creating a self extracting tarball that contains two main parts:
1) the buildtools related files used to ensure the remote machine that will launch tests on DUT has everything needed for an SDK, allowing anyone to develop applications for the DUT. It also includes any needed native binaries (inside sysroots directory)

2) the tests related part, composed of exported_binaries directory that contains the necessary binaries for DUT only and the exported_tests directory that contains the runexported.py script + all .py test files.

You would like to have &quot;1)&quot; removed and not care of any remote machine files? 
Also you would like the resulting files associated to &quot;2)&quot; to be included in a tarball (not self extracting tarball as it is now and possibility to install it like:
cd /
tar -xvzf tarball_name.tar.gz)?

If so, it means the remote machine will have no possibility to offer SDK functionality

Thank you.

Costin</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>55206</commentid>
    <comment_count>2</comment_count>
    <who name="Cathy Shen">cathy.shen</who>
    <bug_when>2015-10-13 05:28:20 +0000</bug_when>
    <thetext>(In reply to comment #1)

&gt; 1) the buildtools related files used to ensure the remote machine that will
&gt; launch tests on DUT has everything needed for an SDK, allowing anyone to
&gt; develop applications for the DUT. It also includes any needed native
&gt; binaries (inside sysroots directory)

For this item, we don&apos;t need SDK stuff in the test tar ball, which is useful for developing applications for DUT but not necessary for testing. Native test binaries are needed for this test tar ball.

IoT still need SDK support from Yocto per my understanding, but it&apos;s another request.

Let me know if it&apos;s clear enough. We can have a short meeting to go through these requirements if you have more questions.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>55246</commentid>
    <comment_count>3</comment_count>
    <who name="Costin">costin.c.constantin</who>
    <bug_when>2015-10-13 11:01:14 +0000</bug_when>
    <thetext>Hi Cathy,

It&apos;s clear enough.

Thank you.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>56786</commentid>
    <comment_count>4</comment_count>
    <who name="Costin">costin.c.constantin</who>
    <bug_when>2015-11-25 21:25:56 +0000</bug_when>
    <thetext>This should separate everything as desired. Please use latest hash

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=cc-tin/YP7850_final</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>61851</commentid>
    <comment_count>5</comment_count>
    <who name="Mariano Lopez">mariano.lopez</who>
    <bug_when>2016-05-02 17:38:55 +0000</bug_when>
    <thetext>Cathy,

The idea behind export test is to decouple the tests from the build environment. I must admit this functionality breaks from time to time. Can you elaborate more in what is needed here?

Thanks</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>61892</commentid>
    <comment_count>6</comment_count>
    <who name="Cathy Shen">cathy.shen</who>
    <bug_when>2016-05-03 12:48:49 +0000</bug_when>
    <thetext>To be simple, if the exported test tar ball can be deployed to another Linux machine w/o Yocto bitbake build environment and trigger the test successfully, it means it&apos;s &quot;decoupled&quot; export test with Yocto build environment.
@Jing, do you have more details on this requirement?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>61974</commentid>
    <comment_count>7</comment_count>
    <who name="jingwang">jing.j.wang</who>
    <bug_when>2016-05-05 00:43:02 +0000</bug_when>
    <thetext>Given test suite is exported, it means
*) it can be deployed to a new environment without poky build system for execution
*) It should be lightweight, just include test suite and test runner
*) Trigger testing from test runner directly, not bitbake.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62435</commentid>
    <comment_count>8</comment_count>
    <who name="Mariano Lopez">mariano.lopez</who>
    <bug_when>2016-05-25 13:19:28 +0000</bug_when>
    <thetext>Sent patches to the mailing list:

http://lists.openembedded.org/pipermail/openembedded-core/2016-May/121992.html</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62676</commentid>
    <comment_count>9</comment_count>
    <who name="Mariano Lopez">mariano.lopez</who>
    <bug_when>2016-06-06 18:37:32 +0000</bug_when>
    <thetext>This has been solved with commits:

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=549f134970b0ba0ad06256d7514b4bea1419da27

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=a9eb22e3d30b9bfd06eea55556894c256be3a4b0

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=b3a656374b2fce0a1ac236fab80998ac5d3a1726</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>