Bug 8478 - Decoupling export test with Yocto build environment
Summary: Decoupling export test with Yocto build environment
Status: RESOLVED FIXED
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: 2.1
Hardware: x86 Multiple
: Medium+ enhancement
Target Milestone: 2.2 M1
Assignee: Mariano Lopez
QA Contact: Cathy Shen
URL:
Whiteboard:
Depends on:
Blocks: 7850
  Show dependency tree
 
Reported: 2015-10-11 13:28 UTC by Cathy Shen
Modified: 2016-06-20 13:33 UTC (History)
7 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Yes (doc changes required)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Cathy Shen 2015-10-11 13:28:05 UTC
For export test, we'd like to have test tar balls with only simple runner, controller and test cases. No need to include build information and build tools in it.
Comment 1 Costin 2015-10-12 12:59:35 UTC
Hi Cathy,

To be clear, the way tests with binaries (both native and DUT specific) are exported now is by creating a self extracting tarball that contains two main parts:
1) the buildtools related files used to ensure the remote machine that will launch tests on DUT has everything needed for an SDK, allowing anyone to develop applications for the DUT. It also includes any needed native binaries (inside sysroots directory)

2) the tests related part, composed of exported_binaries directory that contains the necessary binaries for DUT only and the exported_tests directory that contains the runexported.py script + all .py test files.

You would like to have "1)" removed and not care of any remote machine files? 
Also you would like the resulting files associated to "2)" to be included in a tarball (not self extracting tarball as it is now and possibility to install it like:
cd /
tar -xvzf tarball_name.tar.gz)?

If so, it means the remote machine will have no possibility to offer SDK functionality

Thank you.

Costin
Comment 2 Cathy Shen 2015-10-13 05:28:20 UTC
(In reply to comment #1)

> 1) the buildtools related files used to ensure the remote machine that will
> launch tests on DUT has everything needed for an SDK, allowing anyone to
> develop applications for the DUT. It also includes any needed native
> binaries (inside sysroots directory)

For this item, we don't need SDK stuff in the test tar ball, which is useful for developing applications for DUT but not necessary for testing. Native test binaries are needed for this test tar ball.

IoT still need SDK support from Yocto per my understanding, but it's another request.

Let me know if it's clear enough. We can have a short meeting to go through these requirements if you have more questions.
Comment 3 Costin 2015-10-13 11:01:14 UTC
Hi Cathy,

It's clear enough.

Thank you.
Comment 4 Costin 2015-11-25 21:25:56 UTC
This should separate everything as desired. Please use latest hash

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=cc-tin/YP7850_final
Comment 5 Mariano Lopez 2016-05-02 17:38:55 UTC
Cathy,

The idea behind export test is to decouple the tests from the build environment. I must admit this functionality breaks from time to time. Can you elaborate more in what is needed here?

Thanks
Comment 6 Cathy Shen 2016-05-03 12:48:49 UTC
To be simple, if the exported test tar ball can be deployed to another Linux machine w/o Yocto bitbake build environment and trigger the test successfully, it means it's "decoupled" export test with Yocto build environment.
@Jing, do you have more details on this requirement?
Comment 7 jingwang 2016-05-05 00:43:02 UTC
Given test suite is exported, it means
*) it can be deployed to a new environment without poky build system for execution
*) It should be lightweight, just include test suite and test runner
*) Trigger testing from test runner directly, not bitbake.
Comment 8 Mariano Lopez 2016-05-25 13:19:28 UTC
Sent patches to the mailing list:

http://lists.openembedded.org/pipermail/openembedded-core/2016-May/121992.html