Bug 2081 - [QA/Test] We need to add scripts to stress test sstate package relocatability
Summary: [QA/Test] We need to add scripts to stress test sstate package relocatability
Status: VERIFIED FIXED
Alias: None
Product: Test Plans/Suite
Classification: QA/Testing
Component: test-plans/suite (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium enhancement
Target Milestone: 1.6
Assignee: Stoicescu Cornel
QA Contact: Lucian Musat
URL:
Whiteboard:
Depends on:
Blocks: 4137
  Show dependency tree
 
Reported: 2012-03-13 15:36 UTC by Richard Purdie
Modified: 2014-04-23 10:36 UTC (History)
9 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Richard Purdie 2012-03-13 15:36:48 UTC
I'd like to have scripts available to automate stress testing of the sstate packages to ensure they can be relocated and that each recipe can build against an otherwise complete sstate cache.

It would also be useful to run the test build in a different location to the original build and remove the original build directory so that any original files do not exist.
Comment 1 Jiajun Xu 2012-03-15 15:30:46 UTC
Quote the comments in 2082:
I will add the sstate test cases for bug 2082 into QA 1.2 M4 cycle. And we are setting up the regression test server to automate some build feature testing. According to the description for the sstate failure, we could add a case on regression test server to cover the bug.

Furthermore, we could add a simple script to automate everything including the testing environment setup and running. I will cook one and send out for review.
Comment 2 David Nyström 2012-05-25 08:36:02 UTC
We have seen sstate issues with non standard locations of $SHELL. Our release build machine had $SHELL at /usr/bin/bash, which broke subsequent SSTATE_MIRROR builds on other test machines without bash in this location. 
 
Perhaps this testcase could "randomize" the location of needed ENV as well.
Comment 3 Alexandru Georgescu 2014-01-06 11:04:33 UTC
Corneliu will investigate how to use selftest for the scenarios presented.
Comment 4 Richard Purdie 2014-01-08 10:32:25 UTC
The stress case is:

a) Run a build in /xxx/buildA
b) Save off the sstate and remove the directory /xxx/buildA. It must be removed for the test to have maximal coverage.
c) Iterate over a list of recipes where one at a time, a given recipe is removed from the sstate cache and then bitbake'd in /xxx/buildB. It should never fail and all build correctly each time.
Comment 5 Stoicescu Cornel 2014-01-27 14:57:48 UTC
Patch on oe-core ML.
Comment 6 Stoicescu Cornel 2014-01-28 09:18:03 UTC
Patch merged: 

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=464c120036011f2d8e5ce5f33a5d449fa0fefc83

Edit: Removed dependency on bug 2082 because that one is more specific than this and also can be done separately.
Comment 7 Alexandru Palalau 2014-04-16 07:12:35 UTC
Verified on master branch.
Commit ID: ea90bd054c449a8e19c474c8bfa8c289f692c33f