Bug 2081

Summary:	[QA/Test] We need to add scripts to stress test sstate package relocatability
Product:	[QA/Testing] Test Plans/Suite	Reporter:	Richard Purdie <richard.purdie>
Component:	test-plans/suite	Assignee:	Stoicescu Cornel <corneliux.stoicescu>
Status:	VERIFIED FIXED	QA Contact:	Lucian Musat <georgex.l.musat>
Severity:	enhancement
Priority:	Medium	CC:	alexandru.c.georgescu, bogdanx.a.voiculescu, david.nystrom, jessica.zhang, laurentiu.serban, sgw, song.liu, yp.test.watcher, yp.watcher
Version:	unspecified
Target Milestone:	1.6
Hardware:	x86
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	No (bug/feature does not impact docs)
Bug Depends on:
Bug Blocks:	4137

Description Richard Purdie 2012-03-13 15:36:48 UTC

I'd like to have scripts available to automate stress testing of the sstate packages to ensure they can be relocated and that each recipe can build against an otherwise complete sstate cache.

It would also be useful to run the test build in a different location to the original build and remove the original build directory so that any original files do not exist.

Comment 1 Jiajun Xu 2012-03-15 15:30:46 UTC

Quote the comments in 2082:
I will add the sstate test cases for bug 2082 into QA 1.2 M4 cycle. And we are setting up the regression test server to automate some build feature testing. According to the description for the sstate failure, we could add a case on regression test server to cover the bug.

Furthermore, we could add a simple script to automate everything including the testing environment setup and running. I will cook one and send out for review.

Comment 2 David Nyström 2012-05-25 08:36:02 UTC

We have seen sstate issues with non standard locations of $SHELL. Our release build machine had $SHELL at /usr/bin/bash, which broke subsequent SSTATE_MIRROR builds on other test machines without bash in this location. 
 
Perhaps this testcase could "randomize" the location of needed ENV as well.

Comment 3 Alexandru Georgescu 2014-01-06 11:04:33 UTC

Corneliu will investigate how to use selftest for the scenarios presented.

Comment 4 Richard Purdie 2014-01-08 10:32:25 UTC

The stress case is:

a) Run a build in /xxx/buildA
b) Save off the sstate and remove the directory /xxx/buildA. It must be removed for the test to have maximal coverage.
c) Iterate over a list of recipes where one at a time, a given recipe is removed from the sstate cache and then bitbake'd in /xxx/buildB. It should never fail and all build correctly each time.

Comment 5 Stoicescu Cornel 2014-01-27 14:57:48 UTC

Patch on oe-core ML.

Comment 6 Stoicescu Cornel 2014-01-28 09:18:03 UTC

Patch merged: 

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=464c120036011f2d8e5ce5f33a5d449fa0fefc83

Edit: Removed dependency on bug 2082 because that one is more specific than this and also can be done separately.

Comment 7 Alexandru Palalau 2014-04-16 07:12:35 UTC

Verified on master branch.
Commit ID: ea90bd054c449a8e19c474c8bfa8c289f692c33f