| Summary: | [QA] Optimize test case for better use of time and resources | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [QA/Testing] Test Plans/Suite | Reporter: | Stoicescu Cornel <corneliux.stoicescu> | ||||
| Component: | test-plans/suite | Assignee: | Ionut Chisanovici <ionutx.chisanovici> | ||||
| Status: | VERIFIED FIXED | QA Contact: | |||||
| Severity: | enhancement | ||||||
| Priority: | Medium | CC: | alexandru.c.georgescu, corneliux.stoicescu, ionutx.chisanovici, jessica.zhang | ||||
| Version: | 1.6 | ||||||
| Target Milestone: | 1.6 | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | |||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |||||
| Attachments: |
|
||||||
|
Description
Stoicescu Cornel
2013-10-11 09:33:38 UTC
Started work on feature. The modifications are done. I have sent them to QA team for review. Affected test components: bitbake, oe-core, meta-yocto, HOB. The optimizations made consist of changing the build target for the test case. Also in some cases I had to modify the steps a little bit in order to accomodate the new targets (like replacing "1. build core-image-sato" with "1. add ssh-server-openssh to EXTRA_IMAGE_FEATURES in local.conf; 2. build core-image-minimal"). Except for HOB, I re-run all modified test cases in order to assure results integrity. For HOB, the changes made are not that complex and the result is theoretically the same. The new build targets have been chosen as follow: * m4-native - build time: 1 min - chosen as the fastest build-able recipe/target - used in test cases that don't require a rpm/deb/ipk output package * xcursor-transparent-theme - build time: 8 min - chosen as the fastest build-able recipe/target that has a rpm/deb/ipk package output - is architecture-independent * m4 -build time: 17 min - chosen as the fastest build-able recipe/target that has a pm/deb/ipk package output and is architecture-dependent * core-image-minimal - build time: 40 min - chosen as the fastest build-able image type - in tests that require booting I added the 'ssh-server-openssh" image feature to facilitate automated runtime testing * core-image-basic - build time: 53 min - takes longer to build than core-image-minimal; has more packages included - contains open-ssh by default - used in tests that require removing packages from the base image or additional package functionality (syslogd) * core-image-sato - build time: 80 min - smallest image that contains an x server and a desktop environment - used in tests that have graphical requirements (ex: emgd-driver-bin) * core-image-sato-sdk - build time: 148 min - I did not use this image in my optimizations - this image is still used in some unmodified test cases that require its -sdk functionality There are a few other chosen build targets for the special context of the test case. After I correct any issues signaled by my team upon review I will set this to RESOLVED. Created attachment 1583 [details]
Optimizations table
Here is the optimizations table.
The changes are made and review complete. Hi Ionut, Please verify this! Till now the oe-core weekly TC's were verified and they are ok. We still need to verify the full pass TC's for oe-core and bsp's but this will be done in the next full pass run. Ionut C All the test cases were verified. The spent time on a full pass has decreased considerable. Cheers, Ionut C |