Bug 8499

Summary:	Add specific WIC tests
Product:	[QA/Testing] Runtime Testing	Reporter:	Alexandru Georgescu <alexandru.c.georgescu>
Component:	general	Assignee:	Daniel Istrate <daniel.alexandrux.istrate>
Status:	RESOLVED FIXED	QA Contact:	Costin <costin.c.constantin>
Severity:	enhancement
Priority:	Medium	CC:	bluelightning, eduard.bartosh
Version:	2.1
Target Milestone:	2.1 M3
Hardware:	x86
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	Yes (doc changes required)
Bug Depends on:	8498, 8691
Bug Blocks:

Description Alexandru Georgescu 2015-10-13 07:24:41 UTC

Add new test suite for WIC tool. Example of tests that can be added:

- Build a custom wic image (by changing the wks); Load that image in qemu; Test that the changes made took effect.

- In the wks file configure multiple partitions, boot the image with qemu and test that the partitions were created, that are mounted, can written/read, etc (oe-selftest)

Comment 1 Daniel Istrate 2015-11-10 12:20:54 UTC

These would be oe-selftest testcases what would also run the created image in Qemu. The tests that can be run on the loaded image in Qemu can be specific to the change made when building the image, or a generic test like TestImage to test the overall integrity of the build.

At the moment QemuRunner fails to start the wic created image because:
- When qemu boots with a disk (like one generated by wic) the kernel parameters are no longer accepted by qemu. One of these parameters is the IP address that QemuRunner requires.
- A solution regarding this issue hasn’t been addressed in detail, and requires major changes to the mechanism that handles the qemu machines connectivity and correlation to the running tests (oe-selftest).

Comment 2 Ed Bartosh 2015-11-13 09:44:57 UTC

Would it make sense to create a bug for mentioned QemuRunner issue?

Comment 3 Cristian Iorga 2015-12-02 07:50:14 UTC

Blocking issues added.

Comment 4 Ed Bartosh 2016-02-02 09:40:31 UTC

Added one testcase: http://lists.openembedded.org/pipermail/openembedded-core/2016-February/116637.html

Comment 5 Ed Bartosh 2016-03-31 15:32:44 UTC

just discussed this on bug Triage meeting and decided to close it as adding more tests can slow down AB. It would make sense to test the rest of canned immages when it's possible to run them in parallel. For now we're happy with one we have.