Bug 11246

Summary: QA: Validate Reference kit supports image installer
Product: [QA/Testing] IoT Reference OS Kit Testing Reporter: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia>
Component: intel-iot-refkit-automated-build-testingAssignee: Jair Gonzalez <jair.de.jesus.gonzalez.plascencia>
Status: RESOLVED OBSOLETE QA Contact: yeoh ee peng <ee.peng.yeoh>
Severity: enhancement    
Priority: Medium CC: patrick.ohly
Version: 2.4   
Target Milestone: 2.4 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on: 11071    
Bug Blocks:    

Description Jair Gonzalez 2017-03-24 18:45:33 UTC
Add test suite to validate Reference kit supports image installer functionality, which consists in booting a device once from an external media (like a USB stick) and interactively or automatically installing the actual device operating system to internal media.

For this milestone, only interactive usage will be supported by a new "refkit-installer-image".
Comment 1 Patrick Ohly 2017-03-31 10:28:27 UTC
We need two kinds of tests: a) enough tests to merge the feature and b) additional feature that can be added later as time permits (open ended).

We agreed to treat this QA work items as a), i.e. they block the feature completion.

I don't know how QA wants to track part b). Filing issues is not particularly useful because of the open scope.

At this point, https://github.com/intel/intel-iot-refkit/pull/97 has one test which covers this functionality, which I consider good enough to close this issue once the PR is merged.
Comment 2 Sonia Delgado 2017-04-03 20:54:38 UTC
Patrick, 
what is the coverage for the test case included in the PR??, what are the additional features planned for later, We cannot have any kind of tracker If we do not know the features that will be integrated or are planned
Comment 3 Patrick Ohly 2017-04-04 07:44:28 UTC
(In reply to comment #2)
> what is the coverage for the test case included in the PR??

Using which metric?

Informally speaking, it is fairly basic: just one test case for the main functionality, no variations. Please have a look at the PR if you want to know details.

> what are the
> additional features planned for later.

None planned at the moment.
Comment 4 Jair Gonzalez 2017-04-17 21:20:35 UTC
After an agreement with the Refkit team, the progress on the minimal required sanity tests to release a feature will be tracked on the same bug issue used to track the feature's development. Analogous QA bugs like this one may be created if required, and will be used to track the development of more extensive test cases.

According to this, the dependence will be inverted in relation to the feature bug.
Comment 5 Jair Gonzalez 2017-06-12 19:14:11 UTC
Closed in agreement with the previous comments from Patrick. The image installer feature already has three test cases to validate basic installation scenarios. Tests are currently located on https://github.com/intel/intel-iot-refkit/blob/master/meta-refkit-core/lib/oeqa/selftest/image-installer.py
As stated by Patrick, QA still needs to determine the best way to track the development of additional tests that may be added later.