Bug 11246 - QA: Validate Reference kit supports image installer
Summary: QA: Validate Reference kit supports image installer
Status: RESOLVED OBSOLETE
Alias: None
Product: IoT Reference OS Kit Testing
Classification: QA/Testing
Component: intel-iot-refkit-automated-build-testing (show other bugs)
Version: 2.4
Hardware: x86 Multiple
: Medium enhancement
Target Milestone: 2.4 M1
Assignee: Jair Gonzalez
QA Contact: yeoh ee peng
URL:
Whiteboard:
Depends on: 11071
Blocks:
  Show dependency tree
 
Reported: 2017-03-24 18:45 UTC by Jair Gonzalez
Modified: 2017-06-12 19:14 UTC (History)
1 user (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Jair Gonzalez 2017-03-24 18:45:33 UTC
Add test suite to validate Reference kit supports image installer functionality, which consists in booting a device once from an external media (like a USB stick) and interactively or automatically installing the actual device operating system to internal media.

For this milestone, only interactive usage will be supported by a new "refkit-installer-image".
Comment 1 Patrick Ohly 2017-03-31 10:28:27 UTC
We need two kinds of tests: a) enough tests to merge the feature and b) additional feature that can be added later as time permits (open ended).

We agreed to treat this QA work items as a), i.e. they block the feature completion.

I don't know how QA wants to track part b). Filing issues is not particularly useful because of the open scope.

At this point, https://github.com/intel/intel-iot-refkit/pull/97 has one test which covers this functionality, which I consider good enough to close this issue once the PR is merged.
Comment 2 Sonia Delgado 2017-04-03 20:54:38 UTC
Patrick, 
what is the coverage for the test case included in the PR??, what are the additional features planned for later, We cannot have any kind of tracker If we do not know the features that will be integrated or are planned
Comment 3 Patrick Ohly 2017-04-04 07:44:28 UTC
(In reply to comment #2)
> what is the coverage for the test case included in the PR??

Using which metric?

Informally speaking, it is fairly basic: just one test case for the main functionality, no variations. Please have a look at the PR if you want to know details.

> what are the
> additional features planned for later.

None planned at the moment.
Comment 4 Jair Gonzalez 2017-04-17 21:20:35 UTC
After an agreement with the Refkit team, the progress on the minimal required sanity tests to release a feature will be tracked on the same bug issue used to track the feature's development. Analogous QA bugs like this one may be created if required, and will be used to track the development of more extensive test cases.

According to this, the dependence will be inverted in relation to the feature bug.
Comment 5 Jair Gonzalez 2017-06-12 19:14:11 UTC
Closed in agreement with the previous comments from Patrick. The image installer feature already has three test cases to validate basic installation scenarios. Tests are currently located on https://github.com/intel/intel-iot-refkit/blob/master/meta-refkit-core/lib/oeqa/selftest/image-installer.py
As stated by Patrick, QA still needs to determine the best way to track the development of additional tests that may be added later.