Bug 12435 - Update testopia and templates. Remove some TCs and replace duplicates.
Summary: Update testopia and templates. Remove some TCs and replace duplicates.
Status: RESOLVED FIXED
Alias: None
Product: Test Plans/Suite
Classification: QA/Testing
Component: test-plans/suite (show other bugs)
Version: 2.4.2
Hardware: x86 Multiple
: Medium normal
Target Milestone: 2.5 M4
Assignee: yeoh ee peng
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2017-12-19 17:23 UTC by Joshua Lock
Modified: 2018-04-24 03:03 UTC (History)
1 user (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Lock 2017-12-19 17:23:09 UTC
On a Rocko (2.4.x) build we observed the following inconsistencies in Testopia mappings to our automated test suite.

The following cases no longer exist in the test suite, therefore the associated testopia test cases should be removed:

* Test Case : 278 : sanity_unsafe_script_referencesy (auto)
* Test Case : 300 : Enable cleanup of WORKDIR (tmp)
* Test Case : 563 : Check if the directfb image can be built (auto)
* Test Case : 925 : Remove the obsolete images (auto)
* Test Case : 1101 : Check if efi/gummiboot images can be built
* Test Case : 1103 : Check that wic command can create efi/gummiboot installation images
* Test Case : 1349 : wic - test mkgummidisk
* Test Case : 1434 : sanity_unsafe_binary_references 

The following test cases are duplicated and the template should be updated.
* TC 1643 replaced with TC 1540
* TC 1642 replaced with TC 1545
Comment 1 yeoh ee peng 2018-04-24 03:03:22 UTC
Used the new scripts in qa-tools to compared the oeqa automated tests (baseline) to testopia to identify missing testcase in testopia and vice versa. 

Updated testopia selftest template for 2.4 & 2.5 release to add missing testcase(s) and remove outdated testcase(s). 
https://bugzilla.yoctoproject.org/tr_show_run.cgi?run_id=7420