Bug 3979

Summary: Multiple test plans should be added into a single Test Run.
Product: [QA/Testing] Test Plans/Suite Reporter: S <ssoomro>
Component: test-plans/suiteAssignee: Laurentiu Serban <laurentiu.serban>
Status: VERIFIED FIXED QA Contact:
Severity: enhancement    
Priority: Medium CC: corneliux.stoicescu, jessica.zhang
Version: unspecified   
Target Milestone: 1.5   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: ---

Description S 2013-03-04 17:41:03 UTC
Mostly test plans have difference classifications and categories. Testing teams in the Software companies having a problem to add multiple test plans in a single test run. Every time user is creating multiple test runs.

Management need only one test run, which included all types of test plans and test cases.
Comment 1 Stoicescu Cornel 2013-03-25 15:33:31 UTC
Hello,

I assume you are referring to Testopia. Here are some issues with this:

1) Because Bugzilla and testopia are integrated, Bugzilla would also need to have only 1 product bug classification. That would make it difficult to automatically assign bugs to product stakeholders.

2) Leaving Bugzilla as it is and using only 1 product, only 1 test plan, only 1 test run for all test cases would make the integration with Bugzilla useless as they would work independently.
(The main advantage of Testopia is having complete integration with Buzilla. This might not seem very usefull at the moment, but we are working towards a fully integrated QA system that will greatly benefit from this integration)

3) Testopia does not support multiple test plans in a single test run. A test run can contain test cases from only 1 test plan. This a basic functionality feature and changing it would require a lot of testing and expertise. Other than that, we would deviate from the mainstream version of Testopia and upgrading to future versions would be close to impossible.

We do have a solution for the management part though: The Testopia extension for Mediawiki.
This extension can generate reports from Testopia in a management-friendly format that does not require experience in using Testopia in order to get information from. We are allready using this extension in order to generate reports for our Weekly and Full Pass tests. Here are some pages that use this extension:
https://wiki.yoctoproject.org/wiki/Full_Pass_Test_Report_for_Yocto_1.4_M4_RC1_201302202_Build
https://wiki.yoctoproject.org/wiki/Yocto_1.4_Milestone_Test_Report#Yocto_1.4_M4_RC1_Build_Test_Report

Please note that this extension was changed quite heavily in order to suit the Yocto Project's needs so any documentation you can find on the net might not be usefull. I will make a wiki page some time in the future; until then please re-use the code from the existing ones.

Here is the repository for our production version of the extension:
https://github.com/halstead/testopiareports

Here are our wiki pages for Testopia:
https://wiki.yoctoproject.org/wiki/Testopia
https://wiki.yoctoproject.org/wiki/Testopia_HOWTO

If you need more info, please reply here. If my answer does not satisfy you, please reopen the bug.
Comment 2 Stoicescu Cornel 2013-05-24 12:10:46 UTC
This is Verified.