| Summary: | Create/merge results aggregation and analysis tool | ||
|---|---|---|---|
| Product: | [QA/Testing] Test Plans/Suite | Reporter: | Armin Kuster <akuster> |
| Component: | test-plans/suite | Assignee: | Apoorv <apoorv.sangal> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | enhancement | ||
| Priority: | Medium+ | CC: | bluelightning, ee.peng.yeoh, richard.purdie |
| Version: | 2.7 | ||
| Target Milestone: | 2.7 M3 | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | |||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | Yes (doc changes required) | |
| Bug Depends on: | 12654 | ||
| Bug Blocks: | 13013 | ||
|
Description
Armin Kuster
2018-11-11 19:39:20 UTC
Any high level requirement(s) for this enhancements? Thank you very much! OEQA output test results into json files and these files were archived by Autobuilder during QA releases. To manage multiple test results files and perform analysis, need a helper scripts to enable merged multiple test results and perform regression analysis. Completed developed the "merge" and "regression analysis" functionalities. http://lists.openembedded.org/pipermail/openembedded-core/2019-January/278238.html Testopia main roles was to store test result and provide data for the test summary report. The resultstool scripts were developed to provide the "store" (storing test results into git repository) and "report" (test summary report). Patches submitted to enable "store" and "report" that will replace testopia. http://lists.openembedded.org/pipermail/openembedded-core/2019-January/278487.html Developed the results merge and regression for files, directories & git repository branches. Patch submitted. http://lists.openembedded.org/pipermail/openembedded-core/2019-January/278487.html Enhanced the regression for file/directory/git and improve performance for ptest regression. http://lists.openembedded.org/pipermail/openembedded-core/2019-February/278972.html The resulttool code merged into master. |