| Summary: | ptest comparison script is not showing correct results | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [QA/Testing] Test Plans/Suite | Reporter: | Libertad <libertad.gonzalez.de.la.cruz> | ||||
| Component: | test-plans/suite | Assignee: | Sudhir Sharma <sharmasudhir> | ||||
| Status: | RESOLVED FIXED | QA Contact: | yeoh ee peng <ee.peng.yeoh> | ||||
| Severity: | critical | ||||||
| Priority: | Medium+ | CC: | richard.purdie, sharmasudhir | ||||
| Version: | 2.3.3 | ||||||
| Target Milestone: | 2.7 M2 | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | |||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | Don't know | |||||
| Attachments: |
|
||||||
|
Description
Libertad
2017-12-21 02:47:30 UTC
Created attachment 4180 [details]
ptest_2.3.3.rc1_compared_2.3.2.rc1
Executed the ptest_parser.py, could not reproduce the issue. Attached the ptest result that show the python result is working as expected. ptest comparison script is not showing correct results. For QA 2.7 M1 rc1, the ptest summary from ptest.log (https://wiki.yoctoproject.org/wiki/Ptest_fe43e599327f26b399c1883205e988236a5e51bd) show: === Test Summary === TOTAL: 579 PASSED: 316 FAILED: 251 SKIPPED: 12 END: /usr/lib/valgrind/ptest But the qa-tools/scripts/ptest-parser.py show: TOTAL (Test Ran): 567 PASSED: 304 Need to fix this an rerun ptest comparison script. QA team was working on this. Fixed developed by Sudhir and patch pushed to qa-tools http://git.yoctoproject.org/cgit/cgit.cgi/qa-tools/commit/?id=e1a81ebc332014b71a680df2742bf950ce542295 |