Bug 13150

Summary: Test report contains UNKNOWN status when tests were skipped
Product: [QA/Testing] Runtime Testing Reporter: Ross Burton <ross.burton>
Component: generalAssignee: Armin Kuster <akuster>
Status: CLOSED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: richard.purdie
Version: 2.8   
Target Milestone: 2.6.3   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Ross Burton 2019-01-24 15:53:00 UTC
The python.PythonTest class skips the entire class if python3 isn't present.  However this results in bad output in the JSON test results:

            "python.PythonTest.test_python3": {
                "status": "UNKNOWN"
            }

If a class skips, every test there should be marked a SKIPPED (with the message).
Comment 1 Richard Purdie 2019-05-09 13:48:05 UTC
I tested this and its fine with master. Not sure if its an issue only with say thud or sumo?
Comment 2 Armin Kuster 2019-06-20 15:05:15 UTC
do see this in warrior anymore.
https://autobuilder.yocto.io/pub/non-release/20190615-11/testresults/qemux86-64-ptest/python3.log
Comment 3 Armin Kuster 2019-07-11 15:20:01 UTC
I dont see this in warrior
Comment 4 Armin Kuster 2019-07-11 15:21:16 UTC
not in thud either.
Comment 5 Armin Kuster 2019-07-11 15:21:25 UTC
closing