| Summary: | oeqa runner generate wrong test results in log file when running dynamic test cases | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [QA/Testing] Runtime Testing | Reporter: | dawei <daweix.wu> | ||||
| Component: | general | Assignee: | Unassigned <unassigned> | ||||
| Status: | RESOLVED OBSOLETE | QA Contact: | |||||
| Severity: | enhancement | ||||||
| Priority: | Medium | CC: | jose.perez.carranza, joshuagloe, patrick.ohly, randy.macleod, sgw | ||||
| Version: | 2.4 | ||||||
| Target Milestone: | Future | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | |||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | Don't know | |||||
| Attachments: |
|
||||||
From Zhang,Junhui: there is a workaround in line 19 , if comment it out , this issue is not reproduced. You can see more explanation there. Mariano, can you replicate this test? In the test cases attached it creates dynamically the class and the for every new class it creates a TextTestResult, so this can lead to the behaviour observed. OE doesn't use/require dynamic generated test. For us , we need this function to generate logs for this case: One oe runner static *Total* case includes many real cases , so to the runner, it just only generate one result for those many real cases in the log file, which doesn't reflect the real results. Moving to 2.5, due to limited resources. Returning version to 2.4. Much of the oeqa code has been rewritten since this issue was filed, need to test whether the issue is still present. If this problem shows up again, reopen. |
Created attachment 3333 [details] Test case Details: The results is correct printed on screen but not correct in log file Step: Use yocto oeqa runner to run the attach test cases *Expected Results:* See pass/fail/skip/error 4 results in log file *Actual Results:* All passed in log file