Bug 11060

Summary: selftest: using the xml test output plugin delays the test names in the execution log
Product: [QA/Testing] Build Testing Reporter: Benjamin Esquivel <benjamin.esquivel>
Component: generalAssignee: Apoorv <apoorv.sangal>
Status: RESOLVED WONTFIX QA Contact:
Severity: minor    
Priority: Medium CC: benjamin.esquivel, jose.perez.carranza, sangeeta.jain
Version: unspecified   
Target Milestone: 4.99   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
execution log none

Description Benjamin Esquivel 2017-02-16 19:15:20 UTC
Created attachment 3634 [details]
execution log

Seems like the xml test output plugin (unittest-xml-reporting) is delaying the test names appearing at the execution log (stdout). When a test session is started, you see something like the execution log attachment in this bug.

Then the first name of the test appears when the test is over. This is contrary to the logic and to the plain unittest output plugin (CustomTextTestRunner). 

To reproduce this behavior, just execute the all-tests filter:

$ oe-selftest --run-all-tests

It is worth mentioning that running the command as above it starts always with a test that takes a lot of time to finish. Meaning that with a shorter test (like using a different filter) you also get a faster test name appearing there.

The suggestion is to investigate why/if the unittest-xml-reporting is purposely printing the test name when the test is over instead of when the test begins.
Comment 1 Benjamin Esquivel 2017-02-16 19:43:37 UTC
I have verified that post-printing of the name is how the unittest-xml-reporting behaves as default.

I will look into changing this behavior.
Comment 2 Benjamin Esquivel 2017-02-16 19:58:07 UTC
filed an issue with the plugin provider:

https://bugzilla.yoctoproject.org/show_bug.cgi?id=11060
Comment 3 Benjamin Esquivel 2017-02-16 20:49:43 UTC
correcting the link above

https://github.com/xmlrunner/unittest-xml-reporting/issues/145
Comment 4 Ross Burton 2017-07-05 10:52:01 UTC
Waiting For Upstream status is being removed, changing to Accepted.
Comment 5 Jose Perez C 2017-08-30 15:46:21 UTC
Moved to 2.5 due resources constraint
Comment 6 Sangeeta Jain 2019-10-03 08:02:04 UTC
With new resulttool used for reporting, this issue no longer required to fix.