<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>11060</bug_id>
          
          <creation_ts>2017-02-16 19:15:20 +0000</creation_ts>
          <short_desc>selftest: using the xml test output plugin delays the test names in the execution log</short_desc>
          <delta_ts>2019-10-03 08:02:04 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Build Testing</product>
          <component>general</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WONTFIX</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>minor</bug_severity>
          <target_milestone>4.99</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Benjamin Esquivel">benjamin.esquivel</reporter>
          <assigned_to name="Apoorv">apoorv.sangal</assigned_to>
          <cc>benjamin.esquivel</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>sangeeta.jain</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>70764</commentid>
    <comment_count>0</comment_count>
      <attachid>3634</attachid>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2017-02-16 19:15:20 +0000</bug_when>
    <thetext>Created attachment 3634
execution log

Seems like the xml test output plugin (unittest-xml-reporting) is delaying the test names appearing at the execution log (stdout). When a test session is started, you see something like the execution log attachment in this bug.

Then the first name of the test appears when the test is over. This is contrary to the logic and to the plain unittest output plugin (CustomTextTestRunner). 

To reproduce this behavior, just execute the all-tests filter:

$ oe-selftest --run-all-tests

It is worth mentioning that running the command as above it starts always with a test that takes a lot of time to finish. Meaning that with a shorter test (like using a different filter) you also get a faster test name appearing there.

The suggestion is to investigate why/if the unittest-xml-reporting is purposely printing the test name when the test is over instead of when the test begins.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70770</commentid>
    <comment_count>1</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2017-02-16 19:43:37 +0000</bug_when>
    <thetext>I have verified that post-printing of the name is how the unittest-xml-reporting behaves as default.

I will look into changing this behavior.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70773</commentid>
    <comment_count>2</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2017-02-16 19:58:07 +0000</bug_when>
    <thetext>filed an issue with the plugin provider:

https://bugzilla.yoctoproject.org/show_bug.cgi?id=11060</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70775</commentid>
    <comment_count>3</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2017-02-16 20:49:43 +0000</bug_when>
    <thetext>correcting the link above

https://github.com/xmlrunner/unittest-xml-reporting/issues/145</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>74770</commentid>
    <comment_count>4</comment_count>
    <who name="Ross Burton">ross.burton</who>
    <bug_when>2017-07-05 10:52:01 +0000</bug_when>
    <thetext>Waiting For Upstream status is being removed, changing to Accepted.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>76335</commentid>
    <comment_count>5</comment_count>
    <who name="Jose Perez C">jose.perez.carranza</who>
    <bug_when>2017-08-30 15:46:21 +0000</bug_when>
    <thetext>Moved to 2.5 due resources constraint</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>85179</commentid>
    <comment_count>6</comment_count>
    <who name="Sangeeta Jain">sangeeta.jain</who>
    <bug_when>2019-10-03 08:02:04 +0000</bug_when>
    <thetext>With new resulttool used for reporting, this issue no longer required to fix.</thetext>
  </long_desc>
      
          <attachment
              isobsolete="0"
              ispatch="0"
              isprivate="0"
          >
            <attachid>3634</attachid>
            <date>2017-02-16 19:15:20 +0000</date>
            <delta_ts>2017-02-16 19:15:20 +0000</delta_ts>
            <desc>execution log</desc>
            <filename>file_11060.txt</filename>
            <type>text/plain</type>
            <size>3338</size>
            <attacher name="Benjamin Esquivel">benjamin.esquivel</attacher>
            
              <data encoding="base64">bWVAbW9ibDI6YnVpbGQtc2VsZnRlc3RbbWFzdGVyXSQgb2Utc2VsZnRlc3QgLS1ydW4tYWxsLXRl
c3RzDQoyMDE3LTAyLTE2IDEyOjQ4OjM4LDU0NCAtIHNlbGZ0ZXN0IC0gSU5GTyAtIFJ1bm5pbmcg
Yml0YmFrZSAtZSB0byBnZXQgQkJQQVRIDQoyMDE3LTAyLTE2IDEyOjQ4OjM5LDQ0MiAtIHNlbGZ0
ZXN0IC0gSU5GTyAtIENoZWNraW5nIHRoYXQgZXZlcnl0aGluZyBpcyBpbiBvcmRlciBiZWZvcmUg
cnVubmluZyB0aGUgdGVzdHMNCjIwMTctMDItMTYgMTI6NDg6NDAsMzM5IC0gc2VsZnRlc3QgLSBX
QVJOSU5HIC0gbWV0YS1zZWxmdGVzdCBsYXllciBub3QgZm91bmQgaW4gQkJMQVlFUlMsIGFkZGlu
ZyBpdA0KMjAxNy0wMi0xNiAxMjo0ODo0Miw5MzYgLSBzZWxmdGVzdCAtIElORk8gLSBSdW5uaW5n
IGJpdGJha2UgLXANCjIwMTctMDItMTYgMTI6NDk6MTQsNDI3IC0gc2VsZnRlc3QgLSBJTkZPIC0g
TG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LmFyY2hpdmVyDQoyMDE3LTAyLTE2IDEy
OjQ5OjE0LDQzMCAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJvbTogb2VxYS5z
ZWxmdGVzdC5iYmxheWVycw0KMjAxNy0wMi0xNiAxMjo0OToxNCw0MzEgLSBzZWxmdGVzdCAtIElO
Rk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9lcWEuc2VsZnRlc3QuYmJ0ZXN0cw0KMjAxNy0wMi0x
NiAxMjo0OToxNCw0MzUgLSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9l
cWEuc2VsZnRlc3QuYnVpbGRoaXN0b3J5DQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDQzNiAtIHNlbGZ0
ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJvbTogb2VxYS5zZWxmdGVzdC5idWlsZG9wdGlv
bnMNCjIwMTctMDItMTYgMTI6NDk6MTQsNDM4IC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0
ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LmRldnRvb2wNCjIwMTctMDItMTYgMTI6NDk6MTQsNDQw
IC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LmVT
REsNCjIwMTctMDItMTYgMTI6NDk6MTQsNDQ5IC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0
ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LmltYWdlX3R5cGVkZXANCjIwMTctMDItMTYgMTI6NDk6
MTQsNDQ5IC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0
ZXN0LmltYWdlZmVhdHVyZXMNCjIwMTctMDItMTYgMTI6NDk6MTQsNDUxIC0gc2VsZnRlc3QgLSBJ
TkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LmxheWVyYXBwZW5kDQoyMDE3
LTAyLTE2IDEyOjQ5OjE0LDQ1MiAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJv
bTogb2VxYS5zZWxmdGVzdC5saWJvZQ0KMjAxNy0wMi0xNiAxMjo0OToxNCw0NTMgLSBzZWxmdGVz
dCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9lcWEuc2VsZnRlc3QubGljLWNoZWNrc3Vt
DQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDQ1NCAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVz
dHMgZnJvbTogb2VxYS5zZWxmdGVzdC5tYW5pZmVzdA0KMjAxNy0wMi0xNiAxMjo0OToxNCw0NTUg
LSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9lcWEuc2VsZnRlc3Qub2Vz
Y3JpcHRzDQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDQ1NiAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRp
bmcgdGVzdHMgZnJvbTogb2VxYS5zZWxmdGVzdC5wa2dkYXRhDQoyMDE3LTAyLTE2IDEyOjQ5OjE0
LDQ1OSAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJvbTogb2VxYS5zZWxmdGVz
dC5wcnNlcnZpY2UNCjIwMTctMDItMTYgMTI6NDk6MTQsNDYwIC0gc2VsZnRlc3QgLSBJTkZPIC0g
TG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0LnJlY2lwZXRvb2wNCjIwMTctMDItMTYg
MTI6NDk6MTQsNDYyIC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFh
LnNlbGZ0ZXN0LnJ1bnRpbWUtdGVzdA0KMjAxNy0wMi0xNiAxMjo0OToxNCw0NjQgLSBzZWxmdGVz
dCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9lcWEuc2VsZnRlc3Quc2lnbmluZw0KMjAx
Ny0wMi0xNiAxMjo0OToxNCw0NjUgLSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZy
b206IG9lcWEuc2VsZnRlc3Quc3N0YXRlDQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDQ2NSAtIHNlbGZ0
ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJvbTogb2VxYS5zZWxmdGVzdC5zc3RhdGV0ZXN0
cw0KMjAxNy0wMi0xNiAxMjo0OToxNCw0NjcgLSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRl
c3RzIGZyb206IG9lcWEuc2VsZnRlc3QudGluZm9pbA0KMjAxNy0wMi0xNiAxMjo0OToxNCw0OTMg
LSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRlc3RzIGZyb206IG9lcWEuc2VsZnRlc3Qud2lj
DQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDQ5OSAtIHNlbGZ0ZXN0IC0gSU5GTyAtIExvYWRpbmcgdGVz
dHMgZnJvbTogb2VxYS5zZWxmdGVzdC5vZWxpYi5lbGYNCjIwMTctMDItMTYgMTI6NDk6MTQsNTAx
IC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0Lm9l
bGliLmxpY2Vuc2UNCjIwMTctMDItMTYgMTI6NDk6MTQsNTAyIC0gc2VsZnRlc3QgLSBJTkZPIC0g
TG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFhLnNlbGZ0ZXN0Lm9lbGliLnBhdGgNCjIwMTctMDItMTYg
MTI6NDk6MTQsNTAzIC0gc2VsZnRlc3QgLSBJTkZPIC0gTG9hZGluZyB0ZXN0cyBmcm9tOiBvZXFh
LnNlbGZ0ZXN0Lm9lbGliLnR5cGVzDQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDUwNCAtIHNlbGZ0ZXN0
IC0gSU5GTyAtIExvYWRpbmcgdGVzdHMgZnJvbTogb2VxYS5zZWxmdGVzdC5vZWxpYi51dGlscw0K
MjAxNy0wMi0xNiAxMjo0OToxNCw1MDUgLSBzZWxmdGVzdCAtIElORk8gLSBMb2FkaW5nIHRlc3Rz
IGZyb206IG9lcWEuc2VsZnRlc3Quc3lzdGVtZF9ib290DQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDUw
NiAtIHNlbGZ0ZXN0IC0gSU5GTyAtIEFkZGluZzogImluY2x1ZGUgc2VsZnRlc3QuaW5jIiBpbiBs
b2NhbC5jb25mDQoyMDE3LTAyLTE2IDEyOjQ5OjE0LDUwNyAtIHNlbGZ0ZXN0IC0gSU5GTyAtIEFk
ZGluZzogImluY2x1ZGUgYmJsYXllcnMuaW5jIiBpbiBiYmxheWVycy5jb25mDQoNClJ1bm5pbmcg
dGVzdHMuLi4NCi0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0NCjxBdCB0aGlzIHBvaW50IGl0IHRha2VzIGxvbmcgdGlt
ZSB0byBzaG93IHRoZSBmaXJzdCB0ZXN0J3MgbmFtZT4=
</data>

          </attachment>
      

    </bug>

</bugzilla>