11012 2017-02-03 15:06:57 +0000 oe-selftest.log is not reporting failures when using xmlrunner 2017-02-21 15:33:52 +0000 1 1 10 QA/Testing Build Testing general 2.2 x86 Multiple VERIFIED FIXED High normal 2.3 M3 1 mariano.lopez benjamin.esquivel benjamin.esquivel jose.perez.carranza --- --- No (bug/feature does not impact docs) oldest_to_newest 70415 0 mariano.lopez 2017-02-03 15:06:57 +0000 If xmlrunner is enabled and a test fails, the log (results-oe-selftest.log) will mark test as PASSED. Steps to reproduce this: 1. Install xmlrunner (unittest-xml-reporting) 2. Checkout poky to 0ce888c4dc76b6e7ec09beb6ad74b85a87a54f7c revision 3. Add meta-selftest to bblayers.conf 4. Run 'oe-selftest -r sstatetests.SStateTests.test_sstate_sametune_samesigs' 5. results-oe-selftest.log will have the test as PASSED even as you saw it FAIL 70419 1 mariano.lopez 2017-02-03 15:26:24 +0000 The revision is incorrect, it should be: f431f766a0c5cd2c4545deff5c56e9918117d325 70420 2 benjamin.esquivel 2017-02-03 15:51:08 +0000 I verified it fails, when oe-selftest writes to the log it writes a mistaken result. 70651 3 benjamin.esquivel 2017-02-13 02:59:34 +0000 review sent, can be seen at: https://patchwork.openembedded.org/patch/137058/ and at: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=besquive/bug-11012 Mariano, would you check it? 70749 4 benjamin.esquivel 2017-02-16 16:13:53 +0000 merged in master: http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=476696030492b09a5985f948e38db8304cadd512 70864 5 jose.perez.carranza 2017-02-21 15:33:52 +0000 Tested in GDC local AB and is working correctly, all the logs generated are consistent.