Bug 11645

Summary: oe-selftest: Invalid tests specified on the commandline don't fail
Product: [QA/Testing] Build Testing Reporter: Richard Purdie <richard.purdie>
Component: generalAssignee: Aníbal Limón <anibal.limon>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: patrick.ohly
Version: unspecified   
Target Milestone: 2.4 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Richard Purdie 2017-06-12 09:34:29 UTC 
$ oe-selftest -r test_sstate_allarch_samesigs
2017-06-12 10:31:07,775 - oe-selftest - INFO - Adding layer libraries:
2017-06-12 10:31:07,775 - oe-selftest - INFO - 	/media/build1/poky/meta/lib
2017-06-12 10:31:07,775 - oe-selftest - INFO - 	/media/build1/poky/meta-yocto-bsp/lib
2017-06-12 10:31:07,775 - oe-selftest - INFO - 	/media/build1/poky/meta-selftest/lib
2017-06-12 10:31:07,776 - oe-selftest - INFO - Running bitbake -p
2017-06-12 10:31:47,284 - oe-selftest - INFO - 
2017-06-12 10:31:47,284 - oe-selftest - INFO - Running tests...
2017-06-12 10:31:47,285 - oe-selftest - INFO - ----------------------------------------------------------------------
2017-06-12 10:31:47,285 - oe-selftest - INFO - 
2017-06-12 10:31:47,285 - oe-selftest - INFO - ----------------------------------------------------------------------
2017-06-12 10:31:47,285 - oe-selftest - INFO - Ran 0 tests in 0.000s
2017-06-12 10:31:47,285 - oe-selftest - INFO - 
2017-06-12 10:31:47,285 - oe-selftest - INFO - OK
2017-06-12 10:31:47,285 - oe-selftest - INFO - 
2017-06-12 10:31:47,286 - oe-selftest - INFO - Generating XML reports...
2017-06-12 10:31:47,290 - oe-selftest - INFO - RESULTS:
2017-06-12 10:31:47,290 - oe-selftest - INFO - SUMMARY:
2017-06-12 10:31:47,290 - oe-selftest - INFO - oe-selftest () - Ran 0 tests in 0.006s
2017-06-12 10:31:47,291 - oe-selftest - INFO - oe-selftest - OK - All required tests passed

No mention of the invalid test name...
Comment 1 Patrick Ohly 2017-07-10 15:39:49 UTC 
See also bug #11756, which is about another problem with the new test runner.