8750 2015-12-02 14:33:09 +0000 Allow oe-selftest to run custom test suites based on different criteria 2016-02-16 10:45:00 +0000 1 1 10 QA/Testing Build Testing general 2.0 x86 Multiple VERIFIED FIXED Medium+ enhancement 2.1 M1 8647 1 daniel.alexandrux.istrate daniel.alexandrux.istrate alexandru.c.georgescu bluelightning bogdanx.a.voiculescu richard.purdie ross.burton bogdanx.a.voiculescu --- New (Never tested) Yes (doc changes required) oldest_to_newest 56941 0 daniel.alexandrux.istrate 2015-12-02 14:33:09 +0000 oe-selftest should be able to run custom test suites based on different criteria like: id (test case id (@testcase)), name (test case name), class, module and tag (@tag(feature=(feature list))). eg: oe-selftest --run-tests-by tag wic bitake recipetool pr-service oe-selftest --run-tests-by name test_x test_y test_z oe-selftest --run-tests-by id 1001 1002 185 1902 oe-selftest --run-tests-by class Signing ImageFeatures oe-selftest --run-tests-by module wic signing 56942 1 daniel.alexandrux.istrate 2015-12-02 14:43:02 +0000 Patch sent to ML: http://lists.openembedded.org/pipermail/openembedded-core/2015-December/113637.html This patch covers: 1. Can run custom lists of tests based on different criteria: --run-tests-by <name|class|module|id|tag> <list of tests|classes|modules|ids|tags> eg: --run-tests-by module imagefeatures signing recipetool --run-tests-by id 1377 1273 935 --run-tests-by tag wic sstate bitbake 2. Can list tests based on different criteria: --list-tests-by <name|class|module|id|tag> <list of tests|classes|modules|ids|tags> eg: --list-tests-by module imagefeatures signing recipetool --list-tests-by id 1377 1273 935 --list-tests-by tag wic sstate bitbake 3. Can list all tags that have been set to test cases: --list-tags The list of tags should be kept as minimal as possible. This helps preview the tags used so far. To take advantage of the 'tag' feature: - add @tag(feature=<>) to testcases eg: @tag(feature='signing') for a single tag @tag(feature=(('signing', 'sstate')) or @tag(feature=['signing', 'sstate']) for multiple tags 57065 2 alexandru.c.georgescu 2015-12-07 08:12:46 +0000 Moved to M1 since Daniel already submitted a patch for it in M1. 57067 3 alexandru.c.georgescu 2015-12-07 08:13:41 +0000 Patches submitted. 57235 4 daniel.alexandrux.istrate 2015-12-14 07:28:25 +0000 As of b3d6872bf169a13e572638e3809c50a868246616: patch merged into master. 59087 5 alexandru.c.georgescu 2016-02-16 10:45:00 +0000 Verified with m2.rc1