<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>14852</bug_id>
          
          <creation_ts>2022-07-06 10:18:44 +0000</creation_ts>
          <short_desc>If TEST_SUITES doesn&apos;t contain a valid module, all tests are run</short_desc>
          <delta_ts>2025-08-07 21:09:39 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>oeqa/runtime</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard>newcomer</status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>5.3</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Ross Burton">ross.burton</reporter>
          <assigned_to name="Unassigned">unassigned</assigned_to>
          <cc>mikko.rapeli</cc>
    
    <cc>osama.abdelkader</cc>
    
    <cc>randy.macleod</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>93637</commentid>
    <comment_count>0</comment_count>
    <who name="Ross Burton">ross.burton</who>
    <bug_when>2022-07-06 10:18:44 +0000</bug_when>
    <thetext>If TEST_SUITES is empty (&quot;&quot;), testimage aborts early.  If TEST_SUITES contains a non-existent module (eg &quot;foobar&quot;) then testimage says so.  If TEST_SUITES contains an invalid module name (eg &quot;foo-bar&quot;) then the discovery continues and *all* found test suites are executed.

This is very unexpected.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>95420</commentid>
    <comment_count>1</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2023-04-21 18:45:43 +0000</bug_when>
    <thetext>Moved en masse from 4.2 to 4.3 by Randy.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>101842</commentid>
    <comment_count>2</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2025-05-01 14:07:12 +0000</bug_when>
    <thetext>Bulk move of all unassigned 5.2 medium importance bugs to 5.3.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>102550</commentid>
    <comment_count>3</comment_count>
    <who name="Osama Abdelkader">osama.abdelkader</who>
    <bug_when>2025-08-06 19:12:34 +0000</bug_when>
    <thetext>I tested this on current Poky (5.2.99+snapshot-903710ab5c4ea3c13dd1abf5accdefd27d3a5bdc) and setting TEST_SUITES = &quot;foo-bar&quot; now throws OEQATestNotFound instead of running all tests. The issue seems fixed.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>102570</commentid>
    <comment_count>4</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2025-08-07 21:09:39 +0000</bug_when>
    <thetext>Liklely fixed by one of Mike&apos;s commits:

https://git.openembedded.org/openembedded-core/commit/?id=5c39fedee1dd0e101e2611b71a895c0251ba968d

https://git.openembedded.org/openembedded-core/commit/?id=c66b1dc0a2f973a84dc38b7cc27ae823e0f0a916</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>