<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>9080</bug_id>
          
          <creation_ts>2016-02-09 10:16:57 +0000</creation_ts>
          <short_desc>Autobuilder/oe-selftest: Have a way to specify a which oe-self tests get run on a forced AB job</short_desc>
          <delta_ts>2021-12-23 15:51:11 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>5</classification_id>
          <classification>Infrastructure</classification>
          <product>AutoBuilder</product>
          <component>autobuilder</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WONTFIX</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>Future</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Benjamin Esquivel">benjamin.esquivel</reporter>
          <assigned_to name="Unassigned">unassigned</assigned_to>
          <cc>akuster</cc>
    
    <cc>alexandru.c.georgescu</cc>
    
    <cc>anibal.limon</cc>
    
    <cc>benjamin.esquivel</cc>
    
    <cc>brianbrowns123</cc>
    
    <cc>elizabeth.flanagan</cc>
    
    <cc>infras.ab.watcher</cc>
    
    <cc>Infras.watcher</cc>
    
    <cc>jhonmerced5</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>joshuagloe</cc>
    
    <cc>leonardo.sandoval.gonzalez</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>richard.purdie</cc>
          
          <qa_contact name="Apoorv">apoorv.sangal</qa_contact>
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>58778</commentid>
    <comment_count>0</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-02-09 10:16:57 +0000</bug_when>
    <thetext>Currently, you have no easy way of running a specified set of oe-selftest at a forced build of the autobuilder. So you have to wait hours to see on-demand tests.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58902</commentid>
    <comment_count>1</comment_count>
    <who name="Beth Flanagan">elizabeth.flanagan</who>
    <bug_when>2016-02-11 16:07:43 +0000</bug_when>
    <thetext>What are you trying to accomplish here? 

If you want to do a subset of the tests, if you can give me a list of those subsets (and the default) we can do a select box for them. We do not allow generally a field where you can just input &lt;image&gt; and bitbake will run it (there are security concerns in doing so).</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58906</commentid>
    <comment_count>2</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-02-11 16:20:27 +0000</bug_when>
    <thetext>What you describe is fine, a way of selecting one or more tests to be run (test granularity is better, could be grouped by modules). The tests might come as a dynamic list that you need to read for each of the builds you want to run into (listing via oe-selftest --list-tests or something along the params)

A feature like this would make on-demand builds to be way faster than the added 3 to 5 hours oe-selftest imposes.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58910</commentid>
    <comment_count>3</comment_count>
    <who name="Beth Flanagan">elizabeth.flanagan</who>
    <bug_when>2016-02-11 16:38:30 +0000</bug_when>
    <thetext>Well, it can&apos;t really be done as a dynamic list as the autobuilder has no knowledge as to what is in the codebase until Force Build is pressed and by that time, it&apos;s too late to tell it what to run.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58911</commentid>
    <comment_count>4</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-02-11 16:44:18 +0000</bug_when>
    <thetext>Okay, understand that now. We could try to write a static list of tests now and it would still be useful in most of the cases.

Though, the ideal would be that you can select what&apos;s available.

Do you think we could achieve that at some point?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58913</commentid>
    <comment_count>5</comment_count>
    <who name="Beth Flanagan">elizabeth.flanagan</who>
    <bug_when>2016-02-11 16:49:23 +0000</bug_when>
    <thetext>Probably not in the way you want it. I could make it so that we keep a matrix of branch/tests in the autobuilder code base, but that wouldn&apos;t be particularly useful I don&apos;t think.

One way we could maybe do it is have an abstracted out set of tests that are static on the autobuilder, but change within oe?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>58920</commentid>
    <comment_count>6</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-02-11 19:09:11 +0000</bug_when>
    <thetext>That would be a good first approach at least, how would we specify the tests to run perhaps is the first question.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>62455</commentid>
    <comment_count>7</comment_count>
    <who name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</who>
    <bug_when>2016-05-25 20:44:48 +0000</bug_when>
    <thetext>Due to limited resources, moving this to 2.3</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70120</commentid>
    <comment_count>8</comment_count>
    <who name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</who>
    <bug_when>2017-01-25 16:32:51 +0000</bug_when>
    <thetext>Anibal, any further done on this area during M2?

M2 is over so moving to M3.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>72730</commentid>
    <comment_count>9</comment_count>
    <who name="Aníbal Limón">anibal.limon</who>
    <bug_when>2017-04-20 15:16:27 +0000</bug_when>
    <thetext>Moving to 2.4 because is an enhancement.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>78174</commentid>
    <comment_count>10</comment_count>
    <who name="Jhon Merced">jhonmerced5</who>
    <bug_when>2017-11-13 14:50:58 +0000</bug_when>
    <thetext>Neverending moving? ;) Hope to see it implemented soon.
https://www.premiumlinkgenerator.com</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>79075</commentid>
    <comment_count>11</comment_count>
    <who name="brianbrowns">brianbrowns123</who>
    <bug_when>2018-01-15 16:21:53 +0000</bug_when>
    <thetext>Hi guys, what&apos;s the status here? I&apos;m waiting too. https://promocode.com.ph/</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>85968</commentid>
    <comment_count>12</comment_count>
    <who name="Armin Kuster">akuster</who>
    <bug_when>2019-12-23 16:37:53 +0000</bug_when>
    <thetext>With the new AB, is this still an issue?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>92211</commentid>
    <comment_count>13</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2021-12-23 15:51:11 +0000</bug_when>
    <thetext>Complicated to add to AB and we don&apos;t really see the need.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>