<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>12604</bug_id>
          
          <creation_ts>2018-03-14 11:16:01 +0000</creation_ts>
          <short_desc>Default ptest-runner invocation on multilib may not execute any test suites</short_desc>
          <delta_ts>2020-05-04 12:07:08 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Runtime Testing</product>
          <component>general</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>normal</bug_severity>
          <target_milestone>3.2 M1</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Kyle Russell">bkylerussell</reporter>
          <assigned_to name="Aníbal Limón">anibal</assigned_to>
          <cc>ndec13</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>ross.burton</cc>
    
    <cc>stephano</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>79813</commentid>
    <comment_count>0</comment_count>
    <who name="Kyle Russell">bkylerussell</who>
    <bug_when>2018-03-14 11:16:01 +0000</bug_when>
    <thetext>ptest.bbclass will package ptest scripts in ${libdir}, which may include /usr/lib64 in some multilib configurations.  However, ptest-runner is hard-coded to look at /usr/lib by default, requiring an extra -d /usr/lib64 to execute the default ptest-packaged test suites in these multilib configurations.  This means any automated infrastructure that wants to invoke ptest-runner must be aware of the target architecture to instruct ptest-runner where to find test cases installed by the default arch-dependent ptest packages.  Instead, it would be preferable for ptest-runner to find the default ptest-packaged test suites independent of the arch.

I posted a naive fix to the mailing list to handle the default /usr/lib64 case, though I realize it doesn&apos;t allow support for actual multilib test suites (e.g. lib32-libfoo-ptest).

https://lists.yoctoproject.org/pipermail/yocto/2018-February/039997.html

Ross proposed fixing this in ptest-runner instead, but making ptest-runner&apos;s DEFAULT_DIRECTORY defined by ${libdir} still doesn&apos;t allow ptest-runner to automatically find multilib suites (e.g. lib32-libfoo-ptest) in a /usr/lib64 configuration.

It seemed to me that there were more comprehensive approaches that could be taken to handle multilib setups (https://lists.yoctoproject.org/pipermail/yocto/2018-February/040011.html), so if we can converge on a solution here I&apos;ll be glad to workup and test out some new patches.  (Or I can just move the naive approach to ptest-runner.)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>86717</commentid>
    <comment_count>1</comment_count>
    <who name="Aníbal Limón">anibal</who>
    <bug_when>2020-03-12 16:55:33 +0000</bug_when>
    <thetext>(In reply to comment #0)
&gt; ptest.bbclass will package ptest scripts in ${libdir}, which may include
&gt; /usr/lib64 in some multilib configurations.  However, ptest-runner is
&gt; hard-coded to look at /usr/lib by default, requiring an extra -d /usr/lib64
&gt; to execute the default ptest-packaged test suites in these multilib
&gt; configurations.  This means any automated infrastructure that wants to
&gt; invoke ptest-runner must be aware of the target architecture to instruct
&gt; ptest-runner where to find test cases installed by the default
&gt; arch-dependent ptest packages.  Instead, it would be preferable for
&gt; ptest-runner to find the default ptest-packaged test suites independent of
&gt; the arch.
&gt; 
&gt; I posted a naive fix to the mailing list to handle the default /usr/lib64
&gt; case, though I realize it doesn&apos;t allow support for actual multilib test
&gt; suites (e.g. lib32-libfoo-ptest).
&gt; 
&gt; https://lists.yoctoproject.org/pipermail/yocto/2018-February/039997.html
&gt; 
&gt; Ross proposed fixing this in ptest-runner instead, but making ptest-runner&apos;s
&gt; DEFAULT_DIRECTORY defined by ${libdir} still doesn&apos;t allow ptest-runner to
&gt; automatically find multilib suites (e.g. lib32-libfoo-ptest) in a /usr/lib64
&gt; configuration.
&gt; 
&gt; It seemed to me that there were more comprehensive approaches that could be
&gt; taken to handle multilib setups
&gt; (https://lists.yoctoproject.org/pipermail/yocto/2018-February/040011.html),
&gt; so if we can converge on a solution here I&apos;ll be glad to workup and test out
&gt; some new patches.  (Or I can just move the naive approach to ptest-runner.)

My proposal is to add ptest-runner the ability to specify more than one directory in this case ptest.bbclass can setup multilib libdirs + default libdir.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>86978</commentid>
    <comment_count>2</comment_count>
    <who name="Aníbal Limón">anibal</who>
    <bug_when>2020-04-10 15:15:04 +0000</bug_when>
    <thetext>Review at,

https://lists.yoctoproject.org/g/yocto/message/49115</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>87097</commentid>
    <comment_count>3</comment_count>
    <who name="Aníbal Limón">anibal</who>
    <bug_when>2020-04-28 14:19:14 +0000</bug_when>
    <thetext>OE-Core recipe upgrade and oeqa case at,

https://lists.openembedded.org/g/openembedded-core/topic/patch_1_2_ptest_runner/73336814</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>87143</commentid>
    <comment_count>4</comment_count>
    <who name="Aníbal Limón">anibal</who>
    <bug_when>2020-05-04 12:07:08 +0000</bug_when>
    <thetext>Merged at,

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=792d1ebba98b097d4d68c7261bf6af0c9d186eab

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=81b8656f6beae97fb1f4a99b1d92f71077c716e1</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>