<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>12635</bug_id>
          
          <creation_ts>2018-03-29 23:09:51 +0000</creation_ts>
          <short_desc>add performance test using phoronix test suite</short_desc>
          <delta_ts>2026-08-13 15:15:54 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Test Plans/Suite</product>
          <component>test-plans/suite</component>
          <version>5.99</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WONTFIX</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>5.99</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Anuj Mittal">anuj.mittal</reporter>
          <assigned_to name="Yang Wang">yang.wang</assigned_to>
          <cc>bluelightning</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>stephano</cc>
    
    <cc>tim.orling</cc>
    
    <cc>yang.wang</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>80034</commentid>
    <comment_count>0</comment_count>
    <who name="Anuj Mittal">anuj.mittal</who>
    <bug_when>2018-03-29 23:09:51 +0000</bug_when>
    <thetext>Evaluate if a subset of phoronix tests can be run as ptests so we can have a set of performance numbers for every release.

We might want to start monitoring these to make sure that we are not regressing w.r.t performance for the default set of features enabled.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>80110</commentid>
    <comment_count>1</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2018-04-04 22:46:30 +0000</bug_when>
    <thetext>I guess you mean performance test rather than ptest? It would of course be done at runtime but I don&apos;t think the ptest framework is really where this fits.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>80111</commentid>
    <comment_count>2</comment_count>
    <who name="Anuj Mittal">anuj.mittal</who>
    <bug_when>2018-04-05 05:25:14 +0000</bug_when>
    <thetext>Yes. I was thinking in terms of ptest because I thought it&apos;d be nice if this had the attributes of a test, that is, mark it pass or fail every time we release depending on a baseline.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>80130</commentid>
    <comment_count>3</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2018-04-05 08:29:50 +0000</bug_when>
    <thetext>I think it may make sense as an extension of ptest in that there are a set of tests and they return a value (a performance number) and rather than creating yet another mechanism, we may want to add this as an extension to the ptest usecase?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>86889</commentid>
    <comment_count>4</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2020-04-02 14:45:26 +0000</bug_when>
    <thetext>Ross has a prototype. We&apos;d use parts of meta-oe. Yang are you interested in this work?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>86891</commentid>
    <comment_count>5</comment_count>
    <who name="Yang Wang">yang.wang</who>
    <bug_when>2020-04-02 17:12:59 +0000</bug_when>
    <thetext>Hi Randy,

I would love to, but now there are about 20 tickets in my hand, let me close most of them and then come back to this one, is that okay?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>86892</commentid>
    <comment_count>6</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2020-04-02 17:31:14 +0000</bug_when>
    <thetext>Yang, sure. This story isn&apos;t even in the schedule (3.99 not 3.2) so there&apos;s no hurry. Assigned to you though, thanks!</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>92943</commentid>
    <comment_count>7</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2022-04-07 15:09:58 +0000</bug_when>
    <thetext>Yang, Do you think you&apos;ll have time for this in the coming month or two?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>92944</commentid>
    <comment_count>8</comment_count>
    <who name="Yang Wang">yang.wang</who>
    <bug_when>2022-04-07 15:28:03 +0000</bug_when>
    <thetext>Hi Randy,

I would say it can be difficult, but I will let you know whenever I have time.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>92945</commentid>
    <comment_count>9</comment_count>
    <who name="Tim Orling">tim.orling</who>
    <bug_when>2022-04-07 15:53:37 +0000</bug_when>
    <thetext>I did some work on this a while back:
https://github.com/moto-timo/meta-openembedded/tree/timo/phoronix-8.2.0-isolated</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>92946</commentid>
    <comment_count>10</comment_count>
    <who name="Tim Orling">tim.orling</who>
    <bug_when>2022-04-07 16:16:20 +0000</bug_when>
    <thetext>As I recall, after the isolated fetching issue (during do fetch and not at run time), the next issue was that individual test cases have information about dependencies (DEPENDS/RDEPENDS that would be needed to build/run the test) and also arch info (e.g. some only run on x86).</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>96874</commentid>
    <comment_count>11</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2023-10-24 14:24:34 +0000</bug_when>
    <thetext>Bulk move from 4.99 or 0.00 to 5.99</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>106525</commentid>
    <comment_count>12</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2026-08-13 15:15:46 +0000</bug_when>
    <thetext>Phoronix may not be the best performance test suite, despite it&apos;s name.
This is not something that we plan to implement in oe-core but patches welcome.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>