<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>4144</bug_id>
          
          <creation_ts>2013-03-28 18:41:34 +0000</creation_ts>
          <short_desc>Runtime performance testing</short_desc>
          <delta_ts>2017-12-06 16:46:51 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>7</classification_id>
          <classification>Build System, Metadata &amp; Runtime</classification>
          <product>OE-Core</product>
          <component>core</component>
          <version>unspecified</version>
          <rep_platform>All</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>OBSOLETE</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.3 M2</target_milestone>
          <dependson>5369</dependson>
    
    <dependson>5477</dependson>
    
    <dependson>5478</dependson>
    
    <dependson>6009</dependson>
    
    <dependson>6296</dependson>
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Jason Wessel">jason.wessel</reporter>
          <assigned_to name="Humberto Ibarra">humberto.ibarra.lopez</assigned_to>
          <cc>bogdanx.a.voiculescu</cc>
    
    <cc>leonardo.sandoval.gonzalez</cc>
    
    <cc>meta.mr.watcher</cc>
    
    <cc>meta.watcher</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>richard.purdie</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>31273</commentid>
    <comment_count>0</comment_count>
    <who name="Jason Wessel">jason.wessel</who>
    <bug_when>2013-03-28 18:41:34 +0000</bug_when>
    <thetext>This maybe something that has to move to the meta-yocto layer or infrastructure, but the idea here is that there should be some type of runtime performance testing that happens when builds are successful and also to be able to compare one version of the Yocto Project to the next.

The standard bench marks would be integrated into oe-core or meta-yocto and then run against the booted target system and metrics collected.  The possibilities for benchmark suites include:

lmbench
hackbench
iozone3

As a strech goal start to integrate some or all of the phronix test suite:
http://www.phoronix-test-suite.com/?k=downloads</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>36952</commentid>
    <comment_count>1</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2013-09-19 13:37:51 +0000</bug_when>
    <thetext>This definetly will be future. Maybe 1.6</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>38455</commentid>
    <comment_count>2</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2013-11-04 10:37:58 +0000</bug_when>
    <thetext>Hi Jason,
Do we want the Phoronix Test Suite integrated? Or would be better to include only the benchmarks from it?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>42972</commentid>
    <comment_count>3</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2014-04-24 11:48:38 +0000</bug_when>
    <thetext>Promoting this to a master enhancement bug that will track ovarll runtime performance testing. This includes:
- bug 4527 - that will cover PTS integration or  tests from PTS in a new layer
- bug 6009 - Toaster backend performance testing
- bug 5478 - Covers both build time performance when using gcc security flags
- bug 5477 - Check for any runtime performance degradations with gcc security flags enabled
- bug 5369 -  performance analysis of x32 runtime</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43187</commentid>
    <comment_count>4</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2014-05-08 15:01:22 +0000</bug_when>
    <thetext>- bug 6296 - Add support for runtime performance tests to image_tests</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>69987</commentid>
    <comment_count>5</comment_count>
    <who name="Humberto Ibarra">humberto.ibarra.lopez</who>
    <bug_when>2017-01-22 12:56:48 +0000</bug_when>
    <thetext>The approach for this bug and its blocking bugs is four years old and not the one intended right now. Opened bug #10951 as a new version for this and will track the implementation with that one. Marking this as RESOLVED OBSOLETE</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>