<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>10931</bug_id>
          
          <creation_ts>2017-01-16 22:08:21 +0000</creation_ts>
          <short_desc>Improve indicators on automated performance reports</short_desc>
          <delta_ts>2017-08-16 19:35:30 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Build Testing</product>
          <component>general</component>
          <version>2.3</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.4 M3</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</reporter>
          <assigned_to name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</assigned_to>
          <cc>benjamin.esquivel</cc>
    
    <cc>markus.lehtonen</cc>
    
    <cc>richard.purdie</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>69843</commentid>
    <comment_count>0</comment_count>
    <who name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</who>
    <bug_when>2017-01-16 22:08:21 +0000</bug_when>
    <thetext>Currently, the QA creates plots at milestone rate [1] containing some stats from profiling data (attached). This is fine but it may be too late to detect performance degradation [for example, see 2]. The proposed task consists on parsing the profiling results and from it compute the mean values for each profiling column, which is actually what [1] is doing but this time, the mean values will be included in the email report sent several times per day. 

[1] https://wiki.yoctoproject.org/charts/perf_milestone_GDC/bitbake-core-image-sato-rootfs.html
[2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=10884</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>71591</commentid>
    <comment_count>1</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2017-03-22 17:04:11 +0000</bug_when>
    <thetext>I think I can take this. I&apos;ve already implemented a quick prototype for this:
http://git.openembedded.org/openembedded-core-contrib/log/?h=marquiz/buildperf/scripts

The prototype contains a scripts for creating an (interactive) HTML report, and converting that into an html-formatted email. There is a long list of streamlining/enhancements to do, the most critical being support for XML formatted test reports (it currently only supports json).</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>75726</commentid>
    <comment_count>2</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2017-08-08 15:15:08 +0000</bug_when>
    <thetext>I would propose that we close this bug as fixed. Graphical performance reports are being automatically uploaded to wiki.yoctoproject.org after each test run so the latest data is always available (see [1]).

Assigning back to Leonardo for comments.

[1] https://wiki.yoctoproject.org/wiki/Performance_Test#Daily_Test_Results</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>75920</commentid>
    <comment_count>3</comment_count>
    <who name="Leonardo Sandoval Gonzalez">leonardo.sandoval.gonzalez</who>
    <bug_when>2017-08-16 19:35:30 +0000</bug_when>
    <thetext>Work completed by Markus L.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>