<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>6319</bug_id>
          
          <creation_ts>2014-05-13 13:17:51 +0000</creation_ts>
          <short_desc>Automated storage and graphing of build performance metrics</short_desc>
          <delta_ts>2017-12-06 16:48:04 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Build Testing</product>
          <component>general</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>FIXED</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard>TRT</status_whiteboard>
          <keywords></keywords>
          <priority>Medium+</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>2.4 M1</target_milestone>
          <dependson>10582</dependson>
          <blocked>5049</blocked>
          <everconfirmed>1</everconfirmed>
          <reporter name="Richard Purdie">richard.purdie</reporter>
          <assigned_to name="Markus Lehtonen">markus.lehtonen</assigned_to>
          <cc>belen.barros.pena</cc>
    
    <cc>bill.randle</cc>
    
    <cc>joshuagloe</cc>
    
    <cc>konrad.scherer</cc>
    
    <cc>markus.lehtonen</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>sgw</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>No (bug/feature does not impact docs)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>43280</commentid>
    <comment_count>0</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2014-05-13 13:17:51 +0000</bug_when>
    <thetext>Currently, we do have various build performance numbers being run on a regular basis and we do graph those numbers for milestones.

I&apos;d like to:

a) Collect this data together in a database somewhere rather than having an ever growing csv file
b) Have some kind of visualisation of those numbers automatically generated like the bug trend charts.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>43281</commentid>
    <comment_count>1</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2014-05-13 13:18:49 +0000</bug_when>
    <thetext>Adding Belen as I know there may be some overlap between some functionality of toaster and this.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>50745</commentid>
    <comment_count>2</comment_count>
    <who name="Alexandru Georgescu">alexandru.c.georgescu</who>
    <bug_when>2015-05-04 13:00:04 +0000</bug_when>
    <thetext>This will be integrated in out QA REporting TOol</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>68687</commentid>
    <comment_count>3</comment_count>
    <who name="Benjamin Esquivel">benjamin.esquivel</who>
    <bug_when>2016-11-29 16:56:03 +0000</bug_when>
    <thetext>removing dependency to bug 9958 as it has been set to future and this bug is targeted to a specific release.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>70331</commentid>
    <comment_count>4</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2017-02-01 15:17:51 +0000</bug_when>
    <thetext>Moving to milestone to 2.4 as the feature would be part of the TestReportTool.

I have implemented an initial prototype web service, based on an older CustomReports project. The code is currently available in GitHub (as it is a fork from CustomReports), see build-perf branch:
https://github.com/marquiz/CustomReports/tree/build-perf</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>72286</commentid>
    <comment_count>5</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2017-04-11 12:24:23 +0000</bug_when>
    <thetext>I&apos;m setting the milestone now to 2.4 M1. However, I would be inclined to close the bug as fixed because test results are being automatically stored in Git and graphical test reports are being automatically sent from the testers. 

I&apos;d like to see more fine-grained requirements for TRT when its design/implementation starts.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>73443</commentid>
    <comment_count>6</comment_count>
    <who name="Markus Lehtonen">markus.lehtonen</who>
    <bug_when>2017-05-23 07:49:58 +0000</bug_when>
    <thetext>Build performance test data is being automatically stored in Git:
http://git.yoctoproject.org/cgit/cgit.cgi/yp-qa-build-perf-data/

Also, build performance test reports are now being automatically generated and uploaded to wiki.yoctoproject.org for each test run. Links to the latest test reports are found here:
https://wiki.yoctoproject.org/wiki/Performance_Test#Daily_Test_Results

Closing this bug.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>