<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>3887</bug_id>
          
          <creation_ts>2013-02-13 20:18:06 +0000</creation_ts>
          <short_desc>Merge buildstats into build history and have one data collection mechanism</short_desc>
          <delta_ts>2023-12-21 16:03:43 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>10</classification_id>
          <classification>QA/Testing</classification>
          <product>Build Testing</product>
          <component>general</component>
          <version>5.99</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>RESOLVED</bug_status>
          <resolution>WONTFIX</resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard> </status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>Future</target_milestone>
          <dependson>5709</dependson>
          <blocked>4683</blocked>
          <everconfirmed>1</everconfirmed>
          <reporter name="Laurentiu Serban">laurentiu.serban</reporter>
          <assigned_to name="Unassigned">unassigned</assigned_to>
          <cc>akuster</cc>
    
    <cc>alexandru.c.georgescu</cc>
    
    <cc>bluelightning</cc>
    
    <cc>corneliux.stoicescu</cc>
    
    <cc>jessica.zhang</cc>
    
    <cc>jose.perez.carranza</cc>
    
    <cc>mihai.lindner</cc>
    
    <cc>randy.macleod</cc>
    
    <cc>richard.purdie</cc>
    
    <cc>sgw</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Don&apos;t know</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>29776</commentid>
    <comment_count>0</comment_count>
    <who name="Laurentiu Serban">laurentiu.serban</who>
    <bug_when>2013-02-13 20:18:06 +0000</bug_when>
    <thetext>Merge buildstats into build history and have one data collection mechanism, provide a common dataset and a framework for extracting relevant data</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>32861</commentid>
    <comment_count>1</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2013-05-03 06:36:18 +0000</bug_when>
    <thetext>This is the proposed implementation method:
-move buildstats in the buildhistory directory
-make buildstats compatible with git (rework directory structure)
-no merging will be done between buildstats and buildhistory information and directory structure; this way they will be able to maintain compatibility with related scrips like buildhistory-diff.
-when git is enabled, buildhistory&apos;s commit task will be performed upon both buildhistory and buildstats as it is triggered on bb.event.BuildCompleted . Buildstats and buildhistory should not submit any changes upon that event.

RP: Do you think the above implementation is appropriate? Also can you please provide me with a list of scripts that you are aware of related to buildhistory/buildstats? I need to look for any hard-coded links to &lt;build_directory&gt;/buildstats (where the build directory is acquired by variable but the buildstats directory is hard set in it). I will do my best to identify all of them though.

Regards,
Corneliu</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>32862</commentid>
    <comment_count>2</comment_count>
    <who name="Richard Purdie">richard.purdie</who>
    <bug_when>2013-05-03 07:15:20 +0000</bug_when>
    <thetext>Paul is probably a better person to answer questions related to buildhistory data format</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>35712</commentid>
    <comment_count>3</comment_count>
    <who name="Paul Eggleton">bluelightning</who>
    <bug_when>2013-08-16 16:12:36 +0000</bug_when>
    <thetext>Sorry for the delay in replying. The above plan sounds OK; I&apos;m still a bit concerned about moving buildstats under buildhistory by default though because of the amount of noise it will generate in the git logs (no problem if we want to configure it this way on the autobuilder by setting BUILDSTATS_BASE). Let&apos;s look at what changes will be needed to buildstats to fit within the git repository and go from there. 

As for what looks into buildhistory, scripts/buildhistory-diff and the buildhistory-web application both use meta/lib/oe/buildhistory_analysis.py to analyse the changes. There is also a scripts/buildhistory-collect-srcrevs script. Web Hob is also going to be collecting some information from the buildhistory repository, you should be able to see what there is so far of that here:

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/tree/bitbake/lib/bb/ui/buildinfohelper.py?h=webhob-poky/master

(Although this is subject to change since Web Hob is still being developed.)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>35989</commentid>
    <comment_count>4</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2013-08-28 13:27:33 +0000</bug_when>
    <thetext>Here is the current state of this feature: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=cornel/bstats4

Changelog:

    Modify buildstats to be merged inside buildhistory

    - added buildstats inheritance inside buildhistory
    - reworked the buildstats directory structure not to contain the build name(read: the build start date). Now it only contains the target name and machine. This is usefull in order to reduce git noise.
    - because builds are no longer separated by build name(read: date) it is necessary to remake(remove and create from scratch) the buildstats folder for each build in order keep buildstats compatible with t


Working on improvements and testing.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>35991</commentid>
    <comment_count>5</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2013-08-28 13:56:35 +0000</bug_when>
    <thetext>http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=cornel/bstats4&amp;id=b079111edacbec9802b301af198844711cdc95e2</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>38432</commentid>
    <comment_count>6</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2013-11-01 17:10:46 +0000</bug_when>
    <thetext>patch sent for review on oe-core mailing list.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>39712</commentid>
    <comment_count>7</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2014-01-09 14:12:07 +0000</bug_when>
    <thetext>Because event handlers cannot be ordered, buildhistory_eventhandler is finished before buildstats_eventhandler and this results in some data being left out when buildhistory uses git to commit data.

Marking this feature as blocked by bug 5709</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>42118</commentid>
    <comment_count>8</comment_count>
    <who name="Stoicescu Cornel">corneliux.stoicescu</who>
    <bug_when>2014-04-02 07:15:05 +0000</bug_when>
    <thetext>Moving to 1.7 . Still blocked by bug 5709 unless we go down a different implementation path.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>85940</commentid>
    <comment_count>9</comment_count>
    <who name="Armin Kuster">akuster</who>
    <bug_when>2019-12-22 20:56:28 +0000</bug_when>
    <thetext>does result too do this?

I think so.

if not, please send patches</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>97638</commentid>
    <comment_count>10</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2023-12-21 16:03:43 +0000</bug_when>
    <thetext>buildstats and build history do different things and we&apos;re not planning to merge them.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>