Merge buildstats into build history and have one data collection mechanism, provide a common dataset and a framework for extracting relevant data
This is the proposed implementation method: -move buildstats in the buildhistory directory -make buildstats compatible with git (rework directory structure) -no merging will be done between buildstats and buildhistory information and directory structure; this way they will be able to maintain compatibility with related scrips like buildhistory-diff. -when git is enabled, buildhistory's commit task will be performed upon both buildhistory and buildstats as it is triggered on bb.event.BuildCompleted . Buildstats and buildhistory should not submit any changes upon that event. RP: Do you think the above implementation is appropriate? Also can you please provide me with a list of scripts that you are aware of related to buildhistory/buildstats? I need to look for any hard-coded links to <build_directory>/buildstats (where the build directory is acquired by variable but the buildstats directory is hard set in it). I will do my best to identify all of them though. Regards, Corneliu
Paul is probably a better person to answer questions related to buildhistory data format
Sorry for the delay in replying. The above plan sounds OK; I'm still a bit concerned about moving buildstats under buildhistory by default though because of the amount of noise it will generate in the git logs (no problem if we want to configure it this way on the autobuilder by setting BUILDSTATS_BASE). Let's look at what changes will be needed to buildstats to fit within the git repository and go from there. As for what looks into buildhistory, scripts/buildhistory-diff and the buildhistory-web application both use meta/lib/oe/buildhistory_analysis.py to analyse the changes. There is also a scripts/buildhistory-collect-srcrevs script. Web Hob is also going to be collecting some information from the buildhistory repository, you should be able to see what there is so far of that here: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/tree/bitbake/lib/bb/ui/buildinfohelper.py?h=webhob-poky/master (Although this is subject to change since Web Hob is still being developed.)
Here is the current state of this feature: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=cornel/bstats4 Changelog: Modify buildstats to be merged inside buildhistory - added buildstats inheritance inside buildhistory - reworked the buildstats directory structure not to contain the build name(read: the build start date). Now it only contains the target name and machine. This is usefull in order to reduce git noise. - because builds are no longer separated by build name(read: date) it is necessary to remake(remove and create from scratch) the buildstats folder for each build in order keep buildstats compatible with t Working on improvements and testing.
http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=cornel/bstats4&id=b079111edacbec9802b301af198844711cdc95e2
patch sent for review on oe-core mailing list.
Because event handlers cannot be ordered, buildhistory_eventhandler is finished before buildstats_eventhandler and this results in some data being left out when buildhistory uses git to commit data. Marking this feature as blocked by bug 5709
Moving to 1.7 . Still blocked by bug 5709 unless we go down a different implementation path.
does result too do this? I think so. if not, please send patches
buildstats and build history do different things and we're not planning to merge them.