3886 2013-02-13 20:12:09 +0000 Script to automatically run the performance tests and consolidates the data 2013-04-03 16:12:28 +0000 1 1 10 QA/Testing Build Testing general 1.4 x86 Multiple VERIFIED FIXED High enhancement 1.4 M5 1 laurentiu.serban sstncr corneliux.stoicescu sgw --- --- --- oldest_to_newest 29775 0 laurentiu.serban 2013-02-13 20:12:09 +0000 Write a script which performs the following tests then collects up up the appropriate data. Overall Build Time Prerequisite: Downloaded Sources, no sstate Measurement: Wall clock of "bitbake core-image-sato" Image build from SState Prerequisite: Have already populated full sstate cache Measurement: Wall clock of "bitbake core-image-sato -c rootfs" Time to build the kernel Prerequisite: Have existing build of kernel, run "bitbake virtual/kernel -c clean" Measurement: Wall clock of "bitbake virtual/kernel" Disk space usage of a build (no rm_work) Prerequisite: Downloaded Sources, no sstate Measurement: Size of tmp directory after a "bitbake c-re-image-sato" Disk space usage of a build with rm_work Prerequisite: Downloaded Sources, no sstate Measurement: Size of tmp directory after a "bitbake c-re-image-sato" but with rm_work enabled 29986 1 sstncr 2013-02-20 11:26:51 +0000 http://git.yoctoproject.org/cgit.cgi/poky-contrib/commit/?h=stefans/perf-test&id=f54423b4f44a07c24d8bda400d51e6750718186d 30004 2 sstncr 2013-02-21 14:04:34 +0000 Oki, latest version of the script should be here: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/tree/scripts/contrib/build-perf-test.sh?h=stefans/perf-test It has two outputs, one global results file, which looks smth like: 7d22ef28e64de06b6238d0ef9b664c0bee6efa46 1:07:16,12:48.31,1:11:25,5:14.22 and a more verbose one per commit. I've did two runs on the same system (to ensure reproductiblity), and published some results here: https://wiki.yoctoproject.org/wiki/Performance_Test#1.4_Perfomance_Data What still needs to be done: - improve output - gather some data from buildstats - run the script on every milestone from now on, on the standard Ubuntu machine (I had some problems with mine, that's why on the wiki page you'll see a Fedora system used). 31018 3 corneliux.stoicescu 2013-03-22 09:19:29 +0000 The script works as intended. QA uses it in full pass tests to evaluate build performance. The results can be viewed here: https://wiki.yoctoproject.org/wiki/Performance_Test 31457 4 sstncr 2013-04-03 16:12:28 +0000 For record keeping purposes: this has been merged in master, so that link to poky-contrib is obsolete: http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=851f1e368bea57e090a924330a08a793abfcfa55 It can be found under scripts/contrib folder. I've updated with the new location on the wiki page too.