This maybe something that has to move to the meta-yocto layer or infrastructure, but the idea here is that there should be some type of runtime performance testing that happens when builds are successful and also to be able to compare one version of the Yocto Project to the next. The standard bench marks would be integrated into oe-core or meta-yocto and then run against the booted target system and metrics collected. The possibilities for benchmark suites include: lmbench hackbench iozone3 As a strech goal start to integrate some or all of the phronix test suite: http://www.phoronix-test-suite.com/?k=downloads
This definetly will be future. Maybe 1.6
Hi Jason, Do we want the Phoronix Test Suite integrated? Or would be better to include only the benchmarks from it?
Promoting this to a master enhancement bug that will track ovarll runtime performance testing. This includes: - bug 4527 - that will cover PTS integration or tests from PTS in a new layer - bug 6009 - Toaster backend performance testing - bug 5478 - Covers both build time performance when using gcc security flags - bug 5477 - Check for any runtime performance degradations with gcc security flags enabled - bug 5369 - performance analysis of x32 runtime
- bug 6296 - Add support for runtime performance tests to image_tests
The approach for this bug and its blocking bugs is four years old and not the one intended right now. Opened bug #10951 as a new version for this and will track the implementation with that one. Marking this as RESOLVED OBSOLETE