4527 2013-05-22 12:00:46 +0000 create a Runtime performance test layer to enable runtime performance tests 2017-12-06 16:47:27 +0000 1 1 10 QA/Testing Runtime Testing general 1.5 x86 Multiple RESOLVED FIXED Medium+ enhancement 2.3 M2 10951 1 corneliux.stoicescu humberto.ibarra.lopez alexandru.c.georgescu leonardo.sandoval.gonzalez markus.lehtonen sgw todor.minchev --- --- Don't know oldest_to_newest 33200 0 corneliux.stoicescu 2013-05-22 12:00:46 +0000 We should use the Phoronix test Suite to benchmark Yocto images with common Linux distributions. http://www.phoronix-test-suite.com This is the proposed action plan: 1) Select individual tests or test suites (like Timed Code Compilation) that would be of interest. The tests dependencies should be bared in mind when making this selection. 2) Select the images -hardware and type- (ex: core-image-sato-sdk-atom-pc) that would be tested. Requirements: * Tests must be run on the same hardware using the selected Yocto images and latest/LTS common Linux distributions like Ubuntu, Fedora, OpenSUSE and CentOS; * There should be dedicated machines to run these tests. All distros should be installed on the same HDD using partitions to avoid unwanted errors in the results; * Keeping in mind the above requirements, multiple hardware can be used in order to test different architectures; 36966 1 alexandru.c.georgescu 2013-09-19 13:54:01 +0000 Moving to 1.6 42868 2 alexandru.c.georgescu 2014-04-23 08:09:46 +0000 still in progress. 45272 3 ionutx.chisanovici 2014-08-27 09:35:26 +0000 Moved to 1.7 58728 4 alexandru.c.georgescu 2016-02-08 13:50:46 +0000 See lmbench recipe as reference: http://layers.openembedded.org/layerindex/recipe/869/ 68962 5 humberto.ibarra.lopez 2016-12-08 21:31:28 +0000 Have tracked the required recipes. Implementing the layer. 69005 6 humberto.ibarra.lopez 2016-12-09 20:35:19 +0000 Phoronix might be a bit costly to deploy on certain targets. Either way, not really sure if the extra layer is needed in the first place. Phoronix, lmbench, iozone3 and others are already part of oe-core or meta-oe; a new layer wouldn't really bring anything new into the fold. Check recipes-extended under oe-core and recipes-benchmark under meta-oe. Runtime performance test could add these recipes directly from meta-oe or meta instead of creating a new layer for it. 69052 7 humberto.ibarra.lopez 2016-12-12 21:31:31 +0000 There is a related bug that might be implementing this already, bug is 10500. Sent mail about this and waiting for answers. 69993 8 humberto.ibarra.lopez 2017-01-22 13:16:19 +0000 All other runtime performance bugs were marked obsolete as they didn't reflect the current implementation in the best of ways, however, this one is still valid since we are going to need this layer. The layer will probably be just a skeleton and will be initially added to contrib. Removing old dependencies to obsolete bugs and adding a 10951 as its umbrella bug. 70105 9 humberto.ibarra.lopez 2017-01-25 04:42:01 +0000 Added a skeleton layer for this in: http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/commit/?h=humberto/runtime-performance This layer only contains a dependency to the meta-oe layer, which has the phoronix recipe and is going to be used to run performance testcases. More about phoronix settings can be found at the README file of the layer. Testcases should be implemented for this in future bugs attached to #10951