12372 2017-11-21 23:28:20 +0000 Automate the execution of pTest 2019-05-23 15:28:53 +0000 1 1 10 QA/Testing Build Testing general 2.5 x86 Multiple RESOLVED FIXED Medium normal 4.99 1 jair.de.jesus.gonzalez.plascencia yang.wang aaron.chun.yew.chan akuster konrad.scherer randy.macleod richard.purdie ross.burton --- --- Don't know oldest_to_newest 78307 0 jair.de.jesus.gonzalez.plascencia 2017-11-21 23:28:20 +0000 The PtestRunnerTest class, an existing runtime class in meta/lib/oeqa/runtime/cases/ptest.py already allows to call the ptest-runner script using testimage, parse its results and save them in the logs. However, considering this test needs to be executed on actual hardware, the main obstacle to automate the complete process is to be able to flash and bring up the devices automatically. Though, once the LAVA system allows to do this, it may be possible to complete the work on this area and complete automating the pTest execution. The purpose of this item is to track the progress and completion of this task. 81099 1 randy.macleod 2018-07-12 19:33:39 +0000 Yang uses Lava quite a bit so he'll work on this enhancement in the coming weeks. We need to work out an acceptable approach with the goal being that the ptest results and stats analysis is in OE code and LAVA takes care of the hardware boot and control. I'm sure there's more detail to work out via say a brief RFC email to the oe-core list. 81100 2 yang.wang 2018-07-12 19:37:15 +0000 This item is on my TODO list now, will update the status in next few weeks. 81415 3 aaron.chun.yew.chan 2018-08-23 05:23:11 +0000 We are using LAVA to execute core-image-sato-sdk test cases on hardware but we had not run any pTest on hardware but rather trying to integrate phoronix test suite into the image. This PoC has been done x86-64 hardware specifics and soon it will be roll out to the community. 81427 4 richard.purdie 2018-08-24 08:55:00 +0000 There has been some work to allow lava and autobuilder2 to interact. The work is still being developed but the patches are are: https://github.com/lab-github/yocto-autobuilder2/commits/linaro/lava https://github.com/lab-github/yocto-autobuilder-helper/commits/linaro/lava which most of the supporting code going into the -helper. This work should be submitted soon and could form a base for sending jobs to lava then reporting the results back into the autobuilder for ptest. 81429 5 yang.wang 2018-08-24 15:24:05 +0000 Thanks for the comment. I quickly looked into the code, it tries to make the helper code common and set LAVA server, bsps and device types as variables. We are doing some similar work: https://github.com/WindRiver-OpenSourceLabs/ci-scripts Currently, we haven't test it much with public LAVA server and their board farm, but we do have plan to make it work as soon as we can. 83863 6 ross.burton 2019-05-20 15:22:17 +0000 Closing as we run ptest automatically now. 83952 7 randy.macleod 2019-05-23 15:28:53 +0000 Ross can you add a link to a commit or defect for that work please?