The PtestRunnerTest class, an existing runtime class in meta/lib/oeqa/runtime/cases/ptest.py already allows to call the ptest-runner script using testimage, parse its results and save them in the logs. However, considering this test needs to be executed on actual hardware, the main obstacle to automate the complete process is to be able to flash and bring up the devices automatically. Though, once the LAVA system allows to do this, it may be possible to complete the work on this area and complete automating the pTest execution. The purpose of this item is to track the progress and completion of this task.
Yang uses Lava quite a bit so he'll work on this enhancement in the coming weeks. We need to work out an acceptable approach with the goal being that the ptest results and stats analysis is in OE code and LAVA takes care of the hardware boot and control. I'm sure there's more detail to work out via say a brief RFC email to the oe-core list.
This item is on my TODO list now, will update the status in next few weeks.
We are using LAVA to execute core-image-sato-sdk test cases on hardware but we had not run any pTest on hardware but rather trying to integrate phoronix test suite into the image. This PoC has been done x86-64 hardware specifics and soon it will be roll out to the community.
There has been some work to allow lava and autobuilder2 to interact. The work is still being developed but the patches are are: https://github.com/lab-github/yocto-autobuilder2/commits/linaro/lava https://github.com/lab-github/yocto-autobuilder-helper/commits/linaro/lava which most of the supporting code going into the -helper. This work should be submitted soon and could form a base for sending jobs to lava then reporting the results back into the autobuilder for ptest.
Thanks for the comment. I quickly looked into the code, it tries to make the helper code common and set LAVA server, bsps and device types as variables. We are doing some similar work: https://github.com/WindRiver-OpenSourceLabs/ci-scripts Currently, we haven't test it much with public LAVA server and their board farm, but we do have plan to make it work as soon as we can.
Closing as we run ptest automatically now.
Ross can you add a link to a commit or defect for that work please?