Bug 13846

Summary: Add runtime test for Piglit
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Alexander Kanavin <alex.kanavin>
Component: graphicsAssignee: Unassigned <unassigned>
Status: NEW --- QA Contact:
Severity: enhancement    
Priority: Medium+ CC: alex.kanavin, meta.mr.watcher, meta.watcher, randy.macleod, richard.purdie, ross.burton
Version: unspecified   
Target Milestone: 5.99   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Alexander Kanavin 2020-03-26 12:05:42 UTC
One unclear point is where these tests should be run. They are huge (1.5G) so probably adding them to ptest images isn't the best idea. ltp perhaps?

Another investigation is what the performance is under software renderer or under virgl, and if either is feasible.
Comment 1 Richard Purdie 2020-03-26 14:45:20 UTC
It may make sense to copy the ltp module and add a specific target into the autobuilder which builds the tests into a special purpose image and then runs them.
Comment 2 Alexander Kanavin 2020-03-28 21:20:04 UTC
I ran the 'quick' set under software renderer in qemu:

time 1h5m

total 41428
skip 15373
pass 26591
warn 4
fail 287
crash 73

Next I'd like to try virgl.
Comment 3 Ross Burton 2022-04-01 11:09:22 UTC
A new runtime test for Piglit to enable test execution would be fairly simple, albeit slow so it shouldn't be enabled by default!
Comment 4 Randy MacLeod 2023-10-24 14:24:36 UTC
Bulk move from 4.99 or 0.00 to 5.99
Comment 5 Ross Burton 2024-01-03 11:48:55 UTC
Revised position: I think maybe piglit should inherit ptest.  The run-ptest should be able to be configured to run any tests but have a sensible default, and transform the test report so that the ptest framework can parse it.

This way we get test execution easily (bitbake core-image-ptest-piglit -c testimage) and people who care can run that often and use resulttool to get regression reports.
Comment 6 Randy MacLeod 2025-02-06 16:27:50 UTC
Not really a newcomer bug.