Per the test plan[1] we currently store pTest results in the wiki[2] and generate comparisons using the ptest-parser in qa-tools[3]. We're increasingly moving QA data to git and using associated scripts that can generate reports or perform comparisons on the data. Examples of this trend are buildhistory and performance data. It would be desirable to store pTest results this way also and be able to generate comparative reports based on the results archived in git. Ideally we'd have: a) a yp-qa-ptest-results (or similarly named) repo on git.yoctoproject.org b) automated execution of the ptests on a dut (triggered by QA autobuilder) c) scripts to generate reports comparing the ptest results from two builds b and c should probably have separate bugs 1. https://wiki.yoctoproject.org/wiki/BSP_Test_Plan#pTest 2. https://wiki.yoctoproject.org/wiki/Ptest/archive 3. https://wiki.yoctoproject.org/wiki/Qa-tools#Ptest_Parser
http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=5f6945f5031e1a4ca116cc1eccf4c2f9dc228547 ?
Added Robert since he worked on the commit that adds ptest results to buildhistory that Richard just referenced above.
(In reply to comment #1) > http://git.yoctoproject.org/cgit.cgi/poky/commit/ > ?id=5f6945f5031e1a4ca116cc1eccf4c2f9dc228547 ? This is definitely part of the solution, it means we don't need a separate repository. I need to look closer, some extra tooling may or may not be required. There were more patches in that series which don't appear to have been merged, they will be useful to resolve this bug. https://patchwork.openembedded.org/series/8033/#
(In reply to comment #3) > (In reply to comment #1) > > http://git.yoctoproject.org/cgit.cgi/poky/commit/ > > ?id=5f6945f5031e1a4ca116cc1eccf4c2f9dc228547 ? > > This is definitely part of the solution, it means we don't need a separate > repository. I need to look closer, some extra tooling may or may not be > required. > > There were more patches in that series which don't appear to have been > merged, they will be useful to resolve this bug. > > https://patchwork.openembedded.org/series/8033/# Or I'm an idiot, looks like they were all merged
I've created bug 12372 to track the progress in the implementation of automated execution of pTest.
As point out by Richard and Randy, Robert had enabled ptest from testimage to archive test result to buildhistory git repository. Had verified that this was working with below configuration, ptest result from testimage was stored into buildhistory git repository. TEST_SUITES = "ping ssh xorg ptest" INHERIT += "buildhistory" BUILDHISTORY_COMMIT = "1" Closing this ticket.