Bug 13088 - Add support for extracting individual ptest timing
Summary: Add support for extracting individual ptest timing
Status: RESOLVED FIXED
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium+ enhancement
Target Milestone: 2.7 M2
Assignee: Aníbal Limón
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2018-12-17 16:59 UTC by Richard Purdie
Modified: 2019-01-14 17:43 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Richard Purdie 2018-12-17 16:59:53 UTC
It would be very useful to be able to know how long each individual ptest takes to run and be able to pass this data from ptest-runner through to the xml results logging from testimage so it ends up in the standard test results.

I believe we have some ptests which are taking too long and ending up being 'killed' for timing out but its hard to obtain that data from the logs.

Creating a "dummy" timeout failure in the test results may also be something we need to look at as a way of flagging timeouts up the chain of test reporting.
Comment 1 Aníbal Limón 2019-01-02 19:47:14 UTC
(In reply to comment #0)
> It would be very useful to be able to know how long each individual ptest
> takes to run and be able to pass this data from ptest-runner through to the
> xml results logging from testimage so it ends up in the standard test
> results.
> 
> I believe we have some ptests which are taking too long and ending up being
> 'killed' for timing out but its hard to obtain that data from the logs.
> 
> Creating a "dummy" timeout failure in the test results may also be something
> we need to look at as a way of flagging timeouts up the chain of test
> reporting.

Currently is printing TIMEOUT in the stdout [1], I can add a xml dummy failure for timeout that will display when status in exit is SIGKILL [2]. Is that the idea? [2]

[1] http://git.yoctoproject.org/cgit/cgit.cgi/ptest-runner2/tree/utils.c#n320
[2] http://git.yoctoproject.org/cgit/cgit.cgi/ptest-runner2/tree/utils.c#n432