Bug 13429 - [QA 2.7.1.rc1] gstreamer1.0.pipelines/seek ptest failure
Summary: [QA 2.7.1.rc1] gstreamer1.0.pipelines/seek ptest failure
Status: RESOLVED NOTABUG
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: 2.7
Hardware: x86 Multiple
: Medium critical
Target Milestone: 2.7.1
Assignee: Anuj Mittal
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2019-07-05 01:55 UTC by pavan
Modified: 2019-07-16 09:32 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
resulttool report for 2.7.1.rc1 release (18.85 KB, text/plain)
2019-07-05 01:55 UTC, pavan
no flags Details
regression result for 2.7.1.rc1 (115.25 KB, text/plain)
2019-07-05 01:57 UTC, pavan
no flags Details
ptest testresult for gstreamer (17.73 KB, application/json)
2019-07-16 09:28 UTC, pavan
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description pavan 2019-07-05 01:55:26 UTC
Created attachment 4536 [details]
resulttool report for 2.7.1.rc1 release

while running ptest regression on 2.7.1.rc1, a new gstreamer1.0 package failure is observed.
failure:
     ptestresult.gstreamer1.0.pipelines/seek: FAILED -> PASSED

log files are attached.
Comment 1 pavan 2019-07-05 01:57:14 UTC
Created attachment 4537 [details]
regression result for 2.7.1.rc1
Comment 2 Armin Kuster 2019-07-08 15:53:42 UTC
can not reproduce this.
Comment 3 Armin Kuster 2019-07-08 16:41:40 UTC
Can i get some host details that this test was run on?
Comment 4 pavan 2019-07-09 02:01:00 UTC
Host: NUC
Architecture: qemux86-64
Comment 5 Randy MacLeod 2019-07-11 14:39:49 UTC
Anuj, this is on an Intel NUC, can you take a look please?
Comment 6 Anuj Mittal 2019-07-16 04:36:22 UTC
I can't reproduce this either. Pavan, can you please run gstreamer ptests and see if you get the same results as autobuilder?
Comment 7 pavan 2019-07-16 09:21:09 UTC
Initially, took ptest results from autobuilder and we compare these results. 

yocto-2.7.1.rc1
https://autobuilder.yocto.io/pub/releases/yocto-2.7.1.rc1/testresults/qemux86-64-ptest/testresults.json

yocto-2.7.rc2
https://autobuilder.yocto.io/pub/releases/yocto-2.7.rc2/testresults/qemux86-64-ptest/testresults.json

Below failure is observed: 
ptestresult.gstreamer1.0.pipelines/seek: FAILED -> PASSED
Comment 8 pavan 2019-07-16 09:28:16 UTC
Created attachment 4539 [details]
ptest testresult for gstreamer
Comment 9 pavan 2019-07-16 09:32:57 UTC
we re-run it and tried to reproduce the failure for qemux86-64
Ubuntu-16.04 as host environment
we did ptest regression for gstreamer package but, it is passing.

ptestresult.gstreamer1.0.pipelines/seek": {
                "status": "PASSED"

Attached testresults-(attachement 4539)

The bug is not reproducible. Hence, closing the ticket.