Bug 13907 - [QA 3.0.3 RC2] failure in ptest: zlib.zlib
Summary: [QA 3.0.3 RC2] failure in ptest: zlib.zlib
Status: RESOLVED OBSOLETE
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: 3.0.4
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 3.0.5
Assignee: Anuj Mittal
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2020-05-20 03:09 UTC by Sangeeta Jain
Modified: 2020-12-09 06:22 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
ptest regression report (57.59 KB, application/octet-stream)
2020-05-20 03:09 UTC, Sangeeta Jain
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Sangeeta Jain 2020-05-20 03:09:17 UTC
Created attachment 4680 [details]
ptest regression report

Following ptest is failing in current release(3.0.3.rc2) while passing in previous release(3.0.2.rc3): 

ptestresult.zlib.zlib

Regression is performed on ptest results for qemux86-64. 

ptest Results for current release:
https://autobuilder.yocto.io/pub/releases/yocto-3.0.3.rc2/testresults/qemux86-64-ptest/

ptest results for previous release:
https://autobuilder.yocto.io/pub/releases/yocto-3.0.2.rc3/testresults/qemux86-64-ptest/
Comment 1 Richard Purdie 2020-05-21 07:42:19 UTC
I reran the ptest for comparison, results are here: https://autobuilder.yocto.io/pub/non-release/20200521-9/testresults/qemux86-64-ptest/ (it passed this time). Maybe we should rerun it on the same host it failed on originally?
Comment 2 Anuj Mittal 2020-05-22 00:17:49 UTC
(In reply to comment #1)
> I reran the ptest for comparison, results are here:
> https://autobuilder.yocto.io/pub/non-release/20200521-9/testresults/qemux86-
> 64-ptest/ (it passed this time). Maybe we should rerun it on the same host
> it failed on originally?

I can't reproduce this. Do we have these individual test logs available for release builds as well? I can't find them. That might help understand what actually failed.
Comment 3 Richard Purdie 2020-05-22 15:27:37 UTC
Something like resulttool log --dump-ptest ./3.0.3 testresults-3.0.3.json will pull them from the release json file. Sadly its not particularly helpful :/
Comment 4 akuster 2020-08-21 17:01:05 UTC
this test pasted now. 

please confirm.
Comment 5 Anuj Mittal 2020-08-23 17:52:14 UTC
Yes, it did. I wonder if we should close the bug if there are not going to be any more zeus releases? 

I didn't backport any patch to fix this so the test might still fail I guess but we don't know when it fails ...
Comment 6 Anuj Mittal 2020-12-09 06:22:42 UTC
This has not happened since on master/dunfell/gatesgarth and zeus is not being actively maintained anymore. So closing.