Bug 13907

Summary: [QA 3.0.3 RC2] failure in ptest: zlib.zlib
Product: [QA/Testing] Package Testing (ptest) Reporter: Sangeeta Jain <sangeeta.jain>
Component: ptestAssignee: Anuj Mittal <anuj.mittal>
Status: RESOLVED OBSOLETE QA Contact:
Severity: normal    
Priority: Medium+ CC: akuster808, randy.macleod, richard.purdie, sangeeta.jain
Version: 3.0.4   
Target Milestone: 3.0.5   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ptest regression report none

Description Sangeeta Jain 2020-05-20 03:09:17 UTC
Created attachment 4680 [details]
ptest regression report

Following ptest is failing in current release(3.0.3.rc2) while passing in previous release(3.0.2.rc3): 

ptestresult.zlib.zlib

Regression is performed on ptest results for qemux86-64. 

ptest Results for current release:
https://autobuilder.yocto.io/pub/releases/yocto-3.0.3.rc2/testresults/qemux86-64-ptest/

ptest results for previous release:
https://autobuilder.yocto.io/pub/releases/yocto-3.0.2.rc3/testresults/qemux86-64-ptest/
Comment 1 Richard Purdie 2020-05-21 07:42:19 UTC
I reran the ptest for comparison, results are here: https://autobuilder.yocto.io/pub/non-release/20200521-9/testresults/qemux86-64-ptest/ (it passed this time). Maybe we should rerun it on the same host it failed on originally?
Comment 2 Anuj Mittal 2020-05-22 00:17:49 UTC
(In reply to comment #1)
> I reran the ptest for comparison, results are here:
> https://autobuilder.yocto.io/pub/non-release/20200521-9/testresults/qemux86-
> 64-ptest/ (it passed this time). Maybe we should rerun it on the same host
> it failed on originally?

I can't reproduce this. Do we have these individual test logs available for release builds as well? I can't find them. That might help understand what actually failed.
Comment 3 Richard Purdie 2020-05-22 15:27:37 UTC
Something like resulttool log --dump-ptest ./3.0.3 testresults-3.0.3.json will pull them from the release json file. Sadly its not particularly helpful :/
Comment 4 akuster 2020-08-21 17:01:05 UTC
this test pasted now. 

please confirm.
Comment 5 Anuj Mittal 2020-08-23 17:52:14 UTC
Yes, it did. I wonder if we should close the bug if there are not going to be any more zeus releases? 

I didn't backport any patch to fix this so the test might still fail I guess but we don't know when it fails ...
Comment 6 Anuj Mittal 2020-12-09 06:22:42 UTC
This has not happened since on master/dunfell/gatesgarth and zeus is not being actively maintained anymore. So closing.