Bug 13522

Summary: libevent: inconsistent ptest results compared to autobuilder
Product: [QA/Testing] Package Testing (ptest) Reporter: Trevor Gamblin <tvgamblin>
Component: ptestAssignee: Oleg Polyakov <Oleg.Polyakov>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: randy.macleod, richard.purdie, sangeeta.jain, tvgamblin
Version: unspecified   
Target Milestone: 3.1 M2   
Hardware: x86   
OS: x86_64   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
libevent qemu log none

Description Trevor Gamblin 2019-09-12 17:29:55 UTC
Created attachment 4560 [details]
libevent qemu log

While troubleshooting https://bugzilla.yoctoproject.org/show_bug.cgi?id=13465, the failures for libevent's ptests were unable to be replicated on a local machine running QEMU.

Testing on local build systems reported 300 tests passed, 16 skipped (see attached log). Compare attached with: https://autobuilder.yocto.io/pub/non-release/20190911-7/testresults/qemux86-64-ptest/libevent.log

May be something simple, but clarification on autobuilder environment would help nail down the issue.
Comment 1 Richard Purdie 2019-09-19 14:36:00 UTC
Its run as part of a core-image-sato-ptest which has various ptests installed in it which may be the difference.
Comment 2 Oleg Polyakov 2020-01-21 19:21:16 UTC
The failed tests were removed in a later commit:
    Date: Jan 14 2020
    libevent: disable ptests that require a DNS and an Iternet connection

However, these disabled tests run successfully in local QEMU.

Assumption: the tests fail due to the unstable network connection in autobuilder environment.

Conclusion: Since the tests were already removed, nothing should be done here, and the ticket is to be closed.
Comment 3 Oleg Polyakov 2020-01-21 19:23:57 UTC
See previous comment
Comment 4 Randy MacLeod 2020-01-21 20:41:49 UTC
The commit URL that disabled these tests, to save anyone the look-up time:

http://git.openembedded.org/openembedded-core/commit/?id=65ef2810e94bb8feb6be5febfe8a7b73076c3420