Created attachment 4544 [details] ptest regression results We took ptest results from autobuilder and did ptest regression. 1. Download ptest results for current and previous release. 2. Run resulttool regression for ptest 3. Identify test that passed previous release and failed this release Previous release https://autobuilder.yocto.io/pub/releases/yocto-2.8_M1.rc2/testresults/qemux86-64-ptest/ Current release https://autobuilder.yocto.io/pub/releases/yocto-2.8_M2.rc1/testresults/qemux86-64-ptest/ We have observed failure in ptest regression results. Quilt ptestresult.quilt.remember-locations.test: FAILED -> PASSED ptestresult.quilt.project-settings.test: FAILED -> PASSED ptestresult.quilt.nolink.test: FAILED -> PASSED ptestresult.quilt.import.test: FAILED -> PASSED ptestresult.quilt.import2.test: FAILED -> PASSED ptestresult.quilt.add-filename-check.test: FAILED -> PASSED libevent ptestresult.libevent.libevent: FAILED -> PASSED Attaching failure log for quilt and libevent.
Created attachment 4545 [details] current ptest report
Created attachment 4546 [details] Previous ptest results
Created attachment 4547 [details] quilt log
Created attachment 4548 [details] libevent log
We have re-run the quilt and libevent module and found the same issue re-ocurring. (attached logs)
libevent has been updated so check it again.
libevent works after update. quilt patches at: https://patchwork.openembedded.org/patch/164208/ https://patchwork.openembedded.org/patch/164209/
Patches in master: http://git.openembedded.org/openembedded-core/commit/?id=64f9fd2a1ebfad102140801f8be8b8be33082d61 http://git.openembedded.org/openembedded-core/commit/?id=7ef7923bd9161d562298ace68491a2230210c3e4
https://autobuilder.yocto.io/pub/non-release/20190829-10/testresults/testresult-report.txt Recipe | Passed | Failed | Skipped | Time(s) qemuarm64 libevent | 0 | 1 | 0 | 117 quilt | 60 | 0 | 0 | 49 qemux86-64 libevent | 0 | 1 | 0 | 116 quilt | 60 | 0 | 0 | 29 There is still one failed ptest for libevent.
Unable to recreate the libevent failures. Is more detail on the autobuilder configuration available?
https://autobuilder.yocto.io/pub/non-release/20190829-10/testresults/qemux86-64-ptest/libevent.log
Submitted patches https://patchwork.openembedded.org/patch/164784/ and https://patchwork.openembedded.org/patch/164806/ to increase ptest granularity and show that libevent isn't outright failing. Closing.
(In reply to comment #12) > Submitted patches https://patchwork.openembedded.org/patch/164784/ and > https://patchwork.openembedded.org/patch/164806/ to increase ptest > granularity and show that libevent isn't outright failing. Closing. OE-core commit links: http://git.openembedded.org/openembedded-core/commit/?id=fb17b46e202cc08277d3eeb34872067c73a6bfbc http://git.openembedded.org/openembedded-core/commit/?id=86b8a1d534bfcd70775c6e2b59eabe10de29f526