| Summary: | AB-INT PTEST: openssl ptest failure in Dubious,_test_returned_1 | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [QA/Testing] Package Testing (ptest) | Reporter: | Alexandre Belloni <alexandre.belloni> | ||||
| Component: | ptest | Assignee: | Unassigned <unassigned> | ||||
| Status: | RESOLVED FIXED | QA Contact: | |||||
| Severity: | normal | ||||||
| Priority: | Medium+ | CC: | joaomarcos.costa, randy.macleod, richard.purdie, skandigraun, tgamblin, yoann.congal | ||||
| Version: | 3.4 | ||||||
| Target Milestone: | 5.3 M4 | ||||||
| Hardware: | x86 | ||||||
| OS: | Multiple | ||||||
| Whiteboard: | AB-INT | ||||||
| OS type for building Yocto: | --- | Type of Regression: | --- | ||||
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |||||
| Attachments: |
|
||||||
Was from the v1 of https://git.yoctoproject.org/poky/commit/?id=1121148f1302e14319c0f516c222671c0480e492 and fixed in v2 Created attachment 5135 [details]
logs from valkyrie.yocto.io
Happened again in qemuriscv64-ptest: https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/379/steps/12/logs/stdio Failed ptests:{'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuriscv64-ptest fedora42-vk-1 Reopening. Watch to see if it happens again. https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/2333/steps/13/logs/stdio qemuarm64-ptest ubuntu2404-vk-arm1 Second occurrence after 6 weeks so raise to Medium+. YP has ~ 80 such 'rare' bugs but taken together they make regression tests unreliable. I managed to reproduce this in qemuriscv64, under extreme CPU load (I got the same stacktrace also, as it is in the attachment above) - basically a test times out. 1. Start qemu with core-image-ptest-openssl 2. On the host machine generate load[1] 3. For good measure generate load inside qemu[1] also 4. Run the tests (just a few targeted ones): cd /usr/lib/openssl/ptest export TOP=. export HARNESS_JOBS=4 for i in `seq 20`; do ./run-ptest test_quic_radix test_rand test_algorithmid test_dh; done done # only test_quic_radix is expected to fail, the rest are just extra load # on my machine it happens in 1-3 iterations [1]: I used this load generator in- and outside of qemu: for i in `seq $(nproc)`; do yes > /dev/null & done (don't forget "killall yes" when you are done) 1. I have sent a patch[1] to extend the timeout for this particular test (3s -> 6s) 2. I see now that I messed up the reproduction script in my previous comment... This supposed to be it, (hopefully) without invalid syntax: cd /usr/lib/openssl/ptest for i in `seq 20`; do ./run-ptest test_quic_radix test_rand test_algorithmid test_dh done The patch allows the test pass even if I peg all my CPU cores during test execution, both in- and outside of qemu. [1]: https://lists.openembedded.org/g/openembedded-core/message/225228 |
AssertionError: Failed ptests: {'openssl': ['Dubious,_test_returned_1']} qemuarm64-ptest ubuntu2004-arm-1 https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/2586/steps/12/logs/stdio qemux86-64-ptest debian10-ty-2 https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/2865/steps/12/logs/stdio Both on the same a-full run