AssertionError: Failed ptests: {'openssl': ['Dubious,_test_returned_1']} qemuarm64-ptest ubuntu2004-arm-1 https://autobuilder.yoctoproject.org/typhoon/#builders/82/builds/2586/steps/12/logs/stdio qemux86-64-ptest debian10-ty-2 https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/2865/steps/12/logs/stdio Both on the same a-full run
Was from the v1 of https://git.yoctoproject.org/poky/commit/?id=1121148f1302e14319c0f516c222671c0480e492 and fixed in v2
Created attachment 5135 [details] logs from valkyrie.yocto.io
Happened again in qemuriscv64-ptest: https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/379/steps/12/logs/stdio Failed ptests:{'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuriscv64-ptest fedora42-vk-1
Reopening.
Watch to see if it happens again.
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/2333/steps/13/logs/stdio qemuarm64-ptest ubuntu2404-vk-arm1
Second occurrence after 6 weeks so raise to Medium+. YP has ~ 80 such 'rare' bugs but taken together they make regression tests unreliable.
I managed to reproduce this in qemuriscv64, under extreme CPU load (I got the same stacktrace also, as it is in the attachment above) - basically a test times out. 1. Start qemu with core-image-ptest-openssl 2. On the host machine generate load[1] 3. For good measure generate load inside qemu[1] also 4. Run the tests (just a few targeted ones): cd /usr/lib/openssl/ptest export TOP=. export HARNESS_JOBS=4 for i in `seq 20`; do ./run-ptest test_quic_radix test_rand test_algorithmid test_dh; done done # only test_quic_radix is expected to fail, the rest are just extra load # on my machine it happens in 1-3 iterations [1]: I used this load generator in- and outside of qemu: for i in `seq $(nproc)`; do yes > /dev/null & done (don't forget "killall yes" when you are done)
1. I have sent a patch[1] to extend the timeout for this particular test (3s -> 6s) 2. I see now that I messed up the reproduction script in my previous comment... This supposed to be it, (hopefully) without invalid syntax: cd /usr/lib/openssl/ptest for i in `seq 20`; do ./run-ptest test_quic_radix test_rand test_algorithmid test_dh done The patch allows the test pass even if I peg all my CPU cores during test execution, both in- and outside of qemu. [1]: https://lists.openembedded.org/g/openembedded-core/message/225228
https://git.openembedded.org/openembedded-core/commit/?id=561aba8d38d1e15d23bd13736013825bd04aff2c