15357 2024-01-17 16:33:27 +0000 AB-INT PTEST: openssl ['Dubious,_test_returned_1', 'openssl'] test failure 2026-11-09 08:53:53 +0000 1 1 10 QA/Testing Package Testing (ptest) ptest unspecified x86 Multiple NEW AB-INT Medium normal 6.2 1 joaomarcos.costa pratik.farkase alexandre.belloni mathieu.dubois-briand pratik.farkase randy.macleod richard.purdie ross.burton yoann.congal --- --- Don't know oldest_to_newest 97883 0 joaomarcos.costa 2024-01-17 16:33:27 +0000 WARNING: core-image-ptest-openssl-1.0-r0 do_testimage: There were failing ptests. Traceback (most recent call last): File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 27, in test_ptestrunner_expectfail self.do_ptestrunner() File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 120, in do_ptestrunner self.fail(failmsg) AssertionError: Failed ptests: {'openssl': ['Dubious,_test_returned_1', 'openssl']} https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5783/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 98606 1 joaomarcos.costa 2024-03-25 16:08:43 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6233/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 98793 2 randy.macleod 2024-04-24 20:30:25 +0000 Bulk move from 5.0* to 5.99 to indicate that there isn't any one available to work on this issue. 99003 3 joaomarcos.costa 2024-05-13 08:54:10 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6406/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 99152 4 joaomarcos.costa 2024-06-07 07:32:27 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6505/steps/12/logs/stdio qemuarm64-ptest ubuntu2204-arm-1 99187 5 ross.burton 2024-06-13 14:56:05 +0000 # ERROR: (ptr) 'res != NULL' failed @ /usr/src/debug/openssl/3.3.0/test/cmp_client_test.c:138 # 0x0 # CMP info: received IP # CMP info: received 'waiting' PKIStatus, starting to poll for response # CMP info: received POLLREP # CMP info: received polling response; checkAfter = 1 seconds # CMP info: received IP # CMP info: received final response after polling # CMP info: received ERROR (waiting) # CMP info: received 'waiting' PKIStatus, starting to poll for response # CMP info: received POLLREP # CMP info: received polling response; checkAfter = 1 seconds # CMP error: total timeout # CMP error: polling failed # OPENSSL_TEST_RAND_SEED=1717636581 not ok 8 - test_exec_IR_ses_poll_no_timeout 99188 6 ross.burton 2024-06-13 14:56:46 +0000 # ERROR: (ptr) 'res != NULL' failed @ /usr/src/debug/openssl/3.3.0/test/cmp_client_test.c:138 # 0x0 # CMP info: received IP # CMP info: received 'waiting' PKIStatus, starting to poll for response # CMP info: received POLLREP # CMP info: received polling response; checkAfter = 1 seconds # CMP info: received IP # CMP info: received final response after polling # CMP error: total timeout # OPENSSL_TEST_RAND_SEED=1715432272 not ok 8 - test_exec_IR_ses_poll_no_timeout 99189 7 ross.burton 2024-06-13 14:57:19 +0000 I'm guessing the one second timeout is a bit tight on a loaded system? 99199 8 alexandre.belloni 2024-06-13 17:37:22 +0000 Note, this was previously tracked as 14856 and 14649 99383 9 joaomarcos.costa 2024-07-15 08:46:10 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6628/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 99552 10 joaomarcos.costa 2024-08-19 11:49:50 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6687/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 99669 11 joaomarcos.costa 2024-09-13 15:35:06 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6819/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 100936 12 randy.macleod 2025-02-13 15:42:38 +0000 Hasn't happened on new YP AB and was only happening on Ubuntu 18.04 102526 13 joaomarcos.costa 2025-07-30 11:38:01 +0000 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/257/steps/13/logs/stdio qemuriscv64-ptest rocky8-vk-1 Reopening. 102534 14 richard.purdie 2025-07-31 14:44:39 +0000 Maybe we're seeing this as risc-v is slower and this may be timing related? 102812 15 joaomarcos.costa 2025-09-25 08:11:34 +0000 https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/2299/steps/13/logs/stdio Failed ptests:{'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuarm64-ptest ubuntu2004-vk-arm1 104438 16 mathieu.dubois-briand 2026-02-27 10:26:47 +0000 qemuriscv64-ptest fedora40-vk-2 mathieu/master-next-tests&mathieu/master-next completed at 2026-02-26 15:15:59+00:00 https://valkyrie.yocto.io/pub/non-release/20260226-91/testresults/qemuriscv64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1135/steps/13/logs/stdio 104866 17 mathieu.dubois-briand 2026-03-31 09:03:21 +0000 qemuarm64-ptest debian13-vk-arm1 mathieu/master-next&mathieu/master-next-tests completed at 2026-03-29 20:13:11+00:00 https://valkyrie.yocto.io/pub/non-release/20260329-99/testresults/qemuarm64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/3376/steps/13/logs/stdio 105304 18 mathieu.dubois-briand 2026-04-30 08:32:19 +0000 qemuriscv64-ptest ubuntu2204-vk-4 master completed at 2026-04-30 02:50:06+00:00 https://valkyrie.yocto.io/pub/non-release/20260430-8/testresults/qemuriscv64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1532/steps/13/logs/stdio 105360 19 joaomarcos.costa 2026-05-06 07:30:50 +0000 https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/3603/steps/13/logs/stdio Failed ptests: {'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuarm64-ptest stream10-vk-arm1 --- # OPENSSL_TEST_RAND_SEED=1778030478 not ok 2 - test_script # ------------------------------------------------------------------------------ ../../util/wrap.pl ../../test/quic_multistream_test ../../test/certs/servercert.pem ../../test/certs/serverkey.pem => 1 not ok 1 # ------------------------------------------------------------------------------ # Looks like you failed 1 test of 2.70-test_quic_multistream.t .............. FAIL: Dubious, test returned 1 (wstat 256, 0x100) --- Full logs at https://valkyrie.yocto.io/pub/non-release/20260506-8/testresults/qemuarm64-ptest/openssl.log 105613 20 randy.macleod 2026-05-28 13:16:30 +0000 Bulk move of 6.0 Medium bugs to 6.1. 106578 21 mathieu.dubois-briand 2026-08-20 12:49:36 +0000 Test was disabled: https://git.openembedded.org/openembedded-core/commit/?id=b00cb41a7cd5be88cb7402418a1cc34e094887a5 106963 22 joaomarcos.costa 2026-09-30 07:52:31 +0000 https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1286/steps/15/logs/stdio qemuarm64-musl-ptest ubuntu2404-vk-arm1 """ ../../util/wrap.pl ../../test/sslapitest ../../test/certs ../../test/recipes/90-test_sslapi_data/passwd.txt /tmp/0LL13no3rH default ../../test/default.cnf ../../test/recipes/90-test_sslapi_data/dhparams.pem ../../test/recipes/90-test_sslapi_data => 1 not ok 1 - running sslapitest # ------------------------------------------------------------------------------ # Looks like you failed 1 test of 4.[13:35:29] 90-test_sslapi.t ......................... FAIL: Dubious, test returned 1 (wstat 256, 0x100) """ test_quic_multistream is indeed disabled, but 'sslapitest' is the test case failing at this latest occurrence. Reopening. 106980 23 randy.macleod 2026-10-01 14:49:32 +0000 Pratik, Can you work on this ptest failure. 106988 24 pratik.farkase 2026-10-01 17:39:06 +0000 Yes Randy, let me see 106999 25 pratik.farkase 2026-10-02 11:15:36 +0000 I tracked the failure down to a single sslapitest subtest, test_early_data_skip: # ERROR: (int) 'SSL_read_early_data(serverssl, buf, sizeof(buf), &readbytes) == SSL_READ_EARLY_DATA_FINISH' failed @ test/sslapitest.c:4733 # [1] compared to [2] # not ok 180 - iteration 13 # not ok 34 - test_early_data_skip ... not ok 1 - running sslapitest # Looks like you failed 1 test of 4. 90-test_sslapi.t ......................... FAIL I suspect that's probably under slow qemuarm64-musl emulation that looks like it races the ticket-age tolerance, so the test returns ERROR instead of the expected result. All the other sslapitest subtests pass, so this looks like an intermittent timing/race issue rather than a real failure. Shall we keep an eye on it and, if it fails again, i will send a patch to skip this one like test_quic_multistream. 107005 26 randy.macleod 2026-10-02 20:24:43 +0000 > Shall we keep an eye on it and, if it fails again, > i will send a patch to skip this one like test_quic_multistream. Yes, good plan. Thanks. 107340 27 mathieu.dubois-briand 2026-11-09 08:53:53 +0000 qemuarm64-musl-ptest debian13-vk-arm1 mathieu/master-next completed at 2026-11-06 19:27:02+00:00 https://valkyrie.yocto.io/pub/non-release/20261106-110/testresults/qemuarm64-musl-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1518/steps/15/logs/stdio