| Summary: | AB-INT PTEST: openssl ['Dubious,_test_returned_1', 'openssl'] test failure | ||
|---|---|---|---|
| Product: | [QA/Testing] Package Testing (ptest) | Reporter: | João Marcos Costa <joaomarcos.costa> |
| Component: | ptest | Assignee: | Pratik Farkase <pratik.farkase> |
| Status: | NEW --- | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium | CC: | alexandre.belloni, mathieu.dubois-briand, pratik.farkase, randy.macleod, richard.purdie, ross.burton, yoann.congal |
| Version: | unspecified | ||
| Target Milestone: | 6.2 | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | AB-INT | ||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | Don't know | |
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6233/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 Bulk move from 5.0* to 5.99 to indicate that there isn't any one available to work on this issue. https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6406/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6505/steps/12/logs/stdio qemuarm64-ptest ubuntu2204-arm-1 # ERROR: (ptr) 'res != NULL' failed @ /usr/src/debug/openssl/3.3.0/test/cmp_client_test.c:138
# 0x0
# CMP info: received IP
# CMP info: received 'waiting' PKIStatus, starting to poll for response
# CMP info: received POLLREP
# CMP info: received polling response; checkAfter = 1 seconds
# CMP info: received IP
# CMP info: received final response after polling
# CMP info: received ERROR (waiting)
# CMP info: received 'waiting' PKIStatus, starting to poll for response
# CMP info: received POLLREP
# CMP info: received polling response; checkAfter = 1 seconds
# CMP error: total timeout
# CMP error: polling failed
# OPENSSL_TEST_RAND_SEED=1717636581
not ok 8 - test_exec_IR_ses_poll_no_timeout
# ERROR: (ptr) 'res != NULL' failed @ /usr/src/debug/openssl/3.3.0/test/cmp_client_test.c:138
# 0x0
# CMP info: received IP
# CMP info: received 'waiting' PKIStatus, starting to poll for response
# CMP info: received POLLREP
# CMP info: received polling response; checkAfter = 1 seconds
# CMP info: received IP
# CMP info: received final response after polling
# CMP error: total timeout
# OPENSSL_TEST_RAND_SEED=1715432272
not ok 8 - test_exec_IR_ses_poll_no_timeout
I'm guessing the one second timeout is a bit tight on a loaded system? Note, this was previously tracked as 14856 and 14649 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6628/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6687/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6819/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 Hasn't happened on new YP AB and was only happening on Ubuntu 18.04 https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/257/steps/13/logs/stdio qemuriscv64-ptest rocky8-vk-1 Reopening. Maybe we're seeing this as risc-v is slower and this may be timing related? https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/2299/steps/13/logs/stdio Failed ptests:{'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuarm64-ptest ubuntu2004-vk-arm1 qemuriscv64-ptest fedora40-vk-2 mathieu/master-next-tests&mathieu/master-next completed at 2026-02-26 15:15:59+00:00 https://valkyrie.yocto.io/pub/non-release/20260226-91/testresults/qemuriscv64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1135/steps/13/logs/stdio qemuarm64-ptest debian13-vk-arm1 mathieu/master-next&mathieu/master-next-tests completed at 2026-03-29 20:13:11+00:00 https://valkyrie.yocto.io/pub/non-release/20260329-99/testresults/qemuarm64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/3376/steps/13/logs/stdio qemuriscv64-ptest ubuntu2204-vk-4 master completed at 2026-04-30 02:50:06+00:00 https://valkyrie.yocto.io/pub/non-release/20260430-8/testresults/qemuriscv64-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1532/steps/13/logs/stdio https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/3603/steps/13/logs/stdio Failed ptests: {'openssl': ['Dubious,_test_returned_1', 'openssl']} qemuarm64-ptest stream10-vk-arm1 --- # OPENSSL_TEST_RAND_SEED=1778030478 not ok 2 - test_script # ------------------------------------------------------------------------------ ../../util/wrap.pl ../../test/quic_multistream_test ../../test/certs/servercert.pem ../../test/certs/serverkey.pem => 1 not ok 1 # ------------------------------------------------------------------------------ # Looks like you failed 1 test of 2.70-test_quic_multistream.t .............. FAIL: Dubious, test returned 1 (wstat 256, 0x100) --- Full logs at https://valkyrie.yocto.io/pub/non-release/20260506-8/testresults/qemuarm64-ptest/openssl.log Bulk move of 6.0 Medium bugs to 6.1. Test was disabled: https://git.openembedded.org/openembedded-core/commit/?id=b00cb41a7cd5be88cb7402418a1cc34e094887a5 https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1286/steps/15/logs/stdio qemuarm64-musl-ptest ubuntu2404-vk-arm1 """ ../../util/wrap.pl ../../test/sslapitest ../../test/certs ../../test/recipes/90-test_sslapi_data/passwd.txt /tmp/0LL13no3rH default ../../test/default.cnf ../../test/recipes/90-test_sslapi_data/dhparams.pem ../../test/recipes/90-test_sslapi_data => 1 not ok 1 - running sslapitest # ------------------------------------------------------------------------------ # Looks like you failed 1 test of 4.[13:35:29] 90-test_sslapi.t ......................... FAIL: Dubious, test returned 1 (wstat 256, 0x100) """ test_quic_multistream is indeed disabled, but 'sslapitest' is the test case failing at this latest occurrence. Reopening. Pratik, Can you work on this ptest failure. Yes Randy, let me see I tracked the failure down to a single sslapitest subtest, test_early_data_skip:
# ERROR: (int) 'SSL_read_early_data(serverssl, buf, sizeof(buf), &readbytes) == SSL_READ_EARLY_DATA_FINISH' failed @ test/sslapitest.c:4733
# [1] compared to [2]
# not ok 180 - iteration 13
# not ok 34 - test_early_data_skip
...
not ok 1 - running sslapitest
# Looks like you failed 1 test of 4.
90-test_sslapi.t ......................... FAIL
I suspect that's probably under slow qemuarm64-musl emulation that looks like it races the ticket-age tolerance, so the test returns ERROR instead of the expected result. All the other sslapitest subtests pass, so this looks like an intermittent timing/race issue rather than a real failure. Shall we keep an eye on it and, if it fails again, i will send a patch to skip this one like test_quic_multistream.
> Shall we keep an eye on it and, if it fails again,
> i will send a patch to skip this one like test_quic_multistream.
Yes, good plan. Thanks.
qemuarm64-musl-ptest debian13-vk-arm1 mathieu/master-next completed at 2026-11-06 19:27:02+00:00 https://valkyrie.yocto.io/pub/non-release/20261106-110/testresults/qemuarm64-musl-ptest/ https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1518/steps/15/logs/stdio |
WARNING: core-image-ptest-openssl-1.0-r0 do_testimage: There were failing ptests. Traceback (most recent call last): File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f return func(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 27, in test_ptestrunner_expectfail self.do_ptestrunner() File "/home/pokybuild/yocto-worker/qemuarm64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 120, in do_ptestrunner self.fail(failmsg) AssertionError: Failed ptests: {'openssl': ['Dubious,_test_returned_1', 'openssl']} https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5783/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1