| Summary: | AB-INT PTEST: tcl socket.test failure | ||
|---|---|---|---|
| Product: | [QA/Testing] Package Testing (ptest) | Reporter: | Luca Ceresoli <luca.ceresoli> |
| Component: | ptest | Assignee: | Ross Burton <ross.burton> |
| Status: | RESOLVED FIXED | QA Contact: | |
| Severity: | normal | ||
| Priority: | Medium+ | CC: | alexandre.belloni, chee.yang.lee, luca.ceresoli, randy.macleod, richard.purdie |
| Version: | unspecified | ||
| Target Milestone: | 5.0 | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | AB-INT | ||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | No (bug/feature does not impact docs) | |
We should disable this test. Ross gets the bug as our resident TCL expert! https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/3343/steps/12/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 We probably want to disable this test so we can close the issue as it will likely come back. From the little tcl I know, this shouldn't be load-sensitive so we should be able to keep it. I'll ask the TCL people for advice but we're not seeing it often so this isn't a high priority fix. Hasn't happened for a while. https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/4267/steps/12/logs/stdio qemux86-64-ptest debian11-ty-3 Not seen in a while. If it happens again, we'll just disable some of the socket tests case. https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5200/steps/12/logs/stdio qemux86-64-ptest ubuntu2204-ty-3 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5315/steps/12/logs/stdio qemux86-64-ptest fedora38-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5547/steps/12/logs/stdio qemux86-64-ptest debian11-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5420/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5414/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 1 Patch to add skips sent. https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5700/steps/13/logs/stdio qemuarm64-ptest ubuntu1804-arm-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/6029/steps/13/logs/stdio qemux86-64-ptest fedora38-ty-4 this is also 3.1.30.rc2 build Hopefully fixed in 68beb4f4b5a0bea5d431decddf7656f18ac7a04a. |
Seen this tcl failure once: AssertionError: Failed ptests: {'openssl': ['Dubious,_test_returned_1'], 'tcl': ['socket.test']} (the openssl one is a separate issue, already solved) qemux86-64-ptest on ubuntu1604-ty-1 https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3565/steps/13/logs/stdio From https://autobuilder.yocto.io/pub/non-release/20220601-9/testresults/qemux86-64-ptest/tcl.log : -------------------8<------------------- FAIL: socket.test Tests running in interp: /usr/lib/tcl/ptest/tcltest Tests located in: /usr/lib/tcl/ptest/tests Tests running in: /usr/lib/tcl/ptest Temporary files stored in /usr/lib/tcl/ptest Test files run in separate interpreters Running tests that match: * Skipping test files that match: l.*.test Only running test files that match: socket.test Tests began at Wed Jun 01 13:01:00 BST 2022 socket.test ==== socket-14.14 testing fileevent readable on failed async socket connect FAILED ==== Contents of test case: # Test for bug 581937ab1e set a1 [after $latency {set x timeout}] # This connect should fail set s [socket -async localhost [randport]] fileevent $s readable {set x readable} vwait x set x ---- Result was: timeout ---- Result should have been (exact matching): readable ==== socket-14.14 FAILED Tests ended at Wed Jun 01 13:01:07 BST 2022 all.tcl: Total 173 Passed 156 Skipped 16 Failed 1 Sourced 1 Test Files. Files with failing tests: socket.test Number of tests skipped for each constraint: 1 nonPortable 4 notRoot 10 thread 1 win -------------------8<------------------- Similar, but not equal, to: https://bugzilla.yoctoproject.org/show_bug.cgi?id=14488