Bug 14808

Summary: AB-INT PTEST: gstreamer ptest failure: in gstreamer/libs_gstnetclientclock.test
Product: [QA/Testing] Package Testing (ptest) Reporter: Luca Ceresoli <luca.ceresoli>
Component: ptestAssignee: Unassigned <unassigned>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: alexandre.belloni, chee.yang.lee, joaomarcos.costa, luca.ceresoli, raj.khem, randy.macleod, richard.purdie, ross.burton
Version: unspecified   
Target Milestone: 5.0   
Hardware: x86   
OS: Multiple   
Whiteboard: AB-INT
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Luca Ceresoli 2022-05-20 12:51:35 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3516/steps/12/logs/stdio

qemux86-64-ptest on fedora34-ty-1

Similar to https://bugzilla.yoctoproject.org/show_bug.cgi?id=14780

WARNING: core-image-ptest-all-1.0-r0 do_testimage: There were failing ptests.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
  File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 25, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/home/pokybuild/yocto-worker/qemux86-64-ptest/build/meta/lib/oeqa/runtime/cases/ptest.py", line 112, in do_ptestrunner
    self.fail(failmsg)

AssertionError: Failed ptests:
{'gstreamer1.0': ['gstreamer/libs_gstnetclientclock.test']}

Cannot run ptests without @expectedFailure as ptests are expected to fail
Output from runqemu:
runqemu - INFO - SIGTERM received
runqemu - INFO - Cleaning up
runqemu - INFO - Removing /home/pokybuild/tmp/core-image-ptest-all-qemux86-64.ext4.413471
tput: No value for $TERM and no -T specified
tput: No value for $TERM and no -T specified
Comment 1 Richard Purdie 2022-05-26 14:50:33 UTC 
May need to disable this test as it sounds timing related.
Comment 2 Alexandre Belloni 2022-08-10 21:43:52 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3749/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-3

Running suite(s): GstNetClientClock
50%: Checks: 2, Failures: 1, Errors: 0
../gstreamer-1.20.3/tests/check/libs/gstnetclientclock.c:99:F:generic tests:test_functioning:0: clocks not in sync (2793759564:00:924385520.3775743120)
Check suite gst_net_client_clock ran in 1.003s (tests failed: 1)
FAIL: gstreamer/libs_gstnetclientclock.test (Child process exited with code 1)
Comment 3 Alexandre Belloni 2022-08-11 10:30:49 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3751/steps/13/logs/stdio

qemux86-64-ptest ubuntu2204-ty-1
Comment 4 Alexandre Belloni 2022-09-08 12:13:30 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/3973/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-3
Comment 6 Alexandre Belloni 2022-10-14 16:36:06 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/4125/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-2
Comment 7 Alexandre Belloni 2022-10-27 19:22:11 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/4127/steps/13/logs/stdio
qemux86-64-ptest opensuse154-ty-2
Comment 9 Alexandre Belloni 2022-12-08 10:45:38 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/4350/steps/13/logs/stdio
qemux86-64-ptest opensuse154-ty-3
Comment 11 Alexandre Belloni 2023-01-12 11:05:58 UTC 
https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/4545/steps/13/logs/stdio
qemux86-64-ptest opensuse154-ty-2
Comment 12 Alexandre Belloni 2023-01-12 15:16:00 UTC 
https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/4544/steps/13/logs/stdio
qemux86-64-ptest opensuse154-ty-1
Comment 13 Alexandre Belloni 2023-01-26 16:26:30 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4398/steps/12/logs/stdio
qemuarm64-ptest ubuntu2204-arm-1
Comment 14 Alexandre Belloni 2023-02-23 15:28:27 UTC 
https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/4557/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-2
Comment 15 Alexandre Belloni 2023-03-03 13:20:34 UTC 
https://autobuilder.yoctoproject.org/typhoon/#builders/81/builds/4753/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-3
Comment 16 Alexandre Belloni 2023-06-08 21:54:04 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/4894/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 17 Alexandre Belloni 2023-06-09 19:56:01 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5112/steps/13/logs/stdio

qemux86-64-ptest opensuse154-ty-3
Comment 18 Alexandre Belloni 2023-09-07 14:28:57 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5375/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 19 Alexandre Belloni 2023-09-21 16:22:05 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5646/steps/12/logs/stdio

qemux86-64-ptest fedora37-ty-3
Comment 20 Randy MacLeod 2023-10-30 15:37:25 UTC 
Build move to 5.0 -- ../Randy
Comment 21 Alexandre Belloni 2023-12-11 17:46:29 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/6023/steps/12/logs/stdio

qemux86-64-ptest fedora38-ty-2
Comment 22 Alexandre Belloni 2023-12-11 18:44:31 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5829/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 23 Alexandre Belloni 2024-01-11 14:04:23 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5919/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 24 João Marcos Costa 2024-01-17 09:28:10 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/6144/steps/12/logs/stdio

qemux86-64-ptest alma9-ty-2
Comment 25 João Marcos Costa 2024-01-17 13:04:32 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5773/steps/12/logs/stdio

qemux86-64-ptest fedora38-ty-4
Comment 26 João Marcos Costa 2024-01-17 13:09:08 UTC 
(In reply to João Marcos Costa from comment #25)
> https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5773/steps/
> 12/logs/stdio
> 
> qemux86-64-ptest fedora38-ty-4

Edit: qemuarm64-ptest ubuntu2204-arm-1
Comment 27 João Marcos Costa 2024-01-18 09:28:36 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/5936/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 28 Khem Raj 2024-01-30 20:44:53 UTC 
https://gitlab.freedesktop.org/gstreamer/gstreamer/-/blob/main/subprojects/gstreamer/tests/check/libs/gstnetclientclock.c?ref_type=heads#L91-L98

Seems that on failure if we can capture diff of server and client time, it might show us some more details.

It could just be that we need to raise the timeouts a bit here, so cope for the fact that we are running on emulator and loaded systems often times can flair up the situation.
Comment 29 João Marcos Costa 2024-02-22 13:44:54 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6111/steps/12/logs/stdio

qemuarm64-ptest ubuntu2204-arm-1
Comment 30 João Marcos Costa 2024-02-22 13:57:52 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/82/builds/6102/steps/13/logs/stdio

qemuarm64-ptest ubuntu1804-arm-1
Comment 31 Ross Burton 2024-02-29 15:53:13 UTC 
/usr/src/debug/gstreamer1.0/1.22.10/tests/check/libs/gstnetclientclock.c:99:F:generic tests:test_functioning:0: clocks not in sync (3018655596:00:00.000053012)

Check suite gst_net_client_clock ran in 1.050s (tests failed: 1)

FAIL: gstreamer/libs_gstnetclientclock.test (Child process exited with code 1)
Comment 32 João Marcos Costa 2024-03-06 13:15:43 UTC 
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/6348/steps/12/logs/stdio

qemux86-64-ptest debian12-ty-1
Comment 33 Ross Burton 2024-03-15 17:01:32 UTC 
Patch on the list.
Comment 34 Ross Burton 2024-03-20 12:18:05 UTC 
Hopefully fixed with 669d0df81f651f7c033c8cb7872cac5bfe670a4f.
Comment 35 Chee Yang 2024-11-25 02:18:26 UTC 
happen again during 4.0.23 rc1 build 
https://valkyrie.yoctoproject.org/#/builders/73/builds/394
qemux86-64  ubuntu2004-vk-2
Comment 36 Ross Burton 2024-11-26 17:15:31 UTC 
I meant 669d0df81f651f7c033c8cb7872cac5bfe670a4f, "gstreamer1.0: improve test reliability".

This commit has not been backported to kirkstone, so appearing there isn't unexpected.