Bug 15053 - AB-INT PTEST: lttng-tools tools/clear/test_ust_1377_-_Clear_session_QzDsZ1pWrhzCdsCL failure
Summary: AB-INT PTEST: lttng-tools tools/clear/test_ust_1377_-_Clear_session_QzDsZ1pWr...
Status: RESOLVED WORKSFORME
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium normal
Target Milestone: 6.0
Assignee: Mingli Yu
QA Contact:
URL:
Whiteboard: AB-INT
Depends on:
Blocks:
 
Reported: 2023-03-01 18:20 UTC by Alexandre Belloni
Modified: 2026-01-22 16:09 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
lttng-tools: test_ust failures (110.88 KB, application/gzip)
2024-10-16 08:49 UTC, João Marcos Costa
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandre Belloni 2023-03-01 18:20:29 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/4723/steps/12/logs/stdio

qemux86-64-ptest fedora37-ty-1

'lttng-tools': ['tools/clear/test_ust_1377_-_Clear_session_QzDsZ1pWrhzCdsCL']}

The log file just has:

FAIL: tools/clear/test_ust 1377 - Clear session QzDsZ1pWrhzCdsCL
Comment 1 Randy MacLeod 2023-06-15 14:52:29 UTC
Appears to have been fixed or gone away.
Comment 2 João Marcos Costa 2024-01-17 14:11:50 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/5765/steps/12/logs/stdio

qemux86-64-ptest alma9-ty-1
Comment 3 João Marcos Costa 2024-10-16 08:49:44 UTC
Created attachment 5075 [details]
lttng-tools: test_ust failures
Comment 4 João Marcos Costa 2024-10-16 08:51:02 UTC
https://valkyrie.yoctoproject.org/#/builders/73/builds/223/steps/12/logs/stdio

Failed ptests:
{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',
                 'tools/clear/test_ust_706_-_Babeltrace_succeeds',
                 'tools/clear/test_ust']}

qemux86-64-ptest ubuntu2004-vk-2

Reopening, since those failures come from test_ust.
Comment 5 João Marcos Costa 2024-11-07 15:35:52 UTC
https://valkyrie.yoctoproject.org/#/builders/73/builds/351/steps/13/logs/stdio

AssertionError: 
Failed ptests:
{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',
                 'tools/clear/test_ust']}

qemux86-64-ptest opensuse156-vk-1

The whole logs can be retrieved at:
https://valkyrie.yocto.io/pub/non-release/20241107-80/testresults/qemux86-64-ptest/core-image-ptest-lttng-tools/

Even compressed, it's largely beyond the file size limit, because there's what seems to be random binary data starting from line 34914 up to line 54235.
Comment 6 João Marcos Costa 2024-11-20 09:23:05 UTC
https://valkyrie.yoctoproject.org/#/builders/73/builds/407/steps/12/logs/stdio

qemux86-64-ptest debian11-vk-2
Comment 7 João Marcos Costa 2025-02-07 12:45:02 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/730/steps/12/logs/stdio

qemuarm64-ptest ubuntu2404-vk-arm1
Comment 8 João Marcos Costa 2025-02-21 08:50:59 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/991/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest debian12-vk-1
Comment 9 João Marcos Costa 2025-03-17 09:40:52 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1126/steps/13/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',                 'tools/clear/test_ust_706_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest rocky8-vk-1
Comment 10 João Marcos Costa 2025-04-04 09:18:23 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1245/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_706_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest fedora41-vk-1
Comment 11 João Marcos Costa 2025-04-22 08:02:52 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1341/steps/13/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest rocky8-vk-1
Comment 12 João Marcos Costa 2025-06-16 08:35:51 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1698/steps/12/logs/stdio

qemux86-64-ptest fedora40-vk-1
Comment 13 João Marcos Costa 2025-06-16 08:39:39 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/1700/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_kernel_799_-_Start_tracing_for_session_sNSOl7yAPdwEmLHr',                 'tools/clear/test_kernel_800_-_Stop_lttng_tracing_for_session_sNSOl7yAPdwEmLHr',                 'tools/clear/test_kernel_802_-_Destroy_session_sNSOl7yAPdwEmLHr',                 'tools/clear/test_kernel']}

qemuarm64-ptest ubuntu2204-vk-arm1
Comment 14 João Marcos Costa 2025-07-08 09:08:10 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1793/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest debian12-vk-1
Comment 15 João Marcos Costa 2025-07-08 09:11:57 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1829/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_486_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest debian12-vk-9
Comment 16 Randy MacLeod 2025-07-10 15:02:15 UTC
Mingli, is there a bug reported to upstream?
I'm told that they are usually quite helpful.
Comment 17 Mingli Yu 2025-07-11 09:17:33 UTC
No, didn't report to upstream until now as I can't reproduce the issue as pasted.
Comment 18 Randy MacLeod 2025-07-11 15:52:45 UTC
I understand and agree that usually a having a reproducer is sensible but the lttng team is used to the type of intermittent errors we see in YP AB (and deployed Telco systems), so please file a bug and report it here.
Comment 19 Mingli Yu 2025-07-14 09:44:13 UTC
I'm applying the permission to post issues via https://bugs.lttng.org/projects/lttng-tools.

And already taken some log from the attachment https://bugzilla.yoctoproject.org/attachment.cgi?id=5075 to ask some hints at https://lists.lttng.org/pipermail/lttng-dev/2025-July/030994.html.
Comment 20 Mingli Yu 2025-07-17 06:31:55 UTC
Is it possible to login to the failed host on autobuilder to check the log as attached https://bugzilla.yoctoproject.org/attachment.cgi?id=5075 which uploaded at 2024-10-16 08:49 UTC 
OR 
help to upload the corresponding log like tmp/work/qemux86_64-poky-linux/core-image-ptest-lttng-tools/1.0/testimage/ptest_log.20250710153833/ptest-runner.log for https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/1829/steps/12/logs/stdio?
Comment 21 Randy MacLeod 2025-07-17 19:21:50 UTC
Mathieu Can you help Mingli please since I'll be away for 2 weeks as of tomorrow.

I suspect that this log file is gone and the the right change to make it to patch some file (which one?) to copy the log out of the temporary AB logs when the next failure happens.
Comment 22 João Marcos Costa 2025-08-07 07:48:15 UTC
https://autobuilder.yoctoproject.org/valkyrie/#/builders/73/builds/2050/steps/12/logs/stdio

Failed ptests:{'lttng-tools': ['tools/clear/test_ust_706_-_Babeltrace_succeeds',                 'tools/clear/test_ust']}

qemux86-64-ptest fedora40-vk-1
Comment 23 Randy MacLeod 2025-08-14 15:51:46 UTC
Mingli,

Were you able to create an account and report this issue as a bug? Link?

Richard also mentioned that people are often on IRC on irc.oftc.net:6697 # lttng
and you might talk with them there. They know about the use of lttng in YP and so they should be willing to brainstorm with you across timezones...

Asking for people to manually collect logs is problematic in that:
1. there are lots of types of intermittent problems,
2. this one seems to only happen every month or so
3. Sometimes the build dir has been removed by the time the triage team gets around to reviewing the failures.

it's better to patch the lttng test code or run-ptest to check of this failure and send the  info  you're looking for to standard out (I think that's what you should do at least).
Comment 24 Mingli Yu 2025-10-27 08:32:13 UTC
Hi Randy,

As I said before, I didn't reproduce this issue locally and I will report the issue to the upstream if the issue occurs again in the autobuilder.
Comment 25 Randy MacLeod 2026-01-22 16:09:33 UTC
Hasn't occurred for 5 months. Perhaps fixed in a newer lttng in Aug 13th.