Bug 14392 - [QA 3.2.4 RC1] failure in ptest : ptestresult.lttng-tools.tools
Summary: [QA 3.2.4 RC1] failure in ptest : ptestresult.lttng-tools.tools
Status: RESOLVED WONTFIX
Alias: None
Product: Package Testing (ptest)
Classification: QA/Testing
Component: ptest (show other bugs)
Version: 3.2.4
Hardware: All x86_64
: Undecided normal
Target Milestone: ---
Assignee: Unassigned
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2021-05-11 04:02 UTC by Teoh Jay Shen
Modified: 2021-05-13 14:52 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments
ptest regression report (341.58 KB, text/plain)
2021-05-11 04:02 UTC, Teoh Jay Shen
no flags Details

Note You need to log in before you can comment on or make changes to this bug.
Description Teoh Jay Shen 2021-05-11 04:02:01 UTC
Created attachment 4799 [details]
ptest regression report

Following ptest is failing in current release(3.2.4 rc1) while passing in previous release(3.2.3 rc1): 

ptestresult.lttng-tools.tools/tracker/test_event_tracker_217_-_Validate_empty_trace

Regression is performed on ptest results for qemux86-64. 

ptest Results for current release:
https://autobuilder.yocto.io/pub/releases/yocto-3.2.4.rc1/testresults/qemux86-64-ptest/

ptest results for previous release:
https://autobuilder.yocto.io/pub/releases/yocto-3.2.3.rc1/testresults/qemux86-64-ptest/
Comment 1 Richard Purdie 2021-05-13 10:16:39 UTC
I reran this on the autobuilder:

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2083

which "passed" but shows some failures:

AssertionError: Failed ptests:
{'lttng-tools': ['tools/exclusion/test_exclusion_169_-_Excluded_event_"tp:tptest1"_was_found_in_trace!',
                 'tools/save-load/test_load_22_-_Destroy_session_tracker_legacy_all',
                 'tools/save-load/test_load_23_-_Destroy_session_tracker_legacy_none',
                 'tools/save-load/test_load_24_-_Destroy_session_tracker_legacy_selective',
                 'tools/tracker/test_event_tracker_208_-_Failed_to_parse_trace',
                 'tools/tracker/test_event_tracker_217_-_Validate_empty_trace',
                 'tools/tracker/test_event_tracker_250_-_Failed_to_parse_trace',
                 'tools/tracker/test_event_tracker_259_-_Validate_empty_trace',
                 'ust/namespaces/test_ns_contexts_change_15_-_Validate_trace_for_event_cgroup_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_16_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_31_-_Validate_trace_for_event_ipc_ns_=_4026532233',
                 'ust/namespaces/test_ns_contexts_change_32_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_47_-_Validate_trace_for_event_mnt_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_48_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_63_-_Validate_trace_for_event_net_ns_=_4026532237',
                 'ust/namespaces/test_ns_contexts_change_64_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_79_-_Validate_trace_for_event_uts_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_80_-_Read_a_total_of_0_events,_expected_1000'],
 'pango': ['pango/test-layout.test']}

The results logs are at:

http://autobuilder.yocto.io/pub/non-release/20210512-19/testresults/qemux86-64-ptest/lttng-tools.log

I looked back at the 3.2 baseline:

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2/testresults/testresult-report.txt

    ltpresult.syscalls.ptrace08
testseries | result_id : qemux86-64-ptest | runtime_core-image-sato-sdk-ptest_qemux86-64_20201026224228
    ptestresult.libinput.libinput-test-suite
    ptestresult.lttng-tools.tools/exclusion/test_exclusion_169_-_Excluded_event_"tp:tptest1"_was_found_in_trace!
    ptestresult.lttng-tools.tools/save-load/test_load_22_-_Destroy_session_tracker_legacy_all
    ptestresult.lttng-tools.tools/save-load/test_load_23_-_Destroy_session_tracker_legacy_none
    ptestresult.lttng-tools.tools/save-load/test_load_24_-_Destroy_session_tracker_legacy_selective
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_208_-_Failed_to_parse_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_217_-_Validate_empty_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_250_-_Failed_to_parse_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_259_-_Validate_empty_trace
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_15_-_Validate_trace_for_event_cgroup_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_16_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_31_-_Validate_trace_for_event_ipc_ns_=_4026532233
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_32_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_47_-_Validate_trace_for_event_mnt_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_48_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_63_-_Validate_trace_for_event_net_ns_=_4026532237
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_64_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_79_-_Validate_trace_for_event_uts_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_80_-_Read_a_total_of_0_events,_expected_1000

Similarly:

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.1/testresults/testresult-report.txt

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.2/testresults/testresult-report.txt

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.3/testresults/testresult-report.txt

so I believe this issue has always been in 3.2
Comment 2 Richard Purdie 2021-05-13 10:21:21 UTC
Later we disabled this test: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=f443e3702113a5c3a837365f4f35aaa550875798
Comment 3 Randy MacLeod 2021-05-13 14:52:10 UTC
Not a regression, and there is a fix to disable it.