Bug 14392

Summary:

[QA 3.2.4 RC1] failure in ptest : ptestresult.lttng-tools.tools

Product:

[QA/Testing] Package Testing (ptest)

Reporter:

Teoh Jay Shen <jay.shen.teoh>

Component:

ptest

Assignee:

Unassigned <unassigned>

Status:

RESOLVED WONTFIX

QA Contact:

Severity:

normal

Priority:

Undecided

CC:

akuster808, randy.macleod, richard.purdie, sangeeta.jain

Version:

3.2.4

Target Milestone:

---

Hardware:

All

OS:

x86_64

Whiteboard:

OS type for building Yocto:

---

Type of Regression:

---

Verified:

Documentation change:

No (bug/feature does not impact docs)

Attachments:

Description	Flags
ptest regression report	none

Description Teoh Jay Shen 2021-05-11 04:02:01 UTC

Created attachment 4799 [details]
ptest regression report

Following ptest is failing in current release(3.2.4 rc1) while passing in previous release(3.2.3 rc1): 

ptestresult.lttng-tools.tools/tracker/test_event_tracker_217_-_Validate_empty_trace

Regression is performed on ptest results for qemux86-64. 

ptest Results for current release:
https://autobuilder.yocto.io/pub/releases/yocto-3.2.4.rc1/testresults/qemux86-64-ptest/

ptest results for previous release:
https://autobuilder.yocto.io/pub/releases/yocto-3.2.3.rc1/testresults/qemux86-64-ptest/

Comment 1 Richard Purdie 2021-05-13 10:16:39 UTC

I reran this on the autobuilder:

https://autobuilder.yoctoproject.org/typhoon/#/builders/81/builds/2083

which "passed" but shows some failures:

AssertionError: Failed ptests:
{'lttng-tools': ['tools/exclusion/test_exclusion_169_-_Excluded_event_"tp:tptest1"_was_found_in_trace!',
                 'tools/save-load/test_load_22_-_Destroy_session_tracker_legacy_all',
                 'tools/save-load/test_load_23_-_Destroy_session_tracker_legacy_none',
                 'tools/save-load/test_load_24_-_Destroy_session_tracker_legacy_selective',
                 'tools/tracker/test_event_tracker_208_-_Failed_to_parse_trace',
                 'tools/tracker/test_event_tracker_217_-_Validate_empty_trace',
                 'tools/tracker/test_event_tracker_250_-_Failed_to_parse_trace',
                 'tools/tracker/test_event_tracker_259_-_Validate_empty_trace',
                 'ust/namespaces/test_ns_contexts_change_15_-_Validate_trace_for_event_cgroup_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_16_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_31_-_Validate_trace_for_event_ipc_ns_=_4026532233',
                 'ust/namespaces/test_ns_contexts_change_32_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_47_-_Validate_trace_for_event_mnt_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_48_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_63_-_Validate_trace_for_event_net_ns_=_4026532237',
                 'ust/namespaces/test_ns_contexts_change_64_-_Read_a_total_of_0_events,_expected_1000',
                 'ust/namespaces/test_ns_contexts_change_79_-_Validate_trace_for_event_uts_ns_=_4026532234',
                 'ust/namespaces/test_ns_contexts_change_80_-_Read_a_total_of_0_events,_expected_1000'],
 'pango': ['pango/test-layout.test']}

The results logs are at:

http://autobuilder.yocto.io/pub/non-release/20210512-19/testresults/qemux86-64-ptest/lttng-tools.log

I looked back at the 3.2 baseline:

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2/testresults/testresult-report.txt

    ltpresult.syscalls.ptrace08
testseries | result_id : qemux86-64-ptest | runtime_core-image-sato-sdk-ptest_qemux86-64_20201026224228
    ptestresult.libinput.libinput-test-suite
    ptestresult.lttng-tools.tools/exclusion/test_exclusion_169_-_Excluded_event_"tp:tptest1"_was_found_in_trace!
    ptestresult.lttng-tools.tools/save-load/test_load_22_-_Destroy_session_tracker_legacy_all
    ptestresult.lttng-tools.tools/save-load/test_load_23_-_Destroy_session_tracker_legacy_none
    ptestresult.lttng-tools.tools/save-load/test_load_24_-_Destroy_session_tracker_legacy_selective
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_208_-_Failed_to_parse_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_217_-_Validate_empty_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_250_-_Failed_to_parse_trace
    ptestresult.lttng-tools.tools/tracker/test_event_tracker_259_-_Validate_empty_trace
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_15_-_Validate_trace_for_event_cgroup_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_16_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_31_-_Validate_trace_for_event_ipc_ns_=_4026532233
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_32_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_47_-_Validate_trace_for_event_mnt_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_48_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_63_-_Validate_trace_for_event_net_ns_=_4026532237
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_64_-_Read_a_total_of_0_events,_expected_1000
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_79_-_Validate_trace_for_event_uts_ns_=_4026532234
    ptestresult.lttng-tools.ust/namespaces/test_ns_contexts_change_80_-_Read_a_total_of_0_events,_expected_1000

Similarly:

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.1/testresults/testresult-report.txt

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.2/testresults/testresult-report.txt

http://downloads.yoctoproject.org/releases/yocto/yocto-3.2.3/testresults/testresult-report.txt

so I believe this issue has always been in 3.2

Comment 2 Richard Purdie 2021-05-13 10:21:21 UTC

Later we disabled this test: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=f443e3702113a5c3a837365f4f35aaa550875798

Comment 3 Randy MacLeod 2021-05-13 14:52:10 UTC

Not a regression, and there is a fix to disable it.