Bug 8828 - pTest - lttng-tools tests fail
Summary: pTest - lttng-tools tests fail
Status: RESOLVED FIXED
Alias: None
Product: Runtime Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: 2.1
Hardware: NUC Multiple
: Medium normal
Target Milestone: 4.99
Assignee: Richard Purdie
QA Contact: yeoh ee peng
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2015-12-17 09:59 UTC by Alexandru Georgescu
Modified: 2019-05-08 21:05 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: Regression (Used to work)
Verified:
Documentation change: Don't know


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Alexandru Georgescu 2015-12-17 09:59:22 UTC
Commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
Previous Commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1

Results for NUC ptest lttng-tools 2015-12-10:
********************************
Tests that failed now and worked last time: 220
Full log here: https://wiki.yoctoproject.org/wiki/Ptest_5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
Comment 1 Alexandru Georgescu 2015-12-17 09:59:37 UTC
Tests that failed now and worked last time: 220
43 - Enable channel 131072 for session channel
22 - Stop lttng tracing for session
8 - Deleted snapshot output named
38 - Added snapshot output file://
43 - Enable event 8 for session tp:tptest in channel
17 - Validate trace for event 8192
72 - Destroy session
3 - Enable channel 1 for session channel
13 - Trace validation - netintfield
64 - Trace validation - intfield
3 - Destroy session load-42
93 - Validate trace for event tp:tptest
26 - Trace validation - netintfield
68 - Enable channel 16 for session channel
27 - Added snapshot output ( -n 32768 )
92 - Snapshot recorded
25 - Trace validation - intfield
3 - MI test
39 - Destroy session
33 - Destroy session
13 - Start tracing for session
60 - Enable event 4094 for session tp:tptest in channel
46 - Stop lttng tracing for session
66 - Validate trace for event tp:tptest4
3 - Enable channel 4096 for session channel
42 - Enable channel 8 for session channel
82 - Enable event 32 for session tp:tptest in channel
57 - Start tracing for session
104 - Trace validation - netintfield
6 - Added snapshot output randomname ()
62 - Stop lttng tracing for session
51 - Stop lttng tracing for session
59 - Destroy session
92 - Trace validation - longfield
2 - Create session /tmp/tmp.AkJg20 in
4 - Enable channel for session chan1
51 - Trace validation - intfield
30 - Enable event 4 for session tp:tptest in channel
5 - Enable ust event chan1 for session tp:tptest
82 - Snapshot recorded
35 - Enable channel 65536 for session channel
52 - Enable event 5120 for session tp:tptest in channel
27 - Trace validation - longfield
83 - Validate trace for event tp:tptest
10 - Validate trace for event tp:tptest
20 - Enable event 16384 for session tp:tptest in channel
59 - Extraction of crashed buffers to path
8 - Added snapshot output
53 - Validate trace for event tp:tptest
35 - Enable channel per UID for session snapchan
49 - Validate trace for event 131072
29 - Start tracing for session
98 - Destroy session
11 - Stop lttng tracing for session
9 - Metadata extraction from babeltrace
43 - Validate trace for event tp:tptest
58 - Create session /tmp/tmp.hRxprG in
54 - Create session /tmp/tmp.I1Knc1 in
97 - Stop lttng tracing for session
3 - Enable channel for session snapchan
17 - Added snapshot output file://
71 - Start tracing for session
9 - Validate trace for event 4096
48 - Added snapshot output file://
93 - Create session /tmp/tmp.vjKSoo in
33 - Validate trace for event 32768
13 - Enable ust event chan1 for session tp:tptest
50 - Snapshot recorded
81 - Enable channel 32 for session channel
41 - Validate trace for event 65536
52 - Trace validation - netintfield
84 - Stop lttng tracing for session
55 - Enable channel for session snapchan
4 - Enable event 4096 for session tp:tptest in channel
63 - Destroy session
79 - Trace validation - longfield
42 - Create session /tmp/tmp.dDHP5v in
41 - Create session /tmp/tmp.MbRbWQ in
63 - Validate trace for event tp:tptest1
53 - Start tracing for session
15 - Create session /tmp/tmp.gjEl4J in
72 - Added snapshot output file://
24 - Enable channel for session snapchan with subbuf size
70 - Start tracing for session
18 - Stop lttng tracing for session
5 - Start tracing for session
94 - Stop lttng tracing for session
45 - Stop lttng tracing for session
31 - Start tracing for session
76 - Snapshot recorded
79 - Validate trace for event tp:tptest
29 - Enable channel 4 for session channel
16 - Enable channel 2 for session channel
69 - Enable channel for session snapchan
45 - Enable channel per UID for session snapchan
91 - Trace validation - netintfield
41 - Stop lttng tracing for session
96 - Start tracing for session
28 - Enable event 32768 for session tp:tptest in channel
14 - Stop lttng tracing for session
19 - Enable channel 16384 for session channel
49 - Expect 10 recup event from buffers got 0
2 - Load command with opts
91 - Validate trace for event tp:tptest
16 - Added snapshot output
21 - Start tracing for session
33 - Validate trace for event tp:tptest
84 - Snapshot recorded
22 - Validate trace for event tp:tptest
81 - Validate trace for event tp:tptest
67 - Validate trace for event tp:tptest5
94 - Enable channel 64 for session channel
77 - Trace validation - intfield
26 - Create session /tmp/tmp.5FQI7i in
90 - Snapshot recorded
15 - Destroy session
31 - Destroy session
85 - Validate trace for event tp:tptest
55 - Enable channel 10 for session channel
61 - Stop lttng tracing for session
70 - Enable ust event snapchan for session tp:tptest
14 - Start tracing for session
7 - Destroy session
89 - Validate trace for event tp:tptest
77 - Validate trace for event tp:tptest
66 - Trace validation - longfield
4 - Enable ust event snapchan for session tp:tptest
65 - Validate trace for event tp:tptest3
10 - Create session /tmp/tmp.BDWSg4 in
80 - Create session /tmp/tmp.MWaGri in
2 - Create session /tmp/tmp.iRHoED in
14 - Token \description\ expect:Freeze time with 1KHz for regression t
15 - Enable ust event snapchan for session tp:tptest
15 - Token \freq\ expect:1000 got:
60 - Snapshot recorded
34 - Create session /tmp/tmp.v8XAVm in
37 - Start tracing for session
57 - Validate trace for event 5120
69 - Enable event 16 for session tp:tptest in channel
71 - Stop lttng tracing for session
11 - Create session in no-output mode
32 - Stop lttng tracing for session
25 - Validate trace for event 16384
46 - Destroy session
4 - Enable event 1 for session tp:tptest in channel
20 - Destroy session
17 - Snapshot recorded
54 - Stop lttng tracing for session
61 - Start tracing for session
29 - Snapshot recorded
6 - Start tracing for session
46 - Enable ust event snapchan for session tp:tptest
65 - Trace validation - netintfield
25 - Enable ust event snapchan for session tp:tptest
17 - Enable event 2 for session tp:tptest in channel
18 - Create session /tmp/tmp.u8iV8a in
36 - Enable ust event snapchan for session tp:tptest
28 - Create session /tmp/tmp.0ZthBK in
95 - Enable event 64 for session tp:tptest in channel
103 - Trace validation - intfield
87 - Validate trace for event tp:tptest
12 - Enable event 8192 for session tp:tptest in channel
40 - Trace validation - longfield
26 - Start tracing for session
9 - Added snapshot output somesnapshot ()
67 - Create session /tmp/tmp.nuzCE7 in
10 - Clock metadata extraction
74 - Snapshot recorded
59 - Enable channel 4094 for session channel
23 - Destroy session
11 - Enable channel 8192 for session channel
40 - Snapshot recorded
36 - Enable event 65536 for session tp:tptest in channel
9 - Snapshot recorded
80 - Snapshot recorded
10 - Snapshot named somesnapshot present in list-output listing
8 - Validate trace for event tp:tptest
19 - Snapshot recorded
85 - Destroy session
14 - Trace validation - longfield
50 - Expect 10 recup event from symlink buffers got 0
44 - Start tracing for session
14 - Enable channel for session snapchan
71 - Trace match
13 - Token \uuid\ expect:83c63deb-7aa4-48fb-abda-946f400d76e6 got:
78 - Snapshot recorded
105 - Trace validation - longfield
30 - Stop lttng tracing for session
12 - Trace validation - intfield
12 - Token \name\ expect:lttng_test_clock_override got:
44 - Enable event 131072 for session tp:tptest in channel
16 - Start tracing for session
20 - Validate trace for event tp:tptest
75 - Validate trace for event tp:tptest
39 - Trace validation - netintfield
55 - Destroy session
58 - Added snapshot output file://
47 - Start tracing for session
83 - Start tracing for session
78 - Trace validation - netintfield
86 - Snapshot recorded
38 - Trace validation - intfield
88 - Snapshot recorded
60 - Trace match
12 - Enable channel for session chan1
27 - Enable channel 32768 for session channel
7 - Snapshot named randomname present in list-output listing
45 - Start tracing for session
65 - Validate trace for event 4094
51 - Enable channel 5120 for session channel
50 - Create session /tmp/tmp.TFErlz in
31 - Stop lttng tracing for session
56 - Enable event 10 for session tp:tptest in channel
70 - Extraction of crashed buffers to path /tmp/tmp.uiAXjy/extract
53 - Trace validation - longfield
38 - Stop lttng tracing for session
64 - Validate trace for event tp:tptest2
47 - Destroy session
56 - Enable ust event snapchan for session tp:tptest1tp:tptest2tp:tpte
90 - Trace validation - intfield
Tests that passed now and and failed last time: 0
Comment 2 Francisco Pedraza 2016-02-04 10:01:41 UTC
Retested on NUC 5425WYK genericx86_64, 2016-01-28:
poky: 3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c
AB Link: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M2.rc1/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg

Report: https://wiki.yoctoproject.org/wiki/Ptest_3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c

Getting the following results:

Tests that failed now and worked last time: 1
70 - Extraction of crashed buffers to path /tmp/tmp.tXvwkbJ8mJ/extract
Tests that passed now and and failed last time: 45
13 - Trace validation - netintfield
64 - Trace validation - intfield
26 - Trace validation - netintfield
92 - Snapshot recorded
25 - Trace validation - intfield
104 - Trace validation - netintfield
92 - Trace validation - longfield
51 - Trace validation - intfield
27 - Trace validation - longfield
9 - Metadata extraction from babeltrace
50 - Snapshot recorded
79 - Trace validation - longfield
52 - Trace validation - netintfield
76 - Snapshot recorded
91 - Trace validation - netintfield
84 - Snapshot recorded
77 - Trace validation - intfield
90 - Snapshot recorded
66 - Trace validation - longfield
14 - Token \description\ expect:Freeze time with 1KHz for regression t
40 - Trace validation - longfield
60 - Snapshot recorded
82 - Snapshot recorded
29 - Snapshot recorded
65 - Trace validation - netintfield
103 - Trace validation - intfield
10 - Clock metadata extraction
74 - Snapshot recorded
40 - Snapshot recorded
9 - Snapshot recorded
80 - Snapshot recorded
10 - Snapshot named somesnapshot present in list-output listing
19 - Snapshot recorded
14 - Trace validation - longfield
78 - Snapshot recorded
105 - Trace validation - longfield
12 - Trace validation - intfield
39 - Trace validation - netintfield
78 - Trace validation - netintfield
86 - Snapshot recorded
38 - Trace validation - intfield
88 - Snapshot recorded
7 - Snapshot named randomname present in list-output listing
53 - Trace validation - longfield
90 - Trace validation - intfield
Comment 3 Ross Burton 2016-02-11 12:02:47 UTC
In the latest run lttng is up to a 99% test pass rate.
Comment 4 Jose Perez C 2016-10-20 20:40:15 UTC
for latest run 2.2 rc4 on commit: 4b94b498e21aeba945fe7e72a6b7c4bb0314fb83 5 failures came up:

********** FAILURES **********

FAIL: test_utils_expand_path 23 - symlink tree test case: [tmppath/]a/g/../l/.
FAIL: test_utils_expand_path 24 - symlink tree test case: [tmppath/]a/g/../l/./
FAIL: test_utils_expand_path 25 - symlink tree test case: [tmppath/]a/g/../l/..
FAIL: test_utils_expand_path 26 - symlink tree test case: [tmppath/]a/g/../l/../
FAIL: test_utils_expand_path 27 - symlink tree test case: [tmppath/]a/b/h/g/

******************************


Results:

https://wiki.yoctoproject.org/wiki/Ptest_4b94b498e21aeba945fe7e72a6b7c4bb0314fb83
Comment 5 Richard Purdie 2017-04-02 21:10:07 UTC
Sounds like this was fixed a while ago (minimal number of failures) and we just forgot to close this.
Comment 6 Jair Gonzalez 2017-04-06 20:28:04 UTC
Tested on 2.3 M3 rc2, observing 69 failures on the results and 96.60% pass rate. According to this, I'll re-open the ticket.

Results:
https://wiki.yoctoproject.org/wiki/Ptest_415b72ffcbd26e5f3664370d8b2a9b8105fb6342
Comment 7 Richard Purdie 2019-05-08 21:05:15 UTC
lttng-tools ptest results are now vastly improved:
http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=8e9a0fe61f0ccdad8d88ecf8f46ae90c0c73da97