| Summary: | pTest - lttng-tools tests fail | ||
|---|---|---|---|
| Product: | [QA/Testing] Runtime Testing | Reporter: | Alexandru Georgescu <alexandru.c.georgescu> |
| Component: | general | Assignee: | Richard Purdie <richard.purdie> |
| Status: | RESOLVED FIXED | QA Contact: | yeoh ee peng <ee.peng.yeoh> |
| Severity: | normal | ||
| Priority: | Medium | CC: | francisco.j.pedraza.gonzalez, jair.de.jesus.gonzalez.plascencia, jose.perez.carranza, ntl, richard.purdie |
| Version: | 2.1 | ||
| Target Milestone: | 4.99 | ||
| Hardware: | NUC | ||
| OS: | Multiple | ||
| Whiteboard: | |||
| OS type for building Yocto: | --- | Type of Regression: | Regression (Used to work) |
| Verified: | Documentation change: | Don't know | |
|
Description
Alexandru Georgescu
2015-12-17 09:59:22 UTC
Tests that failed now and worked last time: 220 43 - Enable channel 131072 for session channel 22 - Stop lttng tracing for session 8 - Deleted snapshot output named 38 - Added snapshot output file:// 43 - Enable event 8 for session tp:tptest in channel 17 - Validate trace for event 8192 72 - Destroy session 3 - Enable channel 1 for session channel 13 - Trace validation - netintfield 64 - Trace validation - intfield 3 - Destroy session load-42 93 - Validate trace for event tp:tptest 26 - Trace validation - netintfield 68 - Enable channel 16 for session channel 27 - Added snapshot output ( -n 32768 ) 92 - Snapshot recorded 25 - Trace validation - intfield 3 - MI test 39 - Destroy session 33 - Destroy session 13 - Start tracing for session 60 - Enable event 4094 for session tp:tptest in channel 46 - Stop lttng tracing for session 66 - Validate trace for event tp:tptest4 3 - Enable channel 4096 for session channel 42 - Enable channel 8 for session channel 82 - Enable event 32 for session tp:tptest in channel 57 - Start tracing for session 104 - Trace validation - netintfield 6 - Added snapshot output randomname () 62 - Stop lttng tracing for session 51 - Stop lttng tracing for session 59 - Destroy session 92 - Trace validation - longfield 2 - Create session /tmp/tmp.AkJg20 in 4 - Enable channel for session chan1 51 - Trace validation - intfield 30 - Enable event 4 for session tp:tptest in channel 5 - Enable ust event chan1 for session tp:tptest 82 - Snapshot recorded 35 - Enable channel 65536 for session channel 52 - Enable event 5120 for session tp:tptest in channel 27 - Trace validation - longfield 83 - Validate trace for event tp:tptest 10 - Validate trace for event tp:tptest 20 - Enable event 16384 for session tp:tptest in channel 59 - Extraction of crashed buffers to path 8 - Added snapshot output 53 - Validate trace for event tp:tptest 35 - Enable channel per UID for session snapchan 49 - Validate trace for event 131072 29 - Start tracing for session 98 - Destroy session 11 - Stop lttng tracing for session 9 - Metadata extraction from babeltrace 43 - Validate trace for event tp:tptest 58 - Create session /tmp/tmp.hRxprG in 54 - Create session /tmp/tmp.I1Knc1 in 97 - Stop lttng tracing for session 3 - Enable channel for session snapchan 17 - Added snapshot output file:// 71 - Start tracing for session 9 - Validate trace for event 4096 48 - Added snapshot output file:// 93 - Create session /tmp/tmp.vjKSoo in 33 - Validate trace for event 32768 13 - Enable ust event chan1 for session tp:tptest 50 - Snapshot recorded 81 - Enable channel 32 for session channel 41 - Validate trace for event 65536 52 - Trace validation - netintfield 84 - Stop lttng tracing for session 55 - Enable channel for session snapchan 4 - Enable event 4096 for session tp:tptest in channel 63 - Destroy session 79 - Trace validation - longfield 42 - Create session /tmp/tmp.dDHP5v in 41 - Create session /tmp/tmp.MbRbWQ in 63 - Validate trace for event tp:tptest1 53 - Start tracing for session 15 - Create session /tmp/tmp.gjEl4J in 72 - Added snapshot output file:// 24 - Enable channel for session snapchan with subbuf size 70 - Start tracing for session 18 - Stop lttng tracing for session 5 - Start tracing for session 94 - Stop lttng tracing for session 45 - Stop lttng tracing for session 31 - Start tracing for session 76 - Snapshot recorded 79 - Validate trace for event tp:tptest 29 - Enable channel 4 for session channel 16 - Enable channel 2 for session channel 69 - Enable channel for session snapchan 45 - Enable channel per UID for session snapchan 91 - Trace validation - netintfield 41 - Stop lttng tracing for session 96 - Start tracing for session 28 - Enable event 32768 for session tp:tptest in channel 14 - Stop lttng tracing for session 19 - Enable channel 16384 for session channel 49 - Expect 10 recup event from buffers got 0 2 - Load command with opts 91 - Validate trace for event tp:tptest 16 - Added snapshot output 21 - Start tracing for session 33 - Validate trace for event tp:tptest 84 - Snapshot recorded 22 - Validate trace for event tp:tptest 81 - Validate trace for event tp:tptest 67 - Validate trace for event tp:tptest5 94 - Enable channel 64 for session channel 77 - Trace validation - intfield 26 - Create session /tmp/tmp.5FQI7i in 90 - Snapshot recorded 15 - Destroy session 31 - Destroy session 85 - Validate trace for event tp:tptest 55 - Enable channel 10 for session channel 61 - Stop lttng tracing for session 70 - Enable ust event snapchan for session tp:tptest 14 - Start tracing for session 7 - Destroy session 89 - Validate trace for event tp:tptest 77 - Validate trace for event tp:tptest 66 - Trace validation - longfield 4 - Enable ust event snapchan for session tp:tptest 65 - Validate trace for event tp:tptest3 10 - Create session /tmp/tmp.BDWSg4 in 80 - Create session /tmp/tmp.MWaGri in 2 - Create session /tmp/tmp.iRHoED in 14 - Token \description\ expect:Freeze time with 1KHz for regression t 15 - Enable ust event snapchan for session tp:tptest 15 - Token \freq\ expect:1000 got: 60 - Snapshot recorded 34 - Create session /tmp/tmp.v8XAVm in 37 - Start tracing for session 57 - Validate trace for event 5120 69 - Enable event 16 for session tp:tptest in channel 71 - Stop lttng tracing for session 11 - Create session in no-output mode 32 - Stop lttng tracing for session 25 - Validate trace for event 16384 46 - Destroy session 4 - Enable event 1 for session tp:tptest in channel 20 - Destroy session 17 - Snapshot recorded 54 - Stop lttng tracing for session 61 - Start tracing for session 29 - Snapshot recorded 6 - Start tracing for session 46 - Enable ust event snapchan for session tp:tptest 65 - Trace validation - netintfield 25 - Enable ust event snapchan for session tp:tptest 17 - Enable event 2 for session tp:tptest in channel 18 - Create session /tmp/tmp.u8iV8a in 36 - Enable ust event snapchan for session tp:tptest 28 - Create session /tmp/tmp.0ZthBK in 95 - Enable event 64 for session tp:tptest in channel 103 - Trace validation - intfield 87 - Validate trace for event tp:tptest 12 - Enable event 8192 for session tp:tptest in channel 40 - Trace validation - longfield 26 - Start tracing for session 9 - Added snapshot output somesnapshot () 67 - Create session /tmp/tmp.nuzCE7 in 10 - Clock metadata extraction 74 - Snapshot recorded 59 - Enable channel 4094 for session channel 23 - Destroy session 11 - Enable channel 8192 for session channel 40 - Snapshot recorded 36 - Enable event 65536 for session tp:tptest in channel 9 - Snapshot recorded 80 - Snapshot recorded 10 - Snapshot named somesnapshot present in list-output listing 8 - Validate trace for event tp:tptest 19 - Snapshot recorded 85 - Destroy session 14 - Trace validation - longfield 50 - Expect 10 recup event from symlink buffers got 0 44 - Start tracing for session 14 - Enable channel for session snapchan 71 - Trace match 13 - Token \uuid\ expect:83c63deb-7aa4-48fb-abda-946f400d76e6 got: 78 - Snapshot recorded 105 - Trace validation - longfield 30 - Stop lttng tracing for session 12 - Trace validation - intfield 12 - Token \name\ expect:lttng_test_clock_override got: 44 - Enable event 131072 for session tp:tptest in channel 16 - Start tracing for session 20 - Validate trace for event tp:tptest 75 - Validate trace for event tp:tptest 39 - Trace validation - netintfield 55 - Destroy session 58 - Added snapshot output file:// 47 - Start tracing for session 83 - Start tracing for session 78 - Trace validation - netintfield 86 - Snapshot recorded 38 - Trace validation - intfield 88 - Snapshot recorded 60 - Trace match 12 - Enable channel for session chan1 27 - Enable channel 32768 for session channel 7 - Snapshot named randomname present in list-output listing 45 - Start tracing for session 65 - Validate trace for event 4094 51 - Enable channel 5120 for session channel 50 - Create session /tmp/tmp.TFErlz in 31 - Stop lttng tracing for session 56 - Enable event 10 for session tp:tptest in channel 70 - Extraction of crashed buffers to path /tmp/tmp.uiAXjy/extract 53 - Trace validation - longfield 38 - Stop lttng tracing for session 64 - Validate trace for event tp:tptest2 47 - Destroy session 56 - Enable ust event snapchan for session tp:tptest1tp:tptest2tp:tpte 90 - Trace validation - intfield Tests that passed now and and failed last time: 0 Retested on NUC 5425WYK genericx86_64, 2016-01-28: poky: 3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c AB Link: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M2.rc1/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg Report: https://wiki.yoctoproject.org/wiki/Ptest_3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c Getting the following results: Tests that failed now and worked last time: 1 70 - Extraction of crashed buffers to path /tmp/tmp.tXvwkbJ8mJ/extract Tests that passed now and and failed last time: 45 13 - Trace validation - netintfield 64 - Trace validation - intfield 26 - Trace validation - netintfield 92 - Snapshot recorded 25 - Trace validation - intfield 104 - Trace validation - netintfield 92 - Trace validation - longfield 51 - Trace validation - intfield 27 - Trace validation - longfield 9 - Metadata extraction from babeltrace 50 - Snapshot recorded 79 - Trace validation - longfield 52 - Trace validation - netintfield 76 - Snapshot recorded 91 - Trace validation - netintfield 84 - Snapshot recorded 77 - Trace validation - intfield 90 - Snapshot recorded 66 - Trace validation - longfield 14 - Token \description\ expect:Freeze time with 1KHz for regression t 40 - Trace validation - longfield 60 - Snapshot recorded 82 - Snapshot recorded 29 - Snapshot recorded 65 - Trace validation - netintfield 103 - Trace validation - intfield 10 - Clock metadata extraction 74 - Snapshot recorded 40 - Snapshot recorded 9 - Snapshot recorded 80 - Snapshot recorded 10 - Snapshot named somesnapshot present in list-output listing 19 - Snapshot recorded 14 - Trace validation - longfield 78 - Snapshot recorded 105 - Trace validation - longfield 12 - Trace validation - intfield 39 - Trace validation - netintfield 78 - Trace validation - netintfield 86 - Snapshot recorded 38 - Trace validation - intfield 88 - Snapshot recorded 7 - Snapshot named randomname present in list-output listing 53 - Trace validation - longfield 90 - Trace validation - intfield In the latest run lttng is up to a 99% test pass rate. for latest run 2.2 rc4 on commit: 4b94b498e21aeba945fe7e72a6b7c4bb0314fb83 5 failures came up: ********** FAILURES ********** FAIL: test_utils_expand_path 23 - symlink tree test case: [tmppath/]a/g/../l/. FAIL: test_utils_expand_path 24 - symlink tree test case: [tmppath/]a/g/../l/./ FAIL: test_utils_expand_path 25 - symlink tree test case: [tmppath/]a/g/../l/.. FAIL: test_utils_expand_path 26 - symlink tree test case: [tmppath/]a/g/../l/../ FAIL: test_utils_expand_path 27 - symlink tree test case: [tmppath/]a/b/h/g/ ****************************** Results: https://wiki.yoctoproject.org/wiki/Ptest_4b94b498e21aeba945fe7e72a6b7c4bb0314fb83 Sounds like this was fixed a while ago (minimal number of failures) and we just forgot to close this. Tested on 2.3 M3 rc2, observing 69 failures on the results and 96.60% pass rate. According to this, I'll re-open the ticket. Results: https://wiki.yoctoproject.org/wiki/Ptest_415b72ffcbd26e5f3664370d8b2a9b8105fb6342 lttng-tools ptest results are now vastly improved: http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=8e9a0fe61f0ccdad8d88ecf8f46ae90c0c73da97 |