Bug 12847

Summary: [2.3.4 rc1] valgrind ptest failed
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Manish Das <manish.das>
Component: coreAssignee: Ross Burton <ross.burton>
Status: RESOLVED DUPLICATE QA Contact:
Severity: normal    
Priority: Undecided CC: ee.peng.yeoh, meta.mr.watcher, meta.watcher
Version: 2.3.4   
Target Milestone: ---   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
ptest logs for 2.6 M2 rc1 none

Description Manish Das 2018-07-09 02:43:53 UTC
Performed the diff and found that valgrind tests that passed in 2.3.3 rc1 are failing in 2.3.4rc1

BEGIN: /usr/lib/valgrind/ptest
 PASS: cachegrind/tests/chdir
 PASS: cachegrind/tests/clreq
@@ -136554,8 +137493,7 @@ PASS: drd/tests/sem_wait
 PASS: drd/tests/sigalrm
 PASS: drd/tests/sigaltstack
 PASS: drd/tests/std_atomic
-timed out
-FAIL: drd/tests/std_list
+PASS: drd/tests/std_list
 PASS: drd/tests/std_string
 PASS: drd/tests/std_thread
 FAIL: drd/tests/std_thread2
@@ -136692,7 +137630,7 @@ PASS: memcheck/tests/amd64/fxsave-amd64
 FAIL: memcheck/tests/amd64/insn-bsfl
 FAIL: memcheck/tests/amd64/insn-pcmpistri
 FAIL: memcheck/tests/amd64/insn-pmovmskb
-PASS: memcheck/tests/amd64/insn_basic
+FAIL: memcheck/tests/amd64/insn_basic
 PASS: memcheck/tests/amd64/insn_fpu
 PASS: memcheck/tests/amd64/insn_mmx
 PASS: memcheck/tests/amd64/insn_sse
@@ -136932,7 +137870,7 @@ PASS: none/tests/amd64/fma
 PASS: none/tests/amd64/fma4
 PASS: none/tests/amd64/fxtract
 PASS: none/tests/amd64/getseg
-PASS: none/tests/amd64/insn_basic
+FAIL: none/tests/amd64/insn_basic
 PASS: none/tests/amd64/insn_fpu
 PASS: none/tests/amd64/insn_mmx
 PASS: none/tests/amd64/insn_pclmulqdq
@@ -137008,8 +137946,8 @@ PASS: none/tests/ioctl_moans
 
 ERROR: Exit status is 512
 END: /usr/lib/valgrind/ptest
Comment 1 yeoh ee peng 2018-07-09 03:55:39 UTC
(In reply to comment #0)
> Performed the diff and found that valgrind tests that passed in 2.3.3 rc1
> are failing in 2.3.4rc1
> 
> BEGIN: /usr/lib/valgrind/ptest
>  PASS: cachegrind/tests/chdir
>  PASS: cachegrind/tests/clreq
> @@ -136554,8 +137493,7 @@ PASS: drd/tests/sem_wait
>  PASS: drd/tests/sigalrm
>  PASS: drd/tests/sigaltstack
>  PASS: drd/tests/std_atomic
> -timed out
> -FAIL: drd/tests/std_list
> +PASS: drd/tests/std_list
>  PASS: drd/tests/std_string
>  PASS: drd/tests/std_thread
>  FAIL: drd/tests/std_thread2
> @@ -136692,7 +137630,7 @@ PASS: memcheck/tests/amd64/fxsave-amd64
>  FAIL: memcheck/tests/amd64/insn-bsfl
>  FAIL: memcheck/tests/amd64/insn-pcmpistri
>  FAIL: memcheck/tests/amd64/insn-pmovmskb
> -PASS: memcheck/tests/amd64/insn_basic
> +FAIL: memcheck/tests/amd64/insn_basic
>  PASS: memcheck/tests/amd64/insn_fpu
>  PASS: memcheck/tests/amd64/insn_mmx
>  PASS: memcheck/tests/amd64/insn_sse
> @@ -136932,7 +137870,7 @@ PASS: none/tests/amd64/fma
>  PASS: none/tests/amd64/fma4
>  PASS: none/tests/amd64/fxtract
>  PASS: none/tests/amd64/getseg
> -PASS: none/tests/amd64/insn_basic
> +FAIL: none/tests/amd64/insn_basic
>  PASS: none/tests/amd64/insn_fpu
>  PASS: none/tests/amd64/insn_mmx
>  PASS: none/tests/amd64/insn_pclmulqdq
> @@ -137008,8 +137946,8 @@ PASS: none/tests/ioctl_moans
>  
>  ERROR: Exit status is 512
>  END: /usr/lib/valgrind/ptest

Hi Manish,

Please share which tests are passing in 2.3.3.rc1 and failed in 2.3.4.rc1. 
The below have a mix of pass vs fail. 

-FAIL: drd/tests/std_list
+PASS: drd/tests/std_list
-PASS: memcheck/tests/amd64/insn_basic
+FAIL: memcheck/tests/amd64/insn_basic
-PASS: none/tests/amd64/insn_basic
+FAIL: none/tests/amd64/insn_basic
Comment 2 Manish Das 2018-07-09 09:40:52 UTC
Following Tests are passing in 2.3.3.rc1 but failing in 2.3.4.rc1 are listed below:

-PASS: memcheck/tests/amd64/insn_basic
+FAIL: memcheck/tests/amd64/insn_basic
 
-PASS: none/tests/amd64/insn_basic
+FAIL: none/tests/amd64/insn_basic
Comment 3 Ross Burton 2018-07-12 14:50:31 UTC
Valgrind ptests are not reliable currently.

*** This bug has been marked as a duplicate of bug 12837 ***
Comment 4 Manish Das 2018-07-31 09:56:41 UTC
Created attachment 4353 [details]
ptest logs for 2.6 M2 rc1