Bug 8656

Summary: ptest - perl tests fail for genericx86-64 on NUC - 2.0.rc3
Product: [QA/Testing] Runtime Testing Reporter: Alexandru Georgescu <alexandru.c.georgescu>
Component: generalAssignee: Aníbal Limón <anibal.limon>
Status: RESOLVED FIXED QA Contact: Francisco Pedraza <francisco.j.pedraza.gonzalez>
Severity: normal    
Priority: Medium CC: benjamin.esquivel, bill.randle, francisco.j.pedraza.gonzalez, jose.perez.carranza, leonardo.sandoval.gonzalez, richard.purdie, ross.burton, sgw, yix.wang
Version: 2.0   
Target Milestone: 2.3 M1   
Hardware: NUC   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: Regression (Used to work)
Verified: Documentation change: No (bug/feature does not impact docs)

Description Alexandru Georgescu 2015-11-06 07:52:10 UTC
Opening another bug for the following failures:

A regression has been found while running openssl ptest on YP 2.0.rc3:fc45deac89ef63ca1c44e763c38ced7dfd72cbe1


AB Image: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.0.rc3/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg

pTest perl report: https://wiki.yoctoproject.org/wiki/Ptest_fc45deac89ef63ca1c44e763c38ced7dfd72cbe1

HW Tested: NUC D54250WYK

9 perl ptests failed during this run:

fail:  cpan/ExtUtils-Constant/t/Constant
fail:  cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
fail:  cpan/ExtUtils-MakeMaker/t/PL_FILES
fail:  cpan/ExtUtils-MakeMaker/t/basic
fail:  cpan/ExtUtils-MakeMaker/t/min_perl_version
fail:  cpan/ExtUtils-MakeMaker/t/pm_to_blib
fail:  cpan/ExtUtils-MakeMaker/t/recurs
fail:  cpan/ExtUtils-MakeMaker/t/several_authors
fail:  t/porting/customized
Comment 1 Alexandru Georgescu 2015-12-17 11:03:07 UTC
Current status for YP 2.1_M1.rc1
Commit: 5e3e2e0cbb0a49986f4653e64c4c8d2b5461645e
Previous Commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1


Results for NUC ptest perl 2015-12-10:
********************************
Tests that failed now and worked last time: 4
ext/XS-APItest/t/handy
lib/locale
t/run/locale
t/re/charset
Tests that passed now and and failed last time: 0

Tests that were skipped now and worked last time: 0

Tests that were skipped last time and worked now: 0
Tests that failed now: 13
ext/XS-APItest/t/handy
cpan/ExtUtils-MakeMaker/t/recurs
cpan/ExtUtils-MakeMaker/t/basic
t/porting/customized
lib/locale
cpan/ExtUtils-MakeMaker/t/several_authors
t/run/locale
cpan/ExtUtils-MakeMaker/t/PL_FILES
cpan/ExtUtils-MakeMaker/t/pm_to_blib
cpan/ExtUtils-MakeMaker/t/min_perl_version
cpan/ExtUtils-Constant/t/Constant
cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
t/re/charset
Comment 2 Alexandru Georgescu 2016-01-25 10:13:23 UTC
Tested with 2.0.1.rc2:
poky: dd0ba9ea4a11ab15348d4fe3574e4b28784db82f
previous commit: fc45deac89ef63ca1c44e763c38ced7dfd72cbe1



Tests that failed now and worked last time: 4
ext/XS-APItest/t/handy
lib/locale
t/run/locale
t/re/charset



Tests that failed now: 13
ext/XS-APItest/t/handy
cpan/ExtUtils-MakeMaker/t/recurs
cpan/ExtUtils-MakeMaker/t/basic
t/porting/customized
lib/locale
cpan/ExtUtils-MakeMaker/t/several_authors
t/run/locale
cpan/ExtUtils-MakeMaker/t/PL_FILES
cpan/ExtUtils-MakeMaker/t/pm_to_blib
cpan/ExtUtils-MakeMaker/t/min_perl_version
cpan/ExtUtils-Constant/t/Constant
cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
t/re/charset
Comment 3 Francisco Pedraza 2016-02-04 10:26:05 UTC
Retested on NUC 5425WYK genericx86_64, 2016-01-28:
poky: 3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c
AB Link: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.1_M2.rc1/ptest/machines/genericx86-64/core-image-sato-sdk-genericx86-64.hddimg

Report: https://wiki.yoctoproject.org/wiki/Ptest_3d2c0f5902cacf9d8544bf263b51ef0dd1a7218c

Getting the following results:

Tests that failed now and worked last time: 1
t/run/switches
Tests that passed now and and failed last time: 0

Tests that were skipped now and worked last time: 0

Tests that were skipped last time and worked now: 0
Tests that failed now: 14
ext/XS-APItest/t/handy
cpan/ExtUtils-MakeMaker/t/recurs
t/run/switches
cpan/ExtUtils-MakeMaker/t/basic
t/porting/customized
lib/locale
cpan/ExtUtils-MakeMaker/t/several_authors
t/run/locale
cpan/ExtUtils-MakeMaker/t/PL_FILES
cpan/ExtUtils-MakeMaker/t/pm_to_blib
cpan/ExtUtils-MakeMaker/t/min_perl_version
cpan/ExtUtils-Constant/t/Constant
cpan/ExtUtils-MakeMaker/t/INSTALL_BASE
t/re/charset
Comment 4 Armin Kuster 2016-02-09 01:35:49 UTC
I don't know why I am assigned this?
Comment 5 Bill Randle 2016-06-04 22:50:53 UTC
The test errors fall into four categories:
  1. errors in a hand edit of the Perl config file done as part of the 5.22.0 to 5.22.1 upgrade
  2. missing libssp
  3. a customized.dat file that was not updated to reflect patches applied
  4. errors in several MakeMaker tests in checking for the presence of a working 'make'.

Patches for the above have been submitted to the mailing list.
Comment 6 Ross Burton 2016-06-21 11:16:24 UTC
perl: fix several perl test failures
OE-Core bf1160a62d758b0148856482cb7b3f6fed63a0c2

perl: some perl tests require libssp
OE-Core 9ea1d6474c5cd3546d1cad7c0f02a1ee8b3c76bb

perl: set proper perl subversion number in config files
OE-Core 6e06fec1ca71979e361d8a6e35ef4ec442e71881
Comment 7 Jose Perez C 2016-10-20 19:38:43 UTC
there is still 1 failure on commit : 4b94b498e21aeba945fe7e72a6b7c4bb0314fb83 hence reopening this bug 

********* Failures *********

FAIL:t/porting/customized

****************************

Results:

https://wiki.yoctoproject.org/wiki/Ptest_4b94b498e21aeba945fe7e72a6b7c4bb0314fb83

Image:

http://autobuilder.yoctoproject.org/pub/releases/yocto-2.2.rc4/machines/genericx86-64/core-image-sato-sdk-ptest-genericx86-64.hddimg
Comment 8 Bill Randle 2016-10-24 19:55:01 UTC
I suspect this is a new bug that should have it's own bugid, rather than re-opening an old one. Anytime we create or add a new patch that touches a source file, the customized.dat file should be inspected to update the MD5 hash of the changed file, or possibly add a new entry. If that's not done, the customized ptest test will fail.

I haven't looked at all the changes since June when the customized.dat file was updated by me, but I strongly suspect a subsequent added patch affected a listed file and customized.dat was not updated.

Perl maintainers should be on the lookout for this in the future.
Comment 9 Benjamin Esquivel 2016-11-09 19:19:16 UTC
*** Bug 9373 has been marked as a duplicate of this bug. ***