Bug 12787 - [2.4.3.rc2] perl ptest failed
Summary: [2.4.3.rc2] perl ptest failed
Status: CLOSED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.4.3
Hardware: x86 Multiple
: Medium normal
Target Milestone: 2.5.2
Assignee: Armin Kuster
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2018-06-14 07:15 UTC by yeoh ee peng
Modified: 2018-11-29 16:25 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: Regression (Found by QA test)
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description yeoh ee peng 2018-06-14 07:15:30 UTC
Perform diff and found that perl tests that passing in 2.4.2.rc2 are failing on 2.4.3.rc2

--- a/perl
+++ b/perl
@@ -815,7 +815,7 @@ PASS: cpan/HTTP-Tiny/t/020_headers
 PASS: cpan/HTTP-Tiny/t/030_response
 PASS: cpan/HTTP-Tiny/t/040_content
 PASS: cpan/HTTP-Tiny/t/050_chunked_body
-PASS: cpan/HTTP-Tiny/t/060_http_date
+FAIL: cpan/HTTP-Tiny/t/060_http_date
 PASS: cpan/HTTP-Tiny/t/070_cookie_jar
 PASS: cpan/HTTP-Tiny/t/100_get
 PASS: cpan/HTTP-Tiny/t/101_head
@@ -1488,7 +1488,7 @@ PASS: cpan/Tie-RefHash/t/rebless
 PASS: cpan/Tie-RefHash/t/refhash
 PASS: cpan/Tie-RefHash/t/storable
 PASS: cpan/Tie-RefHash/t/threaded
-PASS: cpan/Time-Local/t/Local
+FAIL: cpan/Time-Local/t/Local
 PASS: cpan/Time-Piece/t/01base
 PASS: cpan/Time-Piece/t/02core_dst
 PASS: cpan/Time-Piece/t/02core
Comment 1 Armin Kuster 2018-08-16 01:07:42 UTC
these are the two tests that fail with latest Rocko 2.4.4
FAIL: t/porting/customized
FAIL: cpan/ExtUtils-Constant/t/Constant

which don't match below
Comment 2 Armin Kuster 2018-08-16 01:08:12 UTC
is "Failed 2 tests out of 2281, 99.91% okay." ?
Comment 3 yeoh ee peng 2018-08-16 01:18:39 UTC
(In reply to comment #2)
> is "Failed 2 tests out of 2281, 99.91% okay." ?

It was not so important on the percentage of pass, but rather the tests that were passing in previous release (eg. 2.4.2) but now failing on current release (eg. 2.4.3) showing that some changes in current release may caused the package functionality to be broken.
Comment 4 Manish Das 2018-10-03 10:11:20 UTC
Performed diff and found that Perl tests that passed in 2.6 M2 rc1 are failing on 2.6 M3 rc1

------------------------------------------------------------------------
Package Name:  perl
------------------------------------------------------------------------
-PASS: t/porting/customized

+FAIL: t/porting/customized

--------------------------------------------------------------------------
Total number of test cases passing in Previous release but failing in Current release:  1
----------------------------------------------------------------------------
Comment 5 Anuj Mittal 2018-10-12 05:52:38 UTC
The customized test checks if any changes were made to the modules listed in Maintainers.pl and matches the hashes. And since we apply patches, that is not going to work.

Should we be doing something like:

( cd ${D}${PTEST_PATH}/t && perl -I../lib porting/customized.t --regen )

to regenerate the hashes in customized.dat.

The patch that is trying to change hashes in this file (from 2016) so this test passes should probably also be removed. That one is always going to remain out of date.
Comment 6 Anuj Mittal 2018-10-16 22:39:11 UTC
This was merged:

https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=bfa9068b4013bbd9ea47229d34f39853c973b63f

Perhaps should be included for sumo 2.5.2 too?

Instead of regenerating the hash database, I found a patch upstream that helps distros skip this test instead.
Comment 7 Armin Kuster 2018-11-01 01:29:48 UTC
in stable/sumo-nmut for testing
Comment 8 Armin Kuster 2018-11-02 00:58:24 UTC
seems to be passing now.
Comment 9 Armin Kuster 2018-11-05 23:34:08 UTC
QA please confirm for sumo in next QA round
Comment 11 Armin Kuster 2018-11-29 16:25:32 UTC
2.4.4 QA test report shows pass.
Comment 12 Armin Kuster 2018-11-29 16:25:42 UTC
closing