Perform diff and found that perl tests that passing in 2.4.2.rc2 are failing on 2.4.3.rc2 --- a/perl +++ b/perl @@ -815,7 +815,7 @@ PASS: cpan/HTTP-Tiny/t/020_headers PASS: cpan/HTTP-Tiny/t/030_response PASS: cpan/HTTP-Tiny/t/040_content PASS: cpan/HTTP-Tiny/t/050_chunked_body -PASS: cpan/HTTP-Tiny/t/060_http_date +FAIL: cpan/HTTP-Tiny/t/060_http_date PASS: cpan/HTTP-Tiny/t/070_cookie_jar PASS: cpan/HTTP-Tiny/t/100_get PASS: cpan/HTTP-Tiny/t/101_head @@ -1488,7 +1488,7 @@ PASS: cpan/Tie-RefHash/t/rebless PASS: cpan/Tie-RefHash/t/refhash PASS: cpan/Tie-RefHash/t/storable PASS: cpan/Tie-RefHash/t/threaded -PASS: cpan/Time-Local/t/Local +FAIL: cpan/Time-Local/t/Local PASS: cpan/Time-Piece/t/01base PASS: cpan/Time-Piece/t/02core_dst PASS: cpan/Time-Piece/t/02core
these are the two tests that fail with latest Rocko 2.4.4 FAIL: t/porting/customized FAIL: cpan/ExtUtils-Constant/t/Constant which don't match below
is "Failed 2 tests out of 2281, 99.91% okay." ?
(In reply to comment #2) > is "Failed 2 tests out of 2281, 99.91% okay." ? It was not so important on the percentage of pass, but rather the tests that were passing in previous release (eg. 2.4.2) but now failing on current release (eg. 2.4.3) showing that some changes in current release may caused the package functionality to be broken.
Performed diff and found that Perl tests that passed in 2.6 M2 rc1 are failing on 2.6 M3 rc1 ------------------------------------------------------------------------ Package Name: perl ------------------------------------------------------------------------ -PASS: t/porting/customized +FAIL: t/porting/customized -------------------------------------------------------------------------- Total number of test cases passing in Previous release but failing in Current release: 1 ----------------------------------------------------------------------------
The customized test checks if any changes were made to the modules listed in Maintainers.pl and matches the hashes. And since we apply patches, that is not going to work. Should we be doing something like: ( cd ${D}${PTEST_PATH}/t && perl -I../lib porting/customized.t --regen ) to regenerate the hashes in customized.dat. The patch that is trying to change hashes in this file (from 2016) so this test passes should probably also be removed. That one is always going to remain out of date.
This was merged: https://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=bfa9068b4013bbd9ea47229d34f39853c973b63f Perhaps should be included for sumo 2.5.2 too? Instead of regenerating the hash database, I found a patch upstream that helps distros skip this test instead.
in stable/sumo-nmut for testing
seems to be passing now.
QA please confirm for sumo in next QA round
this is in rocko proper http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?h=rocko&id=0118c2d2aa9f0209a8669017047d9c4d15929402
2.4.4 QA test report shows pass.
closing