Commit: 573c646d4cc62dcd0c230381df4940bdf314d495 Image: http://autobuilder.yoctoproject.org/pub/releases/yocto-2.3_M1.rc1/machines/genericx86-64/core-image-sato-sdk-ptest-genericx86-64.hddimg HW: NUC6 ----- Steps ---- 1. Download pTest image from autobuilder( you can find core-image-sato-sdk image in pTest directory) * we test it on NUC with genericx86-64 2. Install the image on DUT (using legacy boot) 3. Boot the image 4. In command line type $ ptest-runner > ptest.log EXPECTED RESULT All openssl test cases should be PASS ACTUAL RESULT test cases are failing as below: FAIL:test_bn FAIL:test_cms --- Ouput ---- make[2]: Entering directory '/usr/lib/openssl/ptest/test' starting big number library test, could take a while... running bc make[2]: Leaving directory '/usr/lib/openssl/ptest/test' FAIL: test_bn --- make[2]: Entering directory '/usr/lib/openssl/ptest/test' CMS consistency test /bin/perl cms-test.pl make[2]: Leaving directory '/usr/lib/openssl/ptest/test' FAIL: test_cms NOTE: full lg can be downloaded from here https://wiki.yoctoproject.org/wiki/images/8/81/Logs_2.3.M1.rc1.txt
Postponing to M4, my hands are tied with bug 9675 now. In any case, I'd like to further investigate moving to openssl 1.1 first, by looking at specific packages that currently fail to build against it: http://lists.openembedded.org/pipermail/openembedded-core/2016-December/130132.html
Had a moment while waiting for a build: Both tests end up trying to execute build host perl (with absolute path). This is because even though test/Makefile sets "PERL = perl", the top-level makefile runs test/Makefile with "$(MAKE) -e $(BUILDENV)" and BUILDENV includes PERL, overriding the local PERL definition. Removing PERL from BUILDENV makes the tests pass, but I'm not sure if it would break something during build -- probably not in our case at least.
I ended up patching the Makefile that is installed into ptest directory. This is not particularly important though, as openssl 1.1 will run ptests directly, bypassing the Makefile altogether.
Verified on 2.3 rc2 are working correctly https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2#results