Bug 9090

Summary: extensible sdk test compatibility with sdk
Product: [QA/Testing] Runtime Testing Reporter: Aníbal Limón <anibal.limon>
Component: generalAssignee: Aníbal Limón <anibal.limon>
Status: VERIFIED FIXED QA Contact: oscar lopez arandas <oscarx.lopez.arandas>
Severity: enhancement    
Priority: Medium+ CC: bluelightning, jose.perez.carranza, sonia.delgado
Version: 2.1   
Target Milestone: 2.4 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on: 7601, 9038    
Bug Blocks:    
Attachments:
Description Flags
log none

Description Aníbal Limón 2016-02-10 17:58:40 UTC
Now the SDK compatibility tests are implemented but only exec two/five of them because of lack of information about what is installed see bug 9038.

https://bugzilla.yoctoproject.org/show_bug.cgi?id=9038

The purpose for this bug is for verify that SDK compatiblity tests works after fix 9038.
Comment 1 Aníbal Limón 2016-02-19 23:00:18 UTC
Move to 2.2 due to my current load in QA transition.
Comment 2 Aníbal Limón 2016-07-07 20:54:35 UTC
Move to M3 and assign to Fransisco, he is currently working on eSDK tests.
Comment 3 Francisco Pedraza 2016-09-05 18:58:38 UTC
(In reply to comment #2)
> Move to M3 and assign to Fransisco, he is currently working on eSDK tests.

Done, merged in master.

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=0e38688bca3bc52bd95181eb05370d452c447dc7

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=1da953d631ab1574c6a9242f2c8ff9cd6b74bcd0
Comment 4 Sonia Delgado 2016-11-09 16:21:11 UTC
waiting for Paul's inputs bug 9038
Comment 5 Francisco Pedraza 2017-02-23 18:06:04 UTC
I worked on this implementation. Patch sent.
I added validation on each SDK compatibility test with eSDK based on generated target and host manifests files as per bug https://bugzilla.yoctoproject.org/show_bug.cgi?id=9038 described (I already sent the patch as well).
Waiting for approval.
http://lists.openembedded.org/pipermail/openembedded-core/2017-February/133297.html
Comment 6 Francisco Pedraza 2017-02-24 17:37:37 UTC
I sent two more versions due patch test feedback:
http://lists.openembedded.org/pipermail/openembedded-core/2017-February/133339.html
Comment 7 Francisco Pedraza 2017-03-22 18:01:43 UTC
Patch is sent, I will move to M4 due delay in revision.
Comment 8 Francisco Pedraza 2017-06-09 17:09:50 UTC
Updated version of the patch sent: http://lists.openembedded.org/pipermail/openembedded-core/2017-June/137866.html
Comment 9 Francisco Pedraza 2017-06-09 17:10:02 UTC
Updated version of the patch sent: http://lists.openembedded.org/pipermail/openembedded-core/2017-June/137866.html
Comment 11 Francisco Pedraza 2017-06-12 17:37:42 UTC
Waiting for integration, moved to M2.
Comment 12 Francisco Pedraza 2017-06-12 22:29:38 UTC
Reasigned to 2.4 M1, Merged:
http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=05697aa9418a107e584caa168967e9350d1ea404
Comment 13 oscar lopez arandas 2017-10-06 22:22:44 UTC
validation on each SDK compatibility test with eSDK based on generated target 

BB_VERSION        = "1.34.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "universal-4.8"
TARGET_SYS        = "i586-poky-linux"
MACHINE           = "qemux86"
DISTRO            = "poky"
DISTRO_VERSION    = "2.3"
TUNE_FEATURES     = "m32 i586"      
meta-yocto-bsp    = "HEAD:05697aa9418a107e584caa168967e9350d1ea404"

     Test using Pre-Built SDK Installers: 

  1. Under poky/ do another build folder different from the previous scenario 
     $ source oe-init-build-env build-pre-built

  2. Add proper configuration to local.conf
     $ echo 'SDK_EXT_TYPE = "minimal"' >> conf/local.conf 
     $ echo 'INHERIT += "testsdk"' >> conf/local.conf

  3. Create sdk directory
     $ mkdir -p tmp/deploy/sdk

  4. Download artifacts form AB under new folder created 
     $ cd  tmp/deploy/sdk  
     $ wget <AB_LINK>/toolchain/x86_64/<ARTIFACTS_NEEDED>
        
         Example:
         $ wget https://autobuilder.yocto.io/pub/releases/yocto-2.4_M3.rc1/toolchain/x86_64/poky-glibc-x86_64-core-image-minimal-i586-toolchain-ext-2.3.host.manifest   
         
         NOTE: All the artifacts that should be downloaded are:
           - poky-glibc-x86_64-core-image-minimal-i586-toolchain-ext-2.3.target.manifest
           - poky-glibc-x86_64-core-image-minimal-i586-toolchain-ext-2.3.host.manifest
           - poky-glibc-x86_64-core-image-minimal-i586-toolchain-ext-2.3.sh
           - poky-glibc-x86_64-core-image-minimal-i586-toolchain-ext-2.3.testdata.jason

   5. Give execution permissions to sh files. Rename files, only if it asks.
     $ chmod +x *.sh
     $ for file in *<RELEASE>*; do mv "$file" "${file/<RELEASE>/<RELEASE>+snapshot}"; done
       Example execute below command: 
        $ for file in *2.3*; do mv "$file" "${file/2.3/2.3+snapshot}"; done

   6. Go back to poky build folder "poky/build-pre-built"
     $ cd - 

   7. Prepare the environment to execute tests     
     $ bitbake libxml2
 9. All test should be PASSED


   8. Execute the test   
     $ bitbake core-image-minimal -c testsdkext
note:
 log in attchament
Comment 14 oscar lopez arandas 2017-10-06 22:23:17 UTC
Created attachment 4064 [details]
log