Bug 11786

Summary: [pyro]oe-selftest: coverage-include not giving correct information
Product: [QA/Testing] Build Testing Reporter: Jose Perez C <jose.perez.carranza>
Component: generalAssignee: Unassigned <unassigned>
Status: RESOLVED OBSOLETE QA Contact:
Severity: normal    
Priority: Low CC: bluelightning, leonardo.sandoval.gonzalez, richard.purdie
Version: 2.4   
Target Milestone: Future   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
devtool coverage none

Description Jose Perez C 2017-07-13 19:21:27 UTC
Created attachment 3870 [details]
devtool coverage

Option --coverage-include is not giving proper information about the coverage on test cases, this scenario represents the devtool suite which should be giving specific coverage for scripts/lib/devtool scripts 


===== STEPS =====

1- checkout pyro
2- source oe-init-build-env 
3- under build execute following 

   $ echo "SANITY_TESTED_DISTROS = ''" >> conf/local.conf
   $ oe-selftest -r devtool --coverage --coverage-include /home/jgperezc/sandbox/poky/scripts/lib/devtool/*

EXPECTED RESULTS 
coverage should be specified correctly 

ACTUAL RESULT 

data_file = /home/jgperezc/sandbox/poky/build-devtool-update/.coverage.20170713T104349
branch = True
source = 
    /home/jgperezc/sandbox/poky/meta
    /home/jgperezc/sandbox/poky/meta-poky
    /home/jgperezc/sandbox/poky/meta-yocto-bsp
    /home/jgperezc/sandbox/poky/meta-selftest
    /home/jgperezc/sandbox/poky/scripts
    /home/jgperezc/sandbox/poky/bitbake
include = 
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/build_image.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/build.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/build_sdk.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/deploy.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/__init__.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/package.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/__pycache__
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/runqemu.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/sdk.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/search.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/standard.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/upgrade.py
    /home/jgperezc/sandbox/poky/scripts/lib/devtool/utilcmds.py

2017-07-13 11:31:14,032 - selftest - INFO - Coverage Report
2017-07-13 11:31:14,032 - selftest - INFO - ===============
2017-07-13 11:31:14,068 - selftest - WARNING - No data to report.

----------------------------------------------------------------------
Ran 38 tests in 2845.013s



NOTE: if --coverage --coverage-include is not given to the command the coverage report is showed correctly but without giving information about /home/jgperezc/sandbox/poky/scripts/lib/devtool/* log attached
Comment 1 Richard Purdie 2020-04-30 08:35:49 UTC
Coverage support was remove from oe-selftest during a migration and we don't have the resources to reimplement now.