Bug 12773

Summary: [Meta-Yocto :2.4.3RC2] QA_WARN and QA_ERROR Mechanism checking Failed
Product: [Build System, Metadata & Runtime] Meta-yocto Reporter: pankaj yadav <pankaj-y>
Component: meta-yoctoAssignee: Anuj Mittal <anuj.mittal>
Status: RESOLVED NOTABUG QA Contact:
Severity: normal    
Priority: Medium+ CC: poky.bs.watcher, poky.watcher, ross.burton
Version: 2.4.3   
Target Milestone: 2.6 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description pankaj yadav 2018-06-06 07:28:52 UTC 
Hi All,

Test Case Link : https://bugzilla.yoctoproject.org/tr_show_case.cgi?case_id=804

While executing this test, I am getting below mentioned issue as shown in attached screenshot. 

Issue Reproduced on Release : 2.4.3RC2 and 2.3.4.rc1
Previous Release QA Status : Pass
Test case name :  QA_WARN and QA_ERROR mechanism checking. 
Test case number : Case 804
Environment : x86_64
Summary : According to test we should get 2 warning message  and build should get passed. But build is getting failed with 2 warning message and 1 error message. 

Steps  to reproduce : 
1.	Download the poky source and set environment
2.	Add the following lines to a .bb file. For expample, xcursor-transparent-theme_1.6.bb:
PACKAGES += "${PN}-dbg"
3.	Run "bitbake xcursor-transparent-theme"
4.	Modify the meta-poky/conf/distro/poky.conf. After WARN_QA_remove = "${WARN_TO_ERROR_QA}", add WARN_QA_append = " packages-list".
5.	After ERROR_QA_append = " ${WARN_TO_ERROR_QA}", add ERROR_QA_remove = "packages-list".
6.	Run "bitbake xcursor-transparent-theme" again. 
Expected Output of 6th step :
####################
WARNING: QA Issue: xcursor-transparent-theme-dbg is listed in PACKAGES multiple times, this leads to packaging errors.
NOTE: Tasks Summary: Attempted 379 tasks of which 341 didn't need to be rerun and all succeeded.

Summary: There were 2 WARNING messages shown.
####################
Check the return value of the command, should be 0.
echo $?
0
Actual output:
We get one error message and build is not successful

  
Regards,
Pankaj
Comment 1 Ross Burton 2018-06-07 15:02:09 UTC 
This test case has been part of oe-selftest (and so automated) for quite some time.  Back in 2016 I fixed the test case[1] so it works reliably, and it's been working since.

If this test case is being executed manually, it should be removed from the manual test case list as the automated QA covers this.

[1] http://git.yoctoproject.org/cgit.cgi/poky/commit/meta/lib/oeqa/selftest/buildoptions.py?id=9ec7cef3d079114c391161103cbd6a70ffba555a
Comment 2 pankaj yadav 2018-06-11 02:43:37 UTC 
Closing this bug as a "Not A Bug" as this Test case has been removed from Manual Test Case template and moved to automation QA already.