Bug 10744

Summary: Update test case of smartpm/createrepo under meta/lib/oeqa/runtime
Product: [QA/Testing] Runtime Testing Reporter: Jose Perez C <jose.perez.carranza>
Component: generalAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact: Apoorv <apoorv.sangal>
Severity: enhancement    
Priority: Medium+ CC: alex.kanavin, benjamin.esquivel, mariano.lopez, mark.hatle, randy.macleod, robin.l.jordan
Version: 2.3   
Target Milestone: 2.6 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Bug Depends on: 9675    
Bug Blocks:    

Description Jose Perez C 2016-11-30 14:33:45 UTC
After a final on decision on the bug 9675 QA may require to update the current test cases for rpm and smart located on meta/lib/oequa/runtime
Comment 1 Alexander Kanavin 2017-02-01 17:28:57 UTC
I've already ported and verified the basic test cases. Some of the original test cases for smartpm have been removed because they make no sense to me.

https://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/tree/meta/lib/oeqa/runtime/cases/dnf.py?h=akanavin/dnf-rpm4

https://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/tree/meta/lib/oeqa/runtime/cases/rpm.py?h=akanavin/dnf-rpm4

I would like you to review them, run them, and perhaps add more advanced tests (send me the patches for any new testcases you write).

(note: the branch akanavin/dnf-rpm4 will be force pushed so be prepared to handle that)
Comment 2 Jose Perez C 2017-02-01 17:31:36 UTC
Also test IDs should be created on Testopia
Comment 3 Jose Perez C 2017-02-02 14:13:25 UTC
According to the list of commands on the documentation [1] there is list of commands that dnf provides below is the full list:

******* CURRENTLY TESTED ************
-help
-history
-info 
-install
-makecache
-reinstall
-remove
-repolist
-search

******* NOT CURRENT TESTED ***********

-autoremove
-check-update
-clean
-distro-sync
-downgrade
-group
-list
-mark
-provides
-repository-packages
-updateinfo
-upgrade
-upgrade-to 

Hence the scope of this bug is to cover the commands not being tested, unless someone has a different command/scenario that should be included. 

1- http://dnf.readthedocs.io/en/latest/command_ref.html
Comment 4 Alexander Kanavin 2017-02-02 17:19:15 UTC
I think you could also check various options of the dnf command, both from command line and configuration file. Of particular interest:

-x

--installroot (Mark would be particularly interested in this one :)

signature verification of repositories and packages in them (I didn't implement signing either of those yet, but that doesn't mean you can't write the test :)

Don't blindly make a test for all dnf commands, see what they mean and if testing them makes sense.
Comment 5 Jose Perez C 2017-02-15 21:44:58 UTC
Depending on bug 9675 that was moved to 2.4
Comment 6 Jose Perez C 2017-04-04 19:08:30 UTC
First patch with the test cases ID was already sent 

http://lists.openembedded.org/pipermail/openembedded-core/2017-April/135155.html
Comment 7 Jose Perez C 2017-05-10 19:38:24 UTC
Patch sent

https://patchwork.openembedded.org/patch/139734/
Comment 8 Jose Perez C 2017-05-11 17:33:39 UTC
PATCH v2 sent 

https://patchwork.openembedded.org/patch/139781/
Comment 9 Jose Perez C 2017-05-15 19:21:08 UTC
V3 on the list 

https://patchwork.openembedded.org/patch/139873/
Comment 10 Jose Perez C 2017-06-09 16:33:44 UTC
Some rework needed due failures on AB moving to M2
Comment 11 Jose Perez C 2017-06-13 19:55:36 UTC
V4 on the list 

https://patchwork.openembedded.org/patch/140804/
Comment 12 Jose Perez C 2017-07-19 19:50:14 UTC
Moved to M3 as was not integrated for M2
Comment 13 Jose Perez C 2017-08-18 14:02:51 UTC
There are some issues with archs and image types, reworking to create test cases applicable for all arch and image types. Moving to 2.5 as this is an enhancement and does not apply for 2.4 M4.
Comment 14 Jose Perez C 2017-11-29 17:41:32 UTC
A proposed pact is on below branch 

http://git.yoctoproject.org/cgit/cgit.cgi/poky-contrib/log/?h=jperez/bug-10744-dnf
Comment 15 Alexander Kanavin 2017-11-30 11:49:50 UTC
So were you able to resolve issues mentioned in comment 13? If so, the patch should go on oe-core list.
Comment 16 Jose Perez C 2017-11-30 16:19:03 UTC
patch sent to the list 

https://patchwork.openembedded.org/patch/146317/
Comment 17 Robin Jordan 2018-05-07 17:27:17 UTC
Did this go into 2.5?
Comment 18 Alexander Kanavin 2018-05-07 22:31:22 UTC
No, as far as I see. Since QA team was moved from GDC to Penang, no progress has happened. I don't remember what was the issue with the last iteration of the patch specifically that prevented it going in.