8676 2015-11-11 15:36:13 +0000 QA: devtool: extend oe-selftest testing for devtool upgrade 2020-01-09 16:43:59 +0000 1 1 7 Build System, Metadata & Runtime OE-Core devtools / tool chain 5.99 All Multiple RESOLVED FIXED Medium enhancement Future 1 bluelightning unassigned akuster benjamin.esquivel joshuagloe juan.m.cruz.alcaraz meta.mr.watcher meta.watcher richard.purdie --- --- No (bug/feature does not impact docs) oldest_to_newest 56384 0 bluelightning 2015-11-11 15:36:13 +0000 The current "devtool upgrade" test in meta/lib/oeqa/selftest/devtool.py only does a basic test that upgrading a recipe with local source files works, which is not a common use case. We need to also test: 1) Upgrading a recipe pointing to a remote tarball (part of this will be verifying that the checksums get updated) 2) Upgrading a git recipe As part of these We should also validate that only relevant variables in the recipe get modified (and that they are modified appropriately) 61707 1 bluelightning 2016-04-27 03:50:10 +0000 For 2.1 the existing test was reworked to test upgrading a recipe pointing to a remote file and do more validation, plus an additional test to upgrade a recipe pointing to a git repository. We should look to see if there are any code paths not tested by these current tests and add tests to cover them. 61720 2 leonardo.sandoval.gonzalez 2016-04-27 13:42:10 +0000 (In reply to comment #1) > For 2.1 the existing test was reworked to test upgrading a recipe pointing > to a remote file and do more validation, plus an additional test to upgrade > a recipe pointing to a git repository. We should look to see if there are > any code paths not tested by these current tests and add tests to cover them. Thanks for the update. I will review latest code and cover it with tests. 74433 3 jose.perez.carranza 2017-06-21 15:46:03 +0000 currently the test for devtool upgrade are covering : - test_devtool_upgrade - test_devtool_upgrade_git - test_devtool_finish_upgrade_origlayer - test_devtool_finish_upgrade_otherlayer I is there any missing scenario that you identify that need to be tested ? 74951 4 bluelightning 2017-07-12 12:09:08 +0000 I would like to see what the coverage of the upgrade module (scripts/lib/devtool/upgrade.py) is - Jose is that something you have easily available? 75009 5 jose.perez.carranza 2017-07-13 16:04:40 +0000 (In reply to comment #4) > I would like to see what the coverage of the upgrade module > (scripts/lib/devtool/upgrade.py) is - Jose is that something you have easily > available? Unfortunately coverage option is not working on new framework (Bug 11582), I will do some tests on pyro and get back to you with the results. 75010 6 jose.perez.carranza 2017-07-13 16:05:19 +0000 (In reply to comment #5) > (In reply to comment #4) > > I would like to see what the coverage of the upgrade module > > (scripts/lib/devtool/upgrade.py) is - Jose is that something you have easily > > available? > > Unfortunately coverage option is not working on new framework (Bug 11582), I > will do some tests on pyro and get back to you with the results. Unfortunately coverage option is not working on new framework (Bug 11582), I will do some tests on pyro and get back to you with the results. 75020 7 jose.perez.carranza 2017-07-13 21:07:03 +0000 (In reply to comment #6) > (In reply to comment #5) > > (In reply to comment #4) > > > I would like to see what the coverage of the upgrade module > > > (scripts/lib/devtool/upgrade.py) is - Jose is that something you have easily > > > available? > > > > Unfortunately coverage option is not working on new framework (Bug 11582), I > > will do some tests on pyro and get back to you with the results. > > Unfortunately coverage option is not working on new framework (Bug 11582), I > will do some tests on pyro and get back to you with the results. A Bug 11786 was opened due coverage is not working properly on pyro, util that is resolved I will not be able to check what is the current coverage. 76341 8 jose.perez.carranza 2017-08-30 15:49:38 +0000 Moved to 2.5 due resources constraint 85909 9 akuster 2019-12-22 19:22:03 +0000 this still seems reasonable. 86012 10 richard.purdie 2020-01-09 16:43:59 +0000 devtool upgrade tests were added. The remaining question here was about code coverage. I don't believe we ever figured out correct tools for code coverage of that they are practical with the system so closing the original issue a resolved. If anyone identifies areas needing further testing we will add them.