Bug 12979

Summary: [2.6 M4 rc1] test_recipetool_create_cmake failed on Fedora 27
Product: [QA/Testing] Runtime Testing Reporter: Mohamad Noor Alim <mohamad.noor.alim.hussin>
Component: generalAssignee: Richard Purdie <richard.purdie>
Status: RESOLVED FIXED QA Contact: Mohamad Noor Alim <mohamad.noor.alim.hussin>
Severity: normal    
Priority: Medium+ CC: richard.purdie, ross.burton
Version: 2.6   
Target Milestone: 2.6 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Don't know

Description Mohamad Noor Alim 2018-11-05 05:56:01 UTC
Test failed due to SRC_URI[md5sum] do not match.

AssertionError: '16ceaa14aaa22d15f156a5ed3478b731' != '242f398e979a6b8c0f3c802b63435b68'
- 16ceaa14aaa22d15f156a5ed3478b731
+ 242f398e979a6b8c0f3c802b63435b68
 : values for SRC_URI[md5sum] do not match
Comment 1 Richard Purdie 2018-11-08 08:27:11 UTC
Could you provide more details please, there isn't any context with this error about where it occurred or how to reproduce it.
Comment 2 Mohamad Noor Alim 2018-11-08 08:33:51 UTC
Steps to reproduce

1. clone poky
2. source oe-init
3. $ oe-selftest -r recipetool.RecipetoolTests.test_recipetool_create_cmake

this is example of error log
===============================
2018-11-02 15:31:39,729 - oe-selftest - INFO - FAIL: recipetool.RecipetoolTests.test_recipetool_create_cmake (subunit.RemotedTestCase)
2018-11-02 15:31:39,730 - oe-selftest - INFO - ----------------------------------------------------------------------
2018-11-02 15:31:39,730 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/ab/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/core/decorator/__init__.py", line 32, in wrapped_f
    return func(*args, **kwargs)
  File "/home/ab/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/cases/recipetool.py", line 446, in test_recipetool_create_cmake
    self._test_recipe_contents(recipefile, checkvars, inherits)
  File "/home/ab/yocto-worker/nightly-oe-selftest/build/meta/lib/oeqa/selftest/cases/devtool.py", line 169, in _test_recipe_contents
    self.assertEqual(value, needvalue, 'values for %s do not match' % var)
  File "/usr/lib64/python3.6/unittest/case.py", line 846, in assertEqual
    assertion_func(first, second, msg=msg)
  File "/usr/lib64/python3.6/unittest/case.py", line 1220, in assertMultiLineEqual
    self.fail(self._formatMessage(msg, standardMsg))
  File "/usr/lib64/python3.6/unittest/case.py", line 687, in fail
    raise self.failureException(msg)
AssertionError: '16ceaa14aaa22d15f156a5ed3478b731' != '242f398e979a6b8c0f3c802b63435b68'
- 16ceaa14aaa22d15f156a5ed3478b731
+ 242f398e979a6b8c0f3c802b63435b68
 : values for SRC_URI[md5sum] do not match
Comment 3 Ross Burton 2018-11-08 15:40:09 UTC
FWIW I can verify this happens:

$ wget http://downloads.sourceforge.net/project/navit/v0.5.0/navit-0.5.0.tar.gz
[...]
2018-11-08 15:38:59 (1.26 MB/s) - ‘navit-0.5.0.tar.gz’ saved [6502437/6502437]
$ md5sum navit-0.5.0.tar.gz
16ceaa14aaa22d15f156a5ed3478b731  navit-0.5.0.tar.gz
Comment 4 Mohamad Noor Alim 2018-11-09 01:13:57 UTC
I also get the same md5sum '16ceaa14aaa22d15f156a5ed3478b731' if download navit-0.5.0.tar.gz. But the test case expecting md5sum '242f398e979a6b8c0f3c802b63435b68'. I do not know which version of navit that give the expecting md5sum.
Comment 5 Ross Burton 2018-11-09 01:16:05 UTC
The mirror has the expected checksum, so it looks like the tarball has changed.
Comment 6 Ross Burton 2018-11-09 01:27:02 UTC
The contents have *totally* changed:

$ tar ztvf old-navit-0.5.0.tar.gz |head
drwxrwxr-x root/root         0 2015-12-31 07:42 navit-0.5.0/
-rw-rw-r-- root/root        35 2015-12-31 07:42 navit-0.5.0/.gitignore
-rw-rw-r-- root/root       338 2015-12-31 07:42 navit-0.5.0/AUTHORS
-rwxrwxr-x root/root     28998 2015-12-31 07:42 navit-0.5.0/CMakeLists.txt
-rw-rw-r-- root/root      3763 2015-12-31 07:42 navit-0.5.0/COPYING
-rw-rw-r-- root/root       144 2015-12-31 07:42 navit-0.5.0/COPYRIGHT
-rw-rw-r-- root/root       210 2015-12-31 07:42 navit-0.5.0/ChangeLog
-rw-rw-r-- root/root     17987 2015-12-31 07:42 navit-0.5.0/GPL-2
-rw-rw-r-- root/root     25284 2015-12-31 07:42 navit-0.5.0/LGPL-2
-rw-rw-r-- root/root       681 2015-12-31 07:42 navit-0.5.0/Makefile.am

$ tar ztvf new-navit-0.5.0.tar.gz |head
drwxrwxr-x root/root         0 2015-12-31 07:42 navit-gps-navit-4c7e3da/
-rw-rw-r-- root/root        35 2015-12-31 07:42 navit-gps-navit-4c7e3da/.gitignore
-rw-rw-r-- root/root       338 2015-12-31 07:42 navit-gps-navit-4c7e3da/AUTHORS
-rwxrwxr-x root/root     28998 2015-12-31 07:42 navit-gps-navit-4c7e3da/CMakeLists.txt
-rw-rw-r-- root/root      3763 2015-12-31 07:42 navit-gps-navit-4c7e3da/COPYING
-rw-rw-r-- root/root       144 2015-12-31 07:42 navit-gps-navit-4c7e3da/COPYRIGHT
-rw-rw-r-- root/root       210 2015-12-31 07:42 navit-gps-navit-4c7e3da/ChangeLog
-rw-rw-r-- root/root     17987 2015-12-31 07:42 navit-gps-navit-4c7e3da/GPL-2
-rw-rw-r-- root/root     25284 2015-12-31 07:42 navit-gps-navit-4c7e3da/LGPL-2
-rw-rw-r-- root/root       681 2015-12-31 07:42 navit-gps-navit-4c7e3da/Makefile.am

We should just point the test case at our mirror (http://downloads.yoctoproject.org/mirror/sources/navit-0.5.0.tar.gz) for now.

I've filed a bug upstream too: https://github.com/navit-gps/navit/issues/712
Comment 7 Ross Burton 2018-11-09 01:27:43 UTC
Mohamad, can you fix the test case by changing the URL and verifying the test works again, and if so submit the patch?
Comment 8 Mohamad Noor Alim 2018-11-09 12:39:26 UTC
I send patch to openembedded-core mailing list. http://lists.openembedded.org/pipermail/openembedded-core/2018-November/275923.html