Bug 14252 - oe-selftest reproducible diffoscope command failed
Summary: oe-selftest reproducible diffoscope command failed
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 3.3
Hardware: x86 Multiple
: Undecided normal
Target Milestone: ---
Assignee: Unassigned
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2021-02-23 17:29 UTC by Leonardo Sandoval
Modified: 2021-02-25 16:00 UTC (History)
3 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Leonardo Sandoval 2021-02-23 17:29:31 UTC
AB collection [1], build [2] fail with the following log


2021-02-23 10:27:03,182 - oe-selftest - INFO - reproducible.DiffoscopeTests.test_diffoscope (subunit.RemotedTestCase)
2021-02-23 10:27:03,203 - oe-selftest - INFO -  ... FAIL
2021-02-23 10:27:03,203 - oe-selftest - INFO - 0: 1/2 1/2 (36.96s) (reproducible.DiffoscopeTests.test_diffoscope)
2021-02-23 10:27:03,203 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/meta/lib/oeqa/selftest/cases/reproducible.py", line 162, in test_diffoscope
    native_sysroot=diffoscope_sysroot, cwd=self.diffoscope_test_files)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/meta/lib/oeqa/selftest/cases/reproducible.py", line 149, in run_diffoscope
    **kwargs)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/meta/lib/oeqa/utils/commands.py", line 210, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command '['diffoscope', '--no-default-limits', '--exclude-directory-metadata', 'yes', '--html-dir', '/tmp/tmp8sz450mn', 'A', 'A']' returned non-zero exit status 2:
error: Unable to open /home/pokybuild/yocto-worker/reproducible-ubuntu/build/build-st-31077/tmp/work/x86_64-linux/rpm-native/1_4.16.1.2-r0/recipe-sysroot-native/usr/lib/rpm/rpmrc for reading: No such file or directory.
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/main.py", line 771, in main
    sys.exit(run_diffoscope(parsed_args))
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/main.py", line 725, in run_diffoscope
    difference = compare_root_paths(path1, path2)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/compare.py", line 63, in compare_root_paths
    return compare_directories(path1, path2)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/directory.py", line 225, in compare_directories
    return FilesystemDirectory(path1).compare(FilesystemDirectory(path2))
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/directory.py", line 288, in compare
    differences.extend(my_container.compare(other_container))
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/container.py", line 191, in compare_pair
    difference = compare_files(
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/compare.py", line 96, in compare_files
    specialize(file1)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/specialize.py", line 54, in specialize
    if try_recognize(file, cls, cls.recognizes):
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/specialize.py", line 37, in try_recognize
    if not recognizes(file):
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/file.py", line 165, in recognizes
    file.magic_file_type,
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/file.py", line 319, in magic_file_type
    self._magic_file_type = File.guess_file_type(self.path)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/diffoscope/comparators/utils/file.py", line 102, in guess_file_type
    cls._mimedb = magic.Magic()
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/magic.py", line 66, in __init__
    magic_load(self.cookie, magic_file)
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/magic.py", line 291, in magic_load
    return _magic_load(cookie, coerce_filename(filename))
  File "/home/pokybuild/yocto-worker/reproducible-centos/build/build-st-2641926/tmp/work/x86_64-linux/diffoscope-native/167-r0/recipe-sysroot-native/usr/lib/python3.9/site-packages/magic.py", line 217, in errorcheck_negative_one
    raise MagicException(err)
magic.MagicException: b'could not find any valid magic files!'

[1] https://swatbot.yoctoproject.org/collection/543/
[2] https://autobuilder.yoctoproject.org/typhoon/#/builders/115/builds/29/steps/12/logs/stdio
Comment 1 Leonardo Sandoval 2021-02-23 17:31:35 UTC
Same collection as first comment but different build (and error) [3]

[3] https://autobuilder.yoctoproject.org/typhoon/#/builders/118/builds/29/steps/12/logs/stdio