Bug 13635 - devtool fails when reproducible_build class is inherited
Summary: devtool fails when reproducible_build class is inherited
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: devtools / tool chain (show other bugs)
Version: 3.0
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 3.1 M1
Assignee: Paul Eggleton
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2019-11-18 12:26 UTC by Richard Purdie
Modified: 2019-11-23 14:41 UTC (History)
2 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Richard Purdie 2019-11-18 12:26:09 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/87/builds/481

There were a ton of failures when:

INHERIT += "reproducible_build"

was added. This bug covers the devtool selftest failures

2019-11-16 23:04:29,885 - oe-selftest - INFO - ======================================================================
2019-11-16 23:04:29,885 - oe-selftest - INFO - FAIL: devtool.DevtoolUpgradeTests.test_devtool_finish_upgrade_origlayer (subunit.RemotedTestCase)
2019-11-16 23:04:29,885 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,885 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 1503, in test_devtool_finish_upgrade_origlayer
    recipe, oldrecipefile, recipedir, olddir, newversion, patchfn = self._setup_test_devtool_finish_upgrade()
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 1485, in _setup_test_devtool_finish_upgrade
    result = runCmd('devtool upgrade %s %s -V %s' % (recipe, tempdir, newversion))
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/utils/commands.py", line 199, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'devtool upgrade devtool-upgrade-test1 /tmp/devtoolqajmdui54m -V 1.6.0' returned non-zero exit status 1:
NOTE: Starting bitbake server...
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)...
NOTE: Reconnecting to bitbake server...
NOTE: Previous bitbake instance shutting down?, waiting to retry...
NOTE: Retrying server connection (#2)...
Loading cache...done.
Loaded 1339 entries from dependency cache.
Parsing recipes...done.
INFO: Extracting current version source...
Parsing of 802 .bb files complete (801 cached, 1 parsed). 1339 targets, 46 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 3 tasks of which 0 didn't need to be rerun and all succeeded.
INFO: Extracting upgraded version source...
INFO: Fetching http://www.ivarch.com/programs/sources/pv-1.6.0.tar.gz...
Loading cache...done.
Loaded 1339 entries from dependency cache.
Parsing recipes...done.
Parsing of 803 .bb files complete (801 cached, 2 parsed). 1340 targets, 46 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 2 tasks of which 0 didn't need to be rerun and all succeeded.
DEBUG 5 [Errno 25] Inappropriate ioctl for device
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:  60% |#####################               | ETA:  0:00:00
Adding changed files: 100% |####################################| Time: 0:00:00
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 334, in <module>
    ret = main()
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 321, in main
    ret = args.func(args, config, basepath, workspace)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 556, in upgrade
    tinfoil, rd)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 284, in _extract_new_source
    shutil.rmtree(tmpdir)
  File "/usr/lib/python3.6/shutil.py", line 477, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 475, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/devtoolqkrmgwem'

======================================================================
2019-11-16 23:04:29,885 - oe-selftest - INFO - FAIL: devtool.DevtoolUpgradeTests.test_devtool_finish_upgrade_otherlayer (subunit.RemotedTestCase)
2019-11-16 23:04:29,885 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,885 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 1521, in test_devtool_finish_upgrade_otherlayer
    recipe, oldrecipefile, recipedir, olddir, newversion, patchfn = self._setup_test_devtool_finish_upgrade()
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 1485, in _setup_test_devtool_finish_upgrade
    result = runCmd('devtool upgrade %s %s -V %s' % (recipe, tempdir, newversion))
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/utils/commands.py", line 199, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'devtool upgrade devtool-upgrade-test1 /tmp/devtoolqaamv0po4b -V 1.6.0' returned non-zero exit status 1:
NOTE: Starting bitbake server...
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)...
NOTE: Reconnecting to bitbake server...
NOTE: Previous bitbake instance shutting down?, waiting to retry...
NOTE: Retrying server connection (#2)...
Loading cache...done.
INFO: Extracting current version source...
Loaded 1339 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 3 tasks of which 0 didn't need to be rerun and all succeeded.
INFO: Extracting upgraded version source...
INFO: Fetching http://www.ivarch.com/programs/sources/pv-1.6.0.tar.gz...
Loading cache...done.
Loaded 1339 entries from dependency cache.
Parsing recipes...done.
Parsing of 803 .bb files complete (801 cached, 2 parsed). 1340 targets, 46 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 2 tasks of which 0 didn't need to be rerun and all succeeded.
DEBUG 5 [Errno 25] Inappropriate ioctl for device
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:  60% |#####################               | ETA:  0:00:00
Adding changed files: 100% |####################################| Time: 0:00:00
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 334, in <module>
    ret = main()
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 321, in main
    ret = args.func(args, config, basepath, workspace)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 556, in upgrade
    tinfoil, rd)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 284, in _extract_new_source
    shutil.rmtree(tmpdir)
  File "/usr/lib/python3.6/shutil.py", line 477, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 475, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/devtoolin6cdfha'

======================================================================
2019-11-16 23:04:29,885 - oe-selftest - INFO - FAIL: devtool.DevtoolUpgradeTests.test_devtool_upgrade (subunit.RemotedTestCase)
2019-11-16 23:04:29,886 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,886 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 1350, in test_devtool_upgrade
    result = runCmd('devtool upgrade %s %s -V %s' % (recipe, tempdir, version))
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/utils/commands.py", line 199, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command 'devtool upgrade devtool-upgrade-test1 /tmp/devtoolqa7yb6l0_l -V 1.6.0' returned non-zero exit status 1:
NOTE: Starting bitbake server...
NOTE: Reconnecting to bitbake server...
NOTE: Retrying server connection (#1)...
NOTE: Reconnecting to bitbake server...
NOTE: Previous bitbake instance shutting down?, waiting to retry...
NOTE: Retrying server connection (#2)...
Loading cache...done.
INFO: Extracting current version source...
Loaded 1339 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 3 tasks of which 0 didn't need to be rerun and all succeeded.
INFO: Extracting upgraded version source...
INFO: Fetching http://www.ivarch.com/programs/sources/pv-1.6.0.tar.gz...
Loading cache...done.
Loaded 1339 entries from dependency cache.
Parsing recipes...done.
Parsing of 803 .bb files complete (801 cached, 2 parsed). 1340 targets, 46 skipped, 0 masked, 0 errors.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "1.44.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
DISTRO               = "poky"
DISTRO_VERSION       = "3.0"
TUNE_FEATURES        = "m64 core2"
TARGET_FPU           = ""
meta                 
meta-poky            
meta-yocto-bsp       = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"
meta-selftest        = "master:4399cf456c651640ae1496a2c61355bff9d30841"
workspace            = "master-next:9297ffeebbd3aa972fbb75e6fc3030eb416a2094"

Initialising tasks...done.
Sstate summary: Wanted 0 Found 0 Missed 0 Current 0 (0% match, 0% complete)
NOTE: No setscene tasks
NOTE: Executing Tasks
NOTE: Tasks Summary: Attempted 2 tasks of which 0 didn't need to be rerun and all succeeded.
DEBUG 5 [Errno 25] Inappropriate ioctl for device
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:   0% |                                   | ETA:  --:--:--
Adding changed files:  60% |#####################               | ETA:  0:00:00
Adding changed files: 100% |####################################| Time: 0:00:00
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 334, in <module>
    ret = main()
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/devtool", line 321, in main
    ret = args.func(args, config, basepath, workspace)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 556, in upgrade
    tinfoil, rd)
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/scripts/lib/devtool/upgrade.py", line 284, in _extract_new_source
    shutil.rmtree(tmpdir)
  File "/usr/lib/python3.6/shutil.py", line 477, in rmtree
    onerror(os.lstat, path, sys.exc_info())
  File "/usr/lib/python3.6/shutil.py", line 475, in rmtree
    orig_st = os.lstat(path)
FileNotFoundError: [Errno 2] No such file or directory: '/tmp/devtools9ioc6zt'

======================================================================
2019-11-16 23:04:29,886 - oe-selftest - INFO - FAIL: devtool.DevtoolAddTests.test_devtool_add_fetch (subunit.RemotedTestCase)
2019-11-16 23:04:29,886 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,886 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 408, in test_devtool_add_fetch
    self.assertTrue(os.path.isfile(os.path.join(srcdir, 'setup.py')), 'Unable to find setup.py in source directory')
  File "/usr/lib/python3.6/unittest/case.py", line 682, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true : Unable to find setup.py in source directory


2019-11-16 23:04:29,886 - oe-selftest - INFO - ======================================================================
2019-11-16 23:04:29,886 - oe-selftest - INFO - FAIL: devtool.DevtoolAddTests.test_devtool_add_fetch_git (subunit.RemotedTestCase)
2019-11-16 23:04:29,886 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,886 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 452, in test_devtool_add_fetch_git
    self.assertTrue(os.path.isfile(os.path.join(srcdir, 'imraa', 'imraa.c')), 'Unable to find imraa/imraa.c in source directory')
  File "/usr/lib/python3.6/unittest/case.py", line 682, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true : Unable to find imraa/imraa.c in source directory


2019-11-16 23:04:29,886 - oe-selftest - INFO - ======================================================================
2019-11-16 23:04:29,887 - oe-selftest - INFO - FAIL: devtool.DevtoolAddTests.test_devtool_add_fetch_simple (subunit.RemotedTestCase)
2019-11-16 23:04:29,887 - oe-selftest - INFO - ----------------------------------------------------------------------
2019-11-16 23:04:29,887 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/lib/oeqa/selftest/cases/devtool.py", line 499, in test_devtool_add_fetch_simple
    self.assertTrue(os.path.isfile(os.path.join(srcdir, 'configure')), 'Unable to find configure script in source directory')
  File "/usr/lib/python3.6/unittest/case.py", line 682, in assertTrue
    raise self.failureException(msg)
AssertionError: False is not true : Unable to find configure script in source directory