Bug 8824

Summary: bitbake -b fails during task execution
Product: [Build System, Metadata & Runtime] BitBake Reporter: Paul Eggleton <bluelightning>
Component: bitbakeAssignee: Richard Purdie <richard.purdie>
Status: VERIFIED FIXED QA Contact: Bogdan Alexandru Voiculescu <bogdanx.a.voiculescu>
Severity: normal    
Priority: Medium+ CC: bogdanx.a.voiculescu, poky.bs.watcher, poky.watcher
Version: 2.0   
Target Milestone: 2.1 M2   
Hardware: All   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: Regression (Used to work)
Verified: Documentation change: No (bug/feature does not impact docs)

Description Paul Eggleton 2015-12-17 03:19:14 UTC 
If you use bitbake's -b option, it fails somewhere in executing the tasks:

----------- snip -----------
$ bitbake -b dpkg
WARNING: Buildfile specified, dependencies will not be handled. If this is not what you want, do not use -b / --buildfile.

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-14.04"
TARGET_SYS        = "x86_64-poky-linux"
MACHINE           = "qemux86-64"
DISTRO            = "poky"
DISTRO_VERSION    = "2.0+snapshot-20151217"
TUNE_FEATURES     = "m64 core2"
TARGET_FPU        = ""
meta              
meta-yocto        
meta-yocto-bsp    
workspace         = "master:f1f3716776078d68bd9e3734bca881a486dc2ea3"

NOTE: Preparing RunQueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
No currently running tasks (2 of 13)
can only concatenate tuple (not "int") to tuple
Summary: There was 1 WARNING message shown.
----------- snip -----------

I say "somewhere" because the other odd thing about this is there's no traceback shown and the exception doesn't actually cause the build to fail, even though it clearly caused the build to stop unexpectedly.
Comment 2 Bogdan Alexandru Voiculescu 2016-01-06 14:51:13 UTC 
Trying to verify this bug I notice, build fails because of 'm4' build: 

bitbake -b dpkg
WARNING: Buildfile specified, dependencies will not be handled. If this is not what you want, do not use -b / --buildfile.

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-14.04"
TARGET_SYS        = "arm-poky-linux-gnueabi"
MACHINE           = "beaglebone"
DISTRO            = "poky"
DISTRO_VERSION    = "2.0+snapshot-20160106"
TUNE_FEATURES     = "arm armv7a vfp neon callconvention-hard cortexa8"
TARGET_FPU        = "vfp-neon"
meta
meta-yocto
meta-yocto-bsp    = "master:2cd061a29a94fdcdfec86732e6bcbb71c12c4afc"

NOTE: Preparing RunQueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
ERROR: Function failed: do_configure (log file is located at /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/temp/log.do_configure.24649)
ERROR: Logfile of failure stored in: /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/temp/log.do_configure.24649
Log data follows:
| DEBUG: Executing python function sysroot_cleansstate
| DEBUG: Python function sysroot_cleansstate finished
| DEBUG: SITE files ['endian-little', 'bit-32', 'arm-common', 'arm-32', 'common-linux', 'common-glibc', 'arm-linux', 'arm-linux-gnueabi', 'common']
| DEBUG: Executing shell function autotools_preconfigure
| Previously configured separate build directory detected, cleaning /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/build
| DEBUG: Shell function autotools_preconfigure finished
| DEBUG: Executing python function autotools_copy_aclocals
| DEBUG: SITE files ['endian-little', 'bit-32', 'arm-common', 'arm-32', 'common-linux', 'common-glibc', 'arm-linux', 'arm-linux-gnueabi', 'common']
| DEBUG: Python function autotools_copy_aclocals finished
| DEBUG: Executing shell function do_configure
| sed: can't read /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/dpkg-1.18.2/configure: No such file or directory
| WARNING: /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/temp/run.do_configure.24649:1 exit 2 from
|   sed -i -e 's#PERL_LIBDIR=.*$#PERL_LIBDIR="/usr/lib/perl"#' /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/dpkg-1.18.2/configure
| ERROR: Function failed: do_configure (log file is located at /home/yocto/yocto/BBB/8490/build/tmp/work/cortexa8hf-vfp-neon-poky-linux-gnueabi/dpkg/1.18.2-r0/temp/log.do_configure.24649)
ERROR: Task 5 (/home/yocto/yocto/BBB/poky/meta/recipes-devtools/dpkg/dpkg_1.18.2.bb, do_configure) failed with exit code '1'
NOTE: Tasks Summary: Attempted 6 tasks of which 5 didn't need to be rerun and 1 failed.
No currently running tasks (4 of 14)

Summary: 1 task failed:
  /home/yocto/yocto/BBB/poky/meta/recipes-devtools/dpkg/dpkg_1.18.2.bb, do_configure
Summary: There was 1 WARNING message shown.
Summary: There was 1 ERROR message shown, returning a non-zero exit code.

==============================================================================

 bitbake -b m4
WARNING: Buildfile specified, dependencies will not be handled. If this is not what you want, do not use -b / --buildfile.
ERROR: Unable to match 'm4' to a specific recipe file - 4 matches found:
    /home/yocto/yocto/BBB/poky/meta/recipes-devtools/m4/m4_1.4.9.bb
    /home/yocto/yocto/BBB/poky/meta/recipes-devtools/m4/m4-native_1.4.17.bb
    /home/yocto/yocto/BBB/poky/meta/recipes-devtools/m4/m4_1.4.17.bb
    /home/yocto/yocto/BBB/poky/meta/recipes-kernel/libpfm/libpfm4_4.6.0.bb

Summary: There was 1 WARNING message shown.
Summary: There was 1 ERROR message shown, returning a non-zero exit code.

Without '-b' builds work ok:

bitbake m4
Loading cache: 100% |############################################################################################################################################################| ETA:  00:00:00
Loaded 1315 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-14.04"
TARGET_SYS        = "arm-poky-linux-gnueabi"
MACHINE           = "beaglebone"
DISTRO            = "poky"
DISTRO_VERSION    = "2.0+snapshot-20160106"
TUNE_FEATURES     = "arm armv7a vfp neon callconvention-hard cortexa8"
TARGET_FPU        = "vfp-neon"
meta
meta-yocto
meta-yocto-bsp    = "master:2cd061a29a94fdcdfec86732e6bcbb71c12c4afc"

NOTE: Preparing RunQueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
NOTE: Tasks Summary: Attempted 377 tasks of which 377 didn't need to be rerun and all succeeded.

bitbake dpkg
Loading cache: 100% |############################################################################################################################################################| ETA:  00:00:00
Loaded 1315 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION        = "1.28.0"
BUILD_SYS         = "x86_64-linux"
NATIVELSBSTRING   = "Ubuntu-14.04"
TARGET_SYS        = "arm-poky-linux-gnueabi"
MACHINE           = "beaglebone"
DISTRO            = "poky"
DISTRO_VERSION    = "2.0+snapshot-20160106"
TUNE_FEATURES     = "arm armv7a vfp neon callconvention-hard cortexa8"
TARGET_FPU        = "vfp-neon"
meta
meta-yocto
meta-yocto-bsp    = "master:2cd061a29a94fdcdfec86732e6bcbb71c12c4afc"

NOTE: Preparing RunQueue
NOTE: Executing SetScene Tasks
NOTE: Executing RunQueue Tasks
NOTE: Tasks Summary: Attempted 732 tasks of which 728 didn't need to be rerun and all succeeded.
Comment 3 Paul Eggleton 2016-01-06 19:46:21 UTC 
That isn't the same bug - try it with a different (non-autotools) recipe and it'll work. I have now filed bug 8890 for that and am marking this one as resolved again.
Comment 4 Bogdan Alexandru Voiculescu 2016-01-07 08:21:58 UTC 
Thank you, Paul!
Marked as verified.