Bug 12941

Summary: gitsm unpack issue after rewrite gitsm
Product: [Build System, Metadata & Runtime] BitBake Reporter: openatv
Component: bitbakeAssignee: Mark Hatle <mark.hatle>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: nickersk, openatv, poky.bs.watcher, poky.watcher
Version: 2.6   
Target Milestone: 2.6 M4   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description openatv 2018-09-29 11:21:26 UTC 
After this commit : https://github.com/openembedded/bitbake/commit/9c6b39adf9781fa6745f48913a97c859fa37eb5b

i get unpack error


ERROR: libbluray-v1.0.2+gitAUTOINC+2d18c7099f-r0 do_unpack: Fetcher failure: Submodule contrib/libudfread does not exist in /www/www/sources/git2/git.videolan.org                                                                 .libbluray.git/modules/contrib/libudfread or /home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libblu                                                                 ray/v1.0.2+gitAUTOINC+2d18c7099f-r0/git/.git/modules/contrib/libudfread.
DEBUG: libbluray-v1.0.2+gitAUTOINC+2d18c7099f-r0 do_unpack: Python function base_do_unpack finished
DEBUG: libbluray-v1.0.2+gitAUTOINC+2d18c7099f-r0 do_unpack: Python function do_unpack finished
ERROR: libbluray-v1.0.2+gitAUTOINC+2d18c7099f-r0 do_unpack: Function failed: base_do_unpack
ERROR: Logfile of failure stored in: /home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0                                                                 .2+gitAUTOINC+2d18c7099f-r0/temp/log.do_unpack.28780
ERROR: Task (/home/oe1/atv63/build-enviroment/meta-oe-alliance/meta-oe/recipes-support/libbluray/libbluray_git.bb:do_unpack) failed with exit code '1'
DEBUG: Teardown for bitbake-worker

log show this

DEBUG: Executing python function do_unpack
DEBUG: Executing python function base_do_unpack
DEBUG: Running export PSEUDO_DISABLED=1; export PATH="/home/oe1/atv63/build-enviroment/openembedded-core/scripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin/arm-oe-linux-gnueabi:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot/usr/bin/crossscripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/bin:/home/oe1/atv63/build-enviroment/bitbake/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/hosttools"; export HOME="/home/oe1"; git -c core.fsyncobjectfiles=0 clone -s -n /www/www/sources/git2/git.videolan.org.libbluray.git/ /home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/git/
DEBUG: Running export PSEUDO_DISABLED=1; export PATH="/home/oe1/atv63/build-enviroment/openembedded-core/scripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin/arm-oe-linux-gnueabi:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot/usr/bin/crossscripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/bin:/home/oe1/atv63/build-enviroment/bitbake/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/hosttools"; export HOME="/home/oe1"; git -c core.fsyncobjectfiles=0 remote set-url origin git://git.videolan.org/libbluray.git
DEBUG: Running export PSEUDO_DISABLED=1; export PATH="/home/oe1/atv63/build-enviroment/openembedded-core/scripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin/arm-oe-linux-gnueabi:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot/usr/bin/crossscripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/bin:/home/oe1/atv63/build-enviroment/bitbake/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/hosttools"; export HOME="/home/oe1"; git -c core.fsyncobjectfiles=0 checkout -B master 2d18c7099fec196a1009ddd54029baff31c9282a
DEBUG: Running export PSEUDO_DISABLED=1; export PATH="/home/oe1/atv63/build-enviroment/openembedded-core/scripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin/arm-oe-linux-gnueabi:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot/usr/bin/crossscripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/bin:/home/oe1/atv63/build-enviroment/bitbake/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/hosttools"; export HOME="/home/oe1"; git -c core.fsyncobjectfiles=0 branch master --set-upstream-to origin/master
DEBUG: Running export PSEUDO_DISABLED=1; export PATH="/home/oe1/atv63/build-enviroment/openembedded-core/scripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin/arm-oe-linux-gnueabi:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot/usr/bin/crossscripts:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/usr/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/sbin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/recipe-sysroot-native/bin:/home/oe1/atv63/build-enviroment/bitbake/bin:/home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/hosttools"; export HOME="/home/oe1"; git -c core.fsyncobjectfiles=0 show HEAD:.gitmodules
ERROR: Fetcher failure: Submodule contrib/libudfread does not exist in /www/www/sources/git2/git.videolan.org.libbluray.git/modules/contrib/libudfread or /home/oe1/atv63/build-enviroment/builds/openatv/release/u5pvr/tmp/work/cortexa15hf-neon-vfpv4-oe-linux-gnueabi/libbluray/v1.0.2+gitAUTOINC+2d18c7099f-r0/git/.git/modules/contrib/libudfread.
DEBUG: Python function base_do_unpack finished
DEBUG: Python function do_unpack finished
ERROR: Function failed: base_do_unpack


for test i use this bb file

SUMMARY  = "Library to access Blu-Ray disk"
SECTION = "misc"
HOMEPAGE = "http://videolan.org"
LICENSE = "GPLv2"
LIC_FILES_CHKSUM="file://COPYING;md5=435ed639f84d4585d93824e7da3d85da"

DEPENDS = "libxml2"

SRC_URI = "gitsm://git.videolan.org/libbluray.git"

inherit gitpkgv autotools-brokensep pkgconfig

SRCREV = "${AUTOREV}"
PV = "v1.0.2+git${SRCPV}"
PKGV = "v1.0.2+git${GITPKGV}"

S="${WORKDIR}/git"

EXTRA_OECONF = " \
    --disable-bdjava-jar \
    --disable-doxygen-doc \
    --disable-doxygen-dot \
    --without-freetype \
    --without-fontconfig \
"
Comment 1 Mark Hatle 2018-10-04 14:59:31 UTC 
As I don't know what this "gitpkgv" class is, I simplified the reproducer down to:


SUMMARY  = "Library to access Blu-Ray disk"
SECTION = "misc"
HOMEPAGE = "http://videolan.org"
LICENSE = "GPLv2"
LIC_FILES_CHKSUM="file://COPYING;md5=435ed639f84d4585d93824e7da3d85da"

DEPENDS = "libxml2"

SRC_URI = "gitsm://git.videolan.org/libbluray.git"

SRCREV = "${AUTOREV}"


The patches submitted by to bitbake-devel by Laurent Bonnans and myself to the gitsm.py appear to resolve this issue.
Comment 2 nickersk 2018-10-05 08:26:42 UTC 
using bitbake-devel works for me. thanks