http://lists.linuxtogo.org/pipermail/openembedded-core/2012-September/030543.html In last few days I often see errors when looking for sstate packages. They aren't fatal, build continues, but in the end bitbake returns non-zero exit code: Summary: There was 1 ERROR message shown, returning a non-zero exit code. Which causes jenkins jobs seeing it as failure. Can we hide fetcher error in this case? The file is there, but with different PV PV = "1.0${DISTRO_VERSION}" DISTRO_VERSION = "${DATE}" -rw-rw-r-- 1 jenkins nogroup 918 Sep 30 10:53 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/sstate-cache/5c/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020120928-r0-om_gta02-2-5c3135b290962ddfbeb18f87956911bb_deploy-ipk.tgz -rw-rw-r-- 1 jenkins nogroup 13K Sep 30 10:53 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/sstate-cache/5c/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020120928-r0-om_gta02-2-5c3135b290962ddfbeb18f87956911bb_deploy-ipk.tgz.siginfo So it's correct that it's not reused from sstate, just the fetcher error shouldn't be ERROR imho. NOTE: recipe shr-version-1.020120930-r0: task do_package_write_ipk_setscene: Started WARNING: Failed to fetch URL file://5c/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020120930-r0-om_gta02-2-5c3135b290962ddfbeb18f87956911bb_deploy-ipk.tgz, attempting MIRRORS if available ERROR: Fetcher failure: Unable to find file file://5c/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020120930-r0-om_gta02-2-5c3135b290962ddfbeb18f87956911bb_deploy-ipk.tgz anywhere. The paths that were searched were: /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930-r0/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version-1.020120930/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/files/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/task-package_write_ipk_setscene /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/linux-gnueabi /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/arm /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/build-linux /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/pn-shr-version /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/armv4 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/om-gta02 /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/class-target /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/forcevariable /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/thumb /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/libc-glibc /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/ /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/. /var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/sstate-cache NOTE: recipe xserver-common-1.34-r8: task do_populate_sysroot_setscene: Succeeded NOTE: recipe shr-version-1.020120930-r0: task do_package_write_ipk_setscene: Failed WARNING: Setscene task 642 (/var/lib/jenkins/jobs/shr-core-branches/workspace/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb, do_package_write_ipk_setscene) failed with exit code '1' - real task will be run instead
What is odd here is that it should never have run the setscene task at all if a valid sstate file was unavailable. Its supposed to check what exists in advance and only run if things exist. So the errors are correct, this shouldn't have run at all if the file isn't there. The question then becomes why did the test function in sstate.bbclass think it would suceed.
I'm trying to figure out the best way to reproduce/debug this and I'm struggling. As you point out, the problem is clearly the date in the PV. I have a suspicion that BitBake's cache is holding the old date and this is used for the "sstate cache file exists" test in sstate.bbclass but then when teh task is run, it is reparse, the date updated and the filename changes. Did you exclude DATE from being part of the sstate checksum in this case? I suspect that would also be cause of some of the problems if you did. I'm left concluding that since the checksum hasn't changed between the two yet the date clearly has.
(10:06:09) JaMa: RP__: it's DISTRO_VERSION, but I've seen the same errors with different recipes (which don't have DATE in it) (10:07:13) RP__: JaMa: Can you easily reproduce? The cooker log with -DDD would probably be useful along with the setscene failure log (10:07:42) RP__: JaMa: A version of this without DATE confusing things would also be helpful (10:08:04) JaMa: not right now, but I'll attach logs to that bug when I get them (10:08:58) JaMa: and both cases are with SSTATE_MIRROR defined
Rclassify as medium since the builds don't break, its more of an annoyance.
Martin: Are you still seeing this issue?
I'm going to close this since as in the previous comment, the checksum looks to have excluded the DATE contents when it clearly should be included for this task. This isn't in any of the default configurations I can find. If it can be reproduced with more informaiton, please reopen.
All relevant logs to shr-version are now here: http://build.shr-project.org/tests/jama/shr-version/ This is with bitbake-1.16, danny and OEBasic. Interesting parts: shr-version.log: DEBUG: SState: Found valid sstate file /OE/shr-core/sstate-cache/96/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020121226-r0-om_gta02-2-96e39ac3ddfae94cc8c2fbd2297e1bf7_deploy-ipk.tgz DEBUG: SState using premirror of: file://.* http://garnet.openembedded.org/shr-core-sstate-cache/PATH but downloading with new PV DEBUG: Running /OE/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb:do_package_write_ipk_setscene under fakeroot, fakedirs: /OE/shr-core/tmp-eglibc/work/om_gta02-oe-linux-gnueabi/shr-version-1.020121226-r0/pseudo/ NOTE: recipe shr-version-1.020130114-r0: task do_package_write_ipk_setscene: Started WARNING: Failed to fetch URL file://96/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020130114-r0-om_gta02-2-96e39ac3ddfae94cc8c2fbd2297e1bf7_deploy-ipk.tgz, attempting MIRRORS if available ERROR: Fetcher failure: Unable to find file file://96/sstate-shr-version-om_gta02-oe-linux-gnueabi-1.020130114-r0-om_gta02-2-96e39ac3ddfae94cc8c2fbd2297e1bf7_deploy-ipk.tgz anywhere. The paths that were searched were: For some reason it's also trying to use different WORKDIR in do_write_package_ipk: DEBUG: Stampfile /OE/shr-core/tmp-eglibc/stamps/om_gta02-oe-linux-gnueabi/shr-version-1.020121226-r0.do_package_write_ipk not available NOTE: Running task 987 of 992 (ID: 11, /OE/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb, do_package_write_ipk) DEBUG: Running /OE/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb:do_package_write_ipk under fakeroot, fakedirs: /OE/shr-core/tmp-eglibc/work/om_gta02-oe-linux-gnueabi/shr-version-1.020121226-r0/pseudo/ DEBUG: Setscene covered task 3 (/OE/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb, do_populate_sysroot) NOTE: recipe shr-version-1.020130114-r0: task do_package_write_ipk: Started ERROR: Error executing a python function in /OE/shr-core/meta-smartphone/meta-shr/recipes-shr/shr/shr-version.bb: OSError: [Errno 2] No such file or directory: '/OE/shr-core/tmp-eglibc/work/om_gta02-oe-linux-gnueabi/shr-version-1.020130114-r0/packages-split/shr-version' $ grep ^DISTRO_VERSION shr-version.env DISTRO_VERSION="20130114" DISTRO_VERSION = 20130114 $ grep ^PV shr-version.env PV="1.020130114" but bitbake -S shr-version creates .sigdata files for shr-version-1.020121226 not shr-version-1.020130114 is DISTRO_VERSION = ${DATE} && PV = "1.0${DISTRO_VERSION}" really so bad idea?
after removing cache: rm -rf tmp-eglibc/cache/default-eglibc/ tmp-eglibc/cache/bb_codeparser.dat it seems to work correctly, bitbake -S shr-version as well as build. I've added another bitbake -DDD shr-version (shr-version.log.clean.cache)