1721 2011-11-02 23:59:51 +0000 [sstate] do_populate_sysroot_setscene race condition with useradd recipes 2012-01-27 18:35:04 +0000 1 1 7 Build System, Metadata & Runtime Meta-yocto meta-yocto unspecified x86 Multiple RESOLVED FIXED 2012-01-03: 0% Implemented Medium normal 1.2 M3 1 jiajun.xu scott.a.garman bluelightning edwin.zhai josh ke.yu msm-oss poky.bs.watcher poky.watcher richard.purdie sgw yi.zhao --- --- --- oldest_to_newest 17063 0 jiajun.xu 2011-11-02 23:59:51 +0000 MACHINE: qemux86/atom-pc/qemux86-64/mpc8315e-rdb/qemuppc/routerstationpro/qemumips/beagleboard/qemuarm poky/branch:master 9b76e6a2cfc5a4d779f3b06e3acc5ff7b8275470 On latest autobuilder, I find that some recipes report failed for do_populate_sysroot_setscene. These recipes include avahi,dbus,shadow-sysroot,avahi-ui. You could find detailed logs on autobuilder. For example, you could find qemux86 logs on http://autobuilder.pokylinux.org:8010/builders/nightly-x86/builds/204/steps/shell_12/logs/stdio. log as below: ##### ERROR: Task 1293 (/srv/home/pokybuild/yocto-autobuilder/yocto-slave/nightly-x86/build/meta/recipes-connectivity/avahi/avahi_0.6.30.bb, do_populate_sysroot_setscene) failed with exit code '1' ... ... ... ERROR: Task 1429 (/srv/home/pokybuild/yocto-autobuilder/yocto-slave/nightly-x86/build/meta/recipes-core/dbus/dbus_1.4.12.bb, do_populate_sysroot_setscene) failed with exit code '1' NOTE: Running setscene task 2127 of 2830 (/srv/home/pokybuild/yocto-autobuilder/yocto-slave/nightly-x86/build/meta/recipes-sato/pimlico/tasks_0.19.bb:do_populate_lic_setscene) NOTE: package dbus-1.4.12-r7: task do_populate_lic_setscene: Succeeded ##### 17076 1 sgw 2011-11-03 15:39:09 +0000 My guess is this is related to useradd 17239 2 bluelightning 2011-11-17 01:51:32 +0000 Yes, it seems that way to me also. dbus fails with: ----------------- Running groupadd commands... grep: /media/large/tmp2/sysroots/qemux86/etc/group: No such file or directory pseudo: pseudo: can't run groupadd: Permission denied ----------------- shadow-sysroot: ----------------- DEBUG: Staging files from /media/large/tmp2/work/i586-poky-linux/shadow-sysroot-4.1.4.3-r0/sysroot-destdir/ to /media/large/tmp2/sysroots/qemux86/ install: cannot stat `/media/large/tmp2/work/i586-poky-linux/shadow-sysroot-4.1.4.3-r0/image/etc/login.defs': No such file or directory ----------------- 17252 3 scott.a.garman 2011-11-17 16:08:46 +0000 Paul: what git rev did you see this with most recently? I was under the impression that this commit should have fixed the issue: http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=d0151bcd7bc8124fc9c448a01eb0e093c4f23250 17260 4 bluelightning 2011-11-18 07:29:44 +0000 Scott - that fix only affects packaging, this is at sysroot_setscene time. I'm not sure what revision I was at when I did this but it was quite recently. 17338 5 bluelightning 2011-11-22 12:37:38 +0000 I've confirmed this is still happening with current master as at revision 3ab018c6254b883a6b6a61f79405dc3f8e40ad77. 17339 6 scott.a.garman 2011-11-22 13:25:46 +0000 Thanks for the follow-ups, I'm trying to reproduce the bug now. 17364 7 richard.purdie 2011-11-24 10:59:57 +0000 To reproduce, you need a decent sstate cache and an empty TMPDIR. If you then build something which includes dbus/avahi, you'll see the setcenes for their do_populate_sysroot functions fail. Its due to a race, they're happening before base-passwd is installed into the sysroot. Unfortunately there aren't dependencies between setscene tasks so we're going to have to find a more creative way to get this working without races. Perhaps we could touch the group/passwd files if missing and later call update-passwd against them in base-passwd's setscene function? 18170 8 msm-oss 2012-01-16 14:21:09 +0000 Also, are these really ERROR's? I think it recovers and just reruns the tasks in the RunQueue? Can we change this to something like 'SSTATE FAILURE:' instead of 'ERROR:'? -M 18392 9 richard.purdie 2012-01-27 01:44:26 +0000 Resolved with the patches ending with http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=75fcfde0617cf528a9506fbdc6f7f97e56298bbe 18408 10 msm-oss 2012-01-27 18:35:04 +0000 (In reply to comment #9) > Resolved with the patches ending with > http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=75fcfde0617cf528a9506fbdc6f7f97e56298bbe These appear to have applied cleanly to Josh's edison branch. The one below had some small conflicts from the bb.data -> d rename. http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=9a58e312ef596739923f4bc44ff8ecadaa88ddd9 Completed some build tests and things appear to be working. -M