1075 2011-05-17 00:55:56 +0000 sstate should exclude more variables for packages with PACKAGE_ARCH = "all" 2011-11-16 09:49:09 +0000 1 1 7 Build System, Metadata & Runtime Meta-yocto meta-yocto unspecified x86 Multiple RESOLVED FIXED Final patch out for review on mailing list Medium normal 1.2 1 Martin.Jansa richard.purdie dvhart poky.bs.watcher poky.watcher sgw --- --- --- oldest_to_newest 13850 0 Martin.Jansa 2011-05-17 00:55:56 +0000 If you have package with PACKAGE_ARCH = "all" then the resulting package is created by run.* scripts with different paths, *FLAGS etc even when it produces same output (ie some theme). So all packages with such PACKAGE_ARCH are rebuilt after machine switch (if the machine is ie different arch like om-gta02/nokia900). Sstate is reused when you go back to om-gta02 after building nokia900, so you have ie populate_sysroot only with as many checksums as you're building different archs, but it still makes "all" as PACKAGE_ARCH less usefull. RP said, that right fix is to introduce something like all.bbclass which excludes all variables which shouldn't change the output of such package and then checksums will be the same. There is example with gtk-theme-e17lookalike from meta-shr layer in attachment. 13851 1 156 Martin.Jansa 2011-05-17 00:56:51 +0000 Created attachment 156 bitbake-diffsig example with gtk-theme-e17lookalike 14061 2 Martin.Jansa 2011-05-28 02:42:08 +0000 Current status is tracked in following branches: http://cgit.openembedded.org/cgit.cgi/openembedded-core-contrib/log/?h=jansa/allarch http://cgit.openembedded.org/cgit.cgi/meta-openembedded-contrib/log/?h=jansa/allarch Last issue left is using allarch.bbclass and debian.bbclass. debian.bbclass is renaming packages for runtime so if recipe has task-fso2-compliance.bb: RDEPENDS_${PN} = "libfsotransport" it needs to know what is runtime name for libfsotransport. That's why package.bbclass is calling runtime_mapping_rename for all runtime vars in control file. runtime_mapping_rename calls oe.packagedata.read_subpkgdata in meta/lib/oe/packagedata.py and important fce is this def get_subpkgedata_fn(pkg, d): archs = bb.data.expand("${PACKAGE_ARCHS}", d).split(" ") archs.reverse() pkgdata = bb.data.expand('${TMPDIR}/pkgdata/', d) targetdir = bb.data.expand('${TARGET_VENDOR}-${TARGET_OS}/runtime/', d) bb.note("archs %s" % archs) for arch in archs: fn = pkgdata + arch + targetdir + pkg if os.path.exists(fn): bb.note("found %s" % fn) return fn bb.note("returning %s" % bb.data.expand('${PKGDATA_DIR}/runtime/%s' % pkg, d)) return bb.data.expand('${PKGDATA_DIR}/runtime/%s' % pkg, d) PACKAGE_ARCHS is different for each arch om-gta02: PACKAGE_ARCHS="all any noarch arm armv4 armv4t om_gta02" nokia900: PACKAGE_ARCHS="all any noarch arm armv4 armv4t armv5te armv6 armv7 armv7a nokia900" and file we're looking for is in tmp/pkgdata all-oe-linux all-oe-linux-gnueabi armv4t-oe-linux-gnueabi armv7a-oe-linux-gnueabi nokia900-oe-linux nokia900-oe-linux-gnueabi om_gta02-oe-linux om_gta02-oe-linux-gnueabi for libfsotransport: $ find tmp/pkgdata/ -path \*runtime\* -name libfsotransport tmp/pkgdata/armv7a-oe-linux-gnueabi/runtime/libfsotransport tmp/pkgdata/armv4t-oe-linux-gnueabi/runtime/libfsotransport Problem with allarch is, that we have correctly lost -gnueabi postfix. PACKAGE_ARCH = "all" alone had TARGET_OS = "linux-gnueabi", allarch has TARGET_OS = "linux". get_subpkgedata_fn is looking for files only with the same TARGET_OS so it cannot find libfsotransport and returns default bb.data.expand('${PKGDATA_DIR}/runtime/%s' % pkg, d) which doesn't exist and libfsotransport isn't renamed to libfsotransport0 Right fix is not so simple because imagine this scenario. 1) libfsotransport is upgraded to version 2.0 and soname changes to libfsotransport2 2) image is built for nokia900 3) task-fso2-compliance still RDEPENDS on libfsotransport0 4) someone finds that task-fso2-compliance is wrong and rebuilds it still with nokia900 machine 5) task-fso2-compliance now depends on libfsotransport2 but armv4t feeds doesn't have it (still only libfsotransport0) 6) if someone rebuilds task-fso2-compliance again it will rdepends on libfsotransport0 and break feeds for nokia900 I don't know how to fix this to be 100% correct. Publishing feeds only after all archs/machines were already build makes things better. Using allarch only for recipes which don't depend on any MACHINE_ARCH/FEED_ARCH packages is also way to go, but makes allarch usable only in few special cases. Any thoughts? 14076 3 richard.purdie 2011-05-31 05:05:22 +0000 Marking task-* packages as "allarch" has never been a good idea for exactly this reason and the problem occurs without allarch as you mention, it it perhaps just more hidden. In general task-* packages end up being at least target arch specific and sometimes even machine specific. I think we just have to accept that is the case... 14077 4 richard.purdie 2011-05-31 05:08:29 +0000 http://git.openembedded.net/cgit.cgi/openembedded-core/commit/?id=26e5e5feb695864b11e47e24017e254c28f14494 has some initial changes to start to address this problem. 16780 5 richard.purdie 2011-10-07 06:09:22 +0000 To update on the status of this bug, we're down to 5 potentially bad allarch references in OE-Core: meta/recipes-gnome/hicolor-icon-theme/hicolor-icon-theme_0.12.bb:PACKAGE_ARCH = "all" meta/recipes-extended/perl/libconvert-asn1-perl_0.22.bb:PACKAGE_ARCH = "all" meta/recipes-extended/perl/libtimedate-perl_1.20.bb:PACKAGE_ARCH = "all" meta/recipes-devtools/update-alternatives/update-alternatives-dpkg.inc:PACKAGE_ARCH = "all" meta/recipes-graphics/xorg-font/font-alias_1.0.3.bb:PACKAGE_ARCH = "all" 16782 6 richard.purdie 2011-10-07 06:25:33 +0000 There are WIP patches for some of these at: http://git.openembedded.org/cgit.cgi/openembedded-core-contrib/log/?h=jansa/allarch 17210 7 richard.purdie 2011-11-15 08:13:38 +0000 This is now reduced to the following two recipes: meta/recipes-extended/perl/libconvert-asn1-perl_0.22.bb:PACKAGE_ARCH = "all" meta/recipes-extended/perl/libtimedate-perl_1.20.bb:PACKAGE_ARCH = "all" 17229 8 richard.purdie 2011-11-16 09:49:09 +0000 Final fix merged in http://git.yoctoproject.org/cgit.cgi/poky/commit/?id=d6663c342e61473937e6a5a7976324c7c07252c8 156 2011-05-17 00:56:51 +0000 2011-05-17 00:56:51 +0000 bitbake-diffsig example with gtk-theme-e17lookalike diff.txt text/plain 4029 Martin.Jansa T0UgQCB+L3Noci1jb3JlICQgYml0YmFrZS1kaWZmc2lncyBzc3RhdGUtY2FjaGUvc3N0YXRlLWd0 ay10aGVtZS1lMTdsb29rYWxpa2UtYWxsLWxpbnV4LWdudWVhYmktMC4xLjErZ2l0cjMrOWI5MmEz ZDA5NWVmMWI1M2Y1NTAyNmNjMjkyNzcxZDE1MDdlNjgwMC1yOC1hbGwtMi0qcG9wdWxhdGUtc3lz cm9vdCpzaWdpbmZvCmJhc2VoYXNoIGNoYW5nZWQgZnJvbSBkY2ZjYjk1ODQxMWU4NjUzZTE2MGQw NDAwZWY4OTBmNyB0byA3OWFiYTViNDg3NDYyMGMyZGQzYjIyMjAwODhhN2MwYwpWYXJpYWJsZSBU QVJHRVRfQ0NfQVJDSCB2YWx1ZSBjaGFuZ2VkIGZyb20gLW1hcmNoPWFybXY0dCAtbXR1bmU9YXJt OTIwdCB0byAtbWFyY2g9YXJtdjctYSAtbXR1bmU9Y29ydGV4LWE4IC1tZnB1PW5lb24gLW1mbG9h dC1hYmk9c29mdGZwIC1mbm8tdHJlZS12ZWN0b3JpemUKSGFzaCBmb3IgZGVwZW5kZW50IHRhc2sg L09FL3Noci1jb3JlL21ldGEtc2hyL3JlY2lwZXMtc2hyL3Noci9ndGstdGhlbWUtZTE3bG9va2Fs aWtlX2dpdC5iYi5kb19pbnN0YWxsIGNoYW5nZWQgZnJvbSA4YTBkZTQ0ZjNmMjM4ZjY0NWVhYjk1 MDkxNzJjMmQ4YiB0byA5ZDZiZjAyN2M1ZjQzNTQ5ODAxN2E2NTIwODhkNzMyNwpPRSBAIH4vc2hy LWNvcmUgJCBkaWZmIHRtcC93b3JrL2FsbC1saW51eC1nbnVlYWJpL2d0ay10aGVtZS1lMTdsb29r YWxpa2UtMC4xLjErZ2l0cjMrOWI5MmEzZDA5NWVmMWI1M2Y1NTAyNmNjMjkyNzcxZDE1MDdlNjgw MC1yOC90ZW1wL3J1bi5kb19pbnN0YWxsLioKNWM1CjwgZXhwb3J0IFBBVEg9Ii9PRS9zaHItY29y ZS90bXAvc3lzcm9vdHMveDg2XzY0LWxpbnV4L3Vzci9iaW4vYXJtdjdhLWxpbnV4LWdudWVhYmk6 L09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9ub2tpYTkwMC91c3IvYmluL2Nyb3Nzc2NyaXB0czov T0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3RzL3g4Nl82NC1saW51eC91c3Ivc2JpbjovT0Uvc2hyLWNv cmUvdG1wL3N5c3Jvb3RzL3g4Nl82NC1saW51eC91c3IvYmluOi9PIgotLS0KPiBleHBvcnQgUEFU SD0iL09FL3Noci1jb3JlL3RtcC9zeXNyb290cy94ODZfNjQtbGludXgvdXNyL2Jpbi9hcm12NHQt bGludXgtZ251ZWFiaTovT0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3RzL29tLWd0YTAyL3Vzci9iaW4v Y3Jvc3NzY3JpcHRzOi9PRS9zaHItY29yZS90bXAvc3lzcm9vdHMveDg2XzY0LWxpbnV4L3Vzci9z YmluOi9PRS9zaHItY29yZS90bXAvc3lzcm9vdHMveDg2XzY0LWxpbnV4L3Vzci9iaW46L08iCjEy YzEyCjwgZXhwb3J0IENQUD0iYXJtLWxpbnV4LWdudWVhYmktZ2NjIC1FIC0tc3lzcm9vdD0vT0Uv c2hyLWNvcmUvdG1wL3N5c3Jvb3RzL25va2lhOTAwIgotLS0KPiBleHBvcnQgQ1BQPSJhcm0tbGlu dXgtZ251ZWFiaS1nY2MgLUUgLS1zeXNyb290PS9PRS9zaHItY29yZS90bXAvc3lzcm9vdHMvb20t Z3RhMDIiCjIxYzIxCjwgZXhwb3J0IFFURElSPSIvT0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3RzL25v a2lhOTAwL3F0MiIKLS0tCj4gZXhwb3J0IFFURElSPSIvT0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3Rz L29tLWd0YTAyL3F0MiIKMjRjMjQKPCBleHBvcnQgTEQ9ImFybS1saW51eC1nbnVlYWJpLWxkIC0t c3lzcm9vdD0vT0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3RzL25va2lhOTAwIgotLS0KPiBleHBvcnQg TEQ9ImFybS1saW51eC1nbnVlYWJpLWxkIC0tc3lzcm9vdD0vT0Uvc2hyLWNvcmUvdG1wL3N5c3Jv b3RzL29tLWd0YTAyIgozMGMzMAo8IGV4cG9ydCBPUElFRElSPSIvT0Uvc2hyLWNvcmUvdG1wL3N5 c3Jvb3RzL25va2lhOTAwIgotLS0KPiBleHBvcnQgT1BJRURJUj0iL09FL3Noci1jb3JlL3RtcC9z eXNyb290cy9vbS1ndGEwMiIKMzdjMzcKPCBleHBvcnQgQ0NMRD0iYXJtLWxpbnV4LWdudWVhYmkt Z2NjIC1tYXJjaD1hcm12Ny1hIC1tdHVuZT1jb3J0ZXgtYTggLW1mcHU9bmVvbiAtbWZsb2F0LWFi aT1zb2Z0ZnAgLWZuby10cmVlLXZlY3Rvcml6ZSAtLXN5c3Jvb3Q9L09FL3Noci1jb3JlL3RtcC9z eXNyb290cy9ub2tpYTkwMCIKLS0tCj4gZXhwb3J0IENDTEQ9ImFybS1saW51eC1nbnVlYWJpLWdj YyAtbWFyY2g9YXJtdjR0IC1tdHVuZT1hcm05MjB0IC0tc3lzcm9vdD0vT0Uvc2hyLWNvcmUvdG1w L3N5c3Jvb3RzL29tLWd0YTAyIgozOWMzOQo8IGV4cG9ydCBRUEVESVI9Ii9PRS9zaHItY29yZS90 bXAvc3lzcm9vdHMvbm9raWE5MDAiCi0tLQo+IGV4cG9ydCBRUEVESVI9Ii9PRS9zaHItY29yZS90 bXAvc3lzcm9vdHMvb20tZ3RhMDIiCjQzYzQzCjwgZXhwb3J0IFNUQUdJTkdfSURMRElSPSIvT0Uv c2hyLWNvcmUvdG1wL3N5c3Jvb3RzL25va2lhOTAwL3Vzci9zaGFyZS9pZGwiCi0tLQo+IGV4cG9y dCBTVEFHSU5HX0lETERJUj0iL09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9vbS1ndGEwMi91c3Iv c2hhcmUvaWRsIgo0N2M0Nwo8IGV4cG9ydCBQS0dfQ09ORklHX0xJQkRJUj0iL09FL3Noci1jb3Jl L3RtcC9zeXNyb290cy9ub2tpYTkwMC8vdXNyL2xpYi9wa2djb25maWciCi0tLQo+IGV4cG9ydCBQ S0dfQ09ORklHX0xJQkRJUj0iL09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9vbS1ndGEwMi8vdXNy L2xpYi9wa2djb25maWciCjU1YzU1CjwgZXhwb3J0IFBLR19DT05GSUdfRElSPSIvT0Uvc2hyLWNv cmUvdG1wL3N5c3Jvb3RzL25va2lhOTAwLy91c3IvbGliL3BrZ2NvbmZpZyIKLS0tCj4gZXhwb3J0 IFBLR19DT05GSUdfRElSPSIvT0Uvc2hyLWNvcmUvdG1wL3N5c3Jvb3RzL29tLWd0YTAyLy91c3Iv bGliL3BrZ2NvbmZpZyIKNjJjNjIKPCBleHBvcnQgQ0M9ImFybS1saW51eC1nbnVlYWJpLWdjYyAt bWFyY2g9YXJtdjctYSAtbXR1bmU9Y29ydGV4LWE4IC1tZnB1PW5lb24gLW1mbG9hdC1hYmk9c29m dGZwIC1mbm8tdHJlZS12ZWN0b3JpemUgLS1zeXNyb290PS9PRS9zaHItY29yZS90bXAvc3lzcm9v dHMvbm9raWE5MDAiCi0tLQo+IGV4cG9ydCBDQz0iYXJtLWxpbnV4LWdudWVhYmktZ2NjIC1tYXJj aD1hcm12NHQgLW10dW5lPWFybTkyMHQgLS1zeXNyb290PS9PRS9zaHItY29yZS90bXAvc3lzcm9v dHMvb20tZ3RhMDIiCjY3YzY3CjwgZXhwb3J0IENYWD0iYXJtLWxpbnV4LWdudWVhYmktZysrIC1t YXJjaD1hcm12Ny1hIC1tdHVuZT1jb3J0ZXgtYTggLW1mcHU9bmVvbiAtbWZsb2F0LWFiaT1zb2Z0 ZnAgLWZuby10cmVlLXZlY3Rvcml6ZSAtLXN5c3Jvb3Q9L09FL3Noci1jb3JlL3RtcC9zeXNyb290 cy9ub2tpYTkwMCIKLS0tCj4gZXhwb3J0IENYWD0iYXJtLWxpbnV4LWdudWVhYmktZysrIC1tYXJj aD1hcm12NHQgLW10dW5lPWFybTkyMHQgLS1zeXNyb290PS9PRS9zaHItY29yZS90bXAvc3lzcm9v dHMvb20tZ3RhMDIiCjY5LDcwYzY5LDcwCjwgZXhwb3J0IFBLR19DT05GSUdfU1lTUk9PVF9ESVI9 Ii9PRS9zaHItY29yZS90bXAvc3lzcm9vdHMvbm9raWE5MDAiCjwgZXhwb3J0IFBLR19DT05GSUdf UEFUSD0iL09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9ub2tpYTkwMC8vdXNyL2xpYi9wa2djb25m aWc6L09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9ub2tpYTkwMC91c3Ivc2hhcmUvcGtnY29uZmln IgotLS0KPiBleHBvcnQgUEtHX0NPTkZJR19TWVNST09UX0RJUj0iL09FL3Noci1jb3JlL3RtcC9z eXNyb290cy9vbS1ndGEwMiIKPiBleHBvcnQgUEtHX0NPTkZJR19QQVRIPSIvT0Uvc2hyLWNvcmUv dG1wL3N5c3Jvb3RzL29tLWd0YTAyLy91c3IvbGliL3BrZ2NvbmZpZzovT0Uvc2hyLWNvcmUvdG1w L3N5c3Jvb3RzL29tLWd0YTAyL3Vzci9zaGFyZS9wa2djb25maWciCjc2Yzc2CjwgZXhwb3J0IEY3 Nz0iYXJtLWxpbnV4LWdudWVhYmktZzc3IC1tYXJjaD1hcm12Ny1hIC1tdHVuZT1jb3J0ZXgtYTgg LW1mcHU9bmVvbiAtbWZsb2F0LWFiaT1zb2Z0ZnAgLWZuby10cmVlLXZlY3Rvcml6ZSAtLXN5c3Jv b3Q9L09FL3Noci1jb3JlL3RtcC9zeXNyb290cy9ub2tpYTkwMCIKLS0tCj4gZXhwb3J0IEY3Nz0i YXJtLWxpbnV4LWdudWVhYmktZzc3IC1tYXJjaD1hcm12NHQgLW10dW5lPWFybTkyMHQgLS1zeXNy b290PS9PRS9zaHItY29yZS90bXAvc3lzcm9vdHMvb20tZ3RhMDIi