5221 2013-09-17 23:51:17 +0000 [autobuilder] perf build failures on meta-fsl-ppc 2013-09-19 15:38:57 +0000 1 1 7 Build System, Metadata & Runtime OE-Core devtools / tool chain 1.5 x86 Multiple RESOLVED FIXED High critical 1.5 M5 1 sgw otavio b40290 bruce.ashfield meta.mr.watcher meta.watcher zhenhua.luo --- New (Never tested) No (bug/feature does not impact docs) oldest_to_newest 36830 0 sgw 2013-09-17 23:51:17 +0000 This is an RC2 Blocker /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/x86_64-linux/usr/libexec/ppce500v2-poky-linux-gnuspe/gcc/powerpc-poky-linux-gnuspe/4.8.1/ld: /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/p1022ds/usr/lib/python2.7/config/libpython2.7.a(dynload_shlib.o): undefined reference to symbol 'dlopen@@GLIBC_2.1' | /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/x86_64-linux/usr/libexec/ppce500v2-poky-linux-gnuspe/gcc/powerpc-poky-linux-gnuspe/4.8.1/ld: note: 'dlopen@@GLIBC_2.1' is defined in DSO /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/p1022ds/usr/lib/libdl.so so try adding it to the linker command line | /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/p1022ds/usr/lib/libdl.so: could not read symbols: Invalid operation | collect2: error: ld returned 1 exit status | make: *** [/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/work/p1022ds-poky-linux-gnuspe/perf/1.0-r8/perf-1.0/perf] Error 1 | make: Leaving directory `/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/sysroots/p1022ds/usr/src/kernel/tools/perf' | ERROR: oe_runmake failed | WARNING: /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/work/p1022ds-poky-linux-gnuspe/perf/1.0-r8/temp/run.do_compile.26959:1 exit 1 from | exit 1 | ERROR: Function failed: do_compile (log file is located at /srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/build/tmp/work/p1022ds-poky-linux-gnuspe/perf/1.0-r8/temp/log.do_compile.26959) ERROR: Task 2965 (/srv/home/pokybuild/yocto-autobuilder-new/yocto-slave/nightly-fsl-ppc/build/meta/recipes-kernel/perf/perf.bb, do_compile) failed with exit code '1' Summary: There was 1 ERROR message shown, returning a non-zero exit code. 36841 1 1515 otavio 2013-09-18 04:14:32 +0000 Created attachment 1515 Disable libpython 36842 2 otavio 2013-09-18 04:15:45 +0000 It seems this has been done at: commit d38ad3271829b2d282c973e69edd265ef52174c8 Author: Tom Zanussi <tom.zanussi@intel.com> Date: Fri Jan 14 16:33:05 2011 -0600 linux-yocto: hard-code NO_LIBPERL/NO_LIBPYTHON ExtUtils::Embed ccopts is getting the host's -I/usr/local/include and using it to compile perf, which results in a compilation error that started appearing just recently. This turns the code that makes use of ExtUtils::Embed off and simply hard-codes NO_LIBPERL. It does the same for LIBPYTHON while we're at it, since it probably suffers from a similar underlying problem and just by chance hasn't broken anything yet. This will be re-enabled after I familiarize myself with the perf recipe and am able to create a proper fix. Signed-off-by: Tom Zanussi <tom.zanussi@intel.com> So this fix should be add in meta-fsl-ppc as well? 36843 3 zhenhua.luo 2013-09-18 05:16:17 +0000 Perf can be built successfully after disabling LIBPERL and LIBPYTHON, a patch will be submitted for meta-fsl-ppc. 36844 4 bruce.ashfield 2013-09-18 05:20:42 +0000 My suggestion is to hit the middle ground, I unfortunately can't test from here, since fetches are failing and I need to see what's wrong with my name resolution in the morning. What I mean is that I have a patch, I'm about to send that does this: --- a/meta/recipes-kernel/perf/perf.bb +++ b/meta/recipes-kernel/perf/perf.bb @@ -68,6 +68,7 @@ EXTRA_OEMAKE = \ CC="${CC}" \ AR="${AR}" \ perfexecdir=${libexecdir} \ + EXTRA_CFLAGS="-fno-var-tracking" \ NO_GTK2=1 ${TUI_DEFINES} NO_DWARF=1 ${SCRIPTING_DEFINES} \ To fix build time issues with arm (and even x86), part of the patch that we recently did removes the full export of CFLAGS and LDFLAGS to the perf build, and that's a good thing in my opinion. But we don't want to fix this by patching the kernel, since that means all kernel repos need to carry the fix, so my suggestion is to pass what we used to have: LDFLAGS = "-ldl -lutil" or at least the -ldl, which is what is missing, to the build via EXTRA_CFLAGS, that way we are only extending, not overriding what the makefiles are defining. 36845 5 zhenhua.luo 2013-09-18 05:51:39 +0000 (In reply to comment #4) > My suggestion is to hit the middle ground, I unfortunately can't test from > here, since fetches are failing and I need to see what's wrong with my > name resolution in the morning. > > What I mean is that I have a patch, I'm about to send that does this: > > --- a/meta/recipes-kernel/perf/perf.bb > +++ b/meta/recipes-kernel/perf/perf.bb > @@ -68,6 +68,7 @@ EXTRA_OEMAKE = \ > CC="${CC}" \ > AR="${AR}" \ > perfexecdir=${libexecdir} \ > + EXTRA_CFLAGS="-fno-var-tracking" \ > NO_GTK2=1 ${TUI_DEFINES} NO_DWARF=1 ${SCRIPTING_DEFINES} \ > > To fix build time issues with arm (and even x86), part of the patch > that we recently did removes the full export of CFLAGS and LDFLAGS > to the perf build, and that's a good thing in my opinion. > > But we don't want to fix this by patching the kernel, since that means all > kernel repos need to carry the fix, so my suggestion is to pass what we > used to have: > > LDFLAGS = "-ldl -lutil" > > or at least the -ldl, which is what is missing, to the build via > EXTRA_CFLAGS, that way we are only extending, not overriding what > the makefiles are defining. The suggestion makes sense, we can avoid applying the kernel patch in all kernel repos. According to my test result on p1022ds, both -ldl and -lutil are required to ensure the build pass. diff --git a/meta/recipes-kernel/perf/perf.bb b/meta/recipes-kernel/perf/perf.bb index 4a815ff..0ceccc4 100644 --- a/meta/recipes-kernel/perf/perf.bb +++ b/meta/recipes-kernel/perf/perf.bb @@ -68,6 +68,7 @@ EXTRA_OEMAKE = \ CC="${CC}" \ AR="${AR}" \ perfexecdir=${libexecdir} \ + EXTRA_CFLAGS="-fno-var-tracking" \ NO_GTK2=1 ${TUI_DEFINES} NO_DWARF=1 ${SCRIPTING_DEFINES} \ ' @@ -86,15 +87,17 @@ EXTRA_OEMAKE += "\ PARALLEL_MAKE = "" +LDFLAGS="-ldl -lutil" + do_compile() { # Linux kernel build system is expected to do the right thing - unset CFLAGS LDFLAGS + unset CFLAGS oe_runmake all } do_install() { # Linux kernel build system is expected to do the right thing - unset CFLAGS LDFLAGS + unset CFLAGS oe_runmake DESTDIR=${D} install # we are checking for this make target to be compatible with older perf versions if [ "${@perf_feature_enabled('perf-scripting', 1, 0, d)}" = "1" -a $(grep install-python_ext ${S}/tools/perf/Makefile) = "0"]; then 36867 6 bruce.ashfield 2013-09-18 12:34:58 +0000 (In reply to comment #5) > (In reply to comment #4) > > My suggestion is to hit the middle ground, I unfortunately can't test from > > here, since fetches are failing and I need to see what's wrong with my > > name resolution in the morning. > > > > What I mean is that I have a patch, I'm about to send that does this: > > > > --- a/meta/recipes-kernel/perf/perf.bb > > +++ b/meta/recipes-kernel/perf/perf.bb > > @@ -68,6 +68,7 @@ EXTRA_OEMAKE = \ > > CC="${CC}" \ > > AR="${AR}" \ > > perfexecdir=${libexecdir} \ > > + EXTRA_CFLAGS="-fno-var-tracking" \ > > NO_GTK2=1 ${TUI_DEFINES} NO_DWARF=1 ${SCRIPTING_DEFINES} \ > > > > To fix build time issues with arm (and even x86), part of the patch > > that we recently did removes the full export of CFLAGS and LDFLAGS > > to the perf build, and that's a good thing in my opinion. > > > > But we don't want to fix this by patching the kernel, since that means all > > kernel repos need to carry the fix, so my suggestion is to pass what we > > used to have: > > > > LDFLAGS = "-ldl -lutil" > > > > or at least the -ldl, which is what is missing, to the build via > > EXTRA_CFLAGS, that way we are only extending, not overriding what > > the makefiles are defining. > > The suggestion makes sense, we can avoid applying the kernel patch in all > kernel repos. > > According to my test result on p1022ds, both -ldl and -lutil are required to > ensure the build pass. > > diff --git a/meta/recipes-kernel/perf/perf.bb > b/meta/recipes-kernel/perf/perf.bb > index 4a815ff..0ceccc4 100644 > --- a/meta/recipes-kernel/perf/perf.bb > +++ b/meta/recipes-kernel/perf/perf.bb > @@ -68,6 +68,7 @@ EXTRA_OEMAKE = \ > CC="${CC}" \ > AR="${AR}" \ > perfexecdir=${libexecdir} \ > + EXTRA_CFLAGS="-fno-var-tracking" \ > NO_GTK2=1 ${TUI_DEFINES} NO_DWARF=1 ${SCRIPTING_DEFINES} \ > ' > > @@ -86,15 +87,17 @@ EXTRA_OEMAKE += "\ > > PARALLEL_MAKE = "" > > +LDFLAGS="-ldl -lutil" > + > do_compile() { > # Linux kernel build system is expected to do the right thing > - unset CFLAGS LDFLAGS > + unset CFLAGS > oe_runmake all > } > > do_install() { > # Linux kernel build system is expected to do the right thing > - unset CFLAGS LDFLAGS > + unset CFLAGS > oe_runmake DESTDIR=${D} install > # we are checking for this make target to be compatible with older perf > versions > if [ "${@perf_feature_enabled('perf-scripting', 1, 0, d)}" = "1" -a > $(grep install-python_ext ${S}/tools/perf/Makefile) = "0"]; then Great news. Thanks for the update and testing. Otavio, can you confirm if your build continues to work with the changes listed above ? 36868 7 1517 otavio 2013-09-18 12:39:01 +0000 Created attachment 1517 Proposed patch 36869 8 otavio 2013-09-18 12:55:10 +0000 Bruce found that we don't have EXTRA_LDFLAGS (as it would be expected) so I went and prepared a patch to re-add LDFLAGS and included a comment in the code so someone looking at it knows why it is there. I am building it using 3.11 and if it works will send the patch. 36875 9 otavio 2013-09-18 13:52:07 +0000 I built it fine in imx23evk (with 3.11 kernel). I sent it to OE-Core for review. 36990 10 otavio 2013-09-19 15:38:57 +0000 http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=99b41732458871080cfa7a9bad3f8dfe03e026be 1515 2013-09-18 04:14:32 +0000 2013-09-18 04:14:32 +0000 Disable libpython tools-perf-no-scripting.patch text/plain 1952 otavio ClVwc3RyZWFtLVN0YXR1czogSW5hcHByb3ByaWF0ZSBbY29uZmlndXJhdGlvbl0KCkluZGV4OiB0 b29scy9wZXJmL01ha2VmaWxlCj09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT0KLS0tIGEvdG9vbHMvcGVyZi9NYWtlZmlsZQky MDExLTAxLTE0IDE0OjE3OjMzLjEyNzAwODU1NCAtMDYwMAorKysgYi90b29scy9wZXJmL01ha2Vm aWxlCTIwMTEtMDEtMTQgMTQ6MTg6MTQuMjI3MDA4NTQ4IC0wNjAwCkBAIC01ODgsNDIgKzU4OCw4 IEBACiAJZW5kaWYKIGVuZGlmCiAKLWlmZGVmIE5PX0xJQlBFUkwKLQlCQVNJQ19DRkxBR1MgKz0g LUROT19MSUJQRVJMCi1lbHNlCi0gICAgICAgUEVSTF9FTUJFRF9MRE9QVFMgPSAkKHNoZWxsIHBl cmwgLU1FeHRVdGlsczo6RW1iZWQgLWUgbGRvcHRzIDI+L2Rldi9udWxsKQotICAgICAgIFBFUkxf RU1CRURfTERGTEFHUyA9ICQoY2FsbCBzdHJpcC1saWJzLCQoUEVSTF9FTUJFRF9MRE9QVFMpKQot ICAgICAgIFBFUkxfRU1CRURfTElCQUREID0gJChjYWxsIGdyZXAtbGlicywkKFBFUkxfRU1CRURf TERPUFRTKSkKLQlQRVJMX0VNQkVEX0NDT1BUUyA9IGBwZXJsIC1NRXh0VXRpbHM6OkVtYmVkIC1l IGNjb3B0cyAyPi9kZXYvbnVsbGAKLQlGTEFHU19QRVJMX0VNQkVEPSQoUEVSTF9FTUJFRF9DQ09Q VFMpICQoUEVSTF9FTUJFRF9MRE9QVFMpCi0KLQlpZm5lcSAoJChjYWxsIHRyeS1jYywkKFNPVVJD RV9QRVJMX0VNQkVEKSwkKEZMQUdTX1BFUkxfRU1CRUQpKSx5KQotCQlCQVNJQ19DRkxBR1MgKz0g LUROT19MSUJQRVJMCi0JZWxzZQotICAgICAgICAgICAgICAgQUxMX0xERkxBR1MgKz0gJChQRVJM X0VNQkVEX0xERkxBR1MpCi0gICAgICAgICAgICAgICBFWFRMSUJTICs9ICQoUEVSTF9FTUJFRF9M SUJBREQpCi0JCUxJQl9PQkpTICs9ICQoT1VUUFVUKXV0aWwvc2NyaXB0aW5nLWVuZ2luZXMvdHJh Y2UtZXZlbnQtcGVybC5vCi0JCUxJQl9PQkpTICs9ICQoT1VUUFVUKXNjcmlwdHMvcGVybC9QZXJm LVRyYWNlLVV0aWwvQ29udGV4dC5vCi0JZW5kaWYKLWVuZGlmCi0KLWlmZGVmIE5PX0xJQlBZVEhP TgotCUJBU0lDX0NGTEFHUyArPSAtRE5PX0xJQlBZVEhPTgotZWxzZQotICAgICAgIFBZVEhPTl9F TUJFRF9MRE9QVFMgPSAkKHNoZWxsIHB5dGhvbi1jb25maWcgLS1sZGZsYWdzIDI+L2Rldi9udWxs KQotICAgICAgIFBZVEhPTl9FTUJFRF9MREZMQUdTID0gJChjYWxsIHN0cmlwLWxpYnMsJChQWVRI T05fRU1CRURfTERPUFRTKSkKLSAgICAgICBQWVRIT05fRU1CRURfTElCQUREID0gJChjYWxsIGdy ZXAtbGlicywkKFBZVEhPTl9FTUJFRF9MRE9QVFMpKQotCVBZVEhPTl9FTUJFRF9DQ09QVFMgPSBg cHl0aG9uLWNvbmZpZyAtLWNmbGFncyAyPi9kZXYvbnVsbGAKLQlGTEFHU19QWVRIT05fRU1CRUQ9 JChQWVRIT05fRU1CRURfQ0NPUFRTKSAkKFBZVEhPTl9FTUJFRF9MRE9QVFMpCi0JaWZuZXEgKCQo Y2FsbCB0cnktY2MsJChTT1VSQ0VfUFlUSE9OX0VNQkVEKSwkKEZMQUdTX1BZVEhPTl9FTUJFRCkp LHkpCi0JCUJBU0lDX0NGTEFHUyArPSAtRE5PX0xJQlBZVEhPTgotCWVsc2UKLSAgICAgICAgICAg ICAgIEFMTF9MREZMQUdTICs9ICQoUFlUSE9OX0VNQkVEX0xERkxBR1MpCi0gICAgICAgICAgICAg ICBFWFRMSUJTICs9ICQoUFlUSE9OX0VNQkVEX0xJQkFERCkKLQkJTElCX09CSlMgKz0gJChPVVRQ VVQpdXRpbC9zY3JpcHRpbmctZW5naW5lcy90cmFjZS1ldmVudC1weXRob24ubwotCQlMSUJfT0JK UyArPSAkKE9VVFBVVClzY3JpcHRzL3B5dGhvbi9QZXJmLVRyYWNlLVV0aWwvQ29udGV4dC5vCi0J ZW5kaWYKLWVuZGlmCitCQVNJQ19DRkxBR1MgKz0gLUROT19MSUJQRVJMCitCQVNJQ19DRkxBR1Mg Kz0gLUROT19MSUJQWVRIT04KIAogaWZkZWYgTk9fREVNQU5HTEUKIAlCQVNJQ19DRkxBR1MgKz0g LUROT19ERU1BTkdMRQo= 1517 2013-09-18 12:39:01 +0000 2013-09-18 12:39:01 +0000 Proposed patch 0001-perf-Add-EXTRA_LDFLAGS-to-allow-build-of-old-kernels.patch text/plain 1444 otavio RnJvbSBiZmU5ODAwOTU5OThiZDQwMzIyNDE4NmMxNDBiNTM5ZjBjNGU3NWE5IE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBPdGF2aW8gU2FsdmFkb3IgPG90YXZpb0Bvc3N5c3RlbXMuY29t LmJyPgpEYXRlOiBXZWQsIDE4IFNlcCAyMDEzIDA5OjM1OjA5IC0wMzAwClN1YmplY3Q6IFtQQVRD SF0gcGVyZjogQWRkIEVYVFJBX0xERkxBR1MgdG8gYWxsb3cgYnVpbGQgb2Ygb2xkIGtlcm5lbHMg d2l0aG91dAogcGF0Y2hpbmcKT3JnYW5pemF0aW9uOiBPLlMuIFN5c3RlbXMgU29mdHdhcmUgTFRE QS4KClRoZSBFWFRSQV9MREZMQUdTIGlzIHJlcXVpcmVkIG9yIHNvbWUgb2xkIGtlcm5lbHMgZmFp bHMgZHVlIG1pc3NpbmcKc3ltYm9scyBhbmQgdGhpcyBpcyBwcmVmZXJyZWQgdGhhbiByZXF1aXJp bmcgcGF0Y2hlcyB0byBldmVyeSBvbGQKc3VwcG9ydGVkIGtlcm5lbC4KCkZpeGVzIFtZT0NUTzog IzUyMjFdCgpTaWduZWQtb2ZmLWJ5OiBPdGF2aW8gU2FsdmFkb3IgPG90YXZpb0Bvc3N5c3RlbXMu Y29tLmJyPgotLS0KIG1ldGEvcmVjaXBlcy1rZXJuZWwvcGVyZi9wZXJmLmJiIHwgMyArKysKIDEg ZmlsZSBjaGFuZ2VkLCAzIGluc2VydGlvbnMoKykKCmRpZmYgLS1naXQgYS9tZXRhL3JlY2lwZXMt a2VybmVsL3BlcmYvcGVyZi5iYiBiL21ldGEvcmVjaXBlcy1rZXJuZWwvcGVyZi9wZXJmLmJiCmlu ZGV4IDRhODE1ZmYuLjk2ZGMzZTcgMTAwNjQ0Ci0tLSBhL21ldGEvcmVjaXBlcy1rZXJuZWwvcGVy Zi9wZXJmLmJiCisrKyBiL21ldGEvcmVjaXBlcy1rZXJuZWwvcGVyZi9wZXJmLmJiCkBAIC02MCw2 ICs2MCw4IEBAIEIgPSAiJHtXT1JLRElSfS8ke0JQTn0tJHtQVn0iCiBTQ1JJUFRJTkdfREVGSU5F UyA9ICIke0BwZXJmX2ZlYXR1cmVfZW5hYmxlZCgncGVyZi1zY3JpcHRpbmcnLCAnJywgJ05PX0xJ QlBFUkw9MSBOT19MSUJQWVRIT049MScsZCl9IgogVFVJX0RFRklORVMgPSAiJHtAcGVyZl9mZWF0 dXJlX2VuYWJsZWQoJ3BlcmYtdHVpJywgJycsICdOT19ORVdUPTEnLGQpfSIKIAorIyBUaGUgRVhU UkFfTERGTEFHUyBpcyByZXF1aXJlZCBvciBzb21lIG9sZCBrZXJuZWxzIGZhaWxzIGR1ZSBtaXNz aW5nIHN5bWJvbHMKKyMgYW5kIHRoaXMgaXMgcHJlZmVycmVkIHRoYW4gcmVxdWlyaW5nIHBhdGNo ZXMgdG8gZXZlcnkgb2xkIHN1cHBvcnRlZCBrZXJuZWwuCiBFWFRSQV9PRU1BS0UgPSBcCiAJCSct QyAke1N9L3Rvb2xzL3BlcmYgXAogCQlPPSR7Qn0gXApAQCAtNjgsNiArNzAsNyBAQCBFWFRSQV9P RU1BS0UgPSBcCiAJCUNDPSIke0NDfSIgXAogCQlBUj0iJHtBUn0iIFwKIAkJcGVyZmV4ZWNkaXI9 JHtsaWJleGVjZGlyfSBcCisJCUVYVFJBX0xERkxBR1M9Ii1sZGwgLWx1dGlsIiBcCiAJCU5PX0dU SzI9MSAke1RVSV9ERUZJTkVTfSBOT19EV0FSRj0xICR7U0NSSVBUSU5HX0RFRklORVN9IFwKIAkJ JwogCi0tIAoxLjguNC5yYzMKCg==