13869 2020-04-15 00:12:25 +0000 icu_66.1.bb:do_make_icudata Segmentation Fault in Parallel Builds 2020-08-04 02:10:44 +0000 1 1 7 Build System, Metadata & Runtime OE-Core oe-core other unspecified x86 Multiple RESOLVED FIXED Medium+ normal 3.2 M2 1 hongxu.jia ross.burton randy.macleod richard.purdie ross.burton steve --- --- No (bug/feature does not impact docs) oldest_to_newest 87001 0 hongxu.jia 2020-04-15 00:12:25 +0000 Since commit [icu: Add knobs to generate a subset of ICU data][1]applied, It caused Segmentation fault while executing genrb to generate *.res files 1473 LD_LIBRARY_PATH=../lib:../stubdata:../tools/ctestfw:$LD_LIBRARY_PATH ../bin/genrb -s ./misc -d ./out/build/icudt66l -i ./out/build/icudt66l -k -q pluralRanges.txt ... 1577 make[1]: *** [../data/rules.mk:732: out/build/icudt66l/pluralRanges.res] Segmentation fault (core dumped) 1578 make[1]: *** Waiting for unfinished jobs.... [1]https://git.openembedded.org/openembedded-core/commit/?id=5e5be67744d7ddf5a9ac433ecba02f697a84a325 87002 1 hongxu.jia 2020-04-15 00:14:28 +0000 With a simple google, similar issue of icu https://unicode-org.atlassian.net/browse/ICU-13595?attachmentOrder=asc&oldIssueView=true https://bugzilla.mozilla.org/show_bug.cgi?id=869406 https://sourceforge.net/p/icu/mailman/message/12529195/ 87050 2 raj.khem 2020-04-16 15:53:10 +0000 (In reply to comment #1) > With a simple google, similar issue of icu > > https://unicode-org.atlassian.net/browse/ICU- > 13595?attachmentOrder=asc&oldIssueView=true > > https://bugzilla.mozilla.org/show_bug.cgi?id=869406 > > https://sourceforge.net/p/icu/mailman/message/12529195/ does disabling parallel make help ? 87054 3 richard.purdie 2020-04-20 08:38:43 +0000 Also seen here: https://autobuilder.yoctoproject.org/typhoon/#/builders/44/builds/1816 (step 3b) 87055 4 hongxu.jia 2020-04-20 19:07:34 +0000 (In reply to comment #2) > (In reply to comment #1) > > With a simple google, similar issue of icu > > > > https://unicode-org.atlassian.net/browse/ICU- > > 13595?attachmentOrder=asc&oldIssueView=true > > > > https://bugzilla.mozilla.org/show_bug.cgi?id=869406 > > > > https://sourceforge.net/p/icu/mailman/message/12529195/ > > does disabling parallel make help ? I was trying it locally on wind river linux, if it works, I will send the fix to community --- a/meta/recipes-support/icu/icu_66.1.bb +++ b/meta/recipes-support/icu/icu_66.1.bb @@ -55,7 +55,7 @@ do_make_icudata_class-target () { LDFLAGS='${BUILD_LDFLAGS}' \ ICU_DATA_FILTER_FILE=${WORKDIR}/filter.json \ ./runConfigureICU Linux --with-data-packaging=archive - oe_runmake ${PARALLEL_MAKE} + oe_runmake install -Dm644 ${S}/data/out/icudt${ICU_MAJOR_VER}l.dat ${S}/data/in/icudt${ICU_MAJOR_VER}l.dat } 87149 5 steve 2020-05-06 07:36:24 +0000 I get intermittent failures on dunfell autobuilder builds of icu, likely related: https://errors.yoctoproject.org/Errors/Details/410500/ 87429 6 richard.purdie 2020-06-04 23:54:10 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/23/builds/2230 87491 7 richard.purdie 2020-06-16 10:02:27 +0000 https://autobuilder.yoctoproject.org/typhoon/#/builders/91/builds/2833 87501 8 ross.burton 2020-06-17 03:50:38 +0000 Hongxu: did disabling parallel make help? 87502 9 hongxu.jia 2020-06-17 04:04:40 +0000 (In reply to comment #8) > Hongxu: did disabling parallel make help? Yes, the issue was not found any more 87505 10 richard.purdie 2020-06-18 07:20:20 +0000 We can add PARALLEL_MAKE_task-make-icudata = "" to the recipe to disable parallel make in this task. Execution time for the task goes from 31s to 328s which is my view is unacceptable though, we need to fix this properly. 87515 11 randy.macleod 2020-06-18 08:17:26 +0000 Hongxu, Could you (and Robert?) take a look at the build to try to find and fix the race condition? 87516 12 randy.macleod 2020-06-18 08:20:10 +0000 Actually Ross is going to work on it. 87520 13 ross.burton 2020-06-18 11:07:40 +0000 Got a patch that removes the parallel building but also changes a lot of the build so the performance hit isn't as bad. 87699 14 richard.purdie 2020-07-06 15:29:07 +0000 Dropping the AB-INT tag since this is now disabled from the autobuilder perspective (but is still an issue we need to fix). 87876 15 ross.burton 2020-08-04 02:10:44 +0000 oe-core df89e8d1136fd406ba35ae573e2cb0cfc88c6aad mostly fixed this.