Bug 14319 - xz memory allocation failure during do_populate_sdk
Summary: xz memory allocation failure during do_populate_sdk
Status: RESOLVED DUPLICATE of bug 14310
Alias: None
Product: BitBake
Classification: Build System, Metadata & Runtime
Component: bitbake (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Undecided normal
Target Milestone: ---
Assignee: Richard Purdie
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2021-03-23 10:05 UTC by Oleksiy Obitotskyy
Modified: 2021-03-25 14:57 UTC (History)
4 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Don't know


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Oleksiy Obitotskyy 2021-03-23 10:05:59 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/3211

ERROR: buildtools-tarball-1.0-r0 do_populate_sdk: Error executing a python function in exec_python_func() autogenerated:

The stack trace of python calls that resulted in this exception/failure was:
File: 'exec_python_func() autogenerated', lineno: 2, function: <module>
     0001:
 *** 0002:do_populate_sdk(d)
     0003:
File: '/home/pokybuild/yocto-worker/qemumips64/build/meta/classes/populate_sdk_base.bbclass', lineno: 172, function: do_populate_sdk
     0168:
     0169:    populate_sdk(d)
     0170:
     0171:fakeroot python do_populate_sdk() {
 *** 0172:    populate_sdk_common(d)
     0173:}
     0174:SSTATETASKS += "do_populate_sdk"
     0175:SSTATE_SKIP_CREATION_task-populate-sdk = '1'
     0176:do_populate_sdk[cleandirs] = "${SDKDEPLOYDIR}"
File: '/home/pokybuild/yocto-worker/qemumips64/build/meta/classes/populate_sdk_base.bbclass', lineno: 169, function: populate_sdk_common
     0165:                    manifest_type=Manifest.MANIFEST_TYPE_SDK_HOST)
     0166:    create_manifest(d, manifest_dir=d.getVar('SDK_DIR'),
     0167:                    manifest_type=Manifest.MANIFEST_TYPE_SDK_TARGET)
     0168:
 *** 0169:    populate_sdk(d)
     0170:
     0171:fakeroot python do_populate_sdk() {
     0172:    populate_sdk_common(d)
     0173:}
File: '/home/pokybuild/yocto-worker/qemumips64/build/meta/lib/oe/sdk.py', lineno: 129, function: populate_sdk
     0125:
     0126:    img_type = d.getVar('IMAGE_PKGTYPE')
     0127:    import importlib
     0128:    cls = importlib.import_module('oe.package_manager.' + img_type + '.sdk')
 *** 0129:    cls.PkgSdk(d, manifest_dir).populate()
     0130:
     0131:    os.environ.clear()
     0132:    os.environ.update(env_bkp)
     0133:
File: '/home/pokybuild/yocto-worker/qemumips64/build/meta/lib/oe/sdk.py', lineno: 58, function: populate
     0054:                                 self.sysconfdir, "ld.so.cache")
     0055:        self.mkdirhier(os.path.dirname(link_name))
     0056:        os.symlink("/etc/ld.so.cache", link_name)
     0057:
 *** 0058:        execute_pre_post_process(self.d, self.d.getVar('SDK_POSTPROCESS_COMMAND'))
     0059:
     0060:    def movefile(self, sourcefile, destdir):
     0061:        try:
     0062:            # FIXME: this check of movefile's return code to None should be
File: '/home/pokybuild/yocto-worker/qemumips64/build/meta/lib/oe/utils.py', lineno: 263, function: execute_pre_post_process
     0259:    for cmd in cmds.strip().split(';'):
     0260:        cmd = cmd.strip()
     0261:        if cmd != '':
     0262:            bb.note("Executing %s ..." % cmd)
 *** 0263:            bb.build.exec_func(cmd, d)
     0264:
     0265:# For each item in items, call the function 'target' with item as the first
     0266:# argument, extraargs as the other arguments and handle any exceptions in the
     0267:# parent thread
File: '/home/pokybuild/yocto-worker/qemumips64/build/bitbake/lib/bb/build.py', lineno: 256, function: exec_func
     0252:    with bb.utils.fileslocked(lockfiles):
     0253:        if ispython:
     0254:            exec_func_python(func, d, runfile, cwd=adir)
     0255:        else:
 *** 0256:            exec_func_shell(func, d, runfile, cwd=adir)
     0257:
     0258:    try:
     0259:        curcwd = os.getcwd()
     0260:    except:
File: '/home/pokybuild/yocto-worker/qemumips64/build/bitbake/lib/bb/build.py', lineno: 503, function: exec_func_shell
     0499:    with open(fifopath, 'r+b', buffering=0) as fifo:
     0500:        try:
     0501:            bb.debug(2, "Executing shell function %s" % func)
     0502:            with open(os.devnull, 'r+') as stdin, logfile:
 *** 0503:                bb.process.run(cmd, shell=False, stdin=stdin, log=logfile, extrafiles=[(fifo,readfifo)])
     0504:        except bb.process.ExecutionError as exe:
     0505:            # Find the backtrace that the shell trap generated
     0506:            backtrace_marker_regex = re.compile(r"WARNING: Backtrace \(BB generated script\)")
     0507:            stdout_lines = (exe.stdout or "").split("\n")
File: '/home/pokybuild/yocto-worker/qemumips64/build/bitbake/lib/bb/process.py', lineno: 184, function: run
     0180:        if not stderr is None:
     0181:            stderr = stderr.decode("utf-8")
     0182:
     0183:    if pipe.returncode != 0:
 *** 0184:        raise ExecutionError(cmd, pipe.returncode, stdout, stderr)
     0185:    return stdout, stderr
Exception: bb.process.ExecutionError: Execution of '/home/pokybuild/yocto-worker/qemumips64/build/build/tmp/work/x86_64-nativesdk-pokysdk-linux/buildtools-tarball/1.0-r0/temp/run.archive_sdk.29599' failed with exit code 1:
xz: Adjusted the number of threads from 56 to 51 to not exceed the memory usage limit of 64,418 MiB
xz: (stdin): Cannot allocate memory
WARNING: exit code 1 from a shell command.


NOTE: recipe core-image-minimal-1.0-r0: task do_sdk_depends: Started
ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/work/x86_64-nativesdk-pokysdk-linux/buildtools-tarball/1.0-r0/temp/log.do_populate_sdk.29599
NOTE: recipe buildtools-tarball-1.0-r0: task do_populate_sdk: Failed
ERROR: Task (/home/pokybuild/yocto-worker/qemumips64/build/meta/recipes-core/meta/buildtools-tarball.bb:do_populate_sdk) failed with exit code '1'
Comment 1 Oleksiy Obitotskyy 2021-03-23 10:07:55 UTC
xz memory failure https://bugzilla.yoctoproject.org/show_bug.cgi?id=14310
Comment 2 Oleksiy Obitotskyy 2021-03-23 10:34:49 UTC
https://autobuilder.yoctoproject.org/typhoon/#/builders/74/builds/3211/steps/16/logs/stdio

ERROR: core-image-minimal-1.0-r0 do_testsdkext: The toolchain ext /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/deploy/sdk/poky-glibc-x86_64-core-image-minimal-mips64r2-qemumips64-toolchain-ext-3.2+snapshot.sh is not built. Build it before running the tests: 'bitbake <image> -c populate_sdk_ext' .
ERROR: core-image-sato-1.0-r0 do_testsdkext: The toolchain ext /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/deploy/sdk/poky-glibc-x86_64-core-image-sato-mips64r2-qemumips64-toolchain-ext-3.2+snapshot.sh is not built. Build it before running the tests: 'bitbake <image> -c populate_sdk_ext' .
ERROR: core-image-sato-1.0-r0 do_testsdk: The toolchain /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/deploy/sdk/poky-glibc-x86_64-core-image-sato-mips64r2-qemumips64-toolchain-3.2+snapshot.sh is not built. Build it before running the tests: 'bitbake <image> -c populate_sdk' .
ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/work/qemumips64-poky-linux/core-image-sato/1.0-r0/temp/log.do_testsdk.21342
NOTE: recipe core-image-sato-1.0-r0: task do_testsdk: Failed
ERROR: Task (/home/pokybuild/yocto-worker/qemumips64/build/meta/recipes-sato/images/core-image-sato.bb:do_testsdk) failed with exit code '1'
ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/work/qemumips64-poky-linux/core-image-minimal/1.0-r0/temp/log.do_testsdkext.21340
NOTE: recipe core-image-minimal-1.0-r0: task do_testsdkext: Failed
ERROR: Logfile of failure stored in: /home/pokybuild/yocto-worker/qemumips64/build/build/tmp/work/qemumips64-poky-linux/core-image-sato/1.0-r0/temp/log.do_testsdkext.21341
NOTE: recipe core-image-sato-1.0-r0: task do_testsdkext: Failed
ERROR: Task (/home/pokybuild/yocto-worker/qemumips64/build/meta/recipes-core/images/core-image-minimal.bb:do_testsdkext) failed with exit code '1'
ERROR: Task (/home/pokybuild/yocto-worker/qemumips64/build/meta/recipes-sato/images/core-image-sato.bb:do_testsdkext) failed with exit code '1'


Or should be filed as separate bug?
Comment 3 Randy MacLeod 2021-03-25 14:57:20 UTC
Basically the same issue.

*** This bug has been marked as a duplicate of bug 14310 ***