Bug 12304 - nightly-oe-selftest failing on do_image_ext4 step
Summary: nightly-oe-selftest failing on do_image_ext4 step
Status: RESOLVED DUPLICATE of bug 8430
Alias: None
Product: Build Testing
Classification: QA/Testing
Component: general (show other bugs)
Version: 2.5
Hardware: x86 Multiple
: Medium normal
Target Milestone: 4.99
Assignee: Ross Burton
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2017-11-06 15:40 UTC by Leonardo Sandoval Gonzalez
Modified: 2020-05-20 09:28 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Leonardo Sandoval Gonzalez 2017-11-06 15:40:22 UTC
No memory available on the AB's hard-disk?

This is the log coming from the AB:

-----
| DEBUG: Python function extend_recipe_sysroot finished
| DEBUG: Executing shell function do_image_ext4
| 0+0 records in
| 0+0 records out
| 0 bytes copied, 4.8298e-05 s, 0.0 kB/s
| mke2fs 1.43.5 (04-Aug-2017)
| Discarding device blocks: 1024/8192 done
| Creating filesystem with 8192 1k blocks and 2048 inodes
|
| Allocating group tables: 0/1 done
| Writing inode tables: 0/1 done
| Creating journal (1024 blocks): done
| Copying files into the device: __populate_fs: Could not allocate block in ext2 filesystem while writing file "udevd"
| mkfs.ext4: Could not allocate block in ext2 filesystem while populating file system
| WARNING: /tmp/eSDKQAytysjqod/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/run.do_image_ ext4.837 9:1 exit 1 from 'mkfs.$fstype -F $extra_imagecmd /tmp/eSDKQAytysjqod/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171103192939.rootfs.$fstype -d /tmp/eSDKQAytysjqod/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs'
| ERROR: Function failed: do_image_ext4 (log file is located at /tmp/eSDKQAytysjqod/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/log.do_image_ext4.8379)
ERROR: Task (/tmp/eSDKQAytysjqod/layers/build/meta/recipes-core/images/core-image-minimal.bb:do_image_ext4) failed with exit code '1'
Summary: There was 1 ERROR message shown, returning a non-zero exit code.
-----

AB build details:

Build status: FAILURE Build worker for this Build: opensuse423.yocto.io
Complete logs for all build steps: https://autobuilder.yocto.io/builders/nightly-oe-selftest/builds/590
Build Reason: Triggerable(trigger_main-build_nowait)
Build Properties:
• Contents of bblayers.conf (Note. LCONF_VERSION will not show up correctly)
POKY_BBLAYERS_CONF_VERSION =
BBPATH = "${TOPDIR}"
BBFILES ?=""
BBLAYERS += " \
/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta \
/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-poky \
/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-yocto-bsp \
/home/pokybuild/yocto-autobuilder/yocto-worker/nightly-oe-selftest/build/meta-selftest \
"

• DEST : /srv/autobuilder/autobuilder.yoctoproject.org/pub/nightly/20171103-2
• DISTRO : poky
• Contents of auto.conf (local.conf for autobuilders)
INHERIT += "report-error"
DISTRO = "poky"
PACKAGE_CLASSES = "package_rpm"
BB_NUMBER_THREADS = "24"
PARALLEL_MAKE = "-j 28"
SDKMACHINE ?= "x86_64"
BB_TASK_NICE_LEVEL = "5"
BB_TASK_NICE_LEVEL_task-testimage = "0"
BB_TASK_IONICE_LEVEL = "2.7"
BB_TASK_IONICE_LEVEL_task-testimage = "2.1"
DL_DIR = "/srv/autobuilder/autobuilder.yoctoproject.org/current_sources"
SSTATE_DIR ?= "/srv/autobuilder/autobuilder.yoctoproject.org/pub/sstate/"
MACHINE = "qemux86-64"
PREMIRRORS = ""
BB_GENERATE_MIRROR_TARBALLS = "1"
ADTREPO = "http://adtrepo.yoctoproject.org//2.4"
QEMU_USE_KVM = "True"
SDK_EXT_TYPE = "minimal"
SDK_INCLUDE_TOOLCHAIN = "1"
SANITY_TESTED_DISTROS = ""
RPM_GPG_SIGN_CHUNK = "1"
Comment 1 Saul Wold 2017-11-20 23:04:25 UTC
As best as I can tell from the mke2fs output below, we created a ext4 FS that was around 8192K (~8M) and this might have been too small for a core-image-minimal, which I am seeing clock in around 11M right now.

So we did not run out of space in /tmp, but created an ext4 image that was too small for some reason TBD.  The only way to really understand this is to be able to analyse an actual failure, looking at both the eSDK and the logs of the build. Those logs are long gone now.

Getting the log.do_image_ext4 and run.do_image_ext4 files for a failed build would be extremely helpful.
Comment 2 Andre McCurdy 2017-11-21 01:18:24 UTC
The rootfs image file being created is only 8MB and the build should be gracefully stopped if the host's HDD free space falls below 1GB (according to default BB_DISKMON_DIRS), so it seems unlikely that the host's HDD free space would be the issue here.

From the error message, it seems that the 8MB rootfs image file is too small to hold all the files from the rootfs (note that the error is "Could not allocate block" rather than "Could not allocate inode", so it's the combined size of the files in the rootfs which seems to be the problem - not the number of files).

get_rootfs_size() in image.bbclass tries to ensure that the rootfs image file has sufficient headroom to hold all files + filesystem meta data by measuring the actual size of the files in the rootfs (with "du -ks") and multiplying by IMAGE_OVERHEAD_FACTOR (1.3 by default). There would seem to be two possible ways that could fail:

1) The IMAGE_OVERHEAD_FACTOR is not sufficient to guarantee enough headroom for ext4 meta data (the journal etc) in all cases.

2) The combined size of the files in the rootfs changes (increases) between the time that set_image_size() runs get_rootfs_size() and sets up ROOTFS_SIZE and the time that oe_mkext234fs() references ROOTFS_SIZE to create the rootfs image file.
Comment 3 Saul Wold 2017-11-21 15:30:39 UTC
If we see this bug again, we need to save the workdir to preserve various files, it seems that the get_rootfs_size() might have returned a bad value, but we can't understand why based on the available output.

I am sending a patch to provide some of this needed information into the log output.
Comment 4 Saul Wold 2017-11-22 16:10:23 UTC
This patch provides some additional debug info in hopes that we can capture this failure again.

http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=66a34a7bdb83ad971c8842ea031f1b74e8d78cf3

I am putting this in NEEDINFO as a reminder to track this closer for the next month or so.
Comment 5 Saul Wold 2017-12-06 17:16:51 UTC
Captured the following failure:

| DEBUG: Executing shell function do_image_ext4
| DEBUG: Executing dd if=/dev/zero of=/tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171206143645.rootfs.ext4 seek=8192 count=0 bs=1024
| 0+0 records in
| 0+0 records out
| 0 bytes copied, 7.7844e-05 s, 0.0 kB/s
| DEBUG: Actual Rootfs size:  10572	/tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| DEBUG: Actual Partion size: 0 /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171206143645.rootfs.ext4
| DEBUG: Executing mkfs.ext4 -F -i 4096 /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171206143645.rootfs.ext4 -d /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| mke2fs 1.43.7 (16-Oct-2017)
| Discarding device blocks: 1024/8192         done
| Creating filesystem with 8192 1k blocks and 2048 inodes
| 
| Allocating group tables: 0/1   done
| Writing inode tables: 0/1   done
| Creating journal (1024 blocks): done
| Copying files into the device: __populate_fs: Could not allocate block in ext2 filesystem while writing file "udevd"
| mkfs.ext4: Could not allocate block in ext2 filesystem while populating file system
| WARNING: /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/run.do_image_ext4.27837:1 exit 1 from 'mkfs.$fstype -F $extra_imagecmd /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171206143645.rootfs.$fstype -d /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs'
| ERROR: Function failed: do_image_ext4 (log file is located at /tmp/eSDKQAg8rsb68n/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/log.do_image_ext4.27837)
NOTE: recipe core-image-minimal-1.0-r0: task do_image_ext4: Failed


A couple of important items to note:
1) The dd command is a sparse file creation and is creating of size 8M
2) The actual rootfs size as noted is more like 10M
3) The actual rootfs.ext4 file size of 0 is correct for a sparse file

The key issue seems to be that the ROOTFS_SIZE is not getting computed correctly, but having the 10M size should help test the computation better.

get_rootfs_size() in image.bbclass needs some debug, I will investigate this further.
Comment 6 Saul Wold 2017-12-19 18:20:58 UTC
| DEBUG: Executing python function set_image_size
| DEBUG: 10004.800000 = 7696 * 1.300000
| DEBUG: 10004.800000 = max(10004.800000, 8192)[10004.800000] + 1
| DEBUG: 10005.000000 = int(10004.800000)
| DEBUG: 10005 = aligned(10005)
| DEBUG: returning 10005
| DEBUG: Python function set_image_size finished
| DEBUG: Executing python function extend_recipe_sysroot
| NOTE: Direct dependencies are ['virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/e2fsprogs/e2fsprogs_1.43.7.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/createrepo-c/createrepo-c_git.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-extended/pigz/pigz_2.3.4.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/makedevs/makedevs_1.0.1.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/prelink/prelink_git.bb:do_populate_sysroot', '/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/qemu/qemuwrapper-cross_1.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/dnf/dnf_2.7.5.bb:do_populate_sysroot', '/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/mklibs/mklibs-native_0.1.43.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/rpm/rpm_4.14.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-extended/pbzip2/pbzip2_1.1.13.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/opkg/opkg_0.3.5.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/pseudo/pseudo_1.8.2.bb:do_populate_sysroot', '/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-kernel/kmod/depmodwrapper-cross_1.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-devtools/opkg-utils/opkg-utils_0.3.5.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb:do_populate_sysroot', '/tmp/eSDKQAxo8eh9wo/layers/build/meta/recipes-core/glibc/ldconfig-native_2.12.1.bb:do_populate_sysroot']
| NOTE: Installed into sysroot: []
| NOTE: Skipping as already exists in sysroot: ['e2fsprogs-native', 'createrepo-c-native', 'pigz-native', 'makedevs-native', 'prelink-native', 'qemuwrapper-cross', 'dnf-native', 'mklibs-native', 'rpm-native', 'pbzip2-native', 'opkg-native', 'pseudo-native', 'depmodwrapper-cross', 'opkg-utils-native', 'update-rc.d-native', 'ldconfig-native', 'file-native', 'glib-2.0-native', 'expat-native', 'python3-native', 'openssl-native', 'libxml2-native', 'curl-native', 'pkgconfig-native', 'quilt-native', 'sqlite3-native', 'zlib-native', 'cmake-native', 'xz-native', 'elfutils-native', 'gnu-config-native', 'autoconf-native', 'automake-native', 'libtool-native', 'binutils-native', 'shadow-native', 'bzip2-native', 'libarchive-native', 'libsolv-native', 'gettext-minimal-native', 'texinfo-dummy-native', 'util-linux-native', 'attr-native', 'qemu-native', 'python3-iniparse-native', 'librepo-native', 'libcomps-native', 'libdnf-native', 'db-native', 'dbus-native', 'popt-native', 'nss-native', 'kmod-native', 'libpcre-native', 'gtk-doc-native', 'gettext-native', 'libffi-native', 'readline-native', 'makedepend-native', 'cryptodev-linux-native', 'm4-native', 'flex-native', 'bison-native', 'ncurses-native', 'lzo-native', 'pixman-native', 'libsdl-native', 'alsa-lib-native', 'dtc-native', 'python3-six-native', 'gpgme-native', 'libcheck-native', 'gobject-introspection-native', 'autoconf-archive-native', 'nspr-native', 'util-macros-native', 'xproto-native', 'libpng-native', 'libxrender-native', 'libxext-native', 'libxrandr-native', 'libx11-native', 'python3-setuptools-native', 'libassuan-native', 'libgpg-error-native', 'swig-native', 'renderproto-native', 'xextproto-native', 'randrproto-native', 'kbproto-native', 'libxcb-native', 'xtrans-native', 'inputproto-native', 'unzip-native', 'libxau-native', 'xcb-proto-native', 'libxdmcp-native', 'libpthread-stubs-native']
| DEBUG: Python function extend_recipe_sysroot finished
| DEBUG: Executing shell function do_image_ext4
| DEBUG: Executing dd if=/dev/zero of=/tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171219020250.rootfs.ext4 seek=10005 count=0 bs=1024
| 0+0 records in
| 0+0 records out
| 0 bytes copied, 9.7432e-05 s, 0.0 kB/s
| DEBUG: Actual Rootfs size:  7696	/tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| DEBUG: Actual Partion size: 0 /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171219020250.rootfs.ext4
| DEBUG: Executing mkfs.ext4 -F -i 4096 /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171219020250.rootfs.ext4 -d /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| mke2fs 1.43.7 (16-Oct-2017)
| Discarding device blocks:  1024/10004           done
| Creating filesystem with 10004 1k blocks and 2512 inodes
| Filesystem UUID: 35a71905-9615-4f74-befb-4bffe35249f9
| Superblock backups stored on blocks:
| 	8193
| 
| Allocating group tables: 0/2   done
| Writing inode tables: 0/2   done
| Creating journal (1024 blocks): done
| Copying files into the device: __populate_fs: Could not allocate block in ext2 filesystem while writing file "bzImage-4.12.16-yocto-standard"
| mkfs.ext4: Could not allocate block in ext2 filesystem while populating file system
| WARNING: /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/run.do_image_ext4.42054:1 exit 1 from 'mkfs.$fstype -F $extra_imagecmd /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20171219020250.rootfs.$fstype -d /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs'
| ERROR: Function failed: do_image_ext4 (log file is located at /tmp/eSDKQAxo8eh9wo/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/log.do_image_ext4.42054)
NOTE: recipe core-image-minimal-1.0-r0: task do_image_ext4: Failed

This latest failure seems a little different, as the computed rootfs size is correct at 10005 (~10M) for a rootfs about 7.6M.

This seems to point more to the e2fs tools for mkfs.ext*
(adding Robert).

We really need a way to preserve the failing rootfs files to see if this can be reproduced.
Comment 7 Robert Yang 2017-12-20 09:13:38 UTC
The error message shows:

| Copying files into the device: __populate_fs: Could not allocate block in ext2 filesystem while writing file "bzImage-4.12.16-yocto-standard"
| mkfs.ext4: Could not allocate block in ext2 filesystem while populating file system

Look at the "bzImage-4.12.16-yocto-standard", there should be no this file
in rootfs when dev build-image core-image-minimal, and I think that it wasn't
there when "du -sh rootfs", I must be some process add it to rootfs between
"du -sh rootfs" and "mkfs.ext4 rootfs -d rootfs.img", I checked
meta/lib/oeqa/selftest/cases, the only one that I suspected is
devtool.DevtoolTests.test_devtool_virtual_kernel_modify, but the failed
one is eSDK.oeSDKExtSelfTest.test_image_generation_binary_feeds,
totally different modules and working directory. Maybe there are still
other cases that I didn't find.
Comment 8 Richard Purdie 2018-07-23 14:00:33 UTC
This is still occurring. https://autobuilder.yocto.io/builders/nightly-oe-selftest/builds/1210/steps/Running%20oe-selftest/logs/stdio :

ERROR: Logfile of failure stored in: /tmp/eSDKQAl7_jtpps/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/temp/log.do_image_ext4.28624
Log data follows:
| DEBUG: Executing python function set_image_size
| DEBUG: 5678.400000 = 4368 * 1.300000
| DEBUG: 8192.000000 = max(5678.400000, 8192)[8192.000000] + 1
| DEBUG: 8192.000000 = int(8192.000000)
| DEBUG: 8192 = aligned(8192)
| DEBUG: returning 8192
| DEBUG: Python function set_image_size finished
| DEBUG: Executing python function extend_recipe_sysroot
| NOTE: Direct dependencies are ['virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-extended/pigz/pigz_2.4.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/rpm/rpm_4.14.1.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/makedevs/makedevs_1.0.1.bb:do_populate_sysroot', '/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/qemu/qemuwrapper-cross_1.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/pseudo/pseudo_git.bb:do_populate_sysroot', '/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/mklibs/mklibs-native_0.1.43.bb:do_populate_sysroot', '/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-kernel/kmod/depmodwrapper-cross_1.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/createrepo-c/createrepo-c_git.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-extended/pbzip2/pbzip2_1.1.13.bb:do_populate_sysroot', '/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-core/glibc/ldconfig-native_2.12.1.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/e2fsprogs/e2fsprogs_1.44.2.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/opkg/opkg_0.3.6.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/opkg-utils/opkg-utils_0.3.6.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/dnf/dnf_2.7.5.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQAl7_jtpps/layers/build/meta/recipes-devtools/prelink/prelink_git.bb:do_populate_sysroot']
| NOTE: Installed into sysroot: []
| NOTE: Skipping as already exists in sysroot: ['update-rc.d-native', 'pigz-native', 'rpm-native', 'makedevs-native', 'qemuwrapper-cross', 'pseudo-native', 'mklibs-native', 'depmodwrapper-cross', 'createrepo-c-native', 'pbzip2-native', 'ldconfig-native', 'e2fsprogs-native', 'opkg-native', 'opkg-utils-native', 'dnf-native', 'prelink-native', 'quilt-native', 'zlib-native', 'dbus-native', 'autoconf-native', 'python3-native', 'db-native', 'file-native', 'gnu-config-native', 'popt-native', 'elfutils-native', 'xz-native', 'automake-native', 'gettext-minimal-native', 'pkgconfig-native', 'nss-native', 'bzip2-native', 'libarchive-native', 'libtool-native', 'qemu-native', 'kmod-native', 'curl-native', 'libxml2-native', 'sqlite3-native', 'cmake-native', 'openssl-native', 'glib-2.0-native', 'ninja-native', 'expat-native', 'shadow-native', 'util-linux-native', 'attr-native', 'texinfo-dummy-native', 'libsolv-native', 'librepo-native', 'libdnf-native', 'libcomps-native', 'python3-iniparse-native', 'binutils-native', 'autoconf-archive-native', 'm4-native', 'gdbm-native', 'readline-native', 'nspr-native', 'lzo-native', 'alsa-lib-native', 'pixman-native', 'libsdl2-native', 'dtc-native', 'gtk-doc-native', 'makedepend-native', 'cryptodev-linux-native', 'libffi-native', 'libpcre-native', 're2c-native', 'ncurses-native', 'gpgme-native', 'gobject-introspection-native', 'libcheck-native', 'python3-six-native', 'bison-native', 'flex-native', 'util-macros-native', 'libpng-native', 'libxext-native', 'libxrandr-native', 'libx11-native', 'libxrender-native', 'xorgproto-native', 'libassuan-native', 'libgpg-error-native', 'swig-native', 'python3-setuptools-native', 'libxcb-native', 'xtrans-native', 'unzip-native', 'libxdmcp-native', 'libpthread-stubs-native', 'xcb-proto-native', 'libxau-native']
| DEBUG: Python function extend_recipe_sysroot finished
| DEBUG: Executing shell function do_image_ext4
| DEBUG: Executing dd if=/dev/zero of=/tmp/eSDKQAl7_jtpps/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20180721093433.rootfs.ext4 seek=8192 count=0 bs=1024
| 0+0 records in
| 0+0 records out
| 0 bytes copied, 5.434e-05 s, 0.0 kB/s
| DEBUG: Actual Rootfs size:  10504	/tmp/eSDKQAl7_jtpps/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| DEBUG: Actual Partion size: 8388608
| DEBUG: Executing mkfs.ext4 -F -i 4096 /tmp/eSDKQAl7_jtpps/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20180721093433.rootfs.ext4 -d /tmp/eSDKQAl7_jtpps/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
| mke2fs 1.44.2 (14-May-2018)

rerunning this manually on the same AB:

DEBUG: Executing python function set_image_size
DEBUG: 13806.000000 = 10620 * 1.300000
DEBUG: 13806.000000 = max(13806.000000, 8192)[13806.000000] + 1
DEBUG: 13806.000000 = int(13806.000000)
DEBUG: 13806 = aligned(13806)
DEBUG: returning 13806
DEBUG: Python function set_image_size finished
DEBUG: Executing python function extend_recipe_sysroot
NOTE: Direct dependencies are ['/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-kernel/kmod/depmodwrapper-cross_1.0.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/opkg-utils/opkg-utils_0.3.6.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/makedevs/makedevs_1.0.1.bb:do_populate_sysroot', '/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-core/glibc/ldconfig-native_2.12.1.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-core/update-rc.d/update-rc.d_0.7.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-extended/pbzip2/pbzip2_1.1.13.bb:do_populate_sysroot', '/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/mklibs/mklibs-native_0.1.43.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/pseudo/pseudo_git.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/rpm/rpm_4.14.1.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/dnf/dnf_2.7.5.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/createrepo-c/createrepo-c_git.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-extended/pigz/pigz_2.4.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/e2fsprogs/e2fsprogs_1.44.2.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/opkg/opkg_0.3.6.bb:do_populate_sysroot', 'virtual:native:/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/prelink/prelink_git.bb:do_populate_sysroot', '/tmp/eSDKQApsq4f5fc/layers/build/meta/recipes-devtools/qemu/qemuwrapper-cross_1.0.bb:do_populate_sysroot']
NOTE: Installed into sysroot: []
NOTE: Skipping as already exists in sysroot: ['depmodwrapper-cross', 'opkg-utils-native', 'makedevs-native', 'ldconfig-native', 'update-rc.d-native', 'pbzip2-native', 'mklibs-native', 'pseudo-native', 'rpm-native', 'dnf-native', 'createrepo-c-native', 'pigz-native', 'e2fsprogs-native', 'opkg-native', 'prelink-native', 'qemuwrapper-cross', 'quilt-native', 'bzip2-native', 'libtool-native', 'gettext-minimal-native', 'xz-native', 'automake-native', 'autoconf-native', 'gnu-config-native', 'pkgconfig-native', 'dbus-native', 'python3-native', 'db-native', 'file-native', 'elfutils-native', 'nss-native', 'libarchive-native', 'popt-native', 'attr-native', 'texinfo-dummy-native', 'util-linux-native', 'binutils-native', 'qemu-native', 'kmod-native', 'libcomps-native', 'python3-iniparse-native', 'cmake-native', 'ninja-native', 'librepo-native', 'libdnf-native', 'openssl-native', 'glib-2.0-native', 'curl-native', 'expat-native', 'libxml2-native', 'zlib-native', 'sqlite3-native', 'shadow-native', 'libsolv-native', 'm4-native', 'autoconf-archive-native', 'gdbm-native', 'readline-native', 'nspr-native', 'lzo-native', 'ncurses-native', 'bison-native', 'flex-native', 'dtc-native', 'libsdl2-native', 'pixman-native', 'alsa-lib-native', 'gtk-doc-native', 'libcheck-native', 'python3-six-native', 're2c-native', 'gpgme-native', 'gobject-introspection-native', 'makedepend-native', 'cryptodev-linux-native', 'libpcre-native', 'libffi-native', 'libx11-native', 'libxrandr-native', 'libxext-native', 'libxrender-native', 'util-macros-native', 'libpng-native', 'python3-setuptools-native', 'swig-native', 'libassuan-native', 'libgpg-error-native', 'xorgproto-native', 'xtrans-native', 'libxcb-native', 'unzip-native', 'libxdmcp-native', 'xcb-proto-native', 'libpthread-stubs-native', 'libxau-native']
DEBUG: Python function extend_recipe_sysroot finished
DEBUG: Executing shell function do_image_ext4
DEBUG: Executing dd if=/dev/zero of=/tmp/eSDKQApsq4f5fc/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20180723132439.rootfs.ext4 seek=13806 count=0 bs=1024
0+0 records in
0+0 records out
0 bytes copied, 5.5835e-05 s, 0.0 kB/s
DEBUG: Actual Rootfs size:  10620   /tmp/eSDKQApsq4f5fc/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs
DEBUG: Actual Partion size: 14137344
DEBUG: Executing mkfs.ext4 -F -i 4096 /tmp/eSDKQApsq4f5fc/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/deploy-core-image-minimal-image-complete/core-image-minimal-qemux86-64-20180723132439.rootfs.ext4 -d /tmp/eSDKQApsq4f5fc/tmp/work/qemux86_64-poky-linux/core-image-minimal/1.0-r0/rootfs

so somehow the first du call is not getting the real image size. The second one seems to be right.

Not sure why...
Comment 9 Richard Purdie 2018-07-23 14:07:41 UTC
Note this on a machine with:

/dev/sda3 on /tmp type btrfs (rw,relatime,space_cache,subvolid=264,subvol=/@/tmp)
Comment 10 Ross Burton 2020-05-20 09:28:38 UTC
Pretty sure this is just #8430.

*** This bug has been marked as a duplicate of bug 8430 ***