Bug 12905 - core-image-lsb-sdk failed with opkg backend
Summary: core-image-lsb-sdk failed with opkg backend
Status: RESOLVED FIXED
Alias: None
Product: OE-Core
Classification: Build System, Metadata & Runtime
Component: core (show other bugs)
Version: 2.6
Hardware: All Multiple
: Medium+ major
Target Milestone: 2.6 M4
Assignee: Alejandro del Castillo
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2018-08-30 04:05 UTC by Khem Raj
Modified: 2018-09-06 14:29 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: Regression (Used to work)
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Khem Raj 2018-08-30 04:05:19 UTC
After the below change for locale optimizations

http://git.openembedded.org/openembedded-core/commit/?id=8ffd93bdb09b0a4a84b27dafcd684c6abba392ed

opkg backend has started to fail, rpm backend ( poky default ) is working ok

to reproduce set in local.conf

PACKAGE_CLASSES = "package_ipk"

then 

bitbake core-image-lsb-sdk

It will fail in do_rootfs task

Here is sequence of events

Installing binary locale
=========================
Installing glibc-binary-localedata-en-bw.iso-8859-1 (2.28) on root
Downloading file:/mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/oe-rootfs-repo/riscv64/glibc-binary-localedata-en-bw.iso-8859-1_2.28-r0.2_riscv64.ipk.

configuring it
===============
Configuring glibc-binary-localedata-en-bw.iso-8859-1.

uninstalling binary locale
==========================
/mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/recipe-sysroot-native/usr/bin/opkg --volatile-cache -f /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/opkg.conf -t /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/temp/ipktemp/ -o /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs  --force_postinstall --prefer-arch-to-version   --force-depends remove ....


Here it runs into issues

Removing glibc-binary-localedataCollected errors:
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-en-bw.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-br-fr.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-jo.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-de-de.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-de-at.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-so-ke.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-bs-ba.iso-8859-2.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ko-kr.euc-kr.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-es-sv.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-zh-cn.gb18030.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-tl-ph.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-kw.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-sl-si.iso-8859-2.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-sv-se.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-om.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-is-is.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-ly.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-zu-za.iso-8859-1.list: No such file or directory.

As can be seen, all the failing packages are having a dot(.) appear in their names. Other glibc-binary-localedata-* packages gets removed without errors.

I wonder if this is a limitation/bug in opkg, in any case this will break many such builds with opkg backend, which is general default in OE-Core.
Comment 1 ChristopheCvr 2018-09-05 08:26:52 UTC
yes that is the commit who start to fail the do_rootfs phase not only by 
core-image-lsb-sdk

In general the whole package-manager.py and rootfs.py fails.

this bug has same origin as bug report :

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12900
Comment 2 Alejandro del Castillo 2018-09-05 17:04:36 UTC
Yep, Khem is reight, this is an opkg bug. Opkg is using a glob that is too broad when selecting which metadata files to delete. I posted a fix on the opkg mailing list, as well as an update to the opkg recipe on the oe ml.
Comment 3 Richard Purdie 2018-09-05 20:41:49 UTC
Thanks Alejandro!
Comment 4 Alejandro del Castillo 2018-09-06 14:29:39 UTC
Fixed on commit 715180e41884393d4f2f234dd557df61a21c4745