Bug 12905

Summary:	core-image-lsb-sdk failed with opkg backend
Product:	[Build System, Metadata & Runtime] OE-Core	Reporter:	Khem Raj <raj.khem>
Component:	core	Assignee:	Alejandro del Castillo <alejandro.delcastillo>
Status:	RESOLVED FIXED	QA Contact:
Severity:	major
Priority:	Medium+	CC:	christophevr, meta.mr.watcher, meta.watcher, openatv, richard.purdie
Version:	2.6
Target Milestone:	2.6 M4
Hardware:	All
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	Regression (Used to work)
Verified:		Documentation change:	No (bug/feature does not impact docs)

Description Khem Raj 2018-08-30 04:05:19 UTC

After the below change for locale optimizations

http://git.openembedded.org/openembedded-core/commit/?id=8ffd93bdb09b0a4a84b27dafcd684c6abba392ed

opkg backend has started to fail, rpm backend ( poky default ) is working ok

to reproduce set in local.conf

PACKAGE_CLASSES = "package_ipk"

then 

bitbake core-image-lsb-sdk

It will fail in do_rootfs task

Here is sequence of events

Installing binary locale
=========================
Installing glibc-binary-localedata-en-bw.iso-8859-1 (2.28) on root
Downloading file:/mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/oe-rootfs-repo/riscv64/glibc-binary-localedata-en-bw.iso-8859-1_2.28-r0.2_riscv64.ipk.

configuring it
===============
Configuring glibc-binary-localedata-en-bw.iso-8859-1.

uninstalling binary locale
==========================
/mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/recipe-sysroot-native/usr/bin/opkg --volatile-cache -f /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/opkg.conf -t /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/temp/ipktemp/ -o /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs  --force_postinstall --prefer-arch-to-version   --force-depends remove ....


Here it runs into issues

Removing glibc-binary-localedataCollected errors:
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-en-bw.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-br-fr.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-jo.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-de-de.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-de-at.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-so-ke.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-bs-ba.iso-8859-2.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ko-kr.euc-kr.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-es-sv.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-zh-cn.gb18030.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-tl-ph.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-kw.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-sl-si.iso-8859-2.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-sv-se.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-om.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-is-is.iso-8859-1.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-ar-ly.iso-8859-6.list: No such file or directory.
 * pkg_get_installed_files: Failed to open /mnt/a/oe/build/tmp/work/qemuriscv64-bec-linux/core-image-lsb-sdk/1.0-r0/rootfs///var/lib/opkg/info/glibc-binary-localedata-zu-za.iso-8859-1.list: No such file or directory.

As can be seen, all the failing packages are having a dot(.) appear in their names. Other glibc-binary-localedata-* packages gets removed without errors.

I wonder if this is a limitation/bug in opkg, in any case this will break many such builds with opkg backend, which is general default in OE-Core.

Comment 1 ChristopheCvr 2018-09-05 08:26:52 UTC

yes that is the commit who start to fail the do_rootfs phase not only by 
core-image-lsb-sdk

In general the whole package-manager.py and rootfs.py fails.

this bug has same origin as bug report :

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12900

Comment 2 Alejandro del Castillo 2018-09-05 17:04:36 UTC

Yep, Khem is reight, this is an opkg bug. Opkg is using a glob that is too broad when selecting which metadata files to delete. I posted a fix on the opkg mailing list, as well as an update to the opkg recipe on the oe ml.

Comment 3 Richard Purdie 2018-09-05 20:41:49 UTC

Thanks Alejandro!

Comment 4 Alejandro del Castillo 2018-09-06 14:29:39 UTC

Fixed on commit 715180e41884393d4f2f234dd557df61a21c4745