Bug 2595

Summary: xxx-dev packages missing in the core-image-sato-sdk image using ipk
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Lianhao Lu <lianhao.lu>
Component: coreAssignee: Paul Eggleton <bluelightning>
Status: VERIFIED FIXED QA Contact:
Severity: normal    
Priority: Medium CC: dvhart, jessica.zhang, laurentiu.serban, meta.mr.watcher, meta.watcher, ross.burton
Version: 1.3   
Target Milestone: 1.3 M3   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: ---
Attachments:
Description Flags
fail log file
none
do_rootfs log none

Description Lianhao Lu 2012-06-13 10:52:54 UTC
Created attachment 580 [details]
fail log file

[Environment]
MACHINE = qemux86
DISTRO = "poky"
PACKAGE_CLASSES = "package_ipk"

Tree/Branch: Poky/Master
Commit: 5ed855d12cddf2de535c3f6d05d3dfe85d69d99d

Even though the building of core-image-sato-sdk didn't report any errors, lots of -dev packages are not installed in the final image.
Comment 1 Saul Wold 2012-06-14 15:23:28 UTC
Maybe a dup of 2598
Comment 2 Paul Eggleton 2012-06-25 16:45:41 UTC
*** Bug 2598 has been marked as a duplicate of this bug. ***
Comment 3 Paul Eggleton 2012-06-25 16:55:57 UTC
This is caused by us using the list of packages to install rather than the list of packages that have been installed in order to produce the list of dev/dbg packages to install; the list might not be complete due to dependencies installed by the package manager. This needs to be handled in a similar way to locales.
Comment 4 Ross Burton 2012-06-25 17:42:02 UTC
Is this a ipkg-specific issue?
Comment 5 Paul Eggleton 2012-06-25 17:58:44 UTC
No, it affects all packaging backends.
Comment 6 Lianhao Lu 2012-06-27 01:12:24 UTC
(In reply to comment #3)
> This is caused by us using the list of packages to install rather than the
> list of packages that have been installed in order to produce the list of
> dev/dbg packages to install; the list might not be complete due to
> dependencies installed by the package manager. This needs to be handled in a
> similar way to locales.

Why it was ok in 1.2 release? I don't recall anything changed here about the way how -dev packages get installed since 1.2.
Comment 7 Paul Eggleton 2012-07-02 13:01:29 UTC
Hmm, seems I was on the wrong track. We do have a problem with not all of the -dev packages being installed for all of the packages in the rootfs, and it is not specific to any backend, but that is a separate issue.

The issue reported in this bug *is* ipk-specific - it seems that the dependencies between -dev packages when they are produced as ipks are missing and because of the other issue I mentioned above, they do not get pulled into the rootfs anymore.
Comment 8 Paul Eggleton 2012-07-03 20:27:47 UTC
The opkg-specific bug appears to have been caused by http://git.yoctoproject.org/cgit/cgit.cgi/poky/commit/?id=e3a5089dbb843d013a2f1bb693312b86c717153b

(I also replied with the info below to the mailing list thread for this patch.)

This commit moved the config file to /etc/opkg, and opkg always reads all files under this directory even if -f is specified (as it is during do_rootfs in order to specify our own generated config file), and this means that after opkg-collateral is installed into the rootfs, this version of the config is used, resulting in opkg ignoring the list of packages it has already downloaded (since it now sees list_dir as var/lib/opkg instead of var/lib/opkg/lists) and thus it fails to install any of the "attemptonly" packages (including *-dev, *-dbg, etc.).

The question is, should opkg be fixed to not load anything from etc/opkg/ when 
-f is specified?
Comment 9 Paul Eggleton 2012-07-11 13:09:55 UTC
Let's keep this bug concentrated on the opkg issue alone, which is now fixed in master revision 06348fe76474a20e0fc2f2938919f782c3e5ae28; accordingly I've removed the bug relationships since this issue is self-contained.
Comment 10 Laurentiu Serban 2012-07-23 15:17:16 UTC
The "Unknown packages" messages in in log_do.rootfs disappeared,

although there are several packages not installed:

 'task-core-console-dev'.
 'task-core-standalone-sdk-target-dev'.
 'task-core-qt-dev'.
 'task-core-x11-dev'.     
 'task-core-ssh-dropbear-dev'.
Comment 11 Laurentiu Serban 2012-07-23 15:26:26 UTC
Reopening this as there is no error message or warning for not installing some of the packages on the INSTALL_PACKAGES_ATTEMPTONLY_IPK list.

Resetting importance to minor
Comment 12 Paul Eggleton 2012-07-23 15:45:12 UTC
Are those packages you list actually included in INSTALL_PACKAGES_ATTEMPTONLY_IPK?
Comment 13 Laurentiu Serban 2012-07-24 08:35:56 UTC
Yes.
They are included
I will attach the log.
Comment 14 Laurentiu Serban 2012-07-24 08:41:04 UTC
Created attachment 658 [details]
do_rootfs log
Comment 15 Paul Eggleton 2012-07-24 16:52:41 UTC
These packages genuinely do not exist, so it's expected that they cannot be installed. I suspect you will find after my rootfs patch series we won't even be attempting to install them since that introduces a check to see if the package is valid first.
Comment 16 Paul Eggleton 2012-07-26 14:58:44 UTC
Can we mark this as fixed again? AFAICT there is no issue here.
Comment 17 Paul Eggleton 2012-08-13 14:44:03 UTC
Marking as resolved again; if there is still an issue with do_rootfs taking the above comments into account, please reopen.
Comment 18 Laurentiu Serban 2012-08-18 18:46:45 UTC
Setting this to verified after the latest comments
Comment 19 Laurentiu Serban 2012-08-19 00:13:22 UTC
verified
Comment 20 Paul Eggleton 2012-08-19 16:38:33 UTC
*** Bug 2598 has been marked as a duplicate of this bug. ***