Many packages such as libraries, kernel modules, and the kernel itself can trigger many rebuilds of other packages even when they are not needed. A shared library that is rebuilt but has no interface changes will trigger rebuilds on all recipes that DEPENDS on it, even if it is not really needed. Could the populate_sysroot task somehow check a hash of the exported files to see whether dependent packages really need to rebuild?
We now have the hash equivalency server which addresses this problem.