15169 2023-07-22 11:25:12 +0000 devtool modify of linux kernel with cfg files in subdirectories fails and tries to copy cfg file 2026-07-03 11:12:55 +0000 1 1 7 Build System, Metadata & Runtime OE-Core Scripts and Tools unspecified x86 Multiple RESOLVED FIXED Medium normal 6.1 1 bbergquist sivakumar.bs bruce.ashfield ccasciato randy.macleod ross.burton sivakumar.bs --- --- No (bug/feature does not impact docs) oldest_to_newest 96019 0 bbergquist 2023-07-22 11:25:12 +0000 This is with the kirkstone Yocto release. The kernel recipe has --- FILESEXTRAPATHS:prepend := "${THISDIR}/${PN}:${THISDIR}/${PN}/cfg:${THISDIR}/${PN}/bsp:${THISDIR}/${PN}/patches:" --- and --- SRC_URI:append = " file://cp-config.scc" SRC_URI:append = " file://apl-spi-001.cfg" SRC_URI:append = " file://cp-clock.cfg" --- These cfg files are within the 'cfg' subdirectory. Within 'standard.py' we have in 'modify' --- for key in local_files.copy(): if key.endswith('scc'): sccfile = open(local_files[key], 'r') for l in sccfile: line = l.split() if line and line[0] in ('kconf', 'patch'): cfg = os.path.join(os.path.dirname(local_files[key]), line[-1]) if not cfg in local_files.values(): local_files[line[-1]] = cfg shutil.copy2(cfg, workdir) sccfile.close() --- This opens and reads the 'scc' file and then computes a path to the 'cfg' file based upon the directory of the 'scc' file. In this case, the 'scc' file is in a subdirectory called 'bsp' and the 'cfg' file is in a simply subdirectory called 'cfg'. This then fails to copy the 'cfg' file and reports a file not found error. --- Parsing recipes: 100% |####################################################################################################################################################################| Time: 0:00:23 Parsing of 2832 .bb files complete (0 cached, 2832 parsed). 4341 targets, 95 skipped, 3 masked, 0 errors. INFO: Mapping virtual/kernel to linux-canoga Traceback (most recent call last): File "/home/brett/yocto/layers/poky/scripts/devtool", line 338, in <module> ret = main() File "/home/brett/yocto/layers/poky/scripts/devtool", line 325, in main ret = args.func(args, config, basepath, workspace) File "/home/brett/yocto/layers/poky/scripts/lib/devtool/standard.py", line 852, in modify shutil.copy2(cfg, workdir) File "/usr/lib/python3.8/shutil.py", line 435, in copy2 copyfile(src, dst, follow_symlinks=follow_symlinks) File "/usr/lib/python3.8/shutil.py", line 264, in copyfile with open(src, 'rb') as fsrc, open(dst, 'wb') as fdst: FileNotFoundError: [Errno 2] No such file or directory: '/home/brett/yocto/layers/meta-canoga-bsp/recipes-kernel/linux/linux-canoga/bsp/cp-clock.cfg' brett@brett-Precision-7740:~/yocto/builds/tsx-dev_build (tsx-dev) $ --- The 'local_files' has the complete absolute path to the local 'cfg' file. It would seem to me that if the path to the 'cfg' is absolute and the file exists at that location, we can simply skip trying to copy the 'cfg' this way. 96020 1 bbergquist 2023-07-22 11:29:05 +0000 Maybe we should just copy the absolute file? 96126 2 randy.macleod 2023-07-27 14:42:04 +0000 Hi Brett, Does this occur on the master branch as well? Are you interested in working to fix it, given some advice? Randy for the YP triage group. 96131 3 bbergquist 2023-07-27 16:17:46 +0000 If by master branch, we are talking about the poky layer, I will try that and report back. I am willing to fix the issue, but I am struggling a little on what the section of code conceptually is trying to do. What I see earlier in the code is that all of the local files (represented by the dictionary 'local_files') have already been resolved to absolute paths. So in local_files we have a key and absolute path value. The code in question is opening the 'scc' file that lists the kernel config files and the references in there could be just a file name. I am assuming that this was trying to do was to take the relative filename and then produce a absolute path to the file relative to the path of the 'scc' file. I have worked around locally by checking to see if the relative filename refrences a file in the 'local_files' and if the value is an absolute path, this is used as the path to the kernel configuration file and copy that file instead of a computed path relative to the directory of the 'scc' file. This is working locally and I can supply a patch for consideration. 96193 4 randy.macleod 2023-08-03 19:55:15 +0000 Brett, You seem to be on the right track. Please send the change you have so far to the list to get some feedback and/or to have it merged as a step along the path. Thanks! 96206 5 4968 bbergquist 2023-08-08 13:04:52 +0000 Created attachment 4968 Patch to look for local full patch config files This is what I have locally. The patch first gets the config file path from the 'local_files' dictionary. If then checks to see if the path for the config file is absolute and if so it uses that path. If not, it does what the code currently does and computes the path relative to the 'scc' file path. This works but I am not confident that this is the correct direction as I have not spent enough time to completely understand what is trying to be done. 97905 6 randy.macleod 2024-01-18 16:23:46 +0000 Bruce or someone else may take a look but if not, please send the patch as an RFC to the oe-core list. 99062 7 randy.macleod 2024-05-23 15:09:43 +0000 Changes to workdir on master may have fix this problem since there are no longer copies being made. Please check. 100091 8 randy.macleod 2024-10-31 15:09:24 +0000 Bulk move of 5.1 bugs to 5.2. -- YP bug review (Randy) 102099 9 randy.macleod 2025-05-29 16:08:03 +0000 Moving to 5.3. Brett do you hope to have time to work on this bug? 104428 10 randy.macleod 2026-02-26 16:22:11 +0000 Brett I'm moving this to unassigned so take it back if you find time. If you want to help someone else, I think a simpler reproducer may be needed but I'm skimming this during a meeting so maybe not. 105910 11 sivakumar.bs 2026-06-18 09:30:03 +0000 The original failure no longer reproduces on master — the code that computed the .cfg path from the .scc file's directory was removed in ce8190c519 ("devtool: Drop oe-local-files and simplify"), confirming Randy's Comment 7. To lock this in I wrote an oe-selftest regression test (test_devtool_modify_kernel_cfg_subdirs). Verified it FAILS on the pre-fix tree (d9328e3b0b) with the exact reported FileNotFoundError (copying .cfg from the .scc's bsp/ dir instead of cfg/) and PASSES on current master. Sent to the oe-core list: Suggest resolving once the test merges. https://patchwork.yoctoproject.org/project/oe-core/patch/20260618091736.2319572-1-sivakumar.bs@gmail.com/ 106093 12 sivakumar.bs 2026-07-03 11:12:55 +0000 https://git.openembedded.org/openembedded-core/commit/?id=716a14b7b5e468dd7e9f90647188684a1be931cc 4968 2023-08-08 13:04:52 +0000 2023-08-08 13:04:52 +0000 Patch to look for local full patch config files standard.py.patch text/plain 936 bbergquist ZGlmZiAtLWdpdCBhL3NjcmlwdHMvbGliL2RldnRvb2wvc3RhbmRhcmQucHkgYi9zY3JpcHRzL2xp Yi9kZXZ0b29sL3N0YW5kYXJkLnB5CmluZGV4IGUyYTgzMzVhNjIuLjE0N2FjMDE1MzQgMTAwNjQ0 Ci0tLSBhL3NjcmlwdHMvbGliL2RldnRvb2wvc3RhbmRhcmQucHkKKysrIGIvc2NyaXB0cy9saWIv ZGV2dG9vbC9zdGFuZGFyZC5weQpAQCAtODQ2LDcgKzg0Niw5IEBAIGRlZiBtb2RpZnkoYXJncywg Y29uZmlnLCBiYXNlcGF0aCwgd29ya3NwYWNlKToKICAgICAgICAgICAgICAgICAgICAgICAgIGZv ciBsIGluIHNjY2ZpbGU6CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgbGluZSA9IGwuc3Bs aXQoKQogICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlmIGxpbmUgYW5kIGxpbmVbMF0gaW4g KCdrY29uZicsICdwYXRjaCcpOgotICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjZmcg PSBvcy5wYXRoLmpvaW4ob3MucGF0aC5kaXJuYW1lKGxvY2FsX2ZpbGVzW2tleV0pLCBsaW5lWy0x XSkKKyAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgY2ZnID0gbG9jYWxfZmlsZXNbbGlu ZVstMV1dCisgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGlmIG5vdCBvcy5wYXRoLmlz YWJzKGNmZyk6CisgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBjZmcgPSBvcy5w YXRoLmpvaW4ob3MucGF0aC5kaXJuYW1lKGxvY2FsX2ZpbGVzW2tleV0pLCBsaW5lWy0xXSkKICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgaWYgbm90IGNmZyBpbiBsb2NhbF9maWxlcy52 YWx1ZXMoKToKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGxvY2FsX2ZpbGVz W2xpbmVbLTFdXSA9IGNmZwogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc2h1 dGlsLmNvcHkyKGNmZywgd29ya2RpcikK