Bug 14345 - Autobuilder rebuild button doesn't always work when using shared repos
Summary: Autobuilder rebuild button doesn't always work when using shared repos
Status: NEW
Alias: None
Product: AutoBuilder
Classification: Infrastructure
Component: autobuilder (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium normal
Target Milestone: 6.99
Assignee: Unassigned
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2021-04-14 22:43 UTC by Alejandro
Modified: 2026-02-19 16:23 UTC (History)
8 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Alejandro 2021-04-14 22:43:07 UTC
The Unpack shared repositories step fails to copy the poky repo, it isnt able to find the directory: /srv/autobuilder/repos/a-full-2038

It only failed on the beaglebone-alt build (on two different servers, Ubuntu 1604 and Tumbleweed):

https://autobuilder.yoctoproject.org/typhoon/#/builders/106/builds/2219
https://autobuilder.yoctoproject.org/typhoon/#/builders/106/builds/2218

Hard to tell why such directory was unavailable at the time, or if it will happen again, but seemed okay to report it.


====================================================================================================
Copying in repo poky (1618170463.3)
====================================================================================================
rsync: [sender] change_dir "/srv/autobuilder/repos/a-full-2038" failed: No such file or directory (2)
rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1330) [sender=3.2.3]
Traceback (most recent call last):
  File "/home/pokybuild/yocto-worker/beaglebone-alt/yocto-autobuilder-helper/scripts/shared-repo-unpack", line 57, in <module>
    subprocess.check_call(["rsync", "-a", "%s/%s" % (args.cache_dir, repo), targetsubdir])
  File "/usr/lib64/python3.8/subprocess.py", line 364, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['rsync', '-a', '/srv/autobuilder/repos/a-full-2038/poky', '/home/pokybuild/yocto-worker/beaglebone-alt/build/repos']' returned non-zero exit status 23.
Comment 1 Randy MacLeod 2021-04-15 14:40:56 UTC
Can be avoided by forcing a build rather than hitting the rebuild button.
Comment 2 Jon Mason 2021-05-20 13:44:35 UTC
Seen again on
https://autobuilder.yoctoproject.org/typhoon/#/builders/110/builds/2336/steps/6/logs/stdio
qemuarm-alt
debian10-ty-3
Comment 3 Richard Purdie 2021-11-04 13:35:19 UTC
Issue is from the conditional in http://git.yoctoproject.org/cgit.cgi/yocto-autobuilder-helper/tree/scripts/shared-repo-unpack#n53

When the build completes, the sources are removed as otherwise the can pile up unbounded on the shared storage.

One simple fix would be for the code to check if the sources are there and then just checkout sources again if not. The worry is whether a "rebuild" could/would then rebuild something different and confuse the user?
Comment 4 Randy MacLeod 2023-10-24 14:24:21 UTC
Bulk move from 4.99 or 0.00 to 5.99
Comment 5 Richard Purdie 2026-02-19 16:22:46 UTC
We believe the sources cache files are not being deleted which avoids this bug but creates a maintenance issue for cleaning them up