Bug 9727 - Add autobuilder support to publish sstate objects for releases
Summary: Add autobuilder support to publish sstate objects for releases
Status: VERIFIED FIXED
Alias: None
Product: AutoBuilder
Classification: Infrastructure
Component: autobuilder (show other bugs)
Version: 2.2
Hardware: x86 Multiple
: High enhancement
Target Milestone: 2.3 M1
Assignee: Joshua Lock
QA Contact: Juan Ramos
URL:
Whiteboard:
Depends on:
Blocks: 9596
  Show dependency tree
 
Reported: 2016-06-07 21:50 UTC by Bill Randle
Modified: 2017-03-14 18:22 UTC (History)
6 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: Don't know


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Bill Randle 2016-06-07 21:50:56 UTC
It would be useful and beneficial to the Yocto community to add support on the Autobuilder for building and publishing eSDK package artifacts.
Comment 1 Paul Eggleton 2016-06-08 04:37:39 UTC
I'm not quite sure what you mean here. We build the eSDK installer itself; as far as things you can install using devtool sdk-install, that's simply done from the shared state cache (or more precisely, a mirror set up via SSTATE_MIRRORS).
Comment 2 Bill Randle 2016-06-09 14:55:39 UTC
Yes, when I said packages earlier that was incorrect. What we want to create are SSTATE objects, as Paul indicated.
Comment 3 Joshua Lock 2016-09-28 22:41:21 UTC
The goal is to provide publicly usable sstate objects for consumption both by users of the project (eSDK and general builds) and for use by our automated QA.
Comment 4 Joshua Lock 2016-11-18 16:43:25 UTC
Brain dumping some thoughts:

We need to publish not only sstate objects generated by the build, but also sstate objects used by the build.

A slightly hacky approach would be that when the custom_release_me property is set we set up a separate, empty, SSTATE_DIR and set up an http mirror of the cluster's shared sstate directory. Then when any hits in the mirror are found they will be fetched to the new SSTATE_DIR and we can then publish the entire contents of that directory for the build.

The reason we would set up a http mirror, instead of using a file mirror, is because in the case of file mirrors files in the mirror aren't fetched/copied. It might be worth investigating file mirrors as a slightly cleaner approach.
Comment 5 Joshua Lock 2016-11-30 13:33:14 UTC
Implementation has begun on an approach which uses the autobuilders published sstate mirror with a per-release sstate directory.
Comment 7 Juan Ramos 2017-03-14 18:22:03 UTC
http://sstate.yoctoproject.org/dev/2.3/