Bug 11107

Yes, please update documentation.  We are always fetching uninative tarball from downloads.yoctoproject.org and need to know how to set it up to use local mirrors if the tarball is available.

Hi, 

Here is the SSTATE_MIRRORS description in the glossary: https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-SSTATE_MIRRORS.

Here is a section on the uninative.bbclass: https://yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#ref-classes-uninative

Here is the NATIVELSBSTRING variable description in the glossary: https://yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#var-NATIVELSBSTRING

I need some help understanding what an example would look like in local.conf that shows how to map a developer machine's NATIVELSBSTRING to the one that matches what the server provides.  For example, what would SSTATE_MIRRORS and NATIVELSBSTRING need to be set for and why?  I need further explanation. 

Thanks,
Scott

(In reply to comment #2)
> Hi, 
> 
> Here is the SSTATE_MIRRORS description in the glossary:
> https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-
> SSTATE_MIRRORS.
> 
> Here is a section on the uninative.bbclass:
> https://yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#ref-classes-
> uninative
> 
> Here is the NATIVELSBSTRING variable description in the glossary:
> https://yoctoproject.org/docs/2.6/mega-manual/mega-manual.html#var-
> NATIVELSBSTRING
> 
> I need some help understanding what an example would look like in local.conf
> that shows how to map a developer machine's NATIVELSBSTRING to the one that
> matches what the server provides.  For example, what would SSTATE_MIRRORS
> and NATIVELSBSTRING need to be set for and why?  I need further explanation. 
> 
> Thanks,
> Scott

I don't know why this problem is assigned to me?  I try following the instructions and it doesn't work. Here is was I set:

# Set DL_DIR to a directory outside the project so it can be shared betwen multiple builds.
# All you need to do is checkout all your source trees parallel to eachother
# and this relative path will work
DL_DIR ?= "${TOPDIR}/../../../yocto-cache/downloads"

# Ensure DL_DIR generates tarballs for git repos otherwise yocto will always
# fetch them. This is disabled by default.
BB_GENERATE_MIRROR_TARBALLS = "1"

# Set SSTATE_DIR to a directory outside the project so it can be shared betwen multiple builds.
# All you need to do is checkout all your source trees parallel to eachother
# and this relative path will work
SSTATE_DIR ?= "${TOPDIR}/../../../yocto-cache/sstate-cache"

# We transfer the sstate-cache to a filer so others can access
SSTATE_MIRRORS ?= "\
file://.* file:///projects/ccxsw/yocto/mirror/sstate-cache/PATH"
# And copy the DL_DIR to the filer as well
PREMIRRORS_prepend = "\
git://svcccxswgit@git-ccxsw.rtp.broadcom.com/ git://svcccxswgit@git-ccxsw.rtp.broadcom.com/ \n \
file://.*     file:///projects/ccxsw/yocto/mirror/sources \n \
bzr://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
cvs://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
git://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
gitsm://.*/.* file:///projects/ccxsw/yocto/mirror/sources \n \
hg://.*/.*    file:///projects/ccxsw/yocto/mirror/sources \n \
osc://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
p4://.*/.*    file:///projects/ccxsw/yocto/mirror/sources \n \
svn://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
ftp://.*/.*   file:///projects/ccxsw/yocto/mirror/sources \n \
http://.*/.*  file:///projects/ccxsw/yocto/mirror/sources \n \
https://.*/.* file:///projects/ccxsw/yocto/mirror/sources \n"



EVERYTHING else is fetched properly from the PREMIRRORS.

uninative is fetched outside the first time.  It doesn't pick it up from the PREMIRROR.  But then once it's fetched it does pick it up from the DL_DIR.  So to reproduce you need to make sure you delete it from the DL_DIR.

How do we set UNINATIVE_URL and UNINATIVE_CHECKSUM so uninative is fetched from the PREMIRROR.  Can't figure it out.  Nor why it simply isn't using the uninative prepend.

My original request is only about SSTATE_MIRRORs. If a user wants to use server provided native sstate artifacts, one would need to configure SSTATE_MIRROR regexp so that local search paths get mapped to server provided paths taking the GCC versions into account. This is not mentioned in the documentation.

In my case, it was:
file://universal-4.9/(.*) http://<SERVER_URL_SSTATE_PATH>/universal-4.8/\1 \n 

(the real private URL changed to <SERVER_URL_SSTATE_PATH>)

Mikko, 

See https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-SSTATE_MIRRORS for an addition to try and cover your initial issue regarding SSTATE_MIRRORS.  I am not confident on how I explained the example or even showed the example.  Please correct me there.

Thanks,
Scott

@Scott Brandon:  The reason you temporarily were assigned the bug is because when I saw it, I changed the status to "NEEDINFO" to get more information on how to describe the fix in the docs.  When a but goes to "NEEDINFO", the triage team will look for an "expert" to re-assign the bug to.  They probably grabbed your name as it was the most recent detailed comment. 

Scott

(In reply to comment #5)
> Mikko, 
> 
> See
> https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-
> SSTATE_MIRRORS for an addition to try and cover your initial issue regarding
> SSTATE_MIRRORS.  I am not confident on how I explained the example or even
> showed the example.  Please correct me there.


Perhaps change the first sentence to something like:

When pointing to sstate build artifacts on another machine that uses different GCC version for native builds, SSTATE_MIRROR must be configured with a regular expression that maps local search paths to paths.

Mikko, 

Thanks for the comment.  See https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-SSTATE_MIRRORS.  I just changed your suggested wording a bit to make it more active sentence to conform with the YP document writing style.

Let me know if all is good.

Thanks, 
Scott

This "The server paths must take into account the GCC versions." could be "The paths need to take into account NATIVELSBSTRING set by uninative.bbclass." (with appropriate anchors)

Ok Mikko - see https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-SSTATE_MIRRORS and let me know.

Thanks,
Scott

"with appropriate anchors" tried to say that make the keywords links (like you did). It does not belong in the description.

Haha - ok.  I should have known that.  I thought it was something special about the pathnames :)

See https://yoctoproject.org/docs/2.6/ref-manual/ref-manual.html#var-SSTATE_MIRRORS

Setting to RESOLVED and putting the doc flag to "done."

Scott