Provide a way to automate testing of meta-mingw and meta-darwin layers. These two layers are officially supported by the Yocto project, but there are no automated tests (that I know of) that target these layers. Probably the most common usage of those meta layers are cross-compiled toolchains, so that would make them the prime candidates for automated testing.
An initial step towards automating testing of these layers is to have them integrated into a buildset and built on the autobuilder, thus at least testing the builds are successful. This is why the issue is filed against the autobuilder, which confused this reader on first reading this report. A future step may be to develop automated tests for them, but that should likely be a separate ticket. Note: the meta-darwin build is problematic. The layer requires files be extracted from a Mac OS SDK and we don't have permissions to distribute these files, therefore a meta-darwin build on the public autobuilder will be problematic.
for meta-darwin I'd consider using TravisCI for the tests. If you run it as an objective c test, you get an OSX environment. https://docs.travis-ci.com/user/languages/objective-c
https://www.appveyor.com/docs/running-tests/ can test windows instantiations.
I believe that meta-darwin and meta-mingw can be a target for creating tests for the 2.3 release. CC'ing QA so they can file the bugs as necessary. based on the description of meta-darwin and meta-mingw: OpenEmbedded meta layer for [darwin|mingw] based SDKs. The first approach could be to add oe-selftest cases to the layers then it should be decided whether to execute them along with the nightly-oe-selftest or create a separate one.
I'm moving out the meta-darwin piece into a separate bug as that's more complicated and requires access to a macOS install. See bug 10912. Adding a meta-mingw builder is much simpler and something we can easily provide for 2.3
I have an implementation of a minimal builder config which calls: $ bitbake core-image-sato core-image-minimal -c populate_sdk $ bitbake core-image-sato core-image-minimal -c testsdk I can't test it because of bug 10914
http://git.yoctoproject.org/cgit/cgit.cgi/yocto-autobuilder/commit/?id=ac756a4d94627692da2dd0fa9c523f8402a540f1
Dependent bug was closed after M2 rc1 had been built, moving this to M3
meta-mingw build added to nightly-qa-extras and deployed to both AB clusters: http://git.yoctoproject.org/clean/cgit.cgi/yocto-autobuilder/commit/?id=ac756a4d94627692da2dd0fa9c523f8402a540f1 http://git.yoctoproject.org/clean/cgit.cgi/yocto-autobuilder/commit/?id=e791185ce086dd9b48f0f006c7eab2da561aec7a http://git.yoctoproject.org/clean/cgit.cgi/yocto-autobuilder/commit/?id=7ff32480c118cf0f39db90bd6d47bd5819eed633