Bug 10933

Summary: None-validated host distro such as debian-testing results in oe-selftest failures
Product: [Infrastructure] AutoBuilder Reporter: Joshua Lock <joshuagloe>
Component: autobuilderAssignee: Joshua Lock <joshuagloe>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: Medium+ CC: benjamin.esquivel, infras.ab.watcher, Infras.watcher, pidge, ross.burton
Version: 2.3   
Target Milestone: 2.3 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Joshua Lock 2017-01-17 09:57:37 UTC 
devtool and recipetool selftests both contain assertNotIn() calls which cause oe-selftest to fail if there's a WARNING in the commands output.

This results in a failure when running builds on the debian-testing worker on the autobuilder cluster because the non-versioned/rolling release Debian testing distro isn't listed in SANITY_TESTED_DISTROS and therefore emits a warning from sanity.bbclass:

WARNING: Host distribution "debian" has not been validated with this version of the build system; you may possibly experience unexpected failures. It is recommended that you use a tested distribution.

If we really don't want oe-selftest to run on distros which aren't in SANITY_TESTED_DISTROS we should make oe-selftest check and warn/error for this up front, otherwise we should hack the whitelist so the tests don't fail.
Comment 1 Ross Burton 2017-01-17 10:56:31 UTC 
I think the selftest buildset should set SANITY_TESTED_DISTROS="".
Comment 2 Benjamin Esquivel 2017-01-17 14:27:39 UTC 
Perhaps the tested distros list is outdated, I get the same error for F25 and it should be white-listed as it is tested:


https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest

See the buildslaves list.
Comment 3 Benjamin Esquivel 2017-01-19 17:38:04 UTC 
(In reply to comment #2)
> Perhaps the tested distros list is outdated, I get the same error for F25
> and it should be white-listed as it is tested:
> 
> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest
> 
> See the buildslaves list.

I refrain from this comment, the right way to go is to ignore the sanity tested distros, now the question for me is whether this is ignored on request or by default.