Bug 10933 - None-validated host distro such as debian-testing results in oe-selftest failures
Summary: None-validated host distro such as debian-testing results in oe-selftest fail...
Status: RESOLVED FIXED
Alias: None
Product: AutoBuilder
Classification: Infrastructure
Component: autobuilder (show other bugs)
Version: 2.3
Hardware: x86 Multiple
: Medium+ normal
Target Milestone: 2.3 M2
Assignee: Joshua Lock
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2017-01-17 09:57 UTC by Joshua Lock
Modified: 2017-12-06 17:25 UTC (History)
5 users (show)

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)

Attachments
Add an attachment (proposed patch, testcase, etc.)

Note You need to log in before you can comment on or make changes to this bug.
Description Joshua Lock 2017-01-17 09:57:37 UTC 
devtool and recipetool selftests both contain assertNotIn() calls which cause oe-selftest to fail if there's a WARNING in the commands output.

This results in a failure when running builds on the debian-testing worker on the autobuilder cluster because the non-versioned/rolling release Debian testing distro isn't listed in SANITY_TESTED_DISTROS and therefore emits a warning from sanity.bbclass:

WARNING: Host distribution "debian" has not been validated with this version of the build system; you may possibly experience unexpected failures. It is recommended that you use a tested distribution.

If we really don't want oe-selftest to run on distros which aren't in SANITY_TESTED_DISTROS we should make oe-selftest check and warn/error for this up front, otherwise we should hack the whitelist so the tests don't fail.
Comment 1 Ross Burton 2017-01-17 10:56:31 UTC 
I think the selftest buildset should set SANITY_TESTED_DISTROS="".
Comment 2 Benjamin Esquivel 2017-01-17 14:27:39 UTC 
Perhaps the tested distros list is outdated, I get the same error for F25 and it should be white-listed as it is tested:


https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest

See the buildslaves list.
Comment 3 Benjamin Esquivel 2017-01-19 17:38:04 UTC 
(In reply to comment #2)
> Perhaps the tested distros list is outdated, I get the same error for F25
> and it should be white-listed as it is tested:
> 
> 
> https://autobuilder.yoctoproject.org/main/builders/nightly-oe-selftest
> 
> See the buildslaves list.

I refrain from this comment, the right way to go is to ignore the sanity tested distros, now the question for me is whether this is ignored on request or by default.