| Summary: | testimage: allow runtime tests to trigger installation of packages | ||
|---|---|---|---|
| Product: | [QA/Testing] Runtime Testing | Reporter: | Paul Eggleton <bluelightning> |
| Component: | testimage | Assignee: | Unassigned <unassigned> |
| Status: | RESOLVED WONTFIX | QA Contact: | |
| Severity: | enhancement | ||
| Priority: | Medium+ | CC: | apoorv.sangal, randy.macleod, richard.purdie, TicoTimo, tim.orling |
| Version: | unspecified | ||
| Target Milestone: | Future | ||
| Hardware: | x86 | ||
| OS: | Multiple | ||
| Whiteboard: | |||
| OS type for building Yocto: | --- | Type of Regression: | --- |
| Verified: | Documentation change: | Yes (doc changes required) | |
|
Description
Paul Eggleton
2019-09-25 21:02:55 UTC
One part I missed: it is to be assumed that the configuration of the package manager in the image (i.e. to be able to access the package feed) is done externally, i.e. it's already set up when testimage comes to install the packages. I want to state for the record that this adds a ton of extra dimensions to testing and I'm very nervous about testsing automatically attempting "magic" installation of packages. For example does a given image have enough space? We're struggling as a project to triage and fix problems with the existing tests as nobody is stepping up. Adding these extra dimensions to tests is therefore something which gives me serious worries. Is this going ahead? I am not working on this. I have to agree with Richard on this one. The motivation and intent is understandable, but this could rapidly turn into a nightmare. The test frameworks that assume they are running on a standard desktop distribution and have access to the internet to download and install new dependencies are...perhaps of questionable design, especially in our context. A different approach, such as improved discovery of dependencies in the tests themselves (via devtool or build-time) or improved handling of missing run-time dependency reporting (like the error messages for SRC_URI checksums which basically tell you what to paste into recipe) would be more generally useful. |