Bug 11546

Summary:	oe-build-perf-report: implement thresholds for measurement results
Product:	[Build System, Metadata & Runtime] OE-Core	Reporter:	Markus Lehtonen <markus.lehtonen>
Component:	Scripts and Tools	Assignee:	Unassigned <unassigned>
Status:	NEW ---	QA Contact:
Severity:	enhancement
Priority:	Medium	CC:	markus.lehtonen, randy.macleod, richard.purdie, ross.burton
Version:	2.4
Target Milestone:	Future
Hardware:	x86
OS:	Multiple
Whiteboard:
OS type for building Yocto:	---	Type of Regression:	---
Verified:		Documentation change:	No (bug/feature does not impact docs)

Description Markus Lehtonen 2017-05-19 08:49:56 UTC

It would be useful to have configurable thresholds for measurement results. Both absolute and relative thresholds should be supported. If the result (mean) would exceed the threshold it would be noted in the report. HTML report coloring would probably be adjusted so that only results exceeding the threshold would be colored red/green.

Exceeding a threshold would also be reflected in the return value of the script. This way, the script could be used in bisecting possible regressions.