Bug 13977

Summary: Performance builds are failing in the html email generation code
Product: [Infrastructure] AutoBuilder Reporter: Richard Purdie <richard.purdie>
Component: autobuilderAssignee: Trevor Gamblin <tvgamblin>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: High CC: infras.ab.watcher, Infras.watcher, pidge, randy.macleod
Version: 3.1   
Target Milestone: 3.2 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)
Attachments:
Description Flags
One of the failing html files
none
A report from the last build which passed, which now also fails none

Description Richard Purdie 2020-07-09 07:25:18 UTC
Both performance testing workers are now failing in the html email graph generation code.

https://autobuilder.yoctoproject.org/typhoon/#/builders/91/builds/2971
https://autobuilder.yoctoproject.org/typhoon/#/builders/92/builds/2983

Its happening on multiple branches/releases, all fail.

The code in question takes the google chart JS and renders it using phangomJS into png images which can be included via email for the reports.

Can be reproduced on the workers with:

home/pokybuild/yocto-worker/buildperf-ubuntu1604/yocto-autobuilder-helper/scripts/oe-build-perf-report-email.py --to 'yocto-perf@lists.yoctoproject.org' --subject 'Build Perf Test Report for Ubuntu 16.04.5 LTS' --html perf-ubuntu1604_master_20200709095602_968fcf4989.html
Comment 1 Richard Purdie 2020-07-09 09:56:11 UTC
Created attachment 4702 [details]
One of the failing html files
Comment 2 Richard Purdie 2020-07-09 09:56:48 UTC
Created attachment 4703 [details]
A report from the last build which passed, which now also fails
Comment 3 Trevor Gamblin 2020-07-10 10:55:55 UTC
Builds are passing today. Maybe just a hiccup in the Google Charts API?
Comment 4 Richard Purdie 2020-07-13 08:14:45 UTC
Yes, going to assume this was some issue on google's side which is now fixed. Am a bit worried we're reliant on that though.