Bug 7105 - Error reporting class fails with large log file or long line
Summary: Error reporting class fails with large log file or long line
Status: RESOLVED FIXED
Alias: None
Product: Error Reporting tool
Classification: Yocto Project Subprojects
Component: Error Reporting Tool (show other bugs)
Version: unspecified
Hardware: x86 Multiple
: Medium normal
Target Milestone: 1.8
Assignee: Michael Wood
QA Contact:
URL:
Whiteboard:
Depends on:
Blocks:
 
Reported: 2014-12-24 21:59 UTC by Saul Wold
Modified: 2015-03-27 14:45 UTC (History)
0 users

See Also:
OS type for building Yocto: ---
Type of Regression: ---
Verified:
Documentation change: No (bug/feature does not impact docs)


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description Saul Wold 2014-12-24 21:59:25 UTC
This world build had a qt4 failure with long lines and large log.

https://autobuilder.yoctoproject.org/main/builders/nightly-world/builds/140/steps/BuildImages/logs/stdio

ERROR: Execution of event handler 'errorreport_handler' failed
Traceback (most recent call last):
  File "errorreport_handler(e)", line 34, in errorreport_handler(e=<bb.event.BuildCompleted object at 0x7fa62c0dfc50>) **Excluded longline**

             if end != len(s):
    >            raise ValueError(errmsg("Extra data", s, end, len(s)))
             return obj
ValueError: Extra data: line 16 column 2 - line 24 column 2 (char 33262895 - 33502606)
Comment 1 Paul Eggleton 2015-01-29 15:20:27 UTC
That failure log is egregiously long - even the build log containing the (truncated) JSON is 207MB. We should deal with this, but I don't expect to see this too often so I'm downgrading the priority accordingly.

I've just discussed this with Michael W, it looks like we might be hitting a limitation in the body size for HTTP requests and therefore the JSON error data is being truncated. There might be some workarounds but it might be that logs this large just aren't useful anyway, and we should make an attempt to prevent them from being uploaded or at the very least prevent send-error-report from blindly uploading them.
Comment 2 Michael Wood 2015-03-27 14:45:23 UTC
openembedded-core 5e036f3fd9caaedcd2759214766b3228299e929b

    - Add feature to check the server's max_log_size