Bug 13991

Summary: cve_check fails
Product: [Build System, Metadata & Runtime] OE-Core Reporter: Matthias Schoepfer <matthias.schoepfer>
Component: oe-core otherAssignee: akuster <akuster808>
Status: CLOSED FIXED QA Contact:
Severity: major    
Priority: Medium+ CC: akuster808, randy.macleod
Version: 3.1.2   
Target Milestone: 3.2 M3   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Matthias Schoepfer 2020-07-28 07:44:02 UTC
Since this Sunday (July, 26), cve_check fails with:
ERROR: cve-update-db-native-1.0-r0 do_populate_cve_db: Error executing a python function in exec_python_func() autogenerated:

The stack trace of python calls that resulted in this exception/failure was:
File: 'exec_python_func() autogenerated', lineno: 2, function: <module>
     0001:
 *** 0002:do_populate_cve_db(d)
     0003:
File: '/home/mschoepf/ithinx/git/sa171s-yocto-main/poky/meta/recipes-core/meta/cve-update-db-native.bb', lineno: 97, function: do_populate_cve_db
     0093:            # Update db with current year json file
     0094:            try:
     0095:                response = urllib.request.urlopen(json_url)
     0096:                if response:
 *** 0097:                    update_db(c, gzip.decompress(response.read()).decode('utf-8'))
     0098:                c.execute("insert or replace into META values (?, ?)", [year, last_modified])
     0099:            except urllib.error.URLError as e:
     0100:                cve_f.write('Warning: CVE db update error, CVE data is outdated.\n\n')
     0101:                bb.warn("Cannot parse CVE data (%s), update failed" % e.reason)
File: '/home/mschoepf/ithinx/git/sa171s-yocto-main/poky/meta/recipes-core/meta/cve-update-db-native.bb', lineno: 182, function: update_db
     0178:
     0179:        cveId = elt['cve']['CVE_data_meta']['ID']
     0180:        cveDesc = elt['cve']['description']['description_data'][0]['value']
     0181:        date = elt['lastModifiedDate']
 *** 0182:        accessVector = elt['impact']['baseMetricV2']['cvssV2']['accessVector']
     0183:        cvssv2 = elt['impact']['baseMetricV2']['cvssV2']['baseScore']
     0184:
     0185:        try:
     0186:            cvssv3 = elt['impact']['baseMetricV3']['cvssV3']['baseScore']
Exception: KeyError: 'baseMetricV2'

ERROR: Logfile of failure stored in: /home/mschoepf/yocto/sa171-dunfell/builddir/tmp-glibc/work/x86_64-linux/cve-update-db-native/1.0-r0/temp/log.do_populate_cve_db.3664076
ERROR: Task (/home/mschoepf/ithinx/git/sa171s-yocto-main/poky/meta/recipes-core/meta/cve-update-db-native.bb:do_populate_cve_db) failed with exit code '1'


When on master, everything works. When applying fca05777a49411e07c2277d6e171419b4e831717, effects are mitigated to:
(Might have to do with multiconfig build?!)

ERROR: Execution of event handler 'cve_save_summary_handler' failed
Traceback (most recent call last):
  File "/home/mschoepf/ithinx/git/sa171s-yocto-main/poky/meta/classes/cve-check.bbclass", line 65, in cve_save_summary_handler(e=<bb.event.BuildCompleted object at 0x7f647de6d790>):
     
    >    shutil.copyfile(cve_tmp_file, cve_summary_file)
     
  File "/usr/lib/python3.7/shutil.py", line 120, in copyfile(src='/home/mschoepf/yocto/sa171-dunfell/builddir/tmp-glibc/cve_check', dst='/home/mschoepf/yocto/sa171-dunfell/builddir/tmp-glibc/log/cve/cve-summary-20200728163805.txt', follow_symlinks=True):
         else:
    >        with open(src, 'rb') as fsrc:
                 with open(dst, 'wb') as fdst:
FileNotFoundError: [Errno 2] No such file or directory: '/home/mschoepf/yocto/sa171-dunfell/builddir/tmp-glibc/cve_check'


Summary: There was 1 ERROR message shown, returning a non-zero exit code.
Comment 3 akuster 2020-09-17 08:00:48 UTC
.