Bug 16089

Summary: send qa email: No reference found for commit xxx (resulttool, regression report)
Product: [QA/Testing] Tooling Reporter: Mathieu Dubois-Briand <mathieu.dubois-briand>
Component: toolingAssignee: Paul Barker <paul>
Status: RESOLVED FIXED QA Contact:
Severity: normal    
Priority: High CC: paul, randy.macleod, richard.purdie
Version: unspecified   
Target Milestone: 6.0 M1   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: No (bug/feature does not impact docs)

Description Mathieu Dubois-Briand 2025-12-05 10:26:13 UTC
We got this on all a-full builds on master since yesterday, it look like this is not an AB-INT.

====================================================================================================
Processing regression report (1764908143.7)
====================================================================================================

INFO: Generating regression report between uninative-5.0 and master
INFO: Comparing master to uninative-5.0
INFO: Compute regression report between uninative-5.0 and master
INFO: SHA-1 revision for uninative-5.0 in /srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core is 58558b97c157469f060bb2ad59a40254fb6181e4
INFO: SHA-1 revision for master in /srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core is 293edd0d3d077d0fde7ba6671dc9a26d5b4cf5e4
INFO: Fetching test results for 58558b97c157469f060bb2ad59a40254fb6181e4 in /tmp/sendqaemail.7t7ulury
Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core/scripts/yocto_testresults_query.py", line 126, in <module>
    ret =  main()
           ^^^^^^
  File "/srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core/scripts/yocto_testresults_query.py", line 122, in main
    args.func(args)
  File "/srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core/scripts/yocto_testresults_query.py", line 89, in regression
    basebranch = fetch_testresults(workdir, baserevision)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core/scripts/yocto_testresults_query.py", line 50, in fetch_testresults
    raise Exception(f"No reference found for commit {sha1} in {workdir}")
Exception: No reference found for commit 58558b97c157469f060bb2ad59a40254fb6181e4 in /tmp/sendqaemail.7t7ulury
ERROR: Error while generating regression report: Command '['/srv/pokybuild/yocto-worker/a-full/build/layers/openembedded-core/scripts/yocto_testresults_query.py', 'regression-report', 'uninative-5.0', 'master', '-t', '/tmp/sendqaemail.7t7ulury']' returned non-zero exit status 1.
Comment 1 Mathieu Dubois-Briand 2025-12-05 10:26:38 UTC
a-full ubuntu2404-vk-3 master completed at 2025-12-04 07:09:42+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2819/steps/37/logs/stdio

a-full stream9-vk-1 master completed at 2025-12-04 10:17:42+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2820/steps/37/logs/stdio

a-full ubuntu2204-vk-3 master completed at 2025-12-04 11:28:13+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2821/steps/37/logs/stdio

a-full ubuntu2404-vk-2 master completed at 2025-12-05 04:15:47+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2825/steps/37/logs/stdio
Comment 2 Mathieu Dubois-Briand 2025-12-08 10:17:59 UTC
a-full fedora40-vk-4 master completed at 2025-12-06 04:16:20+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2829/steps/37/logs/stdio

a-full fedora40-vk-3 master completed at 2025-12-07 04:05:51+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2832/steps/37/logs/stdio

a-full ubuntu2404-vk-2 master completed at 2025-12-08 04:15:59+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2833/steps/37/logs/stdio
Comment 3 Mathieu Dubois-Briand 2025-12-09 08:46:49 UTC
a-full alma8-vk-2 master completed at 2025-12-09 08:44:02+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2834/steps/39/logs/stdio
Comment 4 Mathieu Dubois-Briand 2025-12-12 12:14:17 UTC
a-full ubuntu2204-vk-3 master completed at 2025-12-10 04:00:21+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2838/steps/37/logs/stdio

a-full alma8-vk-1 master completed at 2025-12-12 04:27:00+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2848/steps/39/logs/stdio
Comment 5 Mathieu Dubois-Briand 2025-12-15 13:11:36 UTC
a-full debian12-vk-5 master completed at 2025-12-13 04:17:40+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2855/steps/37/logs/stdio

a-full rocky8-vk-1 master completed at 2025-12-14 04:00:54+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2857/steps/39/logs/stdio
Comment 6 Mathieu Dubois-Briand 2025-12-16 12:12:17 UTC
a-full ubuntu2204-vk-1 master completed at 2025-12-15 23:41:43+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2860/steps/37/logs/stdio
Comment 7 Mathieu Dubois-Briand 2025-12-17 13:06:50 UTC
a-full fedora41-vk-1 master completed at 2025-12-17 04:22:16+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2869/steps/37/logs/stdio
Comment 8 Mathieu Dubois-Briand 2025-12-18 15:53:33 UTC
a-full debian12-vk-8 master completed at 2025-12-18 04:14:21+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2878/steps/37/logs/stdio
Comment 9 Mathieu Dubois-Briand 2025-12-19 08:26:52 UTC
a-full debian12-vk-9 master completed at 2025-12-19 04:21:18+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2887/steps/37/logs/stdio
Comment 10 Mathieu Dubois-Briand 2025-12-22 09:28:32 UTC
a-full ubuntu2510-vk-1 master completed at 2025-12-20 04:14:25+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2895/steps/37/logs/stdio

a-full rocky9-vk-2 master completed at 2025-12-21 04:19:36+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2898/steps/37/logs/stdio

a-full ubuntu2510-vk-1 master completed at 2025-12-22 04:14:43+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2903/steps/37/logs/stdio
Comment 11 Mathieu Dubois-Briand 2025-12-29 09:11:48 UTC
a-full opensuse155-vk-1 master completed at 2025-12-25 20:28:47+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2936/steps/39/logs/stdio

a-full rocky9-vk-1 master completed at 2025-12-25 20:46:27+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2937/steps/37/logs/stdio

a-full fedora42-vk-1 master completed at 2025-12-25 20:55:10+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2939/steps/37/logs/stdio
Comment 12 Mathieu Dubois-Briand 2026-01-05 08:32:37 UTC
a-full ubuntu2204-vk-1 master completed at 2026-01-04 20:03:44+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2988/steps/37/logs/stdio
Comment 13 Mathieu Dubois-Briand 2026-01-07 16:56:38 UTC
a-full debian13-vk-1 master completed at 2026-01-06 21:06:02+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2996/steps/37/logs/stdio
Comment 14 Mathieu Dubois-Briand 2026-01-08 08:08:20 UTC
a-full fedora40-vk-3 master completed at 2026-01-07 20:54:01+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/3003/steps/37/logs/stdio
Comment 15 Mathieu Dubois-Briand 2026-01-09 09:12:22 UTC
a-full fedora41-vk-1 master completed at 2026-01-08 21:26:54+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/3008/steps/37/logs/stdio
Comment 16 Paul Barker 2026-01-13 11:18:15 UTC
This should be fixed by https://git.yoctoproject.org/yocto-autobuilder-helper/commit/?id=6f793956c9b43f7a74f5a22c86a93b744b21ada9.

I don't think that is a complete solution though. When send_qa_email.py is looking for the most recent tag to compare results against, it uses `git describe --abbrev=0` which will only pick up things that are tagged directly on master. So it misses the yocto-5.3 tag (as a few commits were made on whinlatter only before tagging the release) and generates a report against uninative-5.0 instead. If it got yocto-5.3 it should work as that was built with bitbake-setup and the results exist with the expected tag.

We can't rely on `git describe --abbrev=0` to find the latest release or milestone. Instead we should sort release tags and pick the highest numbered x.y or x.y_Mz release for master, or the highest numbered 5.3.x release for whinlatter. Earlier releases don't need any change since they still use the poky repository.
Comment 17 Paul Barker 2026-01-13 14:43:30 UTC
I'm going to take this and implementing the tag search described in the previous comment.
Comment 18 Antonin Godard 2026-01-15 13:21:58 UTC
a-full rocky9-vk-3 master completed at 2026-01-15 04:13:39+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/3059/steps/37/logs/stdio

a-full debian12-vk-9 master completed at 2026-01-14 22:27:26+00:00
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/3057/steps/37/logs/stdio