<?xml version="1.0" encoding="UTF-8" standalone="yes" ?>
<!DOCTYPE bugzilla SYSTEM "https://bugzilla.yoctoproject.org/page.cgi?id=bugzilla.dtd">

<bugzilla version="5.0.6"
          urlbase="https://bugzilla.yoctoproject.org/"
          
          maintainer="it-coreprojects-helpdesk@linuxfoundation.org"
>

    <bug>
          <bug_id>15226</bug_id>
          
          <creation_ts>2023-10-09 08:21:52 +0000</creation_ts>
          <short_desc>Add benchmark for buildtime vs build machine specs ?</short_desc>
          <delta_ts>2026-10-23 08:13:37 +0000</delta_ts>
          <reporter_accessible>1</reporter_accessible>
          <cclist_accessible>1</cclist_accessible>
          <classification_id>9</classification_id>
          <classification>Documentation</classification>
          <product>Development Manual</product>
          <component>development</component>
          <version>unspecified</version>
          <rep_platform>x86</rep_platform>
          <op_sys>Multiple</op_sys>
          <bug_status>NEW</bug_status>
          <resolution></resolution>
          
          
          <bug_file_loc></bug_file_loc>
          <status_whiteboard></status_whiteboard>
          <keywords></keywords>
          <priority>Medium</priority>
          <bug_severity>enhancement</bug_severity>
          <target_milestone>6.2 M4</target_milestone>
          
          
          <everconfirmed>1</everconfirmed>
          <reporter name="Yoann Congal">yoann.congal</reporter>
          <assigned_to name="Antonin Godard">antonin.godard</assigned_to>
          <cc>randy.macleod</cc>
    
    <cc>ross.burton</cc>
    
    <cc>yoann.congal</cc>
          
          
          <cf_os>---</cf_os>
          <cf_regression_type>---</cf_regression_type>
          
          <cf_docchange>Yes (doc changes required)</cf_docchange>

      

      

      

          <comment_sort_order>oldest_to_newest</comment_sort_order>  
          <long_desc isprivate="0" >
    <commentid>96663</commentid>
    <comment_count>0</comment_count>
    <who name="Yoann Congal">yoann.congal</who>
    <bug_when>2023-10-09 08:21:52 +0000</bug_when>
    <thetext>Following this discussion on IRC:
&lt;LetoThe2nd&gt; rburton: time bitbake core-image-sato on the new box:real    83m32.211s user    0m25.560s sys     0m10.779s
&lt;yocton&gt; LetoThe2nd: Nice! It got me thinking... Shouldn&apos;t we put some of these number somewhere in the doc? It would give the user the ballpark of the build time they are looking at...
&lt;LetoThe2nd&gt; yocton: ross said he has a table for it, and probably it is public

Maybe some builtime values for some build machine specs interest users?</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>96685</commentid>
    <comment_count>1</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2023-10-12 14:39:15 +0000</bug_when>
    <thetext>A wiki page with the info and document the benchmark is what Richard suggested. -- YP bug review</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>96692</commentid>
    <comment_count>2</comment_count>
    <who name="Ross Burton">ross.burton</who>
    <bug_when>2023-10-12 14:57:37 +0000</bug_when>
    <thetext>A wiki would be sensible.  My only comments are:

- build times should have a date so we can tell how old they are
- build times should be clear what branch and sha, and bitbake target they built

My super-ghetto benchmark is:

# a LTS for stability
$ git checkout origin/kirkstone

# oe-init-build-env anewbuildtree

# fetch all the sources up front
$ bitbake core-image-sato --runall fetch

$ time bitbake core-image-sato

So if we&apos;re collating build times, I&apos;d suggest using the latest LTS so the results stay relevant for longer.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>96712</commentid>
    <comment_count>3</comment_count>
    <who name="Michael Opdenacker">michael.opdenacker</who>
    <bug_when>2023-10-16 14:49:04 +0000</bug_when>
    <thetext>I&apos;m not sure about what we&apos;re thinking about here.
A wiki page with build time for reference images on different build machines?

There are so many possible host configurations (Poky release, host distro, host CPU, amount and type of RAM, storage type) that I don&apos;t see how readers could make use of such information.

IMHO, if we want to track the evolution of build time in a useful way, we should do this through the autobuilder.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>96713</commentid>
    <comment_count>4</comment_count>
    <who name="Yoann Congal">yoann.congal</who>
    <bug_when>2023-10-16 15:30:28 +0000</bug_when>
    <thetext>&gt; I&apos;m not sure about what we&apos;re thinking about here.
&gt; A wiki page with build time for reference images on different build machines?

Yes, that would be a good idea IMHO.

&gt; There are so many possible host configurations (Poky release, host distro, host CPU, amount and type of RAM, storage type) that I don&apos;t see how readers could make use of such information.

This would help a user choosing specs for a Yocto machine. I&apos;ve got this question on various channels quite frequently.

Something like buildtime for core-image-minimal/sato on : a normal desktop, a beefy build server, a laptop, ... This would give an idea of budget vs buildtime.
Obviously, this would be deprecated as soon as it is written but still help.

&gt; IMHO, if we want to track the evolution of build time in a useful way, we should do this through the autobuilder.

Buildtime on autobuilder could be a datapoint :)</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>100021</commentid>
    <comment_count>5</comment_count>
    <who name="Randy MacLeod">randy.macleod</who>
    <bug_when>2024-10-24 15:04:02 +0000</bug_when>
    <thetext>Bulk move of 5.1 M4 to 5.2 M2 as approved by AlexB.</thetext>
  </long_desc><long_desc isprivate="0" >
    <commentid>102179</commentid>
    <comment_count>6</comment_count>
    <who name="Antonin Godard">antonin.godard</who>
    <bug_when>2025-06-06 07:42:30 +0000</bug_when>
    <thetext>Bulk move of bugs I am assigned to from Milestone 5.2M4 to 5.3M1.</thetext>
  </long_desc>
      
      

    </bug>

</bugzilla>