Bug 4528

Summary: boot time should be tracked for systemd and SysVinit
Product: [QA/Testing] Test Plans/Suite Reporter: Stoicescu Cornel <corneliux.stoicescu>
Component: test-plans/suiteAssignee: Humberto Ibarra <humberto.ibarra.lopez>
Status: RESOLVED OBSOLETE QA Contact:
Severity: enhancement    
Priority: Medium+ CC: anibal.limon, bluelightning, bogdanx.a.voiculescu, corneliux.stoicescu, francisco.j.pedraza.gonzalez, humberto.ibarra.lopez, leonardo.sandoval.gonzalez, net147, richard.purdie, sgw, sonia.delgado, todor.minchev
Version: 1.5   
Target Milestone: 2.3 M2   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Yes (doc changes required)

Description Stoicescu Cornel 2013-05-22 13:03:04 UTC
Boot time should be tracked as a performance metric for both the init systems used in Yocto: systemd and sysvinit. 

Results should be stored similar to https://wiki.yoctoproject.org/wiki/Performance_Test
Comment 1 Stoicescu Cornel 2013-05-22 13:13:37 UTC
To test this we need to use real hardware as qemu images would introduce undesired variables. 

Systemd should allready have a bootchart feature integrated.

For sysvinit we could use ./meta-oe/recipes-devtools/bootchart from git://git.openembedded.org/meta-openembedded
Comment 2 Alexandru Georgescu 2013-08-22 07:38:07 UTC
I think this is a good candidate for the runtime test framework (ready only for QEMU), but may be used when we'll have the ability to run it on real HW too.
Comment 3 Alexandru Georgescu 2013-08-22 07:44:55 UTC
This should be targeted for future.
Comment 4 Alexandru Georgescu 2013-09-19 13:41:31 UTC
marking it for future. 
Depends on image-tests framework on real HW
Comment 5 Paul Eggleton 2014-02-27 11:00:48 UTC
I've just filed bug 5893 which may relate to this.
Comment 6 Alexandru Georgescu 2015-03-05 19:23:15 UTC
(In reply to comment #5)
> I've just filed bug 5893 which may relate to this.

I definitely want this in, but it will make it in 1.9.
Comment 7 Benjamin Esquivel 2016-05-13 22:13:57 UTC
Anibal has some insight to this
Comment 8 Aníbal Limón 2016-08-01 15:15:59 UTC
We already have a test for measure boot time for systemd [1], for this bug i think the implementation should be done in the performance script. [2]

[1] http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/runtime/systemd.py#n132
[2] http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/scripts/oe-build-perf-test
Comment 9 Francisco Pedraza 2016-11-03 15:25:48 UTC
(In reply to comment #8)
> We already have a test for measure boot time for systemd [1], for this bug i
> think the implementation should be done in the performance script. [2]
> 
> [1]
> http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/runtime/
> systemd.py#n132
> [2]
> http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/scripts/oe-build-perf-
> test

Anibal,
Based on this we could close this as resolved?
Regards.
Comment 10 Francisco Pedraza 2016-11-03 15:27:43 UTC
Anibal,
Based on this we could close this as resolved?
Regards.
Comment 11 Aníbal Limón 2016-11-03 15:28:53 UTC
(In reply to comment #9)
> (In reply to comment #8)
> > We already have a test for measure boot time for systemd [1], for this bug i
> > think the implementation should be done in the performance script. [2]
> > 
> > [1]
> > http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/lib/oeqa/runtime/
> > systemd.py#n132
> > [2]
> > http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/scripts/oe-build-perf-
> > test
> 
> Anibal,
> Based on this we could close this as resolved?
> Regards.

I don't think so, this boot time measurement is related to the target, as i know we don't have performance tests for the target and this boot time will be one of them.
Comment 12 Jose Perez C 2016-11-03 15:53:24 UTC
CC Humberto Ibarra, He is working on performance on runtime. 

@Francisco please talk to Humberto, this bug may be end up assigned to him.
Comment 13 Humberto Ibarra 2016-12-12 21:32:01 UTC
There is a related bug that might be implementing this already, bug is 10500. Sent mail about this and waiting for answers.
Comment 14 Humberto Ibarra 2017-01-22 13:03:22 UTC
Runtime performance is being reevaluated in bug #10951, a new version for this will probably come out in the next days attached to that umbrella bug.