Bug 13016

Summary: How to run our test suites for boards like beaglebone remotely on a LAVA board farm?
Product: [QA/Testing] Runtime Testing Reporter: Armin Kuster <akuster>
Component: generalAssignee: Unassigned <unassigned>
Status: RESOLVED OBSOLETE QA Contact:
Severity: normal    
Priority: Medium+ CC: aaron.chun.yew.chan, ccasciato, mark.morton, ndec13, randy.macleod, richard.purdie, tim.orling, yang.wang
Version: 2.7   
Target Milestone: 5.99   
Hardware: x86   
OS: Multiple   
Whiteboard:
OS type for building Yocto: --- Type of Regression: ---
Verified: Documentation change: Yes (doc changes required)

Description Armin Kuster 2018-11-11 19:48:33 UTC

    
Comment 1 Aníbal Limón 2019-01-02 19:51:35 UTC
I sent previously a RFC to the YP ML [1], there are some work to do to define better the tasks and scope,


[1] https://lists.yoctoproject.org/pipermail/yocto/2018-November/043207.html
Comment 2 Randy MacLeod 2019-03-21 15:12:38 UTC
Add Yang who has been running HW tests using LAVA at Wind River.
Comment 3 Yang Wang 2019-03-21 15:36:21 UTC
Unfortunately, I haven't got time to do runtime tests with devices in LAVA board farm, I'm using internal boards currently.
From Linaro LAVA report (https://validation.linaro.org/scheduler/alljobs), I see beaglebone targets are being used in health check tests only. There might be an instruction to use them, but I haven't got time to figure it out.
Comment 4 Aníbal Limón 2019-03-21 20:56:29 UTC
(In reply to comment #3)
> Unfortunately, I haven't got time to do runtime tests with devices in LAVA
> board farm, I'm using internal boards currently.
> From Linaro LAVA report (https://validation.linaro.org/scheduler/alljobs), I
> see beaglebone targets are being used in health check tests only. There
> might be an instruction to use them, but I haven't got time to figure it out.

Hi Yang,

I have access to the LAVA board-farm (may be you can get access), we can sync about what you have done and whats is need to do to have image testing in main YP Autobuilder.

Cheers,
Anibal
Comment 5 Richard Purdie 2019-08-15 15:07:55 UTC
We don't seem to be getting anywhere with this. Can we come up with a deliverable or plan for this?

If the people involved don't plan or aren't able to work on it, we should reassign the bug rather than keeping moving it forward indefinitely.
Comment 6 Aníbal Limón 2019-11-19 15:47:36 UTC
(In reply to comment #5)
> We don't seem to be getting anywhere with this. Can we come up with a
> deliverable or plan for this?
> 
> If the people involved don't plan or aren't able to work on it, we should
> reassign the bug rather than keeping moving it forward indefinitely.

Hi Richard,

Just received an email from Yang for start looking into this again, we will sync 
to have some break-down of this task.

Regards,
Anibal
Comment 7 Aníbal Limón 2019-11-23 18:34:12 UTC
Mailing list thread,

https://www.yoctoproject.org/pipermail/yocto/2018-November/043207.html
Comment 8 Aaron Chan 2020-09-14 23:28:11 UTC
(In reply to comment #4)
> (In reply to comment #3)
> > Unfortunately, I haven't got time to do runtime tests with devices in LAVA
> > board farm, I'm using internal boards currently.
> > From Linaro LAVA report (https://validation.linaro.org/scheduler/alljobs), I
> > see beaglebone targets are being used in health check tests only. There
> > might be an instruction to use them, but I haven't got time to figure it out.
> 
> Hi Yang,
> 
> I have access to the LAVA board-farm (may be you can get access), we can
> sync about what you have done and whats is need to do to have image testing
> in main YP Autobuilder.
> 
> Cheers,
> Anibal

Hi Anibal,

Even if you had access to LAVA board-farm and able to trigger job remotely, for test image if requires IP to where the device is connected to back to AB ?

Cheers,
Aaron
Comment 9 Aníbal Limón 2020-09-15 05:58:38 UTC
(In reply to comment #8)
> (In reply to comment #4)
> > (In reply to comment #3)
> > > Unfortunately, I haven't got time to do runtime tests with devices in LAVA
> > > board farm, I'm using internal boards currently.
> > > From Linaro LAVA report (https://validation.linaro.org/scheduler/alljobs), I
> > > see beaglebone targets are being used in health check tests only. There
> > > might be an instruction to use them, but I haven't got time to figure it out.
> > 
> > Hi Yang,
> > 
> > I have access to the LAVA board-farm (may be you can get access), we can
> > sync about what you have done and whats is need to do to have image testing
> > in main YP Autobuilder.
> > 
> > Cheers,
> > Anibal
> 
> Hi Anibal,
> 
> Even if you had access to LAVA board-farm and able to trigger job remotely,
> for test image if requires IP to where the device is connected to back to AB
> ?

Hi Aaron,

As far as I know current LAVA integration requires to be in the same network as Autobuilder, The AB uses LAVA to setup the board and then inject tests via SSH so it needs an IP address to connect.

Regards,
Anibal

> 
> Cheers,
> Aaron
Comment 10 Randy MacLeod 2023-10-24 14:24:31 UTC
Bulk move from 4.99 or 0.00 to 5.99
Comment 11 Randy MacLeod 2026-01-29 16:18:31 UTC
Nico does have testing running at Linaro and others may as well
but this is generally out of scope for Yocto.