DPDK CI discussions
 help / color / mirror / Atom feed
* UNH CI is offline
@ 2021-12-06 18:19 Lincoln Lavoie
  2021-12-08 22:09 ` Lincoln Lavoie
  0 siblings, 1 reply; 5+ messages in thread
From: Lincoln Lavoie @ 2021-12-06 18:19 UTC (permalink / raw)
  To: ci

Hello All,

As discussed at the Thursday CI meeting, UNH infrastructure is now offline
for upgrades.  This means, we will not be reporting results right now,
patches will get tested once systems are restarted (but that will be a
backlog process, i.e. CI will have to catch up).

The dashboard and previous results will remain available.

During the downtime, we can not rerun tests.

We will follow up as we complete the upgrades.

Cheers,
Lincoln
-- 
*Lincoln Lavoie*
Principal Engineer, Broadband Technologies
21 Madbury Rd., Ste. 100, Durham, NH 03824
lylavoie@iol.unh.edu
https://www.iol.unh.edu
+1-603-674-2755 (m)
<https://www.iol.unh.edu>

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: UNH CI is offline
  2021-12-06 18:19 UNH CI is offline Lincoln Lavoie
@ 2021-12-08 22:09 ` Lincoln Lavoie
  2021-12-09 14:33   ` Aaron Conole
  0 siblings, 1 reply; 5+ messages in thread
From: Lincoln Lavoie @ 2021-12-08 22:09 UTC (permalink / raw)
  To: ci

Hello All,

We have completed some first steps for the major update around Jenkins.
The host's operating system has been upgraded to the latest version to pull
in security patches, etc.  Jenkins itself has also been upgraded, but is
not yet to its final desired version.  We have to update
incrementally between LTS versions, to allow Jenkins to migrate
configurations, plugins, and job data.  That process takes a little bit to
complete each time, while it processes its data and the job history.

The system is online now, and we are going to let it catch up on missed
jobs overnight.  We will be keeping a close eye on the output, but things
look stable and correct.  We don't expect Jenkins to change the actual
tests, since it just runs tests and collects results. There will be some
additional downtime, while we continue upgrading versions this week and
early next week.  If you notice anything that looks incorrect or strange,
please let us know.

That does raise a question on storage of historical results (i.e. the
results tar balls) and how long we need to keep those available. The
results (i.e. pass / fail indication) would live on in the dashboard and
database, but the actual results archives (tar balls) are stored in Jenkins
as a job.  Would limiting that storage to 4 or 6 months be acceptable to
the community?  This will reduce the future issues of upgrades and
migration, in terms of processing time required by Jenkins. A test could
always be rerun, if we needed to recreate an older set of logs/results.
I'll add this as a discussion item for the next community call.

Cheers,
Lincoln

On Mon, Dec 6, 2021 at 1:19 PM Lincoln Lavoie <lylavoie@iol.unh.edu> wrote:

> Hello All,
>
> As discussed at the Thursday CI meeting, UNH infrastructure is now offline
> for upgrades.  This means, we will not be reporting results right now,
> patches will get tested once systems are restarted (but that will be a
> backlog process, i.e. CI will have to catch up).
>
> The dashboard and previous results will remain available.
>
> During the downtime, we can not rerun tests.
>
> We will follow up as we complete the upgrades.
>
> Cheers,
> Lincoln
> --
> *Lincoln Lavoie*
> Principal Engineer, Broadband Technologies
> 21 Madbury Rd., Ste. 100, Durham, NH 03824
> lylavoie@iol.unh.edu
> https://www.iol.unh.edu
> +1-603-674-2755 (m)
> <https://www.iol.unh.edu>
>


-- 
*Lincoln Lavoie*
Principal Engineer, Broadband Technologies
21 Madbury Rd., Ste. 100, Durham, NH 03824
lylavoie@iol.unh.edu
https://www.iol.unh.edu
+1-603-674-2755 (m)
<https://www.iol.unh.edu>

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: UNH CI is offline
  2021-12-08 22:09 ` Lincoln Lavoie
@ 2021-12-09 14:33   ` Aaron Conole
  2021-12-09 16:01     ` Thomas Monjalon
  0 siblings, 1 reply; 5+ messages in thread
From: Aaron Conole @ 2021-12-09 14:33 UTC (permalink / raw)
  To: Lincoln Lavoie; +Cc: ci

Lincoln Lavoie <lylavoie@iol.unh.edu> writes:

> Hello All,
>
> We have completed some first steps for the major update around Jenkins.
> The host's operating system has been upgraded to the latest version to pull
> in security patches, etc.  Jenkins itself has also been upgraded, but is
> not yet to its final desired version.  We have to update
> incrementally between LTS versions, to allow Jenkins to migrate
> configurations, plugins, and job data.  That process takes a little bit to
> complete each time, while it processes its data and the job history.

Makes sense, and I expected it wouldn't be a simple 5 minute process.

> The system is online now, and we are going to let it catch up on missed
> jobs overnight.  We will be keeping a close eye on the output, but things
> look stable and correct.  We don't expect Jenkins to change the actual
> tests, since it just runs tests and collects results. There will be some
> additional downtime, while we continue upgrading versions this week and
> early next week.  If you notice anything that looks incorrect or strange,
> please let us know.

Thanks.  I think right now the contribution rate is rather slow (just
because of real-life timing), so I imagine it won't be difficult to
catch up.

> That does raise a question on storage of historical results (i.e. the
> results tar balls) and how long we need to keep those available. The
> results (i.e. pass / fail indication) would live on in the dashboard and
> database, but the actual results archives (tar balls) are stored in Jenkins
> as a job.  Would limiting that storage to 4 or 6 months be acceptable to
> the community?  This will reduce the future issues of upgrades and
> migration, in terms of processing time required by Jenkins. A test could
> always be rerun, if we needed to recreate an older set of logs/results.
> I'll add this as a discussion item for the next community call.

+1 - thanks.

> Cheers,
> Lincoln
>
> On Mon, Dec 6, 2021 at 1:19 PM Lincoln Lavoie <lylavoie@iol.unh.edu> wrote:
>
>> Hello All,
>>
>> As discussed at the Thursday CI meeting, UNH infrastructure is now offline
>> for upgrades.  This means, we will not be reporting results right now,
>> patches will get tested once systems are restarted (but that will be a
>> backlog process, i.e. CI will have to catch up).
>>
>> The dashboard and previous results will remain available.
>>
>> During the downtime, we can not rerun tests.
>>
>> We will follow up as we complete the upgrades.
>>
>> Cheers,
>> Lincoln
>> --
>> *Lincoln Lavoie*
>> Principal Engineer, Broadband Technologies
>> 21 Madbury Rd., Ste. 100, Durham, NH 03824
>> lylavoie@iol.unh.edu
>> https://www.iol.unh.edu
>> +1-603-674-2755 (m)
>> <https://www.iol.unh.edu>
>>


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: UNH CI is offline
  2021-12-09 14:33   ` Aaron Conole
@ 2021-12-09 16:01     ` Thomas Monjalon
  2021-12-13 19:59       ` Lincoln Lavoie
  0 siblings, 1 reply; 5+ messages in thread
From: Thomas Monjalon @ 2021-12-09 16:01 UTC (permalink / raw)
  To: Lincoln Lavoie; +Cc: ci, Aaron Conole

09/12/2021 15:33, Aaron Conole:
> Lincoln Lavoie <lylavoie@iol.unh.edu> writes:
> > That does raise a question on storage of historical results (i.e. the
> > results tar balls) and how long we need to keep those available. The
> > results (i.e. pass / fail indication) would live on in the dashboard and
> > database, but the actual results archives (tar balls) are stored in Jenkins
> > as a job.  Would limiting that storage to 4 or 6 months be acceptable to
> > the community?  This will reduce the future issues of upgrades and
> > migration, in terms of processing time required by Jenkins. A test could
> > always be rerun, if we needed to recreate an older set of logs/results.
> > I'll add this as a discussion item for the next community call.
> 
> +1 - thanks.

I think we don't need more history than current and previous releases.
So I bet 8 months is a fair amount of test history.



^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: UNH CI is offline
  2021-12-09 16:01     ` Thomas Monjalon
@ 2021-12-13 19:59       ` Lincoln Lavoie
  0 siblings, 0 replies; 5+ messages in thread
From: Lincoln Lavoie @ 2021-12-13 19:59 UTC (permalink / raw)
  To: ci; +Cc: Aaron Conole, Thomas Monjalon

Hello All,

Just a quick follow up. Jenkins upgrades have been completed and the system
is getting caught up to the patches that have come in. Please let us know
if you would like any patches rerun.  We'll also take a pass through the
history this week to look for anything that needs to be rerun as well.

Next for upgrades will be the dashboard system and our vpn / router.  The
dashboard will not impact running just, just browsing results. The vpn /
router upgrade will require us to stop the existing jobs.  We expect both
of these to be completed this week.

Cheers,
Lincoln

On Thu, Dec 9, 2021 at 11:01 AM Thomas Monjalon <thomas@monjalon.net> wrote:

> 09/12/2021 15:33, Aaron Conole:
> > Lincoln Lavoie <lylavoie@iol.unh.edu> writes:
> > > That does raise a question on storage of historical results (i.e. the
> > > results tar balls) and how long we need to keep those available. The
> > > results (i.e. pass / fail indication) would live on in the dashboard
> and
> > > database, but the actual results archives (tar balls) are stored in
> Jenkins
> > > as a job.  Would limiting that storage to 4 or 6 months be acceptable
> to
> > > the community?  This will reduce the future issues of upgrades and
> > > migration, in terms of processing time required by Jenkins. A test
> could
> > > always be rerun, if we needed to recreate an older set of logs/results.
> > > I'll add this as a discussion item for the next community call.
> >
> > +1 - thanks.
>
> I think we don't need more history than current and previous releases.
> So I bet 8 months is a fair amount of test history.
>
>
>

-- 
*Lincoln Lavoie*
Principal Engineer, Broadband Technologies
21 Madbury Rd., Ste. 100, Durham, NH 03824
lylavoie@iol.unh.edu
https://www.iol.unh.edu
+1-603-674-2755 (m)
<https://www.iol.unh.edu>

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2021-12-13 19:59 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-12-06 18:19 UNH CI is offline Lincoln Lavoie
2021-12-08 22:09 ` Lincoln Lavoie
2021-12-09 14:33   ` Aaron Conole
2021-12-09 16:01     ` Thomas Monjalon
2021-12-13 19:59       ` Lincoln Lavoie

DPDK CI discussions

This inbox may be cloned and mirrored by anyone:

	git clone --mirror http://inbox.dpdk.org/ci/0 ci/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ci ci/ http://inbox.dpdk.org/ci \
		ci@dpdk.org
	public-inbox-index ci

Example config snippet for mirrors.
Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.ci


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git