From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <ci-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 58FBBA0A02
	for <public@inbox.dpdk.org>; Fri, 16 Apr 2021 23:03:51 +0200 (CEST)
Received: from [217.70.189.124] (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 12EFC161DB0;
	Fri, 16 Apr 2021 23:03:51 +0200 (CEST)
Received: from mail-lf1-f54.google.com (mail-lf1-f54.google.com
 [209.85.167.54])
 by mails.dpdk.org (Postfix) with ESMTP id C37D1161DA9
 for <ci@dpdk.org>; Fri, 16 Apr 2021 23:03:49 +0200 (CEST)
Received: by mail-lf1-f54.google.com with SMTP id n8so46873682lfh.1
 for <ci@dpdk.org>; Fri, 16 Apr 2021 14:03:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol;
 h=mime-version:references:in-reply-to:from:date:message-id:subject:to
 :cc; bh=bDe1NBFV5RqonNc08PKGEpNXRotDnEXsylH2tjdadj8=;
 b=SE3XT6l7j1b8HT9ZyNLD3e6TPYCsHK/qR8DVqLfDP8PNopgHvXsD1jjqjt7s8MHtbG
 BEW0S6b5Y/Zbu5UdBHbF/X86imzWyFp5Vvca6ZDohbBqZ48aRDh+3dWkzuy9vQbGCD85
 vRzOzB5Mfh436y5u5HCii1r6XX+cE8/ZfcKy0=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:references:in-reply-to:from:date
 :message-id:subject:to:cc;
 bh=bDe1NBFV5RqonNc08PKGEpNXRotDnEXsylH2tjdadj8=;
 b=l/3Dy/FGf3wbMYj0dht35AIvc/bdh2yC2wcWiXAxUT03FkI/VRj8mhMx3KZjBZ+kiT
 aTSxKfRNnGmJr2p4t8aPKngqXZc8hZ10HAze+hxCQ4qLI8OVAr+ZbUKOUjODoZqVDXYD
 VaF8U5IEeb7q0IIf3KUVARrg8ULiNroz8JyP1DbcUC08futq4qQZK++30gkcQKS2+z1w
 lUbmvlO1aGD3wYPC9qNfo/0NjaMbzFc7yyWbjGmMOIPcibTHrKdxBf8VSQDQF9VKghjV
 2zXFYv5Ot/mG72rnejeW2m0ZHXuuVa0ci7GxSg4jWS8xph1kFVN6UXSSRba1GrOHV9aN
 gkFg==
X-Gm-Message-State: AOAM530e+Ulrj8sxN3QZ5tZl5oF2Xe/kMQuVwQxuSHK3AnnGss2wX/dV
 igG73b1EgB8z39ZWg1tLQakh5QuvJwUQ2kHjFi07Zw==
X-Google-Smtp-Source: ABdhPJxAVjZlaZiapu40wF631L0FKNb7/RntK9QfI8q4BNBGjN3bmU08BrzaLdvqk1+q/XX0vm5gkPeCKRoU8lsJFnA=
X-Received: by 2002:ac2:43a2:: with SMTP id t2mr4059560lfl.178.1618607029306; 
 Fri, 16 Apr 2021 14:03:49 -0700 (PDT)
MIME-Version: 1.0
References: <2891195.MathiC2lse@thomas>
 <CAOeXdvZuVo5Sty6mWfca_tQcasFvDpVVo7h45yp7H8tKA4KQCw@mail.gmail.com>
 <11645160.apamBYaAj9@thomas>
In-Reply-To: <11645160.apamBYaAj9@thomas>
From: Brandon Lo <blo@iol.unh.edu>
Date: Fri, 16 Apr 2021 17:03:13 -0400
Message-ID: <CAOeXdvbe3u37rZo2=hHub761T19QSCy=-WJ_fF+cTz-LrzG67Q@mail.gmail.com>
To: Thomas Monjalon <thomas@monjalon.net>
Cc: dpdklab <dpdklab@iol.unh.edu>, ci@dpdk.org,
 Aaron Conole <aconole@redhat.com>
Content-Type: text/plain; charset="UTF-8"
Subject: Re: [dpdk-ci] [dpdklab] What is the reliability of the community lab
X-BeenThere: ci@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK CI discussions <ci.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/ci>,
 <mailto:ci-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/ci/>
List-Post: <mailto:ci@dpdk.org>
List-Help: <mailto:ci-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/ci>,
 <mailto:ci-request@dpdk.org?subject=subscribe>
Errors-To: ci-bounces@dpdk.org
Sender: "ci" <ci-bounces@dpdk.org>

We have completed our rolling migration to containers, so all of our
compilation jobs are running and catching up.
Our team has also worked on getting the DTS side of things back up and
running since the DTS issue had caused the pipelines to hang a bit.

Thanks,
Brandon

On Thu, Apr 15, 2021 at 2:33 PM Thomas Monjalon <thomas@monjalon.net> wrote:
>
> 15/04/2021 20:26, Brandon Lo:
> > Hi Thomas,
> >
> > For the ABI check failure, we were working on a few migration-related
> > changes that caused this issue. We have fixed the underlying cause and
> > the rolling migration will be completed soon. The test will be rerun
> > and reported back up to patchworks as well.
>
> You should avoid running tests when the platform is not ready.
> It was giving false positives.
>
> > We are also in the process of adding more monitoring for failure
> > results that are not limited to only infrastructure failures, i.e.
> > failures caused by a test's return value will alert us in a separate
> > category which will allow us to validate the result.
>
> The lab seems stopped currently.
> There are issues for a week now.
> What are the news today?
>
>
> > On Wed, Apr 14, 2021 at 8:10 AM Thomas Monjalon <thomas@monjalon.net> wrote:
> > >
> > > We still have some severe reliability issues with the community lab.
> > > One under investigation, waiting for a bisect, is making the lab crashing.
> > >
> > > Another one I would like to understand is about the ABI check.
> > > Why the test is failing (which is normal) in Travis and GitHub
> > > but passing in the community lab?
> > >
> > > See this example:
> > > https://patches.dpdk.org/project/dpdk/patch/1618283653-16510-6-git-send-email-xuemingl@nvidia.com/
>
>
>


--

Brandon Lo

UNH InterOperability Laboratory

21 Madbury Rd, Suite 100, Durham, NH 03824

blo@iol.unh.edu

www.iol.unh.edu


On Thu, Apr 15, 2021 at 2:33 PM Thomas Monjalon <thomas@monjalon.net> wrote:
>
> 15/04/2021 20:26, Brandon Lo:
> > Hi Thomas,
> >
> > For the ABI check failure, we were working on a few migration-related
> > changes that caused this issue. We have fixed the underlying cause and
> > the rolling migration will be completed soon. The test will be rerun
> > and reported back up to patchworks as well.
>
> You should avoid running tests when the platform is not ready.
> It was giving false positives.
>
> > We are also in the process of adding more monitoring for failure
> > results that are not limited to only infrastructure failures, i.e.
> > failures caused by a test's return value will alert us in a separate
> > category which will allow us to validate the result.
>
> The lab seems stopped currently.
> There are issues for a week now.
> What are the news today?
>
>
> > On Wed, Apr 14, 2021 at 8:10 AM Thomas Monjalon <thomas@monjalon.net> wrote:
> > >
> > > We still have some severe reliability issues with the community lab.
> > > One under investigation, waiting for a bisect, is making the lab crashing.
> > >
> > > Another one I would like to understand is about the ABI check.
> > > Why the test is failing (which is normal) in Travis and GitHub
> > > but passing in the community lab?
> > >
> > > See this example:
> > > https://patches.dpdk.org/project/dpdk/patch/1618283653-16510-6-git-send-email-xuemingl@nvidia.com/
>
>
>


--

Brandon Lo

UNH InterOperability Laboratory

21 Madbury Rd, Suite 100, Durham, NH 03824

blo@iol.unh.edu

www.iol.unh.edu