From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 58FBBA0A02 for ; Fri, 16 Apr 2021 23:03:51 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 12EFC161DB0; Fri, 16 Apr 2021 23:03:51 +0200 (CEST) Received: from mail-lf1-f54.google.com (mail-lf1-f54.google.com [209.85.167.54]) by mails.dpdk.org (Postfix) with ESMTP id C37D1161DA9 for ; Fri, 16 Apr 2021 23:03:49 +0200 (CEST) Received: by mail-lf1-f54.google.com with SMTP id n8so46873682lfh.1 for ; Fri, 16 Apr 2021 14:03:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=bDe1NBFV5RqonNc08PKGEpNXRotDnEXsylH2tjdadj8=; b=SE3XT6l7j1b8HT9ZyNLD3e6TPYCsHK/qR8DVqLfDP8PNopgHvXsD1jjqjt7s8MHtbG BEW0S6b5Y/Zbu5UdBHbF/X86imzWyFp5Vvca6ZDohbBqZ48aRDh+3dWkzuy9vQbGCD85 vRzOzB5Mfh436y5u5HCii1r6XX+cE8/ZfcKy0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=bDe1NBFV5RqonNc08PKGEpNXRotDnEXsylH2tjdadj8=; b=l/3Dy/FGf3wbMYj0dht35AIvc/bdh2yC2wcWiXAxUT03FkI/VRj8mhMx3KZjBZ+kiT aTSxKfRNnGmJr2p4t8aPKngqXZc8hZ10HAze+hxCQ4qLI8OVAr+ZbUKOUjODoZqVDXYD VaF8U5IEeb7q0IIf3KUVARrg8ULiNroz8JyP1DbcUC08futq4qQZK++30gkcQKS2+z1w lUbmvlO1aGD3wYPC9qNfo/0NjaMbzFc7yyWbjGmMOIPcibTHrKdxBf8VSQDQF9VKghjV 2zXFYv5Ot/mG72rnejeW2m0ZHXuuVa0ci7GxSg4jWS8xph1kFVN6UXSSRba1GrOHV9aN gkFg== X-Gm-Message-State: AOAM530e+Ulrj8sxN3QZ5tZl5oF2Xe/kMQuVwQxuSHK3AnnGss2wX/dV igG73b1EgB8z39ZWg1tLQakh5QuvJwUQ2kHjFi07Zw== X-Google-Smtp-Source: ABdhPJxAVjZlaZiapu40wF631L0FKNb7/RntK9QfI8q4BNBGjN3bmU08BrzaLdvqk1+q/XX0vm5gkPeCKRoU8lsJFnA= X-Received: by 2002:ac2:43a2:: with SMTP id t2mr4059560lfl.178.1618607029306; Fri, 16 Apr 2021 14:03:49 -0700 (PDT) MIME-Version: 1.0 References: <2891195.MathiC2lse@thomas> <11645160.apamBYaAj9@thomas> In-Reply-To: <11645160.apamBYaAj9@thomas> From: Brandon Lo Date: Fri, 16 Apr 2021 17:03:13 -0400 Message-ID: To: Thomas Monjalon Cc: dpdklab , ci@dpdk.org, Aaron Conole Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-ci] [dpdklab] What is the reliability of the community lab X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" We have completed our rolling migration to containers, so all of our compilation jobs are running and catching up. Our team has also worked on getting the DTS side of things back up and running since the DTS issue had caused the pipelines to hang a bit. Thanks, Brandon On Thu, Apr 15, 2021 at 2:33 PM Thomas Monjalon wrote: > > 15/04/2021 20:26, Brandon Lo: > > Hi Thomas, > > > > For the ABI check failure, we were working on a few migration-related > > changes that caused this issue. We have fixed the underlying cause and > > the rolling migration will be completed soon. The test will be rerun > > and reported back up to patchworks as well. > > You should avoid running tests when the platform is not ready. > It was giving false positives. > > > We are also in the process of adding more monitoring for failure > > results that are not limited to only infrastructure failures, i.e. > > failures caused by a test's return value will alert us in a separate > > category which will allow us to validate the result. > > The lab seems stopped currently. > There are issues for a week now. > What are the news today? > > > > On Wed, Apr 14, 2021 at 8:10 AM Thomas Monjalon wrote: > > > > > > We still have some severe reliability issues with the community lab. > > > One under investigation, waiting for a bisect, is making the lab crashing. > > > > > > Another one I would like to understand is about the ABI check. > > > Why the test is failing (which is normal) in Travis and GitHub > > > but passing in the community lab? > > > > > > See this example: > > > https://patches.dpdk.org/project/dpdk/patch/1618283653-16510-6-git-send-email-xuemingl@nvidia.com/ > > > -- Brandon Lo UNH InterOperability Laboratory 21 Madbury Rd, Suite 100, Durham, NH 03824 blo@iol.unh.edu www.iol.unh.edu On Thu, Apr 15, 2021 at 2:33 PM Thomas Monjalon wrote: > > 15/04/2021 20:26, Brandon Lo: > > Hi Thomas, > > > > For the ABI check failure, we were working on a few migration-related > > changes that caused this issue. We have fixed the underlying cause and > > the rolling migration will be completed soon. The test will be rerun > > and reported back up to patchworks as well. > > You should avoid running tests when the platform is not ready. > It was giving false positives. > > > We are also in the process of adding more monitoring for failure > > results that are not limited to only infrastructure failures, i.e. > > failures caused by a test's return value will alert us in a separate > > category which will allow us to validate the result. > > The lab seems stopped currently. > There are issues for a week now. > What are the news today? > > > > On Wed, Apr 14, 2021 at 8:10 AM Thomas Monjalon wrote: > > > > > > We still have some severe reliability issues with the community lab. > > > One under investigation, waiting for a bisect, is making the lab crashing. > > > > > > Another one I would like to understand is about the ABI check. > > > Why the test is failing (which is normal) in Travis and GitHub > > > but passing in the community lab? > > > > > > See this example: > > > https://patches.dpdk.org/project/dpdk/patch/1618283653-16510-6-git-send-email-xuemingl@nvidia.com/ > > > -- Brandon Lo UNH InterOperability Laboratory 21 Madbury Rd, Suite 100, Durham, NH 03824 blo@iol.unh.edu www.iol.unh.edu