From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 72463A034F for ; Fri, 12 Nov 2021 15:11:11 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 47D14410E3; Fri, 12 Nov 2021 15:11:11 +0100 (CET) Received: from mail-ed1-f53.google.com (mail-ed1-f53.google.com [209.85.208.53]) by mails.dpdk.org (Postfix) with ESMTP id 0D4B740692 for ; Fri, 12 Nov 2021 15:11:10 +0100 (CET) Received: by mail-ed1-f53.google.com with SMTP id z10so11792049edc.11 for ; Fri, 12 Nov 2021 06:11:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=tdeyFZbw+xrsYXBFPtSQAjnhhx3Dab5lGeDVBFQhsjo=; b=DY7AUigcv1Xh4CLRTvlK4GdkFvYwRsq15LfYDkn9rru1aqzHUX3GDlkDQY6drxb9QI FIOvU7BmcoFOxpyc1XpVE4drS1s6uHVqaQcKRhXz6bIcFKlJEpDUjPrMl3/zY1rWoCRK Xp9kwcEoggglLDnmrq16W/vduNSt4i6AcF1lI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=tdeyFZbw+xrsYXBFPtSQAjnhhx3Dab5lGeDVBFQhsjo=; b=fUS2w7REs0Zxanmwa3h5AHtwbeC0QeGp4rIJMWFzJ/MsHY7QrqnVFat0bKGc9xRHYa DUbYteCVnPL9PKsjBz4Q04LFAj/936LMdgA35UHUs+d6ngp8XsSP5/Ve+3yrum+KCSZX 9DjfuOHdaDh9xz9PfrCnAiL/RtRiJYFbIYW0kiuxjo8bYK/V2li5IREDft2B0CPPeo10 A0XmWJfbqi58JSHPKikfTBJxpRHAXJRp99CJbI3TQCppR4y7WvAyAC0WdVvBQ5jxcCQf KoANnG0u7CS09p5eC/jR2cwJEfVT6UiMoDwnSDYPu/MuIBh4MwOZ/jrss6bJUz3vzMTB dxfA== X-Gm-Message-State: AOAM5323JvLZo1/XpHdAWW1Br37YkKzpqG7DTpyOzTXF5I4tCAeBsZ2W MPTPzTL3v3bPfDJVLQHZKcY8I4tlGZ+rKhqrPb0mOw== X-Google-Smtp-Source: ABdhPJxBNNSBbPJSyCSSgnDS0uFlAF/r+E7n/hDZCz+RueNzRhWcSWzRbyLWv1N1SN/OXP5XSFgQCpdXv6Lw8alA5m0= X-Received: by 2002:a05:6402:331:: with SMTP id q17mr21917006edw.58.1636726269629; Fri, 12 Nov 2021 06:11:09 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Lincoln Lavoie Date: Fri, 12 Nov 2021 09:10:56 -0500 Message-ID: Subject: Re: [dpdk-dev] [Bug 826] red_autotest random failures To: David Marchand Cc: Cristian Dumitrescu , dev , Aaron Conole , Thomas Monjalon , "Yigit, Ferruh" , ci@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org On Fri, Nov 12, 2021 at 8:52 AM David Marchand wrote: > On Fri, Oct 8, 2021 at 9:24 AM wrote: > > > > https://bugs.dpdk.org/show_bug.cgi?id=826 > > > > Bug ID: 826 > > Summary: red_autotest random failures > > Product: DPDK > > Version: unspecified > > Hardware: All > > OS: All > > Status: UNCONFIRMED > > Severity: normal > > Priority: Normal > > Component: other > > Assignee: cristian.dumitrescu@intel.com > > Reporter: david.marchand@redhat.com > > CC: dev@dpdk.org, jasvinder.singh@intel.com > > Target Milestone: --- > > > > A recent failure can be found at: > > https://lab.dpdk.org/results/dashboard/patchsets/19223/ > > > > 50/94 DPDK:fast-tests / red_autotest FAIL > 0.86s > > exit status 1 > > > functional test 6 : use several queues (each with its own run-time data), > use several RED configurations (such that each > configuration is sharte_red by multiple queues), > increase average queue size to target level, > dequeue all packets until queue is empty, > confirm that average queue size is computed correctly > while queue is empty > (this is a larger scale version of functional test 3) > > queue config q avg before q avg after expected > difference % tolerance % result > 0 0 1022.0000 1022.0000 1016.0627 > 0.5843 5.0000 pass > 1 0 1022.0000 1022.0000 1016.0627 > 0.5843 5.0000 pass > 2 1 1022.0000 1022.0000 1010.1483 > 1.1733 5.0000 pass > 3 1 1022.0000 937.1660 1010.1483 > 7.2249 5.0000 fail > > -------------------------------------------------------------------------- > > > > This failure keeps on popping in the CI. > The bug report is one month old, with no reply. > > > I sent a proposal of removing red_autotest from the list executed by the > CI. > > https://patchwork.dpdk.org/project/dpdk/patch/20211027140458.2502-2-david.marchand@redhat.com/ > > It might be the best solution waiting for an analysis. > > > -- > David Marchand > > Hi David, My understanding is, removing the test would require removing it from the DPDK unit tests, we are just running the fast-tests suite for the unit tests. DPDK's unit test structure / framework does not allow removing or customizing the suite of tests beyond the suites. In the lab, Brandon has been looking into and trying different configurations for running the tests within the containers along the lines of the CPU pinning requirements that might be assumed by the unit tests. So far, everything he has tried has still had the similar failures / issues. We are still looking into it, so the bug is not sitting without action, just no final resolution. Cheers, Lincoln -- *Lincoln Lavoie* Principal Engineer, Broadband Technologies 21 Madbury Rd., Ste. 100, Durham, NH 03824 lylavoie@iol.unh.edu https://www.iol.unh.edu +1-603-674-2755 (m)