From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A3E51A0C45; Mon, 22 Nov 2021 09:17:19 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5F33640395; Mon, 22 Nov 2021 09:17:19 +0100 (CET) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id 7D80B4014E for ; Mon, 22 Nov 2021 09:17:17 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1637569037; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mutUFmylDlWBRjIdDSBFomok9DU61eD/RfgTQhWOwVM=; b=YteIDxKbPW5/rSyS0VS3ZzLWQZpim1wODdCAs1qyt/XPiKtufG43946kw07gm9ISoQXUWY CSd0IhIWEhCxIjJLw9ohuvIuMY4OimLPeM3nfjmtjJAZ/QnbdkxgebtfEJLSgDPvYDBRUf j8E/tDTl2ROTXz616GCQzIEmq/T7rBU= Received: from mail-lf1-f72.google.com (mail-lf1-f72.google.com [209.85.167.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-184-T2RAdQOKOvKRCoMjTZZvAQ-1; Mon, 22 Nov 2021 03:17:13 -0500 X-MC-Unique: T2RAdQOKOvKRCoMjTZZvAQ-1 Received: by mail-lf1-f72.google.com with SMTP id k5-20020a05651210c500b0040934a07fbdso11594608lfg.22 for ; Mon, 22 Nov 2021 00:17:13 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=mutUFmylDlWBRjIdDSBFomok9DU61eD/RfgTQhWOwVM=; b=QMtA8W+AAEuaCSdUH1q7P5DG//FKCetBLB8Vvi95u24SiwvCmhWsQYPb/vWAA4rYJ/ kEsMj8UgrhoVDAKCgBFjZ1vE/y9WL26joH77/pcpG9uJ7ZZIJv8iiKIzqjLsVU6NmzEI eeViC+hwWs0TIX+HSTsfAYbnzpRiBJ4Aplp0tStGmnhCZLX18/i6vEUMwFsK60L/Fk+X 0q6c7yKR2WFXjeMHzxZBq9h3OWc7lrVjQOkXv8J0W/kV9xdDaiPRe1MJbV4tLQB96LKx 19XDHRAirZlOR3CX5cPcdnNGZKoXw8dPbQhTFdsmbN/9fx9f6tEupE0BUyUjVozFVKnj QSfw== X-Gm-Message-State: AOAM533iPVuebcXb0KNXooyxv1XcNXQpOgLhAunLeSt2oXSCnB0qk+y8 9ab5eC63WVSwwQVH3wgftK5nZ76fHRt86NNRYMNEpA+q97qvYawqLpwgZVlynbRa+Z5V11JotYr ruOpK2zP6TxC3mx8fgMc= X-Received: by 2002:a2e:8189:: with SMTP id e9mr49722423ljg.333.1637569031845; Mon, 22 Nov 2021 00:17:11 -0800 (PST) X-Google-Smtp-Source: ABdhPJyyw8QbIK+a2uYCC8OznhZgNI1wOeaIe8D52IkS0IY0BnNrqdH0cuZGfNQnoOd5pQEdGsEnpnbAZdqONNb8IN8= X-Received: by 2002:a2e:8189:: with SMTP id e9mr49722407ljg.333.1637569031613; Mon, 22 Nov 2021 00:17:11 -0800 (PST) MIME-Version: 1.0 References: <1928246.j4tpOohVRJ@thomas> In-Reply-To: From: David Marchand Date: Mon, 22 Nov 2021 09:17:00 +0100 Message-ID: Subject: Re: [dpdk-dev] [Bug 826] red_autotest random failures To: "Dumitrescu, Cristian" Cc: Thomas Monjalon , Lincoln Lavoie , "Ajmera, Megha" , "Singh, Jasvinder" , "Liguzinski, WojciechX" , dev , Aaron Conole , "Yigit, Ferruh" , "ci@dpdk.org" , "Zegota, AnnaX" Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=dmarchan@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Fri, Nov 19, 2021 at 5:54 PM Dumitrescu, Cristian wrote: > On a different point, we should probably tweak our autotests to different= iate between logical failures and those failures related to resources not b= eing available, and flag the test result accordingly in the report. For exa= mple, if memory allocation fails, the test should be flagged as "Not enough= resources" instead of simply "Failed". In the first case, the next step sh= ould be fixing the test setup, while in the second case the next step shoul= d be fixing the code. What do people think on this? In such case, the test must return TEST_SKIPPED. I did a pass for cores count / specific hw requirements, some time ago. See https://git.dpdk.org/dpdk/commit/?id=3De0f4a0ed4237 --=20 David Marchand