From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5695AA0C52 for ; Mon, 22 Nov 2021 09:17:20 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 4A8FA41155; Mon, 22 Nov 2021 09:17:20 +0100 (CET) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id AB18940395 for ; Mon, 22 Nov 2021 09:17:17 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1637569037; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=mutUFmylDlWBRjIdDSBFomok9DU61eD/RfgTQhWOwVM=; b=YteIDxKbPW5/rSyS0VS3ZzLWQZpim1wODdCAs1qyt/XPiKtufG43946kw07gm9ISoQXUWY CSd0IhIWEhCxIjJLw9ohuvIuMY4OimLPeM3nfjmtjJAZ/QnbdkxgebtfEJLSgDPvYDBRUf j8E/tDTl2ROTXz616GCQzIEmq/T7rBU= Received: from mail-lf1-f70.google.com (mail-lf1-f70.google.com [209.85.167.70]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-326-j2vmq986P-Wnkm_i-SGE_g-1; Mon, 22 Nov 2021 03:17:13 -0500 X-MC-Unique: j2vmq986P-Wnkm_i-SGE_g-1 Received: by mail-lf1-f70.google.com with SMTP id z1-20020a056512308100b003ff78e6402bso11529684lfd.4 for ; Mon, 22 Nov 2021 00:17:13 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=mutUFmylDlWBRjIdDSBFomok9DU61eD/RfgTQhWOwVM=; b=g4oQPydi33Ym359bGOLTQB1mjux3qFmSCdMCiTdL2m+wTas3eLG+2Dq932pYeoXsgU 7J6QeVDawEbQB7mZb2SZzchQNhQ8kotW2rMP7tGdcD9+VJl8rHQWstePBk3nZK4uiw4Q nLeNL8L1kYSX9f8+D+OslYrynlNIONdIf/JA3/DXu346MS+5Q6W//RPHZRJ25V7/uB8l lIrdGpSel4DKoNKPucp6zcQhHodBj5g/Dzg8hyZYgGG49JQyVvJgvkSfJMowY2rtHL99 2OfRhZI3r4nljuPoivwJBnVwB3vBCyX72Y0a8wuYguh96tjEQrIO926X35obPhS0GElB EUlg== X-Gm-Message-State: AOAM530EYdRleeZQmp8tZur7t0HjGhbGjhaascQaEf4HDbC8UtTT5jin 5LPY++UIMah0t2RfZEK16DlGa97yJQ2KLSYYM/J+ph8CUHeV79S1RXW3X6bvv/pVynlazQcHWNA WDexR6CE3AtHKIPJyfw== X-Received: by 2002:a2e:8189:: with SMTP id e9mr49722434ljg.333.1637569031865; Mon, 22 Nov 2021 00:17:11 -0800 (PST) X-Google-Smtp-Source: ABdhPJyyw8QbIK+a2uYCC8OznhZgNI1wOeaIe8D52IkS0IY0BnNrqdH0cuZGfNQnoOd5pQEdGsEnpnbAZdqONNb8IN8= X-Received: by 2002:a2e:8189:: with SMTP id e9mr49722407ljg.333.1637569031613; Mon, 22 Nov 2021 00:17:11 -0800 (PST) MIME-Version: 1.0 References: <1928246.j4tpOohVRJ@thomas> In-Reply-To: From: David Marchand Date: Mon, 22 Nov 2021 09:17:00 +0100 Message-ID: Subject: Re: [dpdk-dev] [Bug 826] red_autotest random failures To: "Dumitrescu, Cristian" Cc: Thomas Monjalon , Lincoln Lavoie , "Ajmera, Megha" , "Singh, Jasvinder" , "Liguzinski, WojciechX" , dev , Aaron Conole , "Yigit, Ferruh" , "ci@dpdk.org" , "Zegota, AnnaX" Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=dmarchan@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org On Fri, Nov 19, 2021 at 5:54 PM Dumitrescu, Cristian wrote: > On a different point, we should probably tweak our autotests to different= iate between logical failures and those failures related to resources not b= eing available, and flag the test result accordingly in the report. For exa= mple, if memory allocation fails, the test should be flagged as "Not enough= resources" instead of simply "Failed". In the first case, the next step sh= ould be fixing the test setup, while in the second case the next step shoul= d be fixing the code. What do people think on this? In such case, the test must return TEST_SKIPPED. I did a pass for cores count / specific hw requirements, some time ago. See https://git.dpdk.org/dpdk/commit/?id=3De0f4a0ed4237 --=20 David Marchand