From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <dev-bounces@dpdk.org> Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 24A0FA0C55; Fri, 19 Nov 2021 17:53:55 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 9434C4113F; Fri, 19 Nov 2021 17:53:54 +0100 (CET) Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by mails.dpdk.org (Postfix) with ESMTP id ABA3240140; Fri, 19 Nov 2021 17:53:51 +0100 (CET) X-IronPort-AV: E=McAfee;i="6200,9189,10172"; a="234682851" X-IronPort-AV: E=Sophos;i="5.87,248,1631602800"; d="scan'208";a="234682851" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 19 Nov 2021 08:53:50 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.87,248,1631602800"; d="scan'208";a="507972394" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by orsmga008.jf.intel.com with ESMTP; 19 Nov 2021 08:53:50 -0800 Received: from orsmsx603.amr.corp.intel.com (10.22.229.16) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.12; Fri, 19 Nov 2021 08:53:49 -0800 Received: from ORSEDG602.ED.cps.intel.com (10.7.248.7) by orsmsx603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.12 via Frontend Transport; Fri, 19 Nov 2021 08:53:49 -0800 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.168) by edgegateway.intel.com (134.134.137.103) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2242.12; Fri, 19 Nov 2021 08:53:49 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Px+3lM/mhTWjeNlFjkiu8Vpfy/2TEN7ei8lt2qz0Os5qwFHcWck5DUa8YX8A8kVFKOOxdGB9CDJNp0afOh3VBp3kzmK76K9L+BiDOmEYVLX0+RNjRcAen/6fAMgnwL465vIvRl3AQz4Nl1joEBHejd1fqjNzhzs6fua4+TRa/NrbDx6Yf5MOaUkHyOlB7O8p+AngCn7DLzCo07XJW1lcDs5ccpt+6Sf7Tklt2TGS3x5ItNlkk4FhWhZ1HaOaaS5TbhVJHGZljMfjAaazv47LuaC4jxraVIs39FLkSArk3vDVhx8dxp71pfcjv01uVaRLd1ZUdK3JHZNsnAiyDKxcwQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=D2XAojo3ZIrtgLmO/dAWilIm44WRCcqMQMjj/JddJak=; b=aehGOiDpgBCFCHNXRWAJBrldfOSdZmfXQxzCojdlrf8TFzevKpxnbkKMnAAejh+ltjfPBKwQBkGXnKirxCyrphFs6vYiqb+sWkmjZxB/Cl9nKmcWDbm/95Ux3ZAsjhB89/VcQpFqDHR7gP54QfSXhq6xZt3nviK2kHmCAAWsXNvBD23ZzhwsCOL3IzXdoLgwWjZExkfO3IZc0N1CnTRPQKbEM/hxz4XOnuUbwwnp0mkLeUzip8vCjp30ievzoXFuVl9G1wAZAFHjQWiGROpCXIp0LpmWGDpb+z2DuiPdLM+nEFyX+vvDwQZZebqxGoRmUbcKHUN11C9Zmwf41tocSQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=D2XAojo3ZIrtgLmO/dAWilIm44WRCcqMQMjj/JddJak=; b=exzJ+KoIhpyAYV+pVJNDGeQLHjQCD+qAoWa9trp1N3+J1e8A1cisaT2PxFAI/HK6su//vqNQif65fxTfVXan61vFKfcCCM6DzJlSbVMuKzhbYsIYYJuHNDyQv6+HW6Iq65zf6Y7eyAN8apbv5QLx1JtgyJnVNKlM6SMUpEh/a4U= Received: from DM8PR11MB5670.namprd11.prod.outlook.com (2603:10b6:8:37::12) by DM8PR11MB5621.namprd11.prod.outlook.com (2603:10b6:8:38::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4669.16; Fri, 19 Nov 2021 16:53:48 +0000 Received: from DM8PR11MB5670.namprd11.prod.outlook.com ([fe80::c0f1:1135:ceb5:ac10]) by DM8PR11MB5670.namprd11.prod.outlook.com ([fe80::c0f1:1135:ceb5:ac10%9]) with mapi id 15.20.4669.016; Fri, 19 Nov 2021 16:53:47 +0000 From: "Dumitrescu, Cristian" <cristian.dumitrescu@intel.com> To: Thomas Monjalon <thomas@monjalon.net>, David Marchand <david.marchand@redhat.com>, Lincoln Lavoie <lylavoie@iol.unh.edu>, "Ajmera, Megha" <megha.ajmera@intel.com>, "Singh, Jasvinder" <jasvinder.singh@intel.com>, "Liguzinski, WojciechX" <wojciechx.liguzinski@intel.com> CC: dev <dev@dpdk.org>, Aaron Conole <aconole@redhat.com>, "Yigit, Ferruh" <ferruh.yigit@intel.com>, "ci@dpdk.org" <ci@dpdk.org>, "Zegota, AnnaX" <annax.zegota@intel.com> Subject: RE: [dpdk-dev] [Bug 826] red_autotest random failures Thread-Topic: [dpdk-dev] [Bug 826] red_autotest random failures Thread-Index: AQHXvBV8PibP8XzJwEqU7csDaDVaD6wAIMGAgAAFTACAAAFNAIAEjjbwgABePACABQZOAIAAmzQAgACbABA= Date: Fri, 19 Nov 2021 16:53:47 +0000 Message-ID: <DM8PR11MB567043A45C9AEA1BAAF8F816EB9C9@DM8PR11MB5670.namprd11.prod.outlook.com> References: <bug-826-3@http.bugs.dpdk.org/> <DM4SPR01MB00033233A5A39A2336D5D38394989@DM4SPR01MB0003.namprd11.prod.outlook.com> <BN9PR11MB53724D41DC05875D1D7F8E12949B9@BN9PR11MB5372.namprd11.prod.outlook.com> <1928246.j4tpOohVRJ@thomas> In-Reply-To: <1928246.j4tpOohVRJ@thomas> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-version: 11.6.200.16 dlp-reaction: no-action dlp-product: dlpe-windows authentication-results: monjalon.net; dkim=none (message not signed) header.d=none;monjalon.net; dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 03d81ed1-6f4e-48fc-410e-08d9ab7d27fa x-ms-traffictypediagnostic: DM8PR11MB5621: x-microsoft-antispam-prvs: <DM8PR11MB5621AD185EEB1E6E88C8DB6DEB9C9@DM8PR11MB5621.namprd11.prod.outlook.com> x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: wCLophTr3DI4YnPSm5Qcjw2tIe0M99ydsW1cfhmWKTZpQ9edqVDOV435B73nSKnvF1CqKCWPlvoJmS4rFEX56ALJUO+m1lVvNHoeYi4hR3rF3c/4OUxuxTD/AMYnHT+q3mTeiRlSFTsAPClgPSS4mFU2vqM+E8cZYEQ+JpQN27l6Tt+WNx7sjAA/u1ARsP4qV/ZUQMYWUWQEIGfEgvihqx0J6zlc/C8Zvfl294Z5o97T9BLlAoWq9bcS69tnrhMQbEOGv2y3PgR5zhxyg774Lf4bk1ybnI1RhldmeUwLjQ2qCop2H/LhYPdUn5tF9eiQrYnFaOrszxMuMc9iqruyptYy5WXVsuYM54zarJPE6HNjGNMx/XJOCTDvUcyxwCeX5NIFg2QcYlsDwq0CoWzHU84gcKa/EB2OCIKYYUnyedqMNOd0G/B5TkTJ9tUMrIk8sLdj8RbQxW3wBRPuRO3wgbCsoqR0XfNADjoC1hfFoZygDC9bXagKforxVvTgzxSwwaMQLyZd8AVKNGnXyEjtoG/nF0k11ms2XR2jQTrOXPvbfa0z1D4LQxroJ+P8n6qEaBTmbLVPCIY3twDv6N/X0JnMAD29pSu+TGn/gYJ2OIGVzqkPwBydbHG2y9Kv/UdL/b2xuB9/cvxM+ya2QUhk1TbRjVgX0+KfUfOyANGtvv7oHUIniuhnEYqYkt0MmvQLGXa5Ot5qjd00DBeVZENK5Q== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM8PR11MB5670.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(366004)(4326008)(316002)(107886003)(5660300002)(53546011)(8936002)(26005)(2906002)(8676002)(110136005)(122000001)(54906003)(38100700002)(66556008)(7696005)(66446008)(71200400001)(6636002)(508600001)(66946007)(66476007)(33656002)(55016002)(9686003)(82960400001)(52536014)(38070700005)(86362001)(83380400001)(76116006)(186003)(64756008)(6506007); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?wS6ZgBXjV2Vn1HQ/SWyIw59CWAiT5ciXmimgcxe0LRXE9DrCPMatKxmF5ukm?= =?us-ascii?Q?gzMQ3FDN4WziJK9bEvbzMAzMjRRPbOgl9/6rkDfiWJefOwVCOxUd3RzzbzcP?= =?us-ascii?Q?GJ4VA6twpssGPtxHA81ostCNjTcI/imnSmjazVcN3WJVf64IlkX28DEMA65S?= =?us-ascii?Q?GE6R+DMXE4tUGEgEOMXToyNE4iSC3zl5aN78wYJra7OZjwAA8y46/ve+KXka?= =?us-ascii?Q?2vqXpqMZx1ZizosRHl4G3vnIENHhCzq2leCCZvQpgB8kYFMMwXOpm7wXr5bL?= =?us-ascii?Q?tt6ejNR+VxN6uagFIMH59KDb4HyRBy6HpETClnubmMBRrf6Hcmbk/VUQIfSe?= =?us-ascii?Q?sB5SCXGnxAR79vbAaszK9zvGEXY3gLYZbd/uT0JhI/wifLnuYNZPZtpfDWwO?= =?us-ascii?Q?X13lO2r1vQJvz6wqYv7WKROOypVWbHNAe2fIT1K4RSP4KX+tfiDR6D6p7swQ?= =?us-ascii?Q?shp1W25Crel7AT2soYb7Nixx2jSqixnRqBP9p2iCn9m6AS+m794jf8rvq7Bf?= =?us-ascii?Q?QmEb+mSNvhqs2B3PlamQT1KsbWAGxC2mnyf6FwgvAjdjRvRG0iaFSNK9O3HR?= =?us-ascii?Q?hBwECc+bEjqgoB/Lc1o4KkCMxieq4eUepfbOMOsDpG46JXHzFpBDuV75QsPx?= =?us-ascii?Q?K5X+iSPyPKYwHFOBGCjrL6Mcd5U3/9JK94mlJQvtOuS38e/sisTFVkkJJZSV?= =?us-ascii?Q?qvMN1ICv6aJOP/HV5h9VtzilfUS8egLtIkIaUwhwJnU5sri0mhTsWkBAtFhg?= =?us-ascii?Q?DpM7odHKng7bL4w8KriI4GI0tcEbozA2PlH4ekGdgpVwTQHdBT0azkMVZorn?= =?us-ascii?Q?Nf0afc6ttQOnUf1azJ4mjYEWENP6f43qIxL/nJdp27Sxt5YgF/6BPQaWSXtc?= =?us-ascii?Q?jR5fEX31Ch4p5CD8wK6eflJIq/suyd3gljIhuw8q8AVb2KPKknQLuygB1yMq?= =?us-ascii?Q?LyFCq/8j1mA8PVNqtr5bLwLkVka/Sndjc7EEdWWhGbn1Fb/phc0dHTdbf+uB?= =?us-ascii?Q?qxnZMYsbo99/yKNfYKyFK6oyptapWfGqv2NjhTMD+qqM89XkY3+weOnKI7hA?= =?us-ascii?Q?Kg5fILfnVH1BCTY699H6l3UllJDFLim8at/Wn9qMWDOH4qgXyGi+3y09+PXk?= =?us-ascii?Q?Y4fBDPErQo77hfLEX2U1unClLZ76/UwEszTaqFnIWv8BhOmtZsXxRQEBSjaD?= =?us-ascii?Q?M96Ubz9Bx0cMqvUevpyQf8z/O9cBL7HmIdgfEFjY9IJ/DX6JvhmVfN93Bc0M?= =?us-ascii?Q?90Fb4mofujco1LuQc9GWp7sI2HKsuYa6CnPmOkiKW454WdX6iWqMMbw5GFU5?= =?us-ascii?Q?c9pm4L56n48WQjeqqLu+qtrmg/SGnw2PHSfYFyO1l7LfiM4++IgZvj/h2acD?= =?us-ascii?Q?5eYO1T3Bk5MMx69OkTnrP8fcuUBtJeRx6al5MV7Wq8W60bmhc23ki3+D71L4?= =?us-ascii?Q?Fzyqexfa8JAmojPYxWLxfKM2KmXP0P8981v/jeFe2LpEkuNc/P2vaibqBdyu?= =?us-ascii?Q?A1k4EgPKLz5RgURXaWXp5Re8WRIrxGwWh+G8CcLAJnR8G1Hqj5Wnwfuw1/qk?= =?us-ascii?Q?ni06mKOsGsu6HYcvENWyxu3njCdscBBuXPPmfQoNXlP1S28pIOPjzSWv8wES?= =?us-ascii?Q?Zolq1sGVPtIIDtPkZdb7T7d+c7/ywO4Ih9eYdyb0UDOICBFR5dWQ2qzFLvkV?= =?us-ascii?Q?Uj0H7w=3D=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM8PR11MB5670.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 03d81ed1-6f4e-48fc-410e-08d9ab7d27fa X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Nov 2021 16:53:47.7558 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: HF5D1woFNKl+ydsb/p1hsZQe7L2xgVZQXGT+CVweEcNhVeAJEBQ8IBADnKEHR8+YauUqIBwdjph6OSfR/J1GXOBr08prIemH8fP0EdaGNQs= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM8PR11MB5621 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions <dev.dpdk.org> List-Unsubscribe: <https://mails.dpdk.org/options/dev>, <mailto:dev-request@dpdk.org?subject=unsubscribe> List-Archive: <http://mails.dpdk.org/archives/dev/> List-Post: <mailto:dev@dpdk.org> List-Help: <mailto:dev-request@dpdk.org?subject=help> List-Subscribe: <https://mails.dpdk.org/listinfo/dev>, <mailto:dev-request@dpdk.org?subject=subscribe> Errors-To: dev-bounces@dpdk.org > -----Original Message----- > From: Thomas Monjalon <thomas@monjalon.net> > Sent: Friday, November 19, 2021 7:26 AM > To: Dumitrescu, Cristian <cristian.dumitrescu@intel.com>; David Marchand > <david.marchand@redhat.com>; Lincoln Lavoie <lylavoie@iol.unh.edu>; > Ajmera, Megha <megha.ajmera@intel.com>; Singh, Jasvinder > <jasvinder.singh@intel.com>; Liguzinski, WojciechX > <wojciechx.liguzinski@intel.com> > Cc: dev <dev@dpdk.org>; Aaron Conole <aconole@redhat.com>; Yigit, > Ferruh <ferruh.yigit@intel.com>; ci@dpdk.org; Zegota, AnnaX > <annax.zegota@intel.com> > Subject: Re: [dpdk-dev] [Bug 826] red_autotest random failures >=20 > 18/11/2021 23:10, Liguzinski, WojciechX: > > Hi, > > > > I was trying to reproduce this test failure, but for me RED tests are p= assing. > > I was running the exact test command like the one described in Bug 826 = - > 'red_autotest' on the current main branch. >=20 > The test is not always failing. > There are some failing conditions, please find them. > I think you should try in a container with more limited resources. >=20 Hi Thomas, This is not a fair request IMO. We want to avoid wasting everybody's time, = including Wojciech's time. Can the bug originator provide the details on th= e setup to reproduce the failure, please? Thank you! On a different point, we should probably tweak our autotests to differentia= te between logical failures and those failures related to resources not bei= ng available, and flag the test result accordingly in the report. For examp= le, if memory allocation fails, the test should be flagged as "Not enough r= esources" instead of simply "Failed". In the first case, the next step shou= ld be fixing the test setup, while in the second case the next step should = be fixing the code. What do people think on this? Regards, Cristian