From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2B6F741D8D; Mon, 27 Feb 2023 09:41:51 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1B89941151; Mon, 27 Feb 2023 09:41:51 +0100 (CET) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id 4172C40A84; Mon, 27 Feb 2023 09:41:49 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1677487309; x=1709023309; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=Wo/lOcWWrtRQj/S/tMNwr2JvAto3lGP/X5D5wGQzvn0=; b=QBbHJNt//gM8OP06kE/Krzx6uomK6JVNx6OEQLxDmh7Eejz0DQ2brfaT U63vvPhDB/04sM5OdHczHJHdltv5dYT86dAPGnK0WOd83/5nPMk3fOkxR UHjeObAcl8SWrqBDKiVDBFEwUw+rnsaDnUN2UqltosaHWSmuTxi930Cpg faRKGr6eEMW23bTlVFM25AGZ8+nj7JQ31IYhdUmkcy+V5Mwe+ErLrLwP3 6lek5MJv0k89rVmbcJZ8I/+OkZd7TUw6JNKknQGXaAQXFdhwB5dMxPRMw OMuyCkKa/UsKlsajauoOsN38EB97gfKiRlJq6og4wiEPJ87OmreERyfYg w==; X-IronPort-AV: E=McAfee;i="6500,9779,10633"; a="314235802" X-IronPort-AV: E=Sophos;i="5.97,331,1669104000"; d="scan'208";a="314235802" Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 Feb 2023 00:41:48 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10633"; a="1002650842" X-IronPort-AV: E=Sophos;i="5.97,331,1669104000"; d="scan'208";a="1002650842" Received: from orsmsx603.amr.corp.intel.com ([10.22.229.16]) by fmsmga005.fm.intel.com with ESMTP; 27 Feb 2023 00:41:47 -0800 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Mon, 27 Feb 2023 00:41:47 -0800 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Mon, 27 Feb 2023 00:41:46 -0800 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Mon, 27 Feb 2023 00:41:46 -0800 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (104.47.55.171) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Mon, 27 Feb 2023 00:41:46 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=G0exupFfqgyGbmgA6bLYQ9au4756LEryzmHzj6EbyOHVR1d1ia0neYKGpYgO/cmZrXxUQQpJaTho7U96xdbBkIn7Noyh7KxzgjMWchhNEcMObtAhXAWmti/JiXwqV7gTIJXcgvPc7MV/Lehc6pHVTDrXpqiH8ZgUiMuiagslQ1vULI/+NKLaTVB++nuKVWWEMuOKyWSpQ50SpawWjAbg/T5Vho1wX2iFv1oXU0IxG3T6Q+GZmqcM179YLxsDqbuOxiTFP6x2ehig4/7qZFB654Mo/jszvh2wtd17jRo8SO8RaB3ooTmykczVqRYml1W6n46/jpKIr0gImZe5WkMSOQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=rmq+RnhvZVNLzZsjjRaaOdW8/508Zi3B7oBjWylqNdg=; b=P1XfZ7+A72YUO6na5W9LUm687M1scoS/7o5VVsmeTfq/hw7CdJom8Z2yfsE/8LgCBKkp7ag3f6oLlvnPFzcVE3PQXpVPCP1zt6yx6o9Jtq5Ga2EQvrObMb1mM3M4JINIbDeB7IhnmAh+vtiMsU/e25t7ZGbLJJV13caYpw0SkZCu4dGcDelTMpP1XDWYTl6YvxBjdSCoI8bji0gJq1jmZHmP2HbXLe+ONY+nSF8vQ4q9TTJhtnSFe9HEqJezNC+uA2gmXFIAGG0kZF51saO67xwSqwkjB70PuDJ8OmufkAERc6gdTZdhNz2f4UWcDacyubXWKPl5GaQXRJNlhUWiSQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from BN0PR11MB5712.namprd11.prod.outlook.com (2603:10b6:408:160::17) by IA0PR11MB7331.namprd11.prod.outlook.com (2603:10b6:208:435::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6134.25; Mon, 27 Feb 2023 08:41:44 +0000 Received: from BN0PR11MB5712.namprd11.prod.outlook.com ([fe80::f912:bad2:e618:84c1]) by BN0PR11MB5712.namprd11.prod.outlook.com ([fe80::f912:bad2:e618:84c1%8]) with mapi id 15.20.6134.029; Mon, 27 Feb 2023 08:41:44 +0000 From: "Van Haaren, Harry" To: Thomas Monjalon CC: David Marchand , "dev@dpdk.org" , "dpdklab@iol.unh.edu" , "ci@dpdk.org" , "Honnappa.Nagarahalli@arm.com" , mattias.ronnblom , =?iso-8859-1?Q?Morten_Br=F8rup?= , Tyler Retzlaff , Aaron Conole , "Richardson, Bruce" Subject: RE: [PATCH v3] test/service: fix spurious failures by extending timeout Thread-Topic: [PATCH v3] test/service: fix spurious failures by extending timeout Thread-Index: AQHY2YKRDtiKaquGO0iRXNp3CgKP364BW6cAgABmbQCAr1xjAIAIX4GggASLY0CAAAiJgIAADL6QgB+1X4CAAWYosA== Date: Mon, 27 Feb 2023 08:41:44 +0000 Message-ID: References: <20221006081729.578475-1-harry.van.haaren@intel.com> <21760850.EfDdHjke4D@thomas> <4205390.Fh7cpCN91P@thomas> In-Reply-To: <4205390.Fh7cpCN91P@thomas> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: BN0PR11MB5712:EE_|IA0PR11MB7331:EE_ x-ms-office365-filtering-correlation-id: 15dc0221-a8eb-4eb9-f180-08db189e74a4 x-ld-processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: G9f2SaeW7z6dAIFVjXb7EzJe1g2dHg7na3XNB7vMOR5UGVd3N9zti1RCThRfM/2vl0MPLALWj2JZJj6+8JPDGVHEilE0ZOQ7hSC4UiceAVuPsvrKnvwwMeKk0dXJOU48xG17I7267aLshspC5UTK//Efb/FwQh11FyJNfTLrnUW6YDUCzxfg1Qp0YmdCyT7kxfiAm4KEwMGX3lsXg4E25EwAwD2D0d7mCiKSTUPQlt2URU90fmXL1gL0dmwI+M6Bl4jn64fxdzJR6HkM9BEx848D8B/sma/JnspO0VHMvUl158mcgXCd3vtgj9lRtoel3UWMtckQUYAhCGy4hnOzF+Lunq+PHjqDrotpYlsVjM32vmwgCCQ2+iCGx7GLpTsXin/SLm/dtKFalpAAgqxLteM+4PKR4zSb7EuwU9uVHS4ahoXcPP47zJYPtT10DxmF8DTZQoBIdCa6zQSwkg2q6aVFTa5W6bJK3EcL/Lw/mx0Uc5U2Z0mLICquNZY5Rnvx4z5mUyl1BStLowHPzZT3436jLmKJWQLMlmG1ACtsJBYaXuO0LvdC2RXVb6vwCVtZkKn8wu3XOyM2xlrZC7iZGZLGnD7Uw3O1tfORQ+hIlkX3sZcfcn6COw5iPdbECoLG4RU1MHBk6frfSRczNmyIJhhBXBk6OtjKXkNu01FU8hjKFvdsOfBy4X2773lHib7n x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BN0PR11MB5712.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(39860400002)(396003)(346002)(366004)(136003)(376002)(451199018)(55016003)(38070700005)(33656002)(86362001)(478600001)(41300700001)(6916009)(66476007)(66446008)(64756008)(66556008)(52536014)(8936002)(4326008)(71200400001)(76116006)(8676002)(66946007)(7696005)(966005)(6506007)(316002)(54906003)(5660300002)(186003)(7416002)(2906002)(9686003)(83380400001)(122000001)(107886003)(26005)(53546011)(82960400001)(38100700002)(66899018); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?cg9Nme7auBxxCQ9Ne08SU+ylAL8pDnrqg4g7dcp/Pb2/9uD5OOFXr+mFt4?= =?iso-8859-1?Q?vYJgLp84rvj1Z5gGArT16HNrnWjjRzR8xv+Q0Qq7eZPI3Eu/TdSU0buO2Q?= =?iso-8859-1?Q?JeXEIrIvaW9CAqWtj4CLKhfA+sVzmS8TRPOY/4ZKQ7Wpe9uP+kMk3RL0M5?= =?iso-8859-1?Q?KrKLeiUKwP+SpU8NTJ7H72pC1w6WdWbHZUcMIokSpbIhbKH/yIG7fYejSV?= =?iso-8859-1?Q?Bx5jp6zUVB1Xr5vxWadUEOelZ75yK3zHU0h2iNiTrR4y5kl8ehS5CFBI6L?= =?iso-8859-1?Q?Vj+YqbsYtBaVU8W6mTT/mKW8hKmdN0iKpcv19t9Jbq4FTtQYViYlPc/A1G?= =?iso-8859-1?Q?j4c3Tgg4KGX2pNMxdrN/VR57blbT5quruJkjBbBsMuN8UvEWIZkeGgGr6e?= =?iso-8859-1?Q?BTZLWmSYi7mejhY85A7SEljELaNqeeeHE2zGZcAnAXPwz/wTEzLMNqW/To?= =?iso-8859-1?Q?FUwuijVosy8leUgMHijLtkoDk5Ozf+WvHgeGWyzioMyCa99SRcxreAy1/t?= =?iso-8859-1?Q?kOjTXI0VZaTsRUtjQxe7/CtKoCVUxa3kcX1igWvxE9HXTcrsiyZyWiU7Wn?= =?iso-8859-1?Q?IwQIWtZQIxXz4mrnT0kmZjsE/0Sl/F3Fps5IUZtqdYIn/f4jP+ypPKenQ6?= =?iso-8859-1?Q?rWV/taXWasG3K0fD+Mig98vVHuzewEx3IFFpi3ealQMHrhcDTo8zLtq04O?= =?iso-8859-1?Q?8OK6sGTv1+yvJ9wVJwp4ftMvLBUQWCMfMPzibhWNI03+vfnjH9/2hr96kt?= =?iso-8859-1?Q?OSAXJUxVqoN1JKnJ4mRMH0j95rIweecaNtHaaLJvxs/u7Mkut+RJ/mor3J?= =?iso-8859-1?Q?B5rFWfPsamhIiI80WfcFUermTIPBNXp395yVsrAE9YXjYC4aa/xeaWWr1n?= =?iso-8859-1?Q?gbciBFu74Eewt0sBekO2bjud1nHdzj/7GsGRdKaPV8FdnXN3hrm9gCQOO+?= =?iso-8859-1?Q?ywGrxXtEy0fv8lzVxIjUFSYraClBfTM62i5Gkwf1tajXdYfLJEvVFK+8YR?= =?iso-8859-1?Q?c3uPVBf+jOX7oYKcU2lFHpjxDdgf8wphRru8laqK+xGMdvQHynkB5aFT/I?= =?iso-8859-1?Q?hNyzp0x/SS6Z52UZKy/5xqgHwXkxOWBzlzlOMYThFgZuoqsKgDSw3LpMWf?= =?iso-8859-1?Q?JAq8TkPYEiwKfNOZXFdsXaG4GYyFRqQ4ZSaTq9zYRWIcZFtVVhgg4zO5AH?= =?iso-8859-1?Q?8mOd/oCJjtyW+ni/TqMNepIzq5raMOpsch4YlQOzcT2sngJVIKChbQFxPG?= =?iso-8859-1?Q?E2j31sgOy/vBfz3gc7LPp5FbxUL6LvbIqDWXqWMtSkNZWaHVlrps03+l2C?= =?iso-8859-1?Q?ojNILU+X9760Zmu3wpLRMQDXE/0+wnoH1TxZPnkU0C1l++QSbWIHECXOEq?= =?iso-8859-1?Q?TJKgXloL+v0pX8GY30FCN0nEi7MIcu4cVYdgJh2q3fAoTbQ67za3FQCYwg?= =?iso-8859-1?Q?0E6C3VXRl5/UVJ0cjKvekktNPtorwbBTb7Blk/GXqqUPWywR4ZiRO/b469?= =?iso-8859-1?Q?DJTZs8RqDL0G1x1lIO+D2jVEmgYE+5veFCrkg0Uvf6IZB4VtWAIquV318j?= =?iso-8859-1?Q?R4EMwq0BMQpgXa1uXpDiANFJsNlhIGGrtmNUbFmS0s0QC6yDlhcTCNXfdm?= =?iso-8859-1?Q?DQJgIfBazKl4EgGPtVYzJKMHp/pU9Vs8Sh73FobPyGKuxSep9hTvzmvw?= =?iso-8859-1?Q?=3D=3D?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BN0PR11MB5712.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 15dc0221-a8eb-4eb9-f180-08db189e74a4 X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Feb 2023 08:41:44.3766 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 9o2OxmNQK09nKXuVYjo4zcbm/XGldoBM7es03+vdVFKdcNgnObjoGnNWTRMZNYB2c0IeBX/g0Ej7aRTgvvyw1eWihl/Z+jDWcIAfueeC1io= X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR11MB7331 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org > -----Original Message----- > From: Thomas Monjalon > Sent: Thursday, February 23, 2023 8:15 PM > To: Van Haaren, Harry > Cc: David Marchand ; dev@dpdk.org; > dpdklab@iol.unh.edu; ci@dpdk.org; Honnappa.Nagarahalli@arm.com; > mattias.ronnblom ; Morten Br=F8rup > ; Tyler Retzlaff = ; > Aaron Conole ; Richardson, Bruce > > Subject: Re: [PATCH v3] test/service: fix spurious failures by extending = timeout > > > We are talking about seconds. > > > There are setups where scheduling a thread is taking seconds? > > > > Apparently so - otherwise these tests would always pass. > > > > They *only* fail at random runs in CI, and reliably pass everywhere els= e.. I've not > had > > them fail locally, and that includes running in a loop for hours with a= busy system.. > > but not a low-priority CI VM in a busy datacenter. > > > > > > [Bruce wrote in separate mail] >=20 > Bruce was not Cc'ed in this reply. Correct, I missed that he wasn't on the thread already, thanks for adding h= im on CC. > > >>> For me, the question is - why hasn't the service-core been schedule= d? Can > > >>> we use sched-yield or some other mechanism to force a wakeup of it? > > > > I'm not aware of a way to make *a specific other pthread* wakeup. We c= ould > sacrifice > > the current lcore that's waiting for the service-lcore, with a sched_yi= eld() as you > suggest. > > It would potentially "churn" the scheduler enough to give the service c= ore some > CPU? > > It's a guess/gamble in the end, kind of like the timeouts we have today= .. > > > > > > Thoughts and input welcomed, I'm happy to make the code changes > > > themselves, its small effort > > > > For both option 1 & 2. > > > > > > For time-sensitive tests, yes they should be in perf tests category. > > > As David said earlier, no timeout approach in functional tests. > > > > Ok, as before, option 1) is to while(1) and wait for "success". Then th= ere's > > no timeout in the test code, but our meson test runner will time-out/fa= il after > ~10sec IIRC. > > > > Or we move the tests perf-tests, as per Option 2), and these simply won= 't run in > CI. > > > > I'm OK with all 3 (including testing with sched_yield() for a month or = two and if > that helps?) >=20 > Did you send a patch to go in a direction or another? > If not, please move the test to perf-test as suggested before. > We are still hitting the issues in the CI and it is *very* annoying. > It is consuming time of a lot of people for a lot of patches, > just to check it is again an issue with this test. >=20 > Please let's remove this test from the CI now. Patch sent: http://patches.dpdk.org/project/dpdk/patch/20230224173637.24326= 6-1-harry.van.haaren@intel.com/