From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 292C9A055B; Tue, 16 Feb 2021 18:44:55 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 968C116076E; Tue, 16 Feb 2021 18:44:54 +0100 (CET) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by mails.dpdk.org (Postfix) with ESMTP id 7FBF040690 for ; Tue, 16 Feb 2021 18:44:52 +0100 (CET) IronPort-SDR: N4Gkd6mBbXvhzrsbL3Q1wtGQFWrRhF4pagflzPLUVXrSzT7eYo0CjvPJVDimdVTonsvIc7O9VE UDUd6x0rFdZQ== X-IronPort-AV: E=McAfee;i="6000,8403,9897"; a="202155816" X-IronPort-AV: E=Sophos;i="5.81,184,1610438400"; d="scan'208";a="202155816" Received: from orsmga001.jf.intel.com ([10.7.209.18]) by fmsmga101.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Feb 2021 09:44:49 -0800 IronPort-SDR: bTJoubfYpl/Yr4iYj3NJgGQu1F/kOXv3VfqKVIBQ+xpY1zcjN46r+9fJgrhbrDqh8lucIO8ScA wU9qqK0qm/ZA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.81,184,1610438400"; d="scan'208";a="439010787" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by orsmga001.jf.intel.com with ESMTP; 16 Feb 2021 09:44:49 -0800 Received: from fmsmsx601.amr.corp.intel.com (10.18.126.81) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2106.2; Tue, 16 Feb 2021 09:44:48 -0800 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2106.2 via Frontend Transport; Tue, 16 Feb 2021 09:44:48 -0800 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.172) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2106.2; Tue, 16 Feb 2021 09:44:47 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=YWOh82poKnQJX9/TTbl1fCXwnAbWl+YtKeps0Qo5mWbjCl1ipjVEjJ+e8xvg55d9yukTP9e37/HnSFzW6Lh8rn77iJoM/8O+lRuR1DFrcAZ83hz+923yleHVEEvv0VS83/P/1thyXy8PByps7h2fsCcuU/t9OyCUgMtf8XF2BLGtNM1xJ+CWhl12IlVGDGp+hLUarNYNEcWbDT6b10DymsegFPVPZ0tsa/HQPs8hV8vEba/4Z/tolj8/e799k0AQA0ptjWVTbF6j1dr4xn2EevGGJGGObQjTuJlXmHezRcbB4P0nOnubry4xv9zfWeLZ1T2/3zpUJB7yJ0ZP2UZnNA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6+DRrtNq+1cgD9+7Rfknw84E8SrKA1C6RBJ6dVZfbfM=; b=RyijGWFqS6NPuAR5spRAxG4/WDE+dAYHvCY6X92PhRuB9BDcKFfRiH48EfyFhLzRGWsD2+eDsA53FPS73oe12e9C3kVK8f4Z9QZnQdGL323fVFGKVvthdrJQs1D2XKIjiHfNamy3ZEBG8P44TUQ7EhEBoo65OjQaSR/Txy4n1wifAmDWnuVEiLerUqjBgf/e+bPc06lo7UvcDuW9/+/S/IamALvv+/TGXUFSuifqm7KLaMn/EFikCGSl5sNE/TZfHfFeEn6BEA0V9UrkU5R8ckSx1C1z6Jtw9emcSOt8Tfjxn+91Gb90jZOmGohBaDJ+rLd8APS6ZGT+0P+dOdPUvQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=6+DRrtNq+1cgD9+7Rfknw84E8SrKA1C6RBJ6dVZfbfM=; b=uTfWXX4Xexq4c91X94jFPdUQsR3AOEjJp4yUxb9Hv4NqNQZInj53Mw0c7Qi0FFacVNG1ZEhEMAYy6fvbDDQ2hGu/wirM5J7GU3wq0EuFfyjeSbsydF/Qkrtlh0VokjgMXcJ/F9s7IJapOxxAcrOhkTLfXRZEWaM53Vibarp4s24= Received: from BYAPR11MB3143.namprd11.prod.outlook.com (2603:10b6:a03:92::32) by BYAPR11MB3782.namprd11.prod.outlook.com (2603:10b6:a03:fd::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3846.31; Tue, 16 Feb 2021 17:44:37 +0000 Received: from BYAPR11MB3143.namprd11.prod.outlook.com ([fe80::e1c7:915f:8714:9ce0]) by BYAPR11MB3143.namprd11.prod.outlook.com ([fe80::e1c7:915f:8714:9ce0%7]) with mapi id 15.20.3846.041; Tue, 16 Feb 2021 17:44:37 +0000 From: "Van Haaren, Harry" To: "Richardson, Bruce" CC: "Burakov, Anatoly" , "dev@dpdk.org" Thread-Topic: [dpdk-dev] [PATCH] eal: support using 0 as coremask for no-affinitization Thread-Index: AQHXBEg3CvBxe3ZZ9EqTCO7E5sex66paloeAgAAC+gCAAAGyAIAAaeZAgAAFToCAAALuEA== Date: Tue, 16 Feb 2021 17:44:37 +0000 Message-ID: References: <20210216094300.27889-1-bruce.richardson@intel.com> <313c223f-bf1c-9307-75f8-0a0c1da7fd21@intel.com> <20210216104652.GB136@bricha3-MOBL.ger.corp.intel.com> <42706d4c-f8de-55c5-1161-b1e54c77599e@intel.com> <20210216173057.GE136@bricha3-MOBL.ger.corp.intel.com> In-Reply-To: <20210216173057.GE136@bricha3-MOBL.ger.corp.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.5.1.3 authentication-results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=intel.com; x-originating-ip: [86.40.59.136] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: febec663-c77f-44c0-cd72-08d8d2a287b7 x-ms-traffictypediagnostic: BYAPR11MB3782: x-ld-processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: mnoIJd2aYnU3u36qbCTXS2+QeizDm+scQ56ZpHTbvqHrxHYJoHEcE+oVi280MfozNAkM+ok5mPUDax74gsMSYfXmse8DSGdEwfp3j5rWyF+BN2jdjHeK6XJMmRYcHXdJb7pZTuXvrj9W9cRh7NNNXn/MX3XLFtx7QQc4Fz4Ri7p9U9/tpJJvUX6Y+eycqmzAIUByZqDpYi9L8Dj+Ynb7a5TcWlxx6lB/JyiadgLGrlGrq9BxZonrKl4jwYIpckC/pWOoJCz7odzHzf7tpWQw78mq2qgXcVsL3vzHylDqPgC/l21r/4mU3D2mpSvjkD0f/LyT1zJnSHEcUItcsHTZT1P8kj2Q63JfS+knHsQLzH9YGWh05rqemi0TGS7hHXCHN3ZRRJIzLp+LIMDkHWK636UJ4WXvr8fW/ezlvHSY8siutyoVfhOASiK14N96optw00Tt+DUF7EbifvqEoAefxQOSl/uri020AGN6xbONKsqBSYUysCR/3g8DuMNNRMiLfLK3a7EssCPSZqN5x2ZfBVcBxqYLlVMpbweIeDjpl3aJ8+m65WxomAcThO6sI+FUAWREnN+8SI0R4LeoyY/gilsDpQrrJioJSgUe/FJNH80= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BYAPR11MB3143.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(39850400004)(136003)(366004)(376002)(346002)(396003)(55016002)(52536014)(4326008)(83380400001)(66446008)(9686003)(64756008)(53546011)(66556008)(66946007)(6862004)(54906003)(186003)(6506007)(76116006)(2906002)(66476007)(478600001)(6636002)(71200400001)(966005)(8676002)(33656002)(7696005)(8936002)(86362001)(5660300002)(316002)(26005); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?yDRXeuLK3PO0XqLINNbCczbtmDmZhNiQIORfcoGCTOOrlozOdHGDlCV2Onj9?= =?us-ascii?Q?bl1/raj0XA53dYswC667ql5MQiRyfZdVSe1hbie6AhsMkaU8Opwdqh2XbyHy?= =?us-ascii?Q?fh+HJVDJAYGKmZkzoZ/YrGyGDWJO3Sk6LS9X50WaaU7dpSTopRE+KeSvAbXV?= =?us-ascii?Q?Prj5yly7UPwCS/ETvnxXh8rcUbdkPCy4/A4PQb1WIvy5NeZzC+9mekUPZVyt?= =?us-ascii?Q?a9JQWYcGHm7WPu8MjwBSK/FOxNHBMrR0wJVGR1n6Q23GXzLSFSo80HHLC3NS?= =?us-ascii?Q?BblxCNk46uFWg5AWyT/Suzbc9m/TLTxPHDatfAMMz6LS1CH9Kv+o54HDnEUV?= =?us-ascii?Q?HvTD3R4UmNMD3CIMrp0L9WhNfe8d2SueRCKXrB2OvG8eisoiDxC+J7M28EPy?= =?us-ascii?Q?SIPhJVED3Pke41lbMw22dvuty+1bxyiKirGcNOb3PnsOFjFsziGoEAx0vnOS?= =?us-ascii?Q?137ghK7cm7fWe/q/6R2klEogIIM0oTyL3fZHov5imoS0l2SdVdzc3w1EFHXv?= =?us-ascii?Q?AtqkGD1U21kFXdIb+RcdB85Lxj2zzB7sG+/Og4k05GucHf9dmea/lkrf5fSY?= =?us-ascii?Q?4CqYlyiRYFkSzcz8ImT3nAvM+MEmLIZ7xI7iBzntRxR3M9BCd6i04vnzIg1c?= =?us-ascii?Q?sFeopHk97PIEsOH7dgeNhbROz6qeXrCV7g8Mv44Vd3m0YV/6jQrC45jBd6jX?= =?us-ascii?Q?hCDM8OEJqj9LtEVEnlkHYyEJyE1KSQrz23b9cq5XSupe7NQsn7Mae+hDBC6P?= =?us-ascii?Q?aPyj4yz0o3UeAO45J536EO19mK6Z4mwzFWCLVcZZwHbPqE2/LERd8GNxYc3d?= =?us-ascii?Q?XLxgVAlyIqYisa07szdqNN/ElXSQWFuLde/9CRt+b+ulx44sZ9IzYqkqayqu?= =?us-ascii?Q?LSFyKU2PJv6ay1sbtGr/ieEmCEJgRj62B5CX4Kswi1F2P/S3NhEcPG14IT3b?= =?us-ascii?Q?JLJv6cCpdzLQo7Pbc0HRiBcQQsYoVDEg5Mbd9yPE6+wvAAxSVzW546AY7kZl?= =?us-ascii?Q?yj2hK6lAOdHrdNaMDBUz3/6ThWilLy2veu4R5uZbQP+Er7EzhUrdqarNYok2?= =?us-ascii?Q?VBNBRMZe0A4HV0E5+K6sLem0BCtJQT5048zlBp8QF6HZXs82Yyvns9sYgYan?= =?us-ascii?Q?Lr3pO3+4hVNoufnKUcG2uZjckv4VmrRTqoNLFISoAyB3Mx7qHOu0jTMc4XiT?= =?us-ascii?Q?ofcnexvC4fcCd54GlIwMPwZjdKCzFT3dsnhhhokh9j2okV+o0JbeoYx/3rud?= =?us-ascii?Q?cndbFJsejZ0VaTFspBFU1KamfGZYtdfvBFFc0F3Ruv3a/bNz5Kb5AbkC6zU3?= =?us-ascii?Q?ZP4=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BYAPR11MB3143.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: febec663-c77f-44c0-cd72-08d8d2a287b7 X-MS-Exchange-CrossTenant-originalarrivaltime: 16 Feb 2021 17:44:37.5070 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: EhnBddrkzKxRKkuaow+pS9pxHs3eM2pSaEGYBo1o2Ne0oSrZUde19tqvx1ofXSqIJRuClnAHl0gUYTPMqyuT8lB58X8g3eBfKRRc0Q7DKSI= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR11MB3782 X-OriginatorOrg: intel.com Subject: Re: [dpdk-dev] [PATCH] eal: support using 0 as coremask for no-affinitization X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" > -----Original Message----- > From: Bruce Richardson > Sent: Tuesday, February 16, 2021 5:31 PM > To: Van Haaren, Harry > Cc: Burakov, Anatoly ; dev@dpdk.org > Subject: Re: [dpdk-dev] [PATCH] eal: support using 0 as coremask for no- > affinitization >=20 > On Tue, Feb 16, 2021 at 05:22:25PM +0000, Van Haaren, Harry wrote: > > > -----Original Message----- > > > From: Burakov, Anatoly > > > Sent: Tuesday, February 16, 2021 10:53 AM > > > To: Richardson, Bruce ; Van Haaren, Harry > > > > > > Cc: dev@dpdk.org > > > Subject: Re: [dpdk-dev] [PATCH] eal: support using 0 as coremask for = no- > > > affinitization > > > > > > On 16-Feb-21 10:46 AM, Bruce Richardson wrote: > > > > On Tue, Feb 16, 2021 at 10:36:13AM +0000, Burakov, Anatoly wrote: > > > >> On 16-Feb-21 9:43 AM, Bruce Richardson wrote: > > > >>> Allow the user to specify that they don't want any core pinning f= rom > DPDK > > > >>> by passing in the coremask of 0. > > > >>> --- > > > >> > > > >> I haven't checked what happens yet, but down the line we also set = affinity > > > >> for service cores as well as interrupt thread. what would be the s= emantics > > > >> of those in this particular case? do we want the same ability for = service > > > >> cores (i.e. pick a non-affinitized core)? And where does interrupt= thread > > > >> affinitize in this case (presumably, nowhere too)? > > > >> > > > > I have not checked the service core setup, because a) I forgot abou= t them > > > > and b) I'm not sure how their affinity rules work with respect to t= he main > > > > lcore mask. On the other hand I did check out that the lcore mask f= or all > > > > non-pinned threads, or control threads, is the full set of bits as > > > > expected. > > > > > > > > /Bruce > > > > > > > > > > +Harry, > > > > > > I believe service core mask must not overlap with lcore masks, so > > > presumably using 0 as lcore mask would make it so that any service co= re > > > mask will be valid (which is presumably what we want?). > > > > Services cores -S list or -s *must* overlap with the RTE lcores,= EAL > > then"steals" the service cores from the application lcores, code that > implements here: > > http://git.dpdk.org/dpdk- > stable/tree/lib/librte_eal/common/eal_common_options.c?h=3D20.11#n657 > > > > > Should service cores also have a "just pick a core" parameter? > > > > I'm not sure, depends on what the bigger goal is here. > > Assuming we're enabling this for ROLE_RTE threads, then > > it would seem to me that ROLE_SERVICE and control threads > > would require similar treatment? > > > Control threads are affinitised to all cores not in the coremask, which > means in this case that they can run anywhere on the system the OS choose= s. Ah ok, fair enough yes. > In case of service cores, it would seem that using service cores with an > empty coremask is just not compatible. I would assume that this > incompatibility already exists when one has a coremask with only one core > already in it. Yes, correct, it would leave zero lcores for ROLE_RTE, meaning no lcores fo= r the application. A possible solution would be to special case a zero service core mask and a= pply the same treatment as ROLE_RTE coremask? Others likely have better ideas - I don't have time to follow DPDK threadin= g/pinning topic closely at the moment.