From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 0D63B4596E; Thu, 12 Sep 2024 15:30:56 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id E9A3A427D3; Thu, 12 Sep 2024 15:30:55 +0200 (CEST) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.14]) by mails.dpdk.org (Postfix) with ESMTP id 0057E42709 for ; Thu, 12 Sep 2024 15:30:53 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1726147854; x=1757683854; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=iO7qHVXGSLNNNCc0Gnwlon9jYuOZuwcDGBy6aVCXZo4=; b=RAruFPMJdzogKCrZki8KO6dR9D+oOKk1+5VdRvUJCC+B529Ke+F/dHH8 cEvT+dZ+E+7ePqMRG6XRKiZD1UZFbk7wJ6Dvn868qptP3HiS3CIgThTx9 QYKcAMIxq27FpbbEIU3TolQpboK4zfZjF3A0tY0u0kpOMSDZmqFOcrHF9 bmwkdShcce8P6yVGsFnnMir+qS1cDdGJkO8NG4C9GZR7Wj+YcwDFMjfmP OfKfVn1LmjlCq5We5+fMgWL23GPG9mG1YLe2NF+FNWMJjO53zdSdHjCKQ +KGXik2vM0ldpp1bvrJDIoH/GN/7kj1AnrQXW1+RugBSBhnF/DLjgSVOC g==; X-CSE-ConnectionGUID: 0HOQSVeySomQvKvtOhkRww== X-CSE-MsgGUID: kTkXZBvGQT6ECzMeqESTXQ== X-IronPort-AV: E=McAfee;i="6700,10204,11192"; a="28776685" X-IronPort-AV: E=Sophos;i="6.10,223,1719903600"; d="scan'208";a="28776685" Received: from fmviesa010.fm.intel.com ([10.60.135.150]) by orvoesa106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 12 Sep 2024 06:30:53 -0700 X-CSE-ConnectionGUID: FJQUFsfWQaCY5lfvYcbXKQ== X-CSE-MsgGUID: HHxcxR7HRFGm5gTtIsCEmg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.10,223,1719903600"; d="scan'208";a="67944730" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by fmviesa010.fm.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 12 Sep 2024 06:30:53 -0700 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Thu, 12 Sep 2024 06:30:52 -0700 Received: from ORSEDG602.ED.cps.intel.com (10.7.248.7) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39 via Frontend Transport; Thu, 12 Sep 2024 06:30:52 -0700 Received: from NAM10-MW2-obe.outbound.protection.outlook.com (104.47.55.40) by edgegateway.intel.com (134.134.137.103) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Thu, 12 Sep 2024 06:30:52 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=Y3qlBQlTRdXWqH6ZUTsslAze9Lo6nYV9N0+5jJHADsvE5ciPV2UA6S8MjUYVbJfK0bQrUavZVNhz5kbWaCfkX4pJ+EPcokZzH53n+IWTX+2KYmHP+/fJ4oIIXKtx6jQ7S+eOOZPlBa+Wha70MQwTBDTWYpoDFjpyfLSDLsh7uRkWcQcrWB8goYvR8MJgjXsvdD/FaEIz8WveMRlGXXtTttREorQ/mISiKQ+acB6BkHf/vnkneEDf81+LhEDRNz++rgM4xN0UX4S7eKGG4Scdnnzjnw6Gm90x2Fri/gmKp8khmudNK/xVw7empcymeZ15O1cT9+11iCxC4cUXkyXTVQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=W+1T1v1eqLiwfDkGd+2MbSyMaATjeMd2/SiwLtwxhUs=; b=L+OmhFBWnJQuB/VUwmnJqRwMhmx7Rffbyd+CrxxTiLZ5wYE3Z1U2BWX2Rqluan7XqIDS2nDJ01LtHzQ7/OEejPlz7vRTByCZDbW9FkN/Nk1cK6iqr198kO6VVvJtlinGOgYDJijpe5GrFkO+w+t29g0MAU24OSiZUABckekAkrXscynGvZCScJLBj208B+BOprcx8GMyBIA1xycjSyQIiyzpFUUYmCKUeZcUlYZued0h/3PqX/1rSEsYKbpJjViE+cMFyckVcwyOD20H7cWr3+DzzPtzFG/CDT2UAiFFHUGEqT03PdzLmu9srDSQAGxmKcMOFd9LyPI/+K87A1EAgQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by DS7PR11MB6038.namprd11.prod.outlook.com (2603:10b6:8:75::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7962.18; Thu, 12 Sep 2024 13:30:49 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::f120:cc1f:d78d:ae9b]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::f120:cc1f:d78d:ae9b%2]) with mapi id 15.20.7939.022; Thu, 12 Sep 2024 13:30:49 +0000 Date: Thu, 12 Sep 2024 14:30:44 +0100 From: Bruce Richardson To: Mattias =?iso-8859-1?Q?R=F6nnblom?= CC: "Varghese, Vipin" , Honnappa Nagarahalli , "Yigit, Ferruh" , "dev@dpdk.org" , nd Subject: Re: [RFC 0/2] introduce LLC aware functions Message-ID: References: <38d0336d-ea9e-41b3-b3d8-333efb70eb1f@lysator.liu.se> <716375DE-0C2F-4983-934A-144D7DE342C6@arm.com> <42b8749d-ef6d-4857-bf2c-0a5d700405eb@lysator.liu.se> Content-Type: text/plain; charset="iso-8859-1" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <42b8749d-ef6d-4857-bf2c-0a5d700405eb@lysator.liu.se> X-ClientProxiedBy: DU6P191CA0038.EURP191.PROD.OUTLOOK.COM (2603:10a6:10:53f::22) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|DS7PR11MB6038:EE_ X-MS-Office365-Filtering-Correlation-Id: 0b7e2a59-54d5-46ff-48c0-08dcd32f1d76 X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|376014|1800799024; X-Microsoft-Antispam-Message-Info: =?iso-8859-1?Q?XhREYzvZCYbZ/b5opwRILnFPVJ3aNys82xK+vTpXCmey2PV0/dqwtZSssh?= =?iso-8859-1?Q?Ae26KkRaq/U2K1DSbJ5UguzLhH+0tzQ9DtktwFQWx2uFsT6Rc8nRwvw3eW?= =?iso-8859-1?Q?biUpC41peQAdSEtOFU9I9/0oBeF1ArFLZ6gYuAQBcw/2wuMBDy5phSNhgt?= =?iso-8859-1?Q?cpHrVvD1W6dVztHQeNqelDwBBcx8Q4R1zO755ych5PL4p47j24GA1xRkrj?= =?iso-8859-1?Q?2wDiOfwBYCFvdVfu/k83+2iq9gwzEpyzYS3FrU1b2yFtAeaKIOA/WdbRf0?= =?iso-8859-1?Q?NidlQ/hWXIrpDX2YfrYKcJwgUd9uY/SCINMuSZGo9BC7/QLGwxNGA13Z+4?= =?iso-8859-1?Q?kbEA4jLa6d8JBpKf2Kz2GuWp+8o9nk6qfxGLAkfa01j63+HkWTmrxbCkda?= =?iso-8859-1?Q?DapyYRMHYIl16dI7njEJhxzNZ7CWGrvloWzKYmin3ZQ/7/OFGBa3vJF7oL?= =?iso-8859-1?Q?Arfr0cMkcLSnlRihE01aLoiEDuuROiEz6QEEHWCJROg4yRcDMi+IHkx54L?= =?iso-8859-1?Q?THnCMTzxHMxOa579tkfFwHNhdk2PBQnc38SxpeWBccf/xKH+jHv9hLJeXA?= =?iso-8859-1?Q?rMNQ4aWmBvhmVTe9PcwlHR9iXhL5qGvC/IHTxEDT/2HAylj2WhOxUX+pUG?= =?iso-8859-1?Q?UyABJEkBFRXIMXmk05xUYaUiLaxORmfsd1YzXuIFvci795l/d8OBynmAUJ?= =?iso-8859-1?Q?cgVrz5j71a0ZhDjO9938eoEfgwxXqbD7UCLLP+b91pZ6kCtZRireDqO+HZ?= =?iso-8859-1?Q?ppHytmjrKkKFEHJX8cnDCX8c4xA3H+T7Yw4S26VHAFAVDMhUrH7hm0rp1S?= =?iso-8859-1?Q?nS0SlIGcckTOx8TvgySMAfIPoFr543cgnFVqLuVTK3tBYsVY7c+LB10w/4?= =?iso-8859-1?Q?BKQQXlhTv8Aip6wzoDD2RRLvWYCOae8G7wAfydwdl/G12gbSTHnIMzYk/B?= =?iso-8859-1?Q?AmSYJy5bYsPHOMSufYrDQW8j4839Il1LuQw0Gil4WOmFsQW8gJVCvMu/6d?= =?iso-8859-1?Q?WLokGVkZZk2/c7nFhwxU9H6VtK1cthLKjFljCnjhd5HrUNI3olvctMJVFF?= =?iso-8859-1?Q?Q6CbxRzM9A8nWpQ+ppXeEojfX/D7EobAVNTm/OM9N6tJRrsWmP3Z7qztJf?= =?iso-8859-1?Q?OEU5fG2zpuhkjA1pw+UQc9h93UHyYV1p03VLEriQErxU0Ruhfl+j6qGeq1?= =?iso-8859-1?Q?/vOjgboCPdS8kPvxfNP8eZ5YHvc2Y3075b8nWIpi/StXDl7xuEsNIbKzIT?= =?iso-8859-1?Q?5n+wwkzd+HHA9zSmenBuj10I/6H2KCqmmV0oOwVOcuRlNbW8m+6D6tiDeF?= =?iso-8859-1?Q?NXRctUmV/osUqEWERR4GGFCZKc6v8yFGM41qNIff7CVjgw8+7b0AAoPDMH?= =?iso-8859-1?Q?POFhYWxh4AqeMRdqGkuNAK3mpPTg+7i4R8wXu2lRycpD7c6U8Q3w4=3D?= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(366016)(376014)(1800799024); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?iso-8859-1?Q?qtn+GE9HzqglYmq53dXvAHhynrHKvAnqc5hnFUPr15lCwchEBapOU6cz6h?= =?iso-8859-1?Q?IqEzlHhzbK1XWg9M2zS+nf8MU9ooOU5IEgwss2mm2wAvx0EDPCcvwcoBee?= =?iso-8859-1?Q?lq+JCANShl1y6pN4Et8V3iuYOhWIcPKKu8PxFVxIMqvqzaAFzyc0h7vvmv?= =?iso-8859-1?Q?NvMIuQaZ8VfKDYjenU86o/EkL6dbp+OD9mc+hTNdRhJX08pg/dj/3EI9fD?= =?iso-8859-1?Q?jgd/2QFvKJ+0Z9LJZyz2NrRPvxY06D37EIoyPd9UcV5pg+MkkK9kZNqqZM?= =?iso-8859-1?Q?mcS/IslGat4KUkFnfOmZH/SyAue+5E/hHs6GzBOdq7UIbn7PPwPM9L9CNa?= =?iso-8859-1?Q?7oto/s7x52asXfcYox0ac0pmjfmockHMlD7Uw8xtS442XbyeAlPAPbjBF6?= =?iso-8859-1?Q?h3chGNb6K8pQvEZzoAKwzu2k1N7lB/CsIRKWvpWhV+Lb1uv0QRLF06o7pA?= =?iso-8859-1?Q?rRQ97TNC9cCxVld/YSKsZU2TkHuS09SESa8GvDMLWMS+/4He9flB0D8LHJ?= =?iso-8859-1?Q?S8Ji3xYppLM1CzF+8HSafKXJaVk+zEDQBgxDhSyAupn3rmmewueZz8oYY2?= =?iso-8859-1?Q?/Qce9ONnBIm0bhIbEgvVJGVQ7rmda33RdIuVcRbN0Kcr5u7rOUgFodK59T?= =?iso-8859-1?Q?7KZ1JN+ODxkMBy6Ho8rE8tA4seZE3DbrCSUbt48YDUFECBh4JhiVz4TpNz?= =?iso-8859-1?Q?4AAeqZt0c7IkLi84LumS5yu/HacjCW5dFIMLqAEU2crObINrY5s2c1HtLy?= =?iso-8859-1?Q?cKFCoIdNfVF+1PF8BGTmFeZqKvX04eSAXb1wN3iW5XXuGI7uG6pNs6Eokc?= =?iso-8859-1?Q?if1gcFAmB7zQVv7t2XdIvARpOkf45E5/jhGRznJ29zleQ9JuozbP/hyieV?= =?iso-8859-1?Q?rBzG/Bf1p/VGUJAX9nd2twagSttW+JLf7xEyUG7Wt5e5m2HmdlA+sAqmyk?= =?iso-8859-1?Q?PWVx0yVEBHImjBC7fqnS8lE+DqMfyklddm5vzcsitqvSOIJK0RAkeJrITd?= =?iso-8859-1?Q?H/U82plqtmEoFhNBWEsJrWUkto034kIb95f+CTYiAPE2z4Gdka/xOn2x3q?= =?iso-8859-1?Q?Y9pkUiA1LP3lB02qRnYwLUpwZiOaNLg292BNoag3aQ+m78dnnN39xJktQ4?= =?iso-8859-1?Q?/ZUGrlhaSZKVh9qyukU76ov12ETPR+9DpUL6y/zXm2aiqONWaaJJhHisDQ?= =?iso-8859-1?Q?F8F6IsUUhVOSH1nLejIusieB6U9aUIXoNsoBR1Q1ZDSs/gKM1KdwI1t14c?= =?iso-8859-1?Q?oI4NF228jtw6Ttqen6iq3i9CjSfPSabVrOc3czeiQg7pZ0H0kZEerxron2?= =?iso-8859-1?Q?wGj0I3xqZjRG8U6FE+YuKSzPpTqusuA+6LbTHq3MWF87EthV2r4WC/o3of?= =?iso-8859-1?Q?WO0DH2uZ7ZqVQVKTspCiqLkZwYYzaZ7wL7dw+T5hNx2//pf1fj03inrgpG?= =?iso-8859-1?Q?pv8MABTm9us9z5lB6xlix8de/WoJxcWkBKJajwvvBl7AL1ZMogADjMzIf9?= =?iso-8859-1?Q?m49JiEKWEJEnI7g5T3AtVGIfwf1voVLvxsbPzfbXTXrxQ2HAFqxbEL+Qg2?= =?iso-8859-1?Q?sQUkb5xKp8LLJRNHhG3/ToPIus7fl0lgui7xZ6YsgqKlu1+c5Ik5QAFZup?= =?iso-8859-1?Q?625qvEEHYr9Skc+4z6e+/rxREb1Evdr+peZeBgU6ZGzTzBtsMu7Ynv1w?= =?iso-8859-1?Q?=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: 0b7e2a59-54d5-46ff-48c0-08dcd32f1d76 X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 12 Sep 2024 13:30:49.3400 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: ADt3NQv6OpRBdEva7JUT7NT+t7QjkKUqNYw8M6JGGeJtjDiEJJSl9+y5+GZvS+0H33UdHfCgd+KGz3SEYoieULoXaY/bfoAMbBeAkvkEVzY= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS7PR11MB6038 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Thu, Sep 12, 2024 at 01:59:34PM +0200, Mattias Rönnblom wrote: > On 2024-09-12 13:17, Varghese, Vipin wrote: > > [AMD Official Use Only - AMD Internal Distribution Only] > > > > > > > >>>> Thank you Mattias for the information, as shared by in the reply > > > >>>> with > > > >> Anatoly we want expose a new API `rte_get_next_lcore_ex` which > > > >> intakes a extra argument `u32 flags`. > > > >>>> The flags can be RTE_GET_LCORE_L1 (SMT), RTE_GET_LCORE_L2, > > > >> RTE_GET_LCORE_L3, RTE_GET_LCORE_BOOST_ENABLED, > > > >> RTE_GET_LCORE_BOOST_DISABLED. > > > >>> > > > >>> Wouldn't using that API be pretty awkward to use? > > > > Current API available under DPDK is ` rte_get_next_lcore`, which is used > > > within DPDK example and in customer solution. > > > > Based on the comments from others we responded to the idea of changing > > > the new Api from ` rte_get_next_lcore_llc` to ` rte_get_next_lcore_exntd`. > > > > > > > > Can you please help us understand what is `awkward`. > > > > > > > > > > The awkwardness starts when you are trying to fit provide hwloc type > > > information over an API that was designed for iterating over lcores. > > I disagree to this point, current implementation of lcore libraries is > > only focused on iterating through list of enabled cores, core-mask, and > > lcore-map. > > With ever increasing core count, memory, io and accelerators on SoC, > > sub-numa partitioning is common in various vendor SoC. Enhancing or > > Augumenting lcore API to extract or provision NUMA, Cache Topology is > > not awkward. > > DPDK providing an API for this information makes sense to me, as I've > mentioned before. What I questioned was the way it was done (i.e., the API > design) in your RFC, and the limited scope (which in part you have > addressed). > Actually, I'd like to touch on this first item a little bit. What is the main benefit of providing this information in EAL? To me, it seems like something that is for apps to try and be super-smart and select particular cores out of a set of cores to run on. However, is that not taking work that should really be the job of the person deploying the app? The deployer - if I can use that term - has already selected a set of cores and NICs for a DPDK application to use. Should they not also be the one selecting - via app argument, via --lcores flag to map one core id to another, or otherwise - which part of an application should run on what particular piece of hardware? In summary, what is the final real-world intended usecase for this work? DPDK already tries to be smart about cores and NUMA, and in some cases we have hit issues where users have - for their own valid reasons - wanted to run DPDK in a sub-optimal way, and they end up having to fight DPDK's smarts in order to do so! Ref: [1] /Bruce [1] https://git.dpdk.org/dpdk/commit/?id=ed34d87d9cfbae8b908159f60df2008e45e4c39f