From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6AF4F45886; Wed, 28 Aug 2024 10:39:10 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2E3504025E; Wed, 28 Aug 2024 10:39:10 +0200 (CEST) Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.13]) by mails.dpdk.org (Postfix) with ESMTP id 4387F40150 for ; Wed, 28 Aug 2024 10:39:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1724834349; x=1756370349; h=message-id:date:subject:to:references:from:in-reply-to: content-transfer-encoding:mime-version; bh=OF0Ee8xCM+sug3/ZREHA3doc4E8zkVn87uIvJLXc4LM=; b=ORJveGx2qzjvzgFL1XIAq40CSs2VaC9r+j1IrLJOtG7ZF9piQ/YFGGCG sx0smNSngchWkjABMG2d0GvItv7Qx6hLDNrv6dgRKU2kBA98GuGieOiFs IpylhnRS7DYO7nOjNDkRWTuwaTcpYCH7EgFKzMo3fH8FJbkUe7GFC1V3p VgHb53YN1S5x4lw7Oc7f397watPSop7xi/LZs4W/Q1m5fUy9dgEWt0cCY DxSFF5XlsQdm1Tmu0NpHe31W7ga6RhHmyCZ2RTZL8DiGJh5grkODI2m3i DDGe97Ika+VeteeEhS1qz1xKlGj9yUvhktHQ0TZk77DiBuaUHmDQxVl+H A==; X-CSE-ConnectionGUID: X8WOt2YYTXGm8VS+oZ0jhg== X-CSE-MsgGUID: 5d/WhAkVR/mBOc/EQ6FlMA== X-IronPort-AV: E=McAfee;i="6700,10204,11177"; a="26249878" X-IronPort-AV: E=Sophos;i="6.10,182,1719903600"; d="scan'208";a="26249878" Received: from orviesa007.jf.intel.com ([10.64.159.147]) by fmvoesa107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Aug 2024 01:39:07 -0700 X-CSE-ConnectionGUID: bujKE5pYTFiXIGkTIBmV8g== X-CSE-MsgGUID: NO5LLBQ7QUa81GooCua1hA== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.10,182,1719903600"; d="scan'208";a="63658408" Received: from fmsmsx603.amr.corp.intel.com ([10.18.126.83]) by orviesa007.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 28 Aug 2024 01:39:07 -0700 Received: from fmsmsx610.amr.corp.intel.com (10.18.126.90) by fmsmsx603.amr.corp.intel.com (10.18.126.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 28 Aug 2024 01:39:06 -0700 Received: from fmsmsx612.amr.corp.intel.com (10.18.126.92) by fmsmsx610.amr.corp.intel.com (10.18.126.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 28 Aug 2024 01:39:05 -0700 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx612.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39 via Frontend Transport; Wed, 28 Aug 2024 01:39:05 -0700 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.174) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Wed, 28 Aug 2024 01:39:05 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=binso0DiVjqSpKDYt+hTkKXS5328ZQ4TkSpZcgeBcU8/J9me8cbqMAStbyMUgQSX5QD+1kT0st0RnOGstA4cphTk4hgNRf6NhpmDm3YXrzwjbBPX3yIY3+waT69HrHBsMQo+iQaZ4lWC7DzejgdJPCmCzF9kd13Lil7ECqThxYaLh2RMShtxsXokNC3DWpyv2gTuyEsP/iSayJKZQc/zmiPXYzdSDvsZNm7ZCLsmh/N0DDMzuX2fpuZ+uAMmc8BtceBjt+ZArmhzwyN04VHrqttywN26xwy3dZ/Nci4bk1ELRgDilypBfxt4olSg4H2dMo7d2iNGmWOGkAGikNgdzA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1gT56pNEp29nNrEov/hHFNWSc7rTS3L91jUMg1gey9Y=; b=IFyFMeuZOUr23zP6RzJgwnmt+ktAx7dN/bC6g2vjdr+XnQO4Ie7r+QoMMLRzvlLJFsNUCckMbQ7EUXrJ1BcBROWlrPaphcEMko1sIrZ8BEPy0OZSN1ksLpbko2Tey1ZTCDWS+RFgHai6DxWuCsyBjDSvvahv5uZmbqD4NgICenXlJi3rZTS9lqVBr55dq7rel9jAyJDsdHeiLcnsGZSgZ49z4ckaBIZU7J3t3G3K+OvvCiKh30JxpWpWl86tsaINs2R7v4Cw2dd7HStUi0sr2Hm1pOpNK51uy/oWB+T4m8A4kwPRP6xMP7vRiRtYFI17TGKJzc+L4RUvX1I/k8UN2A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DM4PR11MB6502.namprd11.prod.outlook.com (2603:10b6:8:89::7) by DS0PR11MB7460.namprd11.prod.outlook.com (2603:10b6:8:142::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7897.27; Wed, 28 Aug 2024 08:39:03 +0000 Received: from DM4PR11MB6502.namprd11.prod.outlook.com ([fe80::21e4:2d98:c498:2d7a]) by DM4PR11MB6502.namprd11.prod.outlook.com ([fe80::21e4:2d98:c498:2d7a%4]) with mapi id 15.20.7897.021; Wed, 28 Aug 2024 08:39:03 +0000 Message-ID: <288d9e9e-aaec-4dac-b969-54e01956ef4e@intel.com> Date: Wed, 28 Aug 2024 10:38:57 +0200 User-Agent: Mozilla Thunderbird Subject: Re: [RFC 0/2] introduce LLC aware functions To: Vipin Varghese , , References: <20240827151014.201-1-vipin.varghese@amd.com> Content-Language: en-US From: "Burakov, Anatoly" In-Reply-To: <20240827151014.201-1-vipin.varghese@amd.com> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: DU2P251CA0013.EURP251.PROD.OUTLOOK.COM (2603:10a6:10:230::17) To DM4PR11MB6502.namprd11.prod.outlook.com (2603:10b6:8:89::7) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM4PR11MB6502:EE_|DS0PR11MB7460:EE_ X-MS-Office365-Filtering-Correlation-Id: de8f9b5c-0025-4cc2-f67f-08dcc73cdf35 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|366016|376014|1800799024; X-Microsoft-Antispam-Message-Info: =?utf-8?B?SGVpb0d3VVlNbzh6SmxsU3RWV0VQakJZMFRDV0cwNXRhL0h5SmROalgzWVFH?= =?utf-8?B?eWwvV1RrbWlUaWM3TlpzR1hjdk42Q08rSWxzV3EzZFB4U3Z1RWF6OFFpY3Jt?= =?utf-8?B?aFRGeVlaSGUwQ0x4dmFLL0Ficy9vcUViVlpteEpSc0g4OEthVDFpYnBUTm1U?= =?utf-8?B?d1ZXeHAyVG83NDJaOFVZcktuNkkySm9hWU4zamEvTHZnNGQzdmRtMlo1ak9h?= =?utf-8?B?VE9sQnlPWVl4TmtrVUxvSm1XMERWWXUvcWlyYndiMStMUHpYUEpxUEpxWTQz?= =?utf-8?B?VldtSytzdkVFNmlZUmVuT1F3M0svR2ZXdFZDVmJpQ3ZWd01EZ1haZ081bE1D?= =?utf-8?B?NmY2NTZCSG1ZM3pDZUNOS20rNUpldmJpQXRzTWhnY0VEVjdMUWo1NnhiZHhX?= =?utf-8?B?NEpnNzFaRHNBQVhtaDUwTFdDelFSWmU2UEgweHJRbmRiQVRkOFo2bEpsYkg5?= =?utf-8?B?ZDdIY3VMeTdvREpaTlFRSWtvWUh6dnZ3WmFNUjN6MXhNa1RkR3dUZ094M21l?= =?utf-8?B?UzBCRUpOYW9RWEdxdWdtTmJBZUtvU2lNS0NzRUNvVTFZOE54bEFWMG5PVjVT?= =?utf-8?B?b2RpZmFnUzVSWG8zeHptd2xJWHJhbGhDRVh6ZWlQWHJwSTZodEJxMDMyZlJZ?= =?utf-8?B?UDJlWXBQOWx0Z0hlUUtPWDU1bHRwT2NveC9nZVZ2QVNVVUV2SkZjNitEY3pr?= =?utf-8?B?d1JEeUdKWmlmQ3dCY3lGR1BaZy9ma3FNSVd0SUxWcy9TZmtOa1RQVHEyZ2V4?= =?utf-8?B?V3VoT2ticmw2YjI0ZzVSczNRKzRJSGoxcTZYaElYQ2IxWWh6a1A5YVlCSnlr?= =?utf-8?B?dUFtVXhITHE2RWFLMHppTDVjcTJBRFFQTjV2cXE1NWZBdHUzS1c3Ky9Vd09T?= =?utf-8?B?Z2I0cDlBLzJ3L0NGUm5hUStBUysvYW16R0NMUFZ4ZzRJYktrdktsWlVMOEdN?= =?utf-8?B?U3NKYUpGVWoydi9uc1RQa05RTlh3L2JaZ2hZQ25PQ09HeUxDNy9XSnlsa1Fx?= =?utf-8?B?cUJ2ODJWY3dDK3kzMlFzaThQTU9JcGVRemQ5M0NwSkFyRUVVMTI0dHhtUFZz?= =?utf-8?B?UHJOd3J1bnZGZm5LQ2w1R1g3NTBOdnJaTTNWdk5GaWwwUGRSaXk0UC80WmV6?= =?utf-8?B?VGRrUVNrZHF1N3g0dDk3SFM4N0FjNTFnRnlocmZ0eXV6TmN1VGViR0hPWkdv?= =?utf-8?B?NnFvVFBTOUFkbmJzS2FMeXUwZkU1ZVZ3VkNZbTVFMWN1S3JML21UT1M3Njdo?= =?utf-8?B?T2UzSW1uSHhNQU5NZCsvRVhzVTBja2lneFVlME1WNHZSOGNUY1k1c3FUYy9Y?= =?utf-8?B?bWRHWHczZk1hNTF6SXZVT0JESDdFQkdXWjR5SzYvWVNHbktPUFo5Q1hvd0Ft?= =?utf-8?B?NFJudzJSbURSTXBEVlJQelgyazVmUDQ5cDN1eExOUVEvRTk1b3hXVEMxd3NZ?= =?utf-8?B?NmV5YmVhT3UwU0ZmaXdtcmVDTEh4bDdhME5vREVvK0Zjcy9MUFpxenRtaXph?= =?utf-8?B?MjNtNW1RRkFaSmRVeHJlbys4aExoT0UyYkN1ajZBSThwV1FBb1hlbUtGY1dJ?= =?utf-8?B?cW52clJFaWkrWm9XOTFUd2pnL0tGdHFLNWVJSHVPSXVuWFUwWWlFWE0vUHd0?= =?utf-8?B?cklLWEdLWHR3cUlacXpxUmxLR21XOVdsMm0yZ3Y4b1Z1b1I3MlZNRXh0bll5?= =?utf-8?B?WVpvK2kvOFBiQmRxelZ6azBDYS85Rk9vY1VDU1ZLRWRJSDFxOURaaWtiODUy?= =?utf-8?B?aEowanV3WHFiOWhuKzVmaGJHRndKelBoNEVBdWlMeXFzV0hWK1Z3YUE0OTRn?= =?utf-8?B?RHdsdVlUZi9RdlZrNldLUT09?= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM4PR11MB6502.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(366016)(376014)(1800799024); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?d2d4MVVEL3lVQkdPK2NncG1aeWZDdUxodmxaVXhkU01GU3RDcEdwdVcybkJQ?= =?utf-8?B?Y3gwcTdReU01cUJRajEyQll0TEVlZ1BQQk05OVhxNDZPeEY1bmhFcFUvRVF1?= =?utf-8?B?L2hQYS9BTEduOTN3eWpWUjNDS3hWNUI1QjF2R0dEVFJFY0NPbUV3M3lQZkJC?= =?utf-8?B?amxvK2NJYm9JUGxSdW5vUFd0RklpN2habjVLYXY4NUh6SjYwdWVnMEc4RmVU?= =?utf-8?B?ek1EV0xmTmI5UnlSR1V6Tkw0T2diMlVBWWJWUjBuTURxSjh5LytUTGxpSXkz?= =?utf-8?B?RC9lZXRlK0ZTcXpOaFJ6V1BWSjI0WExHdnc4ckJFVGNNQ1BhdXdyNSt6SU91?= =?utf-8?B?V09tQnRqb3pOQjVHdkNvYW1TcHBLN3cwWFJkR0JSMjFZTzJwdWJxazZvWTRx?= =?utf-8?B?Uk9FVXlVaDdHS1RVWElWUTJSS3c3UktzTmt6a2pNdENSNmhmNGRpbFpUQ0tU?= =?utf-8?B?aGJjSU13VzBkRjJoUUZqbTdwNzhtalJIMXJERXNIQWJpQzZDbkxmMkR3YVpr?= =?utf-8?B?V3VCaC9IM2oyUjBwYTY0a0lZNkxmUkQwUDBWZzI2UmZuTG9uWEJmNUlyaU1a?= =?utf-8?B?YWM4c3NFelRId3BWcUQ3MnZmZzRBM3NvWkRDbHR3YTNYVG52aXNRMktMTlpH?= =?utf-8?B?Szd4dWN0aGxFUG1QSzAwTEJNNGhOdUwwZTExR1N4MFUwa1Y4V3kySHBHdytp?= =?utf-8?B?N2UrMFFEMEtLcEFiZkZYM21aWlJlZUdDcmtmMzdmYlhXaVJJSnBycDR0WEdP?= =?utf-8?B?QjN3cmhLTi9hNkhFQTNTQzl6Y1M2OEdocmZ6cmlEMS80bnVpcHpzRjFxMHh6?= =?utf-8?B?RUZVRVRvSnZ4NGRTcjFaOE1weENhRHVid3YydkN4R3kvQXZqdWFZK2UvZTAv?= =?utf-8?B?dWxjU3dLN3F6bGxHb1J6U25udWhwOC9DeHo4TVpXM2docFhRek5sQWpkKzhz?= =?utf-8?B?eDZWRWdZQW1NclZzYkwzYmhPeW9ma0tURzIwekRNTStHNG94UVRzLzZXQlgx?= =?utf-8?B?ZUVVYVZxZ21EQmtuWjdFVktLS2taWHF5Y29OVFcwc3lGL1RWeXJVdExHZC9y?= =?utf-8?B?Rnd1dXl2emwrTmx1eEdUQ24rV3lRZktZR0I1WWFmc3RlbXlmc3BoZDlMOXdu?= =?utf-8?B?dmdROElvRi9jYkV4cS9zbStZZE1KM2RtSTlYNUdDVmUvdHZkK0Z6TXQ5V1Jl?= =?utf-8?B?K1ZJb0tzbW5Qelh6ZkI2NG9YOUVFeG5lYlVFS1hnTGZWY0FIZmZoemRYaDhC?= =?utf-8?B?b1FIdkt4bmRWT3BZQjM2ejh0alBmSm1vMjZENGc1WkJBc2E3U3ZKUi9vWUxB?= =?utf-8?B?bFUyakNEa1VhVnJYNXRva3d5aG8zL0JUSzh2Zjdxa05OR1NpZkF6OEFlRndF?= =?utf-8?B?b2xWbEJ3WVlEalFFck8wSGJKa0hGUmszT3JPeEZNUW4zdGF0S29wN1FKUmQ5?= =?utf-8?B?ZjI4ZmVvdXEweFAvSVYyaHF4aDVZbVVqRWRXSGR3eTJCMFpMM2FoLzJjT0tt?= =?utf-8?B?K1NQMHVTWUFkZUcrMTlkRUlqbnRDNTQzMkk0WFd6UGt6bTVhTFF2YXZRUElk?= =?utf-8?B?TlN4cGI3bmJZbWs1YlhPMnNjdGtSSFFlWGN1Ry9JeE1nL0Z4dTZCUDNWVkxK?= =?utf-8?B?bFIzSWU4QS9CUlRmV1Jld3N6SW0ySXJsdEwzeUIwcXQ3N0ZOTEJtN1FGVVNL?= =?utf-8?B?TE5vam9udXI5NFQ0Y0hNNVExWGF2RXRROFRDSzdyeEFqWGJIK1dTamM5MzVu?= =?utf-8?B?Lzk2bm8rQVNzTzVxYWFzYXJtQUROaEN2NDAxR3Q5UllZTitUYzJIN3BYV1h2?= =?utf-8?B?V1RDWEhhZHdUV2pSQnRTS3V0TnJJM3F0V2p3YURlTnFNVnV3RVMrOXROZEdY?= =?utf-8?B?dEgvaC9Tc1dxRXVNMmFVaGJqbnZXYkhqR0NUbHlDQTJiT2RIaHVieWh3TGJS?= =?utf-8?B?alR1VFNzcy9reERkUnRxRXVqZGM0VGdWVjlrYmdzeGhrNitSWkRUcG1Kb0da?= =?utf-8?B?S01iQjhvVS9yV2NZcU0vczI2MEsxUnpTdStSajFTRUh3emhiQXdxUmFGdmth?= =?utf-8?B?WlN2c3E4Sk0xTEJFVjJXVnFmd296T3F2TWVnOUdtMlhOU2JEUFZhYi9IWkY2?= =?utf-8?B?UmdKZHh1NWRxdjhxbVBCQ09rQ1oyeUVueEdNQXdjZzg2M2tHaWROdmdDQjho?= =?utf-8?B?VGc9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: de8f9b5c-0025-4cc2-f67f-08dcc73cdf35 X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB6502.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Aug 2024 08:39:03.7606 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: BGho+nKU0VYAx8uq4pmF/uEUDV96qipwjp856RqjlUc7/52gv2gSuA90OQ56Q6C8TE/LHqYlIX6wR7hbeaIIgNBMwySHz3Lb+U+UvplGn28= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DS0PR11MB7460 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On 8/27/2024 5:10 PM, Vipin Varghese wrote: > As core density continues to increase, chiplet-based > core packing has become a key trend. In AMD SoC EPYC > architectures, core complexes within the same chiplet > share a Last-Level Cache (LLC). By packing logical cores > within the same LLC, we can enhance pipeline processing > stages due to reduced latency and improved data locality. > > To leverage these benefits, DPDK libraries and examples > can utilize localized lcores. This approach ensures more > consistent latencies by minimizing the dispersion of lcores > across different chiplet complexes and enhances packet > processing by ensuring that data for subsequent pipeline > stages is likely to reside within the LLC. > > < Function: Purpose > > --------------------- > - rte_get_llc_first_lcores: Retrieves all the first lcores in the shared LLC. > - rte_get_llc_lcore: Retrieves all lcores that share the LLC. > - rte_get_llc_n_lcore: Retrieves the first n or skips the first n lcores in the shared LLC. > > < MACRO: Purpose > > ------------------ > RTE_LCORE_FOREACH_LLC_FIRST: iterates through all first lcore from each LLC. > RTE_LCORE_FOREACH_LLC_FIRST_WORKER: iterates through all first worker lcore from each LLC. > RTE_LCORE_FOREACH_LLC_WORKER: iterates lcores from LLC based on hint (lcore id). > RTE_LCORE_FOREACH_LLC_SKIP_FIRST_WORKER: iterates lcores from LLC while skipping first worker. > RTE_LCORE_FOREACH_LLC_FIRST_N_WORKER: iterates through `n` lcores from each LLC. > RTE_LCORE_FOREACH_LLC_SKIP_N_WORKER: skip first `n` lcores, then iterates through reaming lcores in each LLC. > Hi Vipin, I recently looked into how Intel's Sub-NUMA Clustering would work within DPDK, and found that I actually didn't have to do anything, because the SNC "clusters" present themselves as NUMA nodes, which DPDK already supports natively. Does AMD's implementation of chiplets not report themselves as separate NUMA nodes? Because if it does, I don't really think any changes are required because NUMA nodes would give you the same thing, would it not? -- Thanks, Anatoly