From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 84F9545AD8; Mon, 7 Oct 2024 14:58:44 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 511C0402BB; Mon, 7 Oct 2024 14:58:44 +0200 (CEST) Received: from EUR03-AM7-obe.outbound.protection.outlook.com (mail-am7eur03on2105.outbound.protection.outlook.com [40.107.105.105]) by mails.dpdk.org (Postfix) with ESMTP id 0DD254026C for ; Mon, 7 Oct 2024 14:47:40 +0200 (CEST) ARC-Seal: i=2; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=pass; b=Vdnf2VvcA7QHrlIbVOd6ubNKvYqinBJJVme56Nu46NZ0Z4NotiUv/D+Alt+r13pHQj98CvQ7GORaC2LyJmpUx/zfrM+un0pD3GssbxQ3Tj+Pf6YY0LGaqGpaN+8KMkDUzKxIzYpx22TDiMLsRLO41MzZC/bSbxpsxn0Y7xUV739n8j2K7PZkP8249U6w3cKH2euTBFB2QQXg67RoPbRMAcesj4W8RwAoI1GVQXnZXbLs7pUkp9QayjMlgPp9P71R97Mv/VnAiBliH1TeLxxllTwqOki99aHlX1r9ChwsqqqVPXnR/rysOKstlFWPMzA5ndgtO7qCZt1hjovnvAy32Q== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yAOxnRTvHciyAYQYaBlvzrFrwGv2Z9fP5eK0jykDcK4=; b=bWxKY7ryb8MvIHalWzlHjHLjXDa7NbaQ3W2cT1+FfPBt+WeXdOpcU5vMemTks4V13PSSh8TmaZGB7QVlwyx0sgDkMsQPJ7iHmDQPUM6s6evD4IDoOnIc4JDmAjGb5EzoudXVlR2W8ruWcKcwpoPsty17LpXbdZB3Kc3Sh//W+g25T/JcfnKp6Pa2wx3rlKhxBTCsbmC0MJ/d/nFezIkEjDzCCOlJ9Vz3DuYzg0zZKFXW4Us7JZcTHH1jOPSQAsyfWV97y1kdjUtpSVLxQsfjxCf/aP9JPQdqZFi0NBplrSIBrpYwScx/S8/ZReEdoLW6Y4asNK5qzLIkrDA0kqtYNQ== ARC-Authentication-Results: i=2; mx.microsoft.com 1; spf=pass (sender ip is 51.104.160.93) smtp.rcpttodomain=networkplumber.org smtp.mailfrom=astron.nl; dmarc=pass (p=reject sp=none pct=100) action=none header.from=astron.nl; dkim=fail (signature did not verify) header.d=astron.nl; arc=pass (0 oda=1 ltdi=1 spf=[1,1,smtp.mailfrom=astron.nl] dkim=[1,1,header.d=astron.nl] dmarc=[1,1,header.from=astron.nl]) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=astron.nl; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yAOxnRTvHciyAYQYaBlvzrFrwGv2Z9fP5eK0jykDcK4=; b=KQGPzAYBw6SsBsZ2PpugmTYrVTP6oNiXVhIIx7a/Skfgd3pU7ukD4arMUAku/oDv5KQgdRmUB7OXGvdhH4fVzeANZJq9ncbXTxzvj70RH+ahDSaRJZn/ahmv+FaUQEs2y20s9lv2PtrhiA2fjan+1w/wwFzeSsBqHbEfGbWLz3MiuI10l9Pae5wDMy3zIhxczfkd1uI25QBW6B8kHHi9CX2Q0f5E8XUBgufKwvFgZdYxTHCSeDE0K+N86THx/YeV/3SByPHx2hh3C/nOTxRO7hh+ALRz5G3/2GudwGF6O52Y2cfaosMe/CZnNII8tH05SlO9FQLZgJU++ItJnA4Iyw== Received: from AM6P194CA0015.EURP194.PROD.OUTLOOK.COM (2603:10a6:209:90::28) by VI0PR10MB8762.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:800:234::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8048.14; Mon, 7 Oct 2024 12:47:35 +0000 Received: from AMS0EPF0000019B.eurprd05.prod.outlook.com (2603:10a6:209:90:cafe::70) by AM6P194CA0015.outlook.office365.com (2603:10a6:209:90::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8026.20 via Frontend Transport; Mon, 7 Oct 2024 12:47:34 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 51.104.160.93) smtp.mailfrom=astron.nl; dkim=fail (signature did not verify) header.d=astron.nl;dmarc=pass action=none header.from=astron.nl; Received-SPF: Pass (protection.outlook.com: domain of astron.nl designates 51.104.160.93 as permitted sender) receiver=protection.outlook.com; client-ip=51.104.160.93; helo=xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz; pr=C Received: from xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz (51.104.160.93) by AMS0EPF0000019B.mail.protection.outlook.com (10.167.16.247) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7918.13 via Frontend Transport; Mon, 7 Oct 2024 12:47:33 +0000 Received: from EUR03-AM7-obe.outbound.protection.outlook.com (104.47.51.232) by xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz with Crossware for Office365 id 82d8a7ed-30f3-4b96-87c7-5fd3c7d69e31; Mon, 7 Oct 2024 12:47:33 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=brK+9xHiw6IPAcIzkWj+IJlPxhQMJ9lY0OYOla5lDdLAFPpwV1IFD9yk7qOT8/Vkq9U68IdApZA0xgI97K8fi16heqwSoV2QTRpCMJh8CcmZRfSJ2Xi3D4rnse1J/4tvZemHk3Hrc1bU9fvHf9wCGLxA8pIcwFF04EXb6rJ/AoEZaqNCnhmMzgkQJOM99vBx+gua7R6Nv+bpK8XRSWRr3siPDZ4P4e04nI7PgUIz3bnenqVFubvyMc1VKeF01ebcEhOfTakUq/lL/wU1K8xsnAo/PquJKVX0WlYDLZ1qqsh41SI+Aayz1XwK2Fynue+gMF81espgtDtezXVAWoQPDA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=yAOxnRTvHciyAYQYaBlvzrFrwGv2Z9fP5eK0jykDcK4=; b=aKNA4/sI/ojVpv5QGgpvSVQYKBerGg6xuoY6JGk79rMpP1ysoqiuOrc/eKZfY7K8zzWEkTjECkCb/L7m1YghbPiIVnIaA0RPsdShRqOKJJC+AQflJ5ADVzEL9J4rQIff+fGY+JpnheOyPQlBSxSag8h6+lO6vXO/4GkoHDEoVqoc/v1ho4uhfzsDCjimmYFuPd10ukka5TNQ3Eu9MYwmprP2B9pBhoqdIQObzOpX7vGtrXDDGZ/i49LBNVR9LOHkisjouS8O9+IZruojEvO1CRkxDDpjgSKX764BUx/a0YBFcOkYU1OllqdU5xkElRuGhG60sCDHivt0Covg0KKaOg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=astron.nl; dmarc=pass action=none header.from=astron.nl; dkim=pass header.d=astron.nl; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=astron.nl; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=yAOxnRTvHciyAYQYaBlvzrFrwGv2Z9fP5eK0jykDcK4=; b=KQGPzAYBw6SsBsZ2PpugmTYrVTP6oNiXVhIIx7a/Skfgd3pU7ukD4arMUAku/oDv5KQgdRmUB7OXGvdhH4fVzeANZJq9ncbXTxzvj70RH+ahDSaRJZn/ahmv+FaUQEs2y20s9lv2PtrhiA2fjan+1w/wwFzeSsBqHbEfGbWLz3MiuI10l9Pae5wDMy3zIhxczfkd1uI25QBW6B8kHHi9CX2Q0f5E8XUBgufKwvFgZdYxTHCSeDE0K+N86THx/YeV/3SByPHx2hh3C/nOTxRO7hh+ALRz5G3/2GudwGF6O52Y2cfaosMe/CZnNII8tH05SlO9FQLZgJU++ItJnA4Iyw== Authentication-Results-Original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=astron.nl; Received: from PAXPR10MB4977.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:204::20) by GVXPR10MB6322.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:150:17::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8048.14; Mon, 7 Oct 2024 12:47:29 +0000 Received: from PAXPR10MB4977.EURPRD10.PROD.OUTLOOK.COM ([fe80::7bb7:193b:1b7c:782b]) by PAXPR10MB4977.EURPRD10.PROD.OUTLOOK.COM ([fe80::7bb7:193b:1b7c:782b%5]) with mapi id 15.20.8048.013; Mon, 7 Oct 2024 12:47:28 +0000 Content-Type: multipart/alternative; boundary="------------7Nw83z10Aq0gDJwBgTvrw2Zv" Message-ID: Date: Mon, 7 Oct 2024 14:47:27 +0200 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2] common/mlx5: Optimize mlx5 mempool get extmem To: Stephen Hemminger Cc: Slava Ovsiienko , Aaron Conole , "dev@dpdk.org" , Raslan Darawsheh , Elena Agostini , Dmitry Kozlyuk , Matan Azrad , Ori Kam , Suanming Mou References: <20231010143800.102459-1-aconole@redhat.com> <05b8ccc9-a159-4141-b323-924f7ec15baf@astron.nl> <20241004151608.478a2859@hermes.local> Content-Language: en-US, nl From: John Romein In-Reply-To: <20241004151608.478a2859@hermes.local> X-ClientProxiedBy: AM0P190CA0030.EURP190.PROD.OUTLOOK.COM (2603:10a6:208:190::40) To PAXPR10MB4977.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:204::20) MIME-Version: 1.0 X-MS-TrafficTypeDiagnostic: PAXPR10MB4977:EE_|GVXPR10MB6322:EE_|AMS0EPF0000019B:EE_|VI0PR10MB8762:EE_ X-MS-Office365-Filtering-Correlation-Id: e7f13e94-c904-404d-0b8c-08dce6ce36ed X-MAIL_SIG_ADMINUNIT: none X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; ARA:13230040|10070799003|7416014|376014|366016|1800799024; X-Microsoft-Antispam-Message-Info-Original: =?us-ascii?Q?L8Qv9GlMTvXv9gVdzZUAvNWL5VKsgOMKBK19AZO6pf02HtmWaTR1FSH/wg+x?= =?us-ascii?Q?yaD1yZaUYy4oR5rPOtdQst+XzXJMg2feFbdaKrMyggQmb40ZhRNp3jRyNdqT?= =?us-ascii?Q?9o/1CffzAx0ulrTuPTytnslnIgWhrh+6p9+eFedZBx17usDiwaYe15u1fh75?= =?us-ascii?Q?DOhWRtO0BinL/jwsIXha2QADuJDi88clPwyVJjePxi51wSia8mSZk+yeLo+Q?= =?us-ascii?Q?hQ9V8a2EN8qPaaKl8O7Owrw2Zeq+L8UFFG2YAmpLObXe649SUMwjK+9diP3s?= =?us-ascii?Q?2ITWR6rvZBsWXYz3zCRDOkX9m9lA0W0LkCrp+oRGzz+bfhsoL5G9LWakwwmL?= =?us-ascii?Q?giHTYyySB+ovOCG0iDJpueyTqjS/BptPqidddNhbXcFI0Q06ZG5dRJO5OexS?= =?us-ascii?Q?9IIg22jCw9F+hud86A1u4X+I0/+63zQY2dUIBYuThTeuwJrqz6A0mhMuDJ6i?= =?us-ascii?Q?Nq2bWNqDt0vQrx6/tyZxrBZDtaO/XfdtyzQ50MoxxrYvpxX2swaCM8YYRmCH?= =?us-ascii?Q?wGBMANX8H7ovSGEq/1jSl9mQUpGyUcoGSnjWyf5GzscCRGNiZGKm44Cns8Nz?= =?us-ascii?Q?bvESnDU/aKcpCdGNxu4skSqQp4UQrftGB4aPc33STP6YTmo3GiBcyhD3bDVH?= =?us-ascii?Q?iZwuvYIZ/fozji6Wjz90ow2eJRW60hbhuo/SaAdNjaxFotCNFjblsp5QWScZ?= =?us-ascii?Q?5QIMlEvtnu1S4FmmwWV4Vr683oDBi6ymo0UepHBWDk00ubo7WuLn1W0u7K1y?= =?us-ascii?Q?sPSYuHtS7rl77D1V3kVKJm+dzcfGAwc+H9Z7pjEhD4x/sumCAj769rTytPBI?= =?us-ascii?Q?G6/a1viGaL8vVvrhhodT0zpJFxbLnxw65XuLlfDLdJ8lxdZaVCT8/wKimopj?= =?us-ascii?Q?rxz7fz+PXzZEsF6V15deCyzbmxdkBiUYvfMMachApBa3zoFwPhl+A63hG+eG?= =?us-ascii?Q?B+K2tdeJk4kcF1KmH96nW5ob0HbNZGBIUqFHOE46KizvVb8V3rRKqMiP/A+4?= =?us-ascii?Q?1KWaXicPZJ6U86nhn9wIl/p1GJ8ZmHWpkcg4VuoKUtvqUZxaGZCt0s2f/3sb?= =?us-ascii?Q?gDp+/RtCsY1aOLJTDP5bc5M4nlP26p6bYvepbKizClYTENq6gWAjzAymJTHV?= =?us-ascii?Q?LSbzfzX3jXKPH589ZtLJAGCVjVFN3Hnsqw/Dnx21HxXqlZOjjhy3WuTXugNe?= =?us-ascii?Q?nZuXothkeGpOk0Sn/8H0fnRh1T4a0EGBmTmqXL23D2e5tmy66ed6pVtB5wlI?= =?us-ascii?Q?Wtsbt3eDawjLFR8t4x3xHeZFUHKknoaV0ZK9lwVtgA=3D=3D?= X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PAXPR10MB4977.EURPRD10.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230040)(10070799003)(7416014)(376014)(366016)(1800799024); DIR:OUT; SFP:1102; X-MS-Exchange-Transport-CrossTenantHeadersStamped: GVXPR10MB6322 X-CWesigProcessed: Y X-MAIL_SIG_VERSION: 0.2.660 X-MAIL_SIG_SERVER: xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz X-MAIL_SIG_CACHEID: 15025 X-MAIL_SIG_CONFIGNAME: 1 - No signature X-MAIL_SIG_CONFIGNAMEPLIED: 1 - No signature X-EOPAttributedMessage: 0 X-CrossPremisesHeadersPromoted: AMS0EPF0000019B.eurprd05.prod.outlook.com X-CrossPremisesHeadersFiltered: AMS0EPF0000019B.eurprd05.prod.outlook.com X-MS-Exchange-Transport-CrossTenantHeadersStripped: AMS0EPF0000019B.eurprd05.prod.outlook.com X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id-Prvs: a6af158b-5f36-4c7e-a6ae-08dce6ce33d3 X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; ARA:13230040|35042699022|36860700013|82310400026|376014|7416014|1800799024; X-Microsoft-Antispam-Message-Info: =?utf-8?B?WW1xaEtRbzcyWUtnUUUzY0Rxa0pCR01veUlGbmRzSVZRTGVwSUd2K0Vrd3Vu?= =?utf-8?B?U0NlZkVmV1BtcFpDWEU5RS9QK2xlZlZJRlJYMW1rTEhSdTE5WnFKVHJDM0Zi?= =?utf-8?B?cS8yaXp4dVFNQ0J0SVdyUGtIY3czYU5vOFh2bzAzVTRMYmZHcXNYQ2tUVW0v?= =?utf-8?B?c2lLK3VMek45bWQ4b0NoSGl4UTF2anprb3VkQWVDNDZiOTB0WWJNajl3NkNs?= =?utf-8?B?ODY4UHFkNXNtVHFqWWxDdHRGRHdYcjJXMUdHU3c3QWZQTERJRWswM2toWkl6?= =?utf-8?B?YlZEMHc0ZmV4d29PMEpvK0tWZThSS0Q2MFRPSTJ1bWVpRnU3MmRwOEJGWEpU?= =?utf-8?B?VlkyeGU5VVBsUU1QK3BXWEVWZVFRb2s5V2QybUl6ejJIV3F2bmp3STVWT0NF?= =?utf-8?B?Um5ENnc1Y3JMK3B2bjhONEdIK2FHRitGcUkrV2tILzZtdXJud2VNbUxZOUVR?= =?utf-8?B?TEJQMU9Ick5jVUlHNmg0YTlUV3g4QmdSSUJORnQ2YUJTeXNZYnFyK2YyZk9K?= =?utf-8?B?L0RQOEc4Sk1xNDZkeGRPNk5nU2JUcEtiUWpqaDBJUTJTdy9DcEFETnlVQkNF?= =?utf-8?B?SXR2dGk5a002MkRXb0U5MjJaV25Bd3VSZFNjenF1REc5UmtXZC9saU5WNFJS?= =?utf-8?B?aW1CZkk2UHV6N2lhSW44MlNsZ1RWQm9IajByeFl5aFlJL0VJN2I3ekhHWGZT?= =?utf-8?B?UjZkNkFsWVpBQnhsZXYyRE1uT2FuU2FQZzZKTnljdFErU3FFZjRaUURiZVl4?= =?utf-8?B?VHpmSDlUUnFKWEk3WnYvc2s1REJlS2ZScXJhVWU1QUU2NDYzbjlHM2Iyems0?= =?utf-8?B?cnJQdWp0RjBRayt3T2MzemNZQ01UYTRhay9XamZyd1YzdyswU1FXUW9qcjJR?= =?utf-8?B?SjB2eTNNQjdBZGdkOHlqa2xFcGxidFpROGZJd3YrN1pxRkR5QkJPck9NVmZD?= =?utf-8?B?dTg1Nmtpb2RzR1VFTmt4SytHTkorTi8rbGhNa25lellKeHlSZ2RkckZOY3A1?= =?utf-8?B?cVRwM3VKUzNBNC90V2VQVXRkaG1DMStvb1dOMFZUSCtKeEc1NDc2WG1pY0hz?= =?utf-8?B?TzMyTGh4NXB6ZmJmbk9USTZmQjNCOVA4RTNVYVhRcGlheWh4MXZqcExkVy9s?= =?utf-8?B?MGFOUE12Q3l2dUNxVVhhWlJ4U2wvWWNQRzhReHk5UkdYaTVMYnZhMTVCYlZh?= =?utf-8?B?cnZvUEJuNVBMbXBQS1JSVUpMc1BZb0Q1cVhZeGpqM3VMN1g1aXoyMnR2UXNK?= =?utf-8?B?Z3c5cWt4bGljczFMT3ZBTkFmU1FRcXhmVUNCRFdBMGJmRjJDalhhQWhmUDVk?= =?utf-8?B?UXlQbGJxSEYwazRvN0NsaHBsMmIvWGpKcFU0TUlMdWdjbHllamt0Qmo1RDJH?= =?utf-8?B?WnNsekxlRzh2ank3TWVsK3RkVWZwbmViRXFKV2d6bmJ3dUNWeDJwdzlDdVZk?= =?utf-8?B?MWM0M0tYZGdrQ0VFUDluRjFzNEZHUzdvbS9kZ095VU9MdWUzazg5VEpLSjV5?= =?utf-8?B?Tk9Dbm1nRjNHQVJ5dStHOWhkd25FcC9sUUdyc3dZaThWRGl3bUkwTTdHK0Zo?= =?utf-8?B?OHk2cFVLTUVEb2VFM1FlT2RsdUl1c3FhVXIrUFhSR050MDVRMm03VllaN29l?= =?utf-8?B?RU5pcnVHNVpuUDZ5Y3dDcGlYYW5qWUYyWVgrZ0J1bG9GaGtPNW1lL21jZkVh?= =?utf-8?B?TkZkaEhUVWVGY21ZYUlXMkVIbEVzNTNiYlM2U2RNb1d3Q1hic0JxSEowSUsz?= =?utf-8?B?ZE5XSmVOTWo4TEhSbzJVc2FSZDVzWHlnUHZUanpKTTJRZXZqWWpjWnBmalRV?= =?utf-8?B?WjBtY3pJL0JvZDFhUGtKNjZpZy9XZUdjcHl0cnhQZXBEWlFkZDNxUlVqMW9r?= =?utf-8?Q?YgqZPlz2DR5gE?= X-Forefront-Antispam-Report: CIP:51.104.160.93; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz; PTR:InfoDomainNonexistent; CAT:NONE; SFS:(13230040)(35042699022)(36860700013)(82310400026)(376014)(7416014)(1800799024); DIR:OUT; SFP:1102; X-OriginatorOrg: astron.nl X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Oct 2024 12:47:33.6580 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: e7f13e94-c904-404d-0b8c-08dce6ce36ed X-MS-Exchange-CrossTenant-AuthSource: AMS0EPF0000019B.eurprd05.prod.outlook.com X-MS-Exchange-CrossTenant-Id: 03e9259c-3262-4694-ad93-4dce7c9fa403 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=03e9259c-3262-4694-ad93-4dce7c9fa403; Ip=[51.104.160.93]; Helo=[xwaresmtpservice-54f96dbd7b-qp9jc.xware-eu-k1-north-1.o365.crossware.co.nz] X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI0PR10MB8762 X-Mailman-Approved-At: Mon, 07 Oct 2024 14:58:43 +0200 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --------------7Nw83z10Aq0gDJwBgTvrw2Zv Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Dear Stephen, The problem has not been solved, but I found a workaround. According to the documentation (https://doc.dpdk.org/guides/prog_guide/gpudev.html, sec 11.3), rte_extmem_register should be invoked with GPU_PAGE_SIZE as an argument.  If GPU_PAGE_SIZE is set to 2 MB instead of 64 kB, registration of 72 GB of GPU memory (on a Grace Hopper) is done in about ten seconds, not hours. rte_extmem_register(ext_mem.buf_ptr, ext_mem.buf_len, NULL, ext_mem.buf_iova, GPU_PAGE_SIZE); Thanks,  John Romein On 05-10-2024 00:16, Stephen Hemminger wrote: > On Wed, 1 Nov 2023 22:21:16 +0100 > John Romein wrote: > >> Dear Slava, >> >> Thank you for looking at the patch.  With the original code, I saw that >> the application spent literally hours in this function during program >> start up, if tens of gigabytes of GPU memory are registered.  This was >> due to qsort being invoked for every new added item (to keep the list >> sorted).  So I tried to write equivalent code that sorts the list only >> once, after all items were added.  At least for our application, this >> works well and is /much/ faster, as the complexity decreased from n^2 >> log(n) to n log(n).  But I must admit that I have no idea /what/ is >> being sorted, or why; I only understand this isolated piece of code (or >> at least I think so).  So if you think there are better ways to >> initialize the list, then I am sure you will be absolutely right.  But I >> will not be able to implement this, as I do not understand the full >> context of the code. >> >> Kind Regards,  John > Looks like the problem remains but patch has been sitting around for 11 months. > Was this resolved? --------------7Nw83z10Aq0gDJwBgTvrw2Zv Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
Dear Stephen,

The problem has not been solved, but I found a workaround.  According to the documentation (https://doc.dpdk.org/guides/prog_guide/gpudev.html, sec 11.3), rte_extmem_register should be invoked with GPU_PAGE_SIZE as an argument.  If GPU_PAGE_SIZE is set to 2 MB instead of 64 kB, registration of 72 GB of GPU memory (on a Grace Hopper) is done in about ten seconds, not hours.
  rte_extmem_register(ext_mem.buf_ptr, ext_mem.buf_len, NULL, ext_mem.buf_iova, GPU_PAGE_SIZE);

Thanks,  John Romein

On 05-10-2024 00:16, Stephen Hemminger wrote:
On Wed, 1 Nov 2023 22:21:16 +0100
John Romein <romein@astron.nl> wrote:


Dear Slava,

Thank you for looking at the patch.  With the original code, I saw that 
the application spent literally hours in this function during program 
start up, if tens of gigabytes of GPU memory are registered.  This was 
due to qsort being invoked for every new added item (to keep the list 
sorted).  So I tried to write equivalent code that sorts the list only 
once, after all items were added.  At least for our application, this 
works well and is /much/ faster, as the complexity decreased from n^2 
log(n) to n log(n).  But I must admit that I have no idea /what/ is 
being sorted, or why; I only understand this isolated piece of code (or 
at least I think so).  So if you think there are better ways to 
initialize the list, then I am sure you will be absolutely right.  But I 
will not be able to implement this, as I do not understand the full 
context of the code.

Kind Regards,  John

Looks like the problem remains but patch has been sitting around for 11 months.
Was this resolved?



--------------7Nw83z10Aq0gDJwBgTvrw2Zv--