From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3B9AD46801 for ; Tue, 27 May 2025 10:30:16 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C91EF402ED; Tue, 27 May 2025 10:30:15 +0200 (CEST) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2088.outbound.protection.outlook.com [40.107.237.88]) by mails.dpdk.org (Postfix) with ESMTP id 34FD8402ED for ; Tue, 27 May 2025 10:30:14 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=kbKnxQyBYPKlmODUXyD+/75SVuBpasjTjblu6sMjxajgcK9XnmUjAmZR0b/IjDotU8afI8ynHKSbScAdIE+baKwuyVx+SjC2Wx8LcMa7Zqn3Dmpy0woW2+R3V1S4LKigN+Y0xWANFKYiJZth8B195ocXvCWXpAtHnL5KDKI36Vl8IwRJRHP7lqVB836aYTPsCSuwVj3Zsu89uEOOMe2JG9iza8BmnCshFckS52etKPkZLUkQ50/KiPHn2GUuQy/PBYuWgQC1hED1q0mOF/CYtMwKvtbPw9LzzfyPUqGYLkx6rBBqeUs3ie+2NSKPuWECgxJEO3kI0infkcoMw7kLwg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=ccqGlPrwbClCfld9lTIotFCNKucRyneTuo29uBfj080=; b=yfptLL8lQZpnGGXsIjZAOq+x/lkYgOz8r3/xkurugydD31mwmWOBkos63X5XCjg7IcFnfvsgTNeRB/F2FH7oHRD59XjWdpqlgcHysPowjtPENz3CRxDE8pazMm/6gSPs94b9OKke2qoAXzlqoDxItXWXWf0C4hQbgiwIacHoreDJP3G5KielhmYZdDDggyvpvEdfcqGxO17SfxT5+P+YZ/hQp6oWT9NRJl0HHnYItuxHWRj5DEPcIHRWsI7L2+EEWrY5z0oC75RYRELzeezjsznJma/JVEojaqMIZHhZg03FfzJQVNlOiLw1CurB/npGylfDONojVuuFSLvum9hNYQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=gmail.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ccqGlPrwbClCfld9lTIotFCNKucRyneTuo29uBfj080=; b=DvMZAqvS3SO1SelPykX8wvDCWy0HkbH48oHYBPrfTQ40TGQz3J5pq7rbzIt/wl83sbTxxew3tcy8SsxpROQlgR4gRKefJvk2wPGohhfeW5v/iGLb8twxNeEiuY7DDIwqf64MIJ1jgqsnwIMyQ3mUEpj6DZDaFs9uZBEd39NbDxRpyl/RE2l9JrAk/n9aRDlVDDXtpiq+Z64OWvFJiNzXYcWyx1W2zxSLaVO4b0FF5fr6+m1oeSL1X27xQ7VvKPhGa1Jqk3aKUDNWq9QazyPW1G0LUFSPJRO1PW/LG8Nx0BjQXNO1lhkug1vBddcNZrXXS/6vGMgjaL0Eq0S3JDKGBA== Received: from BL1PR13CA0176.namprd13.prod.outlook.com (2603:10b6:208:2bd::31) by SJ0PR12MB8114.namprd12.prod.outlook.com (2603:10b6:a03:4e8::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8769.27; Tue, 27 May 2025 08:30:09 +0000 Received: from BN2PEPF000044A5.namprd04.prod.outlook.com (2603:10b6:208:2bd:cafe::60) by BL1PR13CA0176.outlook.office365.com (2603:10b6:208:2bd::31) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8769.18 via Frontend Transport; Tue, 27 May 2025 08:30:09 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by BN2PEPF000044A5.mail.protection.outlook.com (10.167.243.104) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8769.18 via Frontend Transport; Tue, 27 May 2025 08:30:09 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Tue, 27 May 2025 01:29:57 -0700 Received: from localhost (10.126.230.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.14; Tue, 27 May 2025 01:29:56 -0700 Date: Tue, 27 May 2025 10:29:51 +0200 From: Dariusz Sosnowski To: Charles Oluwaseun Oluboyo CC: Subject: Re: Unable to initialize ConnectX-4 ports in DPDK 24.11 and 25.03 Message-ID: <20250527082918.uurt6ewbhveldici@ds-vm-debian.local> References: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-Originating-IP: [10.126.230.35] X-ClientProxiedBy: rnnvmail201.nvidia.com (10.129.68.8) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BN2PEPF000044A5:EE_|SJ0PR12MB8114:EE_ X-MS-Office365-Filtering-Correlation-Id: cb41e81c-8388-4eca-36a7-08dd9cf8b110 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; ARA:13230040|1800799024|36860700013|82310400026|376014|13003099007; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?t7eqghNHp0CQfC8BJ6FQLomCR/N4LFnClqDeYi+q6O9zehYAYKj+EBVRyU6P?= =?us-ascii?Q?xuwYlvrfqULkDPqlh/XZHLc4YCd4SNXXtCw+wMACEfueNx1/tnM6+PLlvX+q?= =?us-ascii?Q?xrngL3Zvvpk7zF83G5kGOuJt/CJx1Yph4dlrVzn3J91AZGuOAu14w2Beb6aD?= =?us-ascii?Q?30oCh/SugiZ7lqW8ceJvvjkvLnEuG8l0ys/gqp8T1Ar7554v5n4VP4DR7tq7?= =?us-ascii?Q?2gQaOpBmh2JjEVyeQsuzB6QWxYw2w83VdeFcjw9LURXXpBHkTjY9mW5ceTjV?= =?us-ascii?Q?DKVnugAl4KoPREh8c5lZRgBr/EyX8VqyNIvE7GT3ACVxSLRc/ziFN03YBRgc?= =?us-ascii?Q?rqVSy1Yv6g7j3nY07X9HbXeaDGd5ZYt2nJuUwOZUpzMTjK6Dc1AWejGO/aWZ?= =?us-ascii?Q?VjIvDcf6163JKoO0P+fjS8Q2GYJKusOf4JbuPJVu+UkaiZAvULQexVeaOyqJ?= =?us-ascii?Q?wQQwZzfVmf1oB7q+8sxs9exm2rHpKitHbG4q76IBZTI4Bs8q8lqxg1TdRgTX?= =?us-ascii?Q?//F3dGgaHsm+a5H3H5RjdEeOzqMrMN0RUQnBhtwvyrxvA+j3tvnCNsN1tm3Y?= =?us-ascii?Q?K53zZNJzxeDauEUk+lKFCsx6V1J5sq4cFxsztwJx0EngMVQo7JfAW29b4/nz?= =?us-ascii?Q?S2aqHhQ0HrZ6sJnpzAG9oRW8vbqMev3Us7qIvXDXyhoNcKFMHCNsmQZ9Ky27?= =?us-ascii?Q?GBp+t1Biis0K0iKH9FtzxjE/ggbSQzwRB9F0ABOouJ5AjOUHPDKgEK+dfG5R?= =?us-ascii?Q?niuRQYDyUR3+DMeaUAALBreZkTrHAayc8T0ocbhCu0w20cVNCAaDDcWVcRs5?= =?us-ascii?Q?//AUQSpCQVyeu2uGZULvt1dj5jecfeNmxwHNzZQ5LPIc421Fj7zPM76VkHO9?= =?us-ascii?Q?AfK5iFji8VBNFQDTHxFbGG/R/hUDltZtKgzzzqAnjUEjRixiTy4t6yIorvKt?= =?us-ascii?Q?pTtXC0RzfF+mTDBaW99AvjZPWUPavjDBykZhMqh2j+pfJueEoW73EkFcpnbW?= =?us-ascii?Q?HMC9iKRBUupW2WetotEo9chWhsMsPtQyoV8Gq+NtsWtvnLyawOVfMbae5jsQ?= =?us-ascii?Q?L8AT10b45O2uveQXUHCeb6+iBWxgN0zVjrA5lB76dZSwIdS0lND/LrfQKI/u?= =?us-ascii?Q?VlBO5e+LY+sQtFxGsWe4vzja3SKb7ve8qOJUOYK2HqFkX/AskqFqD1cIFhu5?= =?us-ascii?Q?FT65l5GP/OVzt1jtcS4W+58GDKwDyJNxYUGFYeNEsPVtQ4VxFnYRAf4e+BC0?= =?us-ascii?Q?ebWsEjpXvhpRHYK324tddP5+Nvzy9pwXPWHm+fNQ22GUDXLSQnK+uju3SqUq?= =?us-ascii?Q?w8M3upX3DtX7J/IkLVDGuB2pNTGUMbR+T+jtcijBLRpj/sj+++sLzyu5IhVe?= =?us-ascii?Q?USWHPrIn0cMwQwbIrzUAdJvsmbO28BIZzQpkqx+sRZy/Sns+m0sgpoOrZwH4?= =?us-ascii?Q?V3QOLt/nZCLhvPH4ghM/7ukGt/+f461Re/f2BB+gWfStsT26xRkPlidkmQSq?= =?us-ascii?Q?+6cl0MXqrfIvkdNRZu3UX+aF+pyQ1U7LQ/3iJVl/hSz+a+G1xm9ugok2uQ?= =?us-ascii?Q?=3D=3D?= X-Forefront-Antispam-Report: CIP:216.228.117.160; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge1.nvidia.com; CAT:NONE; SFS:(13230040)(1800799024)(36860700013)(82310400026)(376014)(13003099007); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 May 2025 08:30:09.1463 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: cb41e81c-8388-4eca-36a7-08dd9cf8b110 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.160]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: BN2PEPF000044A5.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR12MB8114 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi, On Sat, May 24, 2025 at 01:50:45AM +0100, Charles Oluwaseun Oluboyo wrote: > Hello, > > I have a ConnectX-4 dual-100Gbps NIC that works with DPDK versions > 24.03 and 24.07 but not with 24.11 or 25.03. > > 0000:04:00.0 'MT27700 Family [ConnectX-4] 1013' numa_node=0 > if=enp4s0f0np0 drv=mlx5_core unused=vfio-pci > 0000:04:00.1 'MT27700 Family [ConnectX-4] 1013' numa_node=0 > if=enp4s0f1np1 drv=mlx5_core unused=vfio-pci > > Setting the log levels to debug, the newer versions are unable to > configure more than one (1) description on any queue: > > ETHDEV: Invalid value for nb_tx_desc(=1024), should be: <= 1, >= 0, > and a product of 1 > > Whereas using the older version, I am able to set a larger number of > descriptors. Tried 512, 1024, 2048 and 4096. > > ********************* Infos for port 0 ********************* > MAC address: EC:0D:9A:35:1A:16 > Device name: 04:00.0 > Driver name: mlx5_pci > Firmware-version: 12.24.1000 > Devargs: > Connect to socket: 0 > memory allocation on the socket: 0 > Link status: up > Link speed: 100 Gbps > Link duplex: full-duplex > Autoneg status: On > MTU: 2030 > Promiscuous mode: enabled > Allmulticast mode: disabled > Maximum number of MAC addresses: 128 > Maximum number of MAC addresses of hash filtering: 0 > VLAN offload: > strip off, filter off, extend off, qinq strip off > Hash key size in bytes: 40 > Redirection table size: 4 > Supported RSS offload flow types: > ipv4 ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv6 > ipv6-frag ipv6-tcp ipv6-udp ipv6-other ipv6-ex > ipv6-tcp-ex ipv6-udp-ex esp l4-dst-only l4-src-only > l3-dst-only l3-src-only > Minimum size of RX buffer: 32 > Maximum configurable length of RX packet: 65536 > Maximum configurable size of LRO aggregated packet: 65280 > Current number of RX queues: 4 > Max possible RX queues: 1024 > Max possible number of RXDs per queue: 65535 > Min possible number of RXDs per queue: 0 > RXDs number alignment: 1 > Current number of TX queues: 4 > Max possible TX queues: 1024 > Max possible number of TXDs per queue: 65535 > Min possible number of TXDs per queue: 0 > TXDs number alignment: 1 > Max segment number per packet: 40 > Max segment number per MTU/TSO: 40 > Device capabilities: 0x10( FLOW_SHARED_OBJECT_KEEP ) > Switch name: 04:00.0 > Switch domain Id: 0 > Switch Port Id: 65535 > Device error handling mode: none > Device private info: > none > > Is this a known issue? Please, what should I do next? > > Oluwaseun One of the patches merged to 24.11 introduced an issue with queues descriptor limits on older NICs. A patch with a fix for that is pending for merge to 25.07. Would you be able apply the following patches and test on your side? - https://patches.dpdk.org/project/dpdk/patch/20250424133128.133900-1-viacheslavo@nvidia.com/ - https://patches.dpdk.org/project/dpdk/patch/20250514075530.419423-1-viacheslavo@nvidia.com/ Best regards, Dariusz Sosnowski