From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 7FBB44688D for ; Thu, 5 Jun 2025 16:15:29 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 19B2540281; Thu, 5 Jun 2025 16:15:29 +0200 (CEST) Received: from NAM10-BN7-obe.outbound.protection.outlook.com (mail-bn7nam10on2061.outbound.protection.outlook.com [40.107.92.61]) by mails.dpdk.org (Postfix) with ESMTP id CA47740150 for ; Thu, 5 Jun 2025 16:15:27 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=F1UJBkOU209iUsQS+XKg0iw57lQZ/ThUmAlgcAJRfNJFPF/je+9ijuKUQ4w1zRGKCE7QJ0QdB5kUYD9PluqlxUlFSIl6ge4Hdaz8SFV8kJUQ/S3ymNbAqj0DAJdfDNY4OKZHJvk4BCXgVKV+Ad/oJltDlUOkHtqvGrPRv6+vKLqrE0f9xDwyuLF3x7s5Lkj6vc1I11lwl5p63HpS2+86WbRixD/VhUZzVxRBXZA1opIYRDOLQy79ubM0LpSOHhZPAIHwmN88Ek298rZR/pWFeuE4Sv2De79yxunZjsoY41RfDJsJrJJJyi6+ubsCAXNzKuJCknab345zunJlo/8gFA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qDGZxv1gat2rsZTAojroyoJDkiPTZEc/hTYX3wSwXJY=; b=pppd6X2ovd9dWjZYMSq5kWC53s1ho9YZmbxQYEYSjANk0EkxBFAMQXsN5nMeNTpmUrb+NXl11+lDgCu0J0VTtTzZyzNeAuWK+9CkbyCkb7kau4GPlWAj8TiMlZMAwthne3aR7KYrbsc+N5LLTwuUpd7NDT1abedzHi8waI/+gbcz0vMuNt+3177yvmcdzd0qDe7f6wfUTNN5VL5TI1tMvnHWXMVTuHRmKmEQTajs4SfpDwtQy+9mNySJydcODQupa0Ofkd+q7B8SZ8/erA7SOJSDIssp2BOa8dH0Ghh1Kp460qvoQuK9S72Sgt8w0oqZ4ZJI+gt1cqGmHTibcIbI1A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=gmail.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qDGZxv1gat2rsZTAojroyoJDkiPTZEc/hTYX3wSwXJY=; b=pVeyIsrgZ9l6Da+8Aa3VcICFOKRMeYBa7kKi2r4JTdTbQjlEOIKayuygF8uv0Sxqv5OD7fo0K5CcON0PvTGix8tGlRdvX8I2RwOnrP1fsGvZktVbJelEyRmicXftwNXvlT4FO8+XTMMD3flyXzJbRKc5ZDyF8672tHPGPuZ+G/y+SWUnuYezGWFt6fH5RgR+qEel2OaqA70ViuyX9Ni0lRjyuyDb6VJUdsrDtHjN/3wLiiWVGibOrGo0kkSoLxweqA9l4h/DlMn3y8OEWa7O5cTmhOoE/wUo7JMGFQTTWy+vFg8KEPxIW11HHoL05IFLCjRdtxXvHG7ODK6DomQvVw== Received: from DM6PR02CA0056.namprd02.prod.outlook.com (2603:10b6:5:177::33) by SA0PR12MB4479.namprd12.prod.outlook.com (2603:10b6:806:95::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8792.34; Thu, 5 Jun 2025 14:15:24 +0000 Received: from DS1PEPF0001708F.namprd03.prod.outlook.com (2603:10b6:5:177:cafe::46) by DM6PR02CA0056.outlook.office365.com (2603:10b6:5:177::33) with Microsoft SMTP Server (version=TLS1_3, cipher=TLS_AES_256_GCM_SHA384) id 15.20.8769.19 via Frontend Transport; Thu, 5 Jun 2025 14:15:24 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by DS1PEPF0001708F.mail.protection.outlook.com (10.167.17.139) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8792.29 via Frontend Transport; Thu, 5 Jun 2025 14:15:23 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Thu, 5 Jun 2025 07:15:07 -0700 Received: from localhost (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.14; Thu, 5 Jun 2025 07:15:06 -0700 Date: Thu, 5 Jun 2025 16:14:59 +0200 From: Dariusz Sosnowski To: Charles Oluwaseun Oluboyo CC: Subject: Re: Unable to initialize ConnectX-4 ports in DPDK 24.11 and 25.03 Message-ID: <20250605141459.obfe6vl7ctpatlnh@ds-vm-debian.local> References: <20250527082918.uurt6ewbhveldici@ds-vm-debian.local> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail201.nvidia.com (10.129.68.8) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS1PEPF0001708F:EE_|SA0PR12MB4479:EE_ X-MS-Office365-Filtering-Correlation-Id: 14663073-ebc1-45a6-7210-08dda43b69b6 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; ARA:13230040|376014|1800799024|82310400026|36860700013|7053199007; X-Microsoft-Antispam-Message-Info: =?utf-8?B?Z1pWL0NGb0NJbXNzSDUyMWJBQTdxbmk3bGRjYVpMbVgzZnFlL3lwSXZHQWoy?= =?utf-8?B?ZDIrT1FhdU5nVzRyL2JudVU3bTFMcm9pL09odFpQNjNvNjZjVnJyc1ZxMmpT?= =?utf-8?B?VWlaU1Z6RENyQ1IzaFV3WGZuV1VJWE4zR01UV2tIcXpDM2R0SXlVcWdEWVJ1?= =?utf-8?B?MjNJQUhrVmsvTGQ5NVRrSDJBRVFwc1g4VFJaL1luUGRYYndPQUVQZ1dXd1BI?= =?utf-8?B?dGxIK1A2UWRoSDNVdWEybWo0MklUTVRrWFZzbjVlVUQrM2k1NS9IclEwQXYx?= =?utf-8?B?K0RRWnBBM0JadnJPUmxQYTZTNzQ3S2ZNUEFHUzJlSHRmZ3BtMEZxRm1sSW0y?= =?utf-8?B?VS9wL1ZWUkE3UHE0NC9HRlZzMklDbWp5YTNHT2ExMndGV05TYi9SVjFwck5W?= =?utf-8?B?NHlITThQMG5VL3k5eW1RdmgrSUhDZG5xZjUrQkpMRlFuazdqT2dXQktaU1Zn?= =?utf-8?B?T0xrL0FkL1V0Zm5jRmJ5ZmMwZDJoYS9zSUQyNURBQUJ3OVZHYjJ3ZnN3MTUv?= =?utf-8?B?eVhLT0NQdFUreTlQeFV1VStqMFlOczhxaStBWmVtVkxrVzhPMHZ4RE10K0xu?= =?utf-8?B?eVdHZlU3RklFR2pmUFZvTVhrYTFEbFltcWRPY3NnWHVaVXVvWGtLMU9OU1Az?= =?utf-8?B?TnhtbEZBZ2NNQVdNZ1FUclA4Wlg2eUprRWJ4cDlLaGV1OEJhRGExVjhzWXNT?= =?utf-8?B?c2dWRnRNNDBzV3hENHZVK2MzME9mU2ZVUktROSt1RmF3NzljOVpraU1Zajlh?= =?utf-8?B?ZHZGTk9QMlpUY3JVYVUvY2dWcFYwU1JlekVsOHpYTXBFNHh1UVR6ejFnbXk5?= =?utf-8?B?UndWSFoxODNDcGdKVWlacjBTaFdlQzdReU1odnh4cThNL3BHM3FmcEttTEhK?= =?utf-8?B?UkdhelBNQU8rMHhrK3BldFRnbVlYVWN4dWJqTlVpT3ZIV2JtNVJYR0twSC9i?= =?utf-8?B?VkpzVFNNc3FIQXR5eW9xTDljREZySkUwdFhUaUxhMUw0WkRRZkFhcjVUZWU1?= =?utf-8?B?UkdKcXNvYmlMQnRIQkhVRHUvMG5OZFpsOTlUaTdkZ2d6UllDZFJVOWY4ZjY5?= =?utf-8?B?cEIvUURYZVZyNDFXRXYvWXRpZTVxN0U4Wk1IKzJDdWtwOUdBajJkaVErUHc2?= =?utf-8?B?dTlOMU8yM25qQ0JqQWs4K2ZjS3p5cVRnRXRCQjJlaFM3QmFYdVpuTi9lWDQv?= =?utf-8?B?dE4vUDBwOUIxT3cyWTBpUVAyUjMvTWY3UkVPMmtjdklmd0l4T2RPczBSS05r?= =?utf-8?B?UG5Vak90QVhJR2JqVU5NbjhjMlpHcklBNFQ2VG5OZ203dVNNUkVBeGF4dkZo?= =?utf-8?B?ajJzK210Sm9WWXkxQ0RoU1VTMXZzazR0WldkendVeFE2aXVHUzZqQklhRWlD?= =?utf-8?B?UzUyUWxYeFVHc1ZHUkVvdElMV1F3VGgxMmgraWdEeEhwYlNNV0l3MVNDRzlJ?= =?utf-8?B?TnN6WGlqMjE3ajZ1RnR2WmFaVVN5a1dBVjZlNSsrbW82bCtub1lUQnZud05Z?= =?utf-8?B?SjgxSnlrSGVhZElSd2g4aW1OSW1xbmhhbmdrRUVHNE9KQmRpN05YM294Mklp?= =?utf-8?B?ZjFSbk91Tm9mblZYQnRlUmVEbkJyeTRIbzZXWTZFL2J3V2tHYW5sdTl5SjJX?= =?utf-8?B?VHhxbVF0Nlk3Rk5lcGNQZy9GSXFBTUdtd2g2Rm1rYVpQVkJoZGVtNFlTMzEx?= =?utf-8?B?eFpCMEpxdkpHSXdDMWJrd1A2RjNGUWhDQjJsOEVQRWMxcGQrbFYxN1grb2xU?= =?utf-8?B?QnBZSVBPelNtRXB2MlU0RkI4eDVCeDlRd2RUL2JKdTlnUzBjYTNMaFpaTXpB?= =?utf-8?B?NVZXb0pqdFM5K0Y4a2d5SDJvZm1rZnl0Wmk4MS9WMG45Z0hBVFJTYzh1VlB1?= =?utf-8?B?SUJhSTBGRGY3aWNPRDhVc2ljV3JWWHQwUkRwb1kvVjI0cU1uU2VVcGR1LzM5?= =?utf-8?B?SzdqZVlpaXRrekJnbmlzRDRyNEs1ZkNNOFZtRTdySGNYUlVTQ2g5TGg4UitN?= =?utf-8?B?Y2gweFRUSlA1SVdCUmp1anJRSFlVVlZsVTVJTE9TTnRXNGV4TjNuMnlFL1Z5?= =?utf-8?Q?N3RsmZ?= X-Forefront-Antispam-Report: CIP:216.228.117.160; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge1.nvidia.com; CAT:NONE; SFS:(13230040)(376014)(1800799024)(82310400026)(36860700013)(7053199007); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Jun 2025 14:15:23.8565 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 14663073-ebc1-45a6-7210-08dda43b69b6 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.160]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: DS1PEPF0001708F.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA0PR12MB4479 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Thu, May 29, 2025 at 12:00:29AM +0100, Charles Oluwaseun Oluboyo wrote: > Hello all. > > Appears the PMD is returning the wrong value for the max MTU. > > The error about the frame size is raised in eth_dev_validate_mtu > called from rte_eth_dev_configure. > dev_info->max_rx_pktlen = 65536 > dev_info->max_mtu = 65535 > > That is not true. From my testing, max MTU is 9960 for this ConnectX-4 > Should this have been set in mlx5_dev_infos_get? Correct, the current implementation of mlx5_dev_infos_get() returns invalid max MTU and Rx packet length. It should be fixed. I have opened a bugzilla ticket for tracking: https://bugs.dpdk.org/show_bug.cgi?id=1719 Thank you for reporting. > > Regards, > > Oluwaseun > > On Tue, May 27, 2025 at 7:12 PM Charles Oluwaseun Oluboyo > wrote: > > > > Hello Dariusz and all, > > > > > > > > One of the patches merged to 24.11 introduced an issue with queues > > > descriptor limits on older NICs. > > > > > > A patch with a fix for that is pending for merge to 25.07. > > > > > > Would you be able apply the following patches and test on your side? > > > > > > - https://patches.dpdk.org/project/dpdk/patch/20250424133128.133900-1-viacheslavo@nvidia.com/ > > > - https://patches.dpdk.org/project/dpdk/patch/20250514075530.419423-1-viacheslavo@nvidia.com/ > > > > > > > I applied these patches, and they have fixed the issue with the > > descriptors. There are now 32768 per queue. > > I have tested with testpmd, and the ports work. However, I am unable > > to initialize the ports with pktgen. > > > > Initialize Port 2 ... > > Max MTU: 65535 > > Enabling Tx TCP_CKSUM offload > > Enabling Tx UDP_CKSUM offload > > Enabling Tx IPV4_CKSUM offload > > Allocate packet sequence array > > Setup latency defaults > > Setup fill pattern defaults > > Configure device > > ETHDEV: Frame size (65553) > device max frame size (65536) for port_id 2 > > !PANIC!: Cannot configure device: port=2, Num queues 1,1. > > EAL: PANIC in initialize_port_info(): > > Cannot configure device: port=2, Num queues 1,1. > > 0: /usr/local/lib/x86_64-linux-gnu/librte_eal.so.25 > > (rte_dump_stack+0x42) [7f16cb3de6d2] > > 1: /usr/local/lib/x86_64-linux-gnu/librte_eal.so.25 (__rte_panic+0xd4) > > [7f16cb3b737f] > > 2: ./usr/local/bin/pktgen (5606908ff000+0xd26e) [56069090c26e] > > 3: ./usr/local/bin/pktgen (5606908ff000+0x2c61e) [56069092b61e] > > 4: ./usr/local/bin/pktgen (5606908ff000+0xe339) [56069090d339] > > 5: /lib/x86_64-linux-gnu/libc.so.6 (7f16cafc2000+0x29d90) [7f16cafebd90] > > 6: /lib/x86_64-linux-gnu/libc.so.6 (__libc_start_main+0x80) [7f16cafebe40] > > 7: ./usr/local/bin/pktgen (5606908ff000+0xecc5) [56069090dcc5] > > > > 65553 looks very unusual, doesn't it? Do you have any suggestions as > > to what to do next? > > > > Regards, > > > > Oluwaseun