From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id D01BAA0546 for ; Wed, 26 May 2021 15:48:01 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C5206410E6; Wed, 26 May 2021 15:48:01 +0200 (CEST) Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60088.outbound.protection.outlook.com [40.107.6.88]) by mails.dpdk.org (Postfix) with ESMTP id B688940041 for ; Thu, 20 May 2021 11:53:03 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nwjLN92NnI6nhYt2lWxxzecZseesduRETDYNF2owlb38RGViHqJnHOqB6WHxbZ0Yv8Yd86SQ8zuMTvgbp8U01BvQ5d+kq+bDk6FG9fZm27v2kA+FRNLeXJV42cC+FuDQ+BifdzVtEt/iorpkO9R4aU9QzxHD3IB7YK6xY3LylbiIAQv0zLlRJwVZczVY0HYNT7oWsY7BBtpnnR2yuptKuXs9u8t6NqgmMswqWryuarE7fzFSUnpqv7UQvr0uiMA8E0hwAwAR+m4VNllDgZ3piHt1KDY7cFxFeqt1QWXHz4wQfUigfZ2TuG3jLuNvhDDrzLLw/YR9/eX3gZCtauf1Mg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=P4kQ5hbiP3H7sUfBGsNWtL6VMyg1mQz7aAENsKSWjrA=; b=cGu22eJMImb+wlvsgmTBX7ZkDsoqi281VfATGw8cSzW97lsNghxAy24oTfjmlhYTwRB5Txrzu22oHDUa285GMgUOdm0PTOy43f08mjmfJWA65zGHioD0/8Q+Fgk6fc8jOBkuN71B28gGqht8MkaP5ZAxFBDqPA3/S/ln/648B7SRfn4glELjfIwPRv8EKF0OB1vgERUvnOJBvR7Lvm1sPG5hfOK6bE3WrefOyfcR55VWuOrFdlWsYCYV287A9CYcqKpJHr3jKzyWUanW8+8blsWVWjnH6NCR3wMNT8oBKKuwBRakDOtOAL0NVYDp+DdwANQoZn/wTrQz9+z7MVIZiQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 188.184.36.50) smtp.rcpttodomain=dpdk.org smtp.mailfrom=cern.ch; dmarc=bestguesspass action=none header.from=cern.ch; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cern.onmicrosoft.com; s=selector2-cern-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=P4kQ5hbiP3H7sUfBGsNWtL6VMyg1mQz7aAENsKSWjrA=; b=lJDOMhXpfhrt+Ld1mW65soLb52B0wDiGtPv1VrylVSbmCdOTysR36c/y1cPvvGyCfJG4mEZaE+31OTw5yWNKMEQYUohXzGZYp2EwiD+8dbUEn8dQ+brUgExjOrpCOwUDnHFGzNMs3nPtxN5koKDRwd4Sgf4yy2Z1UgKDqUeUVOs= Received: from AM5PR0601CA0059.eurprd06.prod.outlook.com (2603:10a6:206::24) by DB6PR0602MB2758.eurprd06.prod.outlook.com (2603:10a6:4:94::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4129.28; Thu, 20 May 2021 09:53:02 +0000 Received: from AM5EUR02FT015.eop-EUR02.prod.protection.outlook.com (2603:10a6:206:0:cafe::fc) by AM5PR0601CA0059.outlook.office365.com (2603:10a6:206::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4150.23 via Frontend Transport; Thu, 20 May 2021 09:53:02 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 188.184.36.50) smtp.mailfrom=cern.ch; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=bestguesspass action=none header.from=cern.ch; Received-SPF: Pass (protection.outlook.com: domain of cern.ch designates 188.184.36.50 as permitted sender) receiver=protection.outlook.com; client-ip=188.184.36.50; helo=cernmxgwlb4.cern.ch; Received: from cernmxgwlb4.cern.ch (188.184.36.50) by AM5EUR02FT015.mail.protection.outlook.com (10.152.8.154) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4129.25 via Frontend Transport; Thu, 20 May 2021 09:53:01 +0000 Received: from cernfe01.cern.ch (188.184.36.42) by cernmxgwlb4.cern.ch (188.184.36.50) with Microsoft SMTP Server (TLS) id 14.3.498.0; Thu, 20 May 2021 11:52:51 +0200 Received: from CERNXCHG51.cern.ch ([fe80::20f7:8173:2da8:398a]) by CERNFE01.cern.ch ([fe80::885b:f831:a970:75e1%13]) with mapi id 14.03.0513.000; Thu, 20 May 2021 11:52:52 +0200 From: Alberto Perro To: "users@dpdk.org" Thread-Topic: MLX5 configuration and installation Thread-Index: AddNXeXWvyoW8F0fQOiIfcydLvhaKw== Date: Thu, 20 May 2021 09:52:51 +0000 Message-ID: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [2001:1458:202:55::101:5d28] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 31287968-e276-44b8-5c5f-08d91b750e8c X-MS-TrafficTypeDiagnostic: DB6PR0602MB2758: X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:6430; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4me7zOytlIfvIx8FWCLz98GUutTl3FO9qBYyrqb9NMq53g32ix0LVEahwQyo1Ri5lI6prEH6+0TEn7BAtabzLBmwfmmv8YAmQo3U3O6DMmt6Kx49CMgkZ+me4IxcXgJrg03nfCpUeCjqErz5ynIzcq5w0C0Ll9TrMk6a8ZSDRbnT/ak91UBxcPxavtBn7k1KDGQYl7a6j83pukvKC9dKfvn1lBwWQi4YRhBNRM5y17GLzIGw2rdTryaLUiHJzRA4iRfzRi/881VFmxV1MG6isY3QYeW/YP1DiT4yJiwL5OwVttgKrw3ltEDwKLWXdMmydVKWUxdz+kEcBMJmMuR45MQBQSSqnzMXoc2HNhmczhEArlTZI0rViWfFn5VxAKLRhRNNz26s9KaE/3bzH/dVvi3krz8JNFdwHym663g5eWFAOD6aVRn4fI/UtQnVlhsVThbZOmiAyH79pF+GZ2aLgibOsLuLipIM8b/XmxET0wM1rEB4COZDTeWuN/poRNbCrLBlpnFcm9dF59S9Q+tE+Xu+9M6HBxGcHcPucUos+1WCHGp7RUqZX+dU4BiPBu97oUEh/e08O0tbUHSd6DLmHYx8X0YMO2KvikZpmJzXsp5KHfNEsJi4+Z8DByO4gYPybbI1XpKsFYi3K37lEAW9mwfUPaZnnmwNvgV5Tm166HE= X-Forefront-Antispam-Report: CIP:188.184.36.50; CTRY:CH; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:cernmxgwlb4.cern.ch; PTR:cernmx11.cern.ch; CAT:NONE; SFS:(376002)(396003)(39830400003)(346002)(46966006)(36840700001)(508600001)(37786003)(82310400003)(356005)(8676002)(186003)(47076005)(70586007)(426003)(55846006)(86362001)(26005)(6916009)(8936002)(36860700001)(70206006)(7696005)(33656002)(2906002)(7636003)(5660300002)(55016002)(83380400001)(44832011)(336012); DIR:OUT; SFP:1101; X-OriginatorOrg: cern.ch X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 May 2021 09:53:01.6368 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 31287968-e276-44b8-5c5f-08d91b750e8c X-MS-Exchange-CrossTenant-Id: c80d3499-4a40-4a8c-986e-abce017d6b19 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=c80d3499-4a40-4a8c-986e-abce017d6b19; Ip=[188.184.36.50]; Helo=[cernmxgwlb4.cern.ch] X-MS-Exchange-CrossTenant-AuthSource: AM5EUR02FT015.eop-EUR02.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0602MB2758 X-Mailman-Approved-At: Wed, 26 May 2021 15:48:00 +0200 Subject: [dpdk-users] MLX5 configuration and installation X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Good morning, I want to evaluate DPDK on my servers, which are equipped with 4 Mellanox C= onnectX-5 Ex 2x100G cards. I have installed MLNX_OFED 5.3-1.0.0 from nvidia, compiled from source with= `--upstream-libs --dpdk` flags. I downloaded DPDK 20.11 LTS and compiled following the quick start guide. I have allocated 1024 2MB hugepages for each NUMA node. When I try to run dpdk-helloworld I get: ``` [aperro@ebstortest02 examples]$ sudo ./dpdk-helloworld EAL: Detected 64 lcore(s) EAL: Detected 2 NUMA nodes EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: VFIO support initialized EAL: DPDK is running on a NUMA system, but is compiled without NUMA support= . EAL: This will have adverse consequences for performance and usability. EAL: Please use --legacy-mem option, or recompile with NUMA support. EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:81:00.0 (socket 1) mlx5_pci: probe of PCI device 0000:81:00.0 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:81:00.0 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:81:00.1 (socket 1) mlx5_pci: probe of PCI device 0000:81:00.1 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:81:00.1 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:a1:00.0 (socket 1) mlx5_pci: probe of PCI device 0000:a1:00.0 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:a1:00.0 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:a1:00.1 (socket 1) mlx5_pci: probe of PCI device 0000:a1:00.1 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:a1:00.1 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:c1:00.0 (socket 1) mlx5_pci: probe of PCI device 0000:c1:00.0 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:c1:00.0 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:c1:00.1 (socket 1) mlx5_pci: probe of PCI device 0000:c1:00.1 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:c1:00.1 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:c2:00.0 (socket 1) mlx5_pci: probe of PCI device 0000:c2:00.0 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:c2:00.0 cannot be used EAL: Probe PCI driver: mlx5_pci (15b3:1019) device: 0000:c2:00.1 (socket 1) mlx5_pci: probe of PCI device 0000:c2:00.1 aborted after encountering an er= ror: Cannot allocate memory common_mlx5: Failed to load driver =3D mlx5_pci. EAL: Requested device 0000:c2:00.1 cannot be used EAL: No legacy callbacks, legacy socket not created hello from core 1 ... ```=