From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E25C5A0547 for ; Sun, 7 Feb 2021 13:24:03 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5CDC940147; Sun, 7 Feb 2021 13:24:03 +0100 (CET) Received: from hqnvemgate25.nvidia.com (hqnvemgate25.nvidia.com [216.228.121.64]) by mails.dpdk.org (Postfix) with ESMTP id 6EA5740146 for ; Sun, 7 Feb 2021 13:24:02 +0100 (CET) Received: from hqpgpgate101.nvidia.com (Not Verified[216.228.121.13]) by hqnvemgate25.nvidia.com (using TLS: TLSv1.2, DES-CBC3-SHA) id ; Sun, 07 Feb 2021 04:24:01 -0800 Received: from HQMAIL105.nvidia.com ([172.20.161.6]) by hqpgpgate101.nvidia.com (PGP Universal service); Sun, 07 Feb 2021 04:24:01 -0800 X-PGP-Universal: processed; by hqpgpgate101.nvidia.com on Sun, 07 Feb 2021 04:24:01 -0800 Received: from HQMAIL109.nvidia.com (172.20.187.15) by HQMAIL105.nvidia.com (172.20.187.12) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Sun, 7 Feb 2021 12:24:00 +0000 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.176) by HQMAIL109.nvidia.com (172.20.187.15) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Sun, 7 Feb 2021 12:24:00 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NZVgKg9dSHBXdz+LUUwqaycvu9Xtc3E75i6ZcpfC/HtM5x8FVpcYgItHy9rjdMG9ldNV3nUu3wvemaTAK1pzcJ2CEbf10Mkp+zvJF8k3/rsH5HgRxMu8VKYVeUQIxXQRySoIY3esGUI1/1OOKMuqsJSl6LHcXcnrDbe2CDyBKd/AeWfJwQCwW97wnMSjCkt8DjFWxlPHjkWTwFqcSNHoXM1JNYm5GvZlGePHMdvc4EU1TnxzEt3ORNNOdwVym+J0ytOEiLc7j+Fu+f0fpkgk5BhlDr85xCjW3Q55XSHsYUl7TTlWMxoppQJeLDDRNiUz1jB9nfJ5BUBGLM+TfcMTtw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=hFx7yeJu9KN1cwTg88l0MPAsfGqDIaL/W9TMQE6TFIg=; b=nLIUwTFhnTsNM9lWKggVwac2R9Vp6VXx0s7IVVEEgpF18yFgcUTYT6luRBpvW+s8g3yw77oAoRS0Kssv3O8mmFdw5JkElehLzddkZKJiTJKX44H0HW+NjRom3Yellfq9G0a94K9emUl7oidg/DulLHrmrmjrsm96SZdK2GXFrpDUaxGnNvYGaMuSKtvO/aXMUMtB62QrlUDe41s9IvDxJU7ig3ZbZ/n2mkRxftC6zNuzP7bSuZqA92nR/Y+qaecf3uBmSUW1PI/6XJNG/6rScqdC8wboikoAsAdT0tW4E8zHN/bvdtMtwmPreDImaxWQ+c8JROx6SJpQWJTomB2Fnw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none Received: from DM6PR12MB2748.namprd12.prod.outlook.com (2603:10b6:5:43::28) by DM6PR12MB4316.namprd12.prod.outlook.com (2603:10b6:5:21a::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3825.24; Sun, 7 Feb 2021 12:23:59 +0000 Received: from DM6PR12MB2748.namprd12.prod.outlook.com ([fe80::3d94:1f7f:178f:aba2]) by DM6PR12MB2748.namprd12.prod.outlook.com ([fe80::3d94:1f7f:178f:aba2%6]) with mapi id 15.20.3825.029; Sun, 7 Feb 2021 12:23:59 +0000 From: Raslan Darawsheh To: Kiran Shinde , "users@dpdk.org" , Feras Daoud , Noa Spanier CC: Asaf Penso , Shy Shyman Thread-Topic: Upgrading the Mellanox drivers to v 4.4.3 removes infiniband devices Thread-Index: Adb5IgeQW/XgeDxsSXC9OWrVqH6aBQEKgBHA Date: Sun, 7 Feb 2021 12:23:59 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-Mentions: ferasda@nvidia.com,noas@nvidia.com X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: enea.com; dkim=none (message not signed) header.d=none;enea.com; dmarc=none action=none header.from=nvidia.com; x-originating-ip: [188.161.229.143] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 93b6c9cd-ba5a-4ab9-c9fb-08d8cb633f1d x-ms-traffictypediagnostic: DM6PR12MB4316: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-header: ProcessedBy-CMR-outbound x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: vXWKSwb3NG+nOnvk3ceTRos8U0cUhtt3OigEMkiLf1mK3AiRT7t+BEuOJGVsFCmOdEN076WHxN2HickXRXXunnqf8yzDaectvdAcK8++EQCOMJTTbhJx9GKquknekkB34ZysIPJvdAV/Da973Fj9ufdnaIH9pMeJEoGa9lDU9eCnixZguy6/LSn/fPrn/dHcNVrWyHiT+djYmPdjKozJuaLyXtobES6Jdq4/Y8SsNDnmUcqg8LiI844CNSO8zNvflFwxFxAuIyurwcxbkIaf1zrmeFOhj3v/mFtirzwAp4f/RHcC+0QoMQ4sr26m2YosxlEmd0gaZIa4W46Llq/UiKAGUYHSW7d282Hept6CNUQ1gcn2fTEpW5E6wxH1h4XCcdjh5/U9ab2nrGQR472n+ao4Ir5Ys8FBpx4pfkEP2phg/dFIUMf7IGul8YuktKeoBWBc52BT8cd96tI3j/+HNlvy6utNH2Cw5KQj+kMvPOPx1dIXmDVxuzwLbibR2gbQE5Mj2qxbkNUD2PebccvRYg== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR12MB2748.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(376002)(136003)(39850400004)(396003)(346002)(316002)(52536014)(54906003)(8676002)(55016002)(9686003)(110136005)(8936002)(4326008)(26005)(478600001)(64756008)(66556008)(76116006)(5660300002)(2906002)(66946007)(66476007)(7696005)(6636002)(83380400001)(186003)(71200400001)(6506007)(107886003)(66446008)(86362001)(53546011)(33656002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?pgZI1000LPWvFFs1aH0xkCVnuGq95y2ndmQjdA1CB78UuACEUwgVZm0hDseu?= =?us-ascii?Q?iZ8sDylh2h4HxvKOnhUrsyhbIi11ZfwlxRvagzMzvJhyS5VGTucCXhyNo9vR?= =?us-ascii?Q?kchBvhI2VzlAUdYhoRZYaPawn+Io+cW9vYJOzlQ6gLlGcSt/Qpgj2ije4BvR?= =?us-ascii?Q?TY5YPgUTH15gJ4oN9baobCMRYR+A50rz8iEzVpRYF8IPNDJ5ka+UbyV2miZZ?= =?us-ascii?Q?X3q1sr07p94wOLCG4TkTllOBC+Kg068i4bBlOHAeHrA4heuq2GSdWiObSd1Q?= =?us-ascii?Q?RycbW7RKsH7Hi+KtFup/72E8h5vZINkD9gcvCtitaQ/MJpm28XL/iSejWULw?= =?us-ascii?Q?SdkViryQAoaATgj5zedQVN0Cx34pVbzMWU7IEjWbMGH4KgZ761npKcoHc9uK?= =?us-ascii?Q?23isHAw610WEQ4i3jRAMeyiI1UCX5i5rl8nCsGuAZcP/qVT5HKqO7g3rAyIz?= =?us-ascii?Q?IhsnSw05xuOkntFX1ihpKgM5eqPhmNw3v/+Gvj7c6WPdZV1pjIkZ9EJpLyJf?= =?us-ascii?Q?bv7UwnMxO3uj203LGQMtbi7MkUIzhRoflEu1/XwB7TNrPvtWzaXAUXA1K/8p?= =?us-ascii?Q?Q9/hwCjyAttyJwmVYNxOnu+S9yeMHgfOUaOfS/QIRJdoewIPmu1cSZu7ncrF?= =?us-ascii?Q?d08D5lHOuxAG0QKB8eke6bkcc0ACkLivxHaPdYYT3Bg/Oe3DfKmYK6H1umRD?= =?us-ascii?Q?vwsiCZBKvhOTKXubjZoiY1uPEJv5Z6yitq7sjzJz/4iJTX00rbfyeX/DFdmt?= =?us-ascii?Q?2T7HfJRqxdbF1R1wWTHiopScuCQiEB7VmLVCMckOQnm0ryCdkv0WZbpH/z8+?= =?us-ascii?Q?BhsDRClaTvrFvcr8lWXtRD61xwgZWzix836l6W8swNFQh/9WM3lOUF6d7ZtZ?= =?us-ascii?Q?Zt0UOHGD/wp+rLo/eoRgzzJVQBmfPsPJ02RtX3LOwI94Unrjv+OA03TGOGAx?= =?us-ascii?Q?gOq1h6SonyfQvNHKeC9vrlrpMjkd/q2aFTQp0vqd/zB+S1MH7T9EMB3ETHk2?= =?us-ascii?Q?OstczEZa6CSVqYdR5IOQd4Ffs/pIHBFw+7fSGw3/e1dD2wMNpoZXAXxpLjjH?= =?us-ascii?Q?pi2bv1GT2FWPkiqjEWqnFDZYTdNqWKBYPCt0KMJFUi5uUSXB1cqMzvi10t6x?= =?us-ascii?Q?GLED7WRE5yOWqMS3X6xvpV5EFG27TNBcnzQKtSjcz5c4sPJg/ksXJV2qkDFy?= =?us-ascii?Q?jlYZEkc9qnGXLYaLEALT5+/dEhC6j+vTNMjl1IebLize0rUrZeQpl1mE/Eqh?= =?us-ascii?Q?YbcQJLN1lBwbK7FYZd4W/CLuseeJSPtcluvxZuCKe7J3s6e3Y7uNaTUt+vue?= =?us-ascii?Q?Iv3n4dRBYXa5j8lQcfxfJWsN?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB2748.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 93b6c9cd-ba5a-4ab9-c9fb-08d8cb633f1d X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Feb 2021 12:23:59.2143 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: oX0bV6mwIWbm9PsHTf9zvdtIXQIYGOeBiktN/N6JqoikGALSNane4kIBFTUPeXRHNrmD7GFu39zhfGnGMiyisA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4316 X-OriginatorOrg: Nvidia.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1; t=1612700641; bh=hFx7yeJu9KN1cwTg88l0MPAsfGqDIaL/W9TMQE6TFIg=; h=X-PGP-Universal:ARC-Seal:ARC-Message-Signature: ARC-Authentication-Results:From:To:CC:Subject:Thread-Topic: Thread-Index:Date:Message-ID:References:In-Reply-To: Accept-Language:Content-Language:X-Mentions:X-MS-Has-Attach: X-MS-TNEF-Correlator:authentication-results:x-originating-ip: x-ms-publictraffictype:x-ms-office365-filtering-correlation-id: x-ms-traffictypediagnostic:x-ms-exchange-transport-forked: x-microsoft-antispam-prvs:x-header:x-ms-oob-tlc-oobclassifiers: x-ms-exchange-senderadcheck:x-microsoft-antispam: x-microsoft-antispam-message-info:x-forefront-antispam-report: x-ms-exchange-antispam-messagedata:Content-Type: Content-Transfer-Encoding:MIME-Version: X-MS-Exchange-CrossTenant-AuthAs: X-MS-Exchange-CrossTenant-AuthSource: X-MS-Exchange-CrossTenant-Network-Message-Id: X-MS-Exchange-CrossTenant-originalarrivaltime: X-MS-Exchange-CrossTenant-fromentityheader: X-MS-Exchange-CrossTenant-id:X-MS-Exchange-CrossTenant-mailboxtype: X-MS-Exchange-CrossTenant-userprincipalname: X-MS-Exchange-Transport-CrossTenantHeadersStamped:X-OriginatorOrg; b=c3yBHssWW5E4H64DrybiJQHf8JuMcGdfFrIAFlU2sXe+fs5WzMiFxLRQiSguyEcJf iCk9SI/AqNZ3DnE+wHU83uQ1YaCHshGUa9KBtSskNUCo9NBcXGT2PqtfUmk7cVT0Nn uSfhoKe7eya7dfisgeyItNKFNJPFdv9ereAQZH9FXdVfh00x2ENL8bGRWnvPgp0kIW FKqNJobCx92qdcRyq2KSo2FULNvwhsYTQAWxlxE0i6qEbcowjWaiyec3jQY4VDx3A4 +MXx3Z43ceLRG/czbLFgpSfWnR1zMjcBUHewF7HOtqgv5QKd15JWNOSLxYoZ7TY0A9 78erqSFFrhhsQ== Subject: Re: [dpdk-users] Upgrading the Mellanox drivers to v 4.4.3 removes infiniband devices X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" +@Feras Daoud, @Noa Spanier, Guys, Can you kindly assist with the bellow ? Kindest regards, Raslan Darawsheh > -----Original Message----- > From: users On Behalf Of Kiran Shinde > Sent: Tuesday, February 2, 2021 7:26 AM > To: users@dpdk.org > Subject: [dpdk-users] Upgrading the Mellanox drivers to v 4.4.3 removes > infiniband devices >=20 > Background: > RHEL version: Red Hat Enterprise Linux Server release 7.5 (Maipo) > DPDK version: 17.11.4 > Current Mellanox driver version: 4.0.2 > lspci | grep Mell > 00:06.0 Ethernet controller: Mellanox Technologies MT27500/MT27520 Family > [ConnectX-3/ConnectX-3 Pro Virtual Function] > 00:07.0 Ethernet controller: Mellanox Technologies MT27500/MT27520 Family > [ConnectX-3/ConnectX-3 Pro Virtual Function] > 00:08.0 Ethernet controller: Mellanox Technologies MT27500/MT27520 Family > [ConnectX-3/ConnectX-3 Pro Virtual Function] > 00:09.0 Ethernet controller: Mellanox Technologies MT27500/MT27520 Family > [ConnectX-3/ConnectX-3 Pro Virtual Function] >=20 >=20 > We have a system with above configuration running, we have below > infiniband devices in place before upgrade. > ls -lrt /sys/class/infiniband/ > total 0 > lrwxrwxrwx 1 root root 0 Jan 29 13:06 mlx4_3 -> > ../../devices/pci0000:00/0000:00:09.0/infiniband/mlx4_3 > lrwxrwxrwx 1 root root 0 Jan 29 13:06 mlx4_2 -> > ../../devices/pci0000:00/0000:00:08.0/infiniband/mlx4_2 > lrwxrwxrwx 1 root root 0 Jan 29 13:06 mlx4_1 -> > ../../devices/pci0000:00/0000:00:07.0/infiniband/mlx4_1 > lrwxrwxrwx 1 root root 0 Jan 29 13:06 mlx4_0 -> > ../../devices/pci0000:00/0000:00:06.0/infiniband/mlx4_0 >=20 > When we upgrade Mellanox driver to mlnx-en-4.4-2.0.7.0 and restart the > /etc/init.d/mlnx-en.d, we see all above devices get removed and hence > ibv_get_device_list function is not able to find any device. > Please note we have used image mlnx-en-4.4-2.0.7.0-rhel7.5-x86_64.iso to > upgrade the drivers. >=20 > Has anyone faced this type of problems earlier, are there any explicit st= eps > we need to perform to make sure the infiniband devices are not removed > during upgrade of Mellanox drivers? >=20 > Regards, > Kiran >=20 > This message, including attachments, is CONFIDENTIAL. It may also be > privileged or otherwise protected by law. If you received this email by > mistake please let us know by reply and then delete it from your system; = you > should not copy it or disclose its contents to anyone. All messages sent = to > and from Enea may be monitored to ensure compliance with internal policie= s > and to protect our business. Emails are not secure and cannot be guarante= ed > to be error free as they can be intercepted, amended, lost or destroyed, = or > contain viruses. The sender therefore does not accept liability for any e= rrors > or omissions in the contents of this message, which arise as a result of = email > transmission. Anyone who communicates with us by email accepts these > risks.