From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6FD71A00C2; Tue, 8 Mar 2022 09:19:36 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 032984068B; Tue, 8 Mar 2022 09:19:36 +0100 (CET) Received: from mail-wr1-f52.google.com (mail-wr1-f52.google.com [209.85.221.52]) by mails.dpdk.org (Postfix) with ESMTP id E472B40041 for ; Tue, 8 Mar 2022 09:19:34 +0100 (CET) Received: by mail-wr1-f52.google.com with SMTP id t11so27169637wrm.5 for ; Tue, 08 Mar 2022 00:19:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind.com; s=google; h=message-id:date:mime-version:user-agent:subject:content-language:to :cc:references:from:in-reply-to:content-transfer-encoding; bh=KfD6k+LZ+0iBybthlvVraMGmzBP5xv136zeZHggl7lk=; b=TgVzvkBi7aghGCtykhVTOYcqxUbuegBU42jWcYiqWolL/V4eywJi8K8UVTn0uboSpb xCUXBhSig2C0ZzjvO8zbsg7HRl9O7Nze1EFwWG677KBGKP7BxOY/jO4QGN6N4d44wzeu n6x36WPPAPcy3KbT5yj022pIh8oVTF/mXItwVMiEOfZLZvtJhUbaeVmMIZtTGQFwd82V 4epNsJokNaGwc4YLx5qHu09+DMa/iCstmPFILBofS1kDu7D3Hq6E4URqgV0nrPDzXZgl NmRHeiiHHri++tcLSiBgBefMU9Jb7DZBcUEVvJfNH+s3hqWb7eUenRdiKsriN4mo1mzW X2kw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent:subject :content-language:to:cc:references:from:in-reply-to :content-transfer-encoding; bh=KfD6k+LZ+0iBybthlvVraMGmzBP5xv136zeZHggl7lk=; b=EdrBgk6O+fYMAtzxk7qInwG4RRj+pJHK53TbEpixN2abf2/ZaA3v/utU3U748Pk4RY H/xSivZyqq2XiFnzTmw33RcAtPDrykTAOU9Giw1WvxKECoZoy7vbvZLC6i3QaLMdV/ca AESgjzWlyxA2OHHbVU+JFYzLBdW+6BV5H9bQ1lq6UxU8Zy439ayFzqkFU/rRkwxMDAQN 4YqQcMpEvqAhcVWj3i38onJ335xfNCvdDrLxpl7M+8G4190bG9Z30yYL8y6PsUy+hVUU 9FuCgNDVILzB9fFAPyVUTL95SdD/bg2jbJM9UZjR4QMQWbXPtmqwD3S8xppCYRYVD5W1 GxDQ== X-Gm-Message-State: AOAM531yTBKKFzNFybFS4Cdi3eJgblp8xqhbFKu/ZP9x0PTCtfzr52Bj bOGWarMr14CZaPDRZbkIeZnN X-Google-Smtp-Source: ABdhPJz5AlS0mU8wMhJfdwHax8A04poF28q0KaD0/TAhR/N/akLWBuxXXAMmYjDV05kBO7pM7kDuMg== X-Received: by 2002:adf:dfcf:0:b0:1f1:e502:d426 with SMTP id q15-20020adfdfcf000000b001f1e502d426mr9825927wrn.376.1646727574626; Tue, 08 Mar 2022 00:19:34 -0800 (PST) Received: from [10.17.1.39] ([185.13.181.2]) by smtp.gmail.com with ESMTPSA id w7-20020a1cf607000000b00389a5390180sm1461001wmc.25.2022.03.08.00.19.33 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 08 Mar 2022 00:19:34 -0800 (PST) Message-ID: Date: Tue, 8 Mar 2022 09:19:33 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [DPDK/bnxt] Issues starting bnxt on an Arm server Content-Language: en-US To: Honnappa Nagarahalli , "Ajit Khaparde (ajit.khaparde@broadcom.com)" Cc: "dev@dpdk.org" , Somnath Kotur , Kalesh Anakkur Purayil , Ruifeng Wang , nd References: <2f0b0ce7-c601-4f53-5d81-b1c45eadf8d0@6wind.com> <7840f4be-c86b-c03f-04f9-ded06502ac3e@6wind.com> From: Thierry Herbelot In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Hello, After upgrading the firmware on the bnxt NIC, the NIC is correctly detected by a DPDK application with both DPDK-v20.11 and DPDK-v21.11. Regards Thierry On 3/4/22 01:56, Honnappa Nagarahalli wrote: > + Ruifeng > > > >> >> On Wed, Mar 2, 2022 at 9:28 AM Thierry Herbelot >> wrote: >>> >>> On 3/2/22 18:26, Ajit Khaparde wrote: >>>> On Wed, Mar 2, 2022 at 9:16 AM Thierry Herbelot >>>> wrote: >>>>> >>>>> Hello Ajit >>>>> >>>>> The card is not correctly probed by the kernel, and so the FW version is >>>>> not visible. >>>> Thanks Thierry. >>>> I thought it was just the PMD running into trouble. >>>> >>>> Can you give details of the ARM server? >>>> Make, Vendor, etc..? >>> >>> This a Huawei server: >>> TaiShan 200 Server (Model 2180) aarch64, 48 cores, 2.6GHz, 64GB RAM >> >> Ok. I tried this on a HUAWEI Kunpeng 920 running 4.18.0- >> 348.2.1.el8_5.aarch64. >> I can load the bnxt_en kernel driver and the DPDK PMD without issues. >> And I did load vfio with enable_unsafe_noiommu_mode=1 . >> >> While we are pursuing this further internally, >> I have added Honnappa to see if he can provide any insight. > There is not much information on the error. > Just wondering if it is possible to move the card to x86 machine and check the firmware version and upgrade the firmware version there. > >> >> Ajit >> >>> >>> Thierry >>> >>>> >>>> >>>>> >>>>> I see this in the kernel dmesg: >>>>> bnxt_en 0000:03:00.0 (unnamed net_device) (uninitialized): Error >>>>> (timeout: 500015) msg {0x0 0x0} len:0 >>>>> bnxt_en 0000:03:00.0 (unnamed net_device) (uninitialized): Firmware not >>>>> responding, status: 0x8ffff >>>>> >>>>> And then there are no bnxt_en netdevices. >>>>> >>>>> Best regards >>>>> >>>>> Thierry >>>>> >>>>> >>>>> On 3/2/22 18:13, Ajit Khaparde wrote: >>>>>> On Wed, Mar 2, 2022 at 7:13 AM Thierry Herbelot >>>>>> wrote: >>>>>>> >>>>>>> Hello Ajit >>>>>>> >>>>>>> Thanks for the quick response. >>>>>>> >>>>>>> Please keep me posted when you check on your side. >>>>>> Can you tell what is the firmware version on the card? >>>>>> >>>>>>> >>>>>>> Best regards >>>>>>> >>>>>>> Thierry >>>>>>> >>>>>>> On 3/2/22 16:08, Ajit Khaparde wrote: >>>>>>>>> >>>>>>>>> Is this a know issue ? >>>>>>>> No. >>>>>>>> We have tried the Broadcom PMD on ARM server(s) and have been >>>>>>>> able to use it without any issues. >>>>>>>> But we can try it again and get back to you. >>>>>>>> >>>>>>>> >>>>>>>>> >>>>>>>>> Thanks >>>>>>>>> >>>>>>>>> Thierry Herbelot >>>>>>>>> >>>>>>>>> PS: a similar error is seen for the Ethernet ports, when handled by the >>>>>>>>> kernel: >>>>>>>>> dmesg|grep bnxt >>>>>>>>> [ 57.823746] bnxt_en 0000:03:00.0 (unnamed net_device) >>>>>>>>> (uninitialized): Error (timeout: 500015) msg {0x0 0x0} len:0 >>>>>>>>> [ 59.202255] bnxt_en: probe of 0000:03:00.0 failed with error -16 >>>>>>>>> [ 60.641519] bnxt_en 0000:03:00.1 (unnamed net_device) >>>>>>>>> (uninitialized): Error (timeout: 500015) msg {0x0 0x0} len:0 >>>>>>>>> [ 61.502237] bnxt_en: probe of 0000:03:00.1 failed with error -16 >>>>>>>>> >>>>>>>>> -- Thierry Herbelot Senior Software Engineer Tel: +33 1 39 30 92 61 http://www.6wind.com/ Follow us: https://www.linkedin.com/company/6wind/ https://twitter.com/6WINDsoftware https://www.youtube.com/user/6windsoftware