From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 57500A04A4; Wed, 2 Mar 2022 15:51:10 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D980C42715; Wed, 2 Mar 2022 15:51:09 +0100 (CET) Received: from mail-wm1-f42.google.com (mail-wm1-f42.google.com [209.85.128.42]) by mails.dpdk.org (Postfix) with ESMTP id CA02640141 for ; Wed, 2 Mar 2022 15:51:08 +0100 (CET) Received: by mail-wm1-f42.google.com with SMTP id 19so1015429wmy.3 for ; Wed, 02 Mar 2022 06:51:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind.com; s=google; h=message-id:date:mime-version:user-agent:content-language:to:cc:from :subject:content-transfer-encoding; bh=BNEki3OuMu2IvtgRvJwikRAQbWTWAhj5DBqLG/kQAk8=; b=cylJfN4rcnjbF0XtUJuKJ0demulFpgKDFa6D3szS7BLjJ8NZ4QER8+8dKrel7+RDdR bCIb9Co2A105eilgtLJVx14TsONcxgepO5MwBF5brMH6QxmEVXIrcU8VHH7NeuCtg1I7 wPxnKqlu5RN+z9HLUnX4p9xfkV+LDaHS9fFp++Haomlu1tK3zFn7m8CT3nbPgJnfZVtl vyLTslS6V7bR9VTZc53zXXY5+brrLJ8LeE4VaUXUNqCpR+KFg2s8/gNugg8462tLKpDb nqn2yTFrtNd6rH8IiyqTRg3kbmDBW5m9ZbKJAiNHQHpBMNI6WM9j77eIR/h2VFALCJ5a yw8Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:message-id:date:mime-version:user-agent :content-language:to:cc:from:subject:content-transfer-encoding; bh=BNEki3OuMu2IvtgRvJwikRAQbWTWAhj5DBqLG/kQAk8=; b=ZBmKgSe9VX0bkCfxr/ajDFnCHH9E3aYfg+buwVr7y5vvrcK1HkW0LsXS54mWuIdbTm NvJJ/fox0BHPleySJJA+pz0kacKM7lzh1H4oda+D0P2HcyuIgaaRJde+v1JzGoMZdMXW O4CSK/KBaVbqS+0FmN5GCW61PuvIqd/QFHydc0uTYesZRef2/iniuEXHW0trW4utFbZI 5hCh4mrt2N49AbXGPmHNz82YVQ5S0QAdmzvxAtRrdKpayaRRrLHmpGJHbLVMiY+3yWns Lkxy72yijDUIVSLjCjfObaLCNwb+qiq4KlQDzAyTOGG88ZYZjVEESXKzEV0nHuyrhr9y +nuQ== X-Gm-Message-State: AOAM533EXNq1jXBf7m7x+ERp7hwiGZMBfr5bB3/GNSS07YeiT2RwZmJr fN22+inhqf8VTAQMVwyWzcvPww5XxVjo X-Google-Smtp-Source: ABdhPJynaJogBT1oMGCHrNXv07ImOM9WaO9rMn1/Iu8MCrlc4EZzKNHvcb1KDg8hue/69ZhzAWx7Og== X-Received: by 2002:a05:600c:3c8b:b0:37f:1546:40c9 with SMTP id bg11-20020a05600c3c8b00b0037f154640c9mr89470wmb.161.1646232667923; Wed, 02 Mar 2022 06:51:07 -0800 (PST) Received: from [10.17.1.39] ([185.13.181.2]) by smtp.gmail.com with ESMTPSA id g17-20020adff411000000b001f03426827csm2049408wro.71.2022.03.02.06.51.07 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 02 Mar 2022 06:51:07 -0800 (PST) Message-ID: Date: Wed, 2 Mar 2022 15:51:06 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Content-Language: en-US To: "dev@dpdk.org" Cc: Somnath Kotur , Ajit Khaparde From: Thierry Herbelot Subject: [DPDK/bnxt] Issues starting bnxt on an Arm server Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Hello, I would like to start testpmd with bnxt ports, when running on an Arm server. This is the log at startup (with testpmd from DPDK v20.11.4): dpdk-devbind.py -b vfio-pci 03:00.0 dpdk-devbind.py -b vfio-pci 03:00.1 dpdk-testpmd -l 1,3,5 --main-lcore 1 EAL: Detected 48 lcore(s) EAL: Detected 2 NUMA nodes EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-16777216kB EAL: No available hugepages reported in hugepages-2048kB EAL: Probing VFIO support... EAL: VFIO support initialized EAL: using IOMMU type 8 (No-IOMMU) EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:03:00.0 (socket 0) bnxt_hwrm_send_message(): Error(timeout) sending msg 0x0000, seq_id 0 bnxt_hwrm_ver_get(): failed rc:-110 ethdev initialisation failed EAL: Releasing pci mapped resource for 0000:03:00.0 EAL: Calling pci_unmap_resource for 0000:03:00.0 at 0x4180000000 EAL: Calling pci_unmap_resource for 0000:03:00.0 at 0x4180010000 EAL: Requested device 0000:03:00.0 cannot be used EAL: using IOMMU type 8 (No-IOMMU) EAL: Probe PCI driver: net_bnxt (14e4:1750) device: 0000:03:00.1 (socket 0) bnxt_hwrm_send_message(): Error(timeout) sending msg 0x0000, seq_id 0 bnxt_hwrm_ver_get(): failed rc:-110 ethdev initialisation failed EAL: Releasing pci mapped resource for 0000:03:00.1 EAL: Calling pci_unmap_resource for 0000:03:00.1 at 0x4180110000 EAL: Calling pci_unmap_resource for 0000:03:00.1 at 0x4180120000 EAL: Requested device 0000:03:00.1 cannot be used The server is running Redhat-8 with the following kernel: 4.18.0-348.7.1.el8_5.aarch64 #1 SMP Wed Dec 8 21:35:15 EST 2021 As the IOMMU on this server is not working, the kernel is started with the following option: vfio.enable_unsafe_noiommu_mode=1 A similar testpmd log is obtained with DPDK v21.11.0. Is this a know issue ? Thanks Thierry Herbelot PS: a similar error is seen for the Ethernet ports, when handled by the kernel: dmesg|grep bnxt [ 57.823746] bnxt_en 0000:03:00.0 (unnamed net_device) (uninitialized): Error (timeout: 500015) msg {0x0 0x0} len:0 [ 59.202255] bnxt_en: probe of 0000:03:00.0 failed with error -16 [ 60.641519] bnxt_en 0000:03:00.1 (unnamed net_device) (uninitialized): Error (timeout: 500015) msg {0x0 0x0} len:0 [ 61.502237] bnxt_en: probe of 0000:03:00.1 failed with error -16 -- Thierry Herbelot Senior Software Engineer Tel: +33 1 39 30 92 61 http://www.6wind.com/ Follow us: https://www.linkedin.com/company/6wind/ https://twitter.com/6WINDsoftware https://www.youtube.com/user/6windsoftware