From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id DDC3D439AA for ; Tue, 23 Jan 2024 18:51:46 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A1F1E4026A; Tue, 23 Jan 2024 18:51:46 +0100 (CET) Received: from mail-pf1-f198.google.com (mail-pf1-f198.google.com [209.85.210.198]) by mails.dpdk.org (Postfix) with ESMTP id C9C994025D for ; Tue, 23 Jan 2024 18:51:45 +0100 (CET) Received: by mail-pf1-f198.google.com with SMTP id d2e1a72fcca58-6dbcf62f38aso2175412b3a.2 for ; Tue, 23 Jan 2024 09:51:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=interfacemasters.com; s=google; t=1706032305; x=1706637105; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=eYZYZpwOkB5Up78mZPC7bHbreTrFv7MlPSlVHsa2iEc=; b=NMz0Ag/fOxv9LGvojY7WycXsPTVtqRuAoLLGehZgsao3pFzflbLKaiVa4RZtH9kmf/ y5HPfwxP2IHS8jOUSjqJvNNzIGHT/kMryCupD+E/gmkwV5M+OCnyvt7yMpQ/u0CHUOwS b0vtRFTmU+Fwlje9FoRiwyU6q39UAOopdPfqs= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1706032305; x=1706637105; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=eYZYZpwOkB5Up78mZPC7bHbreTrFv7MlPSlVHsa2iEc=; b=o/dXwjyiwonLV2ZBs5tST+qli2dXS0oT7huCuDqTOGLkq8xLyQ81ReAyxcLWLk5b5Q rLv0AqHfMtDL377taLuaqsnQ6P1S1osN2kx3R24dfXNQmnlb09QPgf6zRUU864K0nJRK +61paThin8vrsWx921MVZaEx3IWA/Jgzb4dfeHIY1IdhS79SXIKWsBeHltE7O2VU94ao b0Gh7sbLQEjcr2IppbWfufH1t/Sj0wfNBRHa/R58w7OiBkBiyPdztBp4mzKT6/ZK0dUc Cxgsp9eAETvF6m2RCxgm5Mjy957kqVMP+h/CXtMv3d9Goq3hqV+v+FICVDQxNRsrRI+O 4lEg== X-Gm-Message-State: AOJu0Ywxg9skUDoIKwhIUjp5tIJW3mWhX8gEfu7pbUZv2z84ceZZgh66 Rml7ENGIICi+5B9U1kQZ419vMV/vijvO/nua31xQso4NU3tMJY3Fc7bFQGT9sSaMJ09NaFZ+If8 +IkiOx9Ym83ez8kA7qi65cNT6ni6sgRm/MexC/DDJuptx0gDG/xw= X-Google-Smtp-Source: AGHT+IEav19beqaO0DcRIIisaO86QLZjrhWTxsZeF7yeo4YkM6QriZ9TOd2/FlQzmViZqzN/Nsl4Dhnc5jnsnfqRQzE= X-Received: by 2002:a05:6a20:6a13:b0:19c:23f6:861b with SMTP id p19-20020a056a206a1300b0019c23f6861bmr3157485pzk.57.1706032304821; Tue, 23 Jan 2024 09:51:44 -0800 (PST) MIME-Version: 1.0 References: <20240123083208.32900f39@hermes.local> In-Reply-To: <20240123083208.32900f39@hermes.local> From: Oleksandr Nahnybida Date: Tue, 23 Jan 2024 19:51:33 +0200 Message-ID: Subject: Re: DPDK Netvsc - RNDIS reports VF but device not found, retrying To: stephen@networkplumber.org Cc: users@dpdk.org Content-Type: multipart/alternative; boundary="000000000000812b6b060fa0992e" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --000000000000812b6b060fa0992e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable azureuser@dpdk0:~$ ethtool -i enP47056s2 driver: mlx5_core version: 5.15.0-1053-azure firmware-version: 16.30.1284 (MSF0000000012) expansion-rom-version: bus-info: b7d0:00:02.0 I also installed rdma-core/libibverbs1 (dpdk was compiled with ibverbs_link=3Dshared) azureuser@dpdk0:~$ apt-cache policy rdma-core rdma-core: Installed: 28.0-1ubuntu1 azureuser@dpdk0:~$ apt-cache policy libibverbs1 libibverbs1: Installed: 28.0-1ubuntu1 On Tue, Jan 23, 2024 at 6:32=E2=80=AFPM Stephen Hemminger < stephen@networkplumber.org> wrote: > On Tue, 23 Jan 2024 14:34:12 +0200 > Oleksandr Nahnybida wrote: > > > Hello, > > > > I am trying to set up dpdk with netvsc as master pmd on Azure following > > > https://learn.microsoft.com/en-us/azure/virtual-network/setup-dpdk?tabs= =3Dubuntu > > and > > https://doc.dpdk.org/guides-22.11/nics/netvsc.html > > > > but I have the following error messages > > > > EAL: VFIO support initialized > > EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: 8565:00:02.0 (socke= t > 0) > > mlx5_net: DV flow is not supported. > > mlx5_common: Failed to allocate DevX UAR (BF/NC) > > mlx5_common: Failed to allocate UAR. > > mlx5_net: Failed to prepare Tx DevX UAR. > > mlx5_net: probe of PCI device 8565:00:02.0 aborted after encountering a= n > > error: Operation not permitted > > mlx5_common: Failed to load driver mlx5_eth > > EAL: Requested device 8565:00:02.0 cannot be used > > EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: d377:00:02.0 (socke= t > 0) > > mlx5_net: DV flow is not supported. > > mlx5_common: Failed to allocate DevX UAR (BF/NC) > > mlx5_common: Failed to allocate UAR. > > mlx5_net: Failed to prepare Tx DevX UAR. > > mlx5_net: probe of PCI device d377:00:02.0 aborted after encountering a= n > > error: Operation not permitted > > mlx5_common: Failed to load driver mlx5_eth > > EAL: Requested device d377:00:02.0 cannot be used > > EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: f97e:00:02.0 (socke= t > 0) > > mlx5_net: DV flow is not supported. > > mlx5_common: Failed to allocate DevX UAR (BF/NC) > > mlx5_common: Failed to allocate UAR. > > mlx5_net: Failed to prepare Tx DevX UAR. > > mlx5_net: probe of PCI device f97e:00:02.0 aborted after encountering a= n > > error: Operation not permitted > > mlx5_common: Failed to load driver mlx5_eth > > EAL: Requested device f97e:00:02.0 cannot be used > > EAL: Bus (pci) probe failed. > > hn_vf_attach(): Couldn't find port for VF > > hn_vf_add(): RNDIS reports VF but device not found, retrying > > hn_vf_attach(): Couldn't find port for VF > > hn_vf_add(): RNDIS reports VF but device not found, retrying > > and so on in a loop > > > > Also, with debug logs I see > > > > mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 > status=3D0 > > syndrome=3D0 > > mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 > status=3D0 > > syndrome=3D0 > > mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 > status=3D0 > > syndrome=3D0 > > > > > > The DPDK version is 22.11, running on > > Linux dpdk0 5.15.0-1053-azure #61~20.04.1-Ubuntu > > VM type D8ls v5, accelerated networking is on for two ports > > > > driverctl -b vmbus list-devices > > > > 000d3a1c-e0df-000d-3a1c-e0df000d3a1c hv_netvsc > > 000d3a1e-4573-000d-3a1e-4573000d3a1e uio_hv_generic [*] > > 000d3a1e-47da-000d-3a1e-47da000d3a1e uio_hv_generic [*] > > > > > > Any, ideas what I might be doing wrong? I see the same behavior with > > testpmd and my app. > > Looks like a mlx5 driver issue, which kernel driver are you using? > The netvsc code sees a VF but can't use it because of the mlx5 errors. > --000000000000812b6b060fa0992e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
azureuser@dpdk0:~$ ethtool -i enP47056s2
driver: mlx5_c= ore
version: 5.15.0-1053-azure
firmware-version: 16.30.1284 (MSF00000= 00012)
expansion-rom-version:
bus-info: b7d0:00:02.0

I also in= stalled rdma-core/libibverbs1 (dpdk was compiled with=C2=A0=C2=A0ibverbs_li= nk=3Dshared)

azureuser@dpdk0:~$ apt-cache policy rdma-core
rdma-c= ore:
=C2=A0 Installed: 28.0-1ubuntu1
azureuser@dpdk0:~$ apt-cache pol= icy libibverbs1
libibverbs1:
=C2=A0 Installed: 28.0-1ubuntu1

On Tu= e, Jan 23, 2024 at 6:32=E2=80=AFPM Stephen Hemminger <stephen@networkplumber.org> wrote:
On Tue, 23 Jan 2024 1= 4:34:12 +0200
Oleksandr Nahnybida <oleksandrn@interfacemasters.com> wrote:

> Hello,
>
> I am trying to set up dpdk with netvsc as master pmd on Azure followin= g
> https://learn.m= icrosoft.com/en-us/azure/virtual-network/setup-dpdk?tabs=3Dubuntu
> and
> https://doc.dpdk.org/guides-22.11/nics/netvsc= .html
>
> but I have the following error messages
>
> EAL: VFIO support initialized
> EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: 8565:00:02.0 (sock= et 0)
> mlx5_net: DV flow is not supported.
> mlx5_common: Failed to allocate DevX UAR (BF/NC)
> mlx5_common: Failed to allocate UAR.
> mlx5_net: Failed to prepare Tx DevX UAR.
> mlx5_net: probe of PCI device 8565:00:02.0 aborted after encountering = an
> error: Operation not permitted
> mlx5_common: Failed to load driver mlx5_eth
> EAL: Requested device 8565:00:02.0 cannot be used
> EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: d377:00:02.0 (sock= et 0)
> mlx5_net: DV flow is not supported.
> mlx5_common: Failed to allocate DevX UAR (BF/NC)
> mlx5_common: Failed to allocate UAR.
> mlx5_net: Failed to prepare Tx DevX UAR.
> mlx5_net: probe of PCI device d377:00:02.0 aborted after encountering = an
> error: Operation not permitted
> mlx5_common: Failed to load driver mlx5_eth
> EAL: Requested device d377:00:02.0 cannot be used
> EAL: Probe PCI driver: mlx5_pci (15b3:1018) device: f97e:00:02.0 (sock= et 0)
> mlx5_net: DV flow is not supported.
> mlx5_common: Failed to allocate DevX UAR (BF/NC)
> mlx5_common: Failed to allocate UAR.
> mlx5_net: Failed to prepare Tx DevX UAR.
> mlx5_net: probe of PCI device f97e:00:02.0 aborted after encountering = an
> error: Operation not permitted
> mlx5_common: Failed to load driver mlx5_eth
> EAL: Requested device f97e:00:02.0 cannot be used
> EAL: Bus (pci) probe failed.
> hn_vf_attach(): Couldn't find port for VF
> hn_vf_add(): RNDIS reports VF but device not found, retrying
> hn_vf_attach(): Couldn't find port for VF
> hn_vf_add(): RNDIS reports VF but device not found, retrying
> and so on in a loop
>
> Also, with debug logs I see
>
> mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 = status=3D0
> syndrome=3D0
> mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 = status=3D0
> syndrome=3D0
> mlx5_common: DevX read access NIC register=3D0X9055 failed errno=3D22 = status=3D0
> syndrome=3D0
>
>
> The DPDK version is 22.11, running on
> Linux dpdk0 5.15.0-1053-azure #61~20.04.1-Ubuntu
> VM type D8ls v5, accelerated networking is on for two ports
>
> driverctl -b vmbus list-devices
>
> 000d3a1c-e0df-000d-3a1c-e0df000d3a1c hv_netvsc
> 000d3a1e-4573-000d-3a1e-4573000d3a1e uio_hv_generic [*]
> 000d3a1e-47da-000d-3a1e-47da000d3a1e uio_hv_generic [*]
>
>
> Any, ideas what I might be doing wrong? I see the same behavior with > testpmd and my app.

Looks like a mlx5 driver issue, which kernel driver are you using?
The netvsc code sees a VF but can't use it because of the mlx5 errors.<= br>
--000000000000812b6b060fa0992e--