From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 11687A00C5 for ; Wed, 3 Aug 2022 06:54:45 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A730740A7E; Wed, 3 Aug 2022 06:54:44 +0200 (CEST) Received: from mail-pj1-f49.google.com (mail-pj1-f49.google.com [209.85.216.49]) by mails.dpdk.org (Postfix) with ESMTP id CD68740141 for ; Wed, 3 Aug 2022 06:54:43 +0200 (CEST) Received: by mail-pj1-f49.google.com with SMTP id v16-20020a17090abb9000b001f25244c65dso848495pjr.2 for ; Tue, 02 Aug 2022 21:54:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=YEq3U4BMCkSM8LU40bWsK6lU6x4or9IpfMLtKfjXJEE=; b=NO95u9aVq/uJzYUj9R67C1J2YcipYr1lyYQ/AnQsTuq3GBEzvxz8FcCYRkyijel4MB 8LO+p6Xnku1bymcfARPLwtxVU7BDFBOhBf+67mFIUtfIsbaCNI+WV0r3kYclPFg6yfZx ITkSepr/LJZyZ3IdNFlTa1ZOho38B2aKekjqENAwtXP30hI+BLCNbsCXdYC6XKrVcfUA StPmgB/Eba92VW+xwk5MQ/pit3sGio/OTy+e7pO1vsvA1n880057i+r5C6VG8G0FzshD MK4HwKzB75YYoR1CSAx47j8BKw8ch8FCpJTK/aDaGiBV0t42EkvXQp6dVrwUEofSW/X5 Jb5g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=YEq3U4BMCkSM8LU40bWsK6lU6x4or9IpfMLtKfjXJEE=; b=WR3x47RumShfo0GqCGBWXskf5AF4khI+fsKUTYt1ptu70LGM+2JaHoHtrcrp1AU4NE KgTUUdkRkQ/dF3CpM9lHQWPHvFPVonVfi8gw0qlhdzkTF57aD2O/zeDVn9VJ1u+yWmzl nkeBg8lPE2TheHHralQeELOOH1BVnjJyE4ZaiTdBwtnRBG4f+YOOXXg9lmc8SReoxJIU cw2zMg6ugp6zvBIFM2Fm8db0kuxd18yo9g4oJIkqA1YzxwAJTfo0QVj8sj8ZsWLITYnt ISohXJyV9CI1ZUbmQSWkTX3EWIddcJuWSdyP1yn7VKbdKfEN9KQ8dfM5y5BkcdWX0tw9 MqSA== X-Gm-Message-State: ACgBeo2T/msI8dzGtKk055HdU7lxFiceUKQp5nwWohfjNc+hvMe5d5rp Lx8FmZJDkQtDjikcKwUGgY4v3WpzgQiavWeqe5I= X-Google-Smtp-Source: AA6agR7WJTOQZBGzmbxruTqRjHMaYmktggGwrm1hET7uuqncjnWWTxBRzbvKJEFHhv9DlJRPD4ZpY1gc0Y64hd6OCh4= X-Received: by 2002:a17:902:8bc5:b0:16c:f48b:d5b5 with SMTP id r5-20020a1709028bc500b0016cf48bd5b5mr25112584plo.128.1659502482643; Tue, 02 Aug 2022 21:54:42 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Lokesh Chakka Date: Wed, 3 Aug 2022 10:24:30 +0530 Message-ID: Subject: Re: intel 100 Gbps Network card shutting down after enabling dpdk To: "Van Haaren, Harry" Cc: "Tkachuk, Georgii" , users Content-Type: multipart/alternative; boundary="000000000000fb5ffa05e54f07fc" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --000000000000fb5ffa05e54f07fc Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Dear Harry, Concern is not static linking or dynamic linking. Concern is Card is shutting down immediately after devbind. This, I am able to clearly see as the green LEDs are turning immediately off after executing devbind. However, I have executed and the following is the observation. +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ $ lspci | grep -i intel c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02) c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C for QSFP (rev 02) $ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1 $ cat one.c #include #include int main(int argc, char *argv[]) { unsigned nb_ports; int ret =3D rte_eal_init(argc, argv); if (ret < 0) rte_exit(EXIT_FAILURE, "Error with EAL initialization\n"); nb_ports =3D rte_eth_dev_count_avail(); fprintf( stderr, "%s %d nb_ports: %u\n", __func__, __LINE__, nb_ports ); } $ gcc one.c `pkg-config --cflags libdpdk --libs --static libdpdk` $ sudo ./a.out EAL: Detected CPU lcores: 64 EAL: Detected NUMA nodes: 4 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'VA' EAL: No available 1048576 kB hugepages reported EAL: VFIO support initialized EAL: Using IOMMU type 1 (Type 1) EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.0 (socket 3) set_mempolicy: Invalid argument EAL: Releasing PCI mapped resource for 0000:c3:00.0 EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4102000000 EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4104000000 EAL: Requested device 0000:c3:00.0 cannot be used EAL: Using IOMMU type 1 (Type 1) EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.1 (socket 3) set_mempolicy: Invalid argument EAL: Releasing PCI mapped resource for 0000:c3:00.1 EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4104010000 EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4106010000 EAL: Requested device 0000:c3:00.1 cannot be used main 20 main 23 nb_ports: 0 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ Please let me know if any more information is required. Thanks & Regards -- Lokesh Chakka. On Tue, Aug 2, 2022 at 2:49 PM Van Haaren, Harry wrote: > [Top posting, as HTML email] > > > > HI Chakka, > > > > When linking against DPDK in Shared-library mode, the .so files to handle > drivers are not automatically loaded; > > > https://doc.dpdk.org/guides-20.05/linux_gsg/linux_eal_parameters.html#lin= ux-specific-eal-parameters > > > > Notice the -d flag in particular: "-d directory>", when used and pointed to the correct .so for the ice pmd .so > file, > > DPDK will be able to initialize the NIC. > > > > As a workaround/alternative, static-linking against DPDK will avoid the > requirement to use "-d" EAL arg to load the PCI device .so drivers. > > > > Hope that helps, -Harry > > > > > > *From:* Lokesh Chakka > *Sent:* Monday, August 1, 2022 9:20 AM > *To:* Tkachuk, Georgii > *Cc:* users > *Subject:* Re: intel 100 Gbps Network card shutting down after enabling > dpdk > > > > After booting the server, the following are commands I have executed. > Immediately after doing devbind -b, cards are going down. I am able to se= e > that green leds are turning off. > > > > following is the two lines of code and output of code. number of ports ar= e > reporting as zero > > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > $ lspci | grep -i intel > c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C > for QSFP (rev 02) > c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C > for QSFP (rev 02) > > $ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1 > $ sudo dpdk-devbind.py -s > > Network devices using DPDK-compatible driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:c3:00.0 'Ethernet Controller E810-C for QSFP 1592' drv=3Dvfio-pci > unused=3Dice > 0000:c3:00.1 'Ethernet Controller E810-C for QSFP 1592' drv=3Dvfio-pci > unused=3Dice > > Network devices using kernel driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:05:00.0 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Deno1 > drv=3Dtg3 unused=3Dvfio-pci > 0000:05:00.1 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Deno2 > drv=3Dtg3 unused=3Dvfio-pci > 0000:05:00.2 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Deno3 > drv=3Dtg3 unused=3Dvfio-pci > 0000:05:00.3 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Deno4 > drv=3Dtg3 unused=3Dvfio-pci > 0000:83:00.0 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb > Ethernet 1750' if=3Dens3f0np0 drv=3Dbnxt_en unused=3Dvfio-pci > 0000:83:00.1 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb > Ethernet 1750' if=3Dens3f1np1 drv=3Dbnxt_en unused=3Dvfio-pci > > No 'Baseband' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D > > Crypto devices using kernel driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:02:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=3Dccp > unused=3Dvfio-pci > 0000:03:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor > 1456' drv=3Dccp unused=3Dvfio-pci > 0000:41:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=3Dccp > unused=3Dvfio-pci > 0000:42:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor > 1456' drv=3Dccp unused=3Dvfio-pci > 0000:81:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=3Dccp > unused=3Dvfio-pci > 0000:82:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor > 1456' drv=3Dccp unused=3Dvfio-pci > 0000:c1:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv=3Dccp > unused=3Dvfio-pci > 0000:c2:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor > 1456' drv=3Dccp unused=3Dvfio-pci > > No 'DMA' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D > > No 'Eventdev' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D > > No 'Mempool' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D > > No 'Compress' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D > > No 'Misc (rawdev)' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > No 'Regex' devices detected > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D > > $ cat one.c > #include > #include > > > int main(int argc, char *argv[]) > { > struct rte_mempool *mbuf_pool; > unsigned nb_ports; > uint16_t portid; > > /* Initializion the Environment Abstraction Layer (EAL). 8< */ > int ret =3D rte_eal_init(argc, argv); > if (ret < 0) > rte_exit(EXIT_FAILURE, "Error with EAL initialization\n"); > /* >8 End of initialization the Environment Abstraction Layer (EAL). */ > > argc -=3D ret; > argv +=3D ret; > > fprintf( stderr, "%s %d\n", __func__, __LINE__ ); > /* Check that there is an even number of ports to send/receive on. */ > nb_ports =3D rte_eth_dev_count_avail(); > fprintf( stderr, "%s %d nb_ports: %u\n", __func__, __LINE__, nb_ports ); > } > > $ gcc one.c `pkg-config --cflags libdpdk --libs libdpdk` > $ sudo ./a.out > EAL: Detected CPU lcores: 64 > EAL: Detected NUMA nodes: 4 > EAL: Detected shared linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > EAL: Selected IOVA mode 'VA' > EAL: No available 1048576 kB hugepages reported > EAL: VFIO support initialized > EAL: Using IOMMU type 1 (Type 1) > EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.0 (socket 3= ) > set_mempolicy: Invalid argument > EAL: Releasing PCI mapped resource for 0000:c3:00.0 > EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4102000000 > EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4104000000 > EAL: Requested device 0000:c3:00.0 cannot be used > EAL: Using IOMMU type 1 (Type 1) > EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.1 (socket 3= ) > set_mempolicy: Invalid argument > EAL: Releasing PCI mapped resource for 0000:c3:00.1 > EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4104010000 > EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4106010000 > EAL: Requested device 0000:c3:00.1 cannot be used > TELEMETRY: No legacy callbacks, legacy socket not created > main 20 > main 23 nb_ports: 0 > > > > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > > > Thanks & Regards > -- > Lokesh Chakka. > > > > > > On Mon, Aug 1, 2022 at 12:44 PM Tkachuk, Georgii < > georgii.tkachuk@intel.com> wrote: > > Please check =E2=80=9Csudo dpdk-devbind.py -s=E2=80=9D to see if both por= ts are bound to > vfio-pci > > And some questions: > > > > What DPDK app are you running? > > What are your EAL command line arguments? > > What do you mean by going down (as reported by what?) > > > > Thank you, > > Georgii > > > > *From:* Lokesh Chakka > *Sent:* Monday, August 01, 2022 12:09 AM > *To:* users > *Subject:* intel 100 Gbps Network card shutting down after enabling dpdk > > > > hello, > > > > Recently I have bought one intel network card > > > > > https://ark.intel.com/content/www/us/en/ark/products/210969/intel-etherne= t-network-adapter-e8102cqda2.html > > > > The moment I do devbind, cards are shutting down. > > > > $ lspci | grep -i intel > c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C > for QSFP (rev 02) > c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C > for QSFP (rev 02) > > $ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1 > > After this, cards are going down. EAL is giving following error > > > > EAL: Requested device 0000:c3:00.1 cannot be used > EAL: Error - exiting with code: 1 > Cause: Error: number of ports must be even > > > > Did anyone face this issue or anyone know how to fix the issue? > > > Thanks & Regards > -- > Lokesh Chakka. > > --000000000000fb5ffa05e54f07fc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Dear Harry,

Concern is not s= tatic linking or dynamic linking. Concern is Card is shutting down immediat= ely after devbind. This, I am able to clearly see as the green LEDs are tur= ning immediately off after executing devbind.
However, I have exe= cuted and the following is the observation.
=
$ lspci |= grep -i intel
c3:00.0 Ethernet controller: Intel Corporation Ethernet C= ontroller E810-C for QSFP (rev 02)
c3:00.1 Ethernet controller: Intel Co= rporation Ethernet Controller E810-C for QSFP (rev 02)
$ sudo dpdk-devbi= nd.py -b vfio-pci c3:00.0 c3:00.1
$ cat one.c
#include <inttypes.= h>
#include <rte_ethdev.h>

int main(int argc, char *argv= [])
{
unsigned nb_ports;

int ret =3D rte_eal_init(argc, argv= );
if (ret < 0)
rte_exit(EXIT_FAILURE, "Error with EAL ini= tialization\n");

nb_ports =3D rte_eth_dev_count_avail();
f= printf( stderr, "%s %d nb_ports: %u\n", __func__, __LINE__, nb_po= rts );
}
$ gcc one.c `pkg-config --cflags libdpdk --libs --static lib= dpdk`
$ sudo ./a.out
EAL: Detected CPU lcores: 64
EAL: Detected N= UMA nodes: 4
EAL: Detected static linkage of DPDK
EAL: Multi-process = socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'<= br>EAL: No available 1048576 kB hugepages reported
EAL: VFIO support ini= tialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_= ice (8086:1592) device: 0000:c3:00.0 (socket 3)
set_mempolicy: Invalid a= rgument
EAL: Releasing PCI mapped resource for 0000:c3:00.0
EAL: Call= ing pci_unmap_resource for 0000:c3:00.0 at 0x4102000000
EAL: Calling pci= _unmap_resource for 0000:c3:00.0 at 0x4104000000
EAL: Requested device 0= 000:c3:00.0 cannot be used
EAL: Using IOMMU type 1 (Type 1)
EAL: Prob= e PCI driver: net_ice (8086:1592) device: 0000:c3:00.1 (socket 3)
set_me= mpolicy: Invalid argument
EAL: Releasing PCI mapped resource for 0000:c3= :00.1
EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4104010000EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4106010000
EAL: = Requested device 0000:c3:00.1 cannot be used
main 20
main 23 nb_ports= : 0

<= a class=3D"gmail_plusreply" id=3D"gmail-plusReplyChip-0">++++++++++++++++++= +++++++++++++++++++++++++++++++++++++++++++++++

Please let me know if any more information is required.


Thanks & Regards
--
Lokesh= Chakka.


On Tue, Aug 2, 2022 at 2:49 PM Van Haaren, Harry <harry.van.haaren@intel.com> w= rote:

= [Top posting, as HTML email]<= /u>

= =C2=A0

= HI Chakka,<= /font>

= =C2=A0

= When linking against DPDK in Sha= red-library mode, the .so files to handle drivers are not automatically loa= ded;

= https://doc.dpdk.org/guides-20.05/linux_gsg/linux_ea= l_parameters.html#linux-specific-eal-parameters<= /u>

=C2=A0

Notice the -d flag in particular: "-d <path to shared = object or directory>", when used and pointed to the correct .so for= the ice pmd .so file,

DPDK will be able to initialize the NIC.<= /font>

=C2=A0

As a workaround/alternative, static-linking against DPDK will = avoid the requirement to use "-d" EAL arg to load the PCI device = .so drivers.

=C2=A0

Hope that helps, -Harry

= =C2=A0

= =C2=A0

From: Lokesh Chakka <lvenkatakumarchakka@gmail.com>
Sent: Monday, August 1, 2022= 9:20 AM
To: Tkachuk, Georgii <georgii.tkachuk= @intel.com>
Cc: users <users@dpdk.org>
Subject: Re: intel 100 Gbps = Network card shutting down after enabling dpdk

=C2=A0

After booting the server, the following are commands I have ex= ecuted. Immediately after doing devbind -b, cards are going down. I am able= to see that green leds are turning off.

=C2=A0

following is the two lines of code and output of code. number = of ports are reporting as zero

=C2=A0

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= ++

=C2=A0

$ lspci | grep -i intel
c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C f= or QSFP (rev 02)
c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C f= or QSFP (rev 02)

$ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1
$ sudo dpdk-devbind.py -s

Network devices using DPDK-compatible driver
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
0000:c3:00.0 'Ethernet Controller E810-C for QSFP 1592' drv=3Dvfio-= pci unused=3Dice
0000:c3:00.1 'Ethernet Controller E810-C for QSFP 1592' drv=3Dvfio-= pci unused=3Dice

Network devices using kernel driver
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
0000:05:00.0 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Den= o1 drv=3Dtg3 unused=3Dvfio-pci
0000:05:00.1 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Den= o2 drv=3Dtg3 unused=3Dvfio-pci
0000:05:00.2 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Den= o3 drv=3Dtg3 unused=3Dvfio-pci
0000:05:00.3 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Den= o4 drv=3Dtg3 unused=3Dvfio-pci
0000:83:00.0 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethe= rnet 1750' if=3Dens3f0np0 drv=3Dbnxt_en unused=3Dvfio-pci
0000:83:00.1 'BCM57508 NetXtreme-E 10Gb/25Gb/40Gb/50Gb/100Gb/200Gb Ethe= rnet 1750' if=3Dens3f1np1 drv=3Dbnxt_en unused=3Dvfio-pci

No 'Baseband' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D

Crypto devices using kernel driver
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D
0000:02:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv= =3Dccp unused=3Dvfio-pci
0000:03:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1= 456' drv=3Dccp unused=3Dvfio-pci
0000:41:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv= =3Dccp unused=3Dvfio-pci
0000:42:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1= 456' drv=3Dccp unused=3Dvfio-pci
0000:81:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv= =3Dccp unused=3Dvfio-pci
0000:82:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1= 456' drv=3Dccp unused=3Dvfio-pci
0000:c1:00.1 'Zeppelin Cryptographic Coprocessor NTBCCP 1468' drv= =3Dccp unused=3Dvfio-pci
0000:c2:00.2 'Family 17h (Models 00h-0fh) Platform Security Processor 1= 456' drv=3Dccp unused=3Dvfio-pci

No 'DMA' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=

No 'Eventdev' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D

No 'Mempool' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D

No 'Compress' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D

No 'Misc (rawdev)' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

No 'Regex' devices detected
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D

$ cat one.c
#include <inttypes.h>
#include <rte_ethdev.h>


int main(int argc, char *argv[])
{
struct rte_mempool *mbuf_pool;
unsigned nb_ports;
uint16_t portid;

/* Initializion the Environment Abstraction Layer (EAL). 8< */
int ret =3D rte_eal_init(argc, argv);
if (ret < 0)
rte_exit(EXIT_FAILURE, "Error with EAL initialization\n");
/* >8 End of initialization the Environment Abstraction Layer (EAL). */<= br>
argc -=3D ret;
argv +=3D ret;

fprintf( stderr, "%s %d\n", __func__, __LINE__ );
/* Check that there is an even number of ports to send/receive on. */
nb_ports =3D rte_eth_dev_count_avail();
fprintf( stderr, "%s %d nb_ports: %u\n", __func__, __LINE__, nb_p= orts );
}

$ gcc one.c `pkg-config --cflags libdpdk --libs libdpdk`
$ sudo ./a.out
EAL: Detected CPU lcores: 64
EAL: Detected NUMA nodes: 4
EAL: Detected shared linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: No available 1048576 kB hugepages reported
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.0 (socket 3)<= br> set_mempolicy: Invalid argument
EAL: Releasing PCI mapped resource for 0000:c3:00.0
EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4102000000
EAL: Calling pci_unmap_resource for 0000:c3:00.0 at 0x4104000000
EAL: Requested device 0000:c3:00.0 cannot be used
EAL: Using IOMMU type 1 (Type 1)
EAL: Probe PCI driver: net_ice (8086:1592) device: 0000:c3:00.1 (socket 3)<= br> set_mempolicy: Invalid argument
EAL: Releasing PCI mapped resource for 0000:c3:00.1
EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4104010000
EAL: Calling pci_unmap_resource for 0000:c3:00.1 at 0x4106010000
EAL: Requested device 0000:c3:00.1 cannot be used
TELEMETRY: No legacy callbacks, legacy socket not created
main 20
main 23 nb_ports: 0

=C2=A0

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= ++

=C2=A0


Thanks & Regards
--
Lokesh Chakka.

=C2=A0

=C2=A0

On Mon, Aug 1, 2022 at 12:44 PM Tkachuk, Georgii <georgii.tkachuk@int= el.com> wrote:

Please check =E2=80=9Csudo dpdk-devbind.py -s= =E2=80=9D to see if both ports are bound to vfio-pci

And some questions:

=C2=A0

What DPDK app are you running?

What are your EAL command line arguments?

What do you mean by going down (as reported by = what?)

=C2=A0

Thank you,

Georgii

=C2=A0

From: Lokesh Chakka <lvenkatakumarchakka@gmail.com>
Sent: Monday, August 01, 202= 2 12:09 AM
To: users <users@dpdk.org>
Subject: intel 100 Gbps Netw= ork card shutting down after enabling dpdk

=C2=A0

hello,

=C2=A0

Recently I have bought one intel network card

=C2=A0

=C2=A0

The moment I do devbind, cards are shutting dow= n.

=C2=A0

$ lspci | grep -i intel
c3:00.0 Ethernet controller: Intel Corporation Ethernet Controller E810-C f= or QSFP (rev 02)
c3:00.1 Ethernet controller: Intel Corporation Ethernet Controller E810-C f= or QSFP (rev 02)

$ sudo dpdk-devbind.py -b vfio-pci c3:00.0 c3:00.1

After this, cards are going down. EAL is giving following error

=C2=A0

EAL: Requested device 0000:c3:00.1 cannot be us= ed
EAL: Error - exiting with code: 1
Cause: Error: number of ports must be even

=C2=A0

Did anyone face this issue or anyone know how t= o fix the issue?


Thanks & Regards
--
Lokesh Chakka.

--000000000000fb5ffa05e54f07fc--