[dpdk-dev] Intel X710 and DPDK...

[dpdk-dev] Intel X710 and DPDK...

[Jeff Weeks]

Hello,


I have some questions regarding the i40e driver in reference to Intel X710 NICs.


I have several 10G X710 cards on a host, mapped into a kvm-based guest via PCI-passthrough.


DPDK sees these cards (the 6 in "Other Network Devices"):

# dpdk-devbind --status

Network devices using kernel driver
===================================
0000:00:03.0 '82540EM Gigabit Ethernet Controller 100e' if=eth0 drv=e1000 unused=uio_pci_generic
0000:00:04.0 'Virtio network device 1000' if=eth1 drv=virtio-pci unused=uio_pci_generic

Other Network devices
=====================
0000:00:09.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic
0000:00:0a.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic
0000:00:0b.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic
0000:00:0c.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic
0000:00:0d.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic
0000:00:0e.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' unused=uio_pci_generic

No 'Crypto' devices detected
============================

No 'Eventdev' devices detected
==============================

No 'Mempool' devices detected
=============================

No 'Compress' devices detected
==============================

But it wont bind them to the i40e driver:

root@10.129.182.229:~# dpdk-devbind -b i40e "0000:00:09.0"
Error: bind failed for 0000:00:09.0 - Cannot bind to driver i40e

I'm wondering what I can do to debug this?

Thanks,
Jeff


Disclaimer:
This communication (including any attachments) is intended for the use of the intended recipient(s) only and may contain information that is considered confidential, proprietary, sensitive and/or otherwise legally protected. Any unauthorized use or dissemination of this communication is strictly prohibited. If you have received this communication in error, please immediately notify the sender by return e-mail message and delete all copies of the original communication. Thank you for your cooperation.

Re: [dpdk-dev] Intel X710 and DPDK...

[Iremonger, Bernard]

Hi Jeff,

> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Jeff Weeks
> Sent: Tuesday, September 10, 2019 8:49 PM
> To: dev@dpdk.org
> Subject: [dpdk-dev] Intel X710 and DPDK...
> 
> Hello,
> 
> 
> I have some questions regarding the i40e driver in reference to Intel X710
> NICs.
> 
> 
> I have several 10G X710 cards on a host, mapped into a kvm-based guest via
> PCI-passthrough.
> 
> 
> DPDK sees these cards (the 6 in "Other Network Devices"):
> 
> # dpdk-devbind --status
> 
> Network devices using kernel driver
> ===================================
> 0000:00:03.0 '82540EM Gigabit Ethernet Controller 100e' if=eth0 drv=e1000
> unused=uio_pci_generic
> 0000:00:04.0 'Virtio network device 1000' if=eth1 drv=virtio-pci
> unused=uio_pci_generic
> 
> Other Network devices
> =====================
> 0000:00:09.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0a.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0b.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0c.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0d.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0e.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 
> No 'Crypto' devices detected
> ============================
> 
> No 'Eventdev' devices detected
> ==============================
> 
> No 'Mempool' devices detected
> =============================
> 
> No 'Compress' devices detected
> ==============================
> 
> But it wont bind them to the i40e driver:
> 
> root@10.129.182.229:~# dpdk-devbind -b i40e "0000:00:09.0"
> Error: bind failed for 0000:00:09.0 - Cannot bind to driver i40e
> 
> I'm wondering what I can do to debug this?
> 
> Thanks,
> Jeff
<snip>

You cannot bind DPDK to the i40e kernel driver.
Try the following:
./dpdk/usertools/dpdk-devbind.py -b igb_uio 0000:00:09.0
or
./dpdk/usertools/dpdk-devbind.py -b uio_pci_generic 0000:00:09.0

Regards,

Re: [dpdk-dev] Intel X710 and DPDK...

[Jeff Weeks]

Thanks Bernard,


I guess I was expecting to see them bound to a dpdk i40e driver.


When sending traffic to these NICs, I'm not actually getting packets from DPDK, and am trying to debug through.  If I disable the VM, I can see the host interfaces receive packets, and I've confirmed that the PCI passthrough configuration appears to be accurate.


When iterating all the RTE_ETH_DEVs, the list is emtpy, so it appears as though the x710 cards aren't being managed by DPDK, and I'm not sure why not.


Thanks,

--Jeff

________________________________
/dev/jeff_weeks.x2936
Sandvine Incorporated


________________________________
From: Iremonger, Bernard <bernard.iremonger@intel.com>
Sent: Wednesday, September 11, 2019 12:30 PM
To: Jeff Weeks; dev@dpdk.org
Subject: RE: Intel X710 and DPDK...

[EXTERNAL]

Hi Jeff,

> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Jeff Weeks
> Sent: Tuesday, September 10, 2019 8:49 PM
> To: dev@dpdk.org
> Subject: [dpdk-dev] Intel X710 and DPDK...
>
> Hello,
>
>
> I have some questions regarding the i40e driver in reference to Intel X710
> NICs.
>
>
> I have several 10G X710 cards on a host, mapped into a kvm-based guest via
> PCI-passthrough.
>
>
> DPDK sees these cards (the 6 in "Other Network Devices"):
>
> # dpdk-devbind --status
>
> Network devices using kernel driver
> ===================================
> 0000:00:03.0 '82540EM Gigabit Ethernet Controller 100e' if=eth0 drv=e1000
> unused=uio_pci_generic
> 0000:00:04.0 'Virtio network device 1000' if=eth1 drv=virtio-pci
> unused=uio_pci_generic
>
> Other Network devices
> =====================
> 0000:00:09.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0a.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0b.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0c.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0d.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
> 0000:00:0e.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'
> unused=uio_pci_generic
>
> No 'Crypto' devices detected
> ============================
>
> No 'Eventdev' devices detected
> ==============================
>
> No 'Mempool' devices detected
> =============================
>
> No 'Compress' devices detected
> ==============================
>
> But it wont bind them to the i40e driver:
>
> root@10.129.182.229:~# dpdk-devbind -b i40e "0000:00:09.0"
> Error: bind failed for 0000:00:09.0 - Cannot bind to driver i40e
>
> I'm wondering what I can do to debug this?
>
> Thanks,
> Jeff
<snip>

You cannot bind DPDK to the i40e kernel driver.
Try the following:
./dpdk/usertools/dpdk-devbind.py -b igb_uio 0000:00:09.0
or
./dpdk/usertools/dpdk-devbind.py -b uio_pci_generic 0000:00:09.0

Regards,