* [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3
@ 2021-09-23 15:29 Dey, Souvik
2021-09-24 0:40 ` Wu, Jingjing
0 siblings, 1 reply; 4+ messages in thread
From: Dey, Souvik @ 2021-09-23 15:29 UTC (permalink / raw)
To: dev, Xing, Beilei, jingjing.wu
Hi All,
Trying to test E810 Sr-IOV based nic card with 20.11.3 dpdk. I am running the host kernel driver and only the VF is attached to the VM where I am running dpdk. But when I attaching the VF to the testpmd it is throwing the below error. Is there are way to move forward here ?
[root@connexip linuxadmin]# ./dpdk-testpmd -c 0xf -n 4 -a 08:00.0 -- -i --rxq=16 --txq=16
EAL: Detected 4 lcore(s)
EAL: Detected 1 NUMA nodes
EAL: Detected static linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: Probe PCI driver: net_iavf (8086:1889) device: 0000:08:00.0 (socket 0)
EAL: Error reading from file descriptor 27: Input/output error
EAL: No legacy callbacks, legacy socket not created
Interactive-mode selected
testpmd: create a new mbuf pool <mb_pool_0>: n=171456, size=2176, socket=0
testpmd: preferred mempool ops selected: ring_mp_mc
Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.
Configuring Port 0 (socket 0)
EAL: Error reading from file descriptor 27: Input/output error
iavf_execute_vf_cmd(): No response for cmd 28
iavf_disable_vlan_strip(): Failed to execute command of OP_DISABLE_VLAN_STRIPPING
iavf_execute_vf_cmd(): No response for cmd 24
iavf_configure_rss_lut(): Failed to execute command of OP_CONFIG_RSS_LUT
iavf_dev_configure(): configure rss failed
Port0 dev_configure = -1
Fail to configure port 0
EAL: Error - exiting with code: 1
Cause: Start ports failed
[root@connexip linuxadmin]#
I do see the matching list for driver but is this required even if I use kernel driver on the host and only IAVF PMD on the guest ?
DPDK
Kernel Driver
OS Default DDP
COMMS DDP
Wireless DDP
Firmware
20.11
1.3.2
1.3.20
1.3.24
N/A
2.3
21.02
1.4.11
1.3.24
1.3.28
1.3.4
2.4
Host details:
Red Hat Enterprise Linux release 8.2 (Ootpa)
[root@localhost ~]# modinfo ice
filename: /lib/modules/4.18.0-193.19.1.el8_2.x86_64/kernel/drivers/net/ethernet/intel/ice/ice.ko.xz
firmware: intel/ice/ddp/ice.pkg (ice-1.3.4.0.pkg)
version: 0.8.1-k
license: GPL v2
description: Intel(R) Ethernet Connection E800 Series Linux Driver
author: Intel Corporation, linux.nics@intel.com<mailto:linux.nics@intel.com>
rhelversion: 8.2
Using vfio-pci to connect the VF to the VM.
Guest Details:
OS : debian buster
Dpdk : 20.11.3
Interface bound to uio_pci_generic
[root@connexip linuxadmin]# /opt/sonus/bin/np/swe/dpdk-devbind.py --status
Network devices using DPDK-compatible driver
============================================
0000:01:00.0 'Virtio network device 1041' drv=uio_pci_generic unused=virtio_pci
0000:08:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf
0000:09:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf
Network devices using kernel driver
===================================
0000:02:00.0 'Virtio network device 1041' if=ha0 drv=virtio-pci unused=virtio_pci,uio_pci_generic *Active*
Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.
^ permalink raw reply [flat|nested] 4+ messages in thread* Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 2021-09-23 15:29 [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 Dey, Souvik @ 2021-09-24 0:40 ` Wu, Jingjing 2021-09-24 5:56 ` Dey, Souvik 0 siblings, 1 reply; 4+ messages in thread From: Wu, Jingjing @ 2021-09-24 0:40 UTC (permalink / raw) To: Dey, Souvik, dev, Xing, Beilei Could you have a try to switch from uio_pci_generic to vfio_pci? From: Dey, Souvik <sodey@rbbn.com> Sent: Thursday, September 23, 2021 11:29 PM To: dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com>; Wu, Jingjing <jingjing.wu@intel.com> Subject: Not able to start IAVF PMD with dpdk 20.11.3 Hi All, Trying to test E810 Sr-IOV based nic card with 20.11.3 dpdk. I am running the host kernel driver and only the VF is attached to the VM where I am running dpdk. But when I attaching the VF to the testpmd it is throwing the below error. Is there are way to move forward here ? [root@connexip linuxadmin]# ./dpdk-testpmd -c 0xf -n 4 -a 08:00.0 -- -i --rxq=16 --txq=16 EAL: Detected 4 lcore(s) EAL: Detected 1 NUMA nodes EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: Probe PCI driver: net_iavf (8086:1889) device: 0000:08:00.0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error EAL: No legacy callbacks, legacy socket not created Interactive-mode selected testpmd: create a new mbuf pool <mb_pool_0>: n=171456, size=2176, socket=0 testpmd: preferred mempool ops selected: ring_mp_mc Warning! port-topology=paired and odd forward ports number, the last port will pair with itself. Configuring Port 0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error iavf_execute_vf_cmd(): No response for cmd 28 iavf_disable_vlan_strip(): Failed to execute command of OP_DISABLE_VLAN_STRIPPING iavf_execute_vf_cmd(): No response for cmd 24 iavf_configure_rss_lut(): Failed to execute command of OP_CONFIG_RSS_LUT iavf_dev_configure(): configure rss failed Port0 dev_configure = -1 Fail to configure port 0 EAL: Error - exiting with code: 1 Cause: Start ports failed [root@connexip linuxadmin]# I do see the matching list for driver but is this required even if I use kernel driver on the host and only IAVF PMD on the guest ? DPDK Kernel Driver OS Default DDP COMMS DDP Wireless DDP Firmware 20.11 1.3.2 1.3.20 1.3.24 N/A 2.3 21.02 1.4.11 1.3.24 1.3.28 1.3.4 2.4 Host details: Red Hat Enterprise Linux release 8.2 (Ootpa) [root@localhost ~]# modinfo ice filename: /lib/modules/4.18.0-193.19.1.el8_2.x86_64/kernel/drivers/net/ethernet/intel/ice/ice.ko.xz firmware: intel/ice/ddp/ice.pkg (ice-1.3.4.0.pkg) version: 0.8.1-k license: GPL v2 description: Intel(R) Ethernet Connection E800 Series Linux Driver author: Intel Corporation, linux.nics@intel.com<mailto:linux.nics@intel.com> rhelversion: 8.2 Using vfio-pci to connect the VF to the VM. Guest Details: OS : debian buster Dpdk : 20.11.3 Interface bound to uio_pci_generic [root@connexip linuxadmin]# /opt/sonus/bin/np/swe/dpdk-devbind.py --status Network devices using DPDK-compatible driver ============================================ 0000:01:00.0 'Virtio network device 1041' drv=uio_pci_generic unused=virtio_pci 0000:08:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf 0000:09:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf Network devices using kernel driver =================================== 0000:02:00.0 'Virtio network device 1041' if=ha0 drv=virtio-pci unused=virtio_pci,uio_pci_generic *Active* Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 2021-09-24 0:40 ` Wu, Jingjing @ 2021-09-24 5:56 ` Dey, Souvik 2021-09-24 19:14 ` Dey, Souvik 0 siblings, 1 reply; 4+ messages in thread From: Dey, Souvik @ 2021-09-24 5:56 UTC (permalink / raw) To: Wu, Jingjing, dev, Xing, Beilei With vfio_pci , I am getting the following error and bind itself is failing, due to probe fail with EINVAL. [root@connexip swe]# ./dpdk-devbind.py -b vfio_pci 08:00.0 Error: bind failed for 0000:08:00.0 - Cannot open /sys/bus/pci/drivers/vfio_pci/bind Sep 24 01:50:29 connexip kernel: [ 323.376403] vfio-pci: probe of 0000:08:00.0 failed with error -22 Sep 24 01:50:29 connexip kernel: [ 323.376440] vfio-pci: probe of 0000:08:00.0 failed with error -22 I am using kernel 4.19.194 from debian buster. From: Wu, Jingjing <jingjing.wu@intel.com> Sent: Thursday, September 23, 2021 8:41 PM To: Dey, Souvik <sodey@rbbn.com>; dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com> Subject: [EXTERNAL] RE: Not able to start IAVF PMD with dpdk 20.11.3 Could you have a try to switch from uio_pci_generic to vfio_pci? From: Dey, Souvik <sodey@rbbn.com<mailto:sodey@rbbn.com>> Sent: Thursday, September 23, 2021 11:29 PM To: dev@dpdk.org<mailto:dev@dpdk.org>; Xing, Beilei <beilei.xing@intel.com<mailto:beilei.xing@intel.com>>; Wu, Jingjing <jingjing.wu@intel.com<mailto:jingjing.wu@intel.com>> Subject: Not able to start IAVF PMD with dpdk 20.11.3 Hi All, Trying to test E810 Sr-IOV based nic card with 20.11.3 dpdk. I am running the host kernel driver and only the VF is attached to the VM where I am running dpdk. But when I attaching the VF to the testpmd it is throwing the below error. Is there are way to move forward here ? [root@connexip linuxadmin]# ./dpdk-testpmd -c 0xf -n 4 -a 08:00.0 -- -i --rxq=16 --txq=16 EAL: Detected 4 lcore(s) EAL: Detected 1 NUMA nodes EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: Probe PCI driver: net_iavf (8086:1889) device: 0000:08:00.0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error EAL: No legacy callbacks, legacy socket not created Interactive-mode selected testpmd: create a new mbuf pool <mb_pool_0>: n=171456, size=2176, socket=0 testpmd: preferred mempool ops selected: ring_mp_mc Warning! port-topology=paired and odd forward ports number, the last port will pair with itself. Configuring Port 0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error iavf_execute_vf_cmd(): No response for cmd 28 iavf_disable_vlan_strip(): Failed to execute command of OP_DISABLE_VLAN_STRIPPING iavf_execute_vf_cmd(): No response for cmd 24 iavf_configure_rss_lut(): Failed to execute command of OP_CONFIG_RSS_LUT iavf_dev_configure(): configure rss failed Port0 dev_configure = -1 Fail to configure port 0 EAL: Error - exiting with code: 1 Cause: Start ports failed [root@connexip linuxadmin]# I do see the matching list for driver but is this required even if I use kernel driver on the host and only IAVF PMD on the guest ? DPDK Kernel Driver OS Default DDP COMMS DDP Wireless DDP Firmware 20.11 1.3.2 1.3.20 1.3.24 N/A 2.3 21.02 1.4.11 1.3.24 1.3.28 1.3.4 2.4 Host details: Red Hat Enterprise Linux release 8.2 (Ootpa) [root@localhost ~]# modinfo ice filename: /lib/modules/4.18.0-193.19.1.el8_2.x86_64/kernel/drivers/net/ethernet/intel/ice/ice.ko.xz firmware: intel/ice/ddp/ice.pkg (ice-1.3.4.0.pkg) version: 0.8.1-k license: GPL v2 description: Intel(R) Ethernet Connection E800 Series Linux Driver author: Intel Corporation, linux.nics@intel.com<mailto:linux.nics@intel.com> rhelversion: 8.2 Using vfio-pci to connect the VF to the VM. Guest Details: OS : debian buster Dpdk : 20.11.3 Interface bound to uio_pci_generic [root@connexip linuxadmin]# /opt/sonus/bin/np/swe/dpdk-devbind.py --status Network devices using DPDK-compatible driver ============================================ 0000:01:00.0 'Virtio network device 1041' drv=uio_pci_generic unused=virtio_pci 0000:08:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf 0000:09:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf Network devices using kernel driver =================================== 0000:02:00.0 'Virtio network device 1041' if=ha0 drv=virtio-pci unused=virtio_pci,uio_pci_generic *Active* Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 2021-09-24 5:56 ` Dey, Souvik @ 2021-09-24 19:14 ` Dey, Souvik 0 siblings, 0 replies; 4+ messages in thread From: Dey, Souvik @ 2021-09-24 19:14 UTC (permalink / raw) To: Dey, Souvik, Wu, Jingjing, dev, Xing, Beilei Hi Wu, Thanks for the update. I got rid of the vfio-pci probe issue by enabling "modprobe vfio enable_unsafe_noiommu_mode=1". This was required as I am trying inside a VM where VT-d is not enabled. Now once I bind the interfaces( VF) to the vfio-pci instead of uio_pci_generic , the links are coming up fine and I am able to rx/tx packets out of the VF. Thanks once again for the quick help on this. Just one follow up question. Are we saying we cannot use uio_pci_generic module for the E810 VFs ? is it a bug, do we have any fixes for the same already upstreamed ? -- Regards, Souvik -----Original Message----- From: dev <dev-bounces@dpdk.org> On Behalf Of Dey, Souvik Sent: Friday, September 24, 2021 1:57 AM To: Wu, Jingjing <jingjing.wu@intel.com>; dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com> Subject: [EXTERNAL] Re: [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 With vfio_pci , I am getting the following error and bind itself is failing, due to probe fail with EINVAL. [root@connexip swe]# ./dpdk-devbind.py -b vfio_pci 08:00.0 Error: bind failed for 0000:08:00.0 - Cannot open /sys/bus/pci/drivers/vfio_pci/bind Sep 24 01:50:29 connexip kernel: [ 323.376403] vfio-pci: probe of 0000:08:00.0 failed with error -22 Sep 24 01:50:29 connexip kernel: [ 323.376440] vfio-pci: probe of 0000:08:00.0 failed with error -22 I am using kernel 4.19.194 from debian buster. From: Wu, Jingjing <jingjing.wu@intel.com> Sent: Thursday, September 23, 2021 8:41 PM To: Dey, Souvik <sodey@rbbn.com>; dev@dpdk.org; Xing, Beilei <beilei.xing@intel.com> Subject: [EXTERNAL] RE: Not able to start IAVF PMD with dpdk 20.11.3 Could you have a try to switch from uio_pci_generic to vfio_pci? From: Dey, Souvik <sodey@rbbn.com<mailto:sodey@rbbn.com>> Sent: Thursday, September 23, 2021 11:29 PM To: dev@dpdk.org<mailto:dev@dpdk.org>; Xing, Beilei <beilei.xing@intel.com<mailto:beilei.xing@intel.com>>; Wu, Jingjing <jingjing.wu@intel.com<mailto:jingjing.wu@intel.com>> Subject: Not able to start IAVF PMD with dpdk 20.11.3 Hi All, Trying to test E810 Sr-IOV based nic card with 20.11.3 dpdk. I am running the host kernel driver and only the VF is attached to the VM where I am running dpdk. But when I attaching the VF to the testpmd it is throwing the below error. Is there are way to move forward here ? [root@connexip linuxadmin]# ./dpdk-testpmd -c 0xf -n 4 -a 08:00.0 -- -i --rxq=16 --txq=16 EAL: Detected 4 lcore(s) EAL: Detected 1 NUMA nodes EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: Probe PCI driver: net_iavf (8086:1889) device: 0000:08:00.0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error EAL: No legacy callbacks, legacy socket not created Interactive-mode selected testpmd: create a new mbuf pool <mb_pool_0>: n=171456, size=2176, socket=0 testpmd: preferred mempool ops selected: ring_mp_mc Warning! port-topology=paired and odd forward ports number, the last port will pair with itself. Configuring Port 0 (socket 0) EAL: Error reading from file descriptor 27: Input/output error iavf_execute_vf_cmd(): No response for cmd 28 iavf_disable_vlan_strip(): Failed to execute command of OP_DISABLE_VLAN_STRIPPING iavf_execute_vf_cmd(): No response for cmd 24 iavf_configure_rss_lut(): Failed to execute command of OP_CONFIG_RSS_LUT iavf_dev_configure(): configure rss failed Port0 dev_configure = -1 Fail to configure port 0 EAL: Error - exiting with code: 1 Cause: Start ports failed [root@connexip linuxadmin]# I do see the matching list for driver but is this required even if I use kernel driver on the host and only IAVF PMD on the guest ? DPDK Kernel Driver OS Default DDP COMMS DDP Wireless DDP Firmware 20.11 1.3.2 1.3.20 1.3.24 N/A 2.3 21.02 1.4.11 1.3.24 1.3.28 1.3.4 2.4 Host details: Red Hat Enterprise Linux release 8.2 (Ootpa) [root@localhost ~]# modinfo ice filename: /lib/modules/4.18.0-193.19.1.el8_2.x86_64/kernel/drivers/net/ethernet/intel/ice/ice.ko.xz firmware: intel/ice/ddp/ice.pkg (ice-1.3.4.0.pkg) version: 0.8.1-k license: GPL v2 description: Intel(R) Ethernet Connection E800 Series Linux Driver author: Intel Corporation, linux.nics@intel.com<mailto:linux.nics@intel.com> rhelversion: 8.2 Using vfio-pci to connect the VF to the VM. Guest Details: OS : debian buster Dpdk : 20.11.3 Interface bound to uio_pci_generic [root@connexip linuxadmin]# /opt/sonus/bin/np/swe/dpdk-devbind.py --status Network devices using DPDK-compatible driver ============================================ 0000:01:00.0 'Virtio network device 1041' drv=uio_pci_generic unused=virtio_pci 0000:08:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf 0000:09:00.0 'Ethernet Adaptive Virtual Function 1889' drv=uio_pci_generic unused=i40evf Network devices using kernel driver =================================== 0000:02:00.0 'Virtio network device 1041' if=ha0 drv=virtio-pci unused=virtio_pci,uio_pci_generic *Active* Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. and its Affiliates that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments. ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-09-24 19:14 UTC | newest] Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2021-09-23 15:29 [dpdk-dev] Not able to start IAVF PMD with dpdk 20.11.3 Dey, Souvik 2021-09-24 0:40 ` Wu, Jingjing 2021-09-24 5:56 ` Dey, Souvik 2021-09-24 19:14 ` Dey, Souvik
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).