[dpdk-dev] basic forwarding example not working

[dpdk-dev] basic forwarding example not working

[Subbu CS]

I am using two virtio network adapter on VM on KVM host.

As  in following output, I have bound both interface with igb_uio driver

./dpdk_nic_bind.py --bind=igb_uio 00:0a.0
./dpdk_nic_bind.py --bind=igb_uio 00:0b.0

[root@localhost tools]# ./dpdk_nic_bind.py --status

Network devices using DPDK-compatible driver
============================================
0000:00:0a.0 'Virtio network device' drv=igb_uio unused=
0000:00:0b.0 'Virtio network device' drv=igb_uio unused=

Network devices using kernel driver
===================================
0000:00:03.0 'RTL-8100/8101L/8139 PCI Fast Ethernet Adapter' if=ens3
drv=8139cp unused=igb_uio *Active*
0000:00:08.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio
0000:00:09.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio

Other network devices
=====================
<none>


But when I run basic fowarding example from skeleton, I get following error

./basicfwd -c 1 -n 2
EAL: Detected lcore 0 as core 0 on socket 0
EAL: Support maximum 128 logical core(s) by configuration.
EAL: Detected 1 lcore(s)
EAL: Probing VFIO support...
EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or
directory)
EAL: VFIO modules not loaded, skipping VFIO support...
EAL: Setting up physically contiguous memory...
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75de400000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75de000000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75ddc00000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75dd800000 (size = 0x200000)
EAL: Ask a virtual area of 0x27400000 bytes
EAL: Virtual area found at 0x7f75b6200000 (size = 0x27400000)
EAL: Ask a virtual area of 0x4a00000 bytes
EAL: Virtual area found at 0x7f75b1600000 (size = 0x4a00000)
EAL: Ask a virtual area of 0x1200000 bytes
EAL: Virtual area found at 0x7f75b0200000 (size = 0x1200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75afe00000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75afa00000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75af600000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75af200000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75aee00000 (size = 0x200000)
EAL: Ask a virtual area of 0x200000 bytes
EAL: Virtual area found at 0x7f75aea00000 (size = 0x200000)
EAL: Requesting 370 pages of size 2MB from socket 0
EAL: TSC frequency is ~1696081 KHz
EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable
clock cycles !
EAL: Master lcore 0 is ready (tid=df5298c0;cpuset=[0])
EAL: PCI device 0000:00:08.0 on NUMA socket -1
EAL:   probe driver: 1af4:1000 rte_virtio_pmd
EAL:   Not managed by a supported kernel driver, skipped
Segmentation fault

Please let me know what is the correct method to run the basic forwarding
application.

Re: [dpdk-dev] basic forwarding example not working

[Christian Ehrhardt]

Hi,
for virtio-pci devices you should either just unbind them or bind them to
one of the generic drivers like uio_pci_generic.
At least I never saw igb_uio on virtio-pci devices.

There might be more complete answers, but I think that should get you going.


Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd

On Tue, Apr 19, 2016 at 6:00 PM, Subbu CS <developer.subodh@gmail.com>
wrote:

> I am using two virtio network adapter on VM on KVM host.
>
> As  in following output, I have bound both interface with igb_uio driver
>
> ./dpdk_nic_bind.py --bind=igb_uio 00:0a.0
> ./dpdk_nic_bind.py --bind=igb_uio 00:0b.0
>
> [root@localhost tools]# ./dpdk_nic_bind.py --status
>
> Network devices using DPDK-compatible driver
> ============================================
> 0000:00:0a.0 'Virtio network device' drv=igb_uio unused=
> 0000:00:0b.0 'Virtio network device' drv=igb_uio unused=
>
> Network devices using kernel driver
> ===================================
> 0000:00:03.0 'RTL-8100/8101L/8139 PCI Fast Ethernet Adapter' if=ens3
> drv=8139cp unused=igb_uio *Active*
> 0000:00:08.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio
> 0000:00:09.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio
>
> Other network devices
> =====================
> <none>
>
>
> But when I run basic fowarding example from skeleton, I get following error
>
> ./basicfwd -c 1 -n 2
> EAL: Detected lcore 0 as core 0 on socket 0
> EAL: Support maximum 128 logical core(s) by configuration.
> EAL: Detected 1 lcore(s)
> EAL: Probing VFIO support...
> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or
> directory)
> EAL: VFIO modules not loaded, skipping VFIO support...
> EAL: Setting up physically contiguous memory...
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75de400000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75de000000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75ddc00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75dd800000 (size = 0x200000)
> EAL: Ask a virtual area of 0x27400000 bytes
> EAL: Virtual area found at 0x7f75b6200000 (size = 0x27400000)
> EAL: Ask a virtual area of 0x4a00000 bytes
> EAL: Virtual area found at 0x7f75b1600000 (size = 0x4a00000)
> EAL: Ask a virtual area of 0x1200000 bytes
> EAL: Virtual area found at 0x7f75b0200000 (size = 0x1200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75afe00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75afa00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75af600000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75af200000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75aee00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f75aea00000 (size = 0x200000)
> EAL: Requesting 370 pages of size 2MB from socket 0
> EAL: TSC frequency is ~1696081 KHz
> EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable
> clock cycles !
> EAL: Master lcore 0 is ready (tid=df5298c0;cpuset=[0])
> EAL: PCI device 0000:00:08.0 on NUMA socket -1
> EAL:   probe driver: 1af4:1000 rte_virtio_pmd
> EAL:   Not managed by a supported kernel driver, skipped
> Segmentation fault
>
> Please let me know what is the correct method to run the basic forwarding
> application.
>

Re: [dpdk-dev] basic forwarding example not working

[Christian Ehrhardt]

Hi,
I think your log is cut short.
At least in what you posted I don't see the "card skipped" issue anymore.
Also I don't see the segfault at the end anymore.
Actually there is no error left in this second log.

I never used basicfwd so far - maybe it is something special to it that
breaks your case.
If it follows the normal EAL commandline I'd recommend to also add
something for memory like --socket-mem 2048.
Well without it should just try to grab everything, but I prefer to specify
things.

Could you try to run the testpmd or l2fwd programs instead - IMHO these are
more commonly used (=usually work better).


Christian Ehrhardt
Software Engineer, Ubuntu Server
Canonical Ltd

On Tue, Apr 19, 2016 at 7:30 PM, Subbu CS <developer.subodh@gmail.com>
wrote:

> Hi Christian,
>
> I unbind two interfaces and then bound them to uio_pci_generic driver.
>
> [root@localhost tools]# ./dpdk_nic_bind.py --status
>
> Network devices using DPDK-compatible driver
> ============================================
> 0000:00:0a.0 'Virtio network device' drv=uio_pci_generic unused=igb_uio
> 0000:00:0b.0 'Virtio network device' drv=uio_pci_generic unused=igb_uio
>
> Network devices using kernel driver
> ===================================
> 0000:00:03.0 'RTL-8100/8101L/8139 PCI Fast Ethernet Adapter' if=ens3
> drv=8139cp unused=igb_uio,uio_pci_generic *Active*
> 0000:00:08.0 'Virtio network device' if= drv=virtio-pci
> unused=igb_uio,uio_pci_generic
> 0000:00:09.0 'Virtio network device' if= drv=virtio-pci
> unused=igb_uio,uio_pci_generic
>
> Other network devices
> =====================
> <none>
>
>
>
> But Still I get the same error
>
>
> [root@localhost build]# ./basicfwd -c 1 -n 2
> EAL: Detected lcore 0 as core 0 on socket 0
> EAL: Support maximum 128 logical core(s) by configuration.
> EAL: Detected 1 lcore(s)
> EAL: Probing VFIO support...
> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or
> directory)
> EAL: VFIO modules not loaded, skipping VFIO support...
> EAL: Setting up physically contiguous memory...
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f189d600000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f189d200000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f189ce00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f189ca00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x27400000 bytes
> EAL: Virtual area found at 0x7f1875400000 (size = 0x27400000)
> EAL: Ask a virtual area of 0x4a00000 bytes
> EAL: Virtual area found at 0x7f1870800000 (size = 0x4a00000)
> EAL: Ask a virtual area of 0x1200000 bytes
> EAL: Virtual area found at 0x7f186f400000 (size = 0x1200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186f000000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186ec00000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186e800000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186e400000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186e000000 (size = 0x200000)
> EAL: Ask a virtual area of 0x200000 bytes
> EAL: Virtual area found at 0x7f186dc00000 (size = 0x200000)
> EAL: Requesting 370 pages of size 2MB from socket 0
> EAL: TSC frequency is ~1696076 KHz
> EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using
> unreliable clock cycles !
> EAL: Master lcore 0 is ready (tid=9e7a58c0;cpuset=[0])
> EAL: PCI device 0000:00:08.0 on NUMA socket -1
> EAL:   probe driver: 1af4:1000 rte_virtio_pmd
> EAL:   Not managed by a supported kernel driver, skipped
> Segmentation fault
>
>
>
> On Tue, Apr 19, 2016 at 9:53 PM, Christian Ehrhardt <
> christian.ehrhardt@canonical.com> wrote:
>
>> Hi,
>> for virtio-pci devices you should either just unbind them or bind them to
>> one of the generic drivers like uio_pci_generic.
>> At least I never saw igb_uio on virtio-pci devices.
>>
>> There might be more complete answers, but I think that should get you
>> going.
>>
>>
>> Christian Ehrhardt
>> Software Engineer, Ubuntu Server
>> Canonical Ltd
>>
>> On Tue, Apr 19, 2016 at 6:00 PM, Subbu CS <developer.subodh@gmail.com>
>> wrote:
>>
>>> I am using two virtio network adapter on VM on KVM host.
>>>
>>> As  in following output, I have bound both interface with igb_uio driver
>>>
>>> ./dpdk_nic_bind.py --bind=igb_uio 00:0a.0
>>> ./dpdk_nic_bind.py --bind=igb_uio 00:0b.0
>>>
>>> [root@localhost tools]# ./dpdk_nic_bind.py --status
>>>
>>> Network devices using DPDK-compatible driver
>>> ============================================
>>> 0000:00:0a.0 'Virtio network device' drv=igb_uio unused=
>>> 0000:00:0b.0 'Virtio network device' drv=igb_uio unused=
>>>
>>> Network devices using kernel driver
>>> ===================================
>>> 0000:00:03.0 'RTL-8100/8101L/8139 PCI Fast Ethernet Adapter' if=ens3
>>> drv=8139cp unused=igb_uio *Active*
>>> 0000:00:08.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio
>>> 0000:00:09.0 'Virtio network device' if= drv=virtio-pci unused=igb_uio
>>>
>>> Other network devices
>>> =====================
>>> <none>
>>>
>>>
>>> But when I run basic fowarding example from skeleton, I get following
>>> error
>>>
>>> ./basicfwd -c 1 -n 2
>>> EAL: Detected lcore 0 as core 0 on socket 0
>>> EAL: Support maximum 128 logical core(s) by configuration.
>>> EAL: Detected 1 lcore(s)
>>> EAL: Probing VFIO support...
>>> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or
>>> directory)
>>> EAL: VFIO modules not loaded, skipping VFIO support...
>>> EAL: Setting up physically contiguous memory...
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75de400000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75de000000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75ddc00000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75dd800000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x27400000 bytes
>>> EAL: Virtual area found at 0x7f75b6200000 (size = 0x27400000)
>>> EAL: Ask a virtual area of 0x4a00000 bytes
>>> EAL: Virtual area found at 0x7f75b1600000 (size = 0x4a00000)
>>> EAL: Ask a virtual area of 0x1200000 bytes
>>> EAL: Virtual area found at 0x7f75b0200000 (size = 0x1200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75afe00000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75afa00000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75af600000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75af200000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75aee00000 (size = 0x200000)
>>> EAL: Ask a virtual area of 0x200000 bytes
>>> EAL: Virtual area found at 0x7f75aea00000 (size = 0x200000)
>>> EAL: Requesting 370 pages of size 2MB from socket 0
>>> EAL: TSC frequency is ~1696081 KHz
>>> EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using
>>> unreliable
>>> clock cycles !
>>> EAL: Master lcore 0 is ready (tid=df5298c0;cpuset=[0])
>>> EAL: PCI device 0000:00:08.0 on NUMA socket -1
>>> EAL:   probe driver: 1af4:1000 rte_virtio_pmd
>>> EAL:   Not managed by a supported kernel driver, skipped
>>> Segmentation fault
>>>
>>> Please let me know what is the correct method to run the basic forwarding
>>> application.
>>>
>>
>>
>