[dpdk-users] Pktgen cannot work with ovs-dpdk vhost user port

[dpdk-users] Pktgen cannot work with ovs-dpdk vhost user port

[Sihao Xie]

Hi, all
  I want to run pktgen with ovs, and I follow some tutorials in the network
but I ran into some problems related to socket ID:

Copyright (c) <2010-2019>, Intel Corporation. All rights reserved. Powered
by DPDK
EAL: Detected 6 lcore(s)
EAL: Detected 1 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/pktgen/mp_socket
EAL: Probing VFIO support...
update_memory_region(): Too many memory regions
update_memory_region(): Too many memory regions
Lua 5.3.1  Copyright (C) 1994-2015 Lua.org, PUC-Rio

*** Copyright (c) <2010-2019>, Intel Corporation. All rights reserved.
*** Pktgen created by: Keith Wiles -- >>> Powered by DPDK <<<

Initialize Port 0 -- TxQ 1, RxQ 1,  Src MAC 00:00:00:00:00:01
Initialize Port 1 -- TxQ 1, RxQ 1,  Src MAC 00:00:00:00:00:02

Port  0: Link Up - speed 10000 Mbps - full-duplex <Enable promiscuous mode>
Port  1: Link Up - speed 10000 Mbps - full-duplex <Enable promiscuous mode>

  RX/TX processing lcore:   0 rx:  1 tx:  1
PANIC in pktgen_main_rxtx_loop():
*** port 0 socket ID 4294967295 has different socket ID for lcore 0 socket
ID 0
7: [/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7ff740ff641d]]
6: [/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7ff7412c06ba]]
5: [./app/x86_64-native-linuxapp-gcc/pktgen(eal_thread_loop+0x1e1)
[0x58e781]]
4: [./app/x86_64-native-linuxapp-gcc/pktgen(pktgen_launch_one_lcore+0xb7)
[0x49fb47]]
3: [./app/x86_64-native-linuxapp-gcc/pktgen() [0x49e115]]
2: [./app/x86_64-native-linuxapp-gcc/pktgen(__rte_panic+0xc3) [0x4634fc]]
1: [./app/x86_64-native-linuxapp-gcc/pktgen(rte_dump_stack+0x2b) [0x594adb]]
Aborted (core dumped)

I use cmd below to run the pktgen:
  export DPDK_PARAMS="-c 0x19 --master-lcore 3 -m 512 --file-prefix pktgen
--no-pci
--vdev=net_virtio_user1,mac=00:00:00:00:00:01,path=/usr/local/var/run/openvswitch/vhost-user1
--vdev=net_virtio_user2,mac=00:00:00:00:00:02,path=/usr/local/var/run/openvswitch/vhost-user2
"
  export PKTGEN_PARAMS='-T -P -m "0.0,4.1"'
  sudo -E ./app/x86_64-native-linuxapp-gcc/pktgen $DPDK_PARAMS --
$PKTGEN_PARAMS

As for ovs, I use cmd below to set up the virtual switch with vhost user
port:
  sudo ./utilities/ovs-vsctl add-br br0 -- set bridge br0
datapath_type=netdev
  sudo ./utilities/ovs-vsctl add-port br0 vhost-user1 -- set Interface
vhost-user1 type=dpdkvhostuser
  sudo ./utilities/ovs-vsctl add-port br0 vhost-user2 -- set Interface
vhost-user2 type=dpdkvhostuser

Finally, I ran pktgen in the same ubuntu16.04 virtual machine which ovs run.

I have no idea why this error occurs and cannot solve it, so I come to ask
for your help.

Many thanks,
House

Re: [dpdk-users] Pktgen cannot work with ovs-dpdk vhost user port

[Wiles, Keith]

> On Apr 16, 2019, at 10:45 AM, Sihao Xie <sihao.x19@gmail.com> wrote:
> 
> Hi, all
>  I want to run pktgen with ovs, and I follow some tutorials in the network
> but I ran into some problems related to socket ID:
> 
> Copyright (c) <2010-2019>, Intel Corporation. All rights reserved. Powered
> by DPDK
> EAL: Detected 6 lcore(s)
> EAL: Detected 1 NUMA nodes
> EAL: Multi-process socket /var/run/dpdk/pktgen/mp_socket
> EAL: Probing VFIO support...
> update_memory_region(): Too many memory regions
> update_memory_region(): Too many memory regions
> Lua 5.3.1  Copyright (C) 1994-2015 Lua.org, PUC-Rio
> 
> *** Copyright (c) <2010-2019>, Intel Corporation. All rights reserved.
> *** Pktgen created by: Keith Wiles -- >>> Powered by DPDK <<<
> 
> Initialize Port 0 -- TxQ 1, RxQ 1,  Src MAC 00:00:00:00:00:01
> Initialize Port 1 -- TxQ 1, RxQ 1,  Src MAC 00:00:00:00:00:02
> 
> Port  0: Link Up - speed 10000 Mbps - full-duplex <Enable promiscuous mode>
> Port  1: Link Up - speed 10000 Mbps - full-duplex <Enable promiscuous mode>
> 
>  RX/TX processing lcore:   0 rx:  1 tx:  1
> PANIC in pktgen_main_rxtx_loop():
> *** port 0 socket ID 4294967295 has different socket ID for lcore 0 socket

I have code in pktgen to verify the socket and lcore are correct and that the configuration does not use a port on master lcore.

Can you change the command line for pktgen and not give the —master-lcore as 3 and change the port setup to be 3,0,4.1 making lcore 0 master. Is there some reason that you need master lcore to be 3?

> ID 0
> 7: [/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7ff740ff641d]]
> 6: [/lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7ff7412c06ba]]
> 5: [./app/x86_64-native-linuxapp-gcc/pktgen(eal_thread_loop+0x1e1)
> [0x58e781]]
> 4: [./app/x86_64-native-linuxapp-gcc/pktgen(pktgen_launch_one_lcore+0xb7)
> [0x49fb47]]
> 3: [./app/x86_64-native-linuxapp-gcc/pktgen() [0x49e115]]
> 2: [./app/x86_64-native-linuxapp-gcc/pktgen(__rte_panic+0xc3) [0x4634fc]]
> 1: [./app/x86_64-native-linuxapp-gcc/pktgen(rte_dump_stack+0x2b) [0x594adb]]
> Aborted (core dumped)
> 
> I use cmd below to run the pktgen:
>  export DPDK_PARAMS="-c 0x19 --master-lcore 3 -m 512 --file-prefix pktgen
> --no-pci
> --vdev=net_virtio_user1,mac=00:00:00:00:00:01,path=/usr/local/var/run/openvswitch/vhost-user1
> --vdev=net_virtio_user2,mac=00:00:00:00:00:02,path=/usr/local/var/run/openvswitch/vhost-user2
> "
>  export PKTGEN_PARAMS='-T -P -m "0.0,4.1"'
>  sudo -E ./app/x86_64-native-linuxapp-gcc/pktgen $DPDK_PARAMS --
> $PKTGEN_PARAMS
> 
> As for ovs, I use cmd below to set up the virtual switch with vhost user
> port:
>  sudo ./utilities/ovs-vsctl add-br br0 -- set bridge br0
> datapath_type=netdev
>  sudo ./utilities/ovs-vsctl add-port br0 vhost-user1 -- set Interface
> vhost-user1 type=dpdkvhostuser
>  sudo ./utilities/ovs-vsctl add-port br0 vhost-user2 -- set Interface
> vhost-user2 type=dpdkvhostuser
> 
> Finally, I ran pktgen in the same ubuntu16.04 virtual machine which ovs run.
> 
> I have no idea why this error occurs and cannot solve it, so I come to ask
> for your help.
> 
> Many thanks,
> House

Regards,
Keith