test suite reviews and discussions
 help / color / mirror / Atom feed
* Re: [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and Optimize script
  2020-11-13 17:54 [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and Optimize script JiangYuX
@ 2020-11-13  9:57 ` Jiang, YuX
  2020-11-17  5:59   ` Wang, Yinan
  0 siblings, 1 reply; 3+ messages in thread
From: Jiang, YuX @ 2020-11-13  9:57 UTC (permalink / raw)
  To: Jiang, YuX, dts

[-- Attachment #1: Type: text/plain, Size: 379 bytes --]

Tested-by: JiangYuX <yux.jiang@intel.com>

    Best Regards
    Jiang yu

> -----Original Message-----
> From: JiangYuX [mailto:yux.jiang@intel.com]
> Sent: Saturday, November 14, 2020 1:55 AM
> To: dts@dpdk.org
> Cc: Jiang, YuX <yux.jiang@intel.com>
> Subject: [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart:
> Add one new case and Optimize script

[-- Attachment #2: TestPVPVirtioUserMultiQueuesPortRestart.log --]
[-- Type: application/octet-stream, Size: 256354 bytes --]

13/11/2020 17:05:03                            dts: 
TEST SUITE : TestPVPVirtioUserMultiQueuesPortRestart
13/11/2020 17:05:03                            dts: NIC :        fortville_spirit
13/11/2020 17:05:03             dut.10.240.183.220: 
13/11/2020 17:05:03                         tester: 
13/11/2020 17:05:03                         tester: ls -d /tmp
13/11/2020 17:05:03                         tester: /tmp
13/11/2020 17:05:05             dut.10.240.183.220: kill_all: called by dut and has no prefix list.
13/11/2020 17:05:06             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:05:06             dut.10.240.183.220: 1048576
13/11/2020 17:05:06 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_inorder_mergeable_path Begin
13/11/2020 17:05:06             dut.10.240.183.220: 
13/11/2020 17:05:06                         tester: 
13/11/2020 17:05:06             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:05:06             dut.10.240.183.220: 
13/11/2020 17:05:06             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:05:06             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:05:06             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:05:06             dut.10.240.183.220: 
13/11/2020 17:05:17             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:05:17             dut.10.240.183.220: 1048576
13/11/2020 17:05:17             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=1,queue_size=255  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2 --txd=255 --rxd=255
13/11/2020 17:05:18             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:05:28             dut.10.240.183.220: set fwd mac
13/11/2020 17:05:28             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:05:28             dut.10.240.183.220: start
13/11/2020 17:05:28             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:05:28 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_packed_ring_inorder_mergeable_path, and 64 frame size.
13/11/2020 17:05:28                         tester: ls -d /tmp
13/11/2020 17:05:28                         tester: /tmp
13/11/2020 17:05:28                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:05:30                         pktgen: test port 0 map gen port 0
13/11/2020 17:05:30                         pktgen: test port 0 map gen port 0
13/11/2020 17:05:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:30                         pktgen: trex port <0> not support flow control
13/11/2020 17:05:30                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:05:30                         pktgen: check the trex port link status
13/11/2020 17:05:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:30                         pktgen: begin traffic ......
13/11/2020 17:05:30                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:05:35                         pktgen: traffic completed. 
13/11/2020 17:05:35                         pktgen: check the trex port link status
13/11/2020 17:05:35                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:35                         pktgen: begin traffic ......
13/11/2020 17:05:35                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:05:45                         pktgen: begin get port statistic ...
13/11/2020 17:05:45                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:05:45                         pktgen: {0: {'ibytes': 11956833664,
     'ierrors': 0,
     'ipackets': 186825558,
     'obytes': 21975703680,
     'oerrors': 0,
     'opackets': 343370385,
     'rx_bps': 9555489792.0,
     'rx_bps_L1': 12541580672.0,
     'rx_pps': 18663068.0,
     'rx_util': 31.353951679999998,
     'tx_bps': 17594408960.0,
     'tx_bps_L1': 23092660480.0,
     'tx_pps': 34364072.0,
     'tx_util': 57.7316512},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.945204734802246,
            'cpu_util': 98.3454818725586,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9555489792.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8038918144.0,
            'rx_pps': 18663068.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17594408960.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 34364072.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11956833664,
           'ierrors': 0,
           'ipackets': 186825558,
           'obytes': 21975703680,
           'oerrors': 0,
           'opackets': 343370385,
           'rx_bps': 9555489792.0,
           'rx_bps_L1': 12541580672.0,
           'rx_pps': 18663068.0,
           'rx_util': 31.353951679999998,
           'tx_bps': 17594408960.0,
           'tx_bps_L1': 23092660480.0,
           'tx_pps': 34364072.0,
           'tx_util': 57.7316512}}
13/11/2020 17:05:45                         pktgen: {'ibytes': 11956833664,
 'ierrors': 0,
 'ipackets': 186825558,
 'obytes': 21975703680,
 'oerrors': 0,
 'opackets': 343370385,
 'rx_bps': 9555489792.0,
 'rx_bps_L1': 12541580672.0,
 'rx_pps': 18663068.0,
 'rx_util': 31.353951679999998,
 'tx_bps': 17594408960.0,
 'tx_bps_L1': 23092660480.0,
 'tx_pps': 34364072.0,
 'tx_util': 57.7316512}
13/11/2020 17:05:45                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17594408960.000000, tx_pps: 34364072.000000 
13/11/2020 17:05:45                         pktgen: {'ibytes': 11956833664,
 'ierrors': 0,
 'ipackets': 186825558,
 'obytes': 21975703680,
 'oerrors': 0,
 'opackets': 343370385,
 'rx_bps': 9555489792.0,
 'rx_bps_L1': 12541580672.0,
 'rx_pps': 18663068.0,
 'rx_util': 31.353951679999998,
 'tx_bps': 17594408960.0,
 'tx_bps_L1': 23092660480.0,
 'tx_pps': 34364072.0,
 'tx_util': 57.7316512}
13/11/2020 17:05:45                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9555489792.000000, rx_pps: 18663068.000000
13/11/2020 17:05:45                         pktgen: throughput: pps_rx 18663068.000000, bps_rx 9555489792.000000
13/11/2020 17:05:45                         pktgen: traffic completed. 
13/11/2020 17:05:45             dut.10.240.183.220: stop
13/11/2020 17:05:45             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 140038536      TX-packets: 140038536      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 140436106      TX-packets: 140436106      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 280474642      RX-dropped: 0             RX-total: 280474642
  TX-packets: 280474642      TX-dropped: 0             TX-total: 280474642
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 280474642      RX-dropped: 0             RX-total: 280474642
  TX-packets: 280474642      TX-dropped: 0             TX-total: 280474642
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:05:45             dut.10.240.183.220: start
13/11/2020 17:05:45             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:05:48                         tester: ls -d /tmp
13/11/2020 17:05:48                         tester: /tmp
13/11/2020 17:05:48                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:05:50                         pktgen: test port 0 map gen port 0
13/11/2020 17:05:50                         pktgen: test port 0 map gen port 0
13/11/2020 17:05:50                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:50                         pktgen: trex port <0> not support flow control
13/11/2020 17:05:50                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:05:50                         pktgen: check the trex port link status
13/11/2020 17:05:50                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:50                         pktgen: begin traffic ......
13/11/2020 17:05:50                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:05:55                         pktgen: traffic completed. 
13/11/2020 17:05:55                         pktgen: check the trex port link status
13/11/2020 17:05:55                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:05:55                         pktgen: begin traffic ......
13/11/2020 17:05:55                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:06:05                         pktgen: begin get port statistic ...
13/11/2020 17:06:05                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:06:05                         pktgen: {0: {'ibytes': 11962841792,
     'ierrors': 0,
     'ipackets': 186919411,
     'obytes': 22070514560,
     'oerrors': 0,
     'opackets': 344851819,
     'rx_bps': 9597844480.0,
     'rx_bps_L1': 12597168640.0,
     'rx_pps': 18745776.0,
     'rx_util': 31.492921600000003,
     'tx_bps': 17686040576.0,
     'tx_bps_L1': 23212927616.0,
     'tx_pps': 34543044.0,
     'tx_util': 58.032319040000004},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.950862884521484,
            'cpu_util': 98.79517364501953,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9597844480.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8088196096.0,
            'rx_pps': 18745776.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17686040576.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 34543044.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11962841792,
           'ierrors': 0,
           'ipackets': 186919411,
           'obytes': 22070514560,
           'oerrors': 0,
           'opackets': 344851819,
           'rx_bps': 9597844480.0,
           'rx_bps_L1': 12597168640.0,
           'rx_pps': 18745776.0,
           'rx_util': 31.492921600000003,
           'tx_bps': 17686040576.0,
           'tx_bps_L1': 23212927616.0,
           'tx_pps': 34543044.0,
           'tx_util': 58.032319040000004}}
13/11/2020 17:06:05                         pktgen: {'ibytes': 11962841792,
 'ierrors': 0,
 'ipackets': 186919411,
 'obytes': 22070514560,
 'oerrors': 0,
 'opackets': 344851819,
 'rx_bps': 9597844480.0,
 'rx_bps_L1': 12597168640.0,
 'rx_pps': 18745776.0,
 'rx_util': 31.492921600000003,
 'tx_bps': 17686040576.0,
 'tx_bps_L1': 23212927616.0,
 'tx_pps': 34543044.0,
 'tx_util': 58.032319040000004}
13/11/2020 17:06:05                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17686040576.000000, tx_pps: 34543044.000000 
13/11/2020 17:06:05                         pktgen: {'ibytes': 11962841792,
 'ierrors': 0,
 'ipackets': 186919411,
 'obytes': 22070514560,
 'oerrors': 0,
 'opackets': 344851819,
 'rx_bps': 9597844480.0,
 'rx_bps_L1': 12597168640.0,
 'rx_pps': 18745776.0,
 'rx_util': 31.492921600000003,
 'tx_bps': 17686040576.0,
 'tx_bps_L1': 23212927616.0,
 'tx_pps': 34543044.0,
 'tx_util': 58.032319040000004}
13/11/2020 17:06:05                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9597844480.000000, rx_pps: 18745776.000000
13/11/2020 17:06:05                         pktgen: throughput: pps_rx 18745776.000000, bps_rx 9597844480.000000
13/11/2020 17:06:05                         pktgen: traffic completed. 
13/11/2020 17:06:05             dut.10.240.183.220: stop
13/11/2020 17:06:05             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 140360943      TX-packets: 140360943      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 140043239      TX-packets: 140043239      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 280404182      RX-dropped: 0             RX-total: 280404182
  TX-packets: 280404182      TX-dropped: 0             TX-total: 280404182
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 280404182      RX-dropped: 0             RX-total: 280404182
  TX-packets: 280404182      TX-dropped: 0             TX-total: 280404182
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:06:05             dut.10.240.183.220: start
13/11/2020 17:06:05             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:06:06             dut.10.240.183.220: quit
13/11/2020 17:06:07             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:06:07 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+-------------------------------+------------------+------------+----------------+
| FrameSize(B) |             Mode              | Throughput(Mpps) | % linerate |     Cycle      |
+==============+===============================+==================+============+================+
| 64           | packed_ring_inorder_mergeable | 18.663           | 31.354     | Before Restart |
+--------------+-------------------------------+------------------+------------+----------------+
| 64           | packed_ring_inorder_mergeable | 18.746           | 31.493     | After Restart  |
+--------------+-------------------------------+------------------+------------+----------------+
13/11/2020 17:06:07 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_inorder_mergeable_path Result PASSED:
13/11/2020 17:06:07             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:06:10 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_inorder_nonmergeable_path Begin
13/11/2020 17:06:10             dut.10.240.183.220:  
13/11/2020 17:06:10                         tester: 
13/11/2020 17:06:10             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:06:10             dut.10.240.183.220: 
13/11/2020 17:06:10             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:06:10             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:06:10             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:06:10             dut.10.240.183.220: 
13/11/2020 17:06:21             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:06:22             dut.10.240.183.220: 1048576
13/11/2020 17:06:22             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1,queue_size=255  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2 --txd=255 --rxd=255
13/11/2020 17:06:22             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:06:32             dut.10.240.183.220: set fwd mac
13/11/2020 17:06:32             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:06:32             dut.10.240.183.220: start
13/11/2020 17:06:32             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:06:32 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_packed_ring_inorder_nonmergeable_path, and 64 frame size.
13/11/2020 17:06:32                         tester: ls -d /tmp
13/11/2020 17:06:32                         tester: /tmp
13/11/2020 17:06:32                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:06:34                         pktgen: test port 0 map gen port 0
13/11/2020 17:06:34                         pktgen: test port 0 map gen port 0
13/11/2020 17:06:34                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:34                         pktgen: trex port <0> not support flow control
13/11/2020 17:06:34                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:06:34                         pktgen: check the trex port link status
13/11/2020 17:06:34                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:34                         pktgen: begin traffic ......
13/11/2020 17:06:34                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:06:39                         pktgen: traffic completed. 
13/11/2020 17:06:39                         pktgen: check the trex port link status
13/11/2020 17:06:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:39                         pktgen: begin traffic ......
13/11/2020 17:06:39                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:06:49                         pktgen: begin get port statistic ...
13/11/2020 17:06:49                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:06:49                         pktgen: {0: {'ibytes': 12103446016,
     'ierrors': 0,
     'ipackets': 189116351,
     'obytes': 22711470016,
     'oerrors': 0,
     'opackets': 354866745,
     'rx_bps': 9679431680.0,
     'rx_bps_L1': 12704253440.0,
     'rx_pps': 18905136.0,
     'rx_util': 31.7606336,
     'tx_bps': 18136156160.0,
     'tx_bps_L1': 23803704320.0,
     'tx_pps': 35422176.0,
     'tx_util': 59.5092608},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.233139038085938,
            'cpu_util': 98.21229553222656,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9679431680.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8456724480.0,
            'rx_pps': 18905136.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18136156160.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35422176.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12103446016,
           'ierrors': 0,
           'ipackets': 189116351,
           'obytes': 22711470016,
           'oerrors': 0,
           'opackets': 354866745,
           'rx_bps': 9679431680.0,
           'rx_bps_L1': 12704253440.0,
           'rx_pps': 18905136.0,
           'rx_util': 31.7606336,
           'tx_bps': 18136156160.0,
           'tx_bps_L1': 23803704320.0,
           'tx_pps': 35422176.0,
           'tx_util': 59.5092608}}
13/11/2020 17:06:49                         pktgen: {'ibytes': 12103446016,
 'ierrors': 0,
 'ipackets': 189116351,
 'obytes': 22711470016,
 'oerrors': 0,
 'opackets': 354866745,
 'rx_bps': 9679431680.0,
 'rx_bps_L1': 12704253440.0,
 'rx_pps': 18905136.0,
 'rx_util': 31.7606336,
 'tx_bps': 18136156160.0,
 'tx_bps_L1': 23803704320.0,
 'tx_pps': 35422176.0,
 'tx_util': 59.5092608}
13/11/2020 17:06:49                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18136156160.000000, tx_pps: 35422176.000000 
13/11/2020 17:06:49                         pktgen: {'ibytes': 12103446016,
 'ierrors': 0,
 'ipackets': 189116351,
 'obytes': 22711470016,
 'oerrors': 0,
 'opackets': 354866745,
 'rx_bps': 9679431680.0,
 'rx_bps_L1': 12704253440.0,
 'rx_pps': 18905136.0,
 'rx_util': 31.7606336,
 'tx_bps': 18136156160.0,
 'tx_bps_L1': 23803704320.0,
 'tx_pps': 35422176.0,
 'tx_util': 59.5092608}
13/11/2020 17:06:49                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9679431680.000000, rx_pps: 18905136.000000
13/11/2020 17:06:49                         pktgen: throughput: pps_rx 18905136.000000, bps_rx 9679431680.000000
13/11/2020 17:06:49                         pktgen: traffic completed. 
13/11/2020 17:06:49             dut.10.240.183.220: stop
13/11/2020 17:06:50             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 141626107      TX-packets: 141626107      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 141161840      TX-packets: 141161840      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 282787947      RX-dropped: 0             RX-total: 282787947
  TX-packets: 282787947      TX-dropped: 0             TX-total: 282787947
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 282787947      RX-dropped: 0             RX-total: 282787947
  TX-packets: 282787947      TX-dropped: 0             TX-total: 282787947
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:06:50             dut.10.240.183.220: start
13/11/2020 17:06:50             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:06:52                         tester: ls -d /tmp
13/11/2020 17:06:52                         tester: /tmp
13/11/2020 17:06:52                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:06:54                         pktgen: test port 0 map gen port 0
13/11/2020 17:06:54                         pktgen: test port 0 map gen port 0
13/11/2020 17:06:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:54                         pktgen: trex port <0> not support flow control
13/11/2020 17:06:54                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:06:54                         pktgen: check the trex port link status
13/11/2020 17:06:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:54                         pktgen: begin traffic ......
13/11/2020 17:06:54                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:06:59                         pktgen: traffic completed. 
13/11/2020 17:06:59                         pktgen: check the trex port link status
13/11/2020 17:06:59                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:06:59                         pktgen: begin traffic ......
13/11/2020 17:06:59                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:07:09                         pktgen: begin get port statistic ...
13/11/2020 17:07:09                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:07:09                         pktgen: {0: {'ibytes': 12016893248,
     'ierrors': 0,
     'ipackets': 187763988,
     'obytes': 22585319616,
     'oerrors': 0,
     'opackets': 352895666,
     'rx_bps': 9591342080.0,
     'rx_bps_L1': 12588636800.0,
     'rx_pps': 18733092.0,
     'rx_util': 31.471591999999998,
     'tx_bps': 17987676160.0,
     'tx_bps_L1': 23608825600.0,
     'tx_pps': 35132184.0,
     'tx_util': 59.02206399999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.105982780456543,
            'cpu_util': 98.76844787597656,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9591342080.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8396334080.0,
            'rx_pps': 18733092.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17987676160.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35132184.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12016893248,
           'ierrors': 0,
           'ipackets': 187763988,
           'obytes': 22585319616,
           'oerrors': 0,
           'opackets': 352895666,
           'rx_bps': 9591342080.0,
           'rx_bps_L1': 12588636800.0,
           'rx_pps': 18733092.0,
           'rx_util': 31.471591999999998,
           'tx_bps': 17987676160.0,
           'tx_bps_L1': 23608825600.0,
           'tx_pps': 35132184.0,
           'tx_util': 59.02206399999999}}
13/11/2020 17:07:09                         pktgen: {'ibytes': 12016893248,
 'ierrors': 0,
 'ipackets': 187763988,
 'obytes': 22585319616,
 'oerrors': 0,
 'opackets': 352895666,
 'rx_bps': 9591342080.0,
 'rx_bps_L1': 12588636800.0,
 'rx_pps': 18733092.0,
 'rx_util': 31.471591999999998,
 'tx_bps': 17987676160.0,
 'tx_bps_L1': 23608825600.0,
 'tx_pps': 35132184.0,
 'tx_util': 59.02206399999999}
13/11/2020 17:07:09                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17987676160.000000, tx_pps: 35132184.000000 
13/11/2020 17:07:09                         pktgen: {'ibytes': 12016893248,
 'ierrors': 0,
 'ipackets': 187763988,
 'obytes': 22585319616,
 'oerrors': 0,
 'opackets': 352895666,
 'rx_bps': 9591342080.0,
 'rx_bps_L1': 12588636800.0,
 'rx_pps': 18733092.0,
 'rx_util': 31.471591999999998,
 'tx_bps': 17987676160.0,
 'tx_bps_L1': 23608825600.0,
 'tx_pps': 35132184.0,
 'tx_util': 59.02206399999999}
13/11/2020 17:07:09                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9591342080.000000, rx_pps: 18733092.000000
13/11/2020 17:07:09                         pktgen: throughput: pps_rx 18733092.000000, bps_rx 9591342080.000000
13/11/2020 17:07:09                         pktgen: traffic completed. 
13/11/2020 17:07:09             dut.10.240.183.220: stop
13/11/2020 17:07:09             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 140776968      TX-packets: 140776968      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 140546496      TX-packets: 140546496      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 281323464      RX-dropped: 0             RX-total: 281323464
  TX-packets: 281323464      TX-dropped: 0             TX-total: 281323464
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 281323464      RX-dropped: 0             RX-total: 281323464
  TX-packets: 281323464      TX-dropped: 0             TX-total: 281323464
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:07:09             dut.10.240.183.220: start
13/11/2020 17:07:10             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:07:11             dut.10.240.183.220: quit
13/11/2020 17:07:11             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:07:11 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+----------------------------------+------------------+------------+----------------+
| FrameSize(B) |               Mode               | Throughput(Mpps) | % linerate |     Cycle      |
+==============+==================================+==================+============+================+
| 64           | packed_ring_inorder_nonmergeable | 18.905           | 31.761     | Before Restart |
+--------------+----------------------------------+------------------+------------+----------------+
| 64           | packed_ring_inorder_nonmergeable | 18.733           | 31.472     | After Restart  |
+--------------+----------------------------------+------------------+------------+----------------+
13/11/2020 17:07:11 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_inorder_nonmergeable_path Result PASSED:
13/11/2020 17:07:11             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:07:14 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_mergeable_path Begin
13/11/2020 17:07:14             dut.10.240.183.220:  
13/11/2020 17:07:14                         tester: 
13/11/2020 17:07:14             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:07:14             dut.10.240.183.220: 
13/11/2020 17:07:14             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:07:14             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:07:14             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:07:15             dut.10.240.183.220: 
13/11/2020 17:07:26             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:07:26             dut.10.240.183.220: 1048576
13/11/2020 17:07:26             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=0,queue_size=255  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2 --txd=255 --rxd=255
13/11/2020 17:07:26             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:07:36             dut.10.240.183.220: set fwd mac
13/11/2020 17:07:36             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:07:36             dut.10.240.183.220: start
13/11/2020 17:07:36             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:07:36 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_packed_ring_mergeable_path, and 64 frame size.
13/11/2020 17:07:36                         tester: ls -d /tmp
13/11/2020 17:07:37                         tester: /tmp
13/11/2020 17:07:37                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:07:39                         pktgen: test port 0 map gen port 0
13/11/2020 17:07:39                         pktgen: test port 0 map gen port 0
13/11/2020 17:07:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:07:39                         pktgen: trex port <0> not support flow control
13/11/2020 17:07:39                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:07:39                         pktgen: check the trex port link status
13/11/2020 17:07:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:07:39                         pktgen: begin traffic ......
13/11/2020 17:07:39                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:07:44                         pktgen: traffic completed. 
13/11/2020 17:07:44                         pktgen: check the trex port link status
13/11/2020 17:07:44                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:07:44                         pktgen: begin traffic ......
13/11/2020 17:07:44                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:07:54                         pktgen: begin get port statistic ...
13/11/2020 17:07:54                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:07:54                         pktgen: {0: {'ibytes': 11737358208,
     'ierrors': 0,
     'ipackets': 183396252,
     'obytes': 22736501056,
     'oerrors': 0,
     'opackets': 355257865,
     'rx_bps': 9400558592.0,
     'rx_bps_L1': 12338233472.0,
     'rx_pps': 18360468.0,
     'rx_util': 30.84558368,
     'tx_bps': 18152171520.0,
     'tx_bps_L1': 23824725120.0,
     'tx_pps': 35453460.0,
     'tx_util': 59.561812800000006},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.25044059753418,
            'cpu_util': 98.11517333984375,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9400558592.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8751612928.0,
            'rx_pps': 18360468.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18152171520.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35453460.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11737358208,
           'ierrors': 0,
           'ipackets': 183396252,
           'obytes': 22736501056,
           'oerrors': 0,
           'opackets': 355257865,
           'rx_bps': 9400558592.0,
           'rx_bps_L1': 12338233472.0,
           'rx_pps': 18360468.0,
           'rx_util': 30.84558368,
           'tx_bps': 18152171520.0,
           'tx_bps_L1': 23824725120.0,
           'tx_pps': 35453460.0,
           'tx_util': 59.561812800000006}}
13/11/2020 17:07:54                         pktgen: {'ibytes': 11737358208,
 'ierrors': 0,
 'ipackets': 183396252,
 'obytes': 22736501056,
 'oerrors': 0,
 'opackets': 355257865,
 'rx_bps': 9400558592.0,
 'rx_bps_L1': 12338233472.0,
 'rx_pps': 18360468.0,
 'rx_util': 30.84558368,
 'tx_bps': 18152171520.0,
 'tx_bps_L1': 23824725120.0,
 'tx_pps': 35453460.0,
 'tx_util': 59.561812800000006}
13/11/2020 17:07:54                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18152171520.000000, tx_pps: 35453460.000000 
13/11/2020 17:07:54                         pktgen: {'ibytes': 11737358208,
 'ierrors': 0,
 'ipackets': 183396252,
 'obytes': 22736501056,
 'oerrors': 0,
 'opackets': 355257865,
 'rx_bps': 9400558592.0,
 'rx_bps_L1': 12338233472.0,
 'rx_pps': 18360468.0,
 'rx_util': 30.84558368,
 'tx_bps': 18152171520.0,
 'tx_bps_L1': 23824725120.0,
 'tx_pps': 35453460.0,
 'tx_util': 59.561812800000006}
13/11/2020 17:07:54                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9400558592.000000, rx_pps: 18360468.000000
13/11/2020 17:07:54                         pktgen: throughput: pps_rx 18360468.000000, bps_rx 9400558592.000000
13/11/2020 17:07:54                         pktgen: traffic completed. 
13/11/2020 17:07:54             dut.10.240.183.220: stop
13/11/2020 17:07:54             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 137206256      TX-packets: 137206256      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 137401017      TX-packets: 137401017      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 274607273      RX-dropped: 0             RX-total: 274607273
  TX-packets: 274607273      TX-dropped: 0             TX-total: 274607273
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 274607273      RX-dropped: 0             RX-total: 274607273
  TX-packets: 274607273      TX-dropped: 0             TX-total: 274607273
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:07:54             dut.10.240.183.220: start
13/11/2020 17:07:54             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:12:24                         tester: ls -d /tmp
13/11/2020 17:12:24                         tester: /tmp
13/11/2020 17:12:24                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:12:26                         pktgen: test port 0 map gen port 0
13/11/2020 17:12:26                         pktgen: test port 0 map gen port 0
13/11/2020 17:12:26                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:12:26                         pktgen: trex port <0> not support flow control
13/11/2020 17:12:26                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:12:26                         pktgen: check the trex port link status
13/11/2020 17:12:26                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:12:26                         pktgen: begin traffic ......
13/11/2020 17:12:26                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:12:31                         pktgen: traffic completed. 
13/11/2020 17:12:31                         pktgen: check the trex port link status
13/11/2020 17:12:31                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:12:31                         pktgen: begin traffic ......
13/11/2020 17:12:31                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:12:41                         pktgen: begin get port statistic ...
13/11/2020 17:12:41                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:12:41                         pktgen: {0: {'ibytes': 11648516608,
     'ierrors': 0,
     'ipackets': 182008096,
     'obytes': 22793386880,
     'oerrors': 0,
     'opackets': 356146705,
     'rx_bps': 9310377984.0,
     'rx_bps_L1': 12219873024.0,
     'rx_pps': 18184344.0,
     'rx_util': 30.54968256,
     'tx_bps': 18107994112.0,
     'tx_bps_L1': 23766744192.0,
     'tx_pps': 35367188.0,
     'tx_util': 59.41686048},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.210906982421875,
            'cpu_util': 98.29647827148438,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9310377984.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8797616128.0,
            'rx_pps': 18184344.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18107994112.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35367188.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11648516608,
           'ierrors': 0,
           'ipackets': 182008096,
           'obytes': 22793386880,
           'oerrors': 0,
           'opackets': 356146705,
           'rx_bps': 9310377984.0,
           'rx_bps_L1': 12219873024.0,
           'rx_pps': 18184344.0,
           'rx_util': 30.54968256,
           'tx_bps': 18107994112.0,
           'tx_bps_L1': 23766744192.0,
           'tx_pps': 35367188.0,
           'tx_util': 59.41686048}}
13/11/2020 17:12:41                         pktgen: {'ibytes': 11648516608,
 'ierrors': 0,
 'ipackets': 182008096,
 'obytes': 22793386880,
 'oerrors': 0,
 'opackets': 356146705,
 'rx_bps': 9310377984.0,
 'rx_bps_L1': 12219873024.0,
 'rx_pps': 18184344.0,
 'rx_util': 30.54968256,
 'tx_bps': 18107994112.0,
 'tx_bps_L1': 23766744192.0,
 'tx_pps': 35367188.0,
 'tx_util': 59.41686048}
13/11/2020 17:12:41                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18107994112.000000, tx_pps: 35367188.000000 
13/11/2020 17:12:41                         pktgen: {'ibytes': 11648516608,
 'ierrors': 0,
 'ipackets': 182008096,
 'obytes': 22793386880,
 'oerrors': 0,
 'opackets': 356146705,
 'rx_bps': 9310377984.0,
 'rx_bps_L1': 12219873024.0,
 'rx_pps': 18184344.0,
 'rx_util': 30.54968256,
 'tx_bps': 18107994112.0,
 'tx_bps_L1': 23766744192.0,
 'tx_pps': 35367188.0,
 'tx_util': 59.41686048}
13/11/2020 17:12:41                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9310377984.000000, rx_pps: 18184344.000000
13/11/2020 17:12:41                         pktgen: throughput: pps_rx 18184344.000000, bps_rx 9310377984.000000
13/11/2020 17:12:41                         pktgen: traffic completed. 
13/11/2020 17:12:41             dut.10.240.183.220: stop
13/11/2020 17:12:41             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 136799277      TX-packets: 136799277      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 136422630      TX-packets: 136422630      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 273221907      RX-dropped: 0             RX-total: 273221907
  TX-packets: 273221907      TX-dropped: 0             TX-total: 273221907
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 273221907      RX-dropped: 0             RX-total: 273221907
  TX-packets: 273221907      TX-dropped: 0             TX-total: 273221907
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:12:41             dut.10.240.183.220: start
13/11/2020 17:12:41             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:12:42             dut.10.240.183.220: quit
13/11/2020 17:12:43             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:12:43 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+-----------------------+------------------+------------+----------------+
| FrameSize(B) |         Mode          | Throughput(Mpps) | % linerate |     Cycle      |
+==============+=======================+==================+============+================+
| 64           | packed_ring_mergeable | 18.360           | 30.846     | Before Restart |
+--------------+-----------------------+------------------+------------+----------------+
| 64           | packed_ring_mergeable | 18.184           | 30.550     | After Restart  |
+--------------+-----------------------+------------------+------------+----------------+
13/11/2020 17:12:43 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_mergeable_path Result PASSED:
13/11/2020 17:12:43             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:12:46 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_nonmergeable_path Begin
13/11/2020 17:12:46             dut.10.240.183.220:  
13/11/2020 17:12:46                         tester: 
13/11/2020 17:12:46             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:12:46             dut.10.240.183.220: 
13/11/2020 17:12:46             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:12:46             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:12:46             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:12:46             dut.10.240.183.220: 
13/11/2020 17:12:57             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:12:57             dut.10.240.183.220: 1048576
13/11/2020 17:12:57             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=0,queue_size=255  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2 --txd=255 --rxd=255
13/11/2020 17:12:58             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:13:08             dut.10.240.183.220: set fwd mac
13/11/2020 17:13:08             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:13:08             dut.10.240.183.220: start
13/11/2020 17:13:08             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:13:08 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_packed_ring_nonmergeable_path, and 64 frame size.
13/11/2020 17:13:08                         tester: ls -d /tmp
13/11/2020 17:13:08                         tester: /tmp
13/11/2020 17:13:08                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:13:10                         pktgen: test port 0 map gen port 0
13/11/2020 17:13:10                         pktgen: test port 0 map gen port 0
13/11/2020 17:13:10                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:10                         pktgen: trex port <0> not support flow control
13/11/2020 17:13:10                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:13:10                         pktgen: check the trex port link status
13/11/2020 17:13:10                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:10                         pktgen: begin traffic ......
13/11/2020 17:13:10                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:13:15                         pktgen: traffic completed. 
13/11/2020 17:13:15                         pktgen: check the trex port link status
13/11/2020 17:13:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:15                         pktgen: begin traffic ......
13/11/2020 17:13:15                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:13:25                         pktgen: begin get port statistic ...
13/11/2020 17:13:25                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:13:25                         pktgen: {0: {'ibytes': 11702239936,
     'ierrors': 0,
     'ipackets': 182847511,
     'obytes': 22780488704,
     'oerrors': 0,
     'opackets': 355945157,
     'rx_bps': 9380657152.0,
     'rx_bps_L1': 12312110592.0,
     'rx_pps': 18321584.0,
     'rx_util': 30.78027648,
     'tx_bps': 18160977920.0,
     'tx_bps_L1': 23836284160.0,
     'tx_pps': 35470664.0,
     'tx_util': 59.5907104},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.217772483825684,
            'cpu_util': 98.51066589355469,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9380657152.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8780321792.0,
            'rx_pps': 18321584.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18160977920.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35470664.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11702239936,
           'ierrors': 0,
           'ipackets': 182847511,
           'obytes': 22780488704,
           'oerrors': 0,
           'opackets': 355945157,
           'rx_bps': 9380657152.0,
           'rx_bps_L1': 12312110592.0,
           'rx_pps': 18321584.0,
           'rx_util': 30.78027648,
           'tx_bps': 18160977920.0,
           'tx_bps_L1': 23836284160.0,
           'tx_pps': 35470664.0,
           'tx_util': 59.5907104}}
13/11/2020 17:13:25                         pktgen: {'ibytes': 11702239936,
 'ierrors': 0,
 'ipackets': 182847511,
 'obytes': 22780488704,
 'oerrors': 0,
 'opackets': 355945157,
 'rx_bps': 9380657152.0,
 'rx_bps_L1': 12312110592.0,
 'rx_pps': 18321584.0,
 'rx_util': 30.78027648,
 'tx_bps': 18160977920.0,
 'tx_bps_L1': 23836284160.0,
 'tx_pps': 35470664.0,
 'tx_util': 59.5907104}
13/11/2020 17:13:25                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18160977920.000000, tx_pps: 35470664.000000 
13/11/2020 17:13:25                         pktgen: {'ibytes': 11702239936,
 'ierrors': 0,
 'ipackets': 182847511,
 'obytes': 22780488704,
 'oerrors': 0,
 'opackets': 355945157,
 'rx_bps': 9380657152.0,
 'rx_bps_L1': 12312110592.0,
 'rx_pps': 18321584.0,
 'rx_util': 30.78027648,
 'tx_bps': 18160977920.0,
 'tx_bps_L1': 23836284160.0,
 'tx_pps': 35470664.0,
 'tx_util': 59.5907104}
13/11/2020 17:13:25                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9380657152.000000, rx_pps: 18321584.000000
13/11/2020 17:13:25                         pktgen: throughput: pps_rx 18321584.000000, bps_rx 9380657152.000000
13/11/2020 17:13:25                         pktgen: traffic completed. 
13/11/2020 17:13:25             dut.10.240.183.220: stop
13/11/2020 17:13:25             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 137146819      TX-packets: 137146819      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 136946673      TX-packets: 136946673      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 274093492      RX-dropped: 0             RX-total: 274093492
  TX-packets: 274093492      TX-dropped: 0             TX-total: 274093492
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 274093492      RX-dropped: 0             RX-total: 274093492
  TX-packets: 274093492      TX-dropped: 0             TX-total: 274093492
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:13:25             dut.10.240.183.220: start
13/11/2020 17:13:25             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:13:28                         tester: ls -d /tmp
13/11/2020 17:13:28                         tester: /tmp
13/11/2020 17:13:28                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:13:30                         pktgen: test port 0 map gen port 0
13/11/2020 17:13:30                         pktgen: test port 0 map gen port 0
13/11/2020 17:13:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:30                         pktgen: trex port <0> not support flow control
13/11/2020 17:13:30                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:13:30                         pktgen: check the trex port link status
13/11/2020 17:13:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:30                         pktgen: begin traffic ......
13/11/2020 17:13:30                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:13:35                         pktgen: traffic completed. 
13/11/2020 17:13:35                         pktgen: check the trex port link status
13/11/2020 17:13:35                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:13:35                         pktgen: begin traffic ......
13/11/2020 17:13:35                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:13:45                         pktgen: begin get port statistic ...
13/11/2020 17:13:45                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:13:45                         pktgen: {0: {'ibytes': 11665365696,
     'ierrors': 0,
     'ipackets': 182271353,
     'obytes': 22803556864,
     'oerrors': 0,
     'opackets': 356305603,
     'rx_bps': 9339260928.0,
     'rx_bps_L1': 12257780608.0,
     'rx_pps': 18240748.0,
     'rx_util': 30.64445152,
     'tx_bps': 18149179392.0,
     'tx_bps_L1': 23820799231.999996,
     'tx_pps': 35447624.0,
     'tx_util': 59.55199807999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.2019681930542,
            'cpu_util': 98.6157455444336,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9339260928.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8809918464.0,
            'rx_pps': 18240748.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18149179392.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35447624.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11665365696,
           'ierrors': 0,
           'ipackets': 182271353,
           'obytes': 22803556864,
           'oerrors': 0,
           'opackets': 356305603,
           'rx_bps': 9339260928.0,
           'rx_bps_L1': 12257780608.0,
           'rx_pps': 18240748.0,
           'rx_util': 30.64445152,
           'tx_bps': 18149179392.0,
           'tx_bps_L1': 23820799231.999996,
           'tx_pps': 35447624.0,
           'tx_util': 59.55199807999999}}
13/11/2020 17:13:45                         pktgen: {'ibytes': 11665365696,
 'ierrors': 0,
 'ipackets': 182271353,
 'obytes': 22803556864,
 'oerrors': 0,
 'opackets': 356305603,
 'rx_bps': 9339260928.0,
 'rx_bps_L1': 12257780608.0,
 'rx_pps': 18240748.0,
 'rx_util': 30.64445152,
 'tx_bps': 18149179392.0,
 'tx_bps_L1': 23820799231.999996,
 'tx_pps': 35447624.0,
 'tx_util': 59.55199807999999}
13/11/2020 17:13:45                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18149179392.000000, tx_pps: 35447624.000000 
13/11/2020 17:13:45                         pktgen: {'ibytes': 11665365696,
 'ierrors': 0,
 'ipackets': 182271353,
 'obytes': 22803556864,
 'oerrors': 0,
 'opackets': 356305603,
 'rx_bps': 9339260928.0,
 'rx_bps_L1': 12257780608.0,
 'rx_pps': 18240748.0,
 'rx_util': 30.64445152,
 'tx_bps': 18149179392.0,
 'tx_bps_L1': 23820799231.999996,
 'tx_pps': 35447624.0,
 'tx_util': 59.55199807999999}
13/11/2020 17:13:45                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9339260928.000000, rx_pps: 18240748.000000
13/11/2020 17:13:45                         pktgen: throughput: pps_rx 18240748.000000, bps_rx 9339260928.000000
13/11/2020 17:13:45                         pktgen: traffic completed. 
13/11/2020 17:13:45             dut.10.240.183.220: stop
13/11/2020 17:13:45             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 136829836      TX-packets: 136829836      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 136227820      TX-packets: 136227820      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 273057656      RX-dropped: 0             RX-total: 273057656
  TX-packets: 273057656      TX-dropped: 0             TX-total: 273057656
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 273057656      RX-dropped: 0             RX-total: 273057656
  TX-packets: 273057656      TX-dropped: 0             TX-total: 273057656
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:13:45             dut.10.240.183.220: start
13/11/2020 17:13:45             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:13:46             dut.10.240.183.220: quit
13/11/2020 17:13:47             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:13:47 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+--------------------------+------------------+------------+----------------+
| FrameSize(B) |           Mode           | Throughput(Mpps) | % linerate |     Cycle      |
+==============+==========================+==================+============+================+
| 64           | packed_ring_nonmergeable | 18.322           | 30.780     | Before Restart |
+--------------+--------------------------+------------------+------------+----------------+
| 64           | packed_ring_nonmergeable | 18.241           | 30.644     | After Restart  |
+--------------+--------------------------+------------------+------------+----------------+
13/11/2020 17:13:47 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_nonmergeable_path Result PASSED:
13/11/2020 17:13:47             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:13:50 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_vectorized_path Begin
13/11/2020 17:13:50             dut.10.240.183.220:  
13/11/2020 17:13:50                         tester: 
13/11/2020 17:13:50             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:13:50             dut.10.240.183.220: 
13/11/2020 17:13:50             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:13:50             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:13:50             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:13:50             dut.10.240.183.220: 
13/11/2020 17:14:01             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:14:02             dut.10.240.183.220: 1048576
13/11/2020 17:14:02             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1,queue_size=255 --force-max-simd-bitwidth=512  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2 --txd=255 --rxd=255
13/11/2020 17:14:02             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:14:12             dut.10.240.183.220: set fwd mac
13/11/2020 17:14:12             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:14:12             dut.10.240.183.220: start
13/11/2020 17:14:12             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:14:12 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_packed_ring_vectorized_path, and 64 frame size.
13/11/2020 17:14:12                         tester: ls -d /tmp
13/11/2020 17:14:13                         tester: /tmp
13/11/2020 17:14:13                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:14:14                         pktgen: test port 0 map gen port 0
13/11/2020 17:14:14                         pktgen: test port 0 map gen port 0
13/11/2020 17:14:14                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:14                         pktgen: trex port <0> not support flow control
13/11/2020 17:14:14                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:14:14                         pktgen: check the trex port link status
13/11/2020 17:14:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:15                         pktgen: begin traffic ......
13/11/2020 17:14:15                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:14:20                         pktgen: traffic completed. 
13/11/2020 17:14:20                         pktgen: check the trex port link status
13/11/2020 17:14:20                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:20                         pktgen: begin traffic ......
13/11/2020 17:14:20                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:14:30                         pktgen: begin get port statistic ...
13/11/2020 17:14:30                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:14:30                         pktgen: {0: {'ibytes': 12035195072,
     'ierrors': 0,
     'ipackets': 188049947,
     'obytes': 22776824320,
     'oerrors': 0,
     'opackets': 355887914,
     'rx_bps': 9632979968.0,
     'rx_bps_L1': 12643285248.0,
     'rx_pps': 18814408.0,
     'rx_util': 31.608213120000002,
     'tx_bps': 18155614208.0,
     'tx_bps_L1': 23829243008.0,
     'tx_pps': 35460180.0,
     'tx_util': 59.57310752},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.226311683654785,
            'cpu_util': 98.39042663574219,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9632979968.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8522632704.0,
            'rx_pps': 18814408.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18155614208.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35460180.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12035195072,
           'ierrors': 0,
           'ipackets': 188049947,
           'obytes': 22776824320,
           'oerrors': 0,
           'opackets': 355887914,
           'rx_bps': 9632979968.0,
           'rx_bps_L1': 12643285248.0,
           'rx_pps': 18814408.0,
           'rx_util': 31.608213120000002,
           'tx_bps': 18155614208.0,
           'tx_bps_L1': 23829243008.0,
           'tx_pps': 35460180.0,
           'tx_util': 59.57310752}}
13/11/2020 17:14:30                         pktgen: {'ibytes': 12035195072,
 'ierrors': 0,
 'ipackets': 188049947,
 'obytes': 22776824320,
 'oerrors': 0,
 'opackets': 355887914,
 'rx_bps': 9632979968.0,
 'rx_bps_L1': 12643285248.0,
 'rx_pps': 18814408.0,
 'rx_util': 31.608213120000002,
 'tx_bps': 18155614208.0,
 'tx_bps_L1': 23829243008.0,
 'tx_pps': 35460180.0,
 'tx_util': 59.57310752}
13/11/2020 17:14:30                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18155614208.000000, tx_pps: 35460180.000000 
13/11/2020 17:14:30                         pktgen: {'ibytes': 12035195072,
 'ierrors': 0,
 'ipackets': 188049947,
 'obytes': 22776824320,
 'oerrors': 0,
 'opackets': 355887914,
 'rx_bps': 9632979968.0,
 'rx_bps_L1': 12643285248.0,
 'rx_pps': 18814408.0,
 'rx_util': 31.608213120000002,
 'tx_bps': 18155614208.0,
 'tx_bps_L1': 23829243008.0,
 'tx_pps': 35460180.0,
 'tx_util': 59.57310752}
13/11/2020 17:14:30                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9632979968.000000, rx_pps: 18814408.000000
13/11/2020 17:14:30                         pktgen: throughput: pps_rx 18814408.000000, bps_rx 9632979968.000000
13/11/2020 17:14:30                         pktgen: traffic completed. 
13/11/2020 17:14:30             dut.10.240.183.220: stop
13/11/2020 17:14:30             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 141684364      TX-packets: 141684364      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 140492091      TX-packets: 140492091      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 282176455      RX-dropped: 0             RX-total: 282176455
  TX-packets: 282176455      TX-dropped: 0             TX-total: 282176455
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 282176455      RX-dropped: 0             RX-total: 282176455
  TX-packets: 282176455      TX-dropped: 0             TX-total: 282176455
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:14:30             dut.10.240.183.220: start
13/11/2020 17:14:30             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:14:32                         tester: ls -d /tmp
13/11/2020 17:14:33                         tester: /tmp
13/11/2020 17:14:33                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:14:34                         pktgen: test port 0 map gen port 0
13/11/2020 17:14:34                         pktgen: test port 0 map gen port 0
13/11/2020 17:14:35                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:35                         pktgen: trex port <0> not support flow control
13/11/2020 17:14:35                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:14:35                         pktgen: check the trex port link status
13/11/2020 17:14:35                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:35                         pktgen: begin traffic ......
13/11/2020 17:14:35                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:14:40                         pktgen: traffic completed. 
13/11/2020 17:14:40                         pktgen: check the trex port link status
13/11/2020 17:14:40                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:14:40                         pktgen: begin traffic ......
13/11/2020 17:14:40                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:14:50                         pktgen: begin get port statistic ...
13/11/2020 17:14:50                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:14:50                         pktgen: {0: {'ibytes': 12118455488,
     'ierrors': 0,
     'ipackets': 189350870,
     'obytes': 22691357312,
     'oerrors': 0,
     'opackets': 354552497,
     'rx_bps': 9715304448.0,
     'rx_bps_L1': 12751335808.0,
     'rx_pps': 18975196.0,
     'rx_util': 31.878339519999997,
     'tx_bps': 18181023744.0,
     'tx_bps_L1': 23862593664.0,
     'tx_pps': 35509812.0,
     'tx_util': 59.65648416},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.195822715759277,
            'cpu_util': 98.85479736328125,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 9715304448.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8465718784.0,
            'rx_pps': 18975196.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18181023744.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35509812.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12118455488,
           'ierrors': 0,
           'ipackets': 189350870,
           'obytes': 22691357312,
           'oerrors': 0,
           'opackets': 354552497,
           'rx_bps': 9715304448.0,
           'rx_bps_L1': 12751335808.0,
           'rx_pps': 18975196.0,
           'rx_util': 31.878339519999997,
           'tx_bps': 18181023744.0,
           'tx_bps_L1': 23862593664.0,
           'tx_pps': 35509812.0,
           'tx_util': 59.65648416}}
13/11/2020 17:14:50                         pktgen: {'ibytes': 12118455488,
 'ierrors': 0,
 'ipackets': 189350870,
 'obytes': 22691357312,
 'oerrors': 0,
 'opackets': 354552497,
 'rx_bps': 9715304448.0,
 'rx_bps_L1': 12751335808.0,
 'rx_pps': 18975196.0,
 'rx_util': 31.878339519999997,
 'tx_bps': 18181023744.0,
 'tx_bps_L1': 23862593664.0,
 'tx_pps': 35509812.0,
 'tx_util': 59.65648416}
13/11/2020 17:14:50                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18181023744.000000, tx_pps: 35509812.000000 
13/11/2020 17:14:50                         pktgen: {'ibytes': 12118455488,
 'ierrors': 0,
 'ipackets': 189350870,
 'obytes': 22691357312,
 'oerrors': 0,
 'opackets': 354552497,
 'rx_bps': 9715304448.0,
 'rx_bps_L1': 12751335808.0,
 'rx_pps': 18975196.0,
 'rx_util': 31.878339519999997,
 'tx_bps': 18181023744.0,
 'tx_bps_L1': 23862593664.0,
 'tx_pps': 35509812.0,
 'tx_util': 59.65648416}
13/11/2020 17:14:50                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9715304448.000000, rx_pps: 18975196.000000
13/11/2020 17:14:50                         pktgen: throughput: pps_rx 18975196.000000, bps_rx 9715304448.000000
13/11/2020 17:14:50                         pktgen: traffic completed. 
13/11/2020 17:14:50             dut.10.240.183.220: stop
13/11/2020 17:14:50             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 142035128      TX-packets: 142035128      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 141544698      TX-packets: 141544698      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 283579826      RX-dropped: 0             RX-total: 283579826
  TX-packets: 283579826      TX-dropped: 0             TX-total: 283579826
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 283579826      RX-dropped: 0             RX-total: 283579826
  TX-packets: 283579826      TX-dropped: 0             TX-total: 283579826
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:14:50             dut.10.240.183.220: start
13/11/2020 17:14:50             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=255 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=255 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:14:51             dut.10.240.183.220: quit
13/11/2020 17:14:51             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:14:51 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+-----------------------------+------------------+------------+----------------+
| FrameSize(B) |            Mode             | Throughput(Mpps) | % linerate |     Cycle      |
+==============+=============================+==================+============+================+
| 64           | packed_ring_vectorized_path | 18.814           | 31.608     | Before Restart |
+--------------+-----------------------------+------------------+------------+----------------+
| 64           | packed_ring_vectorized_path | 18.975           | 31.878     | After Restart  |
+--------------+-----------------------------+------------------+------------+----------------+
13/11/2020 17:14:51 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_packed_ring_vectorized_path Result PASSED:
13/11/2020 17:14:51             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:14:54 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_inorder_mergeable_path Begin
13/11/2020 17:14:54             dut.10.240.183.220:  
13/11/2020 17:14:54                         tester: 
13/11/2020 17:14:54             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:14:55             dut.10.240.183.220: 
13/11/2020 17:14:55             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:14:55             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:14:55             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:14:55             dut.10.240.183.220: 
13/11/2020 17:15:06             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:15:06             dut.10.240.183.220: 1048576
13/11/2020 17:15:06             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=1,mrg_rxbuf=1  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
13/11/2020 17:15:07             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:15:17             dut.10.240.183.220: set fwd mac
13/11/2020 17:15:17             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:15:17             dut.10.240.183.220: start
13/11/2020 17:15:17             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:15:17 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_split_ring_inorder_mergeable_path, and 64 frame size.
13/11/2020 17:15:17                         tester: ls -d /tmp
13/11/2020 17:15:17                         tester: /tmp
13/11/2020 17:15:17                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:15:19                         pktgen: test port 0 map gen port 0
13/11/2020 17:15:19                         pktgen: test port 0 map gen port 0
13/11/2020 17:15:19                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:19                         pktgen: trex port <0> not support flow control
13/11/2020 17:15:19                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:15:19                         pktgen: check the trex port link status
13/11/2020 17:15:19                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:19                         pktgen: begin traffic ......
13/11/2020 17:15:19                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:15:24                         pktgen: traffic completed. 
13/11/2020 17:15:24                         pktgen: check the trex port link status
13/11/2020 17:15:24                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:24                         pktgen: begin traffic ......
13/11/2020 17:15:24                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:15:34                         pktgen: begin get port statistic ...
13/11/2020 17:15:34                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:15:34                         pktgen: {0: {'ibytes': 10592091776,
     'ierrors': 0,
     'ipackets': 165501434,
     'obytes': 22318679744,
     'oerrors': 0,
     'opackets': 348729411,
     'rx_bps': 8482191360.0,
     'rx_bps_L1': 11132875040.0,
     'rx_pps': 16566773.0,
     'rx_util': 27.8321876,
     'tx_bps': 17866659840.0,
     'tx_bps_L1': 23449991040.0,
     'tx_pps': 34895820.0,
     'tx_util': 58.624977599999994},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.090579986572266,
            'cpu_util': 98.27018737792969,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8482191360.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9384468480.0,
            'rx_pps': 16566773.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17866659840.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 34895820.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10592091776,
           'ierrors': 0,
           'ipackets': 165501434,
           'obytes': 22318679744,
           'oerrors': 0,
           'opackets': 348729411,
           'rx_bps': 8482191360.0,
           'rx_bps_L1': 11132875040.0,
           'rx_pps': 16566773.0,
           'rx_util': 27.8321876,
           'tx_bps': 17866659840.0,
           'tx_bps_L1': 23449991040.0,
           'tx_pps': 34895820.0,
           'tx_util': 58.624977599999994}}
13/11/2020 17:15:34                         pktgen: {'ibytes': 10592091776,
 'ierrors': 0,
 'ipackets': 165501434,
 'obytes': 22318679744,
 'oerrors': 0,
 'opackets': 348729411,
 'rx_bps': 8482191360.0,
 'rx_bps_L1': 11132875040.0,
 'rx_pps': 16566773.0,
 'rx_util': 27.8321876,
 'tx_bps': 17866659840.0,
 'tx_bps_L1': 23449991040.0,
 'tx_pps': 34895820.0,
 'tx_util': 58.624977599999994}
13/11/2020 17:15:34                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17866659840.000000, tx_pps: 34895820.000000 
13/11/2020 17:15:34                         pktgen: {'ibytes': 10592091776,
 'ierrors': 0,
 'ipackets': 165501434,
 'obytes': 22318679744,
 'oerrors': 0,
 'opackets': 348729411,
 'rx_bps': 8482191360.0,
 'rx_bps_L1': 11132875040.0,
 'rx_pps': 16566773.0,
 'rx_util': 27.8321876,
 'tx_bps': 17866659840.0,
 'tx_bps_L1': 23449991040.0,
 'tx_pps': 34895820.0,
 'tx_util': 58.624977599999994}
13/11/2020 17:15:34                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8482191360.000000, rx_pps: 16566773.000000
13/11/2020 17:15:34                         pktgen: throughput: pps_rx 16566773.000000, bps_rx 8482191360.000000
13/11/2020 17:15:34                         pktgen: traffic completed. 
13/11/2020 17:15:34             dut.10.240.183.220: stop
13/11/2020 17:15:34             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 124068712      TX-packets: 124068712      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 124255380      TX-packets: 124255380      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 248324092      RX-dropped: 0             RX-total: 248324092
  TX-packets: 248324092      TX-dropped: 0             TX-total: 248324092
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 248324092      RX-dropped: 0             RX-total: 248324092
  TX-packets: 248324092      TX-dropped: 0             TX-total: 248324092
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:15:34             dut.10.240.183.220: start
13/11/2020 17:15:34             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:15:37                         tester: ls -d /tmp
13/11/2020 17:15:37                         tester: /tmp
13/11/2020 17:15:37                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:15:39                         pktgen: test port 0 map gen port 0
13/11/2020 17:15:39                         pktgen: test port 0 map gen port 0
13/11/2020 17:15:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:39                         pktgen: trex port <0> not support flow control
13/11/2020 17:15:39                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:15:39                         pktgen: check the trex port link status
13/11/2020 17:15:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:39                         pktgen: begin traffic ......
13/11/2020 17:15:39                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:15:44                         pktgen: traffic completed. 
13/11/2020 17:15:44                         pktgen: check the trex port link status
13/11/2020 17:15:44                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:15:44                         pktgen: begin traffic ......
13/11/2020 17:15:44                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:15:54                         pktgen: begin get port statistic ...
13/11/2020 17:15:54                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:15:54                         pktgen: {0: {'ibytes': 10542145216,
     'ierrors': 0,
     'ipackets': 164721028,
     'obytes': 22651347392,
     'oerrors': 0,
     'opackets': 353927335,
     'rx_bps': 8404089856.0,
     'rx_bps_L1': 11030366336.0,
     'rx_pps': 16414228.0,
     'rx_util': 27.575915839999997,
     'tx_bps': 18051919872.0,
     'tx_bps_L1': 23693144832.0,
     'tx_pps': 35257656.0,
     'tx_util': 59.232862080000004},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.140172004699707,
            'cpu_util': 98.75043487548828,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8404089856.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9647830016.0,
            'rx_pps': 16414228.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18051919872.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35257656.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10542145216,
           'ierrors': 0,
           'ipackets': 164721028,
           'obytes': 22651347392,
           'oerrors': 0,
           'opackets': 353927335,
           'rx_bps': 8404089856.0,
           'rx_bps_L1': 11030366336.0,
           'rx_pps': 16414228.0,
           'rx_util': 27.575915839999997,
           'tx_bps': 18051919872.0,
           'tx_bps_L1': 23693144832.0,
           'tx_pps': 35257656.0,
           'tx_util': 59.232862080000004}}
13/11/2020 17:15:54                         pktgen: {'ibytes': 10542145216,
 'ierrors': 0,
 'ipackets': 164721028,
 'obytes': 22651347392,
 'oerrors': 0,
 'opackets': 353927335,
 'rx_bps': 8404089856.0,
 'rx_bps_L1': 11030366336.0,
 'rx_pps': 16414228.0,
 'rx_util': 27.575915839999997,
 'tx_bps': 18051919872.0,
 'tx_bps_L1': 23693144832.0,
 'tx_pps': 35257656.0,
 'tx_util': 59.232862080000004}
13/11/2020 17:15:54                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18051919872.000000, tx_pps: 35257656.000000 
13/11/2020 17:15:54                         pktgen: {'ibytes': 10542145216,
 'ierrors': 0,
 'ipackets': 164721028,
 'obytes': 22651347392,
 'oerrors': 0,
 'opackets': 353927335,
 'rx_bps': 8404089856.0,
 'rx_bps_L1': 11030366336.0,
 'rx_pps': 16414228.0,
 'rx_util': 27.575915839999997,
 'tx_bps': 18051919872.0,
 'tx_bps_L1': 23693144832.0,
 'tx_pps': 35257656.0,
 'tx_util': 59.232862080000004}
13/11/2020 17:15:54                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8404089856.000000, rx_pps: 16414228.000000
13/11/2020 17:15:54                         pktgen: throughput: pps_rx 16414228.000000, bps_rx 8404089856.000000
13/11/2020 17:15:54                         pktgen: traffic completed. 
13/11/2020 17:15:54             dut.10.240.183.220: stop
13/11/2020 17:15:54             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 123658267      TX-packets: 123658267      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 123646752      TX-packets: 123646752      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 247305019      RX-dropped: 0             RX-total: 247305019
  TX-packets: 247305019      TX-dropped: 0             TX-total: 247305019
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 247305019      RX-dropped: 0             RX-total: 247305019
  TX-packets: 247305019      TX-dropped: 0             TX-total: 247305019
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:15:54             dut.10.240.183.220: start
13/11/2020 17:15:54             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:15:55             dut.10.240.183.220: quit
13/11/2020 17:15:56             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:15:56 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+------------------------------+------------------+------------+----------------+
| FrameSize(B) |             Mode             | Throughput(Mpps) | % linerate |     Cycle      |
+==============+==============================+==================+============+================+
| 64           | split_ring_inorder_mergeable | 16.567           | 27.832     | Before Restart |
+--------------+------------------------------+------------------+------------+----------------+
| 64           | split_ring_inorder_mergeable | 16.414           | 27.576     | After Restart  |
+--------------+------------------------------+------------------+------------+----------------+
13/11/2020 17:15:56 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_inorder_mergeable_path Result PASSED:
13/11/2020 17:15:56             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:15:59 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_inorder_nonmergeable_path Begin
13/11/2020 17:15:59             dut.10.240.183.220:  
13/11/2020 17:15:59                         tester: 
13/11/2020 17:15:59             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:15:59             dut.10.240.183.220: 
13/11/2020 17:15:59             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:15:59             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:15:59             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:15:59             dut.10.240.183.220: 
13/11/2020 17:16:10             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:16:10             dut.10.240.183.220: 1048576
13/11/2020 17:16:10             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=1,mrg_rxbuf=0,vectorized=1  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
13/11/2020 17:16:11             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:16:21             dut.10.240.183.220: set fwd mac
13/11/2020 17:16:21             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:16:21             dut.10.240.183.220: start
13/11/2020 17:16:21             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:16:21 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_split_ring_inorder_nonmergeable_path, and 64 frame size.
13/11/2020 17:16:21                         tester: ls -d /tmp
13/11/2020 17:16:21                         tester: /tmp
13/11/2020 17:16:21                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:16:23                         pktgen: test port 0 map gen port 0
13/11/2020 17:16:23                         pktgen: test port 0 map gen port 0
13/11/2020 17:16:23                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:23                         pktgen: trex port <0> not support flow control
13/11/2020 17:16:23                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:16:23                         pktgen: check the trex port link status
13/11/2020 17:16:23                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:23                         pktgen: begin traffic ......
13/11/2020 17:16:23                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:16:28                         pktgen: traffic completed. 
13/11/2020 17:16:28                         pktgen: check the trex port link status
13/11/2020 17:16:28                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:28                         pktgen: begin traffic ......
13/11/2020 17:16:28                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:16:38                         pktgen: begin get port statistic ...
13/11/2020 17:16:38                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:16:38                         pktgen: {0: {'ibytes': 10538132288,
     'ierrors': 0,
     'ipackets': 164658317,
     'obytes': 22655643712,
     'oerrors': 0,
     'opackets': 353994459,
     'rx_bps': 8404670976.0,
     'rx_bps_L1': 11031129856.0,
     'rx_pps': 16415368.0,
     'rx_util': 27.57782464,
     'tx_bps': 18052284416.0,
     'tx_bps_L1': 23693623296.0,
     'tx_pps': 35258368.0,
     'tx_util': 59.234058239999996},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.200095176696777,
            'cpu_util': 98.1092300415039,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8404670976.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9647613952.0,
            'rx_pps': 16415368.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18052284416.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35258368.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10538132288,
           'ierrors': 0,
           'ipackets': 164658317,
           'obytes': 22655643712,
           'oerrors': 0,
           'opackets': 353994459,
           'rx_bps': 8404670976.0,
           'rx_bps_L1': 11031129856.0,
           'rx_pps': 16415368.0,
           'rx_util': 27.57782464,
           'tx_bps': 18052284416.0,
           'tx_bps_L1': 23693623296.0,
           'tx_pps': 35258368.0,
           'tx_util': 59.234058239999996}}
13/11/2020 17:16:38                         pktgen: {'ibytes': 10538132288,
 'ierrors': 0,
 'ipackets': 164658317,
 'obytes': 22655643712,
 'oerrors': 0,
 'opackets': 353994459,
 'rx_bps': 8404670976.0,
 'rx_bps_L1': 11031129856.0,
 'rx_pps': 16415368.0,
 'rx_util': 27.57782464,
 'tx_bps': 18052284416.0,
 'tx_bps_L1': 23693623296.0,
 'tx_pps': 35258368.0,
 'tx_util': 59.234058239999996}
13/11/2020 17:16:38                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18052284416.000000, tx_pps: 35258368.000000 
13/11/2020 17:16:38                         pktgen: {'ibytes': 10538132288,
 'ierrors': 0,
 'ipackets': 164658317,
 'obytes': 22655643712,
 'oerrors': 0,
 'opackets': 353994459,
 'rx_bps': 8404670976.0,
 'rx_bps_L1': 11031129856.0,
 'rx_pps': 16415368.0,
 'rx_util': 27.57782464,
 'tx_bps': 18052284416.0,
 'tx_bps_L1': 23693623296.0,
 'tx_pps': 35258368.0,
 'tx_util': 59.234058239999996}
13/11/2020 17:16:38                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8404670976.000000, rx_pps: 16415368.000000
13/11/2020 17:16:38                         pktgen: throughput: pps_rx 16415368.000000, bps_rx 8404670976.000000
13/11/2020 17:16:38                         pktgen: traffic completed. 
13/11/2020 17:16:38             dut.10.240.183.220: stop
13/11/2020 17:16:38             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 123590298      TX-packets: 123590298      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 123490136      TX-packets: 123490136      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 247080434      RX-dropped: 0             RX-total: 247080434
  TX-packets: 247080434      TX-dropped: 0             TX-total: 247080434
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 247080434      RX-dropped: 0             RX-total: 247080434
  TX-packets: 247080434      TX-dropped: 0             TX-total: 247080434
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:16:38             dut.10.240.183.220: start
13/11/2020 17:16:38             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:16:41                         tester: ls -d /tmp
13/11/2020 17:16:41                         tester: /tmp
13/11/2020 17:16:41                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:16:43                         pktgen: test port 0 map gen port 0
13/11/2020 17:16:43                         pktgen: test port 0 map gen port 0
13/11/2020 17:16:43                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:43                         pktgen: trex port <0> not support flow control
13/11/2020 17:16:43                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:16:43                         pktgen: check the trex port link status
13/11/2020 17:16:43                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:43                         pktgen: begin traffic ......
13/11/2020 17:16:43                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:16:48                         pktgen: traffic completed. 
13/11/2020 17:16:48                         pktgen: check the trex port link status
13/11/2020 17:16:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:16:48                         pktgen: begin traffic ......
13/11/2020 17:16:48                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:16:58                         pktgen: begin get port statistic ...
13/11/2020 17:16:58                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:16:58                         pktgen: {0: {'ibytes': 10495609472,
     'ierrors': 0,
     'ipackets': 163993918,
     'obytes': 22708974208,
     'oerrors': 0,
     'opackets': 354827755,
     'rx_bps': 8407537152.0,
     'rx_bps_L1': 11034892992.000002,
     'rx_pps': 16420974.0,
     'rx_util': 27.587232480000008,
     'tx_bps': 18172688384.0,
     'tx_bps_L1': 23851652864.0,
     'tx_pps': 35493528.0,
     'tx_util': 59.62913216},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.209113121032715,
            'cpu_util': 98.66687774658203,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8407537152.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9765150720.0,
            'rx_pps': 16420974.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18172688384.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35493528.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10495609472,
           'ierrors': 0,
           'ipackets': 163993918,
           'obytes': 22708974208,
           'oerrors': 0,
           'opackets': 354827755,
           'rx_bps': 8407537152.0,
           'rx_bps_L1': 11034892992.000002,
           'rx_pps': 16420974.0,
           'rx_util': 27.587232480000008,
           'tx_bps': 18172688384.0,
           'tx_bps_L1': 23851652864.0,
           'tx_pps': 35493528.0,
           'tx_util': 59.62913216}}
13/11/2020 17:16:58                         pktgen: {'ibytes': 10495609472,
 'ierrors': 0,
 'ipackets': 163993918,
 'obytes': 22708974208,
 'oerrors': 0,
 'opackets': 354827755,
 'rx_bps': 8407537152.0,
 'rx_bps_L1': 11034892992.000002,
 'rx_pps': 16420974.0,
 'rx_util': 27.587232480000008,
 'tx_bps': 18172688384.0,
 'tx_bps_L1': 23851652864.0,
 'tx_pps': 35493528.0,
 'tx_util': 59.62913216}
13/11/2020 17:16:58                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18172688384.000000, tx_pps: 35493528.000000 
13/11/2020 17:16:58                         pktgen: {'ibytes': 10495609472,
 'ierrors': 0,
 'ipackets': 163993918,
 'obytes': 22708974208,
 'oerrors': 0,
 'opackets': 354827755,
 'rx_bps': 8407537152.0,
 'rx_bps_L1': 11034892992.000002,
 'rx_pps': 16420974.0,
 'rx_util': 27.587232480000008,
 'tx_bps': 18172688384.0,
 'tx_bps_L1': 23851652864.0,
 'tx_pps': 35493528.0,
 'tx_util': 59.62913216}
13/11/2020 17:16:58                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8407537152.000000, rx_pps: 16420974.000000
13/11/2020 17:16:58                         pktgen: throughput: pps_rx 16420974.000000, bps_rx 8407537152.000000
13/11/2020 17:16:58                         pktgen: traffic completed. 
13/11/2020 17:16:58             dut.10.240.183.220: stop
13/11/2020 17:16:58             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 122918213      TX-packets: 122918213      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 123077483      TX-packets: 123077483      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 245995696      RX-dropped: 0             RX-total: 245995696
  TX-packets: 245995696      TX-dropped: 0             TX-total: 245995696
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 245995696      RX-dropped: 0             RX-total: 245995696
  TX-packets: 245995696      TX-dropped: 0             TX-total: 245995696
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:16:58             dut.10.240.183.220: start
13/11/2020 17:16:58             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:16:59             dut.10.240.183.220: quit
13/11/2020 17:17:00             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:17:00 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+---------------------------------+------------------+------------+----------------+
| FrameSize(B) |              Mode               | Throughput(Mpps) | % linerate |     Cycle      |
+==============+=================================+==================+============+================+
| 64           | split_ring_inorder_nonmergeable | 16.415           | 27.578     | Before Restart |
+--------------+---------------------------------+------------------+------------+----------------+
| 64           | split_ring_inorder_nonmergeable | 16.421           | 27.587     | After Restart  |
+--------------+---------------------------------+------------------+------------+----------------+
13/11/2020 17:17:00 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_inorder_nonmergeable_path Result PASSED:
13/11/2020 17:17:00             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:17:03 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_mergeable_path Begin
13/11/2020 17:17:03             dut.10.240.183.220:  
13/11/2020 17:17:03                         tester: 
13/11/2020 17:17:03             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:17:03             dut.10.240.183.220: 
13/11/2020 17:17:03             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:17:03             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:17:03             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:17:03             dut.10.240.183.220: 
13/11/2020 17:17:14             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:17:15             dut.10.240.183.220: 1048576
13/11/2020 17:17:15             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=0,mrg_rxbuf=1  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
13/11/2020 17:17:15             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:17:25             dut.10.240.183.220: set fwd mac
13/11/2020 17:17:25             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:17:25             dut.10.240.183.220: start
13/11/2020 17:17:25             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:17:25 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_split_ring_mergeable_path, and 64 frame size.
13/11/2020 17:17:25                         tester: ls -d /tmp
13/11/2020 17:17:25                         tester: /tmp
13/11/2020 17:17:25                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:17:27                         pktgen: test port 0 map gen port 0
13/11/2020 17:17:27                         pktgen: test port 0 map gen port 0
13/11/2020 17:17:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:27                         pktgen: trex port <0> not support flow control
13/11/2020 17:17:27                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:17:27                         pktgen: check the trex port link status
13/11/2020 17:17:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:27                         pktgen: begin traffic ......
13/11/2020 17:17:27                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:17:32                         pktgen: traffic completed. 
13/11/2020 17:17:32                         pktgen: check the trex port link status
13/11/2020 17:17:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:33                         pktgen: begin traffic ......
13/11/2020 17:17:33                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:17:43                         pktgen: begin get port statistic ...
13/11/2020 17:17:43                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:17:43                         pktgen: {0: {'ibytes': 10512758464,
     'ierrors': 0,
     'ipackets': 164261875,
     'obytes': 22720817856,
     'oerrors': 0,
     'opackets': 355012812,
     'rx_bps': 8409602560.0,
     'rx_bps_L1': 11037602560.0,
     'rx_pps': 16425000.0,
     'rx_util': 27.594006399999998,
     'tx_bps': 18157080576.0,
     'tx_bps_L1': 23831168256.0,
     'tx_pps': 35463048.0,
     'tx_util': 59.57792064},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.22142219543457,
            'cpu_util': 98.45054626464844,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8409602560.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9747477504.0,
            'rx_pps': 16425000.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18157080576.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35463048.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10512758464,
           'ierrors': 0,
           'ipackets': 164261875,
           'obytes': 22720817856,
           'oerrors': 0,
           'opackets': 355012812,
           'rx_bps': 8409602560.0,
           'rx_bps_L1': 11037602560.0,
           'rx_pps': 16425000.0,
           'rx_util': 27.594006399999998,
           'tx_bps': 18157080576.0,
           'tx_bps_L1': 23831168256.0,
           'tx_pps': 35463048.0,
           'tx_util': 59.57792064}}
13/11/2020 17:17:43                         pktgen: {'ibytes': 10512758464,
 'ierrors': 0,
 'ipackets': 164261875,
 'obytes': 22720817856,
 'oerrors': 0,
 'opackets': 355012812,
 'rx_bps': 8409602560.0,
 'rx_bps_L1': 11037602560.0,
 'rx_pps': 16425000.0,
 'rx_util': 27.594006399999998,
 'tx_bps': 18157080576.0,
 'tx_bps_L1': 23831168256.0,
 'tx_pps': 35463048.0,
 'tx_util': 59.57792064}
13/11/2020 17:17:43                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18157080576.000000, tx_pps: 35463048.000000 
13/11/2020 17:17:43                         pktgen: {'ibytes': 10512758464,
 'ierrors': 0,
 'ipackets': 164261875,
 'obytes': 22720817856,
 'oerrors': 0,
 'opackets': 355012812,
 'rx_bps': 8409602560.0,
 'rx_bps_L1': 11037602560.0,
 'rx_pps': 16425000.0,
 'rx_util': 27.594006399999998,
 'tx_bps': 18157080576.0,
 'tx_bps_L1': 23831168256.0,
 'tx_pps': 35463048.0,
 'tx_util': 59.57792064}
13/11/2020 17:17:43                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8409602560.000000, rx_pps: 16425000.000000
13/11/2020 17:17:43                         pktgen: throughput: pps_rx 16425000.000000, bps_rx 8409602560.000000
13/11/2020 17:17:43                         pktgen: traffic completed. 
13/11/2020 17:17:43             dut.10.240.183.220: stop
13/11/2020 17:17:43             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 123639639      TX-packets: 123639639      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 122764958      TX-packets: 122764958      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 246404597      RX-dropped: 0             RX-total: 246404597
  TX-packets: 246404597      TX-dropped: 0             TX-total: 246404597
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 246404597      RX-dropped: 0             RX-total: 246404597
  TX-packets: 246404597      TX-dropped: 0             TX-total: 246404597
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:17:43             dut.10.240.183.220: start
13/11/2020 17:17:43             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:17:45                         tester: ls -d /tmp
13/11/2020 17:17:46                         tester: /tmp
13/11/2020 17:17:46                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:17:47                         pktgen: test port 0 map gen port 0
13/11/2020 17:17:47                         pktgen: test port 0 map gen port 0
13/11/2020 17:17:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:48                         pktgen: trex port <0> not support flow control
13/11/2020 17:17:48                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:17:48                         pktgen: check the trex port link status
13/11/2020 17:17:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:48                         pktgen: begin traffic ......
13/11/2020 17:17:48                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:17:53                         pktgen: traffic completed. 
13/11/2020 17:17:53                         pktgen: check the trex port link status
13/11/2020 17:17:53                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:17:53                         pktgen: begin traffic ......
13/11/2020 17:17:53                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:18:03                         pktgen: begin get port statistic ...
13/11/2020 17:18:03                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:18:03                         pktgen: {0: {'ibytes': 10426869824,
     'ierrors': 0,
     'ipackets': 162919841,
     'obytes': 21962702144,
     'oerrors': 0,
     'opackets': 343167269,
     'rx_bps': 8318344704.0,
     'rx_bps_L1': 10917827744.0,
     'rx_pps': 16246769.0,
     'rx_util': 27.294569359999997,
     'tx_bps': 17487833088.0,
     'tx_bps_L1': 22952780288.0,
     'tx_pps': 34155920.0,
     'tx_util': 57.38195072},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.87576961517334,
            'cpu_util': 98.51446533203125,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8318344704.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9169488896.0,
            'rx_pps': 16246769.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17487833088.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 34155920.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10426869824,
           'ierrors': 0,
           'ipackets': 162919841,
           'obytes': 21962702144,
           'oerrors': 0,
           'opackets': 343167269,
           'rx_bps': 8318344704.0,
           'rx_bps_L1': 10917827744.0,
           'rx_pps': 16246769.0,
           'rx_util': 27.294569359999997,
           'tx_bps': 17487833088.0,
           'tx_bps_L1': 22952780288.0,
           'tx_pps': 34155920.0,
           'tx_util': 57.38195072}}
13/11/2020 17:18:03                         pktgen: {'ibytes': 10426869824,
 'ierrors': 0,
 'ipackets': 162919841,
 'obytes': 21962702144,
 'oerrors': 0,
 'opackets': 343167269,
 'rx_bps': 8318344704.0,
 'rx_bps_L1': 10917827744.0,
 'rx_pps': 16246769.0,
 'rx_util': 27.294569359999997,
 'tx_bps': 17487833088.0,
 'tx_bps_L1': 22952780288.0,
 'tx_pps': 34155920.0,
 'tx_util': 57.38195072}
13/11/2020 17:18:03                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17487833088.000000, tx_pps: 34155920.000000 
13/11/2020 17:18:03                         pktgen: {'ibytes': 10426869824,
 'ierrors': 0,
 'ipackets': 162919841,
 'obytes': 21962702144,
 'oerrors': 0,
 'opackets': 343167269,
 'rx_bps': 8318344704.0,
 'rx_bps_L1': 10917827744.0,
 'rx_pps': 16246769.0,
 'rx_util': 27.294569359999997,
 'tx_bps': 17487833088.0,
 'tx_bps_L1': 22952780288.0,
 'tx_pps': 34155920.0,
 'tx_util': 57.38195072}
13/11/2020 17:18:03                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8318344704.000000, rx_pps: 16246769.000000
13/11/2020 17:18:03                         pktgen: throughput: pps_rx 16246769.000000, bps_rx 8318344704.000000
13/11/2020 17:18:03                         pktgen: traffic completed. 
13/11/2020 17:18:03             dut.10.240.183.220: stop
13/11/2020 17:18:03             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 122336258      TX-packets: 122336258      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 122220133      TX-packets: 122220133      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 244556391      RX-dropped: 0             RX-total: 244556391
  TX-packets: 244556391      TX-dropped: 0             TX-total: 244556391
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 244556391      RX-dropped: 0             RX-total: 244556391
  TX-packets: 244556391      TX-dropped: 0             TX-total: 244556391
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:18:03             dut.10.240.183.220: start
13/11/2020 17:18:03             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:18:04             dut.10.240.183.220: quit
13/11/2020 17:18:04             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:18:04 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+----------------------+------------------+------------+----------------+
| FrameSize(B) |         Mode         | Throughput(Mpps) | % linerate |     Cycle      |
+==============+======================+==================+============+================+
| 64           | split_ring_mergeable | 16.425           | 27.594     | Before Restart |
+--------------+----------------------+------------------+------------+----------------+
| 64           | split_ring_mergeable | 16.247           | 27.295     | After Restart  |
+--------------+----------------------+------------------+------------+----------------+
13/11/2020 17:18:04 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_mergeable_path Result PASSED:
13/11/2020 17:18:04             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:18:07 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_nonmergeable_path Begin
13/11/2020 17:18:07             dut.10.240.183.220:  
13/11/2020 17:18:07                         tester: 
13/11/2020 17:18:07             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:18:08             dut.10.240.183.220: 
13/11/2020 17:18:08             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:18:08             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:18:08             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:18:08             dut.10.240.183.220: 
13/11/2020 17:18:19             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:18:19             dut.10.240.183.220: 1048576
13/11/2020 17:18:19             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=0,mrg_rxbuf=0,vectorized=1  -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
13/11/2020 17:18:20             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:18:30             dut.10.240.183.220: set fwd mac
13/11/2020 17:18:30             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:18:30             dut.10.240.183.220: start
13/11/2020 17:18:30             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:18:30 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_split_ring_nonmergeable_path, and 64 frame size.
13/11/2020 17:18:30                         tester: ls -d /tmp
13/11/2020 17:18:30                         tester: /tmp
13/11/2020 17:18:30                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:18:32                         pktgen: test port 0 map gen port 0
13/11/2020 17:18:32                         pktgen: test port 0 map gen port 0
13/11/2020 17:18:32                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:32                         pktgen: trex port <0> not support flow control
13/11/2020 17:18:32                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:18:32                         pktgen: check the trex port link status
13/11/2020 17:18:32                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:32                         pktgen: begin traffic ......
13/11/2020 17:18:32                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:18:37                         pktgen: traffic completed. 
13/11/2020 17:18:37                         pktgen: check the trex port link status
13/11/2020 17:18:37                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:37                         pktgen: begin traffic ......
13/11/2020 17:18:37                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:18:47                         pktgen: begin get port statistic ...
13/11/2020 17:18:47                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:18:47                         pktgen: {0: {'ibytes': 10503526336,
     'ierrors': 0,
     'ipackets': 164117634,
     'obytes': 21802451776,
     'oerrors': 0,
     'opackets': 340663356,
     'rx_bps': 8384322048.0,
     'rx_bps_L1': 11004421888.000002,
     'rx_pps': 16375624.0,
     'rx_util': 27.511054720000004,
     'tx_bps': 17356187648.0,
     'tx_bps_L1': 22779998208.0,
     'tx_pps': 33898816.0,
     'tx_util': 56.949995519999995},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.83005142211914,
            'cpu_util': 98.27908325195312,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8384322048.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8971865088.0,
            'rx_pps': 16375624.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 17356187648.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 33898816.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10503526336,
           'ierrors': 0,
           'ipackets': 164117634,
           'obytes': 21802451776,
           'oerrors': 0,
           'opackets': 340663356,
           'rx_bps': 8384322048.0,
           'rx_bps_L1': 11004421888.000002,
           'rx_pps': 16375624.0,
           'rx_util': 27.511054720000004,
           'tx_bps': 17356187648.0,
           'tx_bps_L1': 22779998208.0,
           'tx_pps': 33898816.0,
           'tx_util': 56.949995519999995}}
13/11/2020 17:18:47                         pktgen: {'ibytes': 10503526336,
 'ierrors': 0,
 'ipackets': 164117634,
 'obytes': 21802451776,
 'oerrors': 0,
 'opackets': 340663356,
 'rx_bps': 8384322048.0,
 'rx_bps_L1': 11004421888.000002,
 'rx_pps': 16375624.0,
 'rx_util': 27.511054720000004,
 'tx_bps': 17356187648.0,
 'tx_bps_L1': 22779998208.0,
 'tx_pps': 33898816.0,
 'tx_util': 56.949995519999995}
13/11/2020 17:18:47                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 17356187648.000000, tx_pps: 33898816.000000 
13/11/2020 17:18:47                         pktgen: {'ibytes': 10503526336,
 'ierrors': 0,
 'ipackets': 164117634,
 'obytes': 21802451776,
 'oerrors': 0,
 'opackets': 340663356,
 'rx_bps': 8384322048.0,
 'rx_bps_L1': 11004421888.000002,
 'rx_pps': 16375624.0,
 'rx_util': 27.511054720000004,
 'tx_bps': 17356187648.0,
 'tx_bps_L1': 22779998208.0,
 'tx_pps': 33898816.0,
 'tx_util': 56.949995519999995}
13/11/2020 17:18:47                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8384322048.000000, rx_pps: 16375624.000000
13/11/2020 17:18:47                         pktgen: throughput: pps_rx 16375624.000000, bps_rx 8384322048.000000
13/11/2020 17:18:47                         pktgen: traffic completed. 
13/11/2020 17:18:47             dut.10.240.183.220: stop
13/11/2020 17:18:47             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 122852773      TX-packets: 122852773      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 122945675      TX-packets: 122945675      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 245798448      RX-dropped: 0             RX-total: 245798448
  TX-packets: 245798448      TX-dropped: 0             TX-total: 245798448
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 245798448      RX-dropped: 0             RX-total: 245798448
  TX-packets: 245798448      TX-dropped: 0             TX-total: 245798448
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:18:47             dut.10.240.183.220: start
13/11/2020 17:18:47             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:18:50                         tester: ls -d /tmp
13/11/2020 17:18:50                         tester: /tmp
13/11/2020 17:18:50                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:18:52                         pktgen: test port 0 map gen port 0
13/11/2020 17:18:52                         pktgen: test port 0 map gen port 0
13/11/2020 17:18:52                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:52                         pktgen: trex port <0> not support flow control
13/11/2020 17:18:52                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:18:52                         pktgen: check the trex port link status
13/11/2020 17:18:52                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:52                         pktgen: begin traffic ......
13/11/2020 17:18:52                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:18:57                         pktgen: traffic completed. 
13/11/2020 17:18:57                         pktgen: check the trex port link status
13/11/2020 17:18:57                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:18:57                         pktgen: begin traffic ......
13/11/2020 17:18:57                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:19:07                         pktgen: begin get port statistic ...
13/11/2020 17:19:07                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:19:07                         pktgen: {0: {'ibytes': 10369496192,
     'ierrors': 0,
     'ipackets': 162023391,
     'obytes': 22741219008,
     'oerrors': 0,
     'opackets': 355331584,
     'rx_bps': 8304199168.0,
     'rx_bps_L1': 10899260608.0,
     'rx_pps': 16219134.0,
     'rx_util': 27.248151520000004,
     'tx_bps': 18160406528.0,
     'tx_bps_L1': 23835534207.999996,
     'tx_pps': 35469548.0,
     'tx_util': 59.588835519999996},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.193726539611816,
            'cpu_util': 98.76521301269531,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8304199168.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9856206848.0,
            'rx_pps': 16219134.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18160406528.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35469548.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10369496192,
           'ierrors': 0,
           'ipackets': 162023391,
           'obytes': 22741219008,
           'oerrors': 0,
           'opackets': 355331584,
           'rx_bps': 8304199168.0,
           'rx_bps_L1': 10899260608.0,
           'rx_pps': 16219134.0,
           'rx_util': 27.248151520000004,
           'tx_bps': 18160406528.0,
           'tx_bps_L1': 23835534207.999996,
           'tx_pps': 35469548.0,
           'tx_util': 59.588835519999996}}
13/11/2020 17:19:07                         pktgen: {'ibytes': 10369496192,
 'ierrors': 0,
 'ipackets': 162023391,
 'obytes': 22741219008,
 'oerrors': 0,
 'opackets': 355331584,
 'rx_bps': 8304199168.0,
 'rx_bps_L1': 10899260608.0,
 'rx_pps': 16219134.0,
 'rx_util': 27.248151520000004,
 'tx_bps': 18160406528.0,
 'tx_bps_L1': 23835534207.999996,
 'tx_pps': 35469548.0,
 'tx_util': 59.588835519999996}
13/11/2020 17:19:07                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18160406528.000000, tx_pps: 35469548.000000 
13/11/2020 17:19:07                         pktgen: {'ibytes': 10369496192,
 'ierrors': 0,
 'ipackets': 162023391,
 'obytes': 22741219008,
 'oerrors': 0,
 'opackets': 355331584,
 'rx_bps': 8304199168.0,
 'rx_bps_L1': 10899260608.0,
 'rx_pps': 16219134.0,
 'rx_util': 27.248151520000004,
 'tx_bps': 18160406528.0,
 'tx_bps_L1': 23835534207.999996,
 'tx_pps': 35469548.0,
 'tx_util': 59.588835519999996}
13/11/2020 17:19:07                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8304199168.000000, rx_pps: 16219134.000000
13/11/2020 17:19:07                         pktgen: throughput: pps_rx 16219134.000000, bps_rx 8304199168.000000
13/11/2020 17:19:07                         pktgen: traffic completed. 
13/11/2020 17:19:07             dut.10.240.183.220: stop
13/11/2020 17:19:07             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 121167696      TX-packets: 121167696      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 121861442      TX-packets: 121861442      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 243029138      RX-dropped: 0             RX-total: 243029138
  TX-packets: 243029138      TX-dropped: 0             TX-total: 243029138
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 243029138      RX-dropped: 0             RX-total: 243029138
  TX-packets: 243029138      TX-dropped: 0             TX-total: 243029138
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:19:07             dut.10.240.183.220: start
13/11/2020 17:19:07             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x1 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x1
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:19:08             dut.10.240.183.220: quit
13/11/2020 17:19:09             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:19:09 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+-------------------------+------------------+------------+----------------+
| FrameSize(B) |          Mode           | Throughput(Mpps) | % linerate |     Cycle      |
+==============+=========================+==================+============+================+
| 64           | split_ring_nonmergeable | 16.376           | 27.511     | Before Restart |
+--------------+-------------------------+------------------+------------+----------------+
| 64           | split_ring_nonmergeable | 16.219           | 27.248     | After Restart  |
+--------------+-------------------------+------------------+------------+----------------+
13/11/2020 17:19:09 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_nonmergeable_path Result PASSED:
13/11/2020 17:19:09             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:19:12 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_vector_rx_path Begin
13/11/2020 17:19:12             dut.10.240.183.220:  
13/11/2020 17:19:12                         tester: 
13/11/2020 17:19:12             dut.10.240.183.220: rm -rf ./vhost.out
13/11/2020 17:19:12             dut.10.240.183.220: 
13/11/2020 17:19:12             dut.10.240.183.220: killall -s INT dpdk-testpmd 
13/11/2020 17:19:12             dut.10.240.183.220: dpdk-testpmd: no process found
13/11/2020 17:19:12             dut.10.240.183.220: rm -rf ./vhost-net*
13/11/2020 17:19:12             dut.10.240.183.220: 
13/11/2020 17:19:23             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
13/11/2020 17:19:23             dut.10.240.183.220: 1048576
13/11/2020 17:19:23             dut.10.240.183.220: x86_64-native-linuxapp-gcc/app/dpdk-testpmd  -l 33,34,35 -n 4   --file-prefix=virtio --no-pci  --vdev net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=0,mrg_rxbuf=0,vectorized=1  -- -i --tx-offloads=0x0 --rss-ip --nb-cores=2 --rxq=2 --txq=2
13/11/2020 17:19:24             dut.10.240.183.220: EAL: Detected 112 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/virtio/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: Probing VFIO support...
EAL: VFIO support initialized
Interactive-mode selected
Warning: NUMA should be configured manually by using --port-numa-config and --ring-numa-config parameters along with --numa.
testpmd: create a new mbuf pool <mb_pool_1>: n=163456, size=2176, socket=1
testpmd: preferred mempool ops selected: ring_mp_mc

Warning! port-topology=paired and odd forward ports number, the last port will pair with itself.

Configuring Port 0 (socket 1)
Port 0: 00:01:02:03:04:05
Checking link statuses...
Done
13/11/2020 17:19:34             dut.10.240.183.220: set fwd mac
13/11/2020 17:19:34             dut.10.240.183.220: 
Set mac packet forwarding mode
13/11/2020 17:19:34             dut.10.240.183.220: start
13/11/2020 17:19:34             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x0 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x0
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:19:34 TestPVPVirtioUserMultiQueuesPortRestart: Running test test_perf_pvp_2queues_test_with_split_ring_vector_rx_path, and 64 frame size.
13/11/2020 17:19:34                         tester: ls -d /tmp
13/11/2020 17:19:34                         tester: /tmp
13/11/2020 17:19:34                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:19:36                         pktgen: test port 0 map gen port 0
13/11/2020 17:19:36                         pktgen: test port 0 map gen port 0
13/11/2020 17:19:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:19:36                         pktgen: trex port <0> not support flow control
13/11/2020 17:19:36                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:19:36                         pktgen: check the trex port link status
13/11/2020 17:19:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:19:36                         pktgen: begin traffic ......
13/11/2020 17:19:36                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:19:41                         pktgen: traffic completed. 
13/11/2020 17:19:41                         pktgen: check the trex port link status
13/11/2020 17:19:41                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:19:41                         pktgen: begin traffic ......
13/11/2020 17:19:41                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:19:51                         pktgen: begin get port statistic ...
13/11/2020 17:19:51                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:19:51                         pktgen: {0: {'ibytes': 10404246336,
     'ierrors': 0,
     'ipackets': 162566383,
     'obytes': 22588362944,
     'oerrors': 0,
     'opackets': 352943197,
     'rx_bps': 8356310528.0,
     'rx_bps_L1': 10967657408.0,
     'rx_pps': 16320918.0,
     'rx_util': 27.41914352,
     'tx_bps': 18049748992.0,
     'tx_bps_L1': 23690298112.0,
     'tx_pps': 35253432.0,
     'tx_util': 59.22574528},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.194291114807129,
            'cpu_util': 98.1573715209961,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8356310528.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9693438976.0,
            'rx_pps': 16320918.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18049748992.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35253432.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10404246336,
           'ierrors': 0,
           'ipackets': 162566383,
           'obytes': 22588362944,
           'oerrors': 0,
           'opackets': 352943197,
           'rx_bps': 8356310528.0,
           'rx_bps_L1': 10967657408.0,
           'rx_pps': 16320918.0,
           'rx_util': 27.41914352,
           'tx_bps': 18049748992.0,
           'tx_bps_L1': 23690298112.0,
           'tx_pps': 35253432.0,
           'tx_util': 59.22574528}}
13/11/2020 17:19:51                         pktgen: {'ibytes': 10404246336,
 'ierrors': 0,
 'ipackets': 162566383,
 'obytes': 22588362944,
 'oerrors': 0,
 'opackets': 352943197,
 'rx_bps': 8356310528.0,
 'rx_bps_L1': 10967657408.0,
 'rx_pps': 16320918.0,
 'rx_util': 27.41914352,
 'tx_bps': 18049748992.0,
 'tx_bps_L1': 23690298112.0,
 'tx_pps': 35253432.0,
 'tx_util': 59.22574528}
13/11/2020 17:19:51                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18049748992.000000, tx_pps: 35253432.000000 
13/11/2020 17:19:51                         pktgen: {'ibytes': 10404246336,
 'ierrors': 0,
 'ipackets': 162566383,
 'obytes': 22588362944,
 'oerrors': 0,
 'opackets': 352943197,
 'rx_bps': 8356310528.0,
 'rx_bps_L1': 10967657408.0,
 'rx_pps': 16320918.0,
 'rx_util': 27.41914352,
 'tx_bps': 18049748992.0,
 'tx_bps_L1': 23690298112.0,
 'tx_pps': 35253432.0,
 'tx_util': 59.22574528}
13/11/2020 17:19:51                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8356310528.000000, rx_pps: 16320918.000000
13/11/2020 17:19:51                         pktgen: throughput: pps_rx 16320918.000000, bps_rx 8356310528.000000
13/11/2020 17:19:51                         pktgen: traffic completed. 
13/11/2020 17:19:51             dut.10.240.183.220: stop
13/11/2020 17:19:51             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 122429182      TX-packets: 122429182      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 121938921      TX-packets: 121938921      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 244368103      RX-dropped: 0             RX-total: 244368103
  TX-packets: 244368103      TX-dropped: 0             TX-total: 244368103
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 244368103      RX-dropped: 0             RX-total: 244368103
  TX-packets: 244368103      TX-dropped: 0             TX-total: 244368103
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:19:51             dut.10.240.183.220: start
13/11/2020 17:19:51             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x0 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x0
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:19:54                         tester: ls -d /tmp
13/11/2020 17:19:54                         tester: /tmp
13/11/2020 17:19:54                         tester: scp -v /home/autoregression/jiangyu/dts1113/output/tmp/pcap/pvp_multipath.pcap root@10.240.183.217:/tmp/pvp_multipath.pcap
13/11/2020 17:19:56                         pktgen: test port 0 map gen port 0
13/11/2020 17:19:56                         pktgen: test port 0 map gen port 0
13/11/2020 17:19:56                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:19:56                         pktgen: trex port <0> not support flow control
13/11/2020 17:19:56                         pktgen: trex packet generator: run traffic 5s to warm up ... 
13/11/2020 17:19:56                         pktgen: check the trex port link status
13/11/2020 17:19:56                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:19:56                         pktgen: begin traffic ......
13/11/2020 17:19:56                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:20:01                         pktgen: traffic completed. 
13/11/2020 17:20:01                         pktgen: check the trex port link status
13/11/2020 17:20:01                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
13/11/2020 17:20:01                         pktgen: begin traffic ......
13/11/2020 17:20:01                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
13/11/2020 17:20:11                         pktgen: begin get port statistic ...
13/11/2020 17:20:11                         pktgen: {'options': {'fields_config': {'ip': {'dst': {'action': 'random',
                                              'end': '48.0.0.64',
                                              'start': '48.0.0.1',
                                              'step': 1}}},
             'pcap': '/tmp/pvp_multipath.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/pvp_multipath.pcap',
 'rx_port': 0,
 'tx_port': 0}
13/11/2020 17:20:11                         pktgen: {0: {'ibytes': 10415584640,
     'ierrors': 0,
     'ipackets': 162743526,
     'obytes': 22728655616,
     'oerrors': 0,
     'opackets': 355135280,
     'rx_bps': 8323944448.0,
     'rx_bps_L1': 10925178048.0,
     'rx_pps': 16257710.0,
     'rx_util': 27.31294512,
     'tx_bps': 18150705152.0,
     'tx_bps_L1': 23822799232.0,
     'tx_pps': 35450588.0,
     'tx_util': 59.55699808},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 9.196572303771973,
            'cpu_util': 98.6819076538086,
            'cpu_util_raw': 100.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 0,
            'rx_bps': 8323944448.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9826760704.0,
            'rx_pps': 16257710.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 18150705152.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 35450588.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 10415584640,
           'ierrors': 0,
           'ipackets': 162743526,
           'obytes': 22728655616,
           'oerrors': 0,
           'opackets': 355135280,
           'rx_bps': 8323944448.0,
           'rx_bps_L1': 10925178048.0,
           'rx_pps': 16257710.0,
           'rx_util': 27.31294512,
           'tx_bps': 18150705152.0,
           'tx_bps_L1': 23822799232.0,
           'tx_pps': 35450588.0,
           'tx_util': 59.55699808}}
13/11/2020 17:20:11                         pktgen: {'ibytes': 10415584640,
 'ierrors': 0,
 'ipackets': 162743526,
 'obytes': 22728655616,
 'oerrors': 0,
 'opackets': 355135280,
 'rx_bps': 8323944448.0,
 'rx_bps_L1': 10925178048.0,
 'rx_pps': 16257710.0,
 'rx_util': 27.31294512,
 'tx_bps': 18150705152.0,
 'tx_bps_L1': 23822799232.0,
 'tx_pps': 35450588.0,
 'tx_util': 59.55699808}
13/11/2020 17:20:11                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 18150705152.000000, tx_pps: 35450588.000000 
13/11/2020 17:20:11                         pktgen: {'ibytes': 10415584640,
 'ierrors': 0,
 'ipackets': 162743526,
 'obytes': 22728655616,
 'oerrors': 0,
 'opackets': 355135280,
 'rx_bps': 8323944448.0,
 'rx_bps_L1': 10925178048.0,
 'rx_pps': 16257710.0,
 'rx_util': 27.31294512,
 'tx_bps': 18150705152.0,
 'tx_bps_L1': 23822799232.0,
 'tx_pps': 35450588.0,
 'tx_util': 59.55699808}
13/11/2020 17:20:11                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 8323944448.000000, rx_pps: 16257710.000000
13/11/2020 17:20:11                         pktgen: throughput: pps_rx 16257710.000000, bps_rx 8323944448.000000
13/11/2020 17:20:11                         pktgen: traffic completed. 
13/11/2020 17:20:11             dut.10.240.183.220: stop
13/11/2020 17:20:11             dut.10.240.183.220: 
Telling cores to ...
Waiting for lcores to finish...

  ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 -------
  RX-packets: 122410720      TX-packets: 122410720      TX-dropped: 0             

  ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 -------
  RX-packets: 121931744      TX-packets: 121931744      TX-dropped: 0             

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 244342464      RX-dropped: 0             RX-total: 244342464
  TX-packets: 244342464      TX-dropped: 0             TX-total: 244342464
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 244342464      RX-dropped: 0             RX-total: 244342464
  TX-packets: 244342464      TX-dropped: 0             TX-total: 244342464
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.
13/11/2020 17:20:11             dut.10.240.183.220: start
13/11/2020 17:20:11             dut.10.240.183.220: 
mac packet forwarding - ports=1 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native
Logical Core 34 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=0 (socket 1) -> TX P=0/Q=0 (socket 1) peer=02:00:00:00:00:00
Logical Core 35 (socket 1) forwards packets on 1 streams:
  RX P=0/Q=1 (socket 1) -> TX P=0/Q=1 (socket 1) peer=02:00:00:00:00:00

  mac packet forwarding packets/burst=32
  nb forwarding cores=2 - nb forwarding ports=1
  port 0: RX queue number: 2 Tx queue number: 2
    Rx offloads=0x0 Tx offloads=0x0
    RX queue: 0
      RX desc=0 - RX free threshold=0
      RX threshold registers: pthresh=0 hthresh=0  wthresh=0
      RX Offloads=0x0
    TX queue: 0
      TX desc=0 - TX free threshold=0
      TX threshold registers: pthresh=0 hthresh=0  wthresh=0
      TX offloads=0x0 - TX RS bit threshold=0
13/11/2020 17:20:12             dut.10.240.183.220: quit
13/11/2020 17:20:13             dut.10.240.183.220: 
Telling cores to stop...
Waiting for lcores to finish...

  ---------------------- Forward statistics for port 0  ----------------------
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ----------------------------------------------------------------------------

  +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++
  RX-packets: 0              RX-dropped: 0             RX-total: 0
  TX-packets: 0              TX-dropped: 0             TX-total: 0
  ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

Done.

Stopping port 0...
Stopping ports...
Done

Shutting down port 0...
Closing ports...
13/11/2020 17:20:13 TestPVPVirtioUserMultiQueuesPortRestart: 
+--------------+----------------------+------------------+------------+----------------+
| FrameSize(B) |         Mode         | Throughput(Mpps) | % linerate |     Cycle      |
+==============+======================+==================+============+================+
| 64           | split_ring_vector_rx | 16.321           | 27.419     | Before Restart |
+--------------+----------------------+------------------+------------+----------------+
| 64           | split_ring_vector_rx | 16.258           | 27.313     | After Restart  |
+--------------+----------------------+------------------+------------+----------------+
13/11/2020 17:20:13 TestPVPVirtioUserMultiQueuesPortRestart: Test Case test_perf_pvp_2queues_test_with_split_ring_vector_rx_path Result PASSED:
13/11/2020 17:20:13             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
13/11/2020 17:20:16                            dts: 
TEST SUITE ENDED: TestPVPVirtioUserMultiQueuesPortRestart

^ permalink raw reply	[flat|nested] 3+ messages in thread

* [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and Optimize script
@ 2020-11-13 17:54 JiangYuX
  2020-11-13  9:57 ` Jiang, YuX
  0 siblings, 1 reply; 3+ messages in thread
From: JiangYuX @ 2020-11-13 17:54 UTC (permalink / raw)
  To: dts; +Cc: JiangYu

From: JiangYu <yux.jiang@intel.com>

1,Add one new case:packed_ring_vectorized_path which need enable avx512
2,Optimize testpmd function and Modify TC7&TC8 script to adapt testplan

Signed-off-by: JiangYu <yux.jiang@intel.com>
---
 ...te_pvp_virtio_user_multi_queues_port_restart.py | 84 +++++++++++++---------
 1 file changed, 49 insertions(+), 35 deletions(-)

diff --git a/tests/TestSuite_pvp_virtio_user_multi_queues_port_restart.py b/tests/TestSuite_pvp_virtio_user_multi_queues_port_restart.py
index 4710222..73f0540 100644
--- a/tests/TestSuite_pvp_virtio_user_multi_queues_port_restart.py
+++ b/tests/TestSuite_pvp_virtio_user_multi_queues_port_restart.py
@@ -44,7 +44,7 @@ import re
 from test_case import TestCase
 from packet import Packet
 from pktgen import PacketGeneratorHelper
-
+from pmd_output import PmdOutput
 
 class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
 
@@ -66,11 +66,13 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         # create an instance to set stream field setting
         self.pktgen_helper = PacketGeneratorHelper()
         self.pci_info = self.dut.ports_info[0]['pci']
-        self.vhost = self.dut.new_session(suite="vhost-user")
+        self.vhost_pmd_session = self.dut.new_session(suite="vhost-user")
         self.tx_port = self.tester.get_local_port(self.dut_ports[0])
         self.queue_number = 2
         self.dut.kill_all()
         self.number_of_ports = 1
+        self.vhost_pmd = PmdOutput(self.dut, self.vhost_pmd_session)
+        self.virtio_user_pmd = PmdOutput(self.dut)
         self.app_testpmd_path = self.dut.apps_name['test-pmd']
         self.testpmd_name = self.app_testpmd_path.split("/")[-1]
 
@@ -91,15 +93,13 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         """
         self.dut.send_expect("killall -s INT %s" % self.testpmd_name, "#")
         self.dut.send_expect("rm -rf ./vhost-net*", "#")
-        testcmd = self.app_testpmd_path + " "
-        vdev = 'net_vhost0,iface=vhost-net,queues=2,client=0'
-        eal_params = self.dut.create_eal_parameters(cores=self.core_list[2:5], prefix='vhost', ports=[self.pci_info],
-                                                    vdevs=[vdev])
-        para = " -- -i --nb-cores=2 --rxq=%s --txq=%s --rss-ip" % (self.queue_number, self.queue_number)
-        command_line_vhost = testcmd + eal_params + para
-        self.vhost.send_expect(command_line_vhost, "testpmd> ", 120)
-        self.vhost.send_expect("set fwd mac", "testpmd> ", 120)
-        self.vhost.send_expect("start", "testpmd> ", 120)
+        vdev = "'net_vhost0,iface=vhost-net,queues=2,client=0'"
+        param = "--nb-cores=2 --rxq={} --txq={} --rss-ip".format(self.queue_number, self.queue_number)
+        self.vhost_pmd.start_testpmd(cores=self.core_list[2:5], param=param, \
+                eal_param="-w {} --file-prefix=vhost --vdev {}".format(self.pci_info, vdev))
+
+        self.vhost_pmd.execute_cmd("set fwd mac", "testpmd> ", 120)
+        self.vhost_pmd.execute_cmd("start", "testpmd> ", 120)
 
     @property
     def check_2M_env(self):
@@ -110,21 +110,25 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         """
         start testpmd in vm depend on different path
         """
-        testcmd = self.app_testpmd_path + " "
-        eal_params = self.dut.create_eal_parameters(cores=self.core_list[5:8], prefix='virtio', no_pci=True,
-                                                    vdevs=[vdevs])
+        eal_param="--vdev {}".format(vdevs)
         if self.check_2M_env:
             eal_params += " --single-file-segments"
+        if 'vectorized_path' in self.running_case:
+            eal_param += " --force-max-simd-bitwidth=512"
         if vector_flag:
-            para = " -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=%s --txq=%s --rss-ip" % (
-            self.queue_number, self.queue_number)
+            # split_ring_vector_rx_path don't use enable-hw-vlan-strip params in testplan
+            param = "--tx-offloads=0x0 --rss-ip --nb-cores=2 --rxq={} --txq={}".format(self.queue_number, self.queue_number)
         else:
-            para = " -- -i --tx-offloads=0x0 --rss-ip --nb-cores=2 --rxq=%s --txq=%s --rss-ip" % (
-            self.queue_number, self.queue_number)
-        command_line_user = testcmd + eal_params + para
-        self.dut.send_expect(command_line_user, "testpmd> ", 30)
-        self.dut.send_expect("set fwd mac", "testpmd> ", 30)
-        self.dut.send_expect("start", "testpmd> ", 30)
+            param = "--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq={} --txq={}".format(self.queue_number, self.queue_number)
+
+        if 'packed_ring' in self.running_case:
+            # packed_ring case use txd&rxd in testplan
+            param += " --txd=255 --rxd=255"
+
+        self.virtio_user_pmd.start_testpmd(cores=self.core_list[5:8], param=param, eal_param=eal_param, \
+                no_pci=True, ports=[], prefix="virtio", fixed_prefix=True)
+        self.virtio_user_pmd.execute_cmd("set fwd mac", "testpmd> ", 30)
+        self.virtio_user_pmd.execute_cmd("start", "testpmd> ", 30)
 
     def check_port_link_status_after_port_restart(self):
         """
@@ -133,7 +137,7 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         loop = 1
         port_status = 'down'
         while (loop <= 5):
-            out = self.vhost.send_expect("show port info 0", "testpmd> ", 120)
+            out = self.vhost_pmd.execute_cmd("show port info 0", "testpmd> ", 120)
             port_status = re.findall("Link\s*status:\s*([a-z]*)", out)
             if ("down" not in port_status):
                 break
@@ -143,12 +147,12 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
 
     def port_restart(self, restart_times=1):
         for i in range(restart_times):
-            self.vhost.send_expect("stop", "testpmd> ", 120)
-            self.vhost.send_expect("port stop 0", "testpmd> ", 120)
-            self.vhost.send_expect("clear port stats 0", "testpmd> ", 120)
-            self.vhost.send_expect("port start 0", "testpmd> ", 120)
+            self.vhost_pmd.execute_cmd("stop", "testpmd> ", 120)
+            self.vhost_pmd.execute_cmd("port stop 0", "testpmd> ", 120)
+            self.vhost_pmd.execute_cmd("clear port stats 0", "testpmd> ", 120)
+            self.vhost_pmd.execute_cmd("port start 0", "testpmd> ", 120)
             self.check_port_link_status_after_port_restart()
-            self.vhost.send_expect("start", "testpmd> ", 120)
+            self.vhost_pmd.execute_cmd("start", "testpmd> ", 120)
 
     def update_table_info(self, case_info, frame_size, Mpps, throughtput, Cycle):
         results_row = [frame_size]
@@ -212,7 +216,7 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         """
         check each queue has receive packets
         """
-        out = self.dut.send_expect("stop", "testpmd> ", 60)
+        out = self.virtio_user_pmd.execute_cmd("stop", "testpmd> ", 60)
         p = re.compile("RX Port= 0/Queue= (\d+) -> TX Port= 0/Queue= \d+.*\n.*RX-packets:\s?(\d+).*TX-packets:\s?(\d+)")
         res = p.findall(out)
         self.res_queues = sorted([int(i[0]) for i in res])
@@ -222,14 +226,14 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
                     "frame_size: %s, expect %s queues to handle packets, result %s queues" % (frame_size, list(range(self.queue_number)), self.res_queues))
         self.verify(all(self.res_rx_pkts), "each queue should has rx packets, result: %s" % self.res_rx_pkts)
         self.verify(all(self.res_tx_pkts), "each queue should has tx packets, result: %s" % self.res_tx_pkts)
-        self.dut.send_expect("start", "testpmd> ", 60)
+        self.virtio_user_pmd.execute_cmd("start", "testpmd> ", 60)
 
     def close_all_testpmd(self):
         """
         close testpmd about vhost-user and vm_testpmd
         """
-        self.vhost.send_expect("quit", "#", 60)
-        self.dut.send_expect("quit", "#", 60)
+        self.vhost_pmd.execute_cmd("quit", "#", 10)
+        self.virtio_user_pmd.execute_cmd("quit", "#", 10)
 
     def test_perf_pvp_2queues_test_with_packed_ring_mergeable_path(self):
         self.start_vhost_testpmd()
@@ -275,14 +279,14 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
 
     def test_perf_pvp_2queues_test_with_split_ring_vector_rx_path(self):
         self.start_vhost_testpmd()
-        self.start_virtio_user_testpmd(vdevs="net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=1,queue_size=255", vector_flag=True)
+        self.start_virtio_user_testpmd(vdevs="net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,in_order=0,mrg_rxbuf=0,vectorized=1", vector_flag=True)
         self.send_and_verify("split_ring_vector_rx")
         self.close_all_testpmd()
         self.result_table_print()
 
     def test_perf_pvp_2queues_test_with_packed_ring_inorder_mergeable_path(self):
         self.start_vhost_testpmd()
-        self.start_virtio_user_testpmd(vdevs="net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1,queue_size=255")
+        self.start_virtio_user_testpmd(vdevs="net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=1,queue_size=255")
         self.send_and_verify("packed_ring_inorder_mergeable")
         self.close_all_testpmd()
         self.result_table_print()
@@ -294,6 +298,16 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         self.close_all_testpmd()
         self.result_table_print()
 
+    def test_perf_pvp_2queues_test_with_packed_ring_vectorized_path(self):
+        """
+        Test Case 10: pvp 2 queues test with packed ring vectorized path
+        """
+        self.start_vhost_testpmd()
+        self.start_virtio_user_testpmd(vdevs="net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1,queue_size=255")
+        self.send_and_verify("packed_ring_vectorized_path")
+        self.close_all_testpmd()
+        self.result_table_print()
+
     def tear_down(self):
         """
         Run after each test case.
@@ -305,4 +319,4 @@ class TestPVPVirtioUserMultiQueuesPortRestart(TestCase):
         """
         Run after each test suite.
         """
-        self.dut.close_session(self.vhost)
+        self.dut.close_session(self.vhost_pmd_session)
-- 
2.7.4


^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and Optimize script
  2020-11-13  9:57 ` Jiang, YuX
@ 2020-11-17  5:59   ` Wang, Yinan
  0 siblings, 0 replies; 3+ messages in thread
From: Wang, Yinan @ 2020-11-17  5:59 UTC (permalink / raw)
  To: Jiang, YuX, Jiang, YuX, dts

Acked-by: Wang, Yinan <yinan.wang@intel.com>

> -----Original Message-----
> From: dts <dts-bounces@dpdk.org> On Behalf Of Jiang, YuX
> Sent: 2020?11?13? 17:58
> To: Jiang, YuX <yux.jiang@intel.com>; dts@dpdk.org
> Subject: Re: [dts] [PATCH V1]
> tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and
> Optimize script
> 
> Tested-by: JiangYuX <yux.jiang@intel.com>
> 
>     Best Regards
>     Jiang yu
> 
> > -----Original Message-----
> > From: JiangYuX [mailto:yux.jiang@intel.com]
> > Sent: Saturday, November 14, 2020 1:55 AM
> > To: dts@dpdk.org
> > Cc: Jiang, YuX <yux.jiang@intel.com>
> > Subject: [dts] [PATCH V1]
> tests/pvp_virtio_user_multi_queues_port_restart:
> > Add one new case and Optimize script

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2020-11-17  6:00 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-11-13 17:54 [dts] [PATCH V1] tests/pvp_virtio_user_multi_queues_port_restart: Add one new case and Optimize script JiangYuX
2020-11-13  9:57 ` Jiang, YuX
2020-11-17  5:59   ` Wang, Yinan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).