test suite reviews and discussions
 help / color / mirror / Atom feed
From: "Ling, WeiX" <weix.ling@intel.com>
To: "dts@dpdk.org" <dts@dpdk.org>
Subject: Re: [dts] [PATCH V2] tests/pvp_multi_paths_performance:modify dts code sync with testplan and optimize code
Date: Wed, 3 Mar 2021 08:10:52 +0000	[thread overview]
Message-ID: <7590925b07894c0eba34d6e05c14ec50@intel.com> (raw)
In-Reply-To: <20210303080914.222329-1-weix.ling@intel.com>

[-- Attachment #1: Type: text/plain, Size: 338 bytes --]

> -----Original Message-----
> From: Ling, WeiX <weix.ling@intel.com>
> Sent: Wednesday, March 3, 2021 04:09 PM
> To: dts@dpdk.org
> Cc: Ling, WeiX <weix.ling@intel.com>
> Subject: [dts][PATCH V2] tests/pvp_multi_paths_performance:modify dts
> code sync with testplan and optimize code

Tested-by: Wei Ling <weix.ling@intel.com>

[-- Attachment #2: TestPVPMultiPathPerformance.log --]
[-- Type: application/octet-stream, Size: 431032 bytes --]

03/03/2021 15:51:26                            dts: 
TEST SUITE : TestPVPMultiPathPerformance
03/03/2021 15:51:26                            dts: NIC :        fortville_spirit
03/03/2021 15:51:26             dut.10.240.183.220: 
03/03/2021 15:51:26                         tester: 
03/03/2021 15:51:26                         tester: ls -d /tmp
03/03/2021 15:51:26                         tester: /tmp
03/03/2021 15:51:29             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:51:29             dut.10.240.183.220: 1048576
03/03/2021 15:51:29    TestPVPMultiPathPerformance: Test Case test_perf_pvp_inorder_mergeable Begin
03/03/2021 15:51:29             dut.10.240.183.220: 
03/03/2021 15:51:29                         tester: 
03/03/2021 15:51:29             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:51:29             dut.10.240.183.220: 
03/03/2021 15:51:29             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:51:29             dut.10.240.183.220: 
03/03/2021 15:51:29             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:51:30             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:51:30             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:51:30             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:51:41             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:51:41             dut.10.240.183.220: 1048576
03/03/2021 15:51:52    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 15:51:52                         tester: ls -d /tmp
03/03/2021 15:51:52                         tester: /tmp
03/03/2021 15:51:52                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:51:54                         pktgen: test port 0 map gen port 0
03/03/2021 15:51:54                         pktgen: test port 0 map gen port 0
03/03/2021 15:51:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:51:54                         pktgen: trex port <0> not support flow control
03/03/2021 15:51:54                         pktgen: check the trex port link status
03/03/2021 15:51:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:51:54                         pktgen: begin traffic ......
03/03/2021 15:51:54                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:52:04                         pktgen: begin get port statistic ...
03/03/2021 15:52:04                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:52:04                         pktgen: {0: {'ibytes': 5199472640,
     'ierrors': 0,
     'ipackets': 81241760,
     'obytes': 17275335168,
     'oerrors': 0,
     'opackets': 269927124,
     'rx_bps': 4144094720.0,
     'rx_bps_L1': 5439124320.0,
     'rx_pps': 8093935.0,
     'rx_util': 13.597810799999998,
     'tx_bps': 13781179392.0,
     'tx_bps_L1': 18087797952.0,
     'tx_pps': 26916366.0,
     'tx_util': 45.21949488},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.8406612873077393,
            'cpu_util': 93.58850860595703,
            'cpu_util_raw': 99.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 138864708,
            'rx_bps': 4144094720.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9637085184.0,
            'rx_pps': 8093935.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13781179392.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26916366.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 5199472640,
           'ierrors': 0,
           'ipackets': 81241760,
           'obytes': 17275335168,
           'oerrors': 0,
           'opackets': 269927124,
           'rx_bps': 4144094720.0,
           'rx_bps_L1': 5439124320.0,
           'rx_pps': 8093935.0,
           'rx_util': 13.597810799999998,
           'tx_bps': 13781179392.0,
           'tx_bps_L1': 18087797952.0,
           'tx_pps': 26916366.0,
           'tx_util': 45.21949488}}
03/03/2021 15:52:04                         pktgen: {'ibytes': 5199472640,
 'ierrors': 0,
 'ipackets': 81241760,
 'obytes': 17275335168,
 'oerrors': 0,
 'opackets': 269927124,
 'rx_bps': 4144094720.0,
 'rx_bps_L1': 5439124320.0,
 'rx_pps': 8093935.0,
 'rx_util': 13.597810799999998,
 'tx_bps': 13781179392.0,
 'tx_bps_L1': 18087797952.0,
 'tx_pps': 26916366.0,
 'tx_util': 45.21949488}
03/03/2021 15:52:04                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13781179392.000000, tx_pps: 26916366.000000 
03/03/2021 15:52:04                         pktgen: {'ibytes': 5199472640,
 'ierrors': 0,
 'ipackets': 81241760,
 'obytes': 17275335168,
 'oerrors': 0,
 'opackets': 269927124,
 'rx_bps': 4144094720.0,
 'rx_bps_L1': 5439124320.0,
 'rx_pps': 8093935.0,
 'rx_util': 13.597810799999998,
 'tx_bps': 13781179392.0,
 'tx_bps_L1': 18087797952.0,
 'tx_pps': 26916366.0,
 'tx_util': 45.21949488}
03/03/2021 15:52:04                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 4144094720.000000, rx_pps: 8093935.000000
03/03/2021 15:52:04                         pktgen: throughput: pps_rx 8093935.000000, bps_rx 4144094720.000000
03/03/2021 15:52:04                         pktgen: traffic completed. 
03/03/2021 15:52:04    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 15:52:04                         tester: ls -d /tmp
03/03/2021 15:52:04                         tester: /tmp
03/03/2021 15:52:04                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:52:06                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:06                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:06                         pktgen: trex port <0> not support flow control
03/03/2021 15:52:06                         pktgen: check the trex port link status
03/03/2021 15:52:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:06                         pktgen: begin traffic ......
03/03/2021 15:52:06                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:52:16                         pktgen: begin get port statistic ...
03/03/2021 15:52:16                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:52:16                         pktgen: {0: {'ibytes': 9117578624,
     'ierrors': 0,
     'ipackets': 71231083,
     'obytes': 26908054016,
     'oerrors': 0,
     'opackets': 210219193,
     'rx_bps': 7268955136.0,
     'rx_bps_L1': 8404988576.0,
     'rx_pps': 7100209.0,
     'rx_util': 21.01247144,
     'tx_bps': 21394126848.0,
     'tx_bps_L1': 24737819647.999996,
     'tx_pps': 20898080.0,
     'tx_util': 61.84454911999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.7810628414154053,
            'cpu_util': 96.15985107421875,
            'cpu_util_raw': 98.75,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141265664,
            'rx_bps': 7268955136.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 14125171712.0,
            'rx_pps': 7100209.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 21394126848.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 20898080.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 9117578624,
           'ierrors': 0,
           'ipackets': 71231083,
           'obytes': 26908054016,
           'oerrors': 0,
           'opackets': 210219193,
           'rx_bps': 7268955136.0,
           'rx_bps_L1': 8404988576.0,
           'rx_pps': 7100209.0,
           'rx_util': 21.01247144,
           'tx_bps': 21394126848.0,
           'tx_bps_L1': 24737819647.999996,
           'tx_pps': 20898080.0,
           'tx_util': 61.84454911999999}}
03/03/2021 15:52:16                         pktgen: {'ibytes': 9117578624,
 'ierrors': 0,
 'ipackets': 71231083,
 'obytes': 26908054016,
 'oerrors': 0,
 'opackets': 210219193,
 'rx_bps': 7268955136.0,
 'rx_bps_L1': 8404988576.0,
 'rx_pps': 7100209.0,
 'rx_util': 21.01247144,
 'tx_bps': 21394126848.0,
 'tx_bps_L1': 24737819647.999996,
 'tx_pps': 20898080.0,
 'tx_util': 61.84454911999999}
03/03/2021 15:52:16                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 21394126848.000000, tx_pps: 20898080.000000 
03/03/2021 15:52:16                         pktgen: {'ibytes': 9117578624,
 'ierrors': 0,
 'ipackets': 71231083,
 'obytes': 26908054016,
 'oerrors': 0,
 'opackets': 210219193,
 'rx_bps': 7268955136.0,
 'rx_bps_L1': 8404988576.0,
 'rx_pps': 7100209.0,
 'rx_util': 21.01247144,
 'tx_bps': 21394126848.0,
 'tx_bps_L1': 24737819647.999996,
 'tx_pps': 20898080.0,
 'tx_util': 61.84454911999999}
03/03/2021 15:52:16                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 7268955136.000000, rx_pps: 7100209.000000
03/03/2021 15:52:16                         pktgen: throughput: pps_rx 7100209.000000, bps_rx 7268955136.000000
03/03/2021 15:52:16                         pktgen: traffic completed. 
03/03/2021 15:52:16    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 15:52:16                         tester: ls -d /tmp
03/03/2021 15:52:16                         tester: /tmp
03/03/2021 15:52:16                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:52:18                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:18                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:18                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:18                         pktgen: trex port <0> not support flow control
03/03/2021 15:52:18                         pktgen: check the trex port link status
03/03/2021 15:52:18                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:18                         pktgen: begin traffic ......
03/03/2021 15:52:18                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:52:28                         pktgen: begin get port statistic ...
03/03/2021 15:52:28                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:52:28                         pktgen: {0: {'ibytes': 16541248000,
     'ierrors': 0,
     'ipackets': 64614250,
     'obytes': 45173245184,
     'oerrors': 0,
     'opackets': 176458005,
     'rx_bps': 13199663104.0,
     'rx_bps_L1': 14231105504.0,
     'rx_pps': 6446515.0,
     'rx_util': 35.577763759999996,
     'tx_bps': 34629607424.0,
     'tx_bps_L1': 37335688384.0,
     'tx_pps': 16913006.0,
     'tx_util': 93.33922096},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 21.76630973815918,
            'cpu_util': 19.887161254882812,
            'cpu_util_raw': 25.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 13367200,
            'rx_bps': 13199663104.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 21429944320.0,
            'rx_pps': 6446515.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 34629607424.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 16913006.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 16541248000,
           'ierrors': 0,
           'ipackets': 64614250,
           'obytes': 45173245184,
           'oerrors': 0,
           'opackets': 176458005,
           'rx_bps': 13199663104.0,
           'rx_bps_L1': 14231105504.0,
           'rx_pps': 6446515.0,
           'rx_util': 35.577763759999996,
           'tx_bps': 34629607424.0,
           'tx_bps_L1': 37335688384.0,
           'tx_pps': 16913006.0,
           'tx_util': 93.33922096}}
03/03/2021 15:52:28                         pktgen: {'ibytes': 16541248000,
 'ierrors': 0,
 'ipackets': 64614250,
 'obytes': 45173245184,
 'oerrors': 0,
 'opackets': 176458005,
 'rx_bps': 13199663104.0,
 'rx_bps_L1': 14231105504.0,
 'rx_pps': 6446515.0,
 'rx_util': 35.577763759999996,
 'tx_bps': 34629607424.0,
 'tx_bps_L1': 37335688384.0,
 'tx_pps': 16913006.0,
 'tx_util': 93.33922096}
03/03/2021 15:52:28                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 34629607424.000000, tx_pps: 16913006.000000 
03/03/2021 15:52:28                         pktgen: {'ibytes': 16541248000,
 'ierrors': 0,
 'ipackets': 64614250,
 'obytes': 45173245184,
 'oerrors': 0,
 'opackets': 176458005,
 'rx_bps': 13199663104.0,
 'rx_bps_L1': 14231105504.0,
 'rx_pps': 6446515.0,
 'rx_util': 35.577763759999996,
 'tx_bps': 34629607424.0,
 'tx_bps_L1': 37335688384.0,
 'tx_pps': 16913006.0,
 'tx_util': 93.33922096}
03/03/2021 15:52:28                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 13199663104.000000, rx_pps: 6446515.000000
03/03/2021 15:52:28                         pktgen: throughput: pps_rx 6446515.000000, bps_rx 13199663104.000000
03/03/2021 15:52:28                         pktgen: traffic completed. 
03/03/2021 15:52:28    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 15:52:28                         tester: ls -d /tmp
03/03/2021 15:52:29                         tester: /tmp
03/03/2021 15:52:29                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:52:31                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:31                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:31                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:31                         pktgen: trex port <0> not support flow control
03/03/2021 15:52:31                         pktgen: check the trex port link status
03/03/2021 15:52:31                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:31                         pktgen: begin traffic ......
03/03/2021 15:52:31                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:52:41                         pktgen: begin get port statistic ...
03/03/2021 15:52:41                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:52:41                         pktgen: {0: {'ibytes': 24366748160,
     'ierrors': 0,
     'ipackets': 47591305,
     'obytes': 48169943040,
     'oerrors': 0,
     'opackets': 94081932,
     'rx_bps': 19510374400.0,
     'rx_bps_L1': 20272685440.000004,
     'rx_pps': 4764444.0,
     'rx_util': 50.68171360000001,
     'tx_bps': 38578679808.0,
     'tx_bps_L1': 40086148448.0,
     'tx_pps': 9421679.0,
     'tx_util': 100.21537112000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.579402923583984,
            'cpu_util': 56.208282470703125,
            'cpu_util_raw': 60.5,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82709655,
            'rx_bps': 19510374400.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19068305408.0,
            'rx_pps': 4764444.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38578679808.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9421679.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 24366748160,
           'ierrors': 0,
           'ipackets': 47591305,
           'obytes': 48169943040,
           'oerrors': 0,
           'opackets': 94081932,
           'rx_bps': 19510374400.0,
           'rx_bps_L1': 20272685440.000004,
           'rx_pps': 4764444.0,
           'rx_util': 50.68171360000001,
           'tx_bps': 38578679808.0,
           'tx_bps_L1': 40086148448.0,
           'tx_pps': 9421679.0,
           'tx_util': 100.21537112000001}}
03/03/2021 15:52:41                         pktgen: {'ibytes': 24366748160,
 'ierrors': 0,
 'ipackets': 47591305,
 'obytes': 48169943040,
 'oerrors': 0,
 'opackets': 94081932,
 'rx_bps': 19510374400.0,
 'rx_bps_L1': 20272685440.000004,
 'rx_pps': 4764444.0,
 'rx_util': 50.68171360000001,
 'tx_bps': 38578679808.0,
 'tx_bps_L1': 40086148448.0,
 'tx_pps': 9421679.0,
 'tx_util': 100.21537112000001}
03/03/2021 15:52:41                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38578679808.000000, tx_pps: 9421679.000000 
03/03/2021 15:52:41                         pktgen: {'ibytes': 24366748160,
 'ierrors': 0,
 'ipackets': 47591305,
 'obytes': 48169943040,
 'oerrors': 0,
 'opackets': 94081932,
 'rx_bps': 19510374400.0,
 'rx_bps_L1': 20272685440.000004,
 'rx_pps': 4764444.0,
 'rx_util': 50.68171360000001,
 'tx_bps': 38578679808.0,
 'tx_bps_L1': 40086148448.0,
 'tx_pps': 9421679.0,
 'tx_util': 100.21537112000001}
03/03/2021 15:52:41                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 19510374400.000000, rx_pps: 4764444.000000
03/03/2021 15:52:41                         pktgen: throughput: pps_rx 4764444.000000, bps_rx 19510374400.000000
03/03/2021 15:52:41                         pktgen: traffic completed. 
03/03/2021 15:52:41    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 15:52:41                         tester: ls -d /tmp
03/03/2021 15:52:41                         tester: /tmp
03/03/2021 15:52:41                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:52:43                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:43                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:43                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:43                         pktgen: trex port <0> not support flow control
03/03/2021 15:52:43                         pktgen: check the trex port link status
03/03/2021 15:52:43                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:43                         pktgen: begin traffic ......
03/03/2021 15:52:43                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:52:53                         pktgen: begin get port statistic ...
03/03/2021 15:52:53                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:52:53                         pktgen: {0: {'ibytes': 38481252352,
     'ierrors': 0,
     'ipackets': 37579353,
     'obytes': 49093271552,
     'oerrors': 0,
     'opackets': 47942652,
     'rx_bps': 30696060928.0,
     'rx_bps_L1': 31295727488.0,
     'rx_pps': 3747916.0,
     'rx_util': 78.23931872,
     'tx_bps': 39138738176.0,
     'tx_bps_L1': 39903431776.00001,
     'tx_pps': 4779335.0,
     'tx_util': 99.75857944000002},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 16.99371337890625,
            'cpu_util': 28.78913116455078,
            'cpu_util_raw': 28.8125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36675753,
            'rx_bps': 30696060928.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8442677760.0,
            'rx_pps': 3747916.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39138738176.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4779335.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 38481252352,
           'ierrors': 0,
           'ipackets': 37579353,
           'obytes': 49093271552,
           'oerrors': 0,
           'opackets': 47942652,
           'rx_bps': 30696060928.0,
           'rx_bps_L1': 31295727488.0,
           'rx_pps': 3747916.0,
           'rx_util': 78.23931872,
           'tx_bps': 39138738176.0,
           'tx_bps_L1': 39903431776.00001,
           'tx_pps': 4779335.0,
           'tx_util': 99.75857944000002}}
03/03/2021 15:52:53                         pktgen: {'ibytes': 38481252352,
 'ierrors': 0,
 'ipackets': 37579353,
 'obytes': 49093271552,
 'oerrors': 0,
 'opackets': 47942652,
 'rx_bps': 30696060928.0,
 'rx_bps_L1': 31295727488.0,
 'rx_pps': 3747916.0,
 'rx_util': 78.23931872,
 'tx_bps': 39138738176.0,
 'tx_bps_L1': 39903431776.00001,
 'tx_pps': 4779335.0,
 'tx_util': 99.75857944000002}
03/03/2021 15:52:53                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39138738176.000000, tx_pps: 4779335.000000 
03/03/2021 15:52:53                         pktgen: {'ibytes': 38481252352,
 'ierrors': 0,
 'ipackets': 37579353,
 'obytes': 49093271552,
 'oerrors': 0,
 'opackets': 47942652,
 'rx_bps': 30696060928.0,
 'rx_bps_L1': 31295727488.0,
 'rx_pps': 3747916.0,
 'rx_util': 78.23931872,
 'tx_bps': 39138738176.0,
 'tx_bps_L1': 39903431776.00001,
 'tx_pps': 4779335.0,
 'tx_util': 99.75857944000002}
03/03/2021 15:52:53                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 30696060928.000000, rx_pps: 3747916.000000
03/03/2021 15:52:53                         pktgen: throughput: pps_rx 3747916.000000, bps_rx 30696060928.000000
03/03/2021 15:52:53                         pktgen: traffic completed. 
03/03/2021 15:52:53    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 15:52:53                         tester: ls -d /tmp
03/03/2021 15:52:53                         tester: /tmp
03/03/2021 15:52:53                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:52:55                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:55                         pktgen: test port 0 map gen port 0
03/03/2021 15:52:55                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:55                         pktgen: trex port <0> not support flow control
03/03/2021 15:52:55                         pktgen: check the trex port link status
03/03/2021 15:52:55                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:52:55                         pktgen: begin traffic ......
03/03/2021 15:52:55                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:53:05                         pktgen: begin get port statistic ...
03/03/2021 15:53:05                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:53:05                         pktgen: {0: {'ibytes': 48930003672,
     'ierrors': 0,
     'ipackets': 32233207,
     'obytes': 49400903970,
     'oerrors': 0,
     'opackets': 32543418,
     'rx_bps': 39086673920.0,
     'rx_bps_L1': 39601715560.00001,
     'rx_pps': 3219010.25,
     'rx_util': 99.00428890000002,
     'tx_bps': 39482417152.0,
     'tx_bps_L1': 40002690712.0,
     'tx_pps': 3251709.75,
     'tx_util': 100.00672678},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.273677825927734,
            'cpu_util': 14.399686813354492,
            'cpu_util_raw': 14.6875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17131439,
            'rx_bps': 39086673920.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3219010.25,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39482417152.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3251709.75},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 48930003672,
           'ierrors': 0,
           'ipackets': 32233207,
           'obytes': 49400903970,
           'oerrors': 0,
           'opackets': 32543418,
           'rx_bps': 39086673920.0,
           'rx_bps_L1': 39601715560.00001,
           'rx_pps': 3219010.25,
           'rx_util': 99.00428890000002,
           'tx_bps': 39482417152.0,
           'tx_bps_L1': 40002690712.0,
           'tx_pps': 3251709.75,
           'tx_util': 100.00672678}}
03/03/2021 15:53:05                         pktgen: {'ibytes': 48930003672,
 'ierrors': 0,
 'ipackets': 32233207,
 'obytes': 49400903970,
 'oerrors': 0,
 'opackets': 32543418,
 'rx_bps': 39086673920.0,
 'rx_bps_L1': 39601715560.00001,
 'rx_pps': 3219010.25,
 'rx_util': 99.00428890000002,
 'tx_bps': 39482417152.0,
 'tx_bps_L1': 40002690712.0,
 'tx_pps': 3251709.75,
 'tx_util': 100.00672678}
03/03/2021 15:53:05                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39482417152.000000, tx_pps: 3251709.750000 
03/03/2021 15:53:05                         pktgen: {'ibytes': 48930003672,
 'ierrors': 0,
 'ipackets': 32233207,
 'obytes': 49400903970,
 'oerrors': 0,
 'opackets': 32543418,
 'rx_bps': 39086673920.0,
 'rx_bps_L1': 39601715560.00001,
 'rx_pps': 3219010.25,
 'rx_util': 99.00428890000002,
 'tx_bps': 39482417152.0,
 'tx_bps_L1': 40002690712.0,
 'tx_pps': 3251709.75,
 'tx_util': 100.00672678}
03/03/2021 15:53:05                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39086673920.000000, rx_pps: 3219010.250000
03/03/2021 15:53:05                         pktgen: throughput: pps_rx 3219010.250000, bps_rx 39086673920.000000
03/03/2021 15:53:05                         pktgen: traffic completed. 
03/03/2021 15:53:07    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 15:53:07    TestPVPMultiPathPerformance: 
+-------+---------------------+-------+------------+
| Frame |    Mode/RXD-TXD     | Mpps  | % linerate |
+=======+=====================+=======+============+
| 64    | inoder mergeable on | 8.094 | 13.598     |
+-------+---------------------+-------+------------+
| 128   | inoder mergeable on | 7.100 | 21.017     |
+-------+---------------------+-------+------------+
| 256   | inoder mergeable on | 6.447 | 35.585     |
+-------+---------------------+-------+------------+
| 512   | inoder mergeable on | 4.764 | 50.694     |
+-------+---------------------+-------+------------+
| 1024  | inoder mergeable on | 3.748 | 78.256     |
+-------+---------------------+-------+------------+
| 1518  | inoder mergeable on | 3.219 | 99.017     |
+-------+---------------------+-------+------------+
03/03/2021 15:53:07    TestPVPMultiPathPerformance: 
+-------+--------------+------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps    | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+============+============+=====================+=======================+
| 64    | 1024         | 8.094 Mpps | 13.598%    | 8.054 Mpps          | 0.040 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.219 Mpps | 99.017%    | 3.227 Mpps          | -0.008 Mpps           |
+-------+--------------+------------+------------+---------------------+-----------------------+
03/03/2021 15:53:07    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.402700
03/03/2021 15:53:07    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.040000
03/03/2021 15:53:07    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.161350
03/03/2021 15:53:07    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.008000
03/03/2021 15:53:07    TestPVPMultiPathPerformance: Test Case test_perf_pvp_inorder_mergeable Result PASSED:
03/03/2021 15:53:07             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 15:53:08    TestPVPMultiPathPerformance: Test Case test_perf_pvp_inorder_normal Begin
03/03/2021 15:53:08             dut.10.240.183.220: 
03/03/2021 15:53:08                         tester: 
03/03/2021 15:53:08             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:53:08             dut.10.240.183.220: 
03/03/2021 15:53:08             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:53:08             dut.10.240.183.220: 
03/03/2021 15:53:08             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:53:08             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:53:08             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:53:08             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:53:20             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:53:20             dut.10.240.183.220: 1048576
03/03/2021 15:53:31    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 15:53:31                         tester: ls -d /tmp
03/03/2021 15:53:31                         tester: /tmp
03/03/2021 15:53:31                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:53:33                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:33                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:33                         pktgen: trex port <0> not support flow control
03/03/2021 15:53:33                         pktgen: check the trex port link status
03/03/2021 15:53:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:33                         pktgen: begin traffic ......
03/03/2021 15:53:33                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:53:43                         pktgen: begin get port statistic ...
03/03/2021 15:53:43                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:53:43                         pktgen: {0: {'ibytes': 5370566656,
     'ierrors': 0,
     'ipackets': 83915104,
     'obytes': 17430125440,
     'oerrors': 0,
     'opackets': 272345738,
     'rx_bps': 4298637312.0,
     'rx_bps_L1': 5641961472.0,
     'rx_pps': 8395776.0,
     'rx_util': 14.10490368,
     'tx_bps': 13978252288.0,
     'tx_bps_L1': 18346455168.0,
     'tx_pps': 27301268.0,
     'tx_util': 45.86613792},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.86433744430542,
            'cpu_util': 93.7213134765625,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 138815533,
            'rx_bps': 4298637312.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9679614976.0,
            'rx_pps': 8395776.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13978252288.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 27301268.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 5370566656,
           'ierrors': 0,
           'ipackets': 83915104,
           'obytes': 17430125440,
           'oerrors': 0,
           'opackets': 272345738,
           'rx_bps': 4298637312.0,
           'rx_bps_L1': 5641961472.0,
           'rx_pps': 8395776.0,
           'rx_util': 14.10490368,
           'tx_bps': 13978252288.0,
           'tx_bps_L1': 18346455168.0,
           'tx_pps': 27301268.0,
           'tx_util': 45.86613792}}
03/03/2021 15:53:43                         pktgen: {'ibytes': 5370566656,
 'ierrors': 0,
 'ipackets': 83915104,
 'obytes': 17430125440,
 'oerrors': 0,
 'opackets': 272345738,
 'rx_bps': 4298637312.0,
 'rx_bps_L1': 5641961472.0,
 'rx_pps': 8395776.0,
 'rx_util': 14.10490368,
 'tx_bps': 13978252288.0,
 'tx_bps_L1': 18346455168.0,
 'tx_pps': 27301268.0,
 'tx_util': 45.86613792}
03/03/2021 15:53:43                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13978252288.000000, tx_pps: 27301268.000000 
03/03/2021 15:53:43                         pktgen: {'ibytes': 5370566656,
 'ierrors': 0,
 'ipackets': 83915104,
 'obytes': 17430125440,
 'oerrors': 0,
 'opackets': 272345738,
 'rx_bps': 4298637312.0,
 'rx_bps_L1': 5641961472.0,
 'rx_pps': 8395776.0,
 'rx_util': 14.10490368,
 'tx_bps': 13978252288.0,
 'tx_bps_L1': 18346455168.0,
 'tx_pps': 27301268.0,
 'tx_util': 45.86613792}
03/03/2021 15:53:43                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 4298637312.000000, rx_pps: 8395776.000000
03/03/2021 15:53:43                         pktgen: throughput: pps_rx 8395776.000000, bps_rx 4298637312.000000
03/03/2021 15:53:43                         pktgen: traffic completed. 
03/03/2021 15:53:43    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 15:53:43                         tester: ls -d /tmp
03/03/2021 15:53:43                         tester: /tmp
03/03/2021 15:53:43                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:53:45                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:45                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:45                         pktgen: trex port <0> not support flow control
03/03/2021 15:53:45                         pktgen: check the trex port link status
03/03/2021 15:53:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:45                         pktgen: begin traffic ......
03/03/2021 15:53:45                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:53:55                         pktgen: begin get port statistic ...
03/03/2021 15:53:55                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:53:55                         pktgen: {0: {'ibytes': 9398627712,
     'ierrors': 0,
     'ipackets': 73426779,
     'obytes': 27780903296,
     'oerrors': 0,
     'opackets': 217038328,
     'rx_bps': 7493254656.0,
     'rx_bps_L1': 8664328736.0,
     'rx_pps': 7319213.0,
     'rx_util': 21.66082184,
     'tx_bps': 21744332800.0,
     'tx_bps_L1': 25142712960.0,
     'tx_pps': 21239876.0,
     'tx_util': 62.8567824},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.810894250869751,
            'cpu_util': 96.69668579101562,
            'cpu_util_raw': 99.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141655203,
            'rx_bps': 7493254656.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 14251077632.0,
            'rx_pps': 7319213.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 21744332800.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21239876.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 9398627712,
           'ierrors': 0,
           'ipackets': 73426779,
           'obytes': 27780903296,
           'oerrors': 0,
           'opackets': 217038328,
           'rx_bps': 7493254656.0,
           'rx_bps_L1': 8664328736.0,
           'rx_pps': 7319213.0,
           'rx_util': 21.66082184,
           'tx_bps': 21744332800.0,
           'tx_bps_L1': 25142712960.0,
           'tx_pps': 21239876.0,
           'tx_util': 62.8567824}}
03/03/2021 15:53:55                         pktgen: {'ibytes': 9398627712,
 'ierrors': 0,
 'ipackets': 73426779,
 'obytes': 27780903296,
 'oerrors': 0,
 'opackets': 217038328,
 'rx_bps': 7493254656.0,
 'rx_bps_L1': 8664328736.0,
 'rx_pps': 7319213.0,
 'rx_util': 21.66082184,
 'tx_bps': 21744332800.0,
 'tx_bps_L1': 25142712960.0,
 'tx_pps': 21239876.0,
 'tx_util': 62.8567824}
03/03/2021 15:53:55                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 21744332800.000000, tx_pps: 21239876.000000 
03/03/2021 15:53:55                         pktgen: {'ibytes': 9398627712,
 'ierrors': 0,
 'ipackets': 73426779,
 'obytes': 27780903296,
 'oerrors': 0,
 'opackets': 217038328,
 'rx_bps': 7493254656.0,
 'rx_bps_L1': 8664328736.0,
 'rx_pps': 7319213.0,
 'rx_util': 21.66082184,
 'tx_bps': 21744332800.0,
 'tx_bps_L1': 25142712960.0,
 'tx_pps': 21239876.0,
 'tx_util': 62.8567824}
03/03/2021 15:53:55                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 7493254656.000000, rx_pps: 7319213.000000
03/03/2021 15:53:55                         pktgen: throughput: pps_rx 7319213.000000, bps_rx 7493254656.000000
03/03/2021 15:53:55                         pktgen: traffic completed. 
03/03/2021 15:53:55    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 15:53:55                         tester: ls -d /tmp
03/03/2021 15:53:55                         tester: /tmp
03/03/2021 15:53:55                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:53:57                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:57                         pktgen: test port 0 map gen port 0
03/03/2021 15:53:57                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:57                         pktgen: trex port <0> not support flow control
03/03/2021 15:53:57                         pktgen: check the trex port link status
03/03/2021 15:53:57                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:53:57                         pktgen: begin traffic ......
03/03/2021 15:53:57                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:54:07                         pktgen: begin get port statistic ...
03/03/2021 15:54:07                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:54:07                         pktgen: {0: {'ibytes': 17082976512,
     'ierrors': 0,
     'ipackets': 66730378,
     'obytes': 44344318208,
     'oerrors': 0,
     'opackets': 173220016,
     'rx_bps': 13628497920.0,
     'rx_bps_L1': 14693438240.0,
     'rx_pps': 6655877.0,
     'rx_util': 36.7335956,
     'tx_bps': 34332801024.0,
     'tx_bps_L1': 37015670784.0,
     'tx_pps': 16767936.0,
     'tx_util': 92.53917696},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.704801559448242,
            'cpu_util': 24.2397518157959,
            'cpu_util_raw': 26.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 21327822,
            'rx_bps': 13628497920.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 20704303104.0,
            'rx_pps': 6655877.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 34332801024.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 16767936.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 17082976512,
           'ierrors': 0,
           'ipackets': 66730378,
           'obytes': 44344318208,
           'oerrors': 0,
           'opackets': 173220016,
           'rx_bps': 13628497920.0,
           'rx_bps_L1': 14693438240.0,
           'rx_pps': 6655877.0,
           'rx_util': 36.7335956,
           'tx_bps': 34332801024.0,
           'tx_bps_L1': 37015670784.0,
           'tx_pps': 16767936.0,
           'tx_util': 92.53917696}}
03/03/2021 15:54:07                         pktgen: {'ibytes': 17082976512,
 'ierrors': 0,
 'ipackets': 66730378,
 'obytes': 44344318208,
 'oerrors': 0,
 'opackets': 173220016,
 'rx_bps': 13628497920.0,
 'rx_bps_L1': 14693438240.0,
 'rx_pps': 6655877.0,
 'rx_util': 36.7335956,
 'tx_bps': 34332801024.0,
 'tx_bps_L1': 37015670784.0,
 'tx_pps': 16767936.0,
 'tx_util': 92.53917696}
03/03/2021 15:54:07                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 34332801024.000000, tx_pps: 16767936.000000 
03/03/2021 15:54:07                         pktgen: {'ibytes': 17082976512,
 'ierrors': 0,
 'ipackets': 66730378,
 'obytes': 44344318208,
 'oerrors': 0,
 'opackets': 173220016,
 'rx_bps': 13628497920.0,
 'rx_bps_L1': 14693438240.0,
 'rx_pps': 6655877.0,
 'rx_util': 36.7335956,
 'tx_bps': 34332801024.0,
 'tx_bps_L1': 37015670784.0,
 'tx_pps': 16767936.0,
 'tx_util': 92.53917696}
03/03/2021 15:54:07                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 13628497920.000000, rx_pps: 6655877.000000
03/03/2021 15:54:07                         pktgen: throughput: pps_rx 6655877.000000, bps_rx 13628497920.000000
03/03/2021 15:54:07                         pktgen: traffic completed. 
03/03/2021 15:54:07    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 15:54:07                         tester: ls -d /tmp
03/03/2021 15:54:07                         tester: /tmp
03/03/2021 15:54:07                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:54:09                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:09                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:09                         pktgen: trex port <0> not support flow control
03/03/2021 15:54:09                         pktgen: check the trex port link status
03/03/2021 15:54:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:09                         pktgen: begin traffic ......
03/03/2021 15:54:09                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:54:19                         pktgen: begin get port statistic ...
03/03/2021 15:54:19                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:54:19                         pktgen: {0: {'ibytes': 24309069824,
     'ierrors': 0,
     'ipackets': 47478652,
     'obytes': 48170060288,
     'oerrors': 0,
     'opackets': 94082160,
     'rx_bps': 19526156288.0,
     'rx_bps_L1': 20289083728.0,
     'rx_pps': 4768296.5,
     'rx_util': 50.72270932000001,
     'tx_bps': 38579752960.0,
     'tx_bps_L1': 40087239200.0,
     'tx_pps': 9421789.0,
     'tx_util': 100.21809800000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.552921295166016,
            'cpu_util': 56.38388442993164,
            'cpu_util_raw': 59.6875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82435916,
            'rx_bps': 19526156288.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19053596672.0,
            'rx_pps': 4768296.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38579752960.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9421789.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 24309069824,
           'ierrors': 0,
           'ipackets': 47478652,
           'obytes': 48170060288,
           'oerrors': 0,
           'opackets': 94082160,
           'rx_bps': 19526156288.0,
           'rx_bps_L1': 20289083728.0,
           'rx_pps': 4768296.5,
           'rx_util': 50.72270932000001,
           'tx_bps': 38579752960.0,
           'tx_bps_L1': 40087239200.0,
           'tx_pps': 9421789.0,
           'tx_util': 100.21809800000001}}
03/03/2021 15:54:19                         pktgen: {'ibytes': 24309069824,
 'ierrors': 0,
 'ipackets': 47478652,
 'obytes': 48170060288,
 'oerrors': 0,
 'opackets': 94082160,
 'rx_bps': 19526156288.0,
 'rx_bps_L1': 20289083728.0,
 'rx_pps': 4768296.5,
 'rx_util': 50.72270932000001,
 'tx_bps': 38579752960.0,
 'tx_bps_L1': 40087239200.0,
 'tx_pps': 9421789.0,
 'tx_util': 100.21809800000001}
03/03/2021 15:54:19                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38579752960.000000, tx_pps: 9421789.000000 
03/03/2021 15:54:19                         pktgen: {'ibytes': 24309069824,
 'ierrors': 0,
 'ipackets': 47478652,
 'obytes': 48170060288,
 'oerrors': 0,
 'opackets': 94082160,
 'rx_bps': 19526156288.0,
 'rx_bps_L1': 20289083728.0,
 'rx_pps': 4768296.5,
 'rx_util': 50.72270932000001,
 'tx_bps': 38579752960.0,
 'tx_bps_L1': 40087239200.0,
 'tx_pps': 9421789.0,
 'tx_util': 100.21809800000001}
03/03/2021 15:54:19                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 19526156288.000000, rx_pps: 4768296.500000
03/03/2021 15:54:19                         pktgen: throughput: pps_rx 4768296.500000, bps_rx 19526156288.000000
03/03/2021 15:54:19                         pktgen: traffic completed. 
03/03/2021 15:54:19    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 15:54:19                         tester: ls -d /tmp
03/03/2021 15:54:20                         tester: /tmp
03/03/2021 15:54:20                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:54:21                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:21                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:22                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:22                         pktgen: trex port <0> not support flow control
03/03/2021 15:54:22                         pktgen: check the trex port link status
03/03/2021 15:54:22                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:22                         pktgen: begin traffic ......
03/03/2021 15:54:22                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:54:32                         pktgen: begin get port statistic ...
03/03/2021 15:54:32                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:54:32                         pktgen: {0: {'ibytes': 38725100544,
     'ierrors': 0,
     'ipackets': 37817482,
     'obytes': 49092542464,
     'oerrors': 0,
     'opackets': 47941942,
     'rx_bps': 30892634112.0,
     'rx_bps_L1': 31496134192.0,
     'rx_pps': 3771875.5,
     'rx_util': 78.74033548,
     'tx_bps': 39137402880.0,
     'tx_bps_L1': 39902058720.0,
     'tx_pps': 4779099.0,
     'tx_util': 99.7551468},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 16.84234046936035,
            'cpu_util': 29.046884536743164,
            'cpu_util_raw': 30.4375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 37025668,
            'rx_bps': 30892634112.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8244767744.0,
            'rx_pps': 3771875.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39137402880.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4779099.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 38725100544,
           'ierrors': 0,
           'ipackets': 37817482,
           'obytes': 49092542464,
           'oerrors': 0,
           'opackets': 47941942,
           'rx_bps': 30892634112.0,
           'rx_bps_L1': 31496134192.0,
           'rx_pps': 3771875.5,
           'rx_util': 78.74033548,
           'tx_bps': 39137402880.0,
           'tx_bps_L1': 39902058720.0,
           'tx_pps': 4779099.0,
           'tx_util': 99.7551468}}
03/03/2021 15:54:32                         pktgen: {'ibytes': 38725100544,
 'ierrors': 0,
 'ipackets': 37817482,
 'obytes': 49092542464,
 'oerrors': 0,
 'opackets': 47941942,
 'rx_bps': 30892634112.0,
 'rx_bps_L1': 31496134192.0,
 'rx_pps': 3771875.5,
 'rx_util': 78.74033548,
 'tx_bps': 39137402880.0,
 'tx_bps_L1': 39902058720.0,
 'tx_pps': 4779099.0,
 'tx_util': 99.7551468}
03/03/2021 15:54:32                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39137402880.000000, tx_pps: 4779099.000000 
03/03/2021 15:54:32                         pktgen: {'ibytes': 38725100544,
 'ierrors': 0,
 'ipackets': 37817482,
 'obytes': 49092542464,
 'oerrors': 0,
 'opackets': 47941942,
 'rx_bps': 30892634112.0,
 'rx_bps_L1': 31496134192.0,
 'rx_pps': 3771875.5,
 'rx_util': 78.74033548,
 'tx_bps': 39137402880.0,
 'tx_bps_L1': 39902058720.0,
 'tx_pps': 4779099.0,
 'tx_util': 99.7551468}
03/03/2021 15:54:32                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 30892634112.000000, rx_pps: 3771875.500000
03/03/2021 15:54:32                         pktgen: throughput: pps_rx 3771875.500000, bps_rx 30892634112.000000
03/03/2021 15:54:32                         pktgen: traffic completed. 
03/03/2021 15:54:32    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 15:54:32                         tester: ls -d /tmp
03/03/2021 15:54:32                         tester: /tmp
03/03/2021 15:54:32                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:54:34                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:34                         pktgen: test port 0 map gen port 0
03/03/2021 15:54:34                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:34                         pktgen: trex port <0> not support flow control
03/03/2021 15:54:34                         pktgen: check the trex port link status
03/03/2021 15:54:34                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:54:34                         pktgen: begin traffic ......
03/03/2021 15:54:34                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:54:44                         pktgen: begin get port statistic ...
03/03/2021 15:54:44                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:54:44                         pktgen: {0: {'ibytes': 49079321742,
     'ierrors': 0,
     'ipackets': 32331572,
     'obytes': 49399568130,
     'oerrors': 0,
     'opackets': 32542540,
     'rx_bps': 39169818624.0,
     'rx_bps_L1': 39685953864.00001,
     'rx_pps': 3225845.25,
     'rx_util': 99.21488466000002,
     'tx_bps': 39403937792.0,
     'tx_bps_L1': 39923174552.0,
     'tx_pps': 3245229.75,
     'tx_util': 99.80793638},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.10551071166992,
            'cpu_util': 14.441924095153809,
            'cpu_util_raw': 14.9375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17169473,
            'rx_bps': 39169818624.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3225845.25,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39403937792.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3245229.75},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49079321742,
           'ierrors': 0,
           'ipackets': 32331572,
           'obytes': 49399568130,
           'oerrors': 0,
           'opackets': 32542540,
           'rx_bps': 39169818624.0,
           'rx_bps_L1': 39685953864.00001,
           'rx_pps': 3225845.25,
           'rx_util': 99.21488466000002,
           'tx_bps': 39403937792.0,
           'tx_bps_L1': 39923174552.0,
           'tx_pps': 3245229.75,
           'tx_util': 99.80793638}}
03/03/2021 15:54:44                         pktgen: {'ibytes': 49079321742,
 'ierrors': 0,
 'ipackets': 32331572,
 'obytes': 49399568130,
 'oerrors': 0,
 'opackets': 32542540,
 'rx_bps': 39169818624.0,
 'rx_bps_L1': 39685953864.00001,
 'rx_pps': 3225845.25,
 'rx_util': 99.21488466000002,
 'tx_bps': 39403937792.0,
 'tx_bps_L1': 39923174552.0,
 'tx_pps': 3245229.75,
 'tx_util': 99.80793638}
03/03/2021 15:54:44                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39403937792.000000, tx_pps: 3245229.750000 
03/03/2021 15:54:44                         pktgen: {'ibytes': 49079321742,
 'ierrors': 0,
 'ipackets': 32331572,
 'obytes': 49399568130,
 'oerrors': 0,
 'opackets': 32542540,
 'rx_bps': 39169818624.0,
 'rx_bps_L1': 39685953864.00001,
 'rx_pps': 3225845.25,
 'rx_util': 99.21488466000002,
 'tx_bps': 39403937792.0,
 'tx_bps_L1': 39923174552.0,
 'tx_pps': 3245229.75,
 'tx_util': 99.80793638}
03/03/2021 15:54:44                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39169818624.000000, rx_pps: 3225845.250000
03/03/2021 15:54:44                         pktgen: throughput: pps_rx 3225845.250000, bps_rx 39169818624.000000
03/03/2021 15:54:44                         pktgen: traffic completed. 
03/03/2021 15:54:46    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 15:54:46    TestPVPMultiPathPerformance: 
+-------+----------------------+-------+------------+
| Frame |     Mode/RXD-TXD     | Mpps  | % linerate |
+=======+======================+=======+============+
| 64    | inoder mergeable off | 8.396 | 14.105     |
+-------+----------------------+-------+------------+
| 128   | inoder mergeable off | 7.319 | 21.665     |
+-------+----------------------+-------+------------+
| 256   | inoder mergeable off | 6.656 | 36.740     |
+-------+----------------------+-------+------------+
| 512   | inoder mergeable off | 4.768 | 50.735     |
+-------+----------------------+-------+------------+
| 1024  | inoder mergeable off | 3.772 | 78.757     |
+-------+----------------------+-------+------------+
| 1518  | inoder mergeable off | 3.226 | 99.227     |
+-------+----------------------+-------+------------+
03/03/2021 15:54:46    TestPVPMultiPathPerformance: 
+-------+--------------+------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps    | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+============+============+=====================+=======================+
| 64    | 1024         | 8.396 Mpps | 14.105%    | 8.247 Mpps          | 0.149 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.226 Mpps | 99.227%    | 3.215 Mpps          | 0.011 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
03/03/2021 15:54:46    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.412350
03/03/2021 15:54:46    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.149000
03/03/2021 15:54:46    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.160750
03/03/2021 15:54:46    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.011000
03/03/2021 15:54:46    TestPVPMultiPathPerformance: Test Case test_perf_pvp_inorder_normal Result PASSED:
03/03/2021 15:54:46             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 15:54:47    TestPVPMultiPathPerformance: Test Case test_perf_pvp_mergeable Begin
03/03/2021 15:54:47             dut.10.240.183.220: 
03/03/2021 15:54:47                         tester: 
03/03/2021 15:54:47             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:54:47             dut.10.240.183.220: 
03/03/2021 15:54:47             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:54:47             dut.10.240.183.220: 
03/03/2021 15:54:47             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:54:47             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:54:47             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:54:47             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:54:58             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:54:59             dut.10.240.183.220: 1048576
03/03/2021 15:55:10    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 15:55:10                         tester: ls -d /tmp
03/03/2021 15:55:10                         tester: /tmp
03/03/2021 15:55:10                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:55:12                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:12                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:12                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:12                         pktgen: trex port <0> not support flow control
03/03/2021 15:55:12                         pktgen: check the trex port link status
03/03/2021 15:55:12                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:12                         pktgen: begin traffic ......
03/03/2021 15:55:12                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:55:22                         pktgen: begin get port statistic ...
03/03/2021 15:55:22                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:55:22                         pktgen: {0: {'ibytes': 5263575040,
     'ierrors': 0,
     'ipackets': 82243360,
     'obytes': 16074418304,
     'oerrors': 0,
     'opackets': 251162806,
     'rx_bps': 4176610304.0,
     'rx_bps_L1': 5481799744.0,
     'rx_pps': 8157434.0,
     'rx_util': 13.70449936,
     'tx_bps': 12409989120.0,
     'tx_bps_L1': 16288110720.0,
     'tx_pps': 24238260.0,
     'tx_util': 40.7202768},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.6525923013687134,
            'cpu_util': 93.86759185791016,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 140034445,
            'rx_bps': 4176610304.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8233378816.0,
            'rx_pps': 8157434.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 12409989120.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 24238260.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 5263575040,
           'ierrors': 0,
           'ipackets': 82243360,
           'obytes': 16074418304,
           'oerrors': 0,
           'opackets': 251162806,
           'rx_bps': 4176610304.0,
           'rx_bps_L1': 5481799744.0,
           'rx_pps': 8157434.0,
           'rx_util': 13.70449936,
           'tx_bps': 12409989120.0,
           'tx_bps_L1': 16288110720.0,
           'tx_pps': 24238260.0,
           'tx_util': 40.7202768}}
03/03/2021 15:55:22                         pktgen: {'ibytes': 5263575040,
 'ierrors': 0,
 'ipackets': 82243360,
 'obytes': 16074418304,
 'oerrors': 0,
 'opackets': 251162806,
 'rx_bps': 4176610304.0,
 'rx_bps_L1': 5481799744.0,
 'rx_pps': 8157434.0,
 'rx_util': 13.70449936,
 'tx_bps': 12409989120.0,
 'tx_bps_L1': 16288110720.0,
 'tx_pps': 24238260.0,
 'tx_util': 40.7202768}
03/03/2021 15:55:22                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 12409989120.000000, tx_pps: 24238260.000000 
03/03/2021 15:55:22                         pktgen: {'ibytes': 5263575040,
 'ierrors': 0,
 'ipackets': 82243360,
 'obytes': 16074418304,
 'oerrors': 0,
 'opackets': 251162806,
 'rx_bps': 4176610304.0,
 'rx_bps_L1': 5481799744.0,
 'rx_pps': 8157434.0,
 'rx_util': 13.70449936,
 'tx_bps': 12409989120.0,
 'tx_bps_L1': 16288110720.0,
 'tx_pps': 24238260.0,
 'tx_util': 40.7202768}
03/03/2021 15:55:22                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 4176610304.000000, rx_pps: 8157434.000000
03/03/2021 15:55:22                         pktgen: throughput: pps_rx 8157434.000000, bps_rx 4176610304.000000
03/03/2021 15:55:22                         pktgen: traffic completed. 
03/03/2021 15:55:22    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 15:55:22                         tester: ls -d /tmp
03/03/2021 15:55:22                         tester: /tmp
03/03/2021 15:55:22                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:55:24                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:24                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:24                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:24                         pktgen: trex port <0> not support flow control
03/03/2021 15:55:24                         pktgen: check the trex port link status
03/03/2021 15:55:24                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:24                         pktgen: begin traffic ......
03/03/2021 15:55:24                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:55:34                         pktgen: begin get port statistic ...
03/03/2021 15:55:34                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:55:34                         pktgen: {0: {'ibytes': 9161493248,
     'ierrors': 0,
     'ipackets': 71574166,
     'obytes': 26557512448,
     'oerrors': 0,
     'opackets': 207480580,
     'rx_bps': 7295172608.0,
     'rx_bps_L1': 8435288368.000001,
     'rx_pps': 7125723.5,
     'rx_util': 21.088220920000005,
     'tx_bps': 20224081920.0,
     'tx_bps_L1': 23384814080.0,
     'tx_pps': 19754576.0,
     'tx_util': 58.462035199999995},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.6435036659240723,
            'cpu_util': 95.63105010986328,
            'cpu_util_raw': 99.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141574530,
            'rx_bps': 7295172608.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12928909312.0,
            'rx_pps': 7125723.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 20224081920.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 19754576.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 9161493248,
           'ierrors': 0,
           'ipackets': 71574166,
           'obytes': 26557512448,
           'oerrors': 0,
           'opackets': 207480580,
           'rx_bps': 7295172608.0,
           'rx_bps_L1': 8435288368.000001,
           'rx_pps': 7125723.5,
           'rx_util': 21.088220920000005,
           'tx_bps': 20224081920.0,
           'tx_bps_L1': 23384814080.0,
           'tx_pps': 19754576.0,
           'tx_util': 58.462035199999995}}
03/03/2021 15:55:34                         pktgen: {'ibytes': 9161493248,
 'ierrors': 0,
 'ipackets': 71574166,
 'obytes': 26557512448,
 'oerrors': 0,
 'opackets': 207480580,
 'rx_bps': 7295172608.0,
 'rx_bps_L1': 8435288368.000001,
 'rx_pps': 7125723.5,
 'rx_util': 21.088220920000005,
 'tx_bps': 20224081920.0,
 'tx_bps_L1': 23384814080.0,
 'tx_pps': 19754576.0,
 'tx_util': 58.462035199999995}
03/03/2021 15:55:34                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 20224081920.000000, tx_pps: 19754576.000000 
03/03/2021 15:55:34                         pktgen: {'ibytes': 9161493248,
 'ierrors': 0,
 'ipackets': 71574166,
 'obytes': 26557512448,
 'oerrors': 0,
 'opackets': 207480580,
 'rx_bps': 7295172608.0,
 'rx_bps_L1': 8435288368.000001,
 'rx_pps': 7125723.5,
 'rx_util': 21.088220920000005,
 'tx_bps': 20224081920.0,
 'tx_bps_L1': 23384814080.0,
 'tx_pps': 19754576.0,
 'tx_util': 58.462035199999995}
03/03/2021 15:55:34                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 7295172608.000000, rx_pps: 7125723.500000
03/03/2021 15:55:34                         pktgen: throughput: pps_rx 7125723.500000, bps_rx 7295172608.000000
03/03/2021 15:55:34                         pktgen: traffic completed. 
03/03/2021 15:55:34    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 15:55:34                         tester: ls -d /tmp
03/03/2021 15:55:34                         tester: /tmp
03/03/2021 15:55:34                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:55:36                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:36                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:36                         pktgen: trex port <0> not support flow control
03/03/2021 15:55:36                         pktgen: check the trex port link status
03/03/2021 15:55:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:36                         pktgen: begin traffic ......
03/03/2021 15:55:36                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:55:46                         pktgen: begin get port statistic ...
03/03/2021 15:55:46                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:55:46                         pktgen: {0: {'ibytes': 16611887360,
     'ierrors': 0,
     'ipackets': 64890185,
     'obytes': 39262063104,
     'oerrors': 0,
     'opackets': 153367457,
     'rx_bps': 13237852160.0,
     'rx_bps_L1': 14272265280.000002,
     'rx_pps': 6465082.0,
     'rx_util': 35.680663200000005,
     'tx_bps': 31129597952.0,
     'tx_bps_L1': 33562168032.000004,
     'tx_pps': 15203563.0,
     'tx_util': 83.90542008000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 7.308775901794434,
            'cpu_util': 53.2401008605957,
            'cpu_util_raw': 40.5625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 75839709,
            'rx_bps': 13237852160.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 17891745792.0,
            'rx_pps': 6465082.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 31129597952.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 15203563.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 16611887360,
           'ierrors': 0,
           'ipackets': 64890185,
           'obytes': 39262063104,
           'oerrors': 0,
           'opackets': 153367457,
           'rx_bps': 13237852160.0,
           'rx_bps_L1': 14272265280.000002,
           'rx_pps': 6465082.0,
           'rx_util': 35.680663200000005,
           'tx_bps': 31129597952.0,
           'tx_bps_L1': 33562168032.000004,
           'tx_pps': 15203563.0,
           'tx_util': 83.90542008000001}}
03/03/2021 15:55:46                         pktgen: {'ibytes': 16611887360,
 'ierrors': 0,
 'ipackets': 64890185,
 'obytes': 39262063104,
 'oerrors': 0,
 'opackets': 153367457,
 'rx_bps': 13237852160.0,
 'rx_bps_L1': 14272265280.000002,
 'rx_pps': 6465082.0,
 'rx_util': 35.680663200000005,
 'tx_bps': 31129597952.0,
 'tx_bps_L1': 33562168032.000004,
 'tx_pps': 15203563.0,
 'tx_util': 83.90542008000001}
03/03/2021 15:55:46                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 31129597952.000000, tx_pps: 15203563.000000 
03/03/2021 15:55:46                         pktgen: {'ibytes': 16611887360,
 'ierrors': 0,
 'ipackets': 64890185,
 'obytes': 39262063104,
 'oerrors': 0,
 'opackets': 153367457,
 'rx_bps': 13237852160.0,
 'rx_bps_L1': 14272265280.000002,
 'rx_pps': 6465082.0,
 'rx_util': 35.680663200000005,
 'tx_bps': 31129597952.0,
 'tx_bps_L1': 33562168032.000004,
 'tx_pps': 15203563.0,
 'tx_util': 83.90542008000001}
03/03/2021 15:55:46                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 13237852160.000000, rx_pps: 6465082.000000
03/03/2021 15:55:46                         pktgen: throughput: pps_rx 6465082.000000, bps_rx 13237852160.000000
03/03/2021 15:55:46                         pktgen: traffic completed. 
03/03/2021 15:55:46    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 15:55:46                         tester: ls -d /tmp
03/03/2021 15:55:46                         tester: /tmp
03/03/2021 15:55:46                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:55:48                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:48                         pktgen: test port 0 map gen port 0
03/03/2021 15:55:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:48                         pktgen: trex port <0> not support flow control
03/03/2021 15:55:48                         pktgen: check the trex port link status
03/03/2021 15:55:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:55:48                         pktgen: begin traffic ......
03/03/2021 15:55:48                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:55:58                         pktgen: begin get port statistic ...
03/03/2021 15:55:58                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:55:58                         pktgen: {0: {'ibytes': 24228063744,
     'ierrors': 0,
     'ipackets': 47320437,
     'obytes': 48169448448,
     'oerrors': 0,
     'opackets': 94080962,
     'rx_bps': 19341025280.0,
     'rx_bps_L1': 20096714240.0,
     'rx_pps': 4723056.0,
     'rx_util': 50.2417856,
     'tx_bps': 38428102656.0,
     'tx_bps_L1': 39929619136.0,
     'tx_pps': 9384478.0,
     'tx_util': 99.82404783999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.25877857208252,
            'cpu_util': 58.162506103515625,
            'cpu_util_raw': 62.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82821532,
            'rx_bps': 19341025280.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19087075328.0,
            'rx_pps': 4723056.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38428102656.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9384478.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 24228063744,
           'ierrors': 0,
           'ipackets': 47320437,
           'obytes': 48169448448,
           'oerrors': 0,
           'opackets': 94080962,
           'rx_bps': 19341025280.0,
           'rx_bps_L1': 20096714240.0,
           'rx_pps': 4723056.0,
           'rx_util': 50.2417856,
           'tx_bps': 38428102656.0,
           'tx_bps_L1': 39929619136.0,
           'tx_pps': 9384478.0,
           'tx_util': 99.82404783999999}}
03/03/2021 15:55:58                         pktgen: {'ibytes': 24228063744,
 'ierrors': 0,
 'ipackets': 47320437,
 'obytes': 48169448448,
 'oerrors': 0,
 'opackets': 94080962,
 'rx_bps': 19341025280.0,
 'rx_bps_L1': 20096714240.0,
 'rx_pps': 4723056.0,
 'rx_util': 50.2417856,
 'tx_bps': 38428102656.0,
 'tx_bps_L1': 39929619136.0,
 'tx_pps': 9384478.0,
 'tx_util': 99.82404783999999}
03/03/2021 15:55:58                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38428102656.000000, tx_pps: 9384478.000000 
03/03/2021 15:55:58                         pktgen: {'ibytes': 24228063744,
 'ierrors': 0,
 'ipackets': 47320437,
 'obytes': 48169448448,
 'oerrors': 0,
 'opackets': 94080962,
 'rx_bps': 19341025280.0,
 'rx_bps_L1': 20096714240.0,
 'rx_pps': 4723056.0,
 'rx_util': 50.2417856,
 'tx_bps': 38428102656.0,
 'tx_bps_L1': 39929619136.0,
 'tx_pps': 9384478.0,
 'tx_util': 99.82404783999999}
03/03/2021 15:55:58                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 19341025280.000000, rx_pps: 4723056.000000
03/03/2021 15:55:58                         pktgen: throughput: pps_rx 4723056.000000, bps_rx 19341025280.000000
03/03/2021 15:55:58                         pktgen: traffic completed. 
03/03/2021 15:55:58    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 15:55:58                         tester: ls -d /tmp
03/03/2021 15:55:58                         tester: /tmp
03/03/2021 15:55:58                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:56:00                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:00                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:00                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:00                         pktgen: trex port <0> not support flow control
03/03/2021 15:56:00                         pktgen: check the trex port link status
03/03/2021 15:56:00                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:00                         pktgen: begin traffic ......
03/03/2021 15:56:00                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:56:10                         pktgen: begin get port statistic ...
03/03/2021 15:56:10                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:56:10                         pktgen: {0: {'ibytes': 38608344064,
     'ierrors': 0,
     'ipackets': 37703465,
     'obytes': 49094889472,
     'oerrors': 0,
     'opackets': 47944232,
     'rx_bps': 30795745280.0,
     'rx_bps_L1': 31397349439.999996,
     'rx_pps': 3760026.0,
     'rx_util': 78.4933736,
     'tx_bps': 39162974208.0,
     'tx_bps_L1': 39928124448.0,
     'tx_pps': 4782189.0,
     'tx_util': 99.82031112},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 16.84053611755371,
            'cpu_util': 29.068979263305664,
            'cpu_util_raw': 28.75,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 37088374,
            'rx_bps': 30795745280.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8367226368.0,
            'rx_pps': 3760026.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39162974208.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4782189.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 38608344064,
           'ierrors': 0,
           'ipackets': 37703465,
           'obytes': 49094889472,
           'oerrors': 0,
           'opackets': 47944232,
           'rx_bps': 30795745280.0,
           'rx_bps_L1': 31397349439.999996,
           'rx_pps': 3760026.0,
           'rx_util': 78.4933736,
           'tx_bps': 39162974208.0,
           'tx_bps_L1': 39928124448.0,
           'tx_pps': 4782189.0,
           'tx_util': 99.82031112}}
03/03/2021 15:56:10                         pktgen: {'ibytes': 38608344064,
 'ierrors': 0,
 'ipackets': 37703465,
 'obytes': 49094889472,
 'oerrors': 0,
 'opackets': 47944232,
 'rx_bps': 30795745280.0,
 'rx_bps_L1': 31397349439.999996,
 'rx_pps': 3760026.0,
 'rx_util': 78.4933736,
 'tx_bps': 39162974208.0,
 'tx_bps_L1': 39928124448.0,
 'tx_pps': 4782189.0,
 'tx_util': 99.82031112}
03/03/2021 15:56:10                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39162974208.000000, tx_pps: 4782189.000000 
03/03/2021 15:56:10                         pktgen: {'ibytes': 38608344064,
 'ierrors': 0,
 'ipackets': 37703465,
 'obytes': 49094889472,
 'oerrors': 0,
 'opackets': 47944232,
 'rx_bps': 30795745280.0,
 'rx_bps_L1': 31397349439.999996,
 'rx_pps': 3760026.0,
 'rx_util': 78.4933736,
 'tx_bps': 39162974208.0,
 'tx_bps_L1': 39928124448.0,
 'tx_pps': 4782189.0,
 'tx_util': 99.82031112}
03/03/2021 15:56:10                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 30795745280.000000, rx_pps: 3760026.000000
03/03/2021 15:56:10                         pktgen: throughput: pps_rx 3760026.000000, bps_rx 30795745280.000000
03/03/2021 15:56:10                         pktgen: traffic completed. 
03/03/2021 15:56:10    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 15:56:10                         tester: ls -d /tmp
03/03/2021 15:56:11                         tester: /tmp
03/03/2021 15:56:11                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:56:13                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:13                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:13                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:13                         pktgen: trex port <0> not support flow control
03/03/2021 15:56:13                         pktgen: check the trex port link status
03/03/2021 15:56:13                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:13                         pktgen: begin traffic ......
03/03/2021 15:56:13                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:56:23                         pktgen: begin get port statistic ...
03/03/2021 15:56:23                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:56:23                         pktgen: {0: {'ibytes': 49400784048,
     'ierrors': 0,
     'ipackets': 32543339,
     'obytes': 49401052734,
     'oerrors': 0,
     'opackets': 32543516,
     'rx_bps': 39406751744.0,
     'rx_bps_L1': 39926007424.0,
     'rx_pps': 3245348.0,
     'rx_util': 99.81501856,
     'tx_bps': 39409434624.0,
     'tx_bps_L1': 39928742624.0,
     'tx_pps': 3245675.0,
     'tx_util': 99.82185656},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.22228240966797,
            'cpu_util': 14.394655227661133,
            'cpu_util_raw': 14.4375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17208911,
            'rx_bps': 39406751744.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3245348.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39409434624.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3245675.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49400784048,
           'ierrors': 0,
           'ipackets': 32543339,
           'obytes': 49401052734,
           'oerrors': 0,
           'opackets': 32543516,
           'rx_bps': 39406751744.0,
           'rx_bps_L1': 39926007424.0,
           'rx_pps': 3245348.0,
           'rx_util': 99.81501856,
           'tx_bps': 39409434624.0,
           'tx_bps_L1': 39928742624.0,
           'tx_pps': 3245675.0,
           'tx_util': 99.82185656}}
03/03/2021 15:56:23                         pktgen: {'ibytes': 49400784048,
 'ierrors': 0,
 'ipackets': 32543339,
 'obytes': 49401052734,
 'oerrors': 0,
 'opackets': 32543516,
 'rx_bps': 39406751744.0,
 'rx_bps_L1': 39926007424.0,
 'rx_pps': 3245348.0,
 'rx_util': 99.81501856,
 'tx_bps': 39409434624.0,
 'tx_bps_L1': 39928742624.0,
 'tx_pps': 3245675.0,
 'tx_util': 99.82185656}
03/03/2021 15:56:23                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39409434624.000000, tx_pps: 3245675.000000 
03/03/2021 15:56:23                         pktgen: {'ibytes': 49400784048,
 'ierrors': 0,
 'ipackets': 32543339,
 'obytes': 49401052734,
 'oerrors': 0,
 'opackets': 32543516,
 'rx_bps': 39406751744.0,
 'rx_bps_L1': 39926007424.0,
 'rx_pps': 3245348.0,
 'rx_util': 99.81501856,
 'tx_bps': 39409434624.0,
 'tx_bps_L1': 39928742624.0,
 'tx_pps': 3245675.0,
 'tx_util': 99.82185656}
03/03/2021 15:56:23                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39406751744.000000, rx_pps: 3245348.000000
03/03/2021 15:56:23                         pktgen: throughput: pps_rx 3245348.000000, bps_rx 39406751744.000000
03/03/2021 15:56:23                         pktgen: traffic completed. 
03/03/2021 15:56:24    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 15:56:24    TestPVPMultiPathPerformance: 
+-------+------------------+-------+------------+
| Frame |   Mode/RXD-TXD   | Mpps  | % linerate |
+=======+==================+=======+============+
| 64    | virito mergeable | 8.157 | 13.704     |
+-------+------------------+-------+------------+
| 128   | virito mergeable | 7.126 | 21.092     |
+-------+------------------+-------+------------+
| 256   | virito mergeable | 6.465 | 35.687     |
+-------+------------------+-------+------------+
| 512   | virito mergeable | 4.723 | 50.253     |
+-------+------------------+-------+------------+
| 1024  | virito mergeable | 3.760 | 78.509     |
+-------+------------------+-------+------------+
| 1518  | virito mergeable | 3.245 | 99.827     |
+-------+------------------+-------+------------+
03/03/2021 15:56:24    TestPVPMultiPathPerformance: 
+-------+--------------+------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps    | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+============+============+=====================+=======================+
| 64    | 1024         | 8.157 Mpps | 13.704%    | 8.008 Mpps          | 0.149 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.245 Mpps | 99.827%    | 3.217 Mpps          | 0.028 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
03/03/2021 15:56:24    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.400400
03/03/2021 15:56:24    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.149000
03/03/2021 15:56:24    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.160850
03/03/2021 15:56:24    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.028000
03/03/2021 15:56:24    TestPVPMultiPathPerformance: Test Case test_perf_pvp_mergeable Result PASSED:
03/03/2021 15:56:24             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 15:56:26    TestPVPMultiPathPerformance: Test Case test_perf_pvp_normal Begin
03/03/2021 15:56:26             dut.10.240.183.220: 
03/03/2021 15:56:26                         tester: 
03/03/2021 15:56:26             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:56:26             dut.10.240.183.220: 
03/03/2021 15:56:26             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:56:26             dut.10.240.183.220: 
03/03/2021 15:56:26             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:56:26             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:56:26             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:56:26             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:56:37             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:56:37             dut.10.240.183.220: 1048576
03/03/2021 15:56:48    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 15:56:48                         tester: ls -d /tmp
03/03/2021 15:56:49                         tester: /tmp
03/03/2021 15:56:49                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:56:51                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:51                         pktgen: test port 0 map gen port 0
03/03/2021 15:56:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:51                         pktgen: trex port <0> not support flow control
03/03/2021 15:56:51                         pktgen: check the trex port link status
03/03/2021 15:56:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:56:51                         pktgen: begin traffic ......
03/03/2021 15:56:51                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:57:01                         pktgen: begin get port statistic ...
03/03/2021 15:57:01                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:57:01                         pktgen: {0: {'ibytes': 5249208320,
     'ierrors': 0,
     'ipackets': 82018890,
     'obytes': 17084445568,
     'oerrors': 0,
     'opackets': 266944473,
     'rx_bps': 4190741760.0,
     'rx_bps_L1': 5500347440.000001,
     'rx_pps': 8185035.5,
     'rx_util': 13.750868600000002,
     'tx_bps': 13639833600.0,
     'tx_bps_L1': 17902280960.0,
     'tx_pps': 26640296.0,
     'tx_util': 44.755702400000004},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.8549611568450928,
            'cpu_util': 91.91455078125,
            'cpu_util_raw': 99.5,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 139039580,
            'rx_bps': 4190741760.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9449092096.0,
            'rx_pps': 8185035.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13639833600.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26640296.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 5249208320,
           'ierrors': 0,
           'ipackets': 82018890,
           'obytes': 17084445568,
           'oerrors': 0,
           'opackets': 266944473,
           'rx_bps': 4190741760.0,
           'rx_bps_L1': 5500347440.000001,
           'rx_pps': 8185035.5,
           'rx_util': 13.750868600000002,
           'tx_bps': 13639833600.0,
           'tx_bps_L1': 17902280960.0,
           'tx_pps': 26640296.0,
           'tx_util': 44.755702400000004}}
03/03/2021 15:57:01                         pktgen: {'ibytes': 5249208320,
 'ierrors': 0,
 'ipackets': 82018890,
 'obytes': 17084445568,
 'oerrors': 0,
 'opackets': 266944473,
 'rx_bps': 4190741760.0,
 'rx_bps_L1': 5500347440.000001,
 'rx_pps': 8185035.5,
 'rx_util': 13.750868600000002,
 'tx_bps': 13639833600.0,
 'tx_bps_L1': 17902280960.0,
 'tx_pps': 26640296.0,
 'tx_util': 44.755702400000004}
03/03/2021 15:57:01                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13639833600.000000, tx_pps: 26640296.000000 
03/03/2021 15:57:01                         pktgen: {'ibytes': 5249208320,
 'ierrors': 0,
 'ipackets': 82018890,
 'obytes': 17084445568,
 'oerrors': 0,
 'opackets': 266944473,
 'rx_bps': 4190741760.0,
 'rx_bps_L1': 5500347440.000001,
 'rx_pps': 8185035.5,
 'rx_util': 13.750868600000002,
 'tx_bps': 13639833600.0,
 'tx_bps_L1': 17902280960.0,
 'tx_pps': 26640296.0,
 'tx_util': 44.755702400000004}
03/03/2021 15:57:01                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 4190741760.000000, rx_pps: 8185035.500000
03/03/2021 15:57:01                         pktgen: throughput: pps_rx 8185035.500000, bps_rx 4190741760.000000
03/03/2021 15:57:01                         pktgen: traffic completed. 
03/03/2021 15:57:01    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 15:57:01                         tester: ls -d /tmp
03/03/2021 15:57:01                         tester: /tmp
03/03/2021 15:57:01                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:57:03                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:03                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:03                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:03                         pktgen: trex port <0> not support flow control
03/03/2021 15:57:03                         pktgen: check the trex port link status
03/03/2021 15:57:03                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:03                         pktgen: begin traffic ......
03/03/2021 15:57:03                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:57:13                         pktgen: begin get port statistic ...
03/03/2021 15:57:13                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:57:13                         pktgen: {0: {'ibytes': 9228274688,
     'ierrors': 0,
     'ipackets': 72095897,
     'obytes': 27936150400,
     'oerrors': 0,
     'opackets': 218251204,
     'rx_bps': 7361424384.0,
     'rx_bps_L1': 8511883024.0,
     'rx_pps': 7190366.5,
     'rx_util': 21.27970756,
     'tx_bps': 22080040960.0,
     'tx_bps_L1': 25530820480.0,
     'tx_pps': 21567372.0,
     'tx_util': 63.82705119999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.875049591064453,
            'cpu_util': 95.99851989746094,
            'cpu_util_raw': 99.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141450524,
            'rx_bps': 7361424384.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 14718617600.0,
            'rx_pps': 7190366.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22080040960.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21567372.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 9228274688,
           'ierrors': 0,
           'ipackets': 72095897,
           'obytes': 27936150400,
           'oerrors': 0,
           'opackets': 218251204,
           'rx_bps': 7361424384.0,
           'rx_bps_L1': 8511883024.0,
           'rx_pps': 7190366.5,
           'rx_util': 21.27970756,
           'tx_bps': 22080040960.0,
           'tx_bps_L1': 25530820480.0,
           'tx_pps': 21567372.0,
           'tx_util': 63.82705119999999}}
03/03/2021 15:57:13                         pktgen: {'ibytes': 9228274688,
 'ierrors': 0,
 'ipackets': 72095897,
 'obytes': 27936150400,
 'oerrors': 0,
 'opackets': 218251204,
 'rx_bps': 7361424384.0,
 'rx_bps_L1': 8511883024.0,
 'rx_pps': 7190366.5,
 'rx_util': 21.27970756,
 'tx_bps': 22080040960.0,
 'tx_bps_L1': 25530820480.0,
 'tx_pps': 21567372.0,
 'tx_util': 63.82705119999999}
03/03/2021 15:57:13                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22080040960.000000, tx_pps: 21567372.000000 
03/03/2021 15:57:13                         pktgen: {'ibytes': 9228274688,
 'ierrors': 0,
 'ipackets': 72095897,
 'obytes': 27936150400,
 'oerrors': 0,
 'opackets': 218251204,
 'rx_bps': 7361424384.0,
 'rx_bps_L1': 8511883024.0,
 'rx_pps': 7190366.5,
 'rx_util': 21.27970756,
 'tx_bps': 22080040960.0,
 'tx_bps_L1': 25530820480.0,
 'tx_pps': 21567372.0,
 'tx_util': 63.82705119999999}
03/03/2021 15:57:13                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 7361424384.000000, rx_pps: 7190366.500000
03/03/2021 15:57:13                         pktgen: throughput: pps_rx 7190366.500000, bps_rx 7361424384.000000
03/03/2021 15:57:13                         pktgen: traffic completed. 
03/03/2021 15:57:13    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 15:57:13                         tester: ls -d /tmp
03/03/2021 15:57:13                         tester: /tmp
03/03/2021 15:57:13                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:57:15                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:15                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:15                         pktgen: trex port <0> not support flow control
03/03/2021 15:57:15                         pktgen: check the trex port link status
03/03/2021 15:57:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:15                         pktgen: begin traffic ......
03/03/2021 15:57:15                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:57:25                         pktgen: begin get port statistic ...
03/03/2021 15:57:25                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:57:25                         pktgen: {0: {'ibytes': 16821890816,
     'ierrors': 0,
     'ipackets': 65710528,
     'obytes': 42271348224,
     'oerrors': 0,
     'opackets': 165122470,
     'rx_bps': 13409516544.0,
     'rx_bps_L1': 14457335263.999998,
     'rx_pps': 6548867.0,
     'rx_util': 36.14333815999999,
     'tx_bps': 33521668096.0,
     'tx_bps_L1': 36141144256.0,
     'tx_pps': 16371726.0,
     'tx_util': 90.35286064},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 12.73882007598877,
            'cpu_util': 32.89322280883789,
            'cpu_util_raw': 28.5625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36764539,
            'rx_bps': 13409516544.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 20112152576.0,
            'rx_pps': 6548867.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 33521668096.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 16371726.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 16821890816,
           'ierrors': 0,
           'ipackets': 65710528,
           'obytes': 42271348224,
           'oerrors': 0,
           'opackets': 165122470,
           'rx_bps': 13409516544.0,
           'rx_bps_L1': 14457335263.999998,
           'rx_pps': 6548867.0,
           'rx_util': 36.14333815999999,
           'tx_bps': 33521668096.0,
           'tx_bps_L1': 36141144256.0,
           'tx_pps': 16371726.0,
           'tx_util': 90.35286064}}
03/03/2021 15:57:25                         pktgen: {'ibytes': 16821890816,
 'ierrors': 0,
 'ipackets': 65710528,
 'obytes': 42271348224,
 'oerrors': 0,
 'opackets': 165122470,
 'rx_bps': 13409516544.0,
 'rx_bps_L1': 14457335263.999998,
 'rx_pps': 6548867.0,
 'rx_util': 36.14333815999999,
 'tx_bps': 33521668096.0,
 'tx_bps_L1': 36141144256.0,
 'tx_pps': 16371726.0,
 'tx_util': 90.35286064}
03/03/2021 15:57:25                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 33521668096.000000, tx_pps: 16371726.000000 
03/03/2021 15:57:25                         pktgen: {'ibytes': 16821890816,
 'ierrors': 0,
 'ipackets': 65710528,
 'obytes': 42271348224,
 'oerrors': 0,
 'opackets': 165122470,
 'rx_bps': 13409516544.0,
 'rx_bps_L1': 14457335263.999998,
 'rx_pps': 6548867.0,
 'rx_util': 36.14333815999999,
 'tx_bps': 33521668096.0,
 'tx_bps_L1': 36141144256.0,
 'tx_pps': 16371726.0,
 'tx_util': 90.35286064}
03/03/2021 15:57:25                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 13409516544.000000, rx_pps: 6548867.000000
03/03/2021 15:57:25                         pktgen: throughput: pps_rx 6548867.000000, bps_rx 13409516544.000000
03/03/2021 15:57:25                         pktgen: traffic completed. 
03/03/2021 15:57:25    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 15:57:25                         tester: ls -d /tmp
03/03/2021 15:57:25                         tester: /tmp
03/03/2021 15:57:25                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:57:27                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:27                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:27                         pktgen: trex port <0> not support flow control
03/03/2021 15:57:27                         pktgen: check the trex port link status
03/03/2021 15:57:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:27                         pktgen: begin traffic ......
03/03/2021 15:57:27                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:57:37                         pktgen: begin get port statistic ...
03/03/2021 15:57:37                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:57:37                         pktgen: {0: {'ibytes': 24198398976,
     'ierrors': 0,
     'ipackets': 47262507,
     'obytes': 48172240384,
     'oerrors': 0,
     'opackets': 94086415,
     'rx_bps': 19376754688.0,
     'rx_bps_L1': 20133834368.0,
     'rx_pps': 4731748.0,
     'rx_util': 50.334585919999995,
     'tx_bps': 38569951232.0,
     'tx_bps_L1': 40077028672.0,
     'tx_pps': 9419234.0,
     'tx_util': 100.19257168},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.469078063964844,
            'cpu_util': 56.9276123046875,
            'cpu_util_raw': 60.9375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82612733,
            'rx_bps': 19376754688.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19193194496.0,
            'rx_pps': 4731748.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38569951232.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9419234.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 24198398976,
           'ierrors': 0,
           'ipackets': 47262507,
           'obytes': 48172240384,
           'oerrors': 0,
           'opackets': 94086415,
           'rx_bps': 19376754688.0,
           'rx_bps_L1': 20133834368.0,
           'rx_pps': 4731748.0,
           'rx_util': 50.334585919999995,
           'tx_bps': 38569951232.0,
           'tx_bps_L1': 40077028672.0,
           'tx_pps': 9419234.0,
           'tx_util': 100.19257168}}
03/03/2021 15:57:37                         pktgen: {'ibytes': 24198398976,
 'ierrors': 0,
 'ipackets': 47262507,
 'obytes': 48172240384,
 'oerrors': 0,
 'opackets': 94086415,
 'rx_bps': 19376754688.0,
 'rx_bps_L1': 20133834368.0,
 'rx_pps': 4731748.0,
 'rx_util': 50.334585919999995,
 'tx_bps': 38569951232.0,
 'tx_bps_L1': 40077028672.0,
 'tx_pps': 9419234.0,
 'tx_util': 100.19257168}
03/03/2021 15:57:37                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38569951232.000000, tx_pps: 9419234.000000 
03/03/2021 15:57:37                         pktgen: {'ibytes': 24198398976,
 'ierrors': 0,
 'ipackets': 47262507,
 'obytes': 48172240384,
 'oerrors': 0,
 'opackets': 94086415,
 'rx_bps': 19376754688.0,
 'rx_bps_L1': 20133834368.0,
 'rx_pps': 4731748.0,
 'rx_util': 50.334585919999995,
 'tx_bps': 38569951232.0,
 'tx_bps_L1': 40077028672.0,
 'tx_pps': 9419234.0,
 'tx_util': 100.19257168}
03/03/2021 15:57:37                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 19376754688.000000, rx_pps: 4731748.000000
03/03/2021 15:57:37                         pktgen: throughput: pps_rx 4731748.000000, bps_rx 19376754688.000000
03/03/2021 15:57:37                         pktgen: traffic completed. 
03/03/2021 15:57:37    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 15:57:37                         tester: ls -d /tmp
03/03/2021 15:57:37                         tester: /tmp
03/03/2021 15:57:37                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:57:39                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:39                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:39                         pktgen: trex port <0> not support flow control
03/03/2021 15:57:39                         pktgen: check the trex port link status
03/03/2021 15:57:39                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:39                         pktgen: begin traffic ......
03/03/2021 15:57:39                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:57:49                         pktgen: begin get port statistic ...
03/03/2021 15:57:49                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:57:49                         pktgen: {0: {'ibytes': 38549961728,
     'ierrors': 0,
     'ipackets': 37646452,
     'obytes': 49095252992,
     'oerrors': 0,
     'opackets': 47944587,
     'rx_bps': 30718842880.0,
     'rx_bps_L1': 31318941200.0,
     'rx_pps': 3750614.5,
     'rx_util': 78.297353,
     'tx_bps': 39128498176.0,
     'tx_bps_L1': 39892967296.0,
     'tx_pps': 4777932.0,
     'tx_util': 99.73241824},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 16.95414161682129,
            'cpu_util': 28.84877586364746,
            'cpu_util_raw': 29.625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36910292,
            'rx_bps': 30718842880.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8409656320.0,
            'rx_pps': 3750614.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39128498176.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4777932.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 38549961728,
           'ierrors': 0,
           'ipackets': 37646452,
           'obytes': 49095252992,
           'oerrors': 0,
           'opackets': 47944587,
           'rx_bps': 30718842880.0,
           'rx_bps_L1': 31318941200.0,
           'rx_pps': 3750614.5,
           'rx_util': 78.297353,
           'tx_bps': 39128498176.0,
           'tx_bps_L1': 39892967296.0,
           'tx_pps': 4777932.0,
           'tx_util': 99.73241824}}
03/03/2021 15:57:49                         pktgen: {'ibytes': 38549961728,
 'ierrors': 0,
 'ipackets': 37646452,
 'obytes': 49095252992,
 'oerrors': 0,
 'opackets': 47944587,
 'rx_bps': 30718842880.0,
 'rx_bps_L1': 31318941200.0,
 'rx_pps': 3750614.5,
 'rx_util': 78.297353,
 'tx_bps': 39128498176.0,
 'tx_bps_L1': 39892967296.0,
 'tx_pps': 4777932.0,
 'tx_util': 99.73241824}
03/03/2021 15:57:49                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39128498176.000000, tx_pps: 4777932.000000 
03/03/2021 15:57:49                         pktgen: {'ibytes': 38549961728,
 'ierrors': 0,
 'ipackets': 37646452,
 'obytes': 49095252992,
 'oerrors': 0,
 'opackets': 47944587,
 'rx_bps': 30718842880.0,
 'rx_bps_L1': 31318941200.0,
 'rx_pps': 3750614.5,
 'rx_util': 78.297353,
 'tx_bps': 39128498176.0,
 'tx_bps_L1': 39892967296.0,
 'tx_pps': 4777932.0,
 'tx_util': 99.73241824}
03/03/2021 15:57:49                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 30718842880.000000, rx_pps: 3750614.500000
03/03/2021 15:57:49                         pktgen: throughput: pps_rx 3750614.500000, bps_rx 30718842880.000000
03/03/2021 15:57:49                         pktgen: traffic completed. 
03/03/2021 15:57:49    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 15:57:49                         tester: ls -d /tmp
03/03/2021 15:57:49                         tester: /tmp
03/03/2021 15:57:49                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:57:51                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:51                         pktgen: test port 0 map gen port 0
03/03/2021 15:57:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:51                         pktgen: trex port <0> not support flow control
03/03/2021 15:57:51                         pktgen: check the trex port link status
03/03/2021 15:57:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:57:51                         pktgen: begin traffic ......
03/03/2021 15:57:51                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:58:01                         pktgen: begin get port statistic ...
03/03/2021 15:58:01                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:58:01                         pktgen: {0: {'ibytes': 49401902814,
     'ierrors': 0,
     'ipackets': 32544077,
     'obytes': 49402179090,
     'oerrors': 0,
     'opackets': 32544258,
     'rx_bps': 39413067776.0,
     'rx_bps_L1': 39932403696.0,
     'rx_pps': 3245849.5,
     'rx_util': 99.83100924,
     'tx_bps': 39415590912.0,
     'tx_bps_L1': 39934976512.0,
     'tx_pps': 3246160.0,
     'tx_util': 99.83744128000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 33.45980453491211,
            'cpu_util': 14.72497844696045,
            'cpu_util_raw': 16.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17166346,
            'rx_bps': 39413067776.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3245849.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39415590912.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3246160.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49401902814,
           'ierrors': 0,
           'ipackets': 32544077,
           'obytes': 49402179090,
           'oerrors': 0,
           'opackets': 32544258,
           'rx_bps': 39413067776.0,
           'rx_bps_L1': 39932403696.0,
           'rx_pps': 3245849.5,
           'rx_util': 99.83100924,
           'tx_bps': 39415590912.0,
           'tx_bps_L1': 39934976512.0,
           'tx_pps': 3246160.0,
           'tx_util': 99.83744128000001}}
03/03/2021 15:58:01                         pktgen: {'ibytes': 49401902814,
 'ierrors': 0,
 'ipackets': 32544077,
 'obytes': 49402179090,
 'oerrors': 0,
 'opackets': 32544258,
 'rx_bps': 39413067776.0,
 'rx_bps_L1': 39932403696.0,
 'rx_pps': 3245849.5,
 'rx_util': 99.83100924,
 'tx_bps': 39415590912.0,
 'tx_bps_L1': 39934976512.0,
 'tx_pps': 3246160.0,
 'tx_util': 99.83744128000001}
03/03/2021 15:58:01                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39415590912.000000, tx_pps: 3246160.000000 
03/03/2021 15:58:01                         pktgen: {'ibytes': 49401902814,
 'ierrors': 0,
 'ipackets': 32544077,
 'obytes': 49402179090,
 'oerrors': 0,
 'opackets': 32544258,
 'rx_bps': 39413067776.0,
 'rx_bps_L1': 39932403696.0,
 'rx_pps': 3245849.5,
 'rx_util': 99.83100924,
 'tx_bps': 39415590912.0,
 'tx_bps_L1': 39934976512.0,
 'tx_pps': 3246160.0,
 'tx_util': 99.83744128000001}
03/03/2021 15:58:01                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39413067776.000000, rx_pps: 3245849.500000
03/03/2021 15:58:01                         pktgen: throughput: pps_rx 3245849.500000, bps_rx 39413067776.000000
03/03/2021 15:58:01                         pktgen: traffic completed. 
03/03/2021 15:58:03    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 15:58:03    TestPVPMultiPathPerformance: 
+-------+---------------+-------+------------+
| Frame | Mode/RXD-TXD  | Mpps  | % linerate |
+=======+===============+=======+============+
| 64    | virito normal | 8.185 | 13.751     |
+-------+---------------+-------+------------+
| 128   | virito normal | 7.190 | 21.283     |
+-------+---------------+-------+------------+
| 256   | virito normal | 6.549 | 36.150     |
+-------+---------------+-------+------------+
| 512   | virito normal | 4.732 | 50.346     |
+-------+---------------+-------+------------+
| 1024  | virito normal | 3.751 | 78.313     |
+-------+---------------+-------+------------+
| 1518  | virito normal | 3.246 | 99.842     |
+-------+---------------+-------+------------+
03/03/2021 15:58:03    TestPVPMultiPathPerformance: 
+-------+--------------+------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps    | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+============+============+=====================+=======================+
| 64    | 1024         | 8.185 Mpps | 13.751%    | 8.077 Mpps          | 0.108 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.246 Mpps | 99.842%    | 3.247 Mpps          | -0.001 Mpps           |
+-------+--------------+------------+------------+---------------------+-----------------------+
03/03/2021 15:58:03    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.403850
03/03/2021 15:58:03    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.108000
03/03/2021 15:58:03    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162350
03/03/2021 15:58:03    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.001000
03/03/2021 15:58:03    TestPVPMultiPathPerformance: Test Case test_perf_pvp_normal Result PASSED:
03/03/2021 15:58:03             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 15:58:05    TestPVPMultiPathPerformance: Test Case test_perf_pvp_vector_rx Begin
03/03/2021 15:58:05             dut.10.240.183.220: 
03/03/2021 15:58:05                         tester: 
03/03/2021 15:58:05             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:58:05             dut.10.240.183.220: 
03/03/2021 15:58:05             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:58:05             dut.10.240.183.220: 
03/03/2021 15:58:05             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:58:05             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:58:05             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:58:05             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:58:16             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:58:16             dut.10.240.183.220: 1048576
03/03/2021 15:58:27    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 15:58:27                         tester: ls -d /tmp
03/03/2021 15:58:27                         tester: /tmp
03/03/2021 15:58:27                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:58:29                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:29                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:29                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:29                         pktgen: trex port <0> not support flow control
03/03/2021 15:58:29                         pktgen: check the trex port link status
03/03/2021 15:58:29                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:29                         pktgen: begin traffic ......
03/03/2021 15:58:29                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:58:39                         pktgen: begin get port statistic ...
03/03/2021 15:58:39                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:58:39                         pktgen: {0: {'ibytes': 5302454272,
     'ierrors': 0,
     'ipackets': 82850848,
     'obytes': 17096029440,
     'oerrors': 0,
     'opackets': 267125489,
     'rx_bps': 4235148800.0,
     'rx_bps_L1': 5558632640.0,
     'rx_pps': 8271774.0,
     'rx_util': 13.8965816,
     'tx_bps': 13669021696.0,
     'tx_bps_L1': 17940590336.0,
     'tx_pps': 26697304.0,
     'tx_util': 44.85147584},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.856594443321228,
            'cpu_util': 92.03020477294922,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 138665563,
            'rx_bps': 4235148800.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 9433873408.0,
            'rx_pps': 8271774.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13669021696.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26697304.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 5302454272,
           'ierrors': 0,
           'ipackets': 82850848,
           'obytes': 17096029440,
           'oerrors': 0,
           'opackets': 267125489,
           'rx_bps': 4235148800.0,
           'rx_bps_L1': 5558632640.0,
           'rx_pps': 8271774.0,
           'rx_util': 13.8965816,
           'tx_bps': 13669021696.0,
           'tx_bps_L1': 17940590336.0,
           'tx_pps': 26697304.0,
           'tx_util': 44.85147584}}
03/03/2021 15:58:39                         pktgen: {'ibytes': 5302454272,
 'ierrors': 0,
 'ipackets': 82850848,
 'obytes': 17096029440,
 'oerrors': 0,
 'opackets': 267125489,
 'rx_bps': 4235148800.0,
 'rx_bps_L1': 5558632640.0,
 'rx_pps': 8271774.0,
 'rx_util': 13.8965816,
 'tx_bps': 13669021696.0,
 'tx_bps_L1': 17940590336.0,
 'tx_pps': 26697304.0,
 'tx_util': 44.85147584}
03/03/2021 15:58:39                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13669021696.000000, tx_pps: 26697304.000000 
03/03/2021 15:58:39                         pktgen: {'ibytes': 5302454272,
 'ierrors': 0,
 'ipackets': 82850848,
 'obytes': 17096029440,
 'oerrors': 0,
 'opackets': 267125489,
 'rx_bps': 4235148800.0,
 'rx_bps_L1': 5558632640.0,
 'rx_pps': 8271774.0,
 'rx_util': 13.8965816,
 'tx_bps': 13669021696.0,
 'tx_bps_L1': 17940590336.0,
 'tx_pps': 26697304.0,
 'tx_util': 44.85147584}
03/03/2021 15:58:39                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 4235148800.000000, rx_pps: 8271774.000000
03/03/2021 15:58:39                         pktgen: throughput: pps_rx 8271774.000000, bps_rx 4235148800.000000
03/03/2021 15:58:39                         pktgen: traffic completed. 
03/03/2021 15:58:39    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 15:58:39                         tester: ls -d /tmp
03/03/2021 15:58:40                         tester: /tmp
03/03/2021 15:58:40                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:58:42                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:42                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:42                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:42                         pktgen: trex port <0> not support flow control
03/03/2021 15:58:42                         pktgen: check the trex port link status
03/03/2021 15:58:42                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:42                         pktgen: begin traffic ......
03/03/2021 15:58:42                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:58:52                         pktgen: begin get port statistic ...
03/03/2021 15:58:52                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:58:52                         pktgen: {0: {'ibytes': 9372099712,
     'ierrors': 0,
     'ipackets': 73219529,
     'obytes': 28006057984,
     'oerrors': 0,
     'opackets': 218797350,
     'rx_bps': 7474332160.0,
     'rx_bps_L1': 8642426720.0,
     'rx_pps': 7300591.0,
     'rx_util': 21.6060668,
     'tx_bps': 22335475712.0,
     'tx_bps_L1': 25826137472.0,
     'tx_pps': 21816636.0,
     'tx_util': 64.56534368},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.901616096496582,
            'cpu_util': 96.21997833251953,
            'cpu_util_raw': 99.5625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141740783,
            'rx_bps': 7474332160.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 14861144064.0,
            'rx_pps': 7300591.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22335475712.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21816636.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 9372099712,
           'ierrors': 0,
           'ipackets': 73219529,
           'obytes': 28006057984,
           'oerrors': 0,
           'opackets': 218797350,
           'rx_bps': 7474332160.0,
           'rx_bps_L1': 8642426720.0,
           'rx_pps': 7300591.0,
           'rx_util': 21.6060668,
           'tx_bps': 22335475712.0,
           'tx_bps_L1': 25826137472.0,
           'tx_pps': 21816636.0,
           'tx_util': 64.56534368}}
03/03/2021 15:58:52                         pktgen: {'ibytes': 9372099712,
 'ierrors': 0,
 'ipackets': 73219529,
 'obytes': 28006057984,
 'oerrors': 0,
 'opackets': 218797350,
 'rx_bps': 7474332160.0,
 'rx_bps_L1': 8642426720.0,
 'rx_pps': 7300591.0,
 'rx_util': 21.6060668,
 'tx_bps': 22335475712.0,
 'tx_bps_L1': 25826137472.0,
 'tx_pps': 21816636.0,
 'tx_util': 64.56534368}
03/03/2021 15:58:52                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22335475712.000000, tx_pps: 21816636.000000 
03/03/2021 15:58:52                         pktgen: {'ibytes': 9372099712,
 'ierrors': 0,
 'ipackets': 73219529,
 'obytes': 28006057984,
 'oerrors': 0,
 'opackets': 218797350,
 'rx_bps': 7474332160.0,
 'rx_bps_L1': 8642426720.0,
 'rx_pps': 7300591.0,
 'rx_util': 21.6060668,
 'tx_bps': 22335475712.0,
 'tx_bps_L1': 25826137472.0,
 'tx_pps': 21816636.0,
 'tx_util': 64.56534368}
03/03/2021 15:58:52                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 7474332160.000000, rx_pps: 7300591.000000
03/03/2021 15:58:52                         pktgen: throughput: pps_rx 7300591.000000, bps_rx 7474332160.000000
03/03/2021 15:58:52                         pktgen: traffic completed. 
03/03/2021 15:58:52    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 15:58:52                         tester: ls -d /tmp
03/03/2021 15:58:52                         tester: /tmp
03/03/2021 15:58:52                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:58:54                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:54                         pktgen: test port 0 map gen port 0
03/03/2021 15:58:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:54                         pktgen: trex port <0> not support flow control
03/03/2021 15:58:54                         pktgen: check the trex port link status
03/03/2021 15:58:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:58:54                         pktgen: begin traffic ......
03/03/2021 15:58:54                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:59:04                         pktgen: begin get port statistic ...
03/03/2021 15:59:04                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:59:04                         pktgen: {0: {'ibytes': 16963832064,
     'ierrors': 0,
     'ipackets': 66264969,
     'obytes': 46419408640,
     'oerrors': 0,
     'opackets': 181325837,
     'rx_bps': 13551158272.0,
     'rx_bps_L1': 14610038672.0,
     'rx_pps': 6618002.5,
     'rx_util': 36.525096680000004,
     'tx_bps': 37077639168.0,
     'tx_bps_L1': 39974917888.0,
     'tx_pps': 18107992.0,
     'tx_util': 99.93729472},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 50.872650146484375,
            'cpu_util': 9.110405921936035,
            'cpu_util_raw': 4.875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 1781627,
            'rx_bps': 13551158272.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 23526481920.0,
            'rx_pps': 6618002.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 37077639168.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 18107992.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 16963832064,
           'ierrors': 0,
           'ipackets': 66264969,
           'obytes': 46419408640,
           'oerrors': 0,
           'opackets': 181325837,
           'rx_bps': 13551158272.0,
           'rx_bps_L1': 14610038672.0,
           'rx_pps': 6618002.5,
           'rx_util': 36.525096680000004,
           'tx_bps': 37077639168.0,
           'tx_bps_L1': 39974917888.0,
           'tx_pps': 18107992.0,
           'tx_util': 99.93729472}}
03/03/2021 15:59:04                         pktgen: {'ibytes': 16963832064,
 'ierrors': 0,
 'ipackets': 66264969,
 'obytes': 46419408640,
 'oerrors': 0,
 'opackets': 181325837,
 'rx_bps': 13551158272.0,
 'rx_bps_L1': 14610038672.0,
 'rx_pps': 6618002.5,
 'rx_util': 36.525096680000004,
 'tx_bps': 37077639168.0,
 'tx_bps_L1': 39974917888.0,
 'tx_pps': 18107992.0,
 'tx_util': 99.93729472}
03/03/2021 15:59:04                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 37077639168.000000, tx_pps: 18107992.000000 
03/03/2021 15:59:04                         pktgen: {'ibytes': 16963832064,
 'ierrors': 0,
 'ipackets': 66264969,
 'obytes': 46419408640,
 'oerrors': 0,
 'opackets': 181325837,
 'rx_bps': 13551158272.0,
 'rx_bps_L1': 14610038672.0,
 'rx_pps': 6618002.5,
 'rx_util': 36.525096680000004,
 'tx_bps': 37077639168.0,
 'tx_bps_L1': 39974917888.0,
 'tx_pps': 18107992.0,
 'tx_util': 99.93729472}
03/03/2021 15:59:04                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 13551158272.000000, rx_pps: 6618002.500000
03/03/2021 15:59:04                         pktgen: throughput: pps_rx 6618002.500000, bps_rx 13551158272.000000
03/03/2021 15:59:04                         pktgen: traffic completed. 
03/03/2021 15:59:04    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 15:59:04                         tester: ls -d /tmp
03/03/2021 15:59:04                         tester: /tmp
03/03/2021 15:59:04                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:59:06                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:06                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:06                         pktgen: trex port <0> not support flow control
03/03/2021 15:59:06                         pktgen: check the trex port link status
03/03/2021 15:59:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:06                         pktgen: begin traffic ......
03/03/2021 15:59:06                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:59:16                         pktgen: begin get port statistic ...
03/03/2021 15:59:16                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:59:16                         pktgen: {0: {'ibytes': 24310903808,
     'ierrors': 0,
     'ipackets': 47482234,
     'obytes': 48143985152,
     'oerrors': 0,
     'opackets': 94031233,
     'rx_bps': 19384576000.0,
     'rx_bps_L1': 20141956880.0,
     'rx_pps': 4733630.5,
     'rx_util': 50.3548922,
     'tx_bps': 38390992896.0,
     'tx_bps_L1': 39891108096.0,
     'tx_pps': 9375720.0,
     'tx_util': 99.72777024},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.613863945007324,
            'cpu_util': 55.71105194091797,
            'cpu_util_raw': 59.8125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82448692,
            'rx_bps': 19384576000.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19006416896.0,
            'rx_pps': 4733630.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38390992896.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9375720.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 24310903808,
           'ierrors': 0,
           'ipackets': 47482234,
           'obytes': 48143985152,
           'oerrors': 0,
           'opackets': 94031233,
           'rx_bps': 19384576000.0,
           'rx_bps_L1': 20141956880.0,
           'rx_pps': 4733630.5,
           'rx_util': 50.3548922,
           'tx_bps': 38390992896.0,
           'tx_bps_L1': 39891108096.0,
           'tx_pps': 9375720.0,
           'tx_util': 99.72777024}}
03/03/2021 15:59:16                         pktgen: {'ibytes': 24310903808,
 'ierrors': 0,
 'ipackets': 47482234,
 'obytes': 48143985152,
 'oerrors': 0,
 'opackets': 94031233,
 'rx_bps': 19384576000.0,
 'rx_bps_L1': 20141956880.0,
 'rx_pps': 4733630.5,
 'rx_util': 50.3548922,
 'tx_bps': 38390992896.0,
 'tx_bps_L1': 39891108096.0,
 'tx_pps': 9375720.0,
 'tx_util': 99.72777024}
03/03/2021 15:59:16                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38390992896.000000, tx_pps: 9375720.000000 
03/03/2021 15:59:16                         pktgen: {'ibytes': 24310903808,
 'ierrors': 0,
 'ipackets': 47482234,
 'obytes': 48143985152,
 'oerrors': 0,
 'opackets': 94031233,
 'rx_bps': 19384576000.0,
 'rx_bps_L1': 20141956880.0,
 'rx_pps': 4733630.5,
 'rx_util': 50.3548922,
 'tx_bps': 38390992896.0,
 'tx_bps_L1': 39891108096.0,
 'tx_pps': 9375720.0,
 'tx_util': 99.72777024}
03/03/2021 15:59:16                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 19384576000.000000, rx_pps: 4733630.500000
03/03/2021 15:59:16                         pktgen: throughput: pps_rx 4733630.500000, bps_rx 19384576000.000000
03/03/2021 15:59:16                         pktgen: traffic completed. 
03/03/2021 15:59:16    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 15:59:16                         tester: ls -d /tmp
03/03/2021 15:59:16                         tester: /tmp
03/03/2021 15:59:16                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:59:18                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:18                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:18                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:18                         pktgen: trex port <0> not support flow control
03/03/2021 15:59:18                         pktgen: check the trex port link status
03/03/2021 15:59:18                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:18                         pktgen: begin traffic ......
03/03/2021 15:59:18                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:59:28                         pktgen: begin get port statistic ...
03/03/2021 15:59:28                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:59:28                         pktgen: {0: {'ibytes': 38764847104,
     'ierrors': 0,
     'ipackets': 37856297,
     'obytes': 49092788224,
     'oerrors': 0,
     'opackets': 47942180,
     'rx_bps': 30921367552.0,
     'rx_bps_L1': 31525417432.000004,
     'rx_pps': 3775311.75,
     'rx_util': 78.81354358000002,
     'tx_bps': 39161462784.0,
     'tx_bps_L1': 39926566464.0,
     'tx_pps': 4781898.0,
     'tx_util': 99.81641616},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.386817932128906,
            'cpu_util': 28.154565811157227,
            'cpu_util_raw': 28.9375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36643341,
            'rx_bps': 30921367552.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8240093696.0,
            'rx_pps': 3775311.75,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39161462784.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4781898.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 38764847104,
           'ierrors': 0,
           'ipackets': 37856297,
           'obytes': 49092788224,
           'oerrors': 0,
           'opackets': 47942180,
           'rx_bps': 30921367552.0,
           'rx_bps_L1': 31525417432.000004,
           'rx_pps': 3775311.75,
           'rx_util': 78.81354358000002,
           'tx_bps': 39161462784.0,
           'tx_bps_L1': 39926566464.0,
           'tx_pps': 4781898.0,
           'tx_util': 99.81641616}}
03/03/2021 15:59:28                         pktgen: {'ibytes': 38764847104,
 'ierrors': 0,
 'ipackets': 37856297,
 'obytes': 49092788224,
 'oerrors': 0,
 'opackets': 47942180,
 'rx_bps': 30921367552.0,
 'rx_bps_L1': 31525417432.000004,
 'rx_pps': 3775311.75,
 'rx_util': 78.81354358000002,
 'tx_bps': 39161462784.0,
 'tx_bps_L1': 39926566464.0,
 'tx_pps': 4781898.0,
 'tx_util': 99.81641616}
03/03/2021 15:59:28                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39161462784.000000, tx_pps: 4781898.000000 
03/03/2021 15:59:28                         pktgen: {'ibytes': 38764847104,
 'ierrors': 0,
 'ipackets': 37856297,
 'obytes': 49092788224,
 'oerrors': 0,
 'opackets': 47942180,
 'rx_bps': 30921367552.0,
 'rx_bps_L1': 31525417432.000004,
 'rx_pps': 3775311.75,
 'rx_util': 78.81354358000002,
 'tx_bps': 39161462784.0,
 'tx_bps_L1': 39926566464.0,
 'tx_pps': 4781898.0,
 'tx_util': 99.81641616}
03/03/2021 15:59:28                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 30921367552.000000, rx_pps: 3775311.750000
03/03/2021 15:59:28                         pktgen: throughput: pps_rx 3775311.750000, bps_rx 30921367552.000000
03/03/2021 15:59:28                         pktgen: traffic completed. 
03/03/2021 15:59:28    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 15:59:28                         tester: ls -d /tmp
03/03/2021 15:59:28                         tester: /tmp
03/03/2021 15:59:28                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 15:59:30                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:30                         pktgen: test port 0 map gen port 0
03/03/2021 15:59:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:30                         pktgen: trex port <0> not support flow control
03/03/2021 15:59:30                         pktgen: check the trex port link status
03/03/2021 15:59:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 15:59:30                         pktgen: begin traffic ......
03/03/2021 15:59:30                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 15:59:40                         pktgen: begin get port statistic ...
03/03/2021 15:59:40                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 15:59:40                         pktgen: {0: {'ibytes': 49072590930,
     'ierrors': 0,
     'ipackets': 32327138,
     'obytes': 49401981750,
     'oerrors': 0,
     'opackets': 32544129,
     'rx_bps': 39259107328.0,
     'rx_bps_L1': 39776414128.0,
     'rx_pps': 3233167.5,
     'rx_util': 99.44103532,
     'tx_bps': 39411818496.0,
     'tx_bps_L1': 39931153016.0,
     'tx_pps': 3245840.75,
     'tx_util': 99.82788254},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 35.2628059387207,
            'cpu_util': 13.970746040344238,
            'cpu_util_raw': 14.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17260655,
            'rx_bps': 39259107328.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3233167.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39411818496.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3245840.75},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49072590930,
           'ierrors': 0,
           'ipackets': 32327138,
           'obytes': 49401981750,
           'oerrors': 0,
           'opackets': 32544129,
           'rx_bps': 39259107328.0,
           'rx_bps_L1': 39776414128.0,
           'rx_pps': 3233167.5,
           'rx_util': 99.44103532,
           'tx_bps': 39411818496.0,
           'tx_bps_L1': 39931153016.0,
           'tx_pps': 3245840.75,
           'tx_util': 99.82788254}}
03/03/2021 15:59:40                         pktgen: {'ibytes': 49072590930,
 'ierrors': 0,
 'ipackets': 32327138,
 'obytes': 49401981750,
 'oerrors': 0,
 'opackets': 32544129,
 'rx_bps': 39259107328.0,
 'rx_bps_L1': 39776414128.0,
 'rx_pps': 3233167.5,
 'rx_util': 99.44103532,
 'tx_bps': 39411818496.0,
 'tx_bps_L1': 39931153016.0,
 'tx_pps': 3245840.75,
 'tx_util': 99.82788254}
03/03/2021 15:59:40                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39411818496.000000, tx_pps: 3245840.750000 
03/03/2021 15:59:40                         pktgen: {'ibytes': 49072590930,
 'ierrors': 0,
 'ipackets': 32327138,
 'obytes': 49401981750,
 'oerrors': 0,
 'opackets': 32544129,
 'rx_bps': 39259107328.0,
 'rx_bps_L1': 39776414128.0,
 'rx_pps': 3233167.5,
 'rx_util': 99.44103532,
 'tx_bps': 39411818496.0,
 'tx_bps_L1': 39931153016.0,
 'tx_pps': 3245840.75,
 'tx_util': 99.82788254}
03/03/2021 15:59:40                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39259107328.000000, rx_pps: 3233167.500000
03/03/2021 15:59:40                         pktgen: throughput: pps_rx 3233167.500000, bps_rx 39259107328.000000
03/03/2021 15:59:40                         pktgen: traffic completed. 
03/03/2021 15:59:42    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 15:59:42    TestPVPMultiPathPerformance: 
+-------+------------------+-------+------------+
| Frame |   Mode/RXD-TXD   | Mpps  | % linerate |
+=======+==================+=======+============+
| 64    | virito vector rx | 8.272 | 13.897     |
+-------+------------------+-------+------------+
| 128   | virito vector rx | 7.301 | 21.610     |
+-------+------------------+-------+------------+
| 256   | virito vector rx | 6.618 | 36.531     |
+-------+------------------+-------+------------+
| 512   | virito vector rx | 4.734 | 50.366     |
+-------+------------------+-------+------------+
| 1024  | virito vector rx | 3.775 | 78.829     |
+-------+------------------+-------+------------+
| 1518  | virito vector rx | 3.233 | 99.452     |
+-------+------------------+-------+------------+
03/03/2021 15:59:42    TestPVPMultiPathPerformance: 
+-------+--------------+------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps    | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+============+============+=====================+=======================+
| 64    | 1024         | 8.272 Mpps | 13.897%    | 8.137 Mpps          | 0.135 Mpps            |
+-------+--------------+------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.233 Mpps | 99.452%    | 3.239 Mpps          | -0.006 Mpps           |
+-------+--------------+------------+------------+---------------------+-----------------------+
03/03/2021 15:59:42    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.406850
03/03/2021 15:59:42    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.135000
03/03/2021 15:59:42    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.161950
03/03/2021 15:59:42    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.006000
03/03/2021 15:59:42    TestPVPMultiPathPerformance: Test Case test_perf_pvp_vector_rx Result PASSED:
03/03/2021 15:59:42             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 15:59:44    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_inorder_mergeable Begin
03/03/2021 15:59:44             dut.10.240.183.220: 
03/03/2021 15:59:44                         tester: 
03/03/2021 15:59:44             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 15:59:44             dut.10.240.183.220: 
03/03/2021 15:59:44             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 15:59:44             dut.10.240.183.220: 
03/03/2021 15:59:44             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 15:59:44             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 15:59:44             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 15:59:44             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 15:59:55             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 15:59:55             dut.10.240.183.220: 1048576
03/03/2021 16:00:06    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 16:00:06                         tester: ls -d /tmp
03/03/2021 16:00:06                         tester: /tmp
03/03/2021 16:00:06                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:00:08                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:08                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:08                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:08                         pktgen: trex port <0> not support flow control
03/03/2021 16:00:08                         pktgen: check the trex port link status
03/03/2021 16:00:08                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:08                         pktgen: begin traffic ......
03/03/2021 16:00:08                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:00:18                         pktgen: begin get port statistic ...
03/03/2021 16:00:18                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:00:18                         pktgen: {0: {'ibytes': 6618734592,
     'ierrors': 0,
     'ipackets': 103417740,
     'obytes': 17247687232,
     'oerrors': 0,
     'opackets': 269495138,
     'rx_bps': 5308853760.0,
     'rx_bps_L1': 6967872960.0,
     'rx_pps': 10368870.0,
     'rx_util': 17.4196824,
     'tx_bps': 13735795712.0,
     'tx_bps_L1': 18028232192.0,
     'tx_pps': 26827728.0,
     'tx_util': 45.07058048},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.829909324645996,
            'cpu_util': 93.8283920288086,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 138993194,
            'rx_bps': 5308853760.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8426941440.0,
            'rx_pps': 10368870.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13735795712.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26827728.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 6618734592,
           'ierrors': 0,
           'ipackets': 103417740,
           'obytes': 17247687232,
           'oerrors': 0,
           'opackets': 269495138,
           'rx_bps': 5308853760.0,
           'rx_bps_L1': 6967872960.0,
           'rx_pps': 10368870.0,
           'rx_util': 17.4196824,
           'tx_bps': 13735795712.0,
           'tx_bps_L1': 18028232192.0,
           'tx_pps': 26827728.0,
           'tx_util': 45.07058048}}
03/03/2021 16:00:18                         pktgen: {'ibytes': 6618734592,
 'ierrors': 0,
 'ipackets': 103417740,
 'obytes': 17247687232,
 'oerrors': 0,
 'opackets': 269495138,
 'rx_bps': 5308853760.0,
 'rx_bps_L1': 6967872960.0,
 'rx_pps': 10368870.0,
 'rx_util': 17.4196824,
 'tx_bps': 13735795712.0,
 'tx_bps_L1': 18028232192.0,
 'tx_pps': 26827728.0,
 'tx_util': 45.07058048}
03/03/2021 16:00:18                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13735795712.000000, tx_pps: 26827728.000000 
03/03/2021 16:00:18                         pktgen: {'ibytes': 6618734592,
 'ierrors': 0,
 'ipackets': 103417740,
 'obytes': 17247687232,
 'oerrors': 0,
 'opackets': 269495138,
 'rx_bps': 5308853760.0,
 'rx_bps_L1': 6967872960.0,
 'rx_pps': 10368870.0,
 'rx_util': 17.4196824,
 'tx_bps': 13735795712.0,
 'tx_bps_L1': 18028232192.0,
 'tx_pps': 26827728.0,
 'tx_util': 45.07058048}
03/03/2021 16:00:18                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 5308853760.000000, rx_pps: 10368870.000000
03/03/2021 16:00:18                         pktgen: throughput: pps_rx 10368870.000000, bps_rx 5308853760.000000
03/03/2021 16:00:18                         pktgen: traffic completed. 
03/03/2021 16:00:18    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 16:00:18                         tester: ls -d /tmp
03/03/2021 16:00:19                         tester: /tmp
03/03/2021 16:00:19                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:00:21                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:21                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:21                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:21                         pktgen: trex port <0> not support flow control
03/03/2021 16:00:21                         pktgen: check the trex port link status
03/03/2021 16:00:21                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:21                         pktgen: begin traffic ......
03/03/2021 16:00:21                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:00:31                         pktgen: begin get port statistic ...
03/03/2021 16:00:31                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:00:31                         pktgen: {0: {'ibytes': 12171957888,
     'ierrors': 0,
     'ipackets': 95093443,
     'obytes': 28045088128,
     'oerrors': 0,
     'opackets': 219102270,
     'rx_bps': 9713223680.0,
     'rx_bps_L1': 11231221120.0,
     'rx_pps': 9487484.0,
     'rx_util': 28.0780528,
     'tx_bps': 22351826944.0,
     'tx_bps_L1': 25845090944.000004,
     'tx_pps': 21832900.0,
     'tx_util': 64.61272736000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.910370349884033,
            'cpu_util': 96.00078582763672,
            'cpu_util_raw': 99.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141717589,
            'rx_bps': 9713223680.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12638602240.0,
            'rx_pps': 9487484.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22351826944.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21832900.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12171957888,
           'ierrors': 0,
           'ipackets': 95093443,
           'obytes': 28045088128,
           'oerrors': 0,
           'opackets': 219102270,
           'rx_bps': 9713223680.0,
           'rx_bps_L1': 11231221120.0,
           'rx_pps': 9487484.0,
           'rx_util': 28.0780528,
           'tx_bps': 22351826944.0,
           'tx_bps_L1': 25845090944.000004,
           'tx_pps': 21832900.0,
           'tx_util': 64.61272736000001}}
03/03/2021 16:00:31                         pktgen: {'ibytes': 12171957888,
 'ierrors': 0,
 'ipackets': 95093443,
 'obytes': 28045088128,
 'oerrors': 0,
 'opackets': 219102270,
 'rx_bps': 9713223680.0,
 'rx_bps_L1': 11231221120.0,
 'rx_pps': 9487484.0,
 'rx_util': 28.0780528,
 'tx_bps': 22351826944.0,
 'tx_bps_L1': 25845090944.000004,
 'tx_pps': 21832900.0,
 'tx_util': 64.61272736000001}
03/03/2021 16:00:31                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22351826944.000000, tx_pps: 21832900.000000 
03/03/2021 16:00:31                         pktgen: {'ibytes': 12171957888,
 'ierrors': 0,
 'ipackets': 95093443,
 'obytes': 28045088128,
 'oerrors': 0,
 'opackets': 219102270,
 'rx_bps': 9713223680.0,
 'rx_bps_L1': 11231221120.0,
 'rx_pps': 9487484.0,
 'rx_util': 28.0780528,
 'tx_bps': 22351826944.0,
 'tx_bps_L1': 25845090944.000004,
 'tx_pps': 21832900.0,
 'tx_util': 64.61272736000001}
03/03/2021 16:00:31                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9713223680.000000, rx_pps: 9487484.000000
03/03/2021 16:00:31                         pktgen: throughput: pps_rx 9487484.000000, bps_rx 9713223680.000000
03/03/2021 16:00:31                         pktgen: traffic completed. 
03/03/2021 16:00:31    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 16:00:31                         tester: ls -d /tmp
03/03/2021 16:00:31                         tester: /tmp
03/03/2021 16:00:31                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:00:33                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:33                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:33                         pktgen: trex port <0> not support flow control
03/03/2021 16:00:33                         pktgen: check the trex port link status
03/03/2021 16:00:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:33                         pktgen: begin traffic ......
03/03/2021 16:00:33                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:00:43                         pktgen: begin get port statistic ...
03/03/2021 16:00:43                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:00:43                         pktgen: {0: {'ibytes': 21476994304,
     'ierrors': 0,
     'ipackets': 83894520,
     'obytes': 46392512512,
     'oerrors': 0,
     'opackets': 181220767,
     'rx_bps': 17224083456.0,
     'rx_bps_L1': 18569988096.0,
     'rx_pps': 8411904.0,
     'rx_util': 46.42497024,
     'tx_bps': 37133852672.0,
     'tx_bps_L1': 40035560831.99999,
     'tx_pps': 18135676.0,
     'tx_util': 100.08890207999998},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 49.585487365722656,
            'cpu_util': 9.361068725585938,
            'cpu_util_raw': 4.9375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 2041426,
            'rx_bps': 17224083456.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19909767168.0,
            'rx_pps': 8411904.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 37133852672.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 18135676.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 21476994304,
           'ierrors': 0,
           'ipackets': 83894520,
           'obytes': 46392512512,
           'oerrors': 0,
           'opackets': 181220767,
           'rx_bps': 17224083456.0,
           'rx_bps_L1': 18569988096.0,
           'rx_pps': 8411904.0,
           'rx_util': 46.42497024,
           'tx_bps': 37133852672.0,
           'tx_bps_L1': 40035560831.99999,
           'tx_pps': 18135676.0,
           'tx_util': 100.08890207999998}}
03/03/2021 16:00:43                         pktgen: {'ibytes': 21476994304,
 'ierrors': 0,
 'ipackets': 83894520,
 'obytes': 46392512512,
 'oerrors': 0,
 'opackets': 181220767,
 'rx_bps': 17224083456.0,
 'rx_bps_L1': 18569988096.0,
 'rx_pps': 8411904.0,
 'rx_util': 46.42497024,
 'tx_bps': 37133852672.0,
 'tx_bps_L1': 40035560831.99999,
 'tx_pps': 18135676.0,
 'tx_util': 100.08890207999998}
03/03/2021 16:00:43                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 37133852672.000000, tx_pps: 18135676.000000 
03/03/2021 16:00:43                         pktgen: {'ibytes': 21476994304,
 'ierrors': 0,
 'ipackets': 83894520,
 'obytes': 46392512512,
 'oerrors': 0,
 'opackets': 181220767,
 'rx_bps': 17224083456.0,
 'rx_bps_L1': 18569988096.0,
 'rx_pps': 8411904.0,
 'rx_util': 46.42497024,
 'tx_bps': 37133852672.0,
 'tx_bps_L1': 40035560831.99999,
 'tx_pps': 18135676.0,
 'tx_util': 100.08890207999998}
03/03/2021 16:00:43                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 17224083456.000000, rx_pps: 8411904.000000
03/03/2021 16:00:43                         pktgen: throughput: pps_rx 8411904.000000, bps_rx 17224083456.000000
03/03/2021 16:00:43                         pktgen: traffic completed. 
03/03/2021 16:00:43    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 16:00:43                         tester: ls -d /tmp
03/03/2021 16:00:43                         tester: /tmp
03/03/2021 16:00:43                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:00:45                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:45                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:45                         pktgen: trex port <0> not support flow control
03/03/2021 16:00:45                         pktgen: check the trex port link status
03/03/2021 16:00:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:45                         pktgen: begin traffic ......
03/03/2021 16:00:45                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:00:55                         pktgen: begin get port statistic ...
03/03/2021 16:00:55                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:00:55                         pktgen: {0: {'ibytes': 32165584384,
     'ierrors': 0,
     'ipackets': 62823416,
     'obytes': 48170531328,
     'oerrors': 0,
     'opackets': 94083077,
     'rx_bps': 25642323968.0,
     'rx_bps_L1': 26644207088.000004,
     'rx_pps': 6261769.5,
     'rx_util': 66.61051772,
     'tx_bps': 38382931968.0,
     'tx_bps_L1': 39882760288.0,
     'tx_pps': 9373927.0,
     'tx_util': 99.70690072000001},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.56322193145752,
            'cpu_util': 56.02875518798828,
            'cpu_util_raw': 60.8125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82568863,
            'rx_bps': 25642323968.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12740609024.0,
            'rx_pps': 6261769.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38382931968.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9373927.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 32165584384,
           'ierrors': 0,
           'ipackets': 62823416,
           'obytes': 48170531328,
           'oerrors': 0,
           'opackets': 94083077,
           'rx_bps': 25642323968.0,
           'rx_bps_L1': 26644207088.000004,
           'rx_pps': 6261769.5,
           'rx_util': 66.61051772,
           'tx_bps': 38382931968.0,
           'tx_bps_L1': 39882760288.0,
           'tx_pps': 9373927.0,
           'tx_util': 99.70690072000001}}
03/03/2021 16:00:55                         pktgen: {'ibytes': 32165584384,
 'ierrors': 0,
 'ipackets': 62823416,
 'obytes': 48170531328,
 'oerrors': 0,
 'opackets': 94083077,
 'rx_bps': 25642323968.0,
 'rx_bps_L1': 26644207088.000004,
 'rx_pps': 6261769.5,
 'rx_util': 66.61051772,
 'tx_bps': 38382931968.0,
 'tx_bps_L1': 39882760288.0,
 'tx_pps': 9373927.0,
 'tx_util': 99.70690072000001}
03/03/2021 16:00:55                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38382931968.000000, tx_pps: 9373927.000000 
03/03/2021 16:00:55                         pktgen: {'ibytes': 32165584384,
 'ierrors': 0,
 'ipackets': 62823416,
 'obytes': 48170531328,
 'oerrors': 0,
 'opackets': 94083077,
 'rx_bps': 25642323968.0,
 'rx_bps_L1': 26644207088.000004,
 'rx_pps': 6261769.5,
 'rx_util': 66.61051772,
 'tx_bps': 38382931968.0,
 'tx_bps_L1': 39882760288.0,
 'tx_pps': 9373927.0,
 'tx_util': 99.70690072000001}
03/03/2021 16:00:55                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 25642323968.000000, rx_pps: 6261769.500000
03/03/2021 16:00:55                         pktgen: throughput: pps_rx 6261769.500000, bps_rx 25642323968.000000
03/03/2021 16:00:55                         pktgen: traffic completed. 
03/03/2021 16:00:55    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 16:00:55                         tester: ls -d /tmp
03/03/2021 16:00:55                         tester: /tmp
03/03/2021 16:00:55                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:00:57                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:57                         pktgen: test port 0 map gen port 0
03/03/2021 16:00:57                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:57                         pktgen: trex port <0> not support flow control
03/03/2021 16:00:57                         pktgen: check the trex port link status
03/03/2021 16:00:57                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:00:57                         pktgen: begin traffic ......
03/03/2021 16:00:57                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:01:07                         pktgen: begin get port statistic ...
03/03/2021 16:01:07                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:01:07                         pktgen: {0: {'ibytes': 43991885824,
     'ierrors': 0,
     'ipackets': 42960830,
     'obytes': 49094130688,
     'oerrors': 0,
     'opackets': 47943491,
     'rx_bps': 35064610816.0,
     'rx_bps_L1': 35749630736.0,
     'rx_pps': 4281374.5,
     'rx_util': 89.37407684,
     'tx_bps': 39127519232.0,
     'tx_bps_L1': 39891974512.0,
     'tx_pps': 4777845.5,
     'tx_util': 99.72993628},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.476219177246094,
            'cpu_util': 27.986257553100586,
            'cpu_util_raw': 28.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36131094,
            'rx_bps': 35064610816.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 4062910208.0,
            'rx_pps': 4281374.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39127519232.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4777845.5},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 43991885824,
           'ierrors': 0,
           'ipackets': 42960830,
           'obytes': 49094130688,
           'oerrors': 0,
           'opackets': 47943491,
           'rx_bps': 35064610816.0,
           'rx_bps_L1': 35749630736.0,
           'rx_pps': 4281374.5,
           'rx_util': 89.37407684,
           'tx_bps': 39127519232.0,
           'tx_bps_L1': 39891974512.0,
           'tx_pps': 4777845.5,
           'tx_util': 99.72993628}}
03/03/2021 16:01:07                         pktgen: {'ibytes': 43991885824,
 'ierrors': 0,
 'ipackets': 42960830,
 'obytes': 49094130688,
 'oerrors': 0,
 'opackets': 47943491,
 'rx_bps': 35064610816.0,
 'rx_bps_L1': 35749630736.0,
 'rx_pps': 4281374.5,
 'rx_util': 89.37407684,
 'tx_bps': 39127519232.0,
 'tx_bps_L1': 39891974512.0,
 'tx_pps': 4777845.5,
 'tx_util': 99.72993628}
03/03/2021 16:01:07                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39127519232.000000, tx_pps: 4777845.500000 
03/03/2021 16:01:07                         pktgen: {'ibytes': 43991885824,
 'ierrors': 0,
 'ipackets': 42960830,
 'obytes': 49094130688,
 'oerrors': 0,
 'opackets': 47943491,
 'rx_bps': 35064610816.0,
 'rx_bps_L1': 35749630736.0,
 'rx_pps': 4281374.5,
 'rx_util': 89.37407684,
 'tx_bps': 39127519232.0,
 'tx_bps_L1': 39891974512.0,
 'tx_pps': 4777845.5,
 'tx_util': 99.72993628}
03/03/2021 16:01:07                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 35064610816.000000, rx_pps: 4281374.500000
03/03/2021 16:01:07                         pktgen: throughput: pps_rx 4281374.500000, bps_rx 35064610816.000000
03/03/2021 16:01:07                         pktgen: traffic completed. 
03/03/2021 16:01:07    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 16:01:07                         tester: ls -d /tmp
03/03/2021 16:01:07                         tester: /tmp
03/03/2021 16:01:07                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:01:09                         pktgen: test port 0 map gen port 0
03/03/2021 16:01:09                         pktgen: test port 0 map gen port 0
03/03/2021 16:01:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:01:09                         pktgen: trex port <0> not support flow control
03/03/2021 16:01:09                         pktgen: check the trex port link status
03/03/2021 16:01:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:01:09                         pktgen: begin traffic ......
03/03/2021 16:01:09                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:01:19                         pktgen: begin get port statistic ...
03/03/2021 16:01:19                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:01:19                         pktgen: {0: {'ibytes': 49404283038,
     'ierrors': 0,
     'ipackets': 32545645,
     'obytes': 49404199548,
     'oerrors': 0,
     'opackets': 32545588,
     'rx_bps': 39407177728.0,
     'rx_bps_L1': 39926447248.0,
     'rx_pps': 3245434.5,
     'rx_util': 99.81611812,
     'tx_bps': 39408537600.0,
     'tx_bps_L1': 39927833280.0,
     'tx_pps': 3245598.0,
     'tx_util': 99.8195832},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.03947067260742,
            'cpu_util': 14.47163200378418,
            'cpu_util_raw': 14.125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17219024,
            'rx_bps': 39407177728.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3245434.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39408537600.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3245598.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49404283038,
           'ierrors': 0,
           'ipackets': 32545645,
           'obytes': 49404199548,
           'oerrors': 0,
           'opackets': 32545588,
           'rx_bps': 39407177728.0,
           'rx_bps_L1': 39926447248.0,
           'rx_pps': 3245434.5,
           'rx_util': 99.81611812,
           'tx_bps': 39408537600.0,
           'tx_bps_L1': 39927833280.0,
           'tx_pps': 3245598.0,
           'tx_util': 99.8195832}}
03/03/2021 16:01:19                         pktgen: {'ibytes': 49404283038,
 'ierrors': 0,
 'ipackets': 32545645,
 'obytes': 49404199548,
 'oerrors': 0,
 'opackets': 32545588,
 'rx_bps': 39407177728.0,
 'rx_bps_L1': 39926447248.0,
 'rx_pps': 3245434.5,
 'rx_util': 99.81611812,
 'tx_bps': 39408537600.0,
 'tx_bps_L1': 39927833280.0,
 'tx_pps': 3245598.0,
 'tx_util': 99.8195832}
03/03/2021 16:01:19                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39408537600.000000, tx_pps: 3245598.000000 
03/03/2021 16:01:19                         pktgen: {'ibytes': 49404283038,
 'ierrors': 0,
 'ipackets': 32545645,
 'obytes': 49404199548,
 'oerrors': 0,
 'opackets': 32545588,
 'rx_bps': 39407177728.0,
 'rx_bps_L1': 39926447248.0,
 'rx_pps': 3245434.5,
 'rx_util': 99.81611812,
 'tx_bps': 39408537600.0,
 'tx_bps_L1': 39927833280.0,
 'tx_pps': 3245598.0,
 'tx_util': 99.8195832}
03/03/2021 16:01:19                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39407177728.000000, rx_pps: 3245434.500000
03/03/2021 16:01:19                         pktgen: throughput: pps_rx 3245434.500000, bps_rx 39407177728.000000
03/03/2021 16:01:19                         pktgen: traffic completed. 
03/03/2021 16:01:21    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 16:01:21    TestPVPMultiPathPerformance: 
+-------+---------------------------------+--------+------------+
| Frame |          Mode/RXD-TXD           |  Mpps  | % linerate |
+=======+=================================+========+============+
| 64    | virtio_1.1_inorder_mergeable on | 10.369 | 17.420     |
+-------+---------------------------------+--------+------------+
| 128   | virtio_1.1_inorder_mergeable on | 9.487  | 28.083     |
+-------+---------------------------------+--------+------------+
| 256   | virtio_1.1_inorder_mergeable on | 8.412  | 46.434     |
+-------+---------------------------------+--------+------------+
| 512   | virtio_1.1_inorder_mergeable on | 6.262  | 66.625     |
+-------+---------------------------------+--------+------------+
| 1024  | virtio_1.1_inorder_mergeable on | 4.281  | 89.395     |
+-------+---------------------------------+--------+------------+
| 1518  | virtio_1.1_inorder_mergeable on | 3.245  | 99.830     |
+-------+---------------------------------+--------+------------+
03/03/2021 16:01:21    TestPVPMultiPathPerformance: 
+-------+--------------+-------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps     | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+=============+============+=====================+=======================+
| 64    | 1024         | 10.369 Mpps | 17.420%    | 10.305 Mpps         | 0.064 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.245 Mpps  | 99.830%    | 3.243 Mpps          | 0.002 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
03/03/2021 16:01:21    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.515250
03/03/2021 16:01:21    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.064000
03/03/2021 16:01:21    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162150
03/03/2021 16:01:21    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.002000
03/03/2021 16:01:21    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_inorder_mergeable Result PASSED:
03/03/2021 16:01:21             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 16:01:22    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_inorder_normal Begin
03/03/2021 16:01:23             dut.10.240.183.220: 
03/03/2021 16:01:23                         tester: 
03/03/2021 16:01:23             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 16:01:23             dut.10.240.183.220: 
03/03/2021 16:01:23             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 16:01:23             dut.10.240.183.220: 
03/03/2021 16:01:23             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 16:01:23             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 16:01:23             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 16:01:23             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 16:01:34             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 16:01:34             dut.10.240.183.220: 1048576
03/03/2021 16:01:45    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 16:01:45                         tester: ls -d /tmp
03/03/2021 16:01:45                         tester: /tmp
03/03/2021 16:01:45                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:01:47                         pktgen: test port 0 map gen port 0
03/03/2021 16:01:47                         pktgen: test port 0 map gen port 0
03/03/2021 16:01:47                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:01:47                         pktgen: trex port <0> not support flow control
03/03/2021 16:01:47                         pktgen: check the trex port link status
03/03/2021 16:01:47                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:01:47                         pktgen: begin traffic ......
03/03/2021 16:01:47                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:01:57                         pktgen: begin get port statistic ...
03/03/2021 16:01:57                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:01:57                         pktgen: {0: {'ibytes': 6595339200,
     'ierrors': 0,
     'ipackets': 103052196,
     'obytes': 17188965824,
     'oerrors': 0,
     'opackets': 268577603,
     'rx_bps': 5290326016.0,
     'rx_bps_L1': 6943553216.0,
     'rx_pps': 10332670.0,
     'rx_util': 17.358883040000002,
     'tx_bps': 13716721664.0,
     'tx_bps_L1': 18003198464.0,
     'tx_pps': 26790480.0,
     'tx_util': 45.007996160000005},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.8661434650421143,
            'cpu_util': 91.87879943847656,
            'cpu_util_raw': 99.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 139122483,
            'rx_bps': 5290326016.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8426395648.0,
            'rx_pps': 10332670.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13716721664.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26790480.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 6595339200,
           'ierrors': 0,
           'ipackets': 103052196,
           'obytes': 17188965824,
           'oerrors': 0,
           'opackets': 268577603,
           'rx_bps': 5290326016.0,
           'rx_bps_L1': 6943553216.0,
           'rx_pps': 10332670.0,
           'rx_util': 17.358883040000002,
           'tx_bps': 13716721664.0,
           'tx_bps_L1': 18003198464.0,
           'tx_pps': 26790480.0,
           'tx_util': 45.007996160000005}}
03/03/2021 16:01:57                         pktgen: {'ibytes': 6595339200,
 'ierrors': 0,
 'ipackets': 103052196,
 'obytes': 17188965824,
 'oerrors': 0,
 'opackets': 268577603,
 'rx_bps': 5290326016.0,
 'rx_bps_L1': 6943553216.0,
 'rx_pps': 10332670.0,
 'rx_util': 17.358883040000002,
 'tx_bps': 13716721664.0,
 'tx_bps_L1': 18003198464.0,
 'tx_pps': 26790480.0,
 'tx_util': 45.007996160000005}
03/03/2021 16:01:57                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13716721664.000000, tx_pps: 26790480.000000 
03/03/2021 16:01:57                         pktgen: {'ibytes': 6595339200,
 'ierrors': 0,
 'ipackets': 103052196,
 'obytes': 17188965824,
 'oerrors': 0,
 'opackets': 268577603,
 'rx_bps': 5290326016.0,
 'rx_bps_L1': 6943553216.0,
 'rx_pps': 10332670.0,
 'rx_util': 17.358883040000002,
 'tx_bps': 13716721664.0,
 'tx_bps_L1': 18003198464.0,
 'tx_pps': 26790480.0,
 'tx_util': 45.007996160000005}
03/03/2021 16:01:57                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 5290326016.000000, rx_pps: 10332670.000000
03/03/2021 16:01:57                         pktgen: throughput: pps_rx 10332670.000000, bps_rx 5290326016.000000
03/03/2021 16:01:57                         pktgen: traffic completed. 
03/03/2021 16:01:57    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 16:01:57                         tester: ls -d /tmp
03/03/2021 16:01:58                         tester: /tmp
03/03/2021 16:01:58                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:01:59                         pktgen: test port 0 map gen port 0
03/03/2021 16:01:59                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:00                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:00                         pktgen: trex port <0> not support flow control
03/03/2021 16:02:00                         pktgen: check the trex port link status
03/03/2021 16:02:00                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:00                         pktgen: begin traffic ......
03/03/2021 16:02:00                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:02:10                         pktgen: begin get port statistic ...
03/03/2021 16:02:10                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:02:10                         pktgen: {0: {'ibytes': 12207671168,
     'ierrors': 0,
     'ipackets': 95372431,
     'obytes': 28077953664,
     'oerrors': 0,
     'opackets': 219359038,
     'rx_bps': 9766553600.0,
     'rx_bps_L1': 11292880960.0,
     'rx_pps': 9539546.0,
     'rx_util': 28.232202400000002,
     'tx_bps': 22367100928.0,
     'tx_bps_L1': 25862742528.0,
     'tx_pps': 21847760.0,
     'tx_util': 64.65685632},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.912848711013794,
            'cpu_util': 95.98464965820312,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141692735,
            'rx_bps': 9766553600.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12600548352.0,
            'rx_pps': 9539546.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22367100928.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21847760.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12207671168,
           'ierrors': 0,
           'ipackets': 95372431,
           'obytes': 28077953664,
           'oerrors': 0,
           'opackets': 219359038,
           'rx_bps': 9766553600.0,
           'rx_bps_L1': 11292880960.0,
           'rx_pps': 9539546.0,
           'rx_util': 28.232202400000002,
           'tx_bps': 22367100928.0,
           'tx_bps_L1': 25862742528.0,
           'tx_pps': 21847760.0,
           'tx_util': 64.65685632}}
03/03/2021 16:02:10                         pktgen: {'ibytes': 12207671168,
 'ierrors': 0,
 'ipackets': 95372431,
 'obytes': 28077953664,
 'oerrors': 0,
 'opackets': 219359038,
 'rx_bps': 9766553600.0,
 'rx_bps_L1': 11292880960.0,
 'rx_pps': 9539546.0,
 'rx_util': 28.232202400000002,
 'tx_bps': 22367100928.0,
 'tx_bps_L1': 25862742528.0,
 'tx_pps': 21847760.0,
 'tx_util': 64.65685632}
03/03/2021 16:02:10                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22367100928.000000, tx_pps: 21847760.000000 
03/03/2021 16:02:10                         pktgen: {'ibytes': 12207671168,
 'ierrors': 0,
 'ipackets': 95372431,
 'obytes': 28077953664,
 'oerrors': 0,
 'opackets': 219359038,
 'rx_bps': 9766553600.0,
 'rx_bps_L1': 11292880960.0,
 'rx_pps': 9539546.0,
 'rx_util': 28.232202400000002,
 'tx_bps': 22367100928.0,
 'tx_bps_L1': 25862742528.0,
 'tx_pps': 21847760.0,
 'tx_util': 64.65685632}
03/03/2021 16:02:10                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9766553600.000000, rx_pps: 9539546.000000
03/03/2021 16:02:10                         pktgen: throughput: pps_rx 9539546.000000, bps_rx 9766553600.000000
03/03/2021 16:02:10                         pktgen: traffic completed. 
03/03/2021 16:02:10    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 16:02:10                         tester: ls -d /tmp
03/03/2021 16:02:10                         tester: /tmp
03/03/2021 16:02:10                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:02:12                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:12                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:12                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:12                         pktgen: trex port <0> not support flow control
03/03/2021 16:02:12                         pktgen: check the trex port link status
03/03/2021 16:02:12                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:12                         pktgen: begin traffic ......
03/03/2021 16:02:12                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:02:22                         pktgen: begin get port statistic ...
03/03/2021 16:02:22                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:02:22                         pktgen: {0: {'ibytes': 21392989184,
     'ierrors': 0,
     'ipackets': 83566364,
     'obytes': 46422821376,
     'oerrors': 0,
     'opackets': 181339161,
     'rx_bps': 17191446528.0,
     'rx_bps_L1': 18534797568.0,
     'rx_pps': 8395944.0,
     'rx_util': 46.336993920000005,
     'tx_bps': 37087559680.0,
     'tx_bps_L1': 39985643520.0,
     'tx_pps': 18113024.0,
     'tx_util': 99.96410879999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 50.262428283691406,
            'cpu_util': 9.223480224609375,
            'cpu_util_raw': 5.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 1689964,
            'rx_bps': 17191446528.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 19896111104.0,
            'rx_pps': 8395944.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 37087559680.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 18113024.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 21392989184,
           'ierrors': 0,
           'ipackets': 83566364,
           'obytes': 46422821376,
           'oerrors': 0,
           'opackets': 181339161,
           'rx_bps': 17191446528.0,
           'rx_bps_L1': 18534797568.0,
           'rx_pps': 8395944.0,
           'rx_util': 46.336993920000005,
           'tx_bps': 37087559680.0,
           'tx_bps_L1': 39985643520.0,
           'tx_pps': 18113024.0,
           'tx_util': 99.96410879999999}}
03/03/2021 16:02:22                         pktgen: {'ibytes': 21392989184,
 'ierrors': 0,
 'ipackets': 83566364,
 'obytes': 46422821376,
 'oerrors': 0,
 'opackets': 181339161,
 'rx_bps': 17191446528.0,
 'rx_bps_L1': 18534797568.0,
 'rx_pps': 8395944.0,
 'rx_util': 46.336993920000005,
 'tx_bps': 37087559680.0,
 'tx_bps_L1': 39985643520.0,
 'tx_pps': 18113024.0,
 'tx_util': 99.96410879999999}
03/03/2021 16:02:22                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 37087559680.000000, tx_pps: 18113024.000000 
03/03/2021 16:02:22                         pktgen: {'ibytes': 21392989184,
 'ierrors': 0,
 'ipackets': 83566364,
 'obytes': 46422821376,
 'oerrors': 0,
 'opackets': 181339161,
 'rx_bps': 17191446528.0,
 'rx_bps_L1': 18534797568.0,
 'rx_pps': 8395944.0,
 'rx_util': 46.336993920000005,
 'tx_bps': 37087559680.0,
 'tx_bps_L1': 39985643520.0,
 'tx_pps': 18113024.0,
 'tx_util': 99.96410879999999}
03/03/2021 16:02:22                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 17191446528.000000, rx_pps: 8395944.000000
03/03/2021 16:02:22                         pktgen: throughput: pps_rx 8395944.000000, bps_rx 17191446528.000000
03/03/2021 16:02:22                         pktgen: traffic completed. 
03/03/2021 16:02:22    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 16:02:22                         tester: ls -d /tmp
03/03/2021 16:02:22                         tester: /tmp
03/03/2021 16:02:22                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:02:24                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:24                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:24                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:24                         pktgen: trex port <0> not support flow control
03/03/2021 16:02:24                         pktgen: check the trex port link status
03/03/2021 16:02:24                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:24                         pktgen: begin traffic ......
03/03/2021 16:02:24                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:02:34                         pktgen: begin get port statistic ...
03/03/2021 16:02:34                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:02:34                         pktgen: {0: {'ibytes': 32319363584,
     'ierrors': 0,
     'ipackets': 63123766,
     'obytes': 48171772416,
     'oerrors': 0,
     'opackets': 94085501,
     'rx_bps': 25788100608.0,
     'rx_bps_L1': 26795680528.0,
     'rx_pps': 6297374.5,
     'rx_util': 66.98920132,
     'tx_bps': 38401355776.0,
     'tx_bps_L1': 39901910656.0,
     'tx_pps': 9378468.0,
     'tx_util': 99.75477664},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.518997192382812,
            'cpu_util': 56.346649169921875,
            'cpu_util_raw': 61.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82753001,
            'rx_bps': 25788100608.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12613254144.0,
            'rx_pps': 6297374.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38401355776.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9378468.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 32319363584,
           'ierrors': 0,
           'ipackets': 63123766,
           'obytes': 48171772416,
           'oerrors': 0,
           'opackets': 94085501,
           'rx_bps': 25788100608.0,
           'rx_bps_L1': 26795680528.0,
           'rx_pps': 6297374.5,
           'rx_util': 66.98920132,
           'tx_bps': 38401355776.0,
           'tx_bps_L1': 39901910656.0,
           'tx_pps': 9378468.0,
           'tx_util': 99.75477664}}
03/03/2021 16:02:34                         pktgen: {'ibytes': 32319363584,
 'ierrors': 0,
 'ipackets': 63123766,
 'obytes': 48171772416,
 'oerrors': 0,
 'opackets': 94085501,
 'rx_bps': 25788100608.0,
 'rx_bps_L1': 26795680528.0,
 'rx_pps': 6297374.5,
 'rx_util': 66.98920132,
 'tx_bps': 38401355776.0,
 'tx_bps_L1': 39901910656.0,
 'tx_pps': 9378468.0,
 'tx_util': 99.75477664}
03/03/2021 16:02:34                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38401355776.000000, tx_pps: 9378468.000000 
03/03/2021 16:02:34                         pktgen: {'ibytes': 32319363584,
 'ierrors': 0,
 'ipackets': 63123766,
 'obytes': 48171772416,
 'oerrors': 0,
 'opackets': 94085501,
 'rx_bps': 25788100608.0,
 'rx_bps_L1': 26795680528.0,
 'rx_pps': 6297374.5,
 'rx_util': 66.98920132,
 'tx_bps': 38401355776.0,
 'tx_bps_L1': 39901910656.0,
 'tx_pps': 9378468.0,
 'tx_util': 99.75477664}
03/03/2021 16:02:34                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 25788100608.000000, rx_pps: 6297374.500000
03/03/2021 16:02:34                         pktgen: throughput: pps_rx 6297374.500000, bps_rx 25788100608.000000
03/03/2021 16:02:34                         pktgen: traffic completed. 
03/03/2021 16:02:34    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 16:02:34                         tester: ls -d /tmp
03/03/2021 16:02:34                         tester: /tmp
03/03/2021 16:02:34                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:02:36                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:36                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:36                         pktgen: trex port <0> not support flow control
03/03/2021 16:02:36                         pktgen: check the trex port link status
03/03/2021 16:02:36                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:36                         pktgen: begin traffic ......
03/03/2021 16:02:36                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:02:46                         pktgen: begin get port statistic ...
03/03/2021 16:02:46                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:02:46                         pktgen: {0: {'ibytes': 44086358016,
     'ierrors': 0,
     'ipackets': 43053088,
     'obytes': 49093692416,
     'oerrors': 0,
     'opackets': 47943065,
     'rx_bps': 35224342528.0,
     'rx_bps_L1': 35912485328.0,
     'rx_pps': 4300892.5,
     'rx_util': 89.78121331999999,
     'tx_bps': 39211806720.0,
     'tx_bps_L1': 39977911280.0,
     'tx_pps': 4788153.5,
     'tx_util': 99.9447782},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.36320686340332,
            'cpu_util': 28.229093551635742,
            'cpu_util_raw': 28.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36194818,
            'rx_bps': 35224342528.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 3987460864.0,
            'rx_pps': 4300892.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39211806720.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4788153.5},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 44086358016,
           'ierrors': 0,
           'ipackets': 43053088,
           'obytes': 49093692416,
           'oerrors': 0,
           'opackets': 47943065,
           'rx_bps': 35224342528.0,
           'rx_bps_L1': 35912485328.0,
           'rx_pps': 4300892.5,
           'rx_util': 89.78121331999999,
           'tx_bps': 39211806720.0,
           'tx_bps_L1': 39977911280.0,
           'tx_pps': 4788153.5,
           'tx_util': 99.9447782}}
03/03/2021 16:02:46                         pktgen: {'ibytes': 44086358016,
 'ierrors': 0,
 'ipackets': 43053088,
 'obytes': 49093692416,
 'oerrors': 0,
 'opackets': 47943065,
 'rx_bps': 35224342528.0,
 'rx_bps_L1': 35912485328.0,
 'rx_pps': 4300892.5,
 'rx_util': 89.78121331999999,
 'tx_bps': 39211806720.0,
 'tx_bps_L1': 39977911280.0,
 'tx_pps': 4788153.5,
 'tx_util': 99.9447782}
03/03/2021 16:02:46                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39211806720.000000, tx_pps: 4788153.500000 
03/03/2021 16:02:46                         pktgen: {'ibytes': 44086358016,
 'ierrors': 0,
 'ipackets': 43053088,
 'obytes': 49093692416,
 'oerrors': 0,
 'opackets': 47943065,
 'rx_bps': 35224342528.0,
 'rx_bps_L1': 35912485328.0,
 'rx_pps': 4300892.5,
 'rx_util': 89.78121331999999,
 'tx_bps': 39211806720.0,
 'tx_bps_L1': 39977911280.0,
 'tx_pps': 4788153.5,
 'tx_util': 99.9447782}
03/03/2021 16:02:46                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 35224342528.000000, rx_pps: 4300892.500000
03/03/2021 16:02:46                         pktgen: throughput: pps_rx 4300892.500000, bps_rx 35224342528.000000
03/03/2021 16:02:46                         pktgen: traffic completed. 
03/03/2021 16:02:46    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 16:02:46                         tester: ls -d /tmp
03/03/2021 16:02:46                         tester: /tmp
03/03/2021 16:02:46                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:02:48                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:48                         pktgen: test port 0 map gen port 0
03/03/2021 16:02:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:48                         pktgen: trex port <0> not support flow control
03/03/2021 16:02:48                         pktgen: check the trex port link status
03/03/2021 16:02:48                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:02:48                         pktgen: begin traffic ......
03/03/2021 16:02:48                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:02:58                         pktgen: begin get port statistic ...
03/03/2021 16:02:58                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:02:58                         pktgen: {0: {'ibytes': 49404196512,
     'ierrors': 0,
     'ipackets': 32545587,
     'obytes': 49404090252,
     'oerrors': 0,
     'opackets': 32545517,
     'rx_bps': 39552552960.0,
     'rx_bps_L1': 40073739600.0,
     'rx_pps': 3257416.5,
     'rx_util': 100.184349,
     'tx_bps': 39553839104.0,
     'tx_bps_L1': 40075050784.0,
     'tx_pps': 3257573.0,
     'tx_util': 100.18762696},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.40459442138672,
            'cpu_util': 14.370841979980469,
            'cpu_util_raw': 15.0,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17351103,
            'rx_bps': 39552552960.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3257416.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39553839104.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3257573.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49404196512,
           'ierrors': 0,
           'ipackets': 32545587,
           'obytes': 49404090252,
           'oerrors': 0,
           'opackets': 32545517,
           'rx_bps': 39552552960.0,
           'rx_bps_L1': 40073739600.0,
           'rx_pps': 3257416.5,
           'rx_util': 100.184349,
           'tx_bps': 39553839104.0,
           'tx_bps_L1': 40075050784.0,
           'tx_pps': 3257573.0,
           'tx_util': 100.18762696}}
03/03/2021 16:02:58                         pktgen: {'ibytes': 49404196512,
 'ierrors': 0,
 'ipackets': 32545587,
 'obytes': 49404090252,
 'oerrors': 0,
 'opackets': 32545517,
 'rx_bps': 39552552960.0,
 'rx_bps_L1': 40073739600.0,
 'rx_pps': 3257416.5,
 'rx_util': 100.184349,
 'tx_bps': 39553839104.0,
 'tx_bps_L1': 40075050784.0,
 'tx_pps': 3257573.0,
 'tx_util': 100.18762696}
03/03/2021 16:02:58                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39553839104.000000, tx_pps: 3257573.000000 
03/03/2021 16:02:58                         pktgen: {'ibytes': 49404196512,
 'ierrors': 0,
 'ipackets': 32545587,
 'obytes': 49404090252,
 'oerrors': 0,
 'opackets': 32545517,
 'rx_bps': 39552552960.0,
 'rx_bps_L1': 40073739600.0,
 'rx_pps': 3257416.5,
 'rx_util': 100.184349,
 'tx_bps': 39553839104.0,
 'tx_bps_L1': 40075050784.0,
 'tx_pps': 3257573.0,
 'tx_util': 100.18762696}
03/03/2021 16:02:58                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39552552960.000000, rx_pps: 3257416.500000
03/03/2021 16:02:58                         pktgen: throughput: pps_rx 3257416.500000, bps_rx 39552552960.000000
03/03/2021 16:02:58                         pktgen: traffic completed. 
03/03/2021 16:03:00    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 16:03:00    TestPVPMultiPathPerformance: 
+-------+---------------------------+--------+------------+
| Frame |       Mode/RXD-TXD        |  Mpps  | % linerate |
+=======+===========================+========+============+
| 64    | virtio_1.1_inorder_normal | 10.333 | 17.359     |
+-------+---------------------------+--------+------------+
| 128   | virtio_1.1_inorder_normal | 9.540  | 28.237     |
+-------+---------------------------+--------+------------+
| 256   | virtio_1.1_inorder_normal | 8.396  | 46.346     |
+-------+---------------------------+--------+------------+
| 512   | virtio_1.1_inorder_normal | 6.297  | 67.004     |
+-------+---------------------------+--------+------------+
| 1024  | virtio_1.1_inorder_normal | 4.301  | 89.803     |
+-------+---------------------------+--------+------------+
| 1518  | virtio_1.1_inorder_normal | 3.257  | 100.198    |
+-------+---------------------------+--------+------------+
03/03/2021 16:03:00    TestPVPMultiPathPerformance: 
+-------+--------------+-------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps     | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+=============+============+=====================+=======================+
| 64    | 1024         | 10.333 Mpps | 17.359%    | 10.300 Mpps         | 0.033 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.257 Mpps  | 100.198%   | 3.244 Mpps          | 0.013 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
03/03/2021 16:03:00    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.515000
03/03/2021 16:03:00    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.033000
03/03/2021 16:03:00    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162200
03/03/2021 16:03:00    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.013000
03/03/2021 16:03:00    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_inorder_normal Result PASSED:
03/03/2021 16:03:00             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 16:03:01    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_mergeable Begin
03/03/2021 16:03:02             dut.10.240.183.220: 
03/03/2021 16:03:02                         tester: 
03/03/2021 16:03:02             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 16:03:02             dut.10.240.183.220: 
03/03/2021 16:03:02             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 16:03:02             dut.10.240.183.220: 
03/03/2021 16:03:02             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 16:03:02             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 16:03:02             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 16:03:02             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 16:03:13             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 16:03:13             dut.10.240.183.220: 1048576
03/03/2021 16:03:24    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 16:03:24                         tester: ls -d /tmp
03/03/2021 16:03:24                         tester: /tmp
03/03/2021 16:03:24                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:03:26                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:26                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:26                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:26                         pktgen: trex port <0> not support flow control
03/03/2021 16:03:26                         pktgen: check the trex port link status
03/03/2021 16:03:26                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:26                         pktgen: begin traffic ......
03/03/2021 16:03:26                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:03:36                         pktgen: begin get port statistic ...
03/03/2021 16:03:36                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:03:36                         pktgen: {0: {'ibytes': 6444774144,
     'ierrors': 0,
     'ipackets': 100699596,
     'obytes': 17002944448,
     'oerrors': 0,
     'opackets': 265671039,
     'rx_bps': 5140939264.0,
     'rx_bps_L1': 6747485184.0,
     'rx_pps': 10040912.0,
     'rx_util': 16.86871296,
     'tx_bps': 13580846080.0,
     'tx_bps_L1': 17824860480.0,
     'tx_pps': 26525090.0,
     'tx_util': 44.5621512},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.810396671295166,
            'cpu_util': 93.76982116699219,
            'cpu_util_raw': 99.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 139225882,
            'rx_bps': 5140939264.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8439906304.0,
            'rx_pps': 10040912.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13580846080.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26525090.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 6444774144,
           'ierrors': 0,
           'ipackets': 100699596,
           'obytes': 17002944448,
           'oerrors': 0,
           'opackets': 265671039,
           'rx_bps': 5140939264.0,
           'rx_bps_L1': 6747485184.0,
           'rx_pps': 10040912.0,
           'rx_util': 16.86871296,
           'tx_bps': 13580846080.0,
           'tx_bps_L1': 17824860480.0,
           'tx_pps': 26525090.0,
           'tx_util': 44.5621512}}
03/03/2021 16:03:36                         pktgen: {'ibytes': 6444774144,
 'ierrors': 0,
 'ipackets': 100699596,
 'obytes': 17002944448,
 'oerrors': 0,
 'opackets': 265671039,
 'rx_bps': 5140939264.0,
 'rx_bps_L1': 6747485184.0,
 'rx_pps': 10040912.0,
 'rx_util': 16.86871296,
 'tx_bps': 13580846080.0,
 'tx_bps_L1': 17824860480.0,
 'tx_pps': 26525090.0,
 'tx_util': 44.5621512}
03/03/2021 16:03:36                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13580846080.000000, tx_pps: 26525090.000000 
03/03/2021 16:03:36                         pktgen: {'ibytes': 6444774144,
 'ierrors': 0,
 'ipackets': 100699596,
 'obytes': 17002944448,
 'oerrors': 0,
 'opackets': 265671039,
 'rx_bps': 5140939264.0,
 'rx_bps_L1': 6747485184.0,
 'rx_pps': 10040912.0,
 'rx_util': 16.86871296,
 'tx_bps': 13580846080.0,
 'tx_bps_L1': 17824860480.0,
 'tx_pps': 26525090.0,
 'tx_util': 44.5621512}
03/03/2021 16:03:36                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 5140939264.000000, rx_pps: 10040912.000000
03/03/2021 16:03:36                         pktgen: throughput: pps_rx 10040912.000000, bps_rx 5140939264.000000
03/03/2021 16:03:36                         pktgen: traffic completed. 
03/03/2021 16:03:36    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 16:03:36                         tester: ls -d /tmp
03/03/2021 16:03:36                         tester: /tmp
03/03/2021 16:03:36                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:03:38                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:38                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:38                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:38                         pktgen: trex port <0> not support flow control
03/03/2021 16:03:38                         pktgen: check the trex port link status
03/03/2021 16:03:38                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:38                         pktgen: begin traffic ......
03/03/2021 16:03:38                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:03:48                         pktgen: begin get port statistic ...
03/03/2021 16:03:48                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:03:48                         pktgen: {0: {'ibytes': 11717824640,
     'ierrors': 0,
     'ipackets': 91545510,
     'obytes': 27412926336,
     'oerrors': 0,
     'opackets': 214163511,
     'rx_bps': 9336289280.0,
     'rx_bps_L1': 10795385600.0,
     'rx_pps': 9119352.0,
     'rx_util': 26.988464,
     'tx_bps': 21475241984.0,
     'tx_bps_L1': 24831547263.999996,
     'tx_pps': 20976908.0,
     'tx_util': 62.07886815999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.808746576309204,
            'cpu_util': 95.57306671142578,
            'cpu_util_raw': 98.9375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141186464,
            'rx_bps': 9336289280.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12138952704.0,
            'rx_pps': 9119352.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 21475241984.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 20976908.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11717824640,
           'ierrors': 0,
           'ipackets': 91545510,
           'obytes': 27412926336,
           'oerrors': 0,
           'opackets': 214163511,
           'rx_bps': 9336289280.0,
           'rx_bps_L1': 10795385600.0,
           'rx_pps': 9119352.0,
           'rx_util': 26.988464,
           'tx_bps': 21475241984.0,
           'tx_bps_L1': 24831547263.999996,
           'tx_pps': 20976908.0,
           'tx_util': 62.07886815999999}}
03/03/2021 16:03:48                         pktgen: {'ibytes': 11717824640,
 'ierrors': 0,
 'ipackets': 91545510,
 'obytes': 27412926336,
 'oerrors': 0,
 'opackets': 214163511,
 'rx_bps': 9336289280.0,
 'rx_bps_L1': 10795385600.0,
 'rx_pps': 9119352.0,
 'rx_util': 26.988464,
 'tx_bps': 21475241984.0,
 'tx_bps_L1': 24831547263.999996,
 'tx_pps': 20976908.0,
 'tx_util': 62.07886815999999}
03/03/2021 16:03:48                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 21475241984.000000, tx_pps: 20976908.000000 
03/03/2021 16:03:48                         pktgen: {'ibytes': 11717824640,
 'ierrors': 0,
 'ipackets': 91545510,
 'obytes': 27412926336,
 'oerrors': 0,
 'opackets': 214163511,
 'rx_bps': 9336289280.0,
 'rx_bps_L1': 10795385600.0,
 'rx_pps': 9119352.0,
 'rx_util': 26.988464,
 'tx_bps': 21475241984.0,
 'tx_bps_L1': 24831547263.999996,
 'tx_pps': 20976908.0,
 'tx_util': 62.07886815999999}
03/03/2021 16:03:48                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9336289280.000000, rx_pps: 9119352.000000
03/03/2021 16:03:48                         pktgen: throughput: pps_rx 9119352.000000, bps_rx 9336289280.000000
03/03/2021 16:03:48                         pktgen: traffic completed. 
03/03/2021 16:03:48    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 16:03:48                         tester: ls -d /tmp
03/03/2021 16:03:49                         tester: /tmp
03/03/2021 16:03:49                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:03:51                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:51                         pktgen: test port 0 map gen port 0
03/03/2021 16:03:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:51                         pktgen: trex port <0> not support flow control
03/03/2021 16:03:51                         pktgen: check the trex port link status
03/03/2021 16:03:51                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:03:51                         pktgen: begin traffic ......
03/03/2021 16:03:51                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:04:01                         pktgen: begin get port statistic ...
03/03/2021 16:04:01                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:04:01                         pktgen: {0: {'ibytes': 20862742016,
     'ierrors': 0,
     'ipackets': 81495103,
     'obytes': 46423278592,
     'oerrors': 0,
     'opackets': 181340947,
     'rx_bps': 16664584192.0,
     'rx_bps_L1': 17966769952.0,
     'rx_pps': 8138661.0,
     'rx_util': 44.916924879999996,
     'tx_bps': 37080244224.0,
     'tx_bps_L1': 39977748224.0,
     'tx_pps': 18109400.0,
     'tx_util': 99.94437056},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 49.49666976928711,
            'cpu_util': 9.364328384399414,
            'cpu_util_raw': 5.5625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 1692646,
            'rx_bps': 16664584192.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 20415657984.0,
            'rx_pps': 8138661.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 37080244224.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 18109400.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 20862742016,
           'ierrors': 0,
           'ipackets': 81495103,
           'obytes': 46423278592,
           'oerrors': 0,
           'opackets': 181340947,
           'rx_bps': 16664584192.0,
           'rx_bps_L1': 17966769952.0,
           'rx_pps': 8138661.0,
           'rx_util': 44.916924879999996,
           'tx_bps': 37080244224.0,
           'tx_bps_L1': 39977748224.0,
           'tx_pps': 18109400.0,
           'tx_util': 99.94437056}}
03/03/2021 16:04:01                         pktgen: {'ibytes': 20862742016,
 'ierrors': 0,
 'ipackets': 81495103,
 'obytes': 46423278592,
 'oerrors': 0,
 'opackets': 181340947,
 'rx_bps': 16664584192.0,
 'rx_bps_L1': 17966769952.0,
 'rx_pps': 8138661.0,
 'rx_util': 44.916924879999996,
 'tx_bps': 37080244224.0,
 'tx_bps_L1': 39977748224.0,
 'tx_pps': 18109400.0,
 'tx_util': 99.94437056}
03/03/2021 16:04:01                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 37080244224.000000, tx_pps: 18109400.000000 
03/03/2021 16:04:01                         pktgen: {'ibytes': 20862742016,
 'ierrors': 0,
 'ipackets': 81495103,
 'obytes': 46423278592,
 'oerrors': 0,
 'opackets': 181340947,
 'rx_bps': 16664584192.0,
 'rx_bps_L1': 17966769952.0,
 'rx_pps': 8138661.0,
 'rx_util': 44.916924879999996,
 'tx_bps': 37080244224.0,
 'tx_bps_L1': 39977748224.0,
 'tx_pps': 18109400.0,
 'tx_util': 99.94437056}
03/03/2021 16:04:01                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 16664584192.000000, rx_pps: 8138661.000000
03/03/2021 16:04:01                         pktgen: throughput: pps_rx 8138661.000000, bps_rx 16664584192.000000
03/03/2021 16:04:01                         pktgen: traffic completed. 
03/03/2021 16:04:01    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 16:04:01                         tester: ls -d /tmp
03/03/2021 16:04:01                         tester: /tmp
03/03/2021 16:04:01                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:04:03                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:03                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:03                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:03                         pktgen: trex port <0> not support flow control
03/03/2021 16:04:03                         pktgen: check the trex port link status
03/03/2021 16:04:03                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:03                         pktgen: begin traffic ......
03/03/2021 16:04:03                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:04:13                         pktgen: begin get port statistic ...
03/03/2021 16:04:13                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:04:13                         pktgen: {0: {'ibytes': 31260045312,
     'ierrors': 0,
     'ipackets': 61054779,
     'obytes': 48170492928,
     'oerrors': 0,
     'opackets': 94083002,
     'rx_bps': 24927985664.0,
     'rx_bps_L1': 25901961024.0,
     'rx_pps': 6087346.0,
     'rx_util': 64.75490256,
     'tx_bps': 38422179840.0,
     'tx_bps_L1': 39923547520.0,
     'tx_pps': 9383548.0,
     'tx_util': 99.8088688},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.710530281066895,
            'cpu_util': 55.137542724609375,
            'cpu_util_raw': 58.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82421576,
            'rx_bps': 24927985664.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 13494193152.0,
            'rx_pps': 6087346.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38422179840.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9383548.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 31260045312,
           'ierrors': 0,
           'ipackets': 61054779,
           'obytes': 48170492928,
           'oerrors': 0,
           'opackets': 94083002,
           'rx_bps': 24927985664.0,
           'rx_bps_L1': 25901961024.0,
           'rx_pps': 6087346.0,
           'rx_util': 64.75490256,
           'tx_bps': 38422179840.0,
           'tx_bps_L1': 39923547520.0,
           'tx_pps': 9383548.0,
           'tx_util': 99.8088688}}
03/03/2021 16:04:13                         pktgen: {'ibytes': 31260045312,
 'ierrors': 0,
 'ipackets': 61054779,
 'obytes': 48170492928,
 'oerrors': 0,
 'opackets': 94083002,
 'rx_bps': 24927985664.0,
 'rx_bps_L1': 25901961024.0,
 'rx_pps': 6087346.0,
 'rx_util': 64.75490256,
 'tx_bps': 38422179840.0,
 'tx_bps_L1': 39923547520.0,
 'tx_pps': 9383548.0,
 'tx_util': 99.8088688}
03/03/2021 16:04:13                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38422179840.000000, tx_pps: 9383548.000000 
03/03/2021 16:04:13                         pktgen: {'ibytes': 31260045312,
 'ierrors': 0,
 'ipackets': 61054779,
 'obytes': 48170492928,
 'oerrors': 0,
 'opackets': 94083002,
 'rx_bps': 24927985664.0,
 'rx_bps_L1': 25901961024.0,
 'rx_pps': 6087346.0,
 'rx_util': 64.75490256,
 'tx_bps': 38422179840.0,
 'tx_bps_L1': 39923547520.0,
 'tx_pps': 9383548.0,
 'tx_util': 99.8088688}
03/03/2021 16:04:13                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 24927985664.000000, rx_pps: 6087346.000000
03/03/2021 16:04:13                         pktgen: throughput: pps_rx 6087346.000000, bps_rx 24927985664.000000
03/03/2021 16:04:13                         pktgen: traffic completed. 
03/03/2021 16:04:13    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 16:04:13                         tester: ls -d /tmp
03/03/2021 16:04:13                         tester: /tmp
03/03/2021 16:04:13                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:04:15                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:15                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:15                         pktgen: trex port <0> not support flow control
03/03/2021 16:04:15                         pktgen: check the trex port link status
03/03/2021 16:04:15                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:15                         pktgen: begin traffic ......
03/03/2021 16:04:15                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:04:25                         pktgen: begin get port statistic ...
03/03/2021 16:04:25                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:04:25                         pktgen: {0: {'ibytes': 43472687104,
     'ierrors': 0,
     'ipackets': 42453800,
     'obytes': 49096935424,
     'oerrors': 0,
     'opackets': 47946233,
     'rx_bps': 34746490880.0,
     'rx_bps_L1': 35425294400.0,
     'rx_pps': 4242522.0,
     'rx_util': 88.563236,
     'tx_bps': 39215042560.0,
     'tx_bps_L1': 39981210080.0,
     'tx_pps': 4788547.0,
     'tx_util': 99.9530252},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.22270965576172,
            'cpu_util': 28.46172523498535,
            'cpu_util_raw': 27.875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36926361,
            'rx_bps': 34746490880.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 4468550656.0,
            'rx_pps': 4242522.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39215042560.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4788547.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 43472687104,
           'ierrors': 0,
           'ipackets': 42453800,
           'obytes': 49096935424,
           'oerrors': 0,
           'opackets': 47946233,
           'rx_bps': 34746490880.0,
           'rx_bps_L1': 35425294400.0,
           'rx_pps': 4242522.0,
           'rx_util': 88.563236,
           'tx_bps': 39215042560.0,
           'tx_bps_L1': 39981210080.0,
           'tx_pps': 4788547.0,
           'tx_util': 99.9530252}}
03/03/2021 16:04:25                         pktgen: {'ibytes': 43472687104,
 'ierrors': 0,
 'ipackets': 42453800,
 'obytes': 49096935424,
 'oerrors': 0,
 'opackets': 47946233,
 'rx_bps': 34746490880.0,
 'rx_bps_L1': 35425294400.0,
 'rx_pps': 4242522.0,
 'rx_util': 88.563236,
 'tx_bps': 39215042560.0,
 'tx_bps_L1': 39981210080.0,
 'tx_pps': 4788547.0,
 'tx_util': 99.9530252}
03/03/2021 16:04:25                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39215042560.000000, tx_pps: 4788547.000000 
03/03/2021 16:04:25                         pktgen: {'ibytes': 43472687104,
 'ierrors': 0,
 'ipackets': 42453800,
 'obytes': 49096935424,
 'oerrors': 0,
 'opackets': 47946233,
 'rx_bps': 34746490880.0,
 'rx_bps_L1': 35425294400.0,
 'rx_pps': 4242522.0,
 'rx_util': 88.563236,
 'tx_bps': 39215042560.0,
 'tx_bps_L1': 39981210080.0,
 'tx_pps': 4788547.0,
 'tx_util': 99.9530252}
03/03/2021 16:04:25                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 34746490880.000000, rx_pps: 4242522.000000
03/03/2021 16:04:25                         pktgen: throughput: pps_rx 4242522.000000, bps_rx 34746490880.000000
03/03/2021 16:04:25                         pktgen: traffic completed. 
03/03/2021 16:04:25    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 16:04:25                         tester: ls -d /tmp
03/03/2021 16:04:25                         tester: /tmp
03/03/2021 16:04:25                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:04:27                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:27                         pktgen: test port 0 map gen port 0
03/03/2021 16:04:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:27                         pktgen: trex port <0> not support flow control
03/03/2021 16:04:27                         pktgen: check the trex port link status
03/03/2021 16:04:27                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:04:27                         pktgen: begin traffic ......
03/03/2021 16:04:27                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:04:37                         pktgen: begin get port statistic ...
03/03/2021 16:04:37                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:04:37                         pktgen: {0: {'ibytes': 49402672440,
     'ierrors': 0,
     'ipackets': 32544583,
     'obytes': 49402573770,
     'oerrors': 0,
     'opackets': 32544518,
     'rx_bps': 39556517888.0,
     'rx_bps_L1': 40077755168.0,
     'rx_pps': 3257733.0,
     'rx_util': 100.19438792,
     'tx_bps': 39557906432.0,
     'tx_bps_L1': 40079171152.0,
     'tx_pps': 3257904.5,
     'tx_util': 100.19792788},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.78925704956055,
            'cpu_util': 14.21340560913086,
            'cpu_util_raw': 14.6875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17164923,
            'rx_bps': 39556517888.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3257733.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39557906432.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3257904.5},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49402672440,
           'ierrors': 0,
           'ipackets': 32544583,
           'obytes': 49402573770,
           'oerrors': 0,
           'opackets': 32544518,
           'rx_bps': 39556517888.0,
           'rx_bps_L1': 40077755168.0,
           'rx_pps': 3257733.0,
           'rx_util': 100.19438792,
           'tx_bps': 39557906432.0,
           'tx_bps_L1': 40079171152.0,
           'tx_pps': 3257904.5,
           'tx_util': 100.19792788}}
03/03/2021 16:04:37                         pktgen: {'ibytes': 49402672440,
 'ierrors': 0,
 'ipackets': 32544583,
 'obytes': 49402573770,
 'oerrors': 0,
 'opackets': 32544518,
 'rx_bps': 39556517888.0,
 'rx_bps_L1': 40077755168.0,
 'rx_pps': 3257733.0,
 'rx_util': 100.19438792,
 'tx_bps': 39557906432.0,
 'tx_bps_L1': 40079171152.0,
 'tx_pps': 3257904.5,
 'tx_util': 100.19792788}
03/03/2021 16:04:37                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39557906432.000000, tx_pps: 3257904.500000 
03/03/2021 16:04:37                         pktgen: {'ibytes': 49402672440,
 'ierrors': 0,
 'ipackets': 32544583,
 'obytes': 49402573770,
 'oerrors': 0,
 'opackets': 32544518,
 'rx_bps': 39556517888.0,
 'rx_bps_L1': 40077755168.0,
 'rx_pps': 3257733.0,
 'rx_util': 100.19438792,
 'tx_bps': 39557906432.0,
 'tx_bps_L1': 40079171152.0,
 'tx_pps': 3257904.5,
 'tx_util': 100.19792788}
03/03/2021 16:04:37                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39556517888.000000, rx_pps: 3257733.000000
03/03/2021 16:04:37                         pktgen: throughput: pps_rx 3257733.000000, bps_rx 39556517888.000000
03/03/2021 16:04:37                         pktgen: traffic completed. 
03/03/2021 16:04:39    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 16:04:39    TestPVPMultiPathPerformance: 
+-------+-------------------------+--------+------------+
| Frame |      Mode/RXD-TXD       |  Mpps  | % linerate |
+=======+=========================+========+============+
| 64    | virtio_1.1_mergeable on | 10.041 | 16.869     |
+-------+-------------------------+--------+------------+
| 128   | virtio_1.1_mergeable on | 9.119  | 26.993     |
+-------+-------------------------+--------+------------+
| 256   | virtio_1.1_mergeable on | 8.139  | 44.925     |
+-------+-------------------------+--------+------------+
| 512   | virtio_1.1_mergeable on | 6.087  | 64.769     |
+-------+-------------------------+--------+------------+
| 1024  | virtio_1.1_mergeable on | 4.243  | 88.584     |
+-------+-------------------------+--------+------------+
| 1518  | virtio_1.1_mergeable on | 3.258  | 100.208    |
+-------+-------------------------+--------+------------+
03/03/2021 16:04:39    TestPVPMultiPathPerformance: 
+-------+--------------+-------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps     | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+=============+============+=====================+=======================+
| 64    | 1024         | 10.041 Mpps | 16.869%    | 10.072 Mpps         | -0.031 Mpps           |
+-------+--------------+-------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.258 Mpps  | 100.208%   | 3.242 Mpps          | 0.016 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
03/03/2021 16:04:39    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.503600
03/03/2021 16:04:39    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.031000
03/03/2021 16:04:39    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162100
03/03/2021 16:04:39    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.016000
03/03/2021 16:04:39    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_mergeable Result PASSED:
03/03/2021 16:04:39             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 16:04:40    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_normal Begin
03/03/2021 16:04:40             dut.10.240.183.220: 
03/03/2021 16:04:41                         tester: 
03/03/2021 16:04:41             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 16:04:41             dut.10.240.183.220: 
03/03/2021 16:04:41             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 16:04:41             dut.10.240.183.220: 
03/03/2021 16:04:41             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 16:04:41             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 16:04:41             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 16:04:41             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 16:04:52             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 16:04:52             dut.10.240.183.220: 1048576
03/03/2021 16:05:03    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 16:05:03                         tester: ls -d /tmp
03/03/2021 16:05:03                         tester: /tmp
03/03/2021 16:05:03                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:05:05                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:05                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:05                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:05                         pktgen: trex port <0> not support flow control
03/03/2021 16:05:05                         pktgen: check the trex port link status
03/03/2021 16:05:05                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:05                         pktgen: begin traffic ......
03/03/2021 16:05:05                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:05:15                         pktgen: begin get port statistic ...
03/03/2021 16:05:15                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:05:15                         pktgen: {0: {'ibytes': 6455623680,
     'ierrors': 0,
     'ipackets': 100869120,
     'obytes': 17001243392,
     'oerrors': 0,
     'opackets': 265644447,
     'rx_bps': 5171111424.0,
     'rx_bps_L1': 6787082943.999999,
     'rx_pps': 10099822.0,
     'rx_util': 16.96770736,
     'tx_bps': 13589256192.0,
     'tx_bps_L1': 17835897472.0,
     'tx_pps': 26541508.0,
     'tx_util': 44.58974368},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.8128560781478882,
            'cpu_util': 93.70059967041016,
            'cpu_util_raw': 99.25,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 139212887,
            'rx_bps': 5171111424.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8418144768.0,
            'rx_pps': 10099822.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13589256192.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 26541508.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 6455623680,
           'ierrors': 0,
           'ipackets': 100869120,
           'obytes': 17001243392,
           'oerrors': 0,
           'opackets': 265644447,
           'rx_bps': 5171111424.0,
           'rx_bps_L1': 6787082943.999999,
           'rx_pps': 10099822.0,
           'rx_util': 16.96770736,
           'tx_bps': 13589256192.0,
           'tx_bps_L1': 17835897472.0,
           'tx_pps': 26541508.0,
           'tx_util': 44.58974368}}
03/03/2021 16:05:15                         pktgen: {'ibytes': 6455623680,
 'ierrors': 0,
 'ipackets': 100869120,
 'obytes': 17001243392,
 'oerrors': 0,
 'opackets': 265644447,
 'rx_bps': 5171111424.0,
 'rx_bps_L1': 6787082943.999999,
 'rx_pps': 10099822.0,
 'rx_util': 16.96770736,
 'tx_bps': 13589256192.0,
 'tx_bps_L1': 17835897472.0,
 'tx_pps': 26541508.0,
 'tx_util': 44.58974368}
03/03/2021 16:05:15                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13589256192.000000, tx_pps: 26541508.000000 
03/03/2021 16:05:15                         pktgen: {'ibytes': 6455623680,
 'ierrors': 0,
 'ipackets': 100869120,
 'obytes': 17001243392,
 'oerrors': 0,
 'opackets': 265644447,
 'rx_bps': 5171111424.0,
 'rx_bps_L1': 6787082943.999999,
 'rx_pps': 10099822.0,
 'rx_util': 16.96770736,
 'tx_bps': 13589256192.0,
 'tx_bps_L1': 17835897472.0,
 'tx_pps': 26541508.0,
 'tx_util': 44.58974368}
03/03/2021 16:05:15                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 5171111424.000000, rx_pps: 10099822.000000
03/03/2021 16:05:15                         pktgen: throughput: pps_rx 10099822.000000, bps_rx 5171111424.000000
03/03/2021 16:05:15                         pktgen: traffic completed. 
03/03/2021 16:05:15    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 16:05:15                         tester: ls -d /tmp
03/03/2021 16:05:15                         tester: /tmp
03/03/2021 16:05:15                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:05:17                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:17                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:17                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:17                         pktgen: trex port <0> not support flow control
03/03/2021 16:05:17                         pktgen: check the trex port link status
03/03/2021 16:05:17                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:17                         pktgen: begin traffic ......
03/03/2021 16:05:17                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:05:27                         pktgen: begin get port statistic ...
03/03/2021 16:05:27                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:05:27                         pktgen: {0: {'ibytes': 11725344640,
     'ierrors': 0,
     'ipackets': 91604267,
     'obytes': 28429802624,
     'oerrors': 0,
     'opackets': 222107856,
     'rx_bps': 9361196032.0,
     'rx_bps_L1': 10824194432.0,
     'rx_pps': 9143740.0,
     'rx_util': 27.06048608,
     'tx_bps': 22626539520.0,
     'tx_bps_L1': 26162740480.0,
     'tx_pps': 22101256.0,
     'tx_util': 65.4068512},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.9238877296447754,
            'cpu_util': 96.73139953613281,
            'cpu_util_raw': 99.375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141139073,
            'rx_bps': 9361196032.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 13265342464.0,
            'rx_pps': 9143740.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22626539520.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 22101256.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 11725344640,
           'ierrors': 0,
           'ipackets': 91604267,
           'obytes': 28429802624,
           'oerrors': 0,
           'opackets': 222107856,
           'rx_bps': 9361196032.0,
           'rx_bps_L1': 10824194432.0,
           'rx_pps': 9143740.0,
           'rx_util': 27.06048608,
           'tx_bps': 22626539520.0,
           'tx_bps_L1': 26162740480.0,
           'tx_pps': 22101256.0,
           'tx_util': 65.4068512}}
03/03/2021 16:05:27                         pktgen: {'ibytes': 11725344640,
 'ierrors': 0,
 'ipackets': 91604267,
 'obytes': 28429802624,
 'oerrors': 0,
 'opackets': 222107856,
 'rx_bps': 9361196032.0,
 'rx_bps_L1': 10824194432.0,
 'rx_pps': 9143740.0,
 'rx_util': 27.06048608,
 'tx_bps': 22626539520.0,
 'tx_bps_L1': 26162740480.0,
 'tx_pps': 22101256.0,
 'tx_util': 65.4068512}
03/03/2021 16:05:27                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22626539520.000000, tx_pps: 22101256.000000 
03/03/2021 16:05:27                         pktgen: {'ibytes': 11725344640,
 'ierrors': 0,
 'ipackets': 91604267,
 'obytes': 28429802624,
 'oerrors': 0,
 'opackets': 222107856,
 'rx_bps': 9361196032.0,
 'rx_bps_L1': 10824194432.0,
 'rx_pps': 9143740.0,
 'rx_util': 27.06048608,
 'tx_bps': 22626539520.0,
 'tx_bps_L1': 26162740480.0,
 'tx_pps': 22101256.0,
 'tx_util': 65.4068512}
03/03/2021 16:05:27                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9361196032.000000, rx_pps: 9143740.000000
03/03/2021 16:05:27                         pktgen: throughput: pps_rx 9143740.000000, bps_rx 9361196032.000000
03/03/2021 16:05:27                         pktgen: traffic completed. 
03/03/2021 16:05:27    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 16:05:27                         tester: ls -d /tmp
03/03/2021 16:05:28                         tester: /tmp
03/03/2021 16:05:28                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:05:30                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:30                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:30                         pktgen: trex port <0> not support flow control
03/03/2021 16:05:30                         pktgen: check the trex port link status
03/03/2021 16:05:30                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:30                         pktgen: begin traffic ......
03/03/2021 16:05:30                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:05:40                         pktgen: begin get port statistic ...
03/03/2021 16:05:40                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:05:40                         pktgen: {0: {'ibytes': 20802032896,
     'ierrors': 0,
     'ipackets': 81257941,
     'obytes': 46425555968,
     'oerrors': 0,
     'opackets': 181349851,
     'rx_bps': 16611263488.0,
     'rx_bps_L1': 17909293728.0,
     'rx_pps': 8112689.0,
     'rx_util': 44.77323432,
     'tx_bps': 37032820736.0,
     'tx_bps_L1': 39926676736.0,
     'tx_pps': 18086600.0,
     'tx_util': 99.81669184},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 49.3007926940918,
            'cpu_util': 9.389509201049805,
            'cpu_util_raw': 5.6875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 1658730,
            'rx_bps': 16611263488.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 20421556224.0,
            'rx_pps': 8112689.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 37032820736.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 18086600.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 20802032896,
           'ierrors': 0,
           'ipackets': 81257941,
           'obytes': 46425555968,
           'oerrors': 0,
           'opackets': 181349851,
           'rx_bps': 16611263488.0,
           'rx_bps_L1': 17909293728.0,
           'rx_pps': 8112689.0,
           'rx_util': 44.77323432,
           'tx_bps': 37032820736.0,
           'tx_bps_L1': 39926676736.0,
           'tx_pps': 18086600.0,
           'tx_util': 99.81669184}}
03/03/2021 16:05:40                         pktgen: {'ibytes': 20802032896,
 'ierrors': 0,
 'ipackets': 81257941,
 'obytes': 46425555968,
 'oerrors': 0,
 'opackets': 181349851,
 'rx_bps': 16611263488.0,
 'rx_bps_L1': 17909293728.0,
 'rx_pps': 8112689.0,
 'rx_util': 44.77323432,
 'tx_bps': 37032820736.0,
 'tx_bps_L1': 39926676736.0,
 'tx_pps': 18086600.0,
 'tx_util': 99.81669184}
03/03/2021 16:05:40                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 37032820736.000000, tx_pps: 18086600.000000 
03/03/2021 16:05:40                         pktgen: {'ibytes': 20802032896,
 'ierrors': 0,
 'ipackets': 81257941,
 'obytes': 46425555968,
 'oerrors': 0,
 'opackets': 181349851,
 'rx_bps': 16611263488.0,
 'rx_bps_L1': 17909293728.0,
 'rx_pps': 8112689.0,
 'rx_util': 44.77323432,
 'tx_bps': 37032820736.0,
 'tx_bps_L1': 39926676736.0,
 'tx_pps': 18086600.0,
 'tx_util': 99.81669184}
03/03/2021 16:05:40                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 16611263488.000000, rx_pps: 8112689.000000
03/03/2021 16:05:40                         pktgen: throughput: pps_rx 8112689.000000, bps_rx 16611263488.000000
03/03/2021 16:05:40                         pktgen: traffic completed. 
03/03/2021 16:05:40    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 16:05:40                         tester: ls -d /tmp
03/03/2021 16:05:40                         tester: /tmp
03/03/2021 16:05:40                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:05:42                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:42                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:42                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:42                         pktgen: trex port <0> not support flow control
03/03/2021 16:05:42                         pktgen: check the trex port link status
03/03/2021 16:05:42                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:42                         pktgen: begin traffic ......
03/03/2021 16:05:42                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:05:52                         pktgen: begin get port statistic ...
03/03/2021 16:05:52                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:05:52                         pktgen: {0: {'ibytes': 31440815104,
     'ierrors': 0,
     'ipackets': 61407852,
     'obytes': 48171928576,
     'oerrors': 0,
     'opackets': 94085810,
     'rx_bps': 25059190784.0,
     'rx_bps_L1': 26038301744.0,
     'rx_pps': 6119443.5,
     'rx_util': 65.09575436,
     'tx_bps': 38397579264.0,
     'tx_bps_L1': 39898009984.0,
     'tx_pps': 9377692.0,
     'tx_util': 99.74502496},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.559304237365723,
            'cpu_util': 56.07579040527344,
            'cpu_util_raw': 61.5,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82377356,
            'rx_bps': 25059190784.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 13338386432.0,
            'rx_pps': 6119443.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38397579264.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9377692.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 31440815104,
           'ierrors': 0,
           'ipackets': 61407852,
           'obytes': 48171928576,
           'oerrors': 0,
           'opackets': 94085810,
           'rx_bps': 25059190784.0,
           'rx_bps_L1': 26038301744.0,
           'rx_pps': 6119443.5,
           'rx_util': 65.09575436,
           'tx_bps': 38397579264.0,
           'tx_bps_L1': 39898009984.0,
           'tx_pps': 9377692.0,
           'tx_util': 99.74502496}}
03/03/2021 16:05:52                         pktgen: {'ibytes': 31440815104,
 'ierrors': 0,
 'ipackets': 61407852,
 'obytes': 48171928576,
 'oerrors': 0,
 'opackets': 94085810,
 'rx_bps': 25059190784.0,
 'rx_bps_L1': 26038301744.0,
 'rx_pps': 6119443.5,
 'rx_util': 65.09575436,
 'tx_bps': 38397579264.0,
 'tx_bps_L1': 39898009984.0,
 'tx_pps': 9377692.0,
 'tx_util': 99.74502496}
03/03/2021 16:05:52                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38397579264.000000, tx_pps: 9377692.000000 
03/03/2021 16:05:52                         pktgen: {'ibytes': 31440815104,
 'ierrors': 0,
 'ipackets': 61407852,
 'obytes': 48171928576,
 'oerrors': 0,
 'opackets': 94085810,
 'rx_bps': 25059190784.0,
 'rx_bps_L1': 26038301744.0,
 'rx_pps': 6119443.5,
 'rx_util': 65.09575436,
 'tx_bps': 38397579264.0,
 'tx_bps_L1': 39898009984.0,
 'tx_pps': 9377692.0,
 'tx_util': 99.74502496}
03/03/2021 16:05:52                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 25059190784.000000, rx_pps: 6119443.500000
03/03/2021 16:05:52                         pktgen: throughput: pps_rx 6119443.500000, bps_rx 25059190784.000000
03/03/2021 16:05:52                         pktgen: traffic completed. 
03/03/2021 16:05:52    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 16:05:52                         tester: ls -d /tmp
03/03/2021 16:05:52                         tester: /tmp
03/03/2021 16:05:52                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:05:54                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:54                         pktgen: test port 0 map gen port 0
03/03/2021 16:05:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:54                         pktgen: trex port <0> not support flow control
03/03/2021 16:05:54                         pktgen: check the trex port link status
03/03/2021 16:05:54                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:05:54                         pktgen: begin traffic ......
03/03/2021 16:05:54                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:06:04                         pktgen: begin get port statistic ...
03/03/2021 16:06:04                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:06:04                         pktgen: {0: {'ibytes': 43472820224,
     'ierrors': 0,
     'ipackets': 42453931,
     'obytes': 49093945344,
     'oerrors': 0,
     'opackets': 47943310,
     'rx_bps': 34679857152.0,
     'rx_bps_L1': 35357368752.0,
     'rx_pps': 4234447.5,
     'rx_util': 88.39342188,
     'tx_bps': 39158534144.0,
     'tx_bps_L1': 39923611024.0,
     'tx_pps': 4781730.5,
     'tx_util': 99.80902755999999},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 16.937053680419922,
            'cpu_util': 28.900047302246094,
            'cpu_util_raw': 29.0625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 37196094,
            'rx_bps': 34679857152.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 4478679552.0,
            'rx_pps': 4234447.5,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39158534144.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4781730.5},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 43472820224,
           'ierrors': 0,
           'ipackets': 42453931,
           'obytes': 49093945344,
           'oerrors': 0,
           'opackets': 47943310,
           'rx_bps': 34679857152.0,
           'rx_bps_L1': 35357368752.0,
           'rx_pps': 4234447.5,
           'rx_util': 88.39342188,
           'tx_bps': 39158534144.0,
           'tx_bps_L1': 39923611024.0,
           'tx_pps': 4781730.5,
           'tx_util': 99.80902755999999}}
03/03/2021 16:06:04                         pktgen: {'ibytes': 43472820224,
 'ierrors': 0,
 'ipackets': 42453931,
 'obytes': 49093945344,
 'oerrors': 0,
 'opackets': 47943310,
 'rx_bps': 34679857152.0,
 'rx_bps_L1': 35357368752.0,
 'rx_pps': 4234447.5,
 'rx_util': 88.39342188,
 'tx_bps': 39158534144.0,
 'tx_bps_L1': 39923611024.0,
 'tx_pps': 4781730.5,
 'tx_util': 99.80902755999999}
03/03/2021 16:06:04                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39158534144.000000, tx_pps: 4781730.500000 
03/03/2021 16:06:04                         pktgen: {'ibytes': 43472820224,
 'ierrors': 0,
 'ipackets': 42453931,
 'obytes': 49093945344,
 'oerrors': 0,
 'opackets': 47943310,
 'rx_bps': 34679857152.0,
 'rx_bps_L1': 35357368752.0,
 'rx_pps': 4234447.5,
 'rx_util': 88.39342188,
 'tx_bps': 39158534144.0,
 'tx_bps_L1': 39923611024.0,
 'tx_pps': 4781730.5,
 'tx_util': 99.80902755999999}
03/03/2021 16:06:04                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 34679857152.000000, rx_pps: 4234447.500000
03/03/2021 16:06:04                         pktgen: throughput: pps_rx 4234447.500000, bps_rx 34679857152.000000
03/03/2021 16:06:04                         pktgen: traffic completed. 
03/03/2021 16:06:04    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 16:06:04                         tester: ls -d /tmp
03/03/2021 16:06:04                         tester: /tmp
03/03/2021 16:06:04                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:06:06                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:06                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:06                         pktgen: trex port <0> not support flow control
03/03/2021 16:06:06                         pktgen: check the trex port link status
03/03/2021 16:06:06                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:06                         pktgen: begin traffic ......
03/03/2021 16:06:06                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:06:16                         pktgen: begin get port statistic ...
03/03/2021 16:06:16                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:06:16                         pktgen: {0: {'ibytes': 49401629574,
     'ierrors': 0,
     'ipackets': 32543896,
     'obytes': 49401535458,
     'oerrors': 0,
     'opackets': 32543833,
     'rx_bps': 39447949312.0,
     'rx_bps_L1': 39967759232.00001,
     'rx_pps': 3248812.0,
     'rx_util': 99.91939808000002,
     'tx_bps': 39449423872.0,
     'tx_bps_L1': 39969262752.0,
     'tx_pps': 3248993.0,
     'tx_util': 99.92315688},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.210208892822266,
            'cpu_util': 14.414346694946289,
            'cpu_util_raw': 15.5625,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17185671,
            'rx_bps': 39447949312.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3248812.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39449423872.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3248993.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49401629574,
           'ierrors': 0,
           'ipackets': 32543896,
           'obytes': 49401535458,
           'oerrors': 0,
           'opackets': 32543833,
           'rx_bps': 39447949312.0,
           'rx_bps_L1': 39967759232.00001,
           'rx_pps': 3248812.0,
           'rx_util': 99.91939808000002,
           'tx_bps': 39449423872.0,
           'tx_bps_L1': 39969262752.0,
           'tx_pps': 3248993.0,
           'tx_util': 99.92315688}}
03/03/2021 16:06:16                         pktgen: {'ibytes': 49401629574,
 'ierrors': 0,
 'ipackets': 32543896,
 'obytes': 49401535458,
 'oerrors': 0,
 'opackets': 32543833,
 'rx_bps': 39447949312.0,
 'rx_bps_L1': 39967759232.00001,
 'rx_pps': 3248812.0,
 'rx_util': 99.91939808000002,
 'tx_bps': 39449423872.0,
 'tx_bps_L1': 39969262752.0,
 'tx_pps': 3248993.0,
 'tx_util': 99.92315688}
03/03/2021 16:06:16                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39449423872.000000, tx_pps: 3248993.000000 
03/03/2021 16:06:16                         pktgen: {'ibytes': 49401629574,
 'ierrors': 0,
 'ipackets': 32543896,
 'obytes': 49401535458,
 'oerrors': 0,
 'opackets': 32543833,
 'rx_bps': 39447949312.0,
 'rx_bps_L1': 39967759232.00001,
 'rx_pps': 3248812.0,
 'rx_util': 99.91939808000002,
 'tx_bps': 39449423872.0,
 'tx_bps_L1': 39969262752.0,
 'tx_pps': 3248993.0,
 'tx_util': 99.92315688}
03/03/2021 16:06:16                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39447949312.000000, rx_pps: 3248812.000000
03/03/2021 16:06:16                         pktgen: throughput: pps_rx 3248812.000000, bps_rx 39447949312.000000
03/03/2021 16:06:16                         pktgen: traffic completed. 
03/03/2021 16:06:18    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 16:06:18    TestPVPMultiPathPerformance: 
+-------+-------------------+--------+------------+
| Frame |   Mode/RXD-TXD    |  Mpps  | % linerate |
+=======+===================+========+============+
| 64    | virtio_1.1_normal | 10.100 | 16.968     |
+-------+-------------------+--------+------------+
| 128   | virtio_1.1_normal | 9.144  | 27.065     |
+-------+-------------------+--------+------------+
| 256   | virtio_1.1_normal | 8.113  | 44.782     |
+-------+-------------------+--------+------------+
| 512   | virtio_1.1_normal | 6.119  | 65.111     |
+-------+-------------------+--------+------------+
| 1024  | virtio_1.1_normal | 4.234  | 88.415     |
+-------+-------------------+--------+------------+
| 1518  | virtio_1.1_normal | 3.249  | 99.933     |
+-------+-------------------+--------+------------+
03/03/2021 16:06:18    TestPVPMultiPathPerformance: 
+-------+--------------+-------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps     | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+=============+============+=====================+=======================+
| 64    | 1024         | 10.100 Mpps | 16.968%    | 10.035 Mpps         | 0.065 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.249 Mpps  | 99.933%    | 3.256 Mpps          | -0.007 Mpps           |
+-------+--------------+-------------+------------+---------------------+-----------------------+
03/03/2021 16:06:18    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.501750
03/03/2021 16:06:18    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.065000
03/03/2021 16:06:18    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162800
03/03/2021 16:06:18    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.007000
03/03/2021 16:06:18    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_normal Result PASSED:
03/03/2021 16:06:18             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 16:06:19    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_vectorized Begin
03/03/2021 16:06:19             dut.10.240.183.220: 
03/03/2021 16:06:19                         tester: 
03/03/2021 16:06:19             dut.10.240.183.220: rm -rf ./vhost.out
03/03/2021 16:06:20             dut.10.240.183.220: 
03/03/2021 16:06:20             dut.10.240.183.220: rm -rf ./vhost-net*
03/03/2021 16:06:20             dut.10.240.183.220: 
03/03/2021 16:06:20             dut.10.240.183.220: killall -s INT dpdk-testpmd 
03/03/2021 16:06:20             dut.10.240.183.220: dpdk-testpmd: no process found
03/03/2021 16:06:20             dut.10.240.183.220: killall -s INT qemu-system-x86_64
03/03/2021 16:06:20             dut.10.240.183.220: qemu-system-x86_64: no process found
03/03/2021 16:06:31             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
03/03/2021 16:06:31             dut.10.240.183.220: 1048576
03/03/2021 16:06:42    TestPVPMultiPathPerformance: Test running at parameters: framesize: 64, rxd/txd: 1024
03/03/2021 16:06:42                         tester: ls -d /tmp
03/03/2021 16:06:42                         tester: /tmp
03/03/2021 16:06:42                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:06:44                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:44                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:44                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:44                         pktgen: trex port <0> not support flow control
03/03/2021 16:06:44                         pktgen: check the trex port link status
03/03/2021 16:06:44                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:44                         pktgen: begin traffic ......
03/03/2021 16:06:44                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:06:54                         pktgen: begin get port statistic ...
03/03/2021 16:06:54                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:06:54                         pktgen: {0: {'ibytes': 6586426816,
     'ierrors': 0,
     'ipackets': 102912936,
     'obytes': 17333902336,
     'oerrors': 0,
     'opackets': 270842251,
     'rx_bps': 5277262336.0,
     'rx_bps_L1': 6926407616.0,
     'rx_pps': 10307158.0,
     'rx_util': 17.31601904,
     'tx_bps': 13847552000.0,
     'tx_bps_L1': 18174912640.0,
     'tx_pps': 27046004.0,
     'tx_util': 45.4372816},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 1.8543370962142944,
            'cpu_util': 93.345703125,
            'cpu_util_raw': 99.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 138964532,
            'rx_bps': 5277262336.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 8570289152.0,
            'rx_pps': 10307158.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 13847552000.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 27046004.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 6586426816,
           'ierrors': 0,
           'ipackets': 102912936,
           'obytes': 17333902336,
           'oerrors': 0,
           'opackets': 270842251,
           'rx_bps': 5277262336.0,
           'rx_bps_L1': 6926407616.0,
           'rx_pps': 10307158.0,
           'rx_util': 17.31601904,
           'tx_bps': 13847552000.0,
           'tx_bps_L1': 18174912640.0,
           'tx_pps': 27046004.0,
           'tx_util': 45.4372816}}
03/03/2021 16:06:54                         pktgen: {'ibytes': 6586426816,
 'ierrors': 0,
 'ipackets': 102912936,
 'obytes': 17333902336,
 'oerrors': 0,
 'opackets': 270842251,
 'rx_bps': 5277262336.0,
 'rx_bps_L1': 6926407616.0,
 'rx_pps': 10307158.0,
 'rx_util': 17.31601904,
 'tx_bps': 13847552000.0,
 'tx_bps_L1': 18174912640.0,
 'tx_pps': 27046004.0,
 'tx_util': 45.4372816}
03/03/2021 16:06:54                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 13847552000.000000, tx_pps: 27046004.000000 
03/03/2021 16:06:54                         pktgen: {'ibytes': 6586426816,
 'ierrors': 0,
 'ipackets': 102912936,
 'obytes': 17333902336,
 'oerrors': 0,
 'opackets': 270842251,
 'rx_bps': 5277262336.0,
 'rx_bps_L1': 6926407616.0,
 'rx_pps': 10307158.0,
 'rx_util': 17.31601904,
 'tx_bps': 13847552000.0,
 'tx_bps_L1': 18174912640.0,
 'tx_pps': 27046004.0,
 'tx_util': 45.4372816}
03/03/2021 16:06:54                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 5277262336.000000, rx_pps: 10307158.000000
03/03/2021 16:06:54                         pktgen: throughput: pps_rx 10307158.000000, bps_rx 5277262336.000000
03/03/2021 16:06:54                         pktgen: traffic completed. 
03/03/2021 16:06:54    TestPVPMultiPathPerformance: Test running at parameters: framesize: 128, rxd/txd: 1024
03/03/2021 16:06:54                         tester: ls -d /tmp
03/03/2021 16:06:54                         tester: /tmp
03/03/2021 16:06:54                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:06:56                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:56                         pktgen: test port 0 map gen port 0
03/03/2021 16:06:56                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:56                         pktgen: trex port <0> not support flow control
03/03/2021 16:06:56                         pktgen: check the trex port link status
03/03/2021 16:06:56                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:06:56                         pktgen: begin traffic ......
03/03/2021 16:06:56                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:07:07                         pktgen: begin get port statistic ...
03/03/2021 16:07:07                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:07:07                         pktgen: {0: {'ibytes': 12036311168,
     'ierrors': 0,
     'ipackets': 94033681,
     'obytes': 28022320896,
     'oerrors': 0,
     'opackets': 218924399,
     'rx_bps': 9607980032.0,
     'rx_bps_L1': 11109584512.0,
     'rx_pps': 9385028.0,
     'rx_util': 27.773961279999998,
     'tx_bps': 22314600448.0,
     'tx_bps_L1': 25802183808.0,
     'tx_pps': 21797396.0,
     'tx_util': 64.50545952},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 2.881976366043091,
            'cpu_util': 96.78514862060547,
            'cpu_util_raw': 99.4375,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 141705756,
            'rx_bps': 9607980032.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12706619392.0,
            'rx_pps': 9385028.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 22314600448.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 21797396.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 12036311168,
           'ierrors': 0,
           'ipackets': 94033681,
           'obytes': 28022320896,
           'oerrors': 0,
           'opackets': 218924399,
           'rx_bps': 9607980032.0,
           'rx_bps_L1': 11109584512.0,
           'rx_pps': 9385028.0,
           'rx_util': 27.773961279999998,
           'tx_bps': 22314600448.0,
           'tx_bps_L1': 25802183808.0,
           'tx_pps': 21797396.0,
           'tx_util': 64.50545952}}
03/03/2021 16:07:07                         pktgen: {'ibytes': 12036311168,
 'ierrors': 0,
 'ipackets': 94033681,
 'obytes': 28022320896,
 'oerrors': 0,
 'opackets': 218924399,
 'rx_bps': 9607980032.0,
 'rx_bps_L1': 11109584512.0,
 'rx_pps': 9385028.0,
 'rx_util': 27.773961279999998,
 'tx_bps': 22314600448.0,
 'tx_bps_L1': 25802183808.0,
 'tx_pps': 21797396.0,
 'tx_util': 64.50545952}
03/03/2021 16:07:07                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 22314600448.000000, tx_pps: 21797396.000000 
03/03/2021 16:07:07                         pktgen: {'ibytes': 12036311168,
 'ierrors': 0,
 'ipackets': 94033681,
 'obytes': 28022320896,
 'oerrors': 0,
 'opackets': 218924399,
 'rx_bps': 9607980032.0,
 'rx_bps_L1': 11109584512.0,
 'rx_pps': 9385028.0,
 'rx_util': 27.773961279999998,
 'tx_bps': 22314600448.0,
 'tx_bps_L1': 25802183808.0,
 'tx_pps': 21797396.0,
 'tx_util': 64.50545952}
03/03/2021 16:07:07                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 9607980032.000000, rx_pps: 9385028.000000
03/03/2021 16:07:07                         pktgen: throughput: pps_rx 9385028.000000, bps_rx 9607980032.000000
03/03/2021 16:07:07                         pktgen: traffic completed. 
03/03/2021 16:07:07    TestPVPMultiPathPerformance: Test running at parameters: framesize: 256, rxd/txd: 1024
03/03/2021 16:07:07                         tester: ls -d /tmp
03/03/2021 16:07:07                         tester: /tmp
03/03/2021 16:07:07                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:07:09                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:09                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:09                         pktgen: trex port <0> not support flow control
03/03/2021 16:07:09                         pktgen: check the trex port link status
03/03/2021 16:07:09                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:09                         pktgen: begin traffic ......
03/03/2021 16:07:09                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:07:19                         pktgen: begin get port statistic ...
03/03/2021 16:07:19                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:07:19                         pktgen: {0: {'ibytes': 21467392000,
     'ierrors': 0,
     'ipackets': 83857000,
     'obytes': 43646565120,
     'oerrors': 0,
     'opackets': 170494404,
     'rx_bps': 17151398912.0,
     'rx_bps_L1': 18491664992.0,
     'rx_pps': 8376663.0,
     'rx_util': 46.22916248,
     'tx_bps': 31846103040.0,
     'tx_bps_L1': 34334805599.999996,
     'tx_pps': 15554391.0,
     'tx_util': 85.83701399999998},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 10.084297180175781,
            'cpu_util': 39.4748649597168,
            'cpu_util_raw': 74.75,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 28142305,
            'rx_bps': 17151398912.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 14694705152.0,
            'rx_pps': 8376663.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 31846103040.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 15554391.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 21467392000,
           'ierrors': 0,
           'ipackets': 83857000,
           'obytes': 43646565120,
           'oerrors': 0,
           'opackets': 170494404,
           'rx_bps': 17151398912.0,
           'rx_bps_L1': 18491664992.0,
           'rx_pps': 8376663.0,
           'rx_util': 46.22916248,
           'tx_bps': 31846103040.0,
           'tx_bps_L1': 34334805599.999996,
           'tx_pps': 15554391.0,
           'tx_util': 85.83701399999998}}
03/03/2021 16:07:19                         pktgen: {'ibytes': 21467392000,
 'ierrors': 0,
 'ipackets': 83857000,
 'obytes': 43646565120,
 'oerrors': 0,
 'opackets': 170494404,
 'rx_bps': 17151398912.0,
 'rx_bps_L1': 18491664992.0,
 'rx_pps': 8376663.0,
 'rx_util': 46.22916248,
 'tx_bps': 31846103040.0,
 'tx_bps_L1': 34334805599.999996,
 'tx_pps': 15554391.0,
 'tx_util': 85.83701399999998}
03/03/2021 16:07:19                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 31846103040.000000, tx_pps: 15554391.000000 
03/03/2021 16:07:19                         pktgen: {'ibytes': 21467392000,
 'ierrors': 0,
 'ipackets': 83857000,
 'obytes': 43646565120,
 'oerrors': 0,
 'opackets': 170494404,
 'rx_bps': 17151398912.0,
 'rx_bps_L1': 18491664992.0,
 'rx_pps': 8376663.0,
 'rx_util': 46.22916248,
 'tx_bps': 31846103040.0,
 'tx_bps_L1': 34334805599.999996,
 'tx_pps': 15554391.0,
 'tx_util': 85.83701399999998}
03/03/2021 16:07:19                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 17151398912.000000, rx_pps: 8376663.000000
03/03/2021 16:07:19                         pktgen: throughput: pps_rx 8376663.000000, bps_rx 17151398912.000000
03/03/2021 16:07:19                         pktgen: traffic completed. 
03/03/2021 16:07:19    TestPVPMultiPathPerformance: Test running at parameters: framesize: 512, rxd/txd: 1024
03/03/2021 16:07:19                         tester: ls -d /tmp
03/03/2021 16:07:19                         tester: /tmp
03/03/2021 16:07:19                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:07:21                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:21                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:21                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:21                         pktgen: trex port <0> not support flow control
03/03/2021 16:07:21                         pktgen: check the trex port link status
03/03/2021 16:07:21                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:21                         pktgen: begin traffic ......
03/03/2021 16:07:21                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:07:31                         pktgen: begin get port statistic ...
03/03/2021 16:07:31                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:07:31                         pktgen: {0: {'ibytes': 32305697280,
     'ierrors': 0,
     'ipackets': 63097065,
     'obytes': 48169891328,
     'oerrors': 0,
     'opackets': 94081830,
     'rx_bps': 25797810176.0,
     'rx_bps_L1': 26805806176.0,
     'rx_pps': 6299975.0,
     'rx_util': 67.01451544,
     'tx_bps': 38418198528.0,
     'tx_bps_L1': 39919396928.0,
     'tx_pps': 9382490.0,
     'tx_util': 99.79849232},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 8.243036270141602,
            'cpu_util': 58.258567810058594,
            'cpu_util_raw': 61.3125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 82426464,
            'rx_bps': 25797810176.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 12620388352.0,
            'rx_pps': 6299975.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 38418198528.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 9382490.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 32305697280,
           'ierrors': 0,
           'ipackets': 63097065,
           'obytes': 48169891328,
           'oerrors': 0,
           'opackets': 94081830,
           'rx_bps': 25797810176.0,
           'rx_bps_L1': 26805806176.0,
           'rx_pps': 6299975.0,
           'rx_util': 67.01451544,
           'tx_bps': 38418198528.0,
           'tx_bps_L1': 39919396928.0,
           'tx_pps': 9382490.0,
           'tx_util': 99.79849232}}
03/03/2021 16:07:31                         pktgen: {'ibytes': 32305697280,
 'ierrors': 0,
 'ipackets': 63097065,
 'obytes': 48169891328,
 'oerrors': 0,
 'opackets': 94081830,
 'rx_bps': 25797810176.0,
 'rx_bps_L1': 26805806176.0,
 'rx_pps': 6299975.0,
 'rx_util': 67.01451544,
 'tx_bps': 38418198528.0,
 'tx_bps_L1': 39919396928.0,
 'tx_pps': 9382490.0,
 'tx_util': 99.79849232}
03/03/2021 16:07:31                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 38418198528.000000, tx_pps: 9382490.000000 
03/03/2021 16:07:31                         pktgen: {'ibytes': 32305697280,
 'ierrors': 0,
 'ipackets': 63097065,
 'obytes': 48169891328,
 'oerrors': 0,
 'opackets': 94081830,
 'rx_bps': 25797810176.0,
 'rx_bps_L1': 26805806176.0,
 'rx_pps': 6299975.0,
 'rx_util': 67.01451544,
 'tx_bps': 38418198528.0,
 'tx_bps_L1': 39919396928.0,
 'tx_pps': 9382490.0,
 'tx_util': 99.79849232}
03/03/2021 16:07:31                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 25797810176.000000, rx_pps: 6299975.000000
03/03/2021 16:07:31                         pktgen: throughput: pps_rx 6299975.000000, bps_rx 25797810176.000000
03/03/2021 16:07:31                         pktgen: traffic completed. 
03/03/2021 16:07:31    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1024, rxd/txd: 1024
03/03/2021 16:07:31                         tester: ls -d /tmp
03/03/2021 16:07:31                         tester: /tmp
03/03/2021 16:07:31                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:07:33                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:33                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:33                         pktgen: trex port <0> not support flow control
03/03/2021 16:07:33                         pktgen: check the trex port link status
03/03/2021 16:07:33                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:33                         pktgen: begin traffic ......
03/03/2021 16:07:33                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:07:43                         pktgen: begin get port statistic ...
03/03/2021 16:07:43                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:07:43                         pktgen: {0: {'ibytes': 47549140992,
     'ierrors': 0,
     'ipackets': 46434713,
     'obytes': 49091964928,
     'oerrors': 0,
     'opackets': 47941378,
     'rx_bps': 37864390656.0,
     'rx_bps_L1': 38604123776.0,
     'rx_pps': 4623332.0,
     'rx_util': 96.51030944,
     'tx_bps': 39112032256.0,
     'tx_bps_L1': 39876228256.0,
     'tx_pps': 4776225.0,
     'tx_util': 99.69057064},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 17.161724090576172,
            'cpu_util': 28.487838745117188,
            'cpu_util_raw': 27.875,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 36650008,
            'rx_bps': 37864390656.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 4623332.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39112032256.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 4776225.0},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 47549140992,
           'ierrors': 0,
           'ipackets': 46434713,
           'obytes': 49091964928,
           'oerrors': 0,
           'opackets': 47941378,
           'rx_bps': 37864390656.0,
           'rx_bps_L1': 38604123776.0,
           'rx_pps': 4623332.0,
           'rx_util': 96.51030944,
           'tx_bps': 39112032256.0,
           'tx_bps_L1': 39876228256.0,
           'tx_pps': 4776225.0,
           'tx_util': 99.69057064}}
03/03/2021 16:07:43                         pktgen: {'ibytes': 47549140992,
 'ierrors': 0,
 'ipackets': 46434713,
 'obytes': 49091964928,
 'oerrors': 0,
 'opackets': 47941378,
 'rx_bps': 37864390656.0,
 'rx_bps_L1': 38604123776.0,
 'rx_pps': 4623332.0,
 'rx_util': 96.51030944,
 'tx_bps': 39112032256.0,
 'tx_bps_L1': 39876228256.0,
 'tx_pps': 4776225.0,
 'tx_util': 99.69057064}
03/03/2021 16:07:43                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39112032256.000000, tx_pps: 4776225.000000 
03/03/2021 16:07:43                         pktgen: {'ibytes': 47549140992,
 'ierrors': 0,
 'ipackets': 46434713,
 'obytes': 49091964928,
 'oerrors': 0,
 'opackets': 47941378,
 'rx_bps': 37864390656.0,
 'rx_bps_L1': 38604123776.0,
 'rx_pps': 4623332.0,
 'rx_util': 96.51030944,
 'tx_bps': 39112032256.0,
 'tx_bps_L1': 39876228256.0,
 'tx_pps': 4776225.0,
 'tx_util': 99.69057064}
03/03/2021 16:07:43                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 37864390656.000000, rx_pps: 4623332.000000
03/03/2021 16:07:43                         pktgen: throughput: pps_rx 4623332.000000, bps_rx 37864390656.000000
03/03/2021 16:07:43                         pktgen: traffic completed. 
03/03/2021 16:07:43    TestPVPMultiPathPerformance: Test running at parameters: framesize: 1518, rxd/txd: 1024
03/03/2021 16:07:43                         tester: ls -d /tmp
03/03/2021 16:07:43                         tester: /tmp
03/03/2021 16:07:43                         tester: scp -v /home/lingwei/dts_0302/output/tmp/pcap/multi_path.pcap root@10.240.183.217:/tmp/multi_path.pcap
03/03/2021 16:07:45                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:45                         pktgen: test port 0 map gen port 0
03/03/2021 16:07:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'off',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:45                         pktgen: trex port <0> not support flow control
03/03/2021 16:07:45                         pktgen: check the trex port link status
03/03/2021 16:07:45                         pktgen: {'arp': '-',
 'cores': [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15],
 'description': 'Ethernet Controller XL710 for 40GbE QSFP+',
 'dest': 'b4:96:91:46:e0:5c',
 'driver': 'net_i40e',
 'fc': 'none',
 'fc_supported': 'no',
 'grat_arp': 'off',
 'hw_mac': '3c:fd:fe:c8:17:d0',
 'index': 0,
 'ipv6': 'off',
 'is_fc_supported': False,
 'is_led_supported': True,
 'is_link_supported': True,
 'is_prom_supported': True,
 'is_virtual': 'no',
 'is_vxlan_supported': 'yes',
 'layer_mode': 'Ethernet',
 'led_change_supported': 'yes',
 'link': 'UP',
 'link_change_supported': 'yes',
 'mult': 'off',
 'numa': 1,
 'pci_addr': '0000:82:00.0',
 'prom': 'on',
 'prom_supported': 'yes',
 'rx': {'caps': ['flow_stats', 'latency'], 'counters': 127},
 'rx_filter_mode': 'hardware match',
 'rx_queue': 'off',
 'speed': 40.0,
 'src_ipv4': '-',
 'src_mac': '3c:fd:fe:c8:17:d0',
 'stack': 'legacy',
 'status': 'IDLE',
 'supp_speeds': [40000],
 'vlan': '-',
 'vxlan_fs': '-'}
03/03/2021 16:07:45                         pktgen: begin traffic ......
03/03/2021 16:07:45                         pktgen: {'ports': [0], 'mult': '100%', 'core_mask': None, 'force': True}
03/03/2021 16:07:55                         pktgen: begin get port statistic ...
03/03/2021 16:07:55                         pktgen: {'options': {'pcap': '/tmp/multi_path.pcap',
             'stream_config': {'rate': 100,
                               'transmit_mode': 'continuous',
                               'txmode': {}}},
 'pcap_file': '/tmp/multi_path.pcap',
 'rx_port': 0,
 'tx_port': 0}
03/03/2021 16:07:55                         pktgen: {0: {'ibytes': 49400629212,
     'ierrors': 0,
     'ipackets': 32543237,
     'obytes': 49400533578,
     'oerrors': 0,
     'opackets': 32543175,
     'rx_bps': 39374544896.0,
     'rx_bps_L1': 39893403296.0,
     'rx_pps': 3242865.0,
     'rx_util': 99.73350824,
     'tx_bps': 39375011840.0,
     'tx_bps_L1': 39893879320.00001,
     'tx_pps': 3242921.75,
     'tx_util': 99.73469830000002},
 1: {'ibytes': 0,
     'ierrors': 0,
     'ipackets': 0,
     'obytes': 0,
     'oerrors': 0,
     'opackets': 0,
     'rx_bps': 0.0,
     'rx_bps_L1': 0,
     'rx_pps': 0.0,
     'rx_util': 0.0,
     'tx_bps': 0.0,
     'tx_bps_L1': 0,
     'tx_pps': 0.0,
     'tx_util': 0.0},
 'flow_stats': {},
 'global': {'active_flows': 0.0,
            'active_sockets': 0,
            'bw_per_core': 34.996795654296875,
            'cpu_util': 14.06379222869873,
            'cpu_util_raw': 13.8125,
            'open_flows': 0.0,
            'platform_factor': 1.0,
            'queue_full': 17229407,
            'rx_bps': 39374544896.0,
            'rx_core_pps': 0.0,
            'rx_cpu_util': 0.0,
            'rx_drop_bps': 0.0,
            'rx_pps': 3242865.0,
            'socket_util': 0.0,
            'total_alloc_error': 0,
            'total_clients': 0,
            'total_servers': 0,
            'tx_bps': 39375011840.0,
            'tx_cps': 0.0,
            'tx_expected_bps': 0.0,
            'tx_expected_cps': 0.0,
            'tx_expected_pps': 0.0,
            'tx_pps': 3242921.75},
 'latency': {'global': {'bad_hdr': 0, 'old_flow': 0}},
 'total': {'ibytes': 49400629212,
           'ierrors': 0,
           'ipackets': 32543237,
           'obytes': 49400533578,
           'oerrors': 0,
           'opackets': 32543175,
           'rx_bps': 39374544896.0,
           'rx_bps_L1': 39893403296.0,
           'rx_pps': 3242865.0,
           'rx_util': 99.73350824,
           'tx_bps': 39375011840.0,
           'tx_bps_L1': 39893879320.00001,
           'tx_pps': 3242921.75,
           'tx_util': 99.73469830000002}}
03/03/2021 16:07:55                         pktgen: {'ibytes': 49400629212,
 'ierrors': 0,
 'ipackets': 32543237,
 'obytes': 49400533578,
 'oerrors': 0,
 'opackets': 32543175,
 'rx_bps': 39374544896.0,
 'rx_bps_L1': 39893403296.0,
 'rx_pps': 3242865.0,
 'rx_util': 99.73350824,
 'tx_bps': 39375011840.0,
 'tx_bps_L1': 39893879320.00001,
 'tx_pps': 3242921.75,
 'tx_util': 99.73469830000002}
03/03/2021 16:07:55                         pktgen: Tx Port 0 stats: 
tx_port: 0,  tx_bps: 39375011840.000000, tx_pps: 3242921.750000 
03/03/2021 16:07:55                         pktgen: {'ibytes': 49400629212,
 'ierrors': 0,
 'ipackets': 32543237,
 'obytes': 49400533578,
 'oerrors': 0,
 'opackets': 32543175,
 'rx_bps': 39374544896.0,
 'rx_bps_L1': 39893403296.0,
 'rx_pps': 3242865.0,
 'rx_util': 99.73350824,
 'tx_bps': 39375011840.0,
 'tx_bps_L1': 39893879320.00001,
 'tx_pps': 3242921.75,
 'tx_util': 99.73469830000002}
03/03/2021 16:07:55                         pktgen: Rx Port 0 stats: 
rx_port: 0,  rx_bps: 39374544896.000000, rx_pps: 3242865.000000
03/03/2021 16:07:55                         pktgen: throughput: pps_rx 3242865.000000, bps_rx 39374544896.000000
03/03/2021 16:07:55                         pktgen: traffic completed. 
03/03/2021 16:07:57    TestPVPMultiPathPerformance: result of all framesize result
03/03/2021 16:07:57    TestPVPMultiPathPerformance: 
+-------+---------------------------+--------+------------+
| Frame |       Mode/RXD-TXD        |  Mpps  | % linerate |
+=======+===========================+========+============+
| 64    | virtio_1.1_inorder_normal | 10.307 | 17.316     |
+-------+---------------------------+--------+------------+
| 128   | virtio_1.1_inorder_normal | 9.385  | 27.780     |
+-------+---------------------------+--------+------------+
| 256   | virtio_1.1_inorder_normal | 8.377  | 46.239     |
+-------+---------------------------+--------+------------+
| 512   | virtio_1.1_inorder_normal | 6.300  | 67.032     |
+-------+---------------------------+--------+------------+
| 1024  | virtio_1.1_inorder_normal | 4.623  | 96.535     |
+-------+---------------------------+--------+------------+
| 1518  | virtio_1.1_inorder_normal | 3.243  | 99.751     |
+-------+---------------------------+--------+------------+
03/03/2021 16:07:57    TestPVPMultiPathPerformance: 
+-------+--------------+-------------+------------+---------------------+-----------------------+
| Frame | Mode/RXD-TXD |    Mpps     | % linerate | Expected Throughput | Throughput Difference |
+=======+==============+=============+============+=====================+=======================+
| 64    | 1024         | 10.307 Mpps | 17.316%    | 10.237 Mpps         | 0.070 Mpps            |
+-------+--------------+-------------+------------+---------------------+-----------------------+
| 1518  | 1024         | 3.243 Mpps  | 99.751%    | 3.246 Mpps          | -0.003 Mpps           |
+-------+--------------+-------------+------------+---------------------+-----------------------+
03/03/2021 16:07:57    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.511850
03/03/2021 16:07:57    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) 0.070000
03/03/2021 16:07:57    TestPVPMultiPathPerformance: Accept tolerance are (Mpps) -0.162300
03/03/2021 16:07:57    TestPVPMultiPathPerformance: Throughput Difference are (Mpps) -0.003000
03/03/2021 16:07:57    TestPVPMultiPathPerformance: Test Case test_perf_pvp_virtio11_vectorized Result PASSED:
03/03/2021 16:07:57             dut.10.240.183.220: kill_all: called by dut and prefix list has value.
03/03/2021 16:07:58                            dts: 
TEST SUITE ENDED: TestPVPMultiPathPerformance

      reply	other threads:[~2021-03-03  8:11 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-03-03  8:09 Ling Wei
2021-03-03  8:10 ` Ling, WeiX [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7590925b07894c0eba34d6e05c14ec50@intel.com \
    --to=weix.ling@intel.com \
    --cc=dts@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).