Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

[Rubens Figueiredo]

[-- Attachment #1: Type: text/plain, Size: 3043 bytes --]

Hello community,

I am facing a strange issue in the Trex stateless code, version v3.02 
and v3.04. I am using the Mellanox Cx-5, and have created two VFs on top 
of the PF 0. The mlx5_core version I am using is the 5.7-1.0.2, and the 
ofed version is MLNX_OFED_LINUX-5.7-1.0.2.0 (OFED-5.7-1.0.2).

I have created the following issue in the trex-core repository 
[here](https://github.com/cisco-system-traffic-generator/trex-core/issues/1124), 
and was recommended to post the issue in here. In the github issue you 
see screenshots of the issue I am facing.

I am trying to create two parallel streams with different VLAN 
priorities, but the load generated is not what I expect it to be, and 
CPU util. seems incredibly high (~99%).

I have reproduced this issue with the --software and non software version.

The script I used is below.

|import stl_path from trex.stl.api import * import time import pprint 
from ipaddress import ip_address, ip_network import argparse import 
configparser import os import json def get_packet(tos, mac_dst, ip_src, 
size): # pkt = Ether(src="02:00:00:00:00:01",dst="00:00:00:01:00:01") / 
IP(src="10.0.0.2", tos=tos) / UDP(sport=4444, dport=4444) pkt = ( 
Ether(src="00:01:00:00:00:02", dst=mac_dst) # 
Ether(dst="11:11:11:11:11:11") # / Dot1AD(vlan=0) / Dot1Q(vlan=0, 
prio=tos) / IP(src=ip_src) / UDP(sport=4444, dport=4444) ) pad = max(0, 
size - len(pkt)) * "x" return pkt / pad def main(): """ """ tx_port = 0 
rx_port = 1 c = STLClient() # connect to server c.connect() # prepare 
our ports c.reset(ports=[tx_port, rx_port]) streams = [] s = STLStream( 
packet=STLPktBuilder( pkt=get_packet(4,"00:11:22:33:44:55", 
"10.1.0.2",512), # vm = vm, ), isg=0 * 1000000, 
mode=STLTXCont(pps=1.2*10**6), # flow_stats = STLFlowLatencyStats(pg_id 
= 0) flow_stats = STLFlowStats(pg_id=0), ) streams.append(s) s2 = 
STLStream( packet=STLPktBuilder( pkt=get_packet(2,"00:11:22:33:44:55", 
"10.1.0.2",512), # vm = vm, ), isg=0 * 1000000, 
mode=STLTXCont(pps=1.2*10**6), # flow_stats = STLFlowLatencyStats(pg_id 
= 0) flow_stats = STLFlowStats(pg_id=1), ) streams.append(s2) 
c.add_streams(streams, ports=[tx_port]) c.clear_stats() 
c.start(ports=[tx_port], duration=60, mult="25gbpsl1") 
c.wait_on_traffic(ports=[tx_port, rx_port]) stats = c.get_stats() 
print(stats) if __name__ == "__main__": main() And the configuration is |

|- port_limit: 2 version: 2 port_bandwidth_gb: 100 interfaces: 
["3b:00.2", "3b:00.3"] port_info: - dest_mac: 00:00:00:00:00:01 src_mac: 
00:01:00:00:00:01 - dest_mac: 00:00:00:00:00:02 src_mac: 
00:01:00:00:00:02 c: 14 platform: master_thread_id: 8 latency_thread_id: 
27 dual_if: - socket: 0 threads: 
[9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]|


-- 
BISDN GmbH
Körnerstraße 7-10
10785 Berlin
Germany


Phone: 
+49-30-6108-1-6100


Managing Directors: 
Dr.-Ing. Hagen Woesner, Andreas 
Köpsel


Commercial register: 
Amtsgericht Berlin-Charlottenburg HRB 141569 
B
VAT ID No: DE283257294


[-- Attachment #2: Type: text/html, Size: 5679 bytes --]

RE: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

[Dariusz Sosnowski]

Hi Rubens,

Would you be able to provide the output of "ethtool -S <iface>" for both VFs before and after the test?
Does the same issue appear on this system if both parallel streams use the same VLAN priority?

Best regards,
Dariusz Sosnowski

> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de> 
> Sent: Wednesday, April 17, 2024 19:07
> To: users@dpdk.org
> Subject: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization
> 
> Hello community,
> I am facing a strange issue in the Trex stateless code, version v3.02 and v3.04. I am using the Mellanox Cx-5, and have created two VFs on top of the PF 0. The mlx5_core version I am using is the 5.7-1.0.2, and the ofed version is MLNX_OFED_LINUX-5.7-1.0.2.0 (OFED-5.7-1.0.2).
> I have created the following issue in the trex-core repository [here](https://github.com/cisco-system-traffic-generator/trex-core/issues/1124), and was recommended to post the issue in here. In the github issue you see screenshots of the issue I am facing. 
> I am trying to create two parallel streams with different VLAN priorities, but the load generated is not what I expect it to be, and CPU util. seems incredibly high (~99%).
> I have reproduced this issue with the --software and non software version.
> The script I used is below.
> import stl_path
> from trex.stl.api import *
> 
> import time
> import pprint
> from ipaddress import ip_address, ip_network
> 
> import argparse
> import configparser
> import os
> import json
> 
> 
> def get_packet(tos, mac_dst, ip_src, size):
>     # pkt = Ether(src="02:00:00:00:00:01",dst="00:00:00:01:00:01") / IP(src="10.0.0.2", tos=tos) / UDP(sport=4444, dport=4444)
> 
>     pkt = (
>         Ether(src="00:01:00:00:00:02", dst=mac_dst)
>         # Ether(dst="11:11:11:11:11:11")
>         # / Dot1AD(vlan=0)
>         / Dot1Q(vlan=0, prio=tos)
>         / IP(src=ip_src)
>         / UDP(sport=4444, dport=4444)
>     )
>     pad = max(0, size - len(pkt)) * "x"
> 
>     return pkt / pad
> 
> def main():
>     """ """
>     tx_port = 0
>     rx_port = 1
> 
>     c = STLClient()
> 
>     # connect to server
>     c.connect()
> 
>     # prepare our ports
>     c.reset(ports=[tx_port, rx_port])
> 
>     streams = []
>     s = STLStream(
>         packet=STLPktBuilder(
>             pkt=get_packet(4,"00:11:22:33:44:55", "10.1.0.2",512),
>             # vm = vm,
>         ),
>         isg=0 * 1000000,
>         mode=STLTXCont(pps=1.2*10**6),
>         # flow_stats = STLFlowLatencyStats(pg_id = 0)
>         flow_stats = STLFlowStats(pg_id=0),
>     )
> 
>     streams.append(s)
> 
>     s2 = STLStream(
>         packet=STLPktBuilder(
>             pkt=get_packet(2,"00:11:22:33:44:55", "10.1.0.2",512),
>             # vm = vm,
>         ),
>         isg=0 * 1000000,
>         mode=STLTXCont(pps=1.2*10**6),
>         # flow_stats = STLFlowLatencyStats(pg_id = 0)
>         flow_stats = STLFlowStats(pg_id=1),
>     )
> 
>     streams.append(s2)
> 
>     c.add_streams(streams, ports=[tx_port])
> 
>     c.clear_stats()
> 
>     c.start(ports=[tx_port], duration=60, mult="25gbpsl1")
> 
>     c.wait_on_traffic(ports=[tx_port, rx_port])
> 
>     stats = c.get_stats()
>     print(stats)
> 
> if __name__ == "__main__":
>     main()
> 
> 
> And the configuration is 
> - port_limit: 2
>   version: 2
>   port_bandwidth_gb: 100
>   interfaces: ["3b:00.2", "3b:00.3"]
>   port_info:
>     - dest_mac: 00:00:00:00:00:01
>       src_mac: 00:01:00:00:00:01
>     - dest_mac: 00:00:00:00:00:02
>       src_mac: 00:01:00:00:00:02
>   c: 14
>   platform:
>     master_thread_id: 8
>     latency_thread_id: 27
>     dual_if:
>       - socket: 0
>         threads: [9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]
> 
> 
> BISDN GmbH
> Körnerstraße 7-10
> 10785 Berlin
> Germany
> 
> Phone: +49-30-6108-1-6100
> 
> Managing Directors: 
> Dr.-Ing. Hagen Woesner, Andreas Köpsel
> 
> Commercial register: 
> Amtsgericht Berlin-Charlottenburg HRB 141569 B
> VAT ID No: DE283257294
> ________________________________________

Re: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

[Rubens Figueiredo]

[-- Attachment #1: Type: text/plain, Size: 5773 bytes --]

Hi Dariusz,

Thank you for the help.

If the two parallel stream use the same VLAN priority then the issue is 
not visible anymore. Trex output visible below.

Different priority
CPU util.  |            96.97% |              0.0% |
Tx bps L2  |         3.59 Gbps |          0.29 bps | 3.59 Gbps
Tx bps L1  |         3.64 Gbps |          0.37 bps | 3.64 Gbps
Tx pps     |       298.49 Kpps |             0 pps | 298.49 Kpps
Line Util. |            3.64 % |               0 % |

Same priority
CPU util.  |             0.54% |              0.0% |
Tx bps L2  |        23.98 Gbps |             0 bps | 23.98 Gbps
Tx bps L1  |         24.3 Gbps |             0 bps | 24.3 Gbps
Tx pps     |         1.99 Mpps |             0 pps | 1.99 Mpps
Line Util. |            24.3 % |               0 % |

I have attached the requested output to the email.

Best,
Rubens

On 4/18/24 14:48, Dariusz Sosnowski wrote:
> Hi Rubens,
>
> Would you be able to provide the output of "ethtool -S <iface>" for both VFs before and after the test?
> Does the same issue appear on this system if both parallel streams use the same VLAN priority?
>
> Best regards,
> Dariusz Sosnowski
>
>> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de>
>> Sent: Wednesday, April 17, 2024 19:07
>> To: users@dpdk.org
>> Subject: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization
>>
>> Hello community,
>> I am facing a strange issue in the Trex stateless code, version v3.02 and v3.04. I am using the Mellanox Cx-5, and have created two VFs on top of the PF 0. The mlx5_core version I am using is the 5.7-1.0.2, and the ofed version is MLNX_OFED_LINUX-5.7-1.0.2.0 (OFED-5.7-1.0.2).
>> I have created the following issue in the trex-core repository [here](https://github.com/cisco-system-traffic-generator/trex-core/issues/1124), and was recommended to post the issue in here. In the github issue you see screenshots of the issue I am facing.
>> I am trying to create two parallel streams with different VLAN priorities, but the load generated is not what I expect it to be, and CPU util. seems incredibly high (~99%).
>> I have reproduced this issue with the --software and non software version.
>> The script I used is below.
>> import stl_path
>> from trex.stl.api import *
>>
>> import time
>> import pprint
>> from ipaddress import ip_address, ip_network
>>
>> import argparse
>> import configparser
>> import os
>> import json
>>
>>
>> def get_packet(tos, mac_dst, ip_src, size):
>>      # pkt = Ether(src="02:00:00:00:00:01",dst="00:00:00:01:00:01") / IP(src="10.0.0.2", tos=tos) / UDP(sport=4444, dport=4444)
>>
>>      pkt = (
>>          Ether(src="00:01:00:00:00:02", dst=mac_dst)
>>          # Ether(dst="11:11:11:11:11:11")
>>          # / Dot1AD(vlan=0)
>>          / Dot1Q(vlan=0, prio=tos)
>>          / IP(src=ip_src)
>>          / UDP(sport=4444, dport=4444)
>>      )
>>      pad = max(0, size - len(pkt)) * "x"
>>
>>      return pkt / pad
>>
>> def main():
>>      """ """
>>      tx_port = 0
>>      rx_port = 1
>>
>>      c = STLClient()
>>
>>      # connect to server
>>      c.connect()
>>
>>      # prepare our ports
>>      c.reset(ports=[tx_port, rx_port])
>>
>>      streams = []
>>      s = STLStream(
>>          packet=STLPktBuilder(
>>              pkt=get_packet(4,"00:11:22:33:44:55", "10.1.0.2",512),
>>              # vm = vm,
>>          ),
>>          isg=0 * 1000000,
>>          mode=STLTXCont(pps=1.2*10**6),
>>          # flow_stats = STLFlowLatencyStats(pg_id = 0)
>>          flow_stats = STLFlowStats(pg_id=0),
>>      )
>>
>>      streams.append(s)
>>
>>      s2 = STLStream(
>>          packet=STLPktBuilder(
>>              pkt=get_packet(2,"00:11:22:33:44:55", "10.1.0.2",512),
>>              # vm = vm,
>>          ),
>>          isg=0 * 1000000,
>>          mode=STLTXCont(pps=1.2*10**6),
>>          # flow_stats = STLFlowLatencyStats(pg_id = 0)
>>          flow_stats = STLFlowStats(pg_id=1),
>>      )
>>
>>      streams.append(s2)
>>
>>      c.add_streams(streams, ports=[tx_port])
>>
>>      c.clear_stats()
>>
>>      c.start(ports=[tx_port], duration=60, mult="25gbpsl1")
>>
>>      c.wait_on_traffic(ports=[tx_port, rx_port])
>>
>>      stats = c.get_stats()
>>      print(stats)
>>
>> if __name__ == "__main__":
>>      main()
>>
>>
>> And the configuration is
>> - port_limit: 2
>>    version: 2
>>    port_bandwidth_gb: 100
>>    interfaces: ["3b:00.2", "3b:00.3"]
>>    port_info:
>>      - dest_mac: 00:00:00:00:00:01
>>        src_mac: 00:01:00:00:00:01
>>      - dest_mac: 00:00:00:00:00:02
>>        src_mac: 00:01:00:00:00:02
>>    c: 14
>>    platform:
>>      master_thread_id: 8
>>      latency_thread_id: 27
>>      dual_if:
>>        - socket: 0
>>          threads: [9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]
>>
>>
>> BISDN GmbH
>> Körnerstraße 7-10
>> 10785 Berlin
>> Germany
>>
>> Phone: +49-30-6108-1-6100
>>
>> Managing Directors:
>> Dr.-Ing. Hagen Woesner, Andreas Köpsel
>>
>> Commercial register:
>> Amtsgericht Berlin-Charlottenburg HRB 141569 B
>> VAT ID No: DE283257294
>> ________________________________________
-- 
BISDN GmbH
Körnerstraße 7-10
10785 Berlin
Germany


Phone: 
+49-30-6108-1-6100


Managing Directors: 
Dr.-Ing. Hagen Woesner, Andreas 
Köpsel


Commercial register: 
Amtsgericht Berlin-Charlottenburg HRB 141569 
B
VAT ID No: DE283257294


[-- Attachment #2: ens2f0np0v0_after --]
[-- Type: text/plain, Size: 33970 bytes --]

NIC statistics:
     rx_packets: 0
     rx_bytes: 0
     tx_packets: 11
     tx_bytes: 866
     tx_tso_packets: 0
     tx_tso_bytes: 0
     tx_tso_inner_packets: 0
     tx_tso_inner_bytes: 0
     tx_added_vlan_packets: 0
     tx_nop: 0
     tx_mpwqe_blks: 11
     tx_mpwqe_pkts: 11
     tx_tls_encrypted_packets: 0
     tx_tls_encrypted_bytes: 0
     tx_tls_ooo: 0
     tx_tls_dump_packets: 0
     tx_tls_dump_bytes: 0
     tx_tls_resync_bytes: 0
     tx_tls_skip_no_sync_data: 0
     tx_tls_drop_no_sync_data: 0
     tx_tls_drop_bypass_req: 0
     rx_lro_packets: 0
     rx_lro_bytes: 0
     rx_gro_packets: 0
     rx_gro_bytes: 0
     rx_gro_skbs: 0
     rx_gro_match_packets: 0
     rx_gro_large_hds: 0
     rx_ecn_mark: 0
     rx_removed_vlan_packets: 0
     rx_csum_unnecessary: 0
     rx_csum_none: 0
     rx_csum_complete: 0
     rx_csum_complete_tail: 0
     rx_csum_complete_tail_slow: 0
     rx_csum_unnecessary_inner: 0
     rx_xdp_drop: 0
     rx_xdp_redirect: 0
     rx_xdp_tx_xmit: 0
     rx_xdp_tx_mpwqe: 0
     rx_xdp_tx_inlnw: 0
     rx_xdp_tx_nops: 0
     rx_xdp_tx_full: 0
     rx_xdp_tx_err: 0
     rx_xdp_tx_cqe: 0
     tx_csum_none: 11
     tx_csum_partial: 0
     tx_csum_partial_inner: 0
     tx_queue_stopped: 0
     tx_queue_dropped: 0
     tx_xmit_more: 0
     tx_recover: 0
     tx_cqes: 11
     tx_queue_wake: 0
     tx_cqe_err: 0
     tx_xdp_xmit: 0
     tx_xdp_mpwqe: 0
     tx_xdp_inlnw: 0
     tx_xdp_nops: 0
     tx_xdp_full: 0
     tx_xdp_err: 0
     tx_xdp_cqes: 0
     tx_cqe_compress_blks: 0
     tx_cqe_compress_pkts: 0
     rx_wqe_err: 0
     rx_mpwqe_filler_cqes: 0
     rx_mpwqe_filler_strides: 0
     rx_oversize_pkts_sw_drop: 0
     rx_buff_alloc_err: 0
     rx_cqe_compress_blks: 0
     rx_cqe_compress_pkts: 0
     rx_cache_reuse: 0
     rx_cache_full: 0
     rx_cache_empty: 0
     rx_cache_busy: 0
     rx_cache_ext: 0
     rx_cache_rdc: 0
     rx_cache_alloc: 44352
     rx_cache_waive: 0
     rx_congst_umr: 0
     rx_arfs_err: 0
     rx_recover: 0
     rx_pet_hdr_lookup_drop: 0
     rx_pet_mdata_lookup_drop: 0
     rx_tls_decrypted_packets: 0
     rx_tls_decrypted_bytes: 0
     rx_tls_resync_req_pkt: 0
     rx_tls_resync_req_start: 0
     rx_tls_resync_req_end: 0
     rx_tls_resync_req_skip: 0
     rx_tls_resync_res_ok: 0
     rx_tls_resync_res_retry: 0
     rx_tls_resync_res_skip: 0
     rx_tls_err: 0
     ch_events: 32
     ch_poll: 32
     ch_arm: 32
     ch_aff_change: 0
     ch_force_irq: 0
     ch_eq_rearm: 0
     rx_xsk_packets: 0
     rx_xsk_bytes: 0
     rx_xsk_csum_complete: 0
     rx_xsk_csum_unnecessary: 0
     rx_xsk_csum_unnecessary_inner: 0
     rx_xsk_csum_none: 0
     rx_xsk_ecn_mark: 0
     rx_xsk_removed_vlan_packets: 0
     rx_xsk_xdp_drop: 0
     rx_xsk_xdp_redirect: 0
     rx_xsk_wqe_err: 0
     rx_xsk_mpwqe_filler_cqes: 0
     rx_xsk_mpwqe_filler_strides: 0
     rx_xsk_oversize_pkts_sw_drop: 0
     rx_xsk_buff_alloc_err: 0
     rx_xsk_cqe_compress_blks: 0
     rx_xsk_cqe_compress_pkts: 0
     rx_xsk_congst_umr: 0
     rx_xsk_arfs_err: 0
     tx_xsk_xmit: 0
     tx_xsk_mpwqe: 0
     tx_xsk_inlnw: 0
     tx_xsk_full: 0
     tx_xsk_err: 0
     tx_xsk_cqes: 0
     rx_out_of_buffer: 0
     rx_if_down_packets: 0
     rx_steer_missed_packets: 0
     rx_vport_unicast_packets: 0
     rx_vport_unicast_bytes: 0
     tx_vport_unicast_packets: 43890062
     tx_vport_unicast_bytes: 65835093000
     rx_vport_multicast_packets: 1
     rx_vport_multicast_bytes: 86
     tx_vport_multicast_packets: 11
     tx_vport_multicast_bytes: 866
     rx_vport_broadcast_packets: 0
     rx_vport_broadcast_bytes: 0
     tx_vport_broadcast_packets: 0
     tx_vport_broadcast_bytes: 0
     rx_vport_rdma_unicast_packets: 0
     rx_vport_rdma_unicast_bytes: 0
     tx_vport_rdma_unicast_packets: 0
     tx_vport_rdma_unicast_bytes: 0
     rx_vport_rdma_multicast_packets: 0
     rx_vport_rdma_multicast_bytes: 0
     tx_vport_rdma_multicast_packets: 0
     tx_vport_rdma_multicast_bytes: 0
     tx_packets_phy: 0
     rx_packets_phy: 0
     rx_crc_errors_phy: 0
     tx_bytes_phy: 0
     rx_bytes_phy: 0
     tx_multicast_phy: 0
     tx_broadcast_phy: 0
     rx_multicast_phy: 0
     rx_broadcast_phy: 0
     rx_in_range_len_errors_phy: 0
     rx_out_of_range_len_phy: 0
     rx_oversize_pkts_phy: 0
     rx_symbol_err_phy: 0
     tx_mac_control_phy: 0
     rx_mac_control_phy: 0
     rx_unsupported_op_phy: 0
     rx_pause_ctrl_phy: 0
     tx_pause_ctrl_phy: 0
     rx_discards_phy: 0
     tx_discards_phy: 0
     tx_errors_phy: 0
     rx_undersize_pkts_phy: 0
     rx_fragments_phy: 0
     rx_jabbers_phy: 0
     rx_64_bytes_phy: 0
     rx_65_to_127_bytes_phy: 0
     rx_128_to_255_bytes_phy: 0
     rx_256_to_511_bytes_phy: 0
     rx_512_to_1023_bytes_phy: 0
     rx_1024_to_1518_bytes_phy: 0
     rx_1519_to_2047_bytes_phy: 0
     rx_2048_to_4095_bytes_phy: 0
     rx_4096_to_8191_bytes_phy: 0
     rx_8192_to_10239_bytes_phy: 0
     link_down_events_phy: 0
     rx_prio0_bytes: 0
     rx_prio0_packets: 0
     rx_prio0_discards: 0
     tx_prio0_bytes: 0
     tx_prio0_packets: 0
     rx_prio1_bytes: 0
     rx_prio1_packets: 0
     rx_prio1_discards: 0
     tx_prio1_bytes: 0
     tx_prio1_packets: 0
     rx_prio2_bytes: 0
     rx_prio2_packets: 0
     rx_prio2_discards: 0
     tx_prio2_bytes: 0
     tx_prio2_packets: 0
     rx_prio3_bytes: 0
     rx_prio3_packets: 0
     rx_prio3_discards: 0
     tx_prio3_bytes: 0
     tx_prio3_packets: 0
     rx_prio4_bytes: 0
     rx_prio4_packets: 0
     rx_prio4_discards: 0
     tx_prio4_bytes: 0
     tx_prio4_packets: 0
     rx_prio5_bytes: 0
     rx_prio5_packets: 0
     rx_prio5_discards: 0
     tx_prio5_bytes: 0
     tx_prio5_packets: 0
     rx_prio6_bytes: 0
     rx_prio6_packets: 0
     rx_prio6_discards: 0
     tx_prio6_bytes: 0
     tx_prio6_packets: 0
     rx_prio7_bytes: 0
     rx_prio7_packets: 0
     rx_prio7_discards: 0
     tx_prio7_bytes: 0
     tx_prio7_packets: 0
     module_unplug: 0
     module_bus_stuck: 0
     module_high_temp: 0
     module_bad_shorted: 0
     ch0_events: 2
     ch0_poll: 2
     ch0_arm: 2
     ch0_aff_change: 0
     ch0_force_irq: 0
     ch0_eq_rearm: 0
     ch1_events: 2
     ch1_poll: 2
     ch1_arm: 2
     ch1_aff_change: 0
     ch1_force_irq: 0
     ch1_eq_rearm: 0
     ch2_events: 2
     ch2_poll: 2
     ch2_arm: 2
     ch2_aff_change: 0
     ch2_force_irq: 0
     ch2_eq_rearm: 0
     ch3_events: 2
     ch3_poll: 2
     ch3_arm: 2
     ch3_aff_change: 0
     ch3_force_irq: 0
     ch3_eq_rearm: 0
     ch4_events: 2
     ch4_poll: 2
     ch4_arm: 2
     ch4_aff_change: 0
     ch4_force_irq: 0
     ch4_eq_rearm: 0
     ch5_events: 2
     ch5_poll: 2
     ch5_arm: 2
     ch5_aff_change: 0
     ch5_force_irq: 0
     ch5_eq_rearm: 0
     ch6_events: 2
     ch6_poll: 2
     ch6_arm: 2
     ch6_aff_change: 0
     ch6_force_irq: 0
     ch6_eq_rearm: 0
     ch7_events: 2
     ch7_poll: 2
     ch7_arm: 2
     ch7_aff_change: 0
     ch7_force_irq: 0
     ch7_eq_rearm: 0
     ch8_events: 12
     ch8_poll: 12
     ch8_arm: 12
     ch8_aff_change: 0
     ch8_force_irq: 0
     ch8_eq_rearm: 0
     ch9_events: 2
     ch9_poll: 2
     ch9_arm: 2
     ch9_aff_change: 0
     ch9_force_irq: 0
     ch9_eq_rearm: 0
     ch10_events: 2
     ch10_poll: 2
     ch10_arm: 2
     ch10_aff_change: 0
     ch10_force_irq: 0
     ch10_eq_rearm: 0
     rx0_packets: 0
     rx0_bytes: 0
     rx0_csum_complete: 0
     rx0_csum_complete_tail: 0
     rx0_csum_complete_tail_slow: 0
     rx0_csum_unnecessary: 0
     rx0_csum_unnecessary_inner: 0
     rx0_csum_none: 0
     rx0_xdp_drop: 0
     rx0_xdp_redirect: 0
     rx0_lro_packets: 0
     rx0_lro_bytes: 0
     rx0_gro_packets: 0
     rx0_gro_bytes: 0
     rx0_gro_skbs: 0
     rx0_gro_match_packets: 0
     rx0_gro_large_hds: 0
     rx0_ecn_mark: 0
     rx0_removed_vlan_packets: 0
     rx0_wqe_err: 0
     rx0_mpwqe_filler_cqes: 0
     rx0_mpwqe_filler_strides: 0
     rx0_oversize_pkts_sw_drop: 0
     rx0_buff_alloc_err: 0
     rx0_cqe_compress_blks: 0
     rx0_cqe_compress_pkts: 0
     rx0_cache_reuse: 0
     rx0_cache_full: 0
     rx0_cache_empty: 0
     rx0_cache_busy: 0
     rx0_cache_waive: 0
     rx0_cache_ext: 0
     rx0_cache_rdc: 0
     rx0_cache_alloc: 4032
     rx0_congst_umr: 0
     rx0_arfs_err: 0
     rx0_recover: 0
     rx0_pet_hdr_lookup_drop: 0
     rx0_pet_mdata_lookup_drop: 0
     rx0_tls_decrypted_packets: 0
     rx0_tls_decrypted_bytes: 0
     rx0_tls_resync_req_pkt: 0
     rx0_tls_resync_req_start: 0
     rx0_tls_resync_req_end: 0
     rx0_tls_resync_req_skip: 0
     rx0_tls_resync_res_ok: 0
     rx0_tls_resync_res_retry: 0
     rx0_tls_resync_res_skip: 0
     rx0_tls_err: 0
     rx0_xdp_tx_xmit: 0
     rx0_xdp_tx_mpwqe: 0
     rx0_xdp_tx_inlnw: 0
     rx0_xdp_tx_nops: 0
     rx0_xdp_tx_full: 0
     rx0_xdp_tx_err: 0
     rx0_xdp_tx_cqes: 0
     rx1_packets: 0
     rx1_bytes: 0
     rx1_csum_complete: 0
     rx1_csum_complete_tail: 0
     rx1_csum_complete_tail_slow: 0
     rx1_csum_unnecessary: 0
     rx1_csum_unnecessary_inner: 0
     rx1_csum_none: 0
     rx1_xdp_drop: 0
     rx1_xdp_redirect: 0
     rx1_lro_packets: 0
     rx1_lro_bytes: 0
     rx1_gro_packets: 0
     rx1_gro_bytes: 0
     rx1_gro_skbs: 0
     rx1_gro_match_packets: 0
     rx1_gro_large_hds: 0
     rx1_ecn_mark: 0
     rx1_removed_vlan_packets: 0
     rx1_wqe_err: 0
     rx1_mpwqe_filler_cqes: 0
     rx1_mpwqe_filler_strides: 0
     rx1_oversize_pkts_sw_drop: 0
     rx1_buff_alloc_err: 0
     rx1_cqe_compress_blks: 0
     rx1_cqe_compress_pkts: 0
     rx1_cache_reuse: 0
     rx1_cache_full: 0
     rx1_cache_empty: 0
     rx1_cache_busy: 0
     rx1_cache_waive: 0
     rx1_cache_ext: 0
     rx1_cache_rdc: 0
     rx1_cache_alloc: 4032
     rx1_congst_umr: 0
     rx1_arfs_err: 0
     rx1_recover: 0
     rx1_pet_hdr_lookup_drop: 0
     rx1_pet_mdata_lookup_drop: 0
     rx1_tls_decrypted_packets: 0
     rx1_tls_decrypted_bytes: 0
     rx1_tls_resync_req_pkt: 0
     rx1_tls_resync_req_start: 0
     rx1_tls_resync_req_end: 0
     rx1_tls_resync_req_skip: 0
     rx1_tls_resync_res_ok: 0
     rx1_tls_resync_res_retry: 0
     rx1_tls_resync_res_skip: 0
     rx1_tls_err: 0
     rx1_xdp_tx_xmit: 0
     rx1_xdp_tx_mpwqe: 0
     rx1_xdp_tx_inlnw: 0
     rx1_xdp_tx_nops: 0
     rx1_xdp_tx_full: 0
     rx1_xdp_tx_err: 0
     rx1_xdp_tx_cqes: 0
     rx2_packets: 0
     rx2_bytes: 0
     rx2_csum_complete: 0
     rx2_csum_complete_tail: 0
     rx2_csum_complete_tail_slow: 0
     rx2_csum_unnecessary: 0
     rx2_csum_unnecessary_inner: 0
     rx2_csum_none: 0
     rx2_xdp_drop: 0
     rx2_xdp_redirect: 0
     rx2_lro_packets: 0
     rx2_lro_bytes: 0
     rx2_gro_packets: 0
     rx2_gro_bytes: 0
     rx2_gro_skbs: 0
     rx2_gro_match_packets: 0
     rx2_gro_large_hds: 0
     rx2_ecn_mark: 0
     rx2_removed_vlan_packets: 0
     rx2_wqe_err: 0
     rx2_mpwqe_filler_cqes: 0
     rx2_mpwqe_filler_strides: 0
     rx2_oversize_pkts_sw_drop: 0
     rx2_buff_alloc_err: 0
     rx2_cqe_compress_blks: 0
     rx2_cqe_compress_pkts: 0
     rx2_cache_reuse: 0
     rx2_cache_full: 0
     rx2_cache_empty: 0
     rx2_cache_busy: 0
     rx2_cache_waive: 0
     rx2_cache_ext: 0
     rx2_cache_rdc: 0
     rx2_cache_alloc: 4032
     rx2_congst_umr: 0
     rx2_arfs_err: 0
     rx2_recover: 0
     rx2_pet_hdr_lookup_drop: 0
     rx2_pet_mdata_lookup_drop: 0
     rx2_tls_decrypted_packets: 0
     rx2_tls_decrypted_bytes: 0
     rx2_tls_resync_req_pkt: 0
     rx2_tls_resync_req_start: 0
     rx2_tls_resync_req_end: 0
     rx2_tls_resync_req_skip: 0
     rx2_tls_resync_res_ok: 0
     rx2_tls_resync_res_retry: 0
     rx2_tls_resync_res_skip: 0
     rx2_tls_err: 0
     rx2_xdp_tx_xmit: 0
     rx2_xdp_tx_mpwqe: 0
     rx2_xdp_tx_inlnw: 0
     rx2_xdp_tx_nops: 0
     rx2_xdp_tx_full: 0
     rx2_xdp_tx_err: 0
     rx2_xdp_tx_cqes: 0
     rx3_packets: 0
     rx3_bytes: 0
     rx3_csum_complete: 0
     rx3_csum_complete_tail: 0
     rx3_csum_complete_tail_slow: 0
     rx3_csum_unnecessary: 0
     rx3_csum_unnecessary_inner: 0
     rx3_csum_none: 0
     rx3_xdp_drop: 0
     rx3_xdp_redirect: 0
     rx3_lro_packets: 0
     rx3_lro_bytes: 0
     rx3_gro_packets: 0
     rx3_gro_bytes: 0
     rx3_gro_skbs: 0
     rx3_gro_match_packets: 0
     rx3_gro_large_hds: 0
     rx3_ecn_mark: 0
     rx3_removed_vlan_packets: 0
     rx3_wqe_err: 0
     rx3_mpwqe_filler_cqes: 0
     rx3_mpwqe_filler_strides: 0
     rx3_oversize_pkts_sw_drop: 0
     rx3_buff_alloc_err: 0
     rx3_cqe_compress_blks: 0
     rx3_cqe_compress_pkts: 0
     rx3_cache_reuse: 0
     rx3_cache_full: 0
     rx3_cache_empty: 0
     rx3_cache_busy: 0
     rx3_cache_waive: 0
     rx3_cache_ext: 0
     rx3_cache_rdc: 0
     rx3_cache_alloc: 4032
     rx3_congst_umr: 0
     rx3_arfs_err: 0
     rx3_recover: 0
     rx3_pet_hdr_lookup_drop: 0
     rx3_pet_mdata_lookup_drop: 0
     rx3_tls_decrypted_packets: 0
     rx3_tls_decrypted_bytes: 0
     rx3_tls_resync_req_pkt: 0
     rx3_tls_resync_req_start: 0
     rx3_tls_resync_req_end: 0
     rx3_tls_resync_req_skip: 0
     rx3_tls_resync_res_ok: 0
     rx3_tls_resync_res_retry: 0
     rx3_tls_resync_res_skip: 0
     rx3_tls_err: 0
     rx3_xdp_tx_xmit: 0
     rx3_xdp_tx_mpwqe: 0
     rx3_xdp_tx_inlnw: 0
     rx3_xdp_tx_nops: 0
     rx3_xdp_tx_full: 0
     rx3_xdp_tx_err: 0
     rx3_xdp_tx_cqes: 0
     rx4_packets: 0
     rx4_bytes: 0
     rx4_csum_complete: 0
     rx4_csum_complete_tail: 0
     rx4_csum_complete_tail_slow: 0
     rx4_csum_unnecessary: 0
     rx4_csum_unnecessary_inner: 0
     rx4_csum_none: 0
     rx4_xdp_drop: 0
     rx4_xdp_redirect: 0
     rx4_lro_packets: 0
     rx4_lro_bytes: 0
     rx4_gro_packets: 0
     rx4_gro_bytes: 0
     rx4_gro_skbs: 0
     rx4_gro_match_packets: 0
     rx4_gro_large_hds: 0
     rx4_ecn_mark: 0
     rx4_removed_vlan_packets: 0
     rx4_wqe_err: 0
     rx4_mpwqe_filler_cqes: 0
     rx4_mpwqe_filler_strides: 0
     rx4_oversize_pkts_sw_drop: 0
     rx4_buff_alloc_err: 0
     rx4_cqe_compress_blks: 0
     rx4_cqe_compress_pkts: 0
     rx4_cache_reuse: 0
     rx4_cache_full: 0
     rx4_cache_empty: 0
     rx4_cache_busy: 0
     rx4_cache_waive: 0
     rx4_cache_ext: 0
     rx4_cache_rdc: 0
     rx4_cache_alloc: 4032
     rx4_congst_umr: 0
     rx4_arfs_err: 0
     rx4_recover: 0
     rx4_pet_hdr_lookup_drop: 0
     rx4_pet_mdata_lookup_drop: 0
     rx4_tls_decrypted_packets: 0
     rx4_tls_decrypted_bytes: 0
     rx4_tls_resync_req_pkt: 0
     rx4_tls_resync_req_start: 0
     rx4_tls_resync_req_end: 0
     rx4_tls_resync_req_skip: 0
     rx4_tls_resync_res_ok: 0
     rx4_tls_resync_res_retry: 0
     rx4_tls_resync_res_skip: 0
     rx4_tls_err: 0
     rx4_xdp_tx_xmit: 0
     rx4_xdp_tx_mpwqe: 0
     rx4_xdp_tx_inlnw: 0
     rx4_xdp_tx_nops: 0
     rx4_xdp_tx_full: 0
     rx4_xdp_tx_err: 0
     rx4_xdp_tx_cqes: 0
     rx5_packets: 0
     rx5_bytes: 0
     rx5_csum_complete: 0
     rx5_csum_complete_tail: 0
     rx5_csum_complete_tail_slow: 0
     rx5_csum_unnecessary: 0
     rx5_csum_unnecessary_inner: 0
     rx5_csum_none: 0
     rx5_xdp_drop: 0
     rx5_xdp_redirect: 0
     rx5_lro_packets: 0
     rx5_lro_bytes: 0
     rx5_gro_packets: 0
     rx5_gro_bytes: 0
     rx5_gro_skbs: 0
     rx5_gro_match_packets: 0
     rx5_gro_large_hds: 0
     rx5_ecn_mark: 0
     rx5_removed_vlan_packets: 0
     rx5_wqe_err: 0
     rx5_mpwqe_filler_cqes: 0
     rx5_mpwqe_filler_strides: 0
     rx5_oversize_pkts_sw_drop: 0
     rx5_buff_alloc_err: 0
     rx5_cqe_compress_blks: 0
     rx5_cqe_compress_pkts: 0
     rx5_cache_reuse: 0
     rx5_cache_full: 0
     rx5_cache_empty: 0
     rx5_cache_busy: 0
     rx5_cache_waive: 0
     rx5_cache_ext: 0
     rx5_cache_rdc: 0
     rx5_cache_alloc: 4032
     rx5_congst_umr: 0
     rx5_arfs_err: 0
     rx5_recover: 0
     rx5_pet_hdr_lookup_drop: 0
     rx5_pet_mdata_lookup_drop: 0
     rx5_tls_decrypted_packets: 0
     rx5_tls_decrypted_bytes: 0
     rx5_tls_resync_req_pkt: 0
     rx5_tls_resync_req_start: 0
     rx5_tls_resync_req_end: 0
     rx5_tls_resync_req_skip: 0
     rx5_tls_resync_res_ok: 0
     rx5_tls_resync_res_retry: 0
     rx5_tls_resync_res_skip: 0
     rx5_tls_err: 0
     rx5_xdp_tx_xmit: 0
     rx5_xdp_tx_mpwqe: 0
     rx5_xdp_tx_inlnw: 0
     rx5_xdp_tx_nops: 0
     rx5_xdp_tx_full: 0
     rx5_xdp_tx_err: 0
     rx5_xdp_tx_cqes: 0
     rx6_packets: 0
     rx6_bytes: 0
     rx6_csum_complete: 0
     rx6_csum_complete_tail: 0
     rx6_csum_complete_tail_slow: 0
     rx6_csum_unnecessary: 0
     rx6_csum_unnecessary_inner: 0
     rx6_csum_none: 0
     rx6_xdp_drop: 0
     rx6_xdp_redirect: 0
     rx6_lro_packets: 0
     rx6_lro_bytes: 0
     rx6_gro_packets: 0
     rx6_gro_bytes: 0
     rx6_gro_skbs: 0
     rx6_gro_match_packets: 0
     rx6_gro_large_hds: 0
     rx6_ecn_mark: 0
     rx6_removed_vlan_packets: 0
     rx6_wqe_err: 0
     rx6_mpwqe_filler_cqes: 0
     rx6_mpwqe_filler_strides: 0
     rx6_oversize_pkts_sw_drop: 0
     rx6_buff_alloc_err: 0
     rx6_cqe_compress_blks: 0
     rx6_cqe_compress_pkts: 0
     rx6_cache_reuse: 0
     rx6_cache_full: 0
     rx6_cache_empty: 0
     rx6_cache_busy: 0
     rx6_cache_waive: 0
     rx6_cache_ext: 0
     rx6_cache_rdc: 0
     rx6_cache_alloc: 4032
     rx6_congst_umr: 0
     rx6_arfs_err: 0
     rx6_recover: 0
     rx6_pet_hdr_lookup_drop: 0
     rx6_pet_mdata_lookup_drop: 0
     rx6_tls_decrypted_packets: 0
     rx6_tls_decrypted_bytes: 0
     rx6_tls_resync_req_pkt: 0
     rx6_tls_resync_req_start: 0
     rx6_tls_resync_req_end: 0
     rx6_tls_resync_req_skip: 0
     rx6_tls_resync_res_ok: 0
     rx6_tls_resync_res_retry: 0
     rx6_tls_resync_res_skip: 0
     rx6_tls_err: 0
     rx6_xdp_tx_xmit: 0
     rx6_xdp_tx_mpwqe: 0
     rx6_xdp_tx_inlnw: 0
     rx6_xdp_tx_nops: 0
     rx6_xdp_tx_full: 0
     rx6_xdp_tx_err: 0
     rx6_xdp_tx_cqes: 0
     rx7_packets: 0
     rx7_bytes: 0
     rx7_csum_complete: 0
     rx7_csum_complete_tail: 0
     rx7_csum_complete_tail_slow: 0
     rx7_csum_unnecessary: 0
     rx7_csum_unnecessary_inner: 0
     rx7_csum_none: 0
     rx7_xdp_drop: 0
     rx7_xdp_redirect: 0
     rx7_lro_packets: 0
     rx7_lro_bytes: 0
     rx7_gro_packets: 0
     rx7_gro_bytes: 0
     rx7_gro_skbs: 0
     rx7_gro_match_packets: 0
     rx7_gro_large_hds: 0
     rx7_ecn_mark: 0
     rx7_removed_vlan_packets: 0
     rx7_wqe_err: 0
     rx7_mpwqe_filler_cqes: 0
     rx7_mpwqe_filler_strides: 0
     rx7_oversize_pkts_sw_drop: 0
     rx7_buff_alloc_err: 0
     rx7_cqe_compress_blks: 0
     rx7_cqe_compress_pkts: 0
     rx7_cache_reuse: 0
     rx7_cache_full: 0
     rx7_cache_empty: 0
     rx7_cache_busy: 0
     rx7_cache_waive: 0
     rx7_cache_ext: 0
     rx7_cache_rdc: 0
     rx7_cache_alloc: 4032
     rx7_congst_umr: 0
     rx7_arfs_err: 0
     rx7_recover: 0
     rx7_pet_hdr_lookup_drop: 0
     rx7_pet_mdata_lookup_drop: 0
     rx7_tls_decrypted_packets: 0
     rx7_tls_decrypted_bytes: 0
     rx7_tls_resync_req_pkt: 0
     rx7_tls_resync_req_start: 0
     rx7_tls_resync_req_end: 0
     rx7_tls_resync_req_skip: 0
     rx7_tls_resync_res_ok: 0
     rx7_tls_resync_res_retry: 0
     rx7_tls_resync_res_skip: 0
     rx7_tls_err: 0
     rx7_xdp_tx_xmit: 0
     rx7_xdp_tx_mpwqe: 0
     rx7_xdp_tx_inlnw: 0
     rx7_xdp_tx_nops: 0
     rx7_xdp_tx_full: 0
     rx7_xdp_tx_err: 0
     rx7_xdp_tx_cqes: 0
     rx8_packets: 0
     rx8_bytes: 0
     rx8_csum_complete: 0
     rx8_csum_complete_tail: 0
     rx8_csum_complete_tail_slow: 0
     rx8_csum_unnecessary: 0
     rx8_csum_unnecessary_inner: 0
     rx8_csum_none: 0
     rx8_xdp_drop: 0
     rx8_xdp_redirect: 0
     rx8_lro_packets: 0
     rx8_lro_bytes: 0
     rx8_gro_packets: 0
     rx8_gro_bytes: 0
     rx8_gro_skbs: 0
     rx8_gro_match_packets: 0
     rx8_gro_large_hds: 0
     rx8_ecn_mark: 0
     rx8_removed_vlan_packets: 0
     rx8_wqe_err: 0
     rx8_mpwqe_filler_cqes: 0
     rx8_mpwqe_filler_strides: 0
     rx8_oversize_pkts_sw_drop: 0
     rx8_buff_alloc_err: 0
     rx8_cqe_compress_blks: 0
     rx8_cqe_compress_pkts: 0
     rx8_cache_reuse: 0
     rx8_cache_full: 0
     rx8_cache_empty: 0
     rx8_cache_busy: 0
     rx8_cache_waive: 0
     rx8_cache_ext: 0
     rx8_cache_rdc: 0
     rx8_cache_alloc: 4032
     rx8_congst_umr: 0
     rx8_arfs_err: 0
     rx8_recover: 0
     rx8_pet_hdr_lookup_drop: 0
     rx8_pet_mdata_lookup_drop: 0
     rx8_tls_decrypted_packets: 0
     rx8_tls_decrypted_bytes: 0
     rx8_tls_resync_req_pkt: 0
     rx8_tls_resync_req_start: 0
     rx8_tls_resync_req_end: 0
     rx8_tls_resync_req_skip: 0
     rx8_tls_resync_res_ok: 0
     rx8_tls_resync_res_retry: 0
     rx8_tls_resync_res_skip: 0
     rx8_tls_err: 0
     rx8_xdp_tx_xmit: 0
     rx8_xdp_tx_mpwqe: 0
     rx8_xdp_tx_inlnw: 0
     rx8_xdp_tx_nops: 0
     rx8_xdp_tx_full: 0
     rx8_xdp_tx_err: 0
     rx8_xdp_tx_cqes: 0
     rx9_packets: 0
     rx9_bytes: 0
     rx9_csum_complete: 0
     rx9_csum_complete_tail: 0
     rx9_csum_complete_tail_slow: 0
     rx9_csum_unnecessary: 0
     rx9_csum_unnecessary_inner: 0
     rx9_csum_none: 0
     rx9_xdp_drop: 0
     rx9_xdp_redirect: 0
     rx9_lro_packets: 0
     rx9_lro_bytes: 0
     rx9_gro_packets: 0
     rx9_gro_bytes: 0
     rx9_gro_skbs: 0
     rx9_gro_match_packets: 0
     rx9_gro_large_hds: 0
     rx9_ecn_mark: 0
     rx9_removed_vlan_packets: 0
     rx9_wqe_err: 0
     rx9_mpwqe_filler_cqes: 0
     rx9_mpwqe_filler_strides: 0
     rx9_oversize_pkts_sw_drop: 0
     rx9_buff_alloc_err: 0
     rx9_cqe_compress_blks: 0
     rx9_cqe_compress_pkts: 0
     rx9_cache_reuse: 0
     rx9_cache_full: 0
     rx9_cache_empty: 0
     rx9_cache_busy: 0
     rx9_cache_waive: 0
     rx9_cache_ext: 0
     rx9_cache_rdc: 0
     rx9_cache_alloc: 4032
     rx9_congst_umr: 0
     rx9_arfs_err: 0
     rx9_recover: 0
     rx9_pet_hdr_lookup_drop: 0
     rx9_pet_mdata_lookup_drop: 0
     rx9_tls_decrypted_packets: 0
     rx9_tls_decrypted_bytes: 0
     rx9_tls_resync_req_pkt: 0
     rx9_tls_resync_req_start: 0
     rx9_tls_resync_req_end: 0
     rx9_tls_resync_req_skip: 0
     rx9_tls_resync_res_ok: 0
     rx9_tls_resync_res_retry: 0
     rx9_tls_resync_res_skip: 0
     rx9_tls_err: 0
     rx9_xdp_tx_xmit: 0
     rx9_xdp_tx_mpwqe: 0
     rx9_xdp_tx_inlnw: 0
     rx9_xdp_tx_nops: 0
     rx9_xdp_tx_full: 0
     rx9_xdp_tx_err: 0
     rx9_xdp_tx_cqes: 0
     rx10_packets: 0
     rx10_bytes: 0
     rx10_csum_complete: 0
     rx10_csum_complete_tail: 0
     rx10_csum_complete_tail_slow: 0
     rx10_csum_unnecessary: 0
     rx10_csum_unnecessary_inner: 0
     rx10_csum_none: 0
     rx10_xdp_drop: 0
     rx10_xdp_redirect: 0
     rx10_lro_packets: 0
     rx10_lro_bytes: 0
     rx10_gro_packets: 0
     rx10_gro_bytes: 0
     rx10_gro_skbs: 0
     rx10_gro_match_packets: 0
     rx10_gro_large_hds: 0
     rx10_ecn_mark: 0
     rx10_removed_vlan_packets: 0
     rx10_wqe_err: 0
     rx10_mpwqe_filler_cqes: 0
     rx10_mpwqe_filler_strides: 0
     rx10_oversize_pkts_sw_drop: 0
     rx10_buff_alloc_err: 0
     rx10_cqe_compress_blks: 0
     rx10_cqe_compress_pkts: 0
     rx10_cache_reuse: 0
     rx10_cache_full: 0
     rx10_cache_empty: 0
     rx10_cache_busy: 0
     rx10_cache_waive: 0
     rx10_cache_ext: 0
     rx10_cache_rdc: 0
     rx10_cache_alloc: 4032
     rx10_congst_umr: 0
     rx10_arfs_err: 0
     rx10_recover: 0
     rx10_pet_hdr_lookup_drop: 0
     rx10_pet_mdata_lookup_drop: 0
     rx10_tls_decrypted_packets: 0
     rx10_tls_decrypted_bytes: 0
     rx10_tls_resync_req_pkt: 0
     rx10_tls_resync_req_start: 0
     rx10_tls_resync_req_end: 0
     rx10_tls_resync_req_skip: 0
     rx10_tls_resync_res_ok: 0
     rx10_tls_resync_res_retry: 0
     rx10_tls_resync_res_skip: 0
     rx10_tls_err: 0
     rx10_xdp_tx_xmit: 0
     rx10_xdp_tx_mpwqe: 0
     rx10_xdp_tx_inlnw: 0
     rx10_xdp_tx_nops: 0
     rx10_xdp_tx_full: 0
     rx10_xdp_tx_err: 0
     rx10_xdp_tx_cqes: 0
     tx0_packets: 0
     tx0_bytes: 0
     tx0_tso_packets: 0
     tx0_tso_bytes: 0
     tx0_tso_inner_packets: 0
     tx0_tso_inner_bytes: 0
     tx0_csum_partial: 0
     tx0_csum_partial_inner: 0
     tx0_added_vlan_packets: 0
     tx0_nop: 0
     tx0_mpwqe_blks: 0
     tx0_mpwqe_pkts: 0
     tx0_tls_encrypted_packets: 0
     tx0_tls_encrypted_bytes: 0
     tx0_tls_ooo: 0
     tx0_tls_dump_packets: 0
     tx0_tls_dump_bytes: 0
     tx0_tls_resync_bytes: 0
     tx0_tls_skip_no_sync_data: 0
     tx0_tls_drop_no_sync_data: 0
     tx0_tls_drop_bypass_req: 0
     tx0_csum_none: 0
     tx0_stopped: 0
     tx0_dropped: 0
     tx0_xmit_more: 0
     tx0_recover: 0
     tx0_cqes: 0
     tx0_cqe_compress_blks: 0
     tx0_cqe_compress_pkts: 0
     tx0_wake: 0
     tx0_cqe_err: 0
     tx1_packets: 0
     tx1_bytes: 0
     tx1_tso_packets: 0
     tx1_tso_bytes: 0
     tx1_tso_inner_packets: 0
     tx1_tso_inner_bytes: 0
     tx1_csum_partial: 0
     tx1_csum_partial_inner: 0
     tx1_added_vlan_packets: 0
     tx1_nop: 0
     tx1_mpwqe_blks: 0
     tx1_mpwqe_pkts: 0
     tx1_tls_encrypted_packets: 0
     tx1_tls_encrypted_bytes: 0
     tx1_tls_ooo: 0
     tx1_tls_dump_packets: 0
     tx1_tls_dump_bytes: 0
     tx1_tls_resync_bytes: 0
     tx1_tls_skip_no_sync_data: 0
     tx1_tls_drop_no_sync_data: 0
     tx1_tls_drop_bypass_req: 0
     tx1_csum_none: 0
     tx1_stopped: 0
     tx1_dropped: 0
     tx1_xmit_more: 0
     tx1_recover: 0
     tx1_cqes: 0
     tx1_cqe_compress_blks: 0
     tx1_cqe_compress_pkts: 0
     tx1_wake: 0
     tx1_cqe_err: 0
     tx2_packets: 0
     tx2_bytes: 0
     tx2_tso_packets: 0
     tx2_tso_bytes: 0
     tx2_tso_inner_packets: 0
     tx2_tso_inner_bytes: 0
     tx2_csum_partial: 0
     tx2_csum_partial_inner: 0
     tx2_added_vlan_packets: 0
     tx2_nop: 0
     tx2_mpwqe_blks: 0
     tx2_mpwqe_pkts: 0
     tx2_tls_encrypted_packets: 0
     tx2_tls_encrypted_bytes: 0
     tx2_tls_ooo: 0
     tx2_tls_dump_packets: 0
     tx2_tls_dump_bytes: 0
     tx2_tls_resync_bytes: 0
     tx2_tls_skip_no_sync_data: 0
     tx2_tls_drop_no_sync_data: 0
     tx2_tls_drop_bypass_req: 0
     tx2_csum_none: 0
     tx2_stopped: 0
     tx2_dropped: 0
     tx2_xmit_more: 0
     tx2_recover: 0
     tx2_cqes: 0
     tx2_cqe_compress_blks: 0
     tx2_cqe_compress_pkts: 0
     tx2_wake: 0
     tx2_cqe_err: 0
     tx3_packets: 0
     tx3_bytes: 0
     tx3_tso_packets: 0
     tx3_tso_bytes: 0
     tx3_tso_inner_packets: 0
     tx3_tso_inner_bytes: 0
     tx3_csum_partial: 0
     tx3_csum_partial_inner: 0
     tx3_added_vlan_packets: 0
     tx3_nop: 0
     tx3_mpwqe_blks: 0
     tx3_mpwqe_pkts: 0
     tx3_tls_encrypted_packets: 0
     tx3_tls_encrypted_bytes: 0
     tx3_tls_ooo: 0
     tx3_tls_dump_packets: 0
     tx3_tls_dump_bytes: 0
     tx3_tls_resync_bytes: 0
     tx3_tls_skip_no_sync_data: 0
     tx3_tls_drop_no_sync_data: 0
     tx3_tls_drop_bypass_req: 0
     tx3_csum_none: 0
     tx3_stopped: 0
     tx3_dropped: 0
     tx3_xmit_more: 0
     tx3_recover: 0
     tx3_cqes: 0
     tx3_cqe_compress_blks: 0
     tx3_cqe_compress_pkts: 0
     tx3_wake: 0
     tx3_cqe_err: 0
     tx4_packets: 0
     tx4_bytes: 0
     tx4_tso_packets: 0
     tx4_tso_bytes: 0
     tx4_tso_inner_packets: 0
     tx4_tso_inner_bytes: 0
     tx4_csum_partial: 0
     tx4_csum_partial_inner: 0
     tx4_added_vlan_packets: 0
     tx4_nop: 0
     tx4_mpwqe_blks: 0
     tx4_mpwqe_pkts: 0
     tx4_tls_encrypted_packets: 0
     tx4_tls_encrypted_bytes: 0
     tx4_tls_ooo: 0
     tx4_tls_dump_packets: 0
     tx4_tls_dump_bytes: 0
     tx4_tls_resync_bytes: 0
     tx4_tls_skip_no_sync_data: 0
     tx4_tls_drop_no_sync_data: 0
     tx4_tls_drop_bypass_req: 0
     tx4_csum_none: 0
     tx4_stopped: 0
     tx4_dropped: 0
     tx4_xmit_more: 0
     tx4_recover: 0
     tx4_cqes: 0
     tx4_cqe_compress_blks: 0
     tx4_cqe_compress_pkts: 0
     tx4_wake: 0
     tx4_cqe_err: 0
     tx5_packets: 0
     tx5_bytes: 0
     tx5_tso_packets: 0
     tx5_tso_bytes: 0
     tx5_tso_inner_packets: 0
     tx5_tso_inner_bytes: 0
     tx5_csum_partial: 0
     tx5_csum_partial_inner: 0
     tx5_added_vlan_packets: 0
     tx5_nop: 0
     tx5_mpwqe_blks: 0
     tx5_mpwqe_pkts: 0
     tx5_tls_encrypted_packets: 0
     tx5_tls_encrypted_bytes: 0
     tx5_tls_ooo: 0
     tx5_tls_dump_packets: 0
     tx5_tls_dump_bytes: 0
     tx5_tls_resync_bytes: 0
     tx5_tls_skip_no_sync_data: 0
     tx5_tls_drop_no_sync_data: 0
     tx5_tls_drop_bypass_req: 0
     tx5_csum_none: 0
     tx5_stopped: 0
     tx5_dropped: 0
     tx5_xmit_more: 0
     tx5_recover: 0
     tx5_cqes: 0
     tx5_cqe_compress_blks: 0
     tx5_cqe_compress_pkts: 0
     tx5_wake: 0
     tx5_cqe_err: 0
     tx6_packets: 0
     tx6_bytes: 0
     tx6_tso_packets: 0
     tx6_tso_bytes: 0
     tx6_tso_inner_packets: 0
     tx6_tso_inner_bytes: 0
     tx6_csum_partial: 0
     tx6_csum_partial_inner: 0
     tx6_added_vlan_packets: 0
     tx6_nop: 0
     tx6_mpwqe_blks: 0
     tx6_mpwqe_pkts: 0
     tx6_tls_encrypted_packets: 0
     tx6_tls_encrypted_bytes: 0
     tx6_tls_ooo: 0
     tx6_tls_dump_packets: 0
     tx6_tls_dump_bytes: 0
     tx6_tls_resync_bytes: 0
     tx6_tls_skip_no_sync_data: 0
     tx6_tls_drop_no_sync_data: 0
     tx6_tls_drop_bypass_req: 0
     tx6_csum_none: 0
     tx6_stopped: 0
     tx6_dropped: 0
     tx6_xmit_more: 0
     tx6_recover: 0
     tx6_cqes: 0
     tx6_cqe_compress_blks: 0
     tx6_cqe_compress_pkts: 0
     tx6_wake: 0
     tx6_cqe_err: 0
     tx7_packets: 0
     tx7_bytes: 0
     tx7_tso_packets: 0
     tx7_tso_bytes: 0
     tx7_tso_inner_packets: 0
     tx7_tso_inner_bytes: 0
     tx7_csum_partial: 0
     tx7_csum_partial_inner: 0
     tx7_added_vlan_packets: 0
     tx7_nop: 0
     tx7_mpwqe_blks: 0
     tx7_mpwqe_pkts: 0
     tx7_tls_encrypted_packets: 0
     tx7_tls_encrypted_bytes: 0
     tx7_tls_ooo: 0
     tx7_tls_dump_packets: 0
     tx7_tls_dump_bytes: 0
     tx7_tls_resync_bytes: 0
     tx7_tls_skip_no_sync_data: 0
     tx7_tls_drop_no_sync_data: 0
     tx7_tls_drop_bypass_req: 0
     tx7_csum_none: 0
     tx7_stopped: 0
     tx7_dropped: 0
     tx7_xmit_more: 0
     tx7_recover: 0
     tx7_cqes: 0
     tx7_cqe_compress_blks: 0
     tx7_cqe_compress_pkts: 0
     tx7_wake: 0
     tx7_cqe_err: 0
     tx8_packets: 11
     tx8_bytes: 866
     tx8_tso_packets: 0
     tx8_tso_bytes: 0
     tx8_tso_inner_packets: 0
     tx8_tso_inner_bytes: 0
     tx8_csum_partial: 0
     tx8_csum_partial_inner: 0
     tx8_added_vlan_packets: 0
     tx8_nop: 0
     tx8_mpwqe_blks: 11
     tx8_mpwqe_pkts: 11
     tx8_tls_encrypted_packets: 0
     tx8_tls_encrypted_bytes: 0
     tx8_tls_ooo: 0
     tx8_tls_dump_packets: 0
     tx8_tls_dump_bytes: 0
     tx8_tls_resync_bytes: 0
     tx8_tls_skip_no_sync_data: 0
     tx8_tls_drop_no_sync_data: 0
     tx8_tls_drop_bypass_req: 0
     tx8_csum_none: 11
     tx8_stopped: 0
     tx8_dropped: 0
     tx8_xmit_more: 0
     tx8_recover: 0
     tx8_cqes: 11
     tx8_cqe_compress_blks: 0
     tx8_cqe_compress_pkts: 0
     tx8_wake: 0
     tx8_cqe_err: 0
     tx9_packets: 0
     tx9_bytes: 0
     tx9_tso_packets: 0
     tx9_tso_bytes: 0
     tx9_tso_inner_packets: 0
     tx9_tso_inner_bytes: 0
     tx9_csum_partial: 0
     tx9_csum_partial_inner: 0
     tx9_added_vlan_packets: 0
     tx9_nop: 0
     tx9_mpwqe_blks: 0
     tx9_mpwqe_pkts: 0
     tx9_tls_encrypted_packets: 0
     tx9_tls_encrypted_bytes: 0
     tx9_tls_ooo: 0
     tx9_tls_dump_packets: 0
     tx9_tls_dump_bytes: 0
     tx9_tls_resync_bytes: 0
     tx9_tls_skip_no_sync_data: 0
     tx9_tls_drop_no_sync_data: 0
     tx9_tls_drop_bypass_req: 0
     tx9_csum_none: 0
     tx9_stopped: 0
     tx9_dropped: 0
     tx9_xmit_more: 0
     tx9_recover: 0
     tx9_cqes: 0
     tx9_cqe_compress_blks: 0
     tx9_cqe_compress_pkts: 0
     tx9_wake: 0
     tx9_cqe_err: 0
     tx10_packets: 0
     tx10_bytes: 0
     tx10_tso_packets: 0
     tx10_tso_bytes: 0
     tx10_tso_inner_packets: 0
     tx10_tso_inner_bytes: 0
     tx10_csum_partial: 0
     tx10_csum_partial_inner: 0
     tx10_added_vlan_packets: 0
     tx10_nop: 0
     tx10_mpwqe_blks: 0
     tx10_mpwqe_pkts: 0
     tx10_tls_encrypted_packets: 0
     tx10_tls_encrypted_bytes: 0
     tx10_tls_ooo: 0
     tx10_tls_dump_packets: 0
     tx10_tls_dump_bytes: 0
     tx10_tls_resync_bytes: 0
     tx10_tls_skip_no_sync_data: 0
     tx10_tls_drop_no_sync_data: 0
     tx10_tls_drop_bypass_req: 0
     tx10_csum_none: 0
     tx10_stopped: 0
     tx10_dropped: 0
     tx10_xmit_more: 0
     tx10_recover: 0
     tx10_cqes: 0
     tx10_cqe_compress_blks: 0
     tx10_cqe_compress_pkts: 0
     tx10_wake: 0
     tx10_cqe_err: 0
     tx0_xdp_xmit: 0
     tx0_xdp_mpwqe: 0
     tx0_xdp_inlnw: 0
     tx0_xdp_nops: 0
     tx0_xdp_full: 0
     tx0_xdp_err: 0
     tx0_xdp_cqes: 0
     tx1_xdp_xmit: 0
     tx1_xdp_mpwqe: 0
     tx1_xdp_inlnw: 0
     tx1_xdp_nops: 0
     tx1_xdp_full: 0
     tx1_xdp_err: 0
     tx1_xdp_cqes: 0
     tx2_xdp_xmit: 0
     tx2_xdp_mpwqe: 0
     tx2_xdp_inlnw: 0
     tx2_xdp_nops: 0
     tx2_xdp_full: 0
     tx2_xdp_err: 0
     tx2_xdp_cqes: 0
     tx3_xdp_xmit: 0
     tx3_xdp_mpwqe: 0
     tx3_xdp_inlnw: 0
     tx3_xdp_nops: 0
     tx3_xdp_full: 0
     tx3_xdp_err: 0
     tx3_xdp_cqes: 0
     tx4_xdp_xmit: 0
     tx4_xdp_mpwqe: 0
     tx4_xdp_inlnw: 0
     tx4_xdp_nops: 0
     tx4_xdp_full: 0
     tx4_xdp_err: 0
     tx4_xdp_cqes: 0
     tx5_xdp_xmit: 0
     tx5_xdp_mpwqe: 0
     tx5_xdp_inlnw: 0
     tx5_xdp_nops: 0
     tx5_xdp_full: 0
     tx5_xdp_err: 0
     tx5_xdp_cqes: 0
     tx6_xdp_xmit: 0
     tx6_xdp_mpwqe: 0
     tx6_xdp_inlnw: 0
     tx6_xdp_nops: 0
     tx6_xdp_full: 0
     tx6_xdp_err: 0
     tx6_xdp_cqes: 0
     tx7_xdp_xmit: 0
     tx7_xdp_mpwqe: 0
     tx7_xdp_inlnw: 0
     tx7_xdp_nops: 0
     tx7_xdp_full: 0
     tx7_xdp_err: 0
     tx7_xdp_cqes: 0
     tx8_xdp_xmit: 0
     tx8_xdp_mpwqe: 0
     tx8_xdp_inlnw: 0
     tx8_xdp_nops: 0
     tx8_xdp_full: 0
     tx8_xdp_err: 0
     tx8_xdp_cqes: 0
     tx9_xdp_xmit: 0
     tx9_xdp_mpwqe: 0
     tx9_xdp_inlnw: 0
     tx9_xdp_nops: 0
     tx9_xdp_full: 0
     tx9_xdp_err: 0
     tx9_xdp_cqes: 0
     tx10_xdp_xmit: 0
     tx10_xdp_mpwqe: 0
     tx10_xdp_inlnw: 0
     tx10_xdp_nops: 0
     tx10_xdp_full: 0
     tx10_xdp_err: 0
     tx10_xdp_cqes: 0

[-- Attachment #3: ens2f0np0v0_before --]
[-- Type: text/plain, Size: 5973 bytes --]

NIC statistics:
     rx_packets: 0
     rx_bytes: 0
     tx_packets: 0
     tx_bytes: 0
     tx_tso_packets: 0
     tx_tso_bytes: 0
     tx_tso_inner_packets: 0
     tx_tso_inner_bytes: 0
     tx_added_vlan_packets: 0
     tx_nop: 0
     tx_mpwqe_blks: 0
     tx_mpwqe_pkts: 0
     tx_tls_encrypted_packets: 0
     tx_tls_encrypted_bytes: 0
     tx_tls_ooo: 0
     tx_tls_dump_packets: 0
     tx_tls_dump_bytes: 0
     tx_tls_resync_bytes: 0
     tx_tls_skip_no_sync_data: 0
     tx_tls_drop_no_sync_data: 0
     tx_tls_drop_bypass_req: 0
     rx_lro_packets: 0
     rx_lro_bytes: 0
     rx_gro_packets: 0
     rx_gro_bytes: 0
     rx_gro_skbs: 0
     rx_gro_match_packets: 0
     rx_gro_large_hds: 0
     rx_ecn_mark: 0
     rx_removed_vlan_packets: 0
     rx_csum_unnecessary: 0
     rx_csum_none: 0
     rx_csum_complete: 0
     rx_csum_complete_tail: 0
     rx_csum_complete_tail_slow: 0
     rx_csum_unnecessary_inner: 0
     rx_xdp_drop: 0
     rx_xdp_redirect: 0
     rx_xdp_tx_xmit: 0
     rx_xdp_tx_mpwqe: 0
     rx_xdp_tx_inlnw: 0
     rx_xdp_tx_nops: 0
     rx_xdp_tx_full: 0
     rx_xdp_tx_err: 0
     rx_xdp_tx_cqe: 0
     tx_csum_none: 0
     tx_csum_partial: 0
     tx_csum_partial_inner: 0
     tx_queue_stopped: 0
     tx_queue_dropped: 0
     tx_xmit_more: 0
     tx_recover: 0
     tx_cqes: 0
     tx_queue_wake: 0
     tx_cqe_err: 0
     tx_xdp_xmit: 0
     tx_xdp_mpwqe: 0
     tx_xdp_inlnw: 0
     tx_xdp_nops: 0
     tx_xdp_full: 0
     tx_xdp_err: 0
     tx_xdp_cqes: 0
     tx_cqe_compress_blks: 0
     tx_cqe_compress_pkts: 0
     rx_wqe_err: 0
     rx_mpwqe_filler_cqes: 0
     rx_mpwqe_filler_strides: 0
     rx_oversize_pkts_sw_drop: 0
     rx_buff_alloc_err: 0
     rx_cqe_compress_blks: 0
     rx_cqe_compress_pkts: 0
     rx_cache_reuse: 0
     rx_cache_full: 0
     rx_cache_empty: 0
     rx_cache_busy: 0
     rx_cache_ext: 0
     rx_cache_rdc: 0
     rx_cache_alloc: 0
     rx_cache_waive: 0
     rx_congst_umr: 0
     rx_arfs_err: 0
     rx_recover: 0
     rx_pet_hdr_lookup_drop: 0
     rx_pet_mdata_lookup_drop: 0
     rx_tls_decrypted_packets: 0
     rx_tls_decrypted_bytes: 0
     rx_tls_resync_req_pkt: 0
     rx_tls_resync_req_start: 0
     rx_tls_resync_req_end: 0
     rx_tls_resync_req_skip: 0
     rx_tls_resync_res_ok: 0
     rx_tls_resync_res_retry: 0
     rx_tls_resync_res_skip: 0
     rx_tls_err: 0
     ch_events: 0
     ch_poll: 0
     ch_arm: 0
     ch_aff_change: 0
     ch_force_irq: 0
     ch_eq_rearm: 0
     rx_xsk_packets: 0
     rx_xsk_bytes: 0
     rx_xsk_csum_complete: 0
     rx_xsk_csum_unnecessary: 0
     rx_xsk_csum_unnecessary_inner: 0
     rx_xsk_csum_none: 0
     rx_xsk_ecn_mark: 0
     rx_xsk_removed_vlan_packets: 0
     rx_xsk_xdp_drop: 0
     rx_xsk_xdp_redirect: 0
     rx_xsk_wqe_err: 0
     rx_xsk_mpwqe_filler_cqes: 0
     rx_xsk_mpwqe_filler_strides: 0
     rx_xsk_oversize_pkts_sw_drop: 0
     rx_xsk_buff_alloc_err: 0
     rx_xsk_cqe_compress_blks: 0
     rx_xsk_cqe_compress_pkts: 0
     rx_xsk_congst_umr: 0
     rx_xsk_arfs_err: 0
     tx_xsk_xmit: 0
     tx_xsk_mpwqe: 0
     tx_xsk_inlnw: 0
     tx_xsk_full: 0
     tx_xsk_err: 0
     tx_xsk_cqes: 0
     rx_out_of_buffer: 0
     rx_if_down_packets: 0
     rx_steer_missed_packets: 0
     rx_vport_unicast_packets: 0
     rx_vport_unicast_bytes: 0
     tx_vport_unicast_packets: 0
     tx_vport_unicast_bytes: 0
     rx_vport_multicast_packets: 0
     rx_vport_multicast_bytes: 0
     tx_vport_multicast_packets: 0
     tx_vport_multicast_bytes: 0
     rx_vport_broadcast_packets: 0
     rx_vport_broadcast_bytes: 0
     tx_vport_broadcast_packets: 0
     tx_vport_broadcast_bytes: 0
     rx_vport_rdma_unicast_packets: 0
     rx_vport_rdma_unicast_bytes: 0
     tx_vport_rdma_unicast_packets: 0
     tx_vport_rdma_unicast_bytes: 0
     rx_vport_rdma_multicast_packets: 0
     rx_vport_rdma_multicast_bytes: 0
     tx_vport_rdma_multicast_packets: 0
     tx_vport_rdma_multicast_bytes: 0
     tx_packets_phy: 0
     rx_packets_phy: 0
     rx_crc_errors_phy: 0
     tx_bytes_phy: 0
     rx_bytes_phy: 0
     tx_multicast_phy: 0
     tx_broadcast_phy: 0
     rx_multicast_phy: 0
     rx_broadcast_phy: 0
     rx_in_range_len_errors_phy: 0
     rx_out_of_range_len_phy: 0
     rx_oversize_pkts_phy: 0
     rx_symbol_err_phy: 0
     tx_mac_control_phy: 0
     rx_mac_control_phy: 0
     rx_unsupported_op_phy: 0
     rx_pause_ctrl_phy: 0
     tx_pause_ctrl_phy: 0
     rx_discards_phy: 0
     tx_discards_phy: 0
     tx_errors_phy: 0
     rx_undersize_pkts_phy: 0
     rx_fragments_phy: 0
     rx_jabbers_phy: 0
     rx_64_bytes_phy: 0
     rx_65_to_127_bytes_phy: 0
     rx_128_to_255_bytes_phy: 0
     rx_256_to_511_bytes_phy: 0
     rx_512_to_1023_bytes_phy: 0
     rx_1024_to_1518_bytes_phy: 0
     rx_1519_to_2047_bytes_phy: 0
     rx_2048_to_4095_bytes_phy: 0
     rx_4096_to_8191_bytes_phy: 0
     rx_8192_to_10239_bytes_phy: 0
     link_down_events_phy: 0
     rx_prio0_bytes: 0
     rx_prio0_packets: 0
     rx_prio0_discards: 0
     tx_prio0_bytes: 0
     tx_prio0_packets: 0
     rx_prio1_bytes: 0
     rx_prio1_packets: 0
     rx_prio1_discards: 0
     tx_prio1_bytes: 0
     tx_prio1_packets: 0
     rx_prio2_bytes: 0
     rx_prio2_packets: 0
     rx_prio2_discards: 0
     tx_prio2_bytes: 0
     tx_prio2_packets: 0
     rx_prio3_bytes: 0
     rx_prio3_packets: 0
     rx_prio3_discards: 0
     tx_prio3_bytes: 0
     tx_prio3_packets: 0
     rx_prio4_bytes: 0
     rx_prio4_packets: 0
     rx_prio4_discards: 0
     tx_prio4_bytes: 0
     tx_prio4_packets: 0
     rx_prio5_bytes: 0
     rx_prio5_packets: 0
     rx_prio5_discards: 0
     tx_prio5_bytes: 0
     tx_prio5_packets: 0
     rx_prio6_bytes: 0
     rx_prio6_packets: 0
     rx_prio6_discards: 0
     tx_prio6_bytes: 0
     tx_prio6_packets: 0
     rx_prio7_bytes: 0
     rx_prio7_packets: 0
     rx_prio7_discards: 0
     tx_prio7_bytes: 0
     tx_prio7_packets: 0
     module_unplug: 0
     module_bus_stuck: 0
     module_high_temp: 0
     module_bad_shorted: 0

[-- Attachment #4: ens2f0np0v1_after --]
[-- Type: text/plain, Size: 33972 bytes --]

NIC statistics:
     rx_packets: 0
     rx_bytes: 0
     tx_packets: 11
     tx_bytes: 866
     tx_tso_packets: 0
     tx_tso_bytes: 0
     tx_tso_inner_packets: 0
     tx_tso_inner_bytes: 0
     tx_added_vlan_packets: 0
     tx_nop: 0
     tx_mpwqe_blks: 11
     tx_mpwqe_pkts: 11
     tx_tls_encrypted_packets: 0
     tx_tls_encrypted_bytes: 0
     tx_tls_ooo: 0
     tx_tls_dump_packets: 0
     tx_tls_dump_bytes: 0
     tx_tls_resync_bytes: 0
     tx_tls_skip_no_sync_data: 0
     tx_tls_drop_no_sync_data: 0
     tx_tls_drop_bypass_req: 0
     rx_lro_packets: 0
     rx_lro_bytes: 0
     rx_gro_packets: 0
     rx_gro_bytes: 0
     rx_gro_skbs: 0
     rx_gro_match_packets: 0
     rx_gro_large_hds: 0
     rx_ecn_mark: 0
     rx_removed_vlan_packets: 0
     rx_csum_unnecessary: 0
     rx_csum_none: 0
     rx_csum_complete: 0
     rx_csum_complete_tail: 0
     rx_csum_complete_tail_slow: 0
     rx_csum_unnecessary_inner: 0
     rx_xdp_drop: 0
     rx_xdp_redirect: 0
     rx_xdp_tx_xmit: 0
     rx_xdp_tx_mpwqe: 0
     rx_xdp_tx_inlnw: 0
     rx_xdp_tx_nops: 0
     rx_xdp_tx_full: 0
     rx_xdp_tx_err: 0
     rx_xdp_tx_cqe: 0
     tx_csum_none: 11
     tx_csum_partial: 0
     tx_csum_partial_inner: 0
     tx_queue_stopped: 0
     tx_queue_dropped: 0
     tx_xmit_more: 0
     tx_recover: 0
     tx_cqes: 11
     tx_queue_wake: 0
     tx_cqe_err: 0
     tx_xdp_xmit: 0
     tx_xdp_mpwqe: 0
     tx_xdp_inlnw: 0
     tx_xdp_nops: 0
     tx_xdp_full: 0
     tx_xdp_err: 0
     tx_xdp_cqes: 0
     tx_cqe_compress_blks: 0
     tx_cqe_compress_pkts: 0
     rx_wqe_err: 0
     rx_mpwqe_filler_cqes: 0
     rx_mpwqe_filler_strides: 0
     rx_oversize_pkts_sw_drop: 0
     rx_buff_alloc_err: 0
     rx_cqe_compress_blks: 0
     rx_cqe_compress_pkts: 0
     rx_cache_reuse: 0
     rx_cache_full: 0
     rx_cache_empty: 0
     rx_cache_busy: 0
     rx_cache_ext: 0
     rx_cache_rdc: 0
     rx_cache_alloc: 44352
     rx_cache_waive: 0
     rx_congst_umr: 0
     rx_arfs_err: 0
     rx_recover: 0
     rx_pet_hdr_lookup_drop: 0
     rx_pet_mdata_lookup_drop: 0
     rx_tls_decrypted_packets: 0
     rx_tls_decrypted_bytes: 0
     rx_tls_resync_req_pkt: 0
     rx_tls_resync_req_start: 0
     rx_tls_resync_req_end: 0
     rx_tls_resync_req_skip: 0
     rx_tls_resync_res_ok: 0
     rx_tls_resync_res_retry: 0
     rx_tls_resync_res_skip: 0
     rx_tls_err: 0
     ch_events: 32
     ch_poll: 32
     ch_arm: 32
     ch_aff_change: 0
     ch_force_irq: 0
     ch_eq_rearm: 0
     rx_xsk_packets: 0
     rx_xsk_bytes: 0
     rx_xsk_csum_complete: 0
     rx_xsk_csum_unnecessary: 0
     rx_xsk_csum_unnecessary_inner: 0
     rx_xsk_csum_none: 0
     rx_xsk_ecn_mark: 0
     rx_xsk_removed_vlan_packets: 0
     rx_xsk_xdp_drop: 0
     rx_xsk_xdp_redirect: 0
     rx_xsk_wqe_err: 0
     rx_xsk_mpwqe_filler_cqes: 0
     rx_xsk_mpwqe_filler_strides: 0
     rx_xsk_oversize_pkts_sw_drop: 0
     rx_xsk_buff_alloc_err: 0
     rx_xsk_cqe_compress_blks: 0
     rx_xsk_cqe_compress_pkts: 0
     rx_xsk_congst_umr: 0
     rx_xsk_arfs_err: 0
     tx_xsk_xmit: 0
     tx_xsk_mpwqe: 0
     tx_xsk_inlnw: 0
     tx_xsk_full: 0
     tx_xsk_err: 0
     tx_xsk_cqes: 0
     rx_out_of_buffer: 0
     rx_if_down_packets: 0
     rx_steer_missed_packets: 6439
     rx_vport_unicast_packets: 7536956
     rx_vport_unicast_bytes: 11305434000
     tx_vport_unicast_packets: 0
     tx_vport_unicast_bytes: 0
     rx_vport_multicast_packets: 1
     rx_vport_multicast_bytes: 86
     tx_vport_multicast_packets: 11
     tx_vport_multicast_bytes: 866
     rx_vport_broadcast_packets: 0
     rx_vport_broadcast_bytes: 0
     tx_vport_broadcast_packets: 0
     tx_vport_broadcast_bytes: 0
     rx_vport_rdma_unicast_packets: 0
     rx_vport_rdma_unicast_bytes: 0
     tx_vport_rdma_unicast_packets: 0
     tx_vport_rdma_unicast_bytes: 0
     rx_vport_rdma_multicast_packets: 0
     rx_vport_rdma_multicast_bytes: 0
     tx_vport_rdma_multicast_packets: 0
     tx_vport_rdma_multicast_bytes: 0
     tx_packets_phy: 0
     rx_packets_phy: 0
     rx_crc_errors_phy: 0
     tx_bytes_phy: 0
     rx_bytes_phy: 0
     tx_multicast_phy: 0
     tx_broadcast_phy: 0
     rx_multicast_phy: 0
     rx_broadcast_phy: 0
     rx_in_range_len_errors_phy: 0
     rx_out_of_range_len_phy: 0
     rx_oversize_pkts_phy: 0
     rx_symbol_err_phy: 0
     tx_mac_control_phy: 0
     rx_mac_control_phy: 0
     rx_unsupported_op_phy: 0
     rx_pause_ctrl_phy: 0
     tx_pause_ctrl_phy: 0
     rx_discards_phy: 0
     tx_discards_phy: 0
     tx_errors_phy: 0
     rx_undersize_pkts_phy: 0
     rx_fragments_phy: 0
     rx_jabbers_phy: 0
     rx_64_bytes_phy: 0
     rx_65_to_127_bytes_phy: 0
     rx_128_to_255_bytes_phy: 0
     rx_256_to_511_bytes_phy: 0
     rx_512_to_1023_bytes_phy: 0
     rx_1024_to_1518_bytes_phy: 0
     rx_1519_to_2047_bytes_phy: 0
     rx_2048_to_4095_bytes_phy: 0
     rx_4096_to_8191_bytes_phy: 0
     rx_8192_to_10239_bytes_phy: 0
     link_down_events_phy: 0
     rx_prio0_bytes: 0
     rx_prio0_packets: 0
     rx_prio0_discards: 0
     tx_prio0_bytes: 0
     tx_prio0_packets: 0
     rx_prio1_bytes: 0
     rx_prio1_packets: 0
     rx_prio1_discards: 0
     tx_prio1_bytes: 0
     tx_prio1_packets: 0
     rx_prio2_bytes: 0
     rx_prio2_packets: 0
     rx_prio2_discards: 0
     tx_prio2_bytes: 0
     tx_prio2_packets: 0
     rx_prio3_bytes: 0
     rx_prio3_packets: 0
     rx_prio3_discards: 0
     tx_prio3_bytes: 0
     tx_prio3_packets: 0
     rx_prio4_bytes: 0
     rx_prio4_packets: 0
     rx_prio4_discards: 0
     tx_prio4_bytes: 0
     tx_prio4_packets: 0
     rx_prio5_bytes: 0
     rx_prio5_packets: 0
     rx_prio5_discards: 0
     tx_prio5_bytes: 0
     tx_prio5_packets: 0
     rx_prio6_bytes: 0
     rx_prio6_packets: 0
     rx_prio6_discards: 0
     tx_prio6_bytes: 0
     tx_prio6_packets: 0
     rx_prio7_bytes: 0
     rx_prio7_packets: 0
     rx_prio7_discards: 0
     tx_prio7_bytes: 0
     tx_prio7_packets: 0
     module_unplug: 0
     module_bus_stuck: 0
     module_high_temp: 0
     module_bad_shorted: 0
     ch0_events: 2
     ch0_poll: 2
     ch0_arm: 2
     ch0_aff_change: 0
     ch0_force_irq: 0
     ch0_eq_rearm: 0
     ch1_events: 2
     ch1_poll: 2
     ch1_arm: 2
     ch1_aff_change: 0
     ch1_force_irq: 0
     ch1_eq_rearm: 0
     ch2_events: 2
     ch2_poll: 2
     ch2_arm: 2
     ch2_aff_change: 0
     ch2_force_irq: 0
     ch2_eq_rearm: 0
     ch3_events: 2
     ch3_poll: 2
     ch3_arm: 2
     ch3_aff_change: 0
     ch3_force_irq: 0
     ch3_eq_rearm: 0
     ch4_events: 2
     ch4_poll: 2
     ch4_arm: 2
     ch4_aff_change: 0
     ch4_force_irq: 0
     ch4_eq_rearm: 0
     ch5_events: 2
     ch5_poll: 2
     ch5_arm: 2
     ch5_aff_change: 0
     ch5_force_irq: 0
     ch5_eq_rearm: 0
     ch6_events: 2
     ch6_poll: 2
     ch6_arm: 2
     ch6_aff_change: 0
     ch6_force_irq: 0
     ch6_eq_rearm: 0
     ch7_events: 2
     ch7_poll: 2
     ch7_arm: 2
     ch7_aff_change: 0
     ch7_force_irq: 0
     ch7_eq_rearm: 0
     ch8_events: 12
     ch8_poll: 12
     ch8_arm: 12
     ch8_aff_change: 0
     ch8_force_irq: 0
     ch8_eq_rearm: 0
     ch9_events: 2
     ch9_poll: 2
     ch9_arm: 2
     ch9_aff_change: 0
     ch9_force_irq: 0
     ch9_eq_rearm: 0
     ch10_events: 2
     ch10_poll: 2
     ch10_arm: 2
     ch10_aff_change: 0
     ch10_force_irq: 0
     ch10_eq_rearm: 0
     rx0_packets: 0
     rx0_bytes: 0
     rx0_csum_complete: 0
     rx0_csum_complete_tail: 0
     rx0_csum_complete_tail_slow: 0
     rx0_csum_unnecessary: 0
     rx0_csum_unnecessary_inner: 0
     rx0_csum_none: 0
     rx0_xdp_drop: 0
     rx0_xdp_redirect: 0
     rx0_lro_packets: 0
     rx0_lro_bytes: 0
     rx0_gro_packets: 0
     rx0_gro_bytes: 0
     rx0_gro_skbs: 0
     rx0_gro_match_packets: 0
     rx0_gro_large_hds: 0
     rx0_ecn_mark: 0
     rx0_removed_vlan_packets: 0
     rx0_wqe_err: 0
     rx0_mpwqe_filler_cqes: 0
     rx0_mpwqe_filler_strides: 0
     rx0_oversize_pkts_sw_drop: 0
     rx0_buff_alloc_err: 0
     rx0_cqe_compress_blks: 0
     rx0_cqe_compress_pkts: 0
     rx0_cache_reuse: 0
     rx0_cache_full: 0
     rx0_cache_empty: 0
     rx0_cache_busy: 0
     rx0_cache_waive: 0
     rx0_cache_ext: 0
     rx0_cache_rdc: 0
     rx0_cache_alloc: 4032
     rx0_congst_umr: 0
     rx0_arfs_err: 0
     rx0_recover: 0
     rx0_pet_hdr_lookup_drop: 0
     rx0_pet_mdata_lookup_drop: 0
     rx0_tls_decrypted_packets: 0
     rx0_tls_decrypted_bytes: 0
     rx0_tls_resync_req_pkt: 0
     rx0_tls_resync_req_start: 0
     rx0_tls_resync_req_end: 0
     rx0_tls_resync_req_skip: 0
     rx0_tls_resync_res_ok: 0
     rx0_tls_resync_res_retry: 0
     rx0_tls_resync_res_skip: 0
     rx0_tls_err: 0
     rx0_xdp_tx_xmit: 0
     rx0_xdp_tx_mpwqe: 0
     rx0_xdp_tx_inlnw: 0
     rx0_xdp_tx_nops: 0
     rx0_xdp_tx_full: 0
     rx0_xdp_tx_err: 0
     rx0_xdp_tx_cqes: 0
     rx1_packets: 0
     rx1_bytes: 0
     rx1_csum_complete: 0
     rx1_csum_complete_tail: 0
     rx1_csum_complete_tail_slow: 0
     rx1_csum_unnecessary: 0
     rx1_csum_unnecessary_inner: 0
     rx1_csum_none: 0
     rx1_xdp_drop: 0
     rx1_xdp_redirect: 0
     rx1_lro_packets: 0
     rx1_lro_bytes: 0
     rx1_gro_packets: 0
     rx1_gro_bytes: 0
     rx1_gro_skbs: 0
     rx1_gro_match_packets: 0
     rx1_gro_large_hds: 0
     rx1_ecn_mark: 0
     rx1_removed_vlan_packets: 0
     rx1_wqe_err: 0
     rx1_mpwqe_filler_cqes: 0
     rx1_mpwqe_filler_strides: 0
     rx1_oversize_pkts_sw_drop: 0
     rx1_buff_alloc_err: 0
     rx1_cqe_compress_blks: 0
     rx1_cqe_compress_pkts: 0
     rx1_cache_reuse: 0
     rx1_cache_full: 0
     rx1_cache_empty: 0
     rx1_cache_busy: 0
     rx1_cache_waive: 0
     rx1_cache_ext: 0
     rx1_cache_rdc: 0
     rx1_cache_alloc: 4032
     rx1_congst_umr: 0
     rx1_arfs_err: 0
     rx1_recover: 0
     rx1_pet_hdr_lookup_drop: 0
     rx1_pet_mdata_lookup_drop: 0
     rx1_tls_decrypted_packets: 0
     rx1_tls_decrypted_bytes: 0
     rx1_tls_resync_req_pkt: 0
     rx1_tls_resync_req_start: 0
     rx1_tls_resync_req_end: 0
     rx1_tls_resync_req_skip: 0
     rx1_tls_resync_res_ok: 0
     rx1_tls_resync_res_retry: 0
     rx1_tls_resync_res_skip: 0
     rx1_tls_err: 0
     rx1_xdp_tx_xmit: 0
     rx1_xdp_tx_mpwqe: 0
     rx1_xdp_tx_inlnw: 0
     rx1_xdp_tx_nops: 0
     rx1_xdp_tx_full: 0
     rx1_xdp_tx_err: 0
     rx1_xdp_tx_cqes: 0
     rx2_packets: 0
     rx2_bytes: 0
     rx2_csum_complete: 0
     rx2_csum_complete_tail: 0
     rx2_csum_complete_tail_slow: 0
     rx2_csum_unnecessary: 0
     rx2_csum_unnecessary_inner: 0
     rx2_csum_none: 0
     rx2_xdp_drop: 0
     rx2_xdp_redirect: 0
     rx2_lro_packets: 0
     rx2_lro_bytes: 0
     rx2_gro_packets: 0
     rx2_gro_bytes: 0
     rx2_gro_skbs: 0
     rx2_gro_match_packets: 0
     rx2_gro_large_hds: 0
     rx2_ecn_mark: 0
     rx2_removed_vlan_packets: 0
     rx2_wqe_err: 0
     rx2_mpwqe_filler_cqes: 0
     rx2_mpwqe_filler_strides: 0
     rx2_oversize_pkts_sw_drop: 0
     rx2_buff_alloc_err: 0
     rx2_cqe_compress_blks: 0
     rx2_cqe_compress_pkts: 0
     rx2_cache_reuse: 0
     rx2_cache_full: 0
     rx2_cache_empty: 0
     rx2_cache_busy: 0
     rx2_cache_waive: 0
     rx2_cache_ext: 0
     rx2_cache_rdc: 0
     rx2_cache_alloc: 4032
     rx2_congst_umr: 0
     rx2_arfs_err: 0
     rx2_recover: 0
     rx2_pet_hdr_lookup_drop: 0
     rx2_pet_mdata_lookup_drop: 0
     rx2_tls_decrypted_packets: 0
     rx2_tls_decrypted_bytes: 0
     rx2_tls_resync_req_pkt: 0
     rx2_tls_resync_req_start: 0
     rx2_tls_resync_req_end: 0
     rx2_tls_resync_req_skip: 0
     rx2_tls_resync_res_ok: 0
     rx2_tls_resync_res_retry: 0
     rx2_tls_resync_res_skip: 0
     rx2_tls_err: 0
     rx2_xdp_tx_xmit: 0
     rx2_xdp_tx_mpwqe: 0
     rx2_xdp_tx_inlnw: 0
     rx2_xdp_tx_nops: 0
     rx2_xdp_tx_full: 0
     rx2_xdp_tx_err: 0
     rx2_xdp_tx_cqes: 0
     rx3_packets: 0
     rx3_bytes: 0
     rx3_csum_complete: 0
     rx3_csum_complete_tail: 0
     rx3_csum_complete_tail_slow: 0
     rx3_csum_unnecessary: 0
     rx3_csum_unnecessary_inner: 0
     rx3_csum_none: 0
     rx3_xdp_drop: 0
     rx3_xdp_redirect: 0
     rx3_lro_packets: 0
     rx3_lro_bytes: 0
     rx3_gro_packets: 0
     rx3_gro_bytes: 0
     rx3_gro_skbs: 0
     rx3_gro_match_packets: 0
     rx3_gro_large_hds: 0
     rx3_ecn_mark: 0
     rx3_removed_vlan_packets: 0
     rx3_wqe_err: 0
     rx3_mpwqe_filler_cqes: 0
     rx3_mpwqe_filler_strides: 0
     rx3_oversize_pkts_sw_drop: 0
     rx3_buff_alloc_err: 0
     rx3_cqe_compress_blks: 0
     rx3_cqe_compress_pkts: 0
     rx3_cache_reuse: 0
     rx3_cache_full: 0
     rx3_cache_empty: 0
     rx3_cache_busy: 0
     rx3_cache_waive: 0
     rx3_cache_ext: 0
     rx3_cache_rdc: 0
     rx3_cache_alloc: 4032
     rx3_congst_umr: 0
     rx3_arfs_err: 0
     rx3_recover: 0
     rx3_pet_hdr_lookup_drop: 0
     rx3_pet_mdata_lookup_drop: 0
     rx3_tls_decrypted_packets: 0
     rx3_tls_decrypted_bytes: 0
     rx3_tls_resync_req_pkt: 0
     rx3_tls_resync_req_start: 0
     rx3_tls_resync_req_end: 0
     rx3_tls_resync_req_skip: 0
     rx3_tls_resync_res_ok: 0
     rx3_tls_resync_res_retry: 0
     rx3_tls_resync_res_skip: 0
     rx3_tls_err: 0
     rx3_xdp_tx_xmit: 0
     rx3_xdp_tx_mpwqe: 0
     rx3_xdp_tx_inlnw: 0
     rx3_xdp_tx_nops: 0
     rx3_xdp_tx_full: 0
     rx3_xdp_tx_err: 0
     rx3_xdp_tx_cqes: 0
     rx4_packets: 0
     rx4_bytes: 0
     rx4_csum_complete: 0
     rx4_csum_complete_tail: 0
     rx4_csum_complete_tail_slow: 0
     rx4_csum_unnecessary: 0
     rx4_csum_unnecessary_inner: 0
     rx4_csum_none: 0
     rx4_xdp_drop: 0
     rx4_xdp_redirect: 0
     rx4_lro_packets: 0
     rx4_lro_bytes: 0
     rx4_gro_packets: 0
     rx4_gro_bytes: 0
     rx4_gro_skbs: 0
     rx4_gro_match_packets: 0
     rx4_gro_large_hds: 0
     rx4_ecn_mark: 0
     rx4_removed_vlan_packets: 0
     rx4_wqe_err: 0
     rx4_mpwqe_filler_cqes: 0
     rx4_mpwqe_filler_strides: 0
     rx4_oversize_pkts_sw_drop: 0
     rx4_buff_alloc_err: 0
     rx4_cqe_compress_blks: 0
     rx4_cqe_compress_pkts: 0
     rx4_cache_reuse: 0
     rx4_cache_full: 0
     rx4_cache_empty: 0
     rx4_cache_busy: 0
     rx4_cache_waive: 0
     rx4_cache_ext: 0
     rx4_cache_rdc: 0
     rx4_cache_alloc: 4032
     rx4_congst_umr: 0
     rx4_arfs_err: 0
     rx4_recover: 0
     rx4_pet_hdr_lookup_drop: 0
     rx4_pet_mdata_lookup_drop: 0
     rx4_tls_decrypted_packets: 0
     rx4_tls_decrypted_bytes: 0
     rx4_tls_resync_req_pkt: 0
     rx4_tls_resync_req_start: 0
     rx4_tls_resync_req_end: 0
     rx4_tls_resync_req_skip: 0
     rx4_tls_resync_res_ok: 0
     rx4_tls_resync_res_retry: 0
     rx4_tls_resync_res_skip: 0
     rx4_tls_err: 0
     rx4_xdp_tx_xmit: 0
     rx4_xdp_tx_mpwqe: 0
     rx4_xdp_tx_inlnw: 0
     rx4_xdp_tx_nops: 0
     rx4_xdp_tx_full: 0
     rx4_xdp_tx_err: 0
     rx4_xdp_tx_cqes: 0
     rx5_packets: 0
     rx5_bytes: 0
     rx5_csum_complete: 0
     rx5_csum_complete_tail: 0
     rx5_csum_complete_tail_slow: 0
     rx5_csum_unnecessary: 0
     rx5_csum_unnecessary_inner: 0
     rx5_csum_none: 0
     rx5_xdp_drop: 0
     rx5_xdp_redirect: 0
     rx5_lro_packets: 0
     rx5_lro_bytes: 0
     rx5_gro_packets: 0
     rx5_gro_bytes: 0
     rx5_gro_skbs: 0
     rx5_gro_match_packets: 0
     rx5_gro_large_hds: 0
     rx5_ecn_mark: 0
     rx5_removed_vlan_packets: 0
     rx5_wqe_err: 0
     rx5_mpwqe_filler_cqes: 0
     rx5_mpwqe_filler_strides: 0
     rx5_oversize_pkts_sw_drop: 0
     rx5_buff_alloc_err: 0
     rx5_cqe_compress_blks: 0
     rx5_cqe_compress_pkts: 0
     rx5_cache_reuse: 0
     rx5_cache_full: 0
     rx5_cache_empty: 0
     rx5_cache_busy: 0
     rx5_cache_waive: 0
     rx5_cache_ext: 0
     rx5_cache_rdc: 0
     rx5_cache_alloc: 4032
     rx5_congst_umr: 0
     rx5_arfs_err: 0
     rx5_recover: 0
     rx5_pet_hdr_lookup_drop: 0
     rx5_pet_mdata_lookup_drop: 0
     rx5_tls_decrypted_packets: 0
     rx5_tls_decrypted_bytes: 0
     rx5_tls_resync_req_pkt: 0
     rx5_tls_resync_req_start: 0
     rx5_tls_resync_req_end: 0
     rx5_tls_resync_req_skip: 0
     rx5_tls_resync_res_ok: 0
     rx5_tls_resync_res_retry: 0
     rx5_tls_resync_res_skip: 0
     rx5_tls_err: 0
     rx5_xdp_tx_xmit: 0
     rx5_xdp_tx_mpwqe: 0
     rx5_xdp_tx_inlnw: 0
     rx5_xdp_tx_nops: 0
     rx5_xdp_tx_full: 0
     rx5_xdp_tx_err: 0
     rx5_xdp_tx_cqes: 0
     rx6_packets: 0
     rx6_bytes: 0
     rx6_csum_complete: 0
     rx6_csum_complete_tail: 0
     rx6_csum_complete_tail_slow: 0
     rx6_csum_unnecessary: 0
     rx6_csum_unnecessary_inner: 0
     rx6_csum_none: 0
     rx6_xdp_drop: 0
     rx6_xdp_redirect: 0
     rx6_lro_packets: 0
     rx6_lro_bytes: 0
     rx6_gro_packets: 0
     rx6_gro_bytes: 0
     rx6_gro_skbs: 0
     rx6_gro_match_packets: 0
     rx6_gro_large_hds: 0
     rx6_ecn_mark: 0
     rx6_removed_vlan_packets: 0
     rx6_wqe_err: 0
     rx6_mpwqe_filler_cqes: 0
     rx6_mpwqe_filler_strides: 0
     rx6_oversize_pkts_sw_drop: 0
     rx6_buff_alloc_err: 0
     rx6_cqe_compress_blks: 0
     rx6_cqe_compress_pkts: 0
     rx6_cache_reuse: 0
     rx6_cache_full: 0
     rx6_cache_empty: 0
     rx6_cache_busy: 0
     rx6_cache_waive: 0
     rx6_cache_ext: 0
     rx6_cache_rdc: 0
     rx6_cache_alloc: 4032
     rx6_congst_umr: 0
     rx6_arfs_err: 0
     rx6_recover: 0
     rx6_pet_hdr_lookup_drop: 0
     rx6_pet_mdata_lookup_drop: 0
     rx6_tls_decrypted_packets: 0
     rx6_tls_decrypted_bytes: 0
     rx6_tls_resync_req_pkt: 0
     rx6_tls_resync_req_start: 0
     rx6_tls_resync_req_end: 0
     rx6_tls_resync_req_skip: 0
     rx6_tls_resync_res_ok: 0
     rx6_tls_resync_res_retry: 0
     rx6_tls_resync_res_skip: 0
     rx6_tls_err: 0
     rx6_xdp_tx_xmit: 0
     rx6_xdp_tx_mpwqe: 0
     rx6_xdp_tx_inlnw: 0
     rx6_xdp_tx_nops: 0
     rx6_xdp_tx_full: 0
     rx6_xdp_tx_err: 0
     rx6_xdp_tx_cqes: 0
     rx7_packets: 0
     rx7_bytes: 0
     rx7_csum_complete: 0
     rx7_csum_complete_tail: 0
     rx7_csum_complete_tail_slow: 0
     rx7_csum_unnecessary: 0
     rx7_csum_unnecessary_inner: 0
     rx7_csum_none: 0
     rx7_xdp_drop: 0
     rx7_xdp_redirect: 0
     rx7_lro_packets: 0
     rx7_lro_bytes: 0
     rx7_gro_packets: 0
     rx7_gro_bytes: 0
     rx7_gro_skbs: 0
     rx7_gro_match_packets: 0
     rx7_gro_large_hds: 0
     rx7_ecn_mark: 0
     rx7_removed_vlan_packets: 0
     rx7_wqe_err: 0
     rx7_mpwqe_filler_cqes: 0
     rx7_mpwqe_filler_strides: 0
     rx7_oversize_pkts_sw_drop: 0
     rx7_buff_alloc_err: 0
     rx7_cqe_compress_blks: 0
     rx7_cqe_compress_pkts: 0
     rx7_cache_reuse: 0
     rx7_cache_full: 0
     rx7_cache_empty: 0
     rx7_cache_busy: 0
     rx7_cache_waive: 0
     rx7_cache_ext: 0
     rx7_cache_rdc: 0
     rx7_cache_alloc: 4032
     rx7_congst_umr: 0
     rx7_arfs_err: 0
     rx7_recover: 0
     rx7_pet_hdr_lookup_drop: 0
     rx7_pet_mdata_lookup_drop: 0
     rx7_tls_decrypted_packets: 0
     rx7_tls_decrypted_bytes: 0
     rx7_tls_resync_req_pkt: 0
     rx7_tls_resync_req_start: 0
     rx7_tls_resync_req_end: 0
     rx7_tls_resync_req_skip: 0
     rx7_tls_resync_res_ok: 0
     rx7_tls_resync_res_retry: 0
     rx7_tls_resync_res_skip: 0
     rx7_tls_err: 0
     rx7_xdp_tx_xmit: 0
     rx7_xdp_tx_mpwqe: 0
     rx7_xdp_tx_inlnw: 0
     rx7_xdp_tx_nops: 0
     rx7_xdp_tx_full: 0
     rx7_xdp_tx_err: 0
     rx7_xdp_tx_cqes: 0
     rx8_packets: 0
     rx8_bytes: 0
     rx8_csum_complete: 0
     rx8_csum_complete_tail: 0
     rx8_csum_complete_tail_slow: 0
     rx8_csum_unnecessary: 0
     rx8_csum_unnecessary_inner: 0
     rx8_csum_none: 0
     rx8_xdp_drop: 0
     rx8_xdp_redirect: 0
     rx8_lro_packets: 0
     rx8_lro_bytes: 0
     rx8_gro_packets: 0
     rx8_gro_bytes: 0
     rx8_gro_skbs: 0
     rx8_gro_match_packets: 0
     rx8_gro_large_hds: 0
     rx8_ecn_mark: 0
     rx8_removed_vlan_packets: 0
     rx8_wqe_err: 0
     rx8_mpwqe_filler_cqes: 0
     rx8_mpwqe_filler_strides: 0
     rx8_oversize_pkts_sw_drop: 0
     rx8_buff_alloc_err: 0
     rx8_cqe_compress_blks: 0
     rx8_cqe_compress_pkts: 0
     rx8_cache_reuse: 0
     rx8_cache_full: 0
     rx8_cache_empty: 0
     rx8_cache_busy: 0
     rx8_cache_waive: 0
     rx8_cache_ext: 0
     rx8_cache_rdc: 0
     rx8_cache_alloc: 4032
     rx8_congst_umr: 0
     rx8_arfs_err: 0
     rx8_recover: 0
     rx8_pet_hdr_lookup_drop: 0
     rx8_pet_mdata_lookup_drop: 0
     rx8_tls_decrypted_packets: 0
     rx8_tls_decrypted_bytes: 0
     rx8_tls_resync_req_pkt: 0
     rx8_tls_resync_req_start: 0
     rx8_tls_resync_req_end: 0
     rx8_tls_resync_req_skip: 0
     rx8_tls_resync_res_ok: 0
     rx8_tls_resync_res_retry: 0
     rx8_tls_resync_res_skip: 0
     rx8_tls_err: 0
     rx8_xdp_tx_xmit: 0
     rx8_xdp_tx_mpwqe: 0
     rx8_xdp_tx_inlnw: 0
     rx8_xdp_tx_nops: 0
     rx8_xdp_tx_full: 0
     rx8_xdp_tx_err: 0
     rx8_xdp_tx_cqes: 0
     rx9_packets: 0
     rx9_bytes: 0
     rx9_csum_complete: 0
     rx9_csum_complete_tail: 0
     rx9_csum_complete_tail_slow: 0
     rx9_csum_unnecessary: 0
     rx9_csum_unnecessary_inner: 0
     rx9_csum_none: 0
     rx9_xdp_drop: 0
     rx9_xdp_redirect: 0
     rx9_lro_packets: 0
     rx9_lro_bytes: 0
     rx9_gro_packets: 0
     rx9_gro_bytes: 0
     rx9_gro_skbs: 0
     rx9_gro_match_packets: 0
     rx9_gro_large_hds: 0
     rx9_ecn_mark: 0
     rx9_removed_vlan_packets: 0
     rx9_wqe_err: 0
     rx9_mpwqe_filler_cqes: 0
     rx9_mpwqe_filler_strides: 0
     rx9_oversize_pkts_sw_drop: 0
     rx9_buff_alloc_err: 0
     rx9_cqe_compress_blks: 0
     rx9_cqe_compress_pkts: 0
     rx9_cache_reuse: 0
     rx9_cache_full: 0
     rx9_cache_empty: 0
     rx9_cache_busy: 0
     rx9_cache_waive: 0
     rx9_cache_ext: 0
     rx9_cache_rdc: 0
     rx9_cache_alloc: 4032
     rx9_congst_umr: 0
     rx9_arfs_err: 0
     rx9_recover: 0
     rx9_pet_hdr_lookup_drop: 0
     rx9_pet_mdata_lookup_drop: 0
     rx9_tls_decrypted_packets: 0
     rx9_tls_decrypted_bytes: 0
     rx9_tls_resync_req_pkt: 0
     rx9_tls_resync_req_start: 0
     rx9_tls_resync_req_end: 0
     rx9_tls_resync_req_skip: 0
     rx9_tls_resync_res_ok: 0
     rx9_tls_resync_res_retry: 0
     rx9_tls_resync_res_skip: 0
     rx9_tls_err: 0
     rx9_xdp_tx_xmit: 0
     rx9_xdp_tx_mpwqe: 0
     rx9_xdp_tx_inlnw: 0
     rx9_xdp_tx_nops: 0
     rx9_xdp_tx_full: 0
     rx9_xdp_tx_err: 0
     rx9_xdp_tx_cqes: 0
     rx10_packets: 0
     rx10_bytes: 0
     rx10_csum_complete: 0
     rx10_csum_complete_tail: 0
     rx10_csum_complete_tail_slow: 0
     rx10_csum_unnecessary: 0
     rx10_csum_unnecessary_inner: 0
     rx10_csum_none: 0
     rx10_xdp_drop: 0
     rx10_xdp_redirect: 0
     rx10_lro_packets: 0
     rx10_lro_bytes: 0
     rx10_gro_packets: 0
     rx10_gro_bytes: 0
     rx10_gro_skbs: 0
     rx10_gro_match_packets: 0
     rx10_gro_large_hds: 0
     rx10_ecn_mark: 0
     rx10_removed_vlan_packets: 0
     rx10_wqe_err: 0
     rx10_mpwqe_filler_cqes: 0
     rx10_mpwqe_filler_strides: 0
     rx10_oversize_pkts_sw_drop: 0
     rx10_buff_alloc_err: 0
     rx10_cqe_compress_blks: 0
     rx10_cqe_compress_pkts: 0
     rx10_cache_reuse: 0
     rx10_cache_full: 0
     rx10_cache_empty: 0
     rx10_cache_busy: 0
     rx10_cache_waive: 0
     rx10_cache_ext: 0
     rx10_cache_rdc: 0
     rx10_cache_alloc: 4032
     rx10_congst_umr: 0
     rx10_arfs_err: 0
     rx10_recover: 0
     rx10_pet_hdr_lookup_drop: 0
     rx10_pet_mdata_lookup_drop: 0
     rx10_tls_decrypted_packets: 0
     rx10_tls_decrypted_bytes: 0
     rx10_tls_resync_req_pkt: 0
     rx10_tls_resync_req_start: 0
     rx10_tls_resync_req_end: 0
     rx10_tls_resync_req_skip: 0
     rx10_tls_resync_res_ok: 0
     rx10_tls_resync_res_retry: 0
     rx10_tls_resync_res_skip: 0
     rx10_tls_err: 0
     rx10_xdp_tx_xmit: 0
     rx10_xdp_tx_mpwqe: 0
     rx10_xdp_tx_inlnw: 0
     rx10_xdp_tx_nops: 0
     rx10_xdp_tx_full: 0
     rx10_xdp_tx_err: 0
     rx10_xdp_tx_cqes: 0
     tx0_packets: 0
     tx0_bytes: 0
     tx0_tso_packets: 0
     tx0_tso_bytes: 0
     tx0_tso_inner_packets: 0
     tx0_tso_inner_bytes: 0
     tx0_csum_partial: 0
     tx0_csum_partial_inner: 0
     tx0_added_vlan_packets: 0
     tx0_nop: 0
     tx0_mpwqe_blks: 0
     tx0_mpwqe_pkts: 0
     tx0_tls_encrypted_packets: 0
     tx0_tls_encrypted_bytes: 0
     tx0_tls_ooo: 0
     tx0_tls_dump_packets: 0
     tx0_tls_dump_bytes: 0
     tx0_tls_resync_bytes: 0
     tx0_tls_skip_no_sync_data: 0
     tx0_tls_drop_no_sync_data: 0
     tx0_tls_drop_bypass_req: 0
     tx0_csum_none: 0
     tx0_stopped: 0
     tx0_dropped: 0
     tx0_xmit_more: 0
     tx0_recover: 0
     tx0_cqes: 0
     tx0_cqe_compress_blks: 0
     tx0_cqe_compress_pkts: 0
     tx0_wake: 0
     tx0_cqe_err: 0
     tx1_packets: 0
     tx1_bytes: 0
     tx1_tso_packets: 0
     tx1_tso_bytes: 0
     tx1_tso_inner_packets: 0
     tx1_tso_inner_bytes: 0
     tx1_csum_partial: 0
     tx1_csum_partial_inner: 0
     tx1_added_vlan_packets: 0
     tx1_nop: 0
     tx1_mpwqe_blks: 0
     tx1_mpwqe_pkts: 0
     tx1_tls_encrypted_packets: 0
     tx1_tls_encrypted_bytes: 0
     tx1_tls_ooo: 0
     tx1_tls_dump_packets: 0
     tx1_tls_dump_bytes: 0
     tx1_tls_resync_bytes: 0
     tx1_tls_skip_no_sync_data: 0
     tx1_tls_drop_no_sync_data: 0
     tx1_tls_drop_bypass_req: 0
     tx1_csum_none: 0
     tx1_stopped: 0
     tx1_dropped: 0
     tx1_xmit_more: 0
     tx1_recover: 0
     tx1_cqes: 0
     tx1_cqe_compress_blks: 0
     tx1_cqe_compress_pkts: 0
     tx1_wake: 0
     tx1_cqe_err: 0
     tx2_packets: 0
     tx2_bytes: 0
     tx2_tso_packets: 0
     tx2_tso_bytes: 0
     tx2_tso_inner_packets: 0
     tx2_tso_inner_bytes: 0
     tx2_csum_partial: 0
     tx2_csum_partial_inner: 0
     tx2_added_vlan_packets: 0
     tx2_nop: 0
     tx2_mpwqe_blks: 0
     tx2_mpwqe_pkts: 0
     tx2_tls_encrypted_packets: 0
     tx2_tls_encrypted_bytes: 0
     tx2_tls_ooo: 0
     tx2_tls_dump_packets: 0
     tx2_tls_dump_bytes: 0
     tx2_tls_resync_bytes: 0
     tx2_tls_skip_no_sync_data: 0
     tx2_tls_drop_no_sync_data: 0
     tx2_tls_drop_bypass_req: 0
     tx2_csum_none: 0
     tx2_stopped: 0
     tx2_dropped: 0
     tx2_xmit_more: 0
     tx2_recover: 0
     tx2_cqes: 0
     tx2_cqe_compress_blks: 0
     tx2_cqe_compress_pkts: 0
     tx2_wake: 0
     tx2_cqe_err: 0
     tx3_packets: 0
     tx3_bytes: 0
     tx3_tso_packets: 0
     tx3_tso_bytes: 0
     tx3_tso_inner_packets: 0
     tx3_tso_inner_bytes: 0
     tx3_csum_partial: 0
     tx3_csum_partial_inner: 0
     tx3_added_vlan_packets: 0
     tx3_nop: 0
     tx3_mpwqe_blks: 0
     tx3_mpwqe_pkts: 0
     tx3_tls_encrypted_packets: 0
     tx3_tls_encrypted_bytes: 0
     tx3_tls_ooo: 0
     tx3_tls_dump_packets: 0
     tx3_tls_dump_bytes: 0
     tx3_tls_resync_bytes: 0
     tx3_tls_skip_no_sync_data: 0
     tx3_tls_drop_no_sync_data: 0
     tx3_tls_drop_bypass_req: 0
     tx3_csum_none: 0
     tx3_stopped: 0
     tx3_dropped: 0
     tx3_xmit_more: 0
     tx3_recover: 0
     tx3_cqes: 0
     tx3_cqe_compress_blks: 0
     tx3_cqe_compress_pkts: 0
     tx3_wake: 0
     tx3_cqe_err: 0
     tx4_packets: 0
     tx4_bytes: 0
     tx4_tso_packets: 0
     tx4_tso_bytes: 0
     tx4_tso_inner_packets: 0
     tx4_tso_inner_bytes: 0
     tx4_csum_partial: 0
     tx4_csum_partial_inner: 0
     tx4_added_vlan_packets: 0
     tx4_nop: 0
     tx4_mpwqe_blks: 0
     tx4_mpwqe_pkts: 0
     tx4_tls_encrypted_packets: 0
     tx4_tls_encrypted_bytes: 0
     tx4_tls_ooo: 0
     tx4_tls_dump_packets: 0
     tx4_tls_dump_bytes: 0
     tx4_tls_resync_bytes: 0
     tx4_tls_skip_no_sync_data: 0
     tx4_tls_drop_no_sync_data: 0
     tx4_tls_drop_bypass_req: 0
     tx4_csum_none: 0
     tx4_stopped: 0
     tx4_dropped: 0
     tx4_xmit_more: 0
     tx4_recover: 0
     tx4_cqes: 0
     tx4_cqe_compress_blks: 0
     tx4_cqe_compress_pkts: 0
     tx4_wake: 0
     tx4_cqe_err: 0
     tx5_packets: 0
     tx5_bytes: 0
     tx5_tso_packets: 0
     tx5_tso_bytes: 0
     tx5_tso_inner_packets: 0
     tx5_tso_inner_bytes: 0
     tx5_csum_partial: 0
     tx5_csum_partial_inner: 0
     tx5_added_vlan_packets: 0
     tx5_nop: 0
     tx5_mpwqe_blks: 0
     tx5_mpwqe_pkts: 0
     tx5_tls_encrypted_packets: 0
     tx5_tls_encrypted_bytes: 0
     tx5_tls_ooo: 0
     tx5_tls_dump_packets: 0
     tx5_tls_dump_bytes: 0
     tx5_tls_resync_bytes: 0
     tx5_tls_skip_no_sync_data: 0
     tx5_tls_drop_no_sync_data: 0
     tx5_tls_drop_bypass_req: 0
     tx5_csum_none: 0
     tx5_stopped: 0
     tx5_dropped: 0
     tx5_xmit_more: 0
     tx5_recover: 0
     tx5_cqes: 0
     tx5_cqe_compress_blks: 0
     tx5_cqe_compress_pkts: 0
     tx5_wake: 0
     tx5_cqe_err: 0
     tx6_packets: 0
     tx6_bytes: 0
     tx6_tso_packets: 0
     tx6_tso_bytes: 0
     tx6_tso_inner_packets: 0
     tx6_tso_inner_bytes: 0
     tx6_csum_partial: 0
     tx6_csum_partial_inner: 0
     tx6_added_vlan_packets: 0
     tx6_nop: 0
     tx6_mpwqe_blks: 0
     tx6_mpwqe_pkts: 0
     tx6_tls_encrypted_packets: 0
     tx6_tls_encrypted_bytes: 0
     tx6_tls_ooo: 0
     tx6_tls_dump_packets: 0
     tx6_tls_dump_bytes: 0
     tx6_tls_resync_bytes: 0
     tx6_tls_skip_no_sync_data: 0
     tx6_tls_drop_no_sync_data: 0
     tx6_tls_drop_bypass_req: 0
     tx6_csum_none: 0
     tx6_stopped: 0
     tx6_dropped: 0
     tx6_xmit_more: 0
     tx6_recover: 0
     tx6_cqes: 0
     tx6_cqe_compress_blks: 0
     tx6_cqe_compress_pkts: 0
     tx6_wake: 0
     tx6_cqe_err: 0
     tx7_packets: 0
     tx7_bytes: 0
     tx7_tso_packets: 0
     tx7_tso_bytes: 0
     tx7_tso_inner_packets: 0
     tx7_tso_inner_bytes: 0
     tx7_csum_partial: 0
     tx7_csum_partial_inner: 0
     tx7_added_vlan_packets: 0
     tx7_nop: 0
     tx7_mpwqe_blks: 0
     tx7_mpwqe_pkts: 0
     tx7_tls_encrypted_packets: 0
     tx7_tls_encrypted_bytes: 0
     tx7_tls_ooo: 0
     tx7_tls_dump_packets: 0
     tx7_tls_dump_bytes: 0
     tx7_tls_resync_bytes: 0
     tx7_tls_skip_no_sync_data: 0
     tx7_tls_drop_no_sync_data: 0
     tx7_tls_drop_bypass_req: 0
     tx7_csum_none: 0
     tx7_stopped: 0
     tx7_dropped: 0
     tx7_xmit_more: 0
     tx7_recover: 0
     tx7_cqes: 0
     tx7_cqe_compress_blks: 0
     tx7_cqe_compress_pkts: 0
     tx7_wake: 0
     tx7_cqe_err: 0
     tx8_packets: 11
     tx8_bytes: 866
     tx8_tso_packets: 0
     tx8_tso_bytes: 0
     tx8_tso_inner_packets: 0
     tx8_tso_inner_bytes: 0
     tx8_csum_partial: 0
     tx8_csum_partial_inner: 0
     tx8_added_vlan_packets: 0
     tx8_nop: 0
     tx8_mpwqe_blks: 11
     tx8_mpwqe_pkts: 11
     tx8_tls_encrypted_packets: 0
     tx8_tls_encrypted_bytes: 0
     tx8_tls_ooo: 0
     tx8_tls_dump_packets: 0
     tx8_tls_dump_bytes: 0
     tx8_tls_resync_bytes: 0
     tx8_tls_skip_no_sync_data: 0
     tx8_tls_drop_no_sync_data: 0
     tx8_tls_drop_bypass_req: 0
     tx8_csum_none: 11
     tx8_stopped: 0
     tx8_dropped: 0
     tx8_xmit_more: 0
     tx8_recover: 0
     tx8_cqes: 11
     tx8_cqe_compress_blks: 0
     tx8_cqe_compress_pkts: 0
     tx8_wake: 0
     tx8_cqe_err: 0
     tx9_packets: 0
     tx9_bytes: 0
     tx9_tso_packets: 0
     tx9_tso_bytes: 0
     tx9_tso_inner_packets: 0
     tx9_tso_inner_bytes: 0
     tx9_csum_partial: 0
     tx9_csum_partial_inner: 0
     tx9_added_vlan_packets: 0
     tx9_nop: 0
     tx9_mpwqe_blks: 0
     tx9_mpwqe_pkts: 0
     tx9_tls_encrypted_packets: 0
     tx9_tls_encrypted_bytes: 0
     tx9_tls_ooo: 0
     tx9_tls_dump_packets: 0
     tx9_tls_dump_bytes: 0
     tx9_tls_resync_bytes: 0
     tx9_tls_skip_no_sync_data: 0
     tx9_tls_drop_no_sync_data: 0
     tx9_tls_drop_bypass_req: 0
     tx9_csum_none: 0
     tx9_stopped: 0
     tx9_dropped: 0
     tx9_xmit_more: 0
     tx9_recover: 0
     tx9_cqes: 0
     tx9_cqe_compress_blks: 0
     tx9_cqe_compress_pkts: 0
     tx9_wake: 0
     tx9_cqe_err: 0
     tx10_packets: 0
     tx10_bytes: 0
     tx10_tso_packets: 0
     tx10_tso_bytes: 0
     tx10_tso_inner_packets: 0
     tx10_tso_inner_bytes: 0
     tx10_csum_partial: 0
     tx10_csum_partial_inner: 0
     tx10_added_vlan_packets: 0
     tx10_nop: 0
     tx10_mpwqe_blks: 0
     tx10_mpwqe_pkts: 0
     tx10_tls_encrypted_packets: 0
     tx10_tls_encrypted_bytes: 0
     tx10_tls_ooo: 0
     tx10_tls_dump_packets: 0
     tx10_tls_dump_bytes: 0
     tx10_tls_resync_bytes: 0
     tx10_tls_skip_no_sync_data: 0
     tx10_tls_drop_no_sync_data: 0
     tx10_tls_drop_bypass_req: 0
     tx10_csum_none: 0
     tx10_stopped: 0
     tx10_dropped: 0
     tx10_xmit_more: 0
     tx10_recover: 0
     tx10_cqes: 0
     tx10_cqe_compress_blks: 0
     tx10_cqe_compress_pkts: 0
     tx10_wake: 0
     tx10_cqe_err: 0
     tx0_xdp_xmit: 0
     tx0_xdp_mpwqe: 0
     tx0_xdp_inlnw: 0
     tx0_xdp_nops: 0
     tx0_xdp_full: 0
     tx0_xdp_err: 0
     tx0_xdp_cqes: 0
     tx1_xdp_xmit: 0
     tx1_xdp_mpwqe: 0
     tx1_xdp_inlnw: 0
     tx1_xdp_nops: 0
     tx1_xdp_full: 0
     tx1_xdp_err: 0
     tx1_xdp_cqes: 0
     tx2_xdp_xmit: 0
     tx2_xdp_mpwqe: 0
     tx2_xdp_inlnw: 0
     tx2_xdp_nops: 0
     tx2_xdp_full: 0
     tx2_xdp_err: 0
     tx2_xdp_cqes: 0
     tx3_xdp_xmit: 0
     tx3_xdp_mpwqe: 0
     tx3_xdp_inlnw: 0
     tx3_xdp_nops: 0
     tx3_xdp_full: 0
     tx3_xdp_err: 0
     tx3_xdp_cqes: 0
     tx4_xdp_xmit: 0
     tx4_xdp_mpwqe: 0
     tx4_xdp_inlnw: 0
     tx4_xdp_nops: 0
     tx4_xdp_full: 0
     tx4_xdp_err: 0
     tx4_xdp_cqes: 0
     tx5_xdp_xmit: 0
     tx5_xdp_mpwqe: 0
     tx5_xdp_inlnw: 0
     tx5_xdp_nops: 0
     tx5_xdp_full: 0
     tx5_xdp_err: 0
     tx5_xdp_cqes: 0
     tx6_xdp_xmit: 0
     tx6_xdp_mpwqe: 0
     tx6_xdp_inlnw: 0
     tx6_xdp_nops: 0
     tx6_xdp_full: 0
     tx6_xdp_err: 0
     tx6_xdp_cqes: 0
     tx7_xdp_xmit: 0
     tx7_xdp_mpwqe: 0
     tx7_xdp_inlnw: 0
     tx7_xdp_nops: 0
     tx7_xdp_full: 0
     tx7_xdp_err: 0
     tx7_xdp_cqes: 0
     tx8_xdp_xmit: 0
     tx8_xdp_mpwqe: 0
     tx8_xdp_inlnw: 0
     tx8_xdp_nops: 0
     tx8_xdp_full: 0
     tx8_xdp_err: 0
     tx8_xdp_cqes: 0
     tx9_xdp_xmit: 0
     tx9_xdp_mpwqe: 0
     tx9_xdp_inlnw: 0
     tx9_xdp_nops: 0
     tx9_xdp_full: 0
     tx9_xdp_err: 0
     tx9_xdp_cqes: 0
     tx10_xdp_xmit: 0
     tx10_xdp_mpwqe: 0
     tx10_xdp_inlnw: 0
     tx10_xdp_nops: 0
     tx10_xdp_full: 0
     tx10_xdp_err: 0
     tx10_xdp_cqes: 0

[-- Attachment #5: ens2f0np0v1_before --]
[-- Type: text/plain, Size: 5973 bytes --]

NIC statistics:
     rx_packets: 0
     rx_bytes: 0
     tx_packets: 0
     tx_bytes: 0
     tx_tso_packets: 0
     tx_tso_bytes: 0
     tx_tso_inner_packets: 0
     tx_tso_inner_bytes: 0
     tx_added_vlan_packets: 0
     tx_nop: 0
     tx_mpwqe_blks: 0
     tx_mpwqe_pkts: 0
     tx_tls_encrypted_packets: 0
     tx_tls_encrypted_bytes: 0
     tx_tls_ooo: 0
     tx_tls_dump_packets: 0
     tx_tls_dump_bytes: 0
     tx_tls_resync_bytes: 0
     tx_tls_skip_no_sync_data: 0
     tx_tls_drop_no_sync_data: 0
     tx_tls_drop_bypass_req: 0
     rx_lro_packets: 0
     rx_lro_bytes: 0
     rx_gro_packets: 0
     rx_gro_bytes: 0
     rx_gro_skbs: 0
     rx_gro_match_packets: 0
     rx_gro_large_hds: 0
     rx_ecn_mark: 0
     rx_removed_vlan_packets: 0
     rx_csum_unnecessary: 0
     rx_csum_none: 0
     rx_csum_complete: 0
     rx_csum_complete_tail: 0
     rx_csum_complete_tail_slow: 0
     rx_csum_unnecessary_inner: 0
     rx_xdp_drop: 0
     rx_xdp_redirect: 0
     rx_xdp_tx_xmit: 0
     rx_xdp_tx_mpwqe: 0
     rx_xdp_tx_inlnw: 0
     rx_xdp_tx_nops: 0
     rx_xdp_tx_full: 0
     rx_xdp_tx_err: 0
     rx_xdp_tx_cqe: 0
     tx_csum_none: 0
     tx_csum_partial: 0
     tx_csum_partial_inner: 0
     tx_queue_stopped: 0
     tx_queue_dropped: 0
     tx_xmit_more: 0
     tx_recover: 0
     tx_cqes: 0
     tx_queue_wake: 0
     tx_cqe_err: 0
     tx_xdp_xmit: 0
     tx_xdp_mpwqe: 0
     tx_xdp_inlnw: 0
     tx_xdp_nops: 0
     tx_xdp_full: 0
     tx_xdp_err: 0
     tx_xdp_cqes: 0
     tx_cqe_compress_blks: 0
     tx_cqe_compress_pkts: 0
     rx_wqe_err: 0
     rx_mpwqe_filler_cqes: 0
     rx_mpwqe_filler_strides: 0
     rx_oversize_pkts_sw_drop: 0
     rx_buff_alloc_err: 0
     rx_cqe_compress_blks: 0
     rx_cqe_compress_pkts: 0
     rx_cache_reuse: 0
     rx_cache_full: 0
     rx_cache_empty: 0
     rx_cache_busy: 0
     rx_cache_ext: 0
     rx_cache_rdc: 0
     rx_cache_alloc: 0
     rx_cache_waive: 0
     rx_congst_umr: 0
     rx_arfs_err: 0
     rx_recover: 0
     rx_pet_hdr_lookup_drop: 0
     rx_pet_mdata_lookup_drop: 0
     rx_tls_decrypted_packets: 0
     rx_tls_decrypted_bytes: 0
     rx_tls_resync_req_pkt: 0
     rx_tls_resync_req_start: 0
     rx_tls_resync_req_end: 0
     rx_tls_resync_req_skip: 0
     rx_tls_resync_res_ok: 0
     rx_tls_resync_res_retry: 0
     rx_tls_resync_res_skip: 0
     rx_tls_err: 0
     ch_events: 0
     ch_poll: 0
     ch_arm: 0
     ch_aff_change: 0
     ch_force_irq: 0
     ch_eq_rearm: 0
     rx_xsk_packets: 0
     rx_xsk_bytes: 0
     rx_xsk_csum_complete: 0
     rx_xsk_csum_unnecessary: 0
     rx_xsk_csum_unnecessary_inner: 0
     rx_xsk_csum_none: 0
     rx_xsk_ecn_mark: 0
     rx_xsk_removed_vlan_packets: 0
     rx_xsk_xdp_drop: 0
     rx_xsk_xdp_redirect: 0
     rx_xsk_wqe_err: 0
     rx_xsk_mpwqe_filler_cqes: 0
     rx_xsk_mpwqe_filler_strides: 0
     rx_xsk_oversize_pkts_sw_drop: 0
     rx_xsk_buff_alloc_err: 0
     rx_xsk_cqe_compress_blks: 0
     rx_xsk_cqe_compress_pkts: 0
     rx_xsk_congst_umr: 0
     rx_xsk_arfs_err: 0
     tx_xsk_xmit: 0
     tx_xsk_mpwqe: 0
     tx_xsk_inlnw: 0
     tx_xsk_full: 0
     tx_xsk_err: 0
     tx_xsk_cqes: 0
     rx_out_of_buffer: 0
     rx_if_down_packets: 0
     rx_steer_missed_packets: 0
     rx_vport_unicast_packets: 0
     rx_vport_unicast_bytes: 0
     tx_vport_unicast_packets: 0
     tx_vport_unicast_bytes: 0
     rx_vport_multicast_packets: 0
     rx_vport_multicast_bytes: 0
     tx_vport_multicast_packets: 0
     tx_vport_multicast_bytes: 0
     rx_vport_broadcast_packets: 0
     rx_vport_broadcast_bytes: 0
     tx_vport_broadcast_packets: 0
     tx_vport_broadcast_bytes: 0
     rx_vport_rdma_unicast_packets: 0
     rx_vport_rdma_unicast_bytes: 0
     tx_vport_rdma_unicast_packets: 0
     tx_vport_rdma_unicast_bytes: 0
     rx_vport_rdma_multicast_packets: 0
     rx_vport_rdma_multicast_bytes: 0
     tx_vport_rdma_multicast_packets: 0
     tx_vport_rdma_multicast_bytes: 0
     tx_packets_phy: 0
     rx_packets_phy: 0
     rx_crc_errors_phy: 0
     tx_bytes_phy: 0
     rx_bytes_phy: 0
     tx_multicast_phy: 0
     tx_broadcast_phy: 0
     rx_multicast_phy: 0
     rx_broadcast_phy: 0
     rx_in_range_len_errors_phy: 0
     rx_out_of_range_len_phy: 0
     rx_oversize_pkts_phy: 0
     rx_symbol_err_phy: 0
     tx_mac_control_phy: 0
     rx_mac_control_phy: 0
     rx_unsupported_op_phy: 0
     rx_pause_ctrl_phy: 0
     tx_pause_ctrl_phy: 0
     rx_discards_phy: 0
     tx_discards_phy: 0
     tx_errors_phy: 0
     rx_undersize_pkts_phy: 0
     rx_fragments_phy: 0
     rx_jabbers_phy: 0
     rx_64_bytes_phy: 0
     rx_65_to_127_bytes_phy: 0
     rx_128_to_255_bytes_phy: 0
     rx_256_to_511_bytes_phy: 0
     rx_512_to_1023_bytes_phy: 0
     rx_1024_to_1518_bytes_phy: 0
     rx_1519_to_2047_bytes_phy: 0
     rx_2048_to_4095_bytes_phy: 0
     rx_4096_to_8191_bytes_phy: 0
     rx_8192_to_10239_bytes_phy: 0
     link_down_events_phy: 0
     rx_prio0_bytes: 0
     rx_prio0_packets: 0
     rx_prio0_discards: 0
     tx_prio0_bytes: 0
     tx_prio0_packets: 0
     rx_prio1_bytes: 0
     rx_prio1_packets: 0
     rx_prio1_discards: 0
     tx_prio1_bytes: 0
     tx_prio1_packets: 0
     rx_prio2_bytes: 0
     rx_prio2_packets: 0
     rx_prio2_discards: 0
     tx_prio2_bytes: 0
     tx_prio2_packets: 0
     rx_prio3_bytes: 0
     rx_prio3_packets: 0
     rx_prio3_discards: 0
     tx_prio3_bytes: 0
     tx_prio3_packets: 0
     rx_prio4_bytes: 0
     rx_prio4_packets: 0
     rx_prio4_discards: 0
     tx_prio4_bytes: 0
     tx_prio4_packets: 0
     rx_prio5_bytes: 0
     rx_prio5_packets: 0
     rx_prio5_discards: 0
     tx_prio5_bytes: 0
     tx_prio5_packets: 0
     rx_prio6_bytes: 0
     rx_prio6_packets: 0
     rx_prio6_discards: 0
     tx_prio6_bytes: 0
     tx_prio6_packets: 0
     rx_prio7_bytes: 0
     rx_prio7_packets: 0
     rx_prio7_discards: 0
     tx_prio7_bytes: 0
     tx_prio7_packets: 0
     module_unplug: 0
     module_bus_stuck: 0
     module_high_temp: 0
     module_bad_shorted: 0

RE: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

[Dariusz Sosnowski]

Thank you for the info.

You might have run into an issue, where NIC generates backpressure to the SW because of very frequent switching between different VLAN priorities on Tx datapath in the NIC.

Could you please apply the following QoS configuration on all interfaces and rerun the test with different VLAN priorities?

sudo mlnx_qos -i <iface> --trust=dscp
for dscp in {0..63}; do sudo mlnx_qos -i <iface> --dscp2prio set,$dscp,0; sleep 0.001;done

These commands will map internally all priorities to priority 0. This workaround should reduce the backpressure without affecting the generated traffic.

Best regards,
Dariusz Sosnowski

> -----Original Message-----
> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de>
> Sent: Thursday, April 18, 2024 15:21
> To: Dariusz Sosnowski <dsosnowski@nvidia.com>
> Cc: users@dpdk.org
> Subject: Re: Trex with mlx5 driver - Multiple streams with different VLAN
> priority causes high CPU utilization
> 
> External email: Use caution opening links or attachments
> 
> 
> Hi Dariusz,
> 
> Thank you for the help.
> 
> If the two parallel stream use the same VLAN priority then the issue is not
> visible anymore. Trex output visible below.
> 
> Different priority
> CPU util.  |            96.97% |              0.0% | Tx bps L2  |         3.59 Gbps |          0.29
> bps | 3.59 Gbps Tx bps L1  |         3.64 Gbps |          0.37 bps | 3.64 Gbps
> Tx pps     |       298.49 Kpps |             0 pps | 298.49 Kpps
> Line Util. |            3.64 % |               0 % |
> 
> Same priority
> CPU util.  |             0.54% |              0.0% | Tx bps L2  |        23.98 Gbps |             0
> bps | 23.98 Gbps Tx bps L1  |         24.3 Gbps |             0 bps | 24.3 Gbps
> Tx pps     |         1.99 Mpps |             0 pps | 1.99 Mpps
> Line Util. |            24.3 % |               0 % |
> 
> I have attached the requested output to the email.
> 
> Best,
> Rubens
> 
> On 4/18/24 14:48, Dariusz Sosnowski wrote:
> > Hi Rubens,
> >
> > Would you be able to provide the output of "ethtool -S <iface>" for both VFs
> before and after the test?
> > Does the same issue appear on this system if both parallel streams use the
> same VLAN priority?
> >
> > Best regards,
> > Dariusz Sosnowski
> >
> >> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de>
> >> Sent: Wednesday, April 17, 2024 19:07
> >> To: users@dpdk.org
> >> Subject: Trex with mlx5 driver - Multiple streams with different VLAN
> >> priority causes high CPU utilization
> >>
> >> Hello community,
> >> I am facing a strange issue in the Trex stateless code, version v3.02 and
> v3.04. I am using the Mellanox Cx-5, and have created two VFs on top of the
> PF 0. The mlx5_core version I am using is the 5.7-1.0.2, and the ofed version is
> MLNX_OFED_LINUX-5.7-1.0.2.0 (OFED-5.7-1.0.2).
> >> I have created the following issue in the trex-core repository
> [here](https://github.com/cisco-system-traffic-generator/trex-
> core/issues/1124), and was recommended to post the issue in here. In the
> github issue you see screenshots of the issue I am facing.
> >> I am trying to create two parallel streams with different VLAN priorities, but
> the load generated is not what I expect it to be, and CPU util. seems incredibly
> high (~99%).
> >> I have reproduced this issue with the --software and non software version.
> >> The script I used is below.
> >> import stl_path
> >> from trex.stl.api import *
> >>
> >> import time
> >> import pprint
> >> from ipaddress import ip_address, ip_network
> >>
> >> import argparse
> >> import configparser
> >> import os
> >> import json
> >>
> >>
> >> def get_packet(tos, mac_dst, ip_src, size):
> >>      # pkt = Ether(src="02:00:00:00:00:01",dst="00:00:00:01:00:01") /
> >> IP(src="10.0.0.2", tos=tos) / UDP(sport=4444, dport=4444)
> >>
> >>      pkt = (
> >>          Ether(src="00:01:00:00:00:02", dst=mac_dst)
> >>          # Ether(dst="11:11:11:11:11:11")
> >>          # / Dot1AD(vlan=0)
> >>          / Dot1Q(vlan=0, prio=tos)
> >>          / IP(src=ip_src)
> >>          / UDP(sport=4444, dport=4444)
> >>      )
> >>      pad = max(0, size - len(pkt)) * "x"
> >>
> >>      return pkt / pad
> >>
> >> def main():
> >>      """ """
> >>      tx_port = 0
> >>      rx_port = 1
> >>
> >>      c = STLClient()
> >>
> >>      # connect to server
> >>      c.connect()
> >>
> >>      # prepare our ports
> >>      c.reset(ports=[tx_port, rx_port])
> >>
> >>      streams = []
> >>      s = STLStream(
> >>          packet=STLPktBuilder(
> >>              pkt=get_packet(4,"00:11:22:33:44:55", "10.1.0.2",512),
> >>              # vm = vm,
> >>          ),
> >>          isg=0 * 1000000,
> >>          mode=STLTXCont(pps=1.2*10**6),
> >>          # flow_stats = STLFlowLatencyStats(pg_id = 0)
> >>          flow_stats = STLFlowStats(pg_id=0),
> >>      )
> >>
> >>      streams.append(s)
> >>
> >>      s2 = STLStream(
> >>          packet=STLPktBuilder(
> >>              pkt=get_packet(2,"00:11:22:33:44:55", "10.1.0.2",512),
> >>              # vm = vm,
> >>          ),
> >>          isg=0 * 1000000,
> >>          mode=STLTXCont(pps=1.2*10**6),
> >>          # flow_stats = STLFlowLatencyStats(pg_id = 0)
> >>          flow_stats = STLFlowStats(pg_id=1),
> >>      )
> >>
> >>      streams.append(s2)
> >>
> >>      c.add_streams(streams, ports=[tx_port])
> >>
> >>      c.clear_stats()
> >>
> >>      c.start(ports=[tx_port], duration=60, mult="25gbpsl1")
> >>
> >>      c.wait_on_traffic(ports=[tx_port, rx_port])
> >>
> >>      stats = c.get_stats()
> >>      print(stats)
> >>
> >> if __name__ == "__main__":
> >>      main()
> >>
> >>
> >> And the configuration is
> >> - port_limit: 2
> >>    version: 2
> >>    port_bandwidth_gb: 100
> >>    interfaces: ["3b:00.2", "3b:00.3"]
> >>    port_info:
> >>      - dest_mac: 00:00:00:00:00:01
> >>        src_mac: 00:01:00:00:00:01
> >>      - dest_mac: 00:00:00:00:00:02
> >>        src_mac: 00:01:00:00:00:02
> >>    c: 14
> >>    platform:
> >>      master_thread_id: 8
> >>      latency_thread_id: 27
> >>      dual_if:
> >>        - socket: 0
> >>          threads:
> >> [9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]
> >>
> >>
> >> BISDN GmbH
> >> Körnerstraße 7-10
> >> 10785 Berlin
> >> Germany
> >>
> >> Phone: +49-30-6108-1-6100
> >>
> >> Managing Directors:
> >> Dr.-Ing. Hagen Woesner, Andreas Köpsel
> >>
> >> Commercial register:
> >> Amtsgericht Berlin-Charlottenburg HRB 141569 B VAT ID No:
> DE283257294
> >> ________________________________________
> --
> BISDN GmbH
> Körnerstraße 7-10
> 10785 Berlin
> Germany
> 
> 
> Phone:
> +49-30-6108-1-6100
> 
> 
> Managing Directors:
> Dr.-Ing. Hagen Woesner, Andreas
> Köpsel
> 
> 
> Commercial register:
> Amtsgericht Berlin-Charlottenburg HRB 141569 B VAT ID No: DE283257294

Re: Trex with mlx5 driver - Multiple streams with different VLAN priority causes high CPU utilization

[Rubens Figueiredo]

Thank you for the help!

I ran the commands and traffic is being generated correctly.

Best regards,

Rubens

On 4/19/24 14:31, Dariusz Sosnowski wrote:
> Thank you for the info.
>
> You might have run into an issue, where NIC generates backpressure to the SW because of very frequent switching between different VLAN priorities on Tx datapath in the NIC.
>
> Could you please apply the following QoS configuration on all interfaces and rerun the test with different VLAN priorities?
>
> sudo mlnx_qos -i <iface> --trust=dscp
> for dscp in {0..63}; do sudo mlnx_qos -i <iface> --dscp2prio set,$dscp,0; sleep 0.001;done
>
> These commands will map internally all priorities to priority 0. This workaround should reduce the backpressure without affecting the generated traffic.
>
> Best regards,
> Dariusz Sosnowski
>
>> -----Original Message-----
>> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de>
>> Sent: Thursday, April 18, 2024 15:21
>> To: Dariusz Sosnowski <dsosnowski@nvidia.com>
>> Cc: users@dpdk.org
>> Subject: Re: Trex with mlx5 driver - Multiple streams with different VLAN
>> priority causes high CPU utilization
>>
>> External email: Use caution opening links or attachments
>>
>>
>> Hi Dariusz,
>>
>> Thank you for the help.
>>
>> If the two parallel stream use the same VLAN priority then the issue is not
>> visible anymore. Trex output visible below.
>>
>> Different priority
>> CPU util.  |            96.97% |              0.0% | Tx bps L2  |         3.59 Gbps |          0.29
>> bps | 3.59 Gbps Tx bps L1  |         3.64 Gbps |          0.37 bps | 3.64 Gbps
>> Tx pps     |       298.49 Kpps |             0 pps | 298.49 Kpps
>> Line Util. |            3.64 % |               0 % |
>>
>> Same priority
>> CPU util.  |             0.54% |              0.0% | Tx bps L2  |        23.98 Gbps |             0
>> bps | 23.98 Gbps Tx bps L1  |         24.3 Gbps |             0 bps | 24.3 Gbps
>> Tx pps     |         1.99 Mpps |             0 pps | 1.99 Mpps
>> Line Util. |            24.3 % |               0 % |
>>
>> I have attached the requested output to the email.
>>
>> Best,
>> Rubens
>>
>> On 4/18/24 14:48, Dariusz Sosnowski wrote:
>>> Hi Rubens,
>>>
>>> Would you be able to provide the output of "ethtool -S <iface>" for both VFs
>> before and after the test?
>>> Does the same issue appear on this system if both parallel streams use the
>> same VLAN priority?
>>> Best regards,
>>> Dariusz Sosnowski
>>>
>>>> From: Rubens Figueiredo <rubens.figueiredo@bisdn.de>
>>>> Sent: Wednesday, April 17, 2024 19:07
>>>> To: users@dpdk.org
>>>> Subject: Trex with mlx5 driver - Multiple streams with different VLAN
>>>> priority causes high CPU utilization
>>>>
>>>> Hello community,
>>>> I am facing a strange issue in the Trex stateless code, version v3.02 and
>> v3.04. I am using the Mellanox Cx-5, and have created two VFs on top of the
>> PF 0. The mlx5_core version I am using is the 5.7-1.0.2, and the ofed version is
>> MLNX_OFED_LINUX-5.7-1.0.2.0 (OFED-5.7-1.0.2).
>>>> I have created the following issue in the trex-core repository
>> [here](https://github.com/cisco-system-traffic-generator/trex-
>> core/issues/1124), and was recommended to post the issue in here. In the
>> github issue you see screenshots of the issue I am facing.
>>>> I am trying to create two parallel streams with different VLAN priorities, but
>> the load generated is not what I expect it to be, and CPU util. seems incredibly
>> high (~99%).
>>>> I have reproduced this issue with the --software and non software version.
>>>> The script I used is below.
>>>> import stl_path
>>>> from trex.stl.api import *
>>>>
>>>> import time
>>>> import pprint
>>>> from ipaddress import ip_address, ip_network
>>>>
>>>> import argparse
>>>> import configparser
>>>> import os
>>>> import json
>>>>
>>>>
>>>> def get_packet(tos, mac_dst, ip_src, size):
>>>>       # pkt = Ether(src="02:00:00:00:00:01",dst="00:00:00:01:00:01") /
>>>> IP(src="10.0.0.2", tos=tos) / UDP(sport=4444, dport=4444)
>>>>
>>>>       pkt = (
>>>>           Ether(src="00:01:00:00:00:02", dst=mac_dst)
>>>>           # Ether(dst="11:11:11:11:11:11")
>>>>           # / Dot1AD(vlan=0)
>>>>           / Dot1Q(vlan=0, prio=tos)
>>>>           / IP(src=ip_src)
>>>>           / UDP(sport=4444, dport=4444)
>>>>       )
>>>>       pad = max(0, size - len(pkt)) * "x"
>>>>
>>>>       return pkt / pad
>>>>
>>>> def main():
>>>>       """ """
>>>>       tx_port = 0
>>>>       rx_port = 1
>>>>
>>>>       c = STLClient()
>>>>
>>>>       # connect to server
>>>>       c.connect()
>>>>
>>>>       # prepare our ports
>>>>       c.reset(ports=[tx_port, rx_port])
>>>>
>>>>       streams = []
>>>>       s = STLStream(
>>>>           packet=STLPktBuilder(
>>>>               pkt=get_packet(4,"00:11:22:33:44:55", "10.1.0.2",512),
>>>>               # vm = vm,
>>>>           ),
>>>>           isg=0 * 1000000,
>>>>           mode=STLTXCont(pps=1.2*10**6),
>>>>           # flow_stats = STLFlowLatencyStats(pg_id = 0)
>>>>           flow_stats = STLFlowStats(pg_id=0),
>>>>       )
>>>>
>>>>       streams.append(s)
>>>>
>>>>       s2 = STLStream(
>>>>           packet=STLPktBuilder(
>>>>               pkt=get_packet(2,"00:11:22:33:44:55", "10.1.0.2",512),
>>>>               # vm = vm,
>>>>           ),
>>>>           isg=0 * 1000000,
>>>>           mode=STLTXCont(pps=1.2*10**6),
>>>>           # flow_stats = STLFlowLatencyStats(pg_id = 0)
>>>>           flow_stats = STLFlowStats(pg_id=1),
>>>>       )
>>>>
>>>>       streams.append(s2)
>>>>
>>>>       c.add_streams(streams, ports=[tx_port])
>>>>
>>>>       c.clear_stats()
>>>>
>>>>       c.start(ports=[tx_port], duration=60, mult="25gbpsl1")
>>>>
>>>>       c.wait_on_traffic(ports=[tx_port, rx_port])
>>>>
>>>>       stats = c.get_stats()
>>>>       print(stats)
>>>>
>>>> if __name__ == "__main__":
>>>>       main()
>>>>
>>>>
>>>> And the configuration is
>>>> - port_limit: 2
>>>>     version: 2
>>>>     port_bandwidth_gb: 100
>>>>     interfaces: ["3b:00.2", "3b:00.3"]
>>>>     port_info:
>>>>       - dest_mac: 00:00:00:00:00:01
>>>>         src_mac: 00:01:00:00:00:01
>>>>       - dest_mac: 00:00:00:00:00:02
>>>>         src_mac: 00:01:00:00:00:02
>>>>     c: 14
>>>>     platform:
>>>>       master_thread_id: 8
>>>>       latency_thread_id: 27
>>>>       dual_if:
>>>>         - socket: 0
>>>>           threads:
>>>> [9,10,11,12,13,14,15,16,17,18,19,20,21,22,23,24,25,26]
>>>>
>>>>
>>>> BISDN GmbH
>>>> Körnerstraße 7-10
>>>> 10785 Berlin
>>>> Germany
>>>>
>>>> Phone: +49-30-6108-1-6100
>>>>
>>>> Managing Directors:
>>>> Dr.-Ing. Hagen Woesner, Andreas Köpsel
>>>>
>>>> Commercial register:
>>>> Amtsgericht Berlin-Charlottenburg HRB 141569 B VAT ID No:
>> DE283257294
>>>> ________________________________________
>> --
>> BISDN GmbH
>> Körnerstraße 7-10
>> 10785 Berlin
>> Germany
>>
>>
>> Phone:
>> +49-30-6108-1-6100
>>
>>
>> Managing Directors:
>> Dr.-Ing. Hagen Woesner, Andreas
>> Köpsel
>>
>>
>> Commercial register:
>> Amtsgericht Berlin-Charlottenburg HRB 141569 B VAT ID No: DE283257294

-- 
BISDN GmbH
Körnerstraße 7-10
10785 Berlin
Germany


Phone: 
+49-30-6108-1-6100


Managing Directors: 
Dr.-Ing. Hagen Woesner, Andreas 
Köpsel


Commercial register: 
Amtsgericht Berlin-Charlottenburg HRB 141569 
B
VAT ID No: DE283257294