ConnectX-7 400GbE wire-rate?

ConnectX-7 400GbE wire-rate?

[Yasuhiro Ohara]

Hi. My colleague is trying to generate 400Gbps traffic using ConnectX-7,
but with no luck.

Has anyone succeeded in generating 400Gbps (by larger than 1500B is ok),
or are there any known issues?

Using dpdk-pktgen, the link is successfully recognized as 400GbE
but when we start the traffic, it seems to be capped at 100Gbps.

Some info follows.

[    1.490256] mlx5_core 0000:01:00.0: firmware version: 28.41.1000
[    1.492853] mlx5_core 0000:01:00.0: 504.112 Gb/s available PCIe
bandwidth (32.0 GT/s PCIe x16 link)
[    1.805419] mlx5_core 0000:01:00.0: Rate limit: 127 rates are
supported, range: 0Mbps to 195312Mbps
[    1.808477] mlx5_core 0000:01:00.0: E-Switch: Total vports 18, per
vport: max uc(128) max mc(2048)
[    1.827270] mlx5_core 0000:01:00.0: Port module event: module 0,
Cable unplugged
[    1.830317] mlx5_core 0000:01:00.0: mlx5_pcie_event:298:(pid 9):
PCIe slot advertised sufficient power (75W).
[    1.830610] mlx5_core 0000:01:00.0: MLX5E: StrdRq(1) RqSz(8)
StrdSz(2048) RxCqeCmprss(0)
[    1.929813] mlx5_core 0000:01:00.0: Supported tc offload range -
chains: 4294967294, prios: 4294967295

Device type:    ConnectX7
Name:           MCX75310AAS-NEA_Ax
Description:    NVIDIA ConnectX-7 HHHL Adapter card; 400GbE / NDR IB
(default mode); Single-port OSFP; PCIe 5.0 x16; Crypto Disabled;
Secure Boot Enabled;
Device:         /dev/mst/mt4129_pciconf0

Enabled Link Speed (Ext.)       : 0x00010000 (400G_4X)
Supported Cable Speed (Ext.)    : 0x00010800 (400G_4X,100G_1X)

pktgen result:

Pkts/s Rx         :              0
           TX         :  8059264

MBits/s Rx/Tx  :   0/97742


Any info is appreciated. Thanks.

regards,
Yasu