Mellanox - Unexpected CEQ error, rx stops receiving packets

Mellanox - Unexpected CEQ error, rx stops receiving packets

[Ken Andrews]

Hi,

I'm seeing an issue previously mentioned on this list in 2022, where my Mellanox NIC is logging an Unexpected CEQ error syndrome. Once this condition is hit, the 
rxq->err_state var in the mlx5 PMD is never cleared, and the rx just loops around never receiving any further packets. 

It's not clear what's causing the initial CEQ error, as it can take upwards of an hour to occur.

The full log entry is:

Unexpected CQE error syndrome 0x04 CQN = 256 SQN = 4679 wqe_counter = 2149 wq_ci = 3294 cq_ci = 42609
MLX5 Error CQ: at [0x292d26000], len=16384

The NIC is:  NVIDIA ConnectX-7 HHHL Adapter card, 400GbE / NDR IB (default mode), Single-port OSFP, PCIe 5.0 x16, Crypto Enabled, Secure Boot Enabled
Part number: MCX75310AAC-NEA_Ax
Firmware: 28.36.1010
OFED Version: 24.04-0.6.6.0
DPDK Version: 23.11.0

This issue was previously mentioned in this post: https://mails.dpdk.org/archives/users/2022-October/006779.html

Can anyone please help shed some light on this?

Thanks,
Ken AndrewsKen Andrews R&D Departmentt: +44 1506 671416e: ken.andrews@calnexsol.comw: calnexsol.comNew Product

The SNE-X is a total solution to the problem of real-world Ethernet testing. It combines comprehensive and efficient network emulation for 5G, Data Center, and Cloud applications. Click for more information.

Calnex Solutions
Oracle Campus
Linlithgow
EH49 7LR
United KingdomCalnex Solutions plc is registered in Scotland. Registration number: SC299625. Registered office: Oracle Campus, Linlithgow, Scotland, EH49 7LR, United Kingdom.