DPDK usage discussions
 help / color / mirror / Atom feed
From: Alexander Kozyrev <akozyrev@nvidia.com>
To: Ken Andrews <ken.andrews@calnexsol.com>,
	"users@dpdk.org" <users@dpdk.org>
Subject: Re: Mellanox - Unexpected CEQ error, rx stops receiving packets
Date: Mon, 22 Jul 2024 20:34:38 +0000	[thread overview]
Message-ID: <DM5PR12MB24050E37689CA9DB74D12DB3AFA82@DM5PR12MB2405.namprd12.prod.outlook.com> (raw)
In-Reply-To: <CWLP265MB649951D023BC6FF080A92A14EED02@CWLP265MB6499.GBRP265.PROD.OUTLOOK.COM>

[-- Attachment #1: Type: text/plain, Size: 2269 bytes --]

Hi Ken, here is the error syndrome 0x04 meaning:
0x4: Local_Protection_Error
"This event is generated when a user attempts to access an address outside of the registered memory region.
For example, this may happen if the Lkey does not match the address in the WR."
Looks like wrong buffer was passed to the NIC for a packet acquisition.
Could you please share more details on your test case? What is the traffic pattern? What is Rx/Tx queues config? mbufs?

Regards,
Alex

________________________________
From: Ken Andrews <ken.andrews@calnexsol.com>
Sent: Friday, June 28, 2024 5:22 AM
To: users@dpdk.org <users@dpdk.org>
Subject: Mellanox - Unexpected CEQ error, rx stops receiving packets

Hi,

I'm seeing an issue previously mentioned on this list in 2022, where my Mellanox NIC is logging an Unexpected CEQ error syndrome. Once this condition is hit, the
rxq->err_state var in the mlx5 PMD is never cleared, and the rx just loops around never receiving any further packets.

It's not clear what's causing the initial CEQ error, as it can take upwards of an hour to occur.

The full log entry is:

Unexpected CQE error syndrome 0x04 CQN = 256 SQN = 4679 wqe_counter = 2149 wq_ci = 3294 cq_ci = 42609
MLX5 Error CQ: at [0x292d26000], len=16384

The NIC is:  NVIDIA ConnectX-7 HHHL Adapter card, 400GbE / NDR IB (default mode), Single-port OSFP, PCIe 5.0 x16, Crypto Enabled, Secure Boot Enabled
Part number: MCX75310AAC-NEA_Ax
Firmware: 28.36.1010
OFED Version: 24.04-0.6.6.0
DPDK Version: 23.11.0

This issue was previously mentioned in this post: https://mails.dpdk.org/archives/users/2022-October/006779.html

Can anyone please help shed some light on this?

Thanks,
Ken AndrewsKen Andrews R&D Departmentt: +44 1506 671416e: ken.andrews@calnexsol.comw: calnexsol.comNew Product

The SNE-X is a total solution to the problem of real-world Ethernet testing. It combines comprehensive and efficient network emulation for 5G, Data Center, and Cloud applications. Click for more information.

Calnex Solutions
Oracle Campus
Linlithgow
EH49 7LR
United KingdomCalnex Solutions plc is registered in Scotland. Registration number: SC299625. Registered office: Oracle Campus, Linlithgow, Scotland, EH49 7LR, United Kingdom.

[-- Attachment #2: Type: text/html, Size: 5207 bytes --]

      reply	other threads:[~2024-07-22 20:34 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-06-28  9:22 Ken Andrews
2024-07-22 20:34 ` Alexander Kozyrev [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DM5PR12MB24050E37689CA9DB74D12DB3AFA82@DM5PR12MB2405.namprd12.prod.outlook.com \
    --to=akozyrev@nvidia.com \
    --cc=ken.andrews@calnexsol.com \
    --cc=users@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).