From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <users-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 68CD145683
	for <public@inbox.dpdk.org>; Mon, 22 Jul 2024 19:37:11 +0200 (CEST)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 163154067C;
	Mon, 22 Jul 2024 19:37:11 +0200 (CEST)
Received: from fhigh8-smtp.messagingengine.com
 (fhigh8-smtp.messagingengine.com [103.168.172.159])
 by mails.dpdk.org (Postfix) with ESMTP id 35CF34028B
 for <users@dpdk.org>; Mon, 22 Jul 2024 19:37:08 +0200 (CEST)
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44])
 by mailfhigh.nyi.internal (Postfix) with ESMTP id 0FDE311401ED;
 Mon, 22 Jul 2024 13:37:06 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163])
 by compute4.internal (MEProxy); Mon, 22 Jul 2024 13:37:06 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=monjalon.net; h=
 cc:cc:content-transfer-encoding:content-type:content-type:date
 :date:from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to; s=fm3; t=1721669826;
 x=1721756226; bh=yr2W8h6niFladoF0rPzdcQO1gpffzjDoZ6ll/kYlUjk=; b=
 pchTlpuEbvawJrOBC5/wfWf1hR6bHfm9UXVK+W2oLMP7DKLp+7q9KSjPrZk/DxEH
 F8ORzawsz2tN22vd/olMQW3hOc1B4U+CZd2Rn5+oTdmUMcpBTvGDxr9a11lsSaCM
 PCW7SahpWY8aMHjS9TOhOQ7PPbMdcPGr1EuLLIwMTIi5RzuGmmPSyKcIdqsqrZAP
 Kf+oqEVmnMC4iynJHEu/Vsu7o+kxM4tJRzmFvH29pUOwEWIVHyhJC67Hv6mC/+gS
 hG6AdNHZXIU5vAzRAJtQ95V1v/lWd9fW3nuYbqMCu99KBkXgPB2bDEP/T3W+A1ab
 UjKPSOvkZ7ReGYhBhpr6yQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:cc:content-transfer-encoding
 :content-type:content-type:date:date:feedback-id:feedback-id
 :from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy
 :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1721669826; x=
 1721756226; bh=yr2W8h6niFladoF0rPzdcQO1gpffzjDoZ6ll/kYlUjk=; b=I
 ehOhY0L2f84RwOqQuqBdzosHzZ7Gh9hlXNy2ggFLyQARNyVul7AO/07kY+ZrlPy+
 XjHpRWz3yHy2WFQ7dysDFWNyLXvCmZPDd6MvSDjxL8k5kh5g5MmWInyVPdKXuAUk
 xMFA1VbLLzmxW/4kos/Vmb4CLfFbrLpKI3FmZFiHbHi7EJHh7H9FpZZX/mNkm+J+
 ADM1ZgN74McN/aiGnk1fZseINwlpn0cUuVCxohSPuT7PDGxFNSkRqViNIlQR9I9H
 EeXcHy4aCaEHbUtHK27Gf4uR/ssuP9bqNbzx9allnRq/sKfo47uQZgJ6caG3A9Pa
 885jT7BWC5AdG7QP9Tcnw==
X-ME-Sender: <xms:wZieZi3WEMUM2rc9q6YltuDIV77lwqOrApb8_ZVtR-TC_r_YFna2Iw>
 <xme:wZieZlG7CcgUzUDi1VmpyZ9TNEYga80Rdb4JXAq5nj83DVMXuZYlP44w9R11A8Ufu
 n2FoFLE0u9c-E1-bQ>
X-ME-Received: <xmr:wZieZq7fe85YSksguNo4nQT_94Bxu0xUOXSzNH3r58up70j5ogjOhAQ6-xU8ql5hbOOhvedSZtV_sQ-iPV7ZvoWQZQ>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrheejgdduudeiucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne
 cujfgurhephffvvefufffkjghfggfgtgesthfuredttddtjeenucfhrhhomhepvfhhohhm
 rghsucfoohhnjhgrlhhonhcuoehthhhomhgrshesmhhonhhjrghlohhnrdhnvghtqeenuc
 ggtffrrghtthgvrhhnpeejudevheeiveduuddtveffgfdtgeekueevjeffjeegtdeggeek
 gfdvuefgfeekjeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfh
 hrohhmpehthhhomhgrshesmhhonhhjrghlohhnrdhnvght
X-ME-Proxy: <xmx:wZieZj39_5KREdyWrk8aufqm-y8KAieQz9jZWhaGrhMO8xa3fjqAuA>
 <xmx:wZieZlFlAyuyQ7boGT5JWOp5ZHcEqTPxSRrjFuNYZFN7ibSCxIhqjw>
 <xmx:wZieZs-FC4NJRdBG3wp4y1Ub3J-9N_NdhN2ABHMarm2k5jqxQXIbIw>
 <xmx:wZieZqmEkXUpo9WOFPltd9iBPnNXtvGkL77ziSEU5J6wNDeiB-Hk8g>
 <xmx:wpieZqRr3VdvFAPqUiJkiK9IqnltJ1qVIrijj7TK10S9bIu4cPnnbgBY>
Feedback-ID: i47234305:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Mon,
 22 Jul 2024 13:37:05 -0400 (EDT)
From: Thomas Monjalon <thomas@monjalon.net>
To: Yasuhiro Ohara <yasu1976@gmail.com>
Cc: users@dpdk.org
Subject: Re: ConnectX-7 400GbE wire-rate?
Date: Mon, 22 Jul 2024 19:37:01 +0200
Message-ID: <5485686.Sb9uPGUboI@thomas>
In-Reply-To: <CAJO98mMhyC6_-9sFPEeLUmkg2TcnrBvNrRk9sP_UP5vEsnz8pg@mail.gmail.com>
References: <CAJO98mMhyC6_-9sFPEeLUmkg2TcnrBvNrRk9sP_UP5vEsnz8pg@mail.gmail.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="utf-8"
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
Errors-To: users-bounces@dpdk.org

Hello,

I see there is no answer.

Did you try with testpmd?
I don't know whether it can be a limitation of dpdk-pktgen?



29/05/2024 03:32, Yasuhiro Ohara:
> Hi. My colleague is trying to generate 400Gbps traffic using ConnectX-7,
> but with no luck.
> 
> Has anyone succeeded in generating 400Gbps (by larger than 1500B is ok),
> or are there any known issues?
> 
> Using dpdk-pktgen, the link is successfully recognized as 400GbE
> but when we start the traffic, it seems to be capped at 100Gbps.
> 
> Some info follows.
> 
> [    1.490256] mlx5_core 0000:01:00.0: firmware version: 28.41.1000
> [    1.492853] mlx5_core 0000:01:00.0: 504.112 Gb/s available PCIe
> bandwidth (32.0 GT/s PCIe x16 link)
> [    1.805419] mlx5_core 0000:01:00.0: Rate limit: 127 rates are
> supported, range: 0Mbps to 195312Mbps
> [    1.808477] mlx5_core 0000:01:00.0: E-Switch: Total vports 18, per
> vport: max uc(128) max mc(2048)
> [    1.827270] mlx5_core 0000:01:00.0: Port module event: module 0,
> Cable unplugged
> [    1.830317] mlx5_core 0000:01:00.0: mlx5_pcie_event:298:(pid 9):
> PCIe slot advertised sufficient power (75W).
> [    1.830610] mlx5_core 0000:01:00.0: MLX5E: StrdRq(1) RqSz(8)
> StrdSz(2048) RxCqeCmprss(0)
> [    1.929813] mlx5_core 0000:01:00.0: Supported tc offload range -
> chains: 4294967294, prios: 4294967295
> 
> Device type:    ConnectX7
> Name:           MCX75310AAS-NEA_Ax
> Description:    NVIDIA ConnectX-7 HHHL Adapter card; 400GbE / NDR IB
> (default mode); Single-port OSFP; PCIe 5.0 x16; Crypto Disabled;
> Secure Boot Enabled;
> Device:         /dev/mst/mt4129_pciconf0
> 
> Enabled Link Speed (Ext.)       : 0x00010000 (400G_4X)
> Supported Cable Speed (Ext.)    : 0x00010800 (400G_4X,100G_1X)
> 
> pktgen result:
> 
> Pkts/s Rx         :              0
>            TX         :  8059264
> 
> MBits/s Rx/Tx  :   0/97742
> 
> 
> Any info is appreciated. Thanks.
> 
> regards,
> Yasu
>