From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 956C2440F9 for ; Wed, 29 May 2024 03:32:34 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id F2888402AD; Wed, 29 May 2024 03:32:33 +0200 (CEST) Received: from mail-vs1-f47.google.com (mail-vs1-f47.google.com [209.85.217.47]) by mails.dpdk.org (Postfix) with ESMTP id C678C402AD for ; Wed, 29 May 2024 03:32:32 +0200 (CEST) Received: by mail-vs1-f47.google.com with SMTP id ada2fe7eead31-48a39b54e22so534295137.3 for ; Tue, 28 May 2024 18:32:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1716946352; x=1717551152; darn=dpdk.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=WsA6K1C2a4YUvVKBpJNU6fgCLivPFBVN9AGL5s3okeY=; b=kZ3QC7HOwV7ivXwBi9xRpc8W9Gif/VJvLYL2Eeg8y7t/8QsgeFPfKlG5vW2As+L253 yJcRjCJ5/payFwI8hELBoPCJpaCoNy7PndAQRsNkVyvlPCQ68MOc06oZ4MXFjBlvJSsu 7EarLnZT6Vlfk63ADmB3lrn8tWI0TSiOR/nobn55WYhFqs/1qkx6nADWkRgCKqquSJ+W PnXVI2QN2a6Et0f8Ned53DXBVdz7BZBMr+Y6JQYKwjz/BUtu5H6XTMu2ZuW4aLNEb5Xf Ui+vlXRllr89YWtbOpXSgKX8wsFMPwig+HaiQgj2zxIwNCogkubbPpXq5LIFY6uT1Ks7 nOXQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1716946352; x=1717551152; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=WsA6K1C2a4YUvVKBpJNU6fgCLivPFBVN9AGL5s3okeY=; b=h0xXU9oYyoZJuYrHbhHu0Q60qo2O6E++FQeNg/iRuuVmghZ8ac3DtQUze1Kh54XvQk e8xi0qHDahMCcf2IsoeH1xrUrtfcFcKkHTO8Lf6vVMicQMDfG5lyR7ZeC8VqGWUakJkX E0sfjOiJY8BYK9ZS+L9TMMAmwH7hM8vrURCS0P/l26wDIRKhThOODOJQ8+seweVtclIh bS8B5sl3Cvr1T5mqSastOD1d1Ipd4IhE3E7baeaIPlyr3bWZgC7UYAw6TBYkpobCd0kW opPf6z6seDds7N0jwLvyoeJZhw9iFMu/FlN+leuqjWPN20iDSqsXKkNxEHX0jj2WkIdO Bahg== X-Gm-Message-State: AOJu0YwOx3Wp8W33oUSi74Ghg40KTg8RmwaXVBnf5aPv0Z6YIDe9Q0so uNj4r2/nW0KGflpKi1e/mpkULL/G5QA6K597D247wiVEy3x7a/eV6rgpIiW6OmmclAWcasezANf /lDSO3zhwfhTIax16WCodZ7DVPdn+kFew X-Google-Smtp-Source: AGHT+IFH3LOUDeL46bkmzvdmLxMCE7KRGgwHZpiyxN201NALqwWJNxw59Cti81FniHj1xIhQyZrnTLMfYVEDdNsJnS0= X-Received: by 2002:a05:6102:58c8:b0:47b:a44d:1ca5 with SMTP id ada2fe7eead31-48a385361a5mr14926493137.10.1716946351697; Tue, 28 May 2024 18:32:31 -0700 (PDT) MIME-Version: 1.0 From: Yasuhiro Ohara Date: Wed, 29 May 2024 10:32:20 +0900 Message-ID: Subject: ConnectX-7 400GbE wire-rate? To: users@dpdk.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi. My colleague is trying to generate 400Gbps traffic using ConnectX-7, but with no luck. Has anyone succeeded in generating 400Gbps (by larger than 1500B is ok), or are there any known issues? Using dpdk-pktgen, the link is successfully recognized as 400GbE but when we start the traffic, it seems to be capped at 100Gbps. Some info follows. [ 1.490256] mlx5_core 0000:01:00.0: firmware version: 28.41.1000 [ 1.492853] mlx5_core 0000:01:00.0: 504.112 Gb/s available PCIe bandwidth (32.0 GT/s PCIe x16 link) [ 1.805419] mlx5_core 0000:01:00.0: Rate limit: 127 rates are supported, range: 0Mbps to 195312Mbps [ 1.808477] mlx5_core 0000:01:00.0: E-Switch: Total vports 18, per vport: max uc(128) max mc(2048) [ 1.827270] mlx5_core 0000:01:00.0: Port module event: module 0, Cable unplugged [ 1.830317] mlx5_core 0000:01:00.0: mlx5_pcie_event:298:(pid 9): PCIe slot advertised sufficient power (75W). [ 1.830610] mlx5_core 0000:01:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(2048) RxCqeCmprss(0) [ 1.929813] mlx5_core 0000:01:00.0: Supported tc offload range - chains: 4294967294, prios: 4294967295 Device type: ConnectX7 Name: MCX75310AAS-NEA_Ax Description: NVIDIA ConnectX-7 HHHL Adapter card; 400GbE / NDR IB (default mode); Single-port OSFP; PCIe 5.0 x16; Crypto Disabled; Secure Boot Enabled; Device: /dev/mst/mt4129_pciconf0 Enabled Link Speed (Ext.) : 0x00010000 (400G_4X) Supported Cable Speed (Ext.) : 0x00010800 (400G_4X,100G_1X) pktgen result: Pkts/s Rx : 0 TX : 8059264 MBits/s Rx/Tx : 0/97742 Any info is appreciated. Thanks. regards, Yasu