From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 124F746B08 for ; Sat, 5 Jul 2025 19:36:24 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C96E640608; Sat, 5 Jul 2025 19:36:23 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0a-00196b01.pphosted.com [67.231.149.170]) by mails.dpdk.org (Postfix) with ESMTP id 6B23E4025F for ; Sat, 5 Jul 2025 19:36:21 +0200 (CEST) Received: from pps.filterd (m0072398.ppops.net [127.0.0.1]) by mx0a-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 565BrDI5013508; Sat, 5 Jul 2025 13:36:12 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= netscout.com.09.24.2020; bh=3C2Rll2YXx+6TVgVrQNmoh+VpT392kGJq2zQ AeY9O8k=; b=lsnvfBmbU8cAZ+FoA29MWe8BDdFJgVk7CjfYOzmU8m5+CugQdzV8 qIK4E07EoODcf+qQPueFRADt+XLNw7i7TDSW7lArJFMgLwRUE8G+uwoB1kMp3N5m xWkGBwsIpDaThori6BN9HgL65Nr/vAN/W6ClpHws18L7NZ2lB1ewAGQfenNYMLf6 G+0pSvsp8EriUoExLoEYPuFmSS5HGeXBRJx8Uud7Xu5SR32yiH3uTdoqaasgZdTt SDuZnGhorPaBSb4pQ+Ysp9h58JzKwQI0x99NjNUTneYUUN3+TsllRQZ760ry1fu4 Wg0f8XsGJuWhn38H6xTFTIAlND1p+KIYtg== Received: from nam10-bn7-obe.outbound.protection.outlook.com (mail-bn7nam10lp2049.outbound.protection.outlook.com [104.47.70.49]) by mx0a-00196b01.pphosted.com (PPS) with ESMTPS id 47q06p0ag8-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 05 Jul 2025 13:36:12 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=WBczSnychLRBVXkvkSxxvV/lUzOj3Sr4LqfbOvB7/1GbamBBb7kFbWZzsvRAUpos0SQ/u71FupiQZJxjOWaED1CtDRjwITQ1IIBIhvf5PNXC/uiB5SoC23SnazH3AdYFACkdZZkwoWUmtFWeCNDyREuCrszOCrha9Qy1R1G+E1GTFdqkz8/BMVhOnpBCwmtMiDBu4xsxl/CS9u2vMLun+EAEsfc14ry2PzmPidDxAHUHMv+iy5zLCd8VoYUZElHJEqFK9zz6UKL9ZtcwLFW7NQoQErtfSU+OuiT2moKNK0gakznJbvJ2qzKBMiLH8Tk28Es3/MGVzE8XFz3v+Pkh3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3C2Rll2YXx+6TVgVrQNmoh+VpT392kGJq2zQAeY9O8k=; b=N+js70O1Jca2SLkbtla82zjvI1nI1StQBhkwvgdA8oUuLSn6gqxzpimUw2c1qk80Qe0NRZQahUXURwC3zMCXu5mBecTxfCNyn0wRXjFi86fu6z0lIunVuNZiY8B7yMUzSIyX3RSVlXYRb9TMan2E0V3HmStucu6XEYynZWpsATCFxVEml1tDgyujvVHs7DxfteQn+8AGzP/fPzx3rSd7u7Wwo6Nu8ii4saOHLZ6bkHqoP1Yvepy1BwfHzSOwt11TR5Rt2inoXg77ogP+1TGRjw/SiLHegFGrH6DvAe1d4qIZBoHtyjFk9ZVpCxTNa6X9SZK91Llah88BnYw44TV7Vg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by BY3PR01MB6563.prod.exchangelabs.com (2603:10b6:a03:367::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8901.23; Sat, 5 Jul 2025 17:36:08 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd%3]) with mapi id 15.20.8901.021; Sat, 5 Jul 2025 17:36:08 +0000 From: "Lombardo, Ed" To: Stephen Hemminger , Ivan Malov CC: users Subject: RE: dpdk Tx falling short Thread-Topic: dpdk Tx falling short Thread-Index: AdvsS4XiFhfr9tUWTZG/9hrfPmeo0QAjYaoAAAZ3EoAAOAaP4A== Date: Sat, 5 Jul 2025 17:36:08 +0000 Message-ID: References: <20250704074957.5848175a@hermes.local> In-Reply-To: <20250704074957.5848175a@hermes.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|BY3PR01MB6563:EE_ x-ms-office365-filtering-correlation-id: 9d34fbe5-7e3b-4370-1b47-08ddbbea6d39 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|1800799024|376014|366016|38070700018; x-microsoft-antispam-message-info: =?us-ascii?Q?dv57nv1cpio10BjlUxHqNH0J9q1msPIxRVxwMHKtFyho3SEKtRdhGs4H4mie?= =?us-ascii?Q?UXCcgTTiqAx+Cjk4GTTbRCeDRKTaLDMVd/VUTxHhVvwVQyv8WLupbJMXJwoT?= =?us-ascii?Q?MBNIe4xltXYhkbCb/yhmzl7KbnagW76MkRW4GQTtLerunw+n73FwlVNFSLWv?= =?us-ascii?Q?X2Z4RLqq1tbQ5Dvbesu/dECebY/vnVJwfbdWqCHhUhM0/RLaKGQgtgmT42a3?= =?us-ascii?Q?2LPm4gfspOgiDSy3hOII2nkcdG1/5+0rZHGr9gd4QGa6FeSSQf3+MgExUezi?= =?us-ascii?Q?s9S2YZnANh57npGZ8QtGEr4QyJoMXSAQbyTdK7K8TjlHoEpLp/jihzBDBwJ9?= =?us-ascii?Q?fRzazHE++ipEoa1FDHYV3yNkGyRDCKEWQs7H8qtEWwhJg5oyitmowaePJzuz?= =?us-ascii?Q?VV40w93+dPyECq88AUMb4g8Y7BXA++JCxJ8V72ANRYqtubC2CAgApH+9S5Qv?= =?us-ascii?Q?fwpzEz4e0eafIpDUNw2YvuPIgKFsmx7Qx73Xd+MxU/aWzd5i6WY9zdqZ5Qts?= =?us-ascii?Q?nnP01DGNsAL7P2MU3Zu9FWNM/0nZy8IB+Owy6AxGNEcDswLV42iLiPgTFnCT?= =?us-ascii?Q?sqML0r+LXT7u9oqagJnkQTDIEBFrTVF8CPBNeHTcfKTdcIZcKZovqZnwqPps?= =?us-ascii?Q?n3/2IMrV0akl6pl9V41z1tS3yfLdd7nrkIeFEUXcwo5ZvUvprW5N21WnvXT4?= =?us-ascii?Q?MV8cnlqmLN/n+TsUv0pCzTeJAaVBl7JsT8DDibBt1dCJTrDsg+Olo2QiU1pz?= =?us-ascii?Q?HgJO77AwXnFudj/Ied4R5HaFSRx3zHZ6uNYLiILnFD0UXEVcOb0bGY0932i1?= =?us-ascii?Q?4nB90w4t/V02UtSZSyOMCDjRzLQvRMb8gKk7NNZgfzg7SJjkELJaAL5ffrdy?= =?us-ascii?Q?crDISbdRCAH/kqHfsRf/PxHARDSvHges4CaO5gdIrOoqJvK97gZpzc5as3kd?= =?us-ascii?Q?SFqnp2klUbVQx8vqueH/kfSvnLcl50gLImjlSaZelRsFIG+TFCBwvGQxQ7Dy?= =?us-ascii?Q?YzOoRBDdabxuJ2ymJoYvqL+hneJ/gbXx9G55Nk1F29DOnnbWfO5U8BU34Plu?= =?us-ascii?Q?gT1Ahx7uQd/676PzpbJU3rZIgEijd5ZbJvYHo4flZ5/B+7USAuOfQlsTlnRt?= =?us-ascii?Q?li4h8ko+TtBVAYvuoYkVvqMiULHdDO9LXV+u1Re0CgHPiGXgdjfG++nyEV8N?= =?us-ascii?Q?iT78iWPahuR+4yX9Kir9PPC13WJLVtI5dlEnUSzG4ucU0FBWXASRJzj/z3jm?= =?us-ascii?Q?i6UhbjNs3E/avz0lz39Wlmk2cVROmgimQe0NKQSt5WS4YkS9bDQaBTbU+vRZ?= =?us-ascii?Q?ocCaPjgOT+yDCe4CCscuazeaZLmfnWubgy86hr02ojs797AtVHXbvXjjhFZ/?= =?us-ascii?Q?iceSN+BIErJsSZUA2OXlq1asDTD7/N6NOmvDHhAoxe9b8tqB7PMHF4LX58ox?= =?us-ascii?Q?v0XolDuaES2Lr7cghvhPySqd26owYMDAAIDrOyJFsnRz//BdXsxhOg=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230040)(1800799024)(376014)(366016)(38070700018); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?l/BYDe1R/k+pCoSEJfQhxsL5xw9BwsrzpZTbJwGmmNf+uFqElfYR1YQim1wM?= =?us-ascii?Q?2/xA+eXlLu6eyX7iMYwVBL0w7jJ/0nQZAzaENb/8u8eCD99aQ1DeqAVZD8qt?= =?us-ascii?Q?DmZplsCwodgfj9L9PCZ3uV8Z0ET/KRQuK5hTlQFsTjNZs6jzyvzayd2F+nxv?= =?us-ascii?Q?NbUrpqN2Kmzg8QvbuSJQ6B0m11IPg8vOHFLTv0cfGPG5nIvhVoc21omvQD3U?= =?us-ascii?Q?7oqlzSZe0eiaJW7Y9Vvu9Hec7bXPPzsAywW7sOC/vgCinTVJ6q2WQGII9sZt?= =?us-ascii?Q?NaHBieKAcMe7vMzpOOiJIIpngDK+rMvJ3CD6/jbi5aoMm/2xC9OjDzM+VNll?= =?us-ascii?Q?ivvG4EB7lXYilxZUc5Um4VlgI9xW+i9siFoKqbuaFVB7z1dCN+YqWLiG9S6p?= =?us-ascii?Q?QTtCUG1SG5osceQJgVW8xkXIssMf+IVFff+6MD1BTIqVd1Z6bt1eyVnh9F/x?= =?us-ascii?Q?x4MOQ00sLMwbpKy4mPXdHgVxDjjRiotaE78/atmJaY5mSyTp+BZkEH8fUAmJ?= =?us-ascii?Q?vn1v2fmV/6G9Rm4PJOsvDh7+69vUT5mTXs19+FTwxqPfIVkNkeC4wTIMwZTZ?= =?us-ascii?Q?uMNE2yhqzT85sG5IIo19Q6b3CZHbdqglTYdVfB2t+BE6jM97slfRlJXN6ix7?= =?us-ascii?Q?/cgd5TXX4PN09uaepK2uh54t0LxQVX8F/SVgcKECYdwdGjMzUt5SYWRa+Z19?= =?us-ascii?Q?7hX8JnhpOlGNS/8USnOsPVaTjFY36obcNhDFYO3DHe3gF62uK6xTh+XCGiDj?= =?us-ascii?Q?XzrkxTPtoL+UgcyUG53Fv11xyFVILL10GThtqavDUug5EEu9pOwgtqjvpPsU?= =?us-ascii?Q?D0FKEw/+72ryTWEyBprCKzFgSY6AYO82tUkE6uAlaITn2dUkwRg1GWP8LH5H?= =?us-ascii?Q?kHyRRGjZKC+Dp5PnPwuDMdrpAwNVXfPvwilr5KGPMSUHV/xmylnGT5PisFgd?= =?us-ascii?Q?OkX/w+mIDOaeVHzwqp0CzweBKHamVQ2mZLEmUL5YLX7lhWMrQ8/ZPAsCUIDj?= =?us-ascii?Q?p4an7QdOcJfigGbLeDhRw8FnbrpNb6zScWA5VsQn+haE1HGLnsnBtdl365Tp?= =?us-ascii?Q?qaKzqgLj7IC5oa2siBYUuqvm8STl/Sh7aA4excMOx0YsJdqHZUtVwpVjr8jK?= =?us-ascii?Q?S6uBOsJSwuF8LWXSB+M/Zqjzz8kSkihNZ9TXuIfXLVlrQ7xtCn6qktT4HCbV?= =?us-ascii?Q?+NF4FYeIqrEd7fOTpMHB3z7lQDFpEXngcJFZ8iS2oTMee1N7WRLWR9MRQL30?= =?us-ascii?Q?nFQZG7MbpeAAUnEuZvI/rRd+yfac8Tox1OuSYcha2F7qnpjDbRbNOVKC57nP?= =?us-ascii?Q?nfh3QejRwuS9XN+ZD4WG5ZIuPTn1N0wX2soSLNtRBui2auot4mpX9f6KBNzW?= =?us-ascii?Q?SIKu9nAXupgB5Rmbd1PCQYN/e23AB8al4/Y0Qc2yU/t8fMv8WGbYq+6d7mBR?= =?us-ascii?Q?sEF7DRgJvpN5azXOsGigRGa4g520pcLW0/HFyGKKHc3XT9o4fNcHOuGGgGyw?= =?us-ascii?Q?rKz9sUxlUtIcfwD9ZV0A27VanujtG5aSLhuoiwp/BbvtDWFzyhRXiQjV+fWC?= =?us-ascii?Q?2IosiSlcnW/GGzMF1Ikji/WuK5NLFEEY/53F8Sxy?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 4amTaVFr/vUFUW+vWOVKXaPZ2edNBprccu8hSa54bLokAUHLtsXJP2UTu47lb7Ug0qLSCu6kGrfxusQ3C9iiXlK0Ow+WI7r0qwQ/ttvpidfli97P5lH8mqsfJNPue9JOsC1GONi4jLfdct258lhcqE+1fhIaN/vug3LToxrNycXnewcFsQRotL1aKS/cYcq8fngM3Y3IqPSvYU2E6GZiN75KWo48AjfZ627WdO2vdXglZog+LxxJw1AhC1s1Pa5kB/noIvxUq7W91ebYqvHcvv0qPvpr8+IO+nPkKcXKhy/XRIwc2TfH4QP/rJiKhL6Zuu7boS45kyofMpW0WyIOrcPMO1IjLniTAkcV24gF85JK7b3dC0BEQ/TtLiVbvrEkIEzv+gqRKYu80v7DJwg2TjAgET0+w9Zp2zHc6VKnjTP8XSTaKxt6Sf4WoZKb7liqz4bcLFTKySPrNm6DbIHUyA+yMR1ZGwLMBysvxS/eanhOXSic/sIiEPYZ/2fbtoa+Sn4a8Gqae0y2AqDkuMNlKHC3xfBk/ovZX0GuUdqldOpcnyLdw6PCuqy6RuBUS1B84K/99tRfUN162wnfKRckbKR6voiKRX6YeKqtHte1bS7f5zIjN9hjSgmazgtIJCo6 X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9d34fbe5-7e3b-4370-1b47-08ddbbea6d39 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Jul 2025 17:36:08.5562 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: eYCnhSA53Gn7fUp/Em5xs4CJ8DKWNA6rFJzUxKK7lP6lIVaLwp9nfus/E95EPHFxJXdAh+4RLgtNaS5nsDirkg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY3PR01MB6563 X-Proofpoint-GUID: y1ZrHmHrmJ6_vnx4RWfiShtsaGZeFKrN X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzA1MDExNiBTYWx0ZWRfX9vGPZ0K6/tyS yVrS+R+NBEfgs+t2bPLd/QDbbSG0zL55kV7Yg6jGN7TEjq5SAIYjz24aH4Tq37BTBUyZhQBNbft r0R9CS9CPzHeOeNoXnuB620tRUlWR4/GKOsJ3IecDJpj16h5tI+VKUxLqtVX2YZkAdsmi6MMFXx 6DUhicgZcIKP13uAm8aElnw6walfzB/UBeCiEpudDlfEtLcd33aa941lQrJpBq/PNvU3R5C9D3n 8VzY+HWnfKiHoEeZA5GhluAgThtEfmX5hY77GTnnzf6jVxhNCnGlfhB571TQvdBorKREDME6iI5 p7ezr/JQ3vz1NyJX0fp1Ud2tP2hSfMcAgempzEifSGaj+G8B61DzqIvdCT+9YovpJLq7cyyyR1+ NF6Wtzlog/qDyhJRG8Nw9pwfw1Tku1NFcmmLqyfsQrGRWBdebkz0KNLaFt5MoS7nIc3trfZk X-Proofpoint-ORIG-GUID: y1ZrHmHrmJ6_vnx4RWfiShtsaGZeFKrN X-Authority-Analysis: v=2.4 cv=LqqSymdc c=1 sm=1 tr=0 ts=6869628c cx=c_pps a=YkRwJB1Lcas13D3J5+BQ6w==:117 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=kj9zAlcOel0A:10 a=Wb1JkmetP80A:10 a=jZVsG21pAAAA:8 a=jQOgFn-ZAAAA:8 a=8rWy6zfcAAAA:8 a=w6jENaGwyD2i-hvhAisA:9 a=CjuIK1q_8ugA:10 a=3Sh2lD0sZASs_lUdrUhf:22 a=mT82qxFQzDvLIExZS32s:22 a=YjdVzJdQTyZRADMV7wFX:22 cc=ntf X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 spamscore=0 clxscore=1011 mlxlogscore=999 phishscore=0 impostorscore=0 malwarescore=0 bulkscore=0 lowpriorityscore=0 mlxscore=0 suspectscore=0 adultscore=0 priorityscore=1501 classifier=spam authscore=0 authtc=n/a authcc=notification route=outbound adjust=0 reason=mlx scancount=1 engine=8.21.0-2505280000 definitions=main-2507050116 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Stephen, I saw your response to more mempools and cache behavior. I have a goal to support 2x100G next, and if I can't get 10G with DPDK then= something is seriously wrong. Should I build the dpdk static libraries with LTO? Thanks, Ed -----Original Message----- From: Stephen Hemminger =20 Sent: Friday, July 4, 2025 10:50 AM To: Ivan Malov Cc: Lombardo, Ed ; users Subject: Re: dpdk Tx falling short External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. On Fri, 4 Jul 2025 15:44:50 +0400 (+04) Ivan Malov wrote: > Hi Ed, >=20 > You say there is only one mempool. Why? > Have you tried using dedicated mempools, one per each port pair (0,2), (3= ,4)? >=20 > Thank you. >=20 > On Thu, 3 Jul 2025, Lombardo, Ed wrote: More mempools can make cache behavior worse not better.