From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E26E446B2B for ; Tue, 8 Jul 2025 18:31:29 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B499140292; Tue, 8 Jul 2025 18:31:29 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0a-00196b01.pphosted.com [67.231.149.170]) by mails.dpdk.org (Postfix) with ESMTP id E354E4025E for ; Tue, 8 Jul 2025 18:31:27 +0200 (CEST) Received: from pps.filterd (m0072398.ppops.net [127.0.0.1]) by mx0a-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 568EU9g5004694; Tue, 8 Jul 2025 12:31:18 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= netscout.com.09.24.2020; bh=qX7uxLkqU6Gj50cHE19VmD6v2XO2L5kWXgEZ keLhPno=; b=LBv3wGV5ROil8AyVcsqHSWUd0wzKiMDYpc63sgsNed+yFd1JpExu dxAKok9Y5geiMfdgqtn2HRXksO9IhZw+/GziaGl1HhW32V5QElrxp5gxnYRVmtsd 8yMXh0mrEMMZvUD6cRRbQojGdhmdlmE8cQylomDbby//BdhiOwPEU4XzkrWu5joi ZNy+FzFBZ0c5bIlKMJKE2ZKw6MIZDzTh5JWK/DacH8SPXwsVIQWoK+tcz90jYHhx oNzJ0inzrdwQIFEQYMLKRB90X5aWcj3NvgpY0/YfGZ5ylEnCBzJ+TxAyBNxrz4v0 EqcgBwmJ+i09HppKjfsKmvKDaG8vDk3lTQ== Received: from nam11-bn8-obe.outbound.protection.outlook.com (mail-bn8nam11lp2173.outbound.protection.outlook.com [104.47.58.173]) by mx0a-00196b01.pphosted.com (PPS) with ESMTPS id 47rfbksjyu-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 08 Jul 2025 12:31:18 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=j0ZUytBbskZqNAYXZGHAIPR58nDVqnpcd71ezgCKBfP8DYjiP2/uSYlWjfzS/xVvD7S+kHHxwrNqJmN3boRbUOypsZxG5MzoG5r4l0h8X/CvhDlk4US9szEivvLktXKLRgnMeUm+U9aaLoL2j40TjFmRStvVZm9rJOIIQjKnTXfFtewKukIUWmDTCs+y6BTDublrX9e4maZr1fHX6bG/C32m1nJ6/v5BrY9V3/CVnHwjuqEte9Mt2mmvRZtXN+zatDur38rTzPlOzzsRZlOkzM+9R4KquvLx8wA9HzCmPI1XMuqf73O/pTpohpl9H2TIDZCX0Vi37Visn0Px/hRKFw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qX7uxLkqU6Gj50cHE19VmD6v2XO2L5kWXgEZkeLhPno=; b=Yz+JfqVNsTopPgPFsATbTIZZqxTJg35wiSadQxSKs8DfYTPbt1N5BI9P7Tex8vfS1ho+6SMf9vedeEa7ixx7ghpwwo/a3CuDXO34XprquYs2F1r3+yP9qBxhk5jv6cX9KhA6C6Y8EY/ko/3SDF1wTSxs4998+g1tLOufDR3e6kZoPQY0SNI19GRi2kVaeNOCZ643QeYMQfIQE4sK32S/mP1DnxCG0CO7FFk8DfBd/e61iDjaz1Jql0yqVYJc1zlRej0VT6ChwJ5L0Ls8yiBKsTFId057CmL8ZJrgRYsgHx3fHaTPceUOSUuLDKtz0GPABrgkhsCUSTqlJim1ySKkxA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by CY3PR01MB9296.prod.exchangelabs.com (2603:10b6:930:100::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8901.26; Tue, 8 Jul 2025 16:31:15 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd%3]) with mapi id 15.20.8901.021; Tue, 8 Jul 2025 16:31:15 +0000 From: "Lombardo, Ed" To: Ivan Malov CC: Stephen Hemminger , users Subject: RE: dpdk Tx falling short Thread-Topic: dpdk Tx falling short Thread-Index: AdvsS4XiFhfr9tUWTZG/9hrfPmeo0QAjYaoAAAZ3EoAAOAaP4AADTEIAAAkqa1AAIqDrAAADVbOwAC9nmnAAC62DAAACmVaAAApYvfAAFH2agAAANzQwAADljgAAACPVIAAA6lSAAAMFuyA= Date: Tue, 8 Jul 2025 16:31:15 +0000 Message-ID: References: <20250704074957.5848175a@hermes.local> <20250705120834.78849e56@hermes.local> <20250706090232.635bd36e@hermes.local> <9ae56e38-0d29-4c7c-0bc2-f92912146da2@arknetworks.am> <20250707160409.75fbc2f1@hermes.local> <20250708064707.583df905@hermes.local> <4b43a1ce-2dc6-5d46-12e0-b26d13a60633@arknetworks.am> <1b7533d3-a3de-b5e9-8838-2d6608f2c8e5@arknetworks.am> In-Reply-To: <1b7533d3-a3de-b5e9-8838-2d6608f2c8e5@arknetworks.am> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|CY3PR01MB9296:EE_ x-ms-office365-filtering-correlation-id: dc1ded77-deaf-4c2c-8630-08ddbe3cdc1f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|376014|366016|1800799024|38070700018; x-microsoft-antispam-message-info: =?us-ascii?Q?cYMxdLLQ5/p64uS05716DQfv1WZrVd8EXTLU2Z7Um9psvpkGmdh1uR7JR/n+?= =?us-ascii?Q?H1V6pOr3o8+q0KWtyV8ELUanJCu2PRHc2IkKnLV5WHOsNGKyPSJ5QzO03eCY?= =?us-ascii?Q?yEFNKggIDVFxVDLq8dCwgylORWpE+3rHrapujgBoCpxtav5HH0pFOYGl2n8N?= =?us-ascii?Q?cIAXbaQ85v1vZnpuOBuVesNEfsBCmZFNYl3VmowE8SCw/1YPBQxav0ux54Ix?= =?us-ascii?Q?fy+aTbzbiC+yK29xNJu6XuUILhaJODB2saz4gZZ+rtBhqmHATPRY0kUmWqDn?= =?us-ascii?Q?SociQd89KKAR1la++lFwmwhsKm+6YK89t79Asgz7eZGkcl1L2EYmU0pcOopW?= =?us-ascii?Q?CtYMxOwVo4g/kWuBlEjePs5R70OeFSSpAdcgXk2HAYZiBEQyWfhVqthJtqIB?= =?us-ascii?Q?e3l2T4xohaA3zZRWyAkNKspRekMW7PrF3iECl/o467/QH1iPRfatBCc4Nfn2?= =?us-ascii?Q?HmwJ/HpK0QjJTN4A0K0kLWk2E+L2Ro503P6hZVUBKE4kmjdd4D7Dw2wMRuPB?= =?us-ascii?Q?gFxnnzJ1d4lkKNr2bh75OSrRj0bGBCGtSTvl5LprHNBYFkJnMgHIOXWHfL+L?= =?us-ascii?Q?zDCeBsfR5miWLIQqHr7xGKJjcNXZv4YKENeIkjsC24pissd+PD2U8HU/Vcc+?= =?us-ascii?Q?vpWWc10urv9EwGcSmlLLtJiyTpMHuTKXCxa5ndNvwO7LkGYabtHBssnbIa+o?= =?us-ascii?Q?zI80Rcgosy/PaNVCA9lPFeFT7H0a0wpBYAvV8ZYpt9ogba7EFOnLq15BHNmP?= =?us-ascii?Q?BIKX4WSpuYYGezmHNeO/VpmKp5YlNtR/wdFEpZSFz3YNLACpfZEo4uePrLFJ?= =?us-ascii?Q?Rl68AjZKV4OKYGQAvpRCJ9sGffsHhjwuYvL9EUrUsVwvUeNuXgq59rK0+fay?= =?us-ascii?Q?oR0A0QkYiDyp0PVkrpd0bHpxOUk8px9mBVB6cn/y+rlwABQTIP3LF02MxH/X?= =?us-ascii?Q?G+v8UgXToCLGzMMXFZJh0yLMcL9M+gZZWzaNCjh63oScETtDBu2EoVjmvHQC?= =?us-ascii?Q?q4gbl1W2JLl0ZDyh89g7hXc9WA4ICQbT7HA5iEOEX09emfRVvqZBXn+JWgr9?= =?us-ascii?Q?iixJ4ENOisLu25xrd8UEVKSZZ0DlY7WX38rAJh6dKjq7sH3/jQaRdIsTn5dQ?= =?us-ascii?Q?ZaJFQFbDepJyXlTo6JwDeLveTKlLWeBa5yGU0Qd3xpPEEFX8k0rCJuMZHN2L?= =?us-ascii?Q?nNKJonJLC2uy07soSwzoPFsEM+ExSUPzeKcyA/H+Q+IXFTWXXw8X+aWvz4sO?= =?us-ascii?Q?3auWKrfLOFWxecljYi7BQYfrvCFGEh0Z4swgO3eoHU6WKnxADLXCD5vSSsgu?= =?us-ascii?Q?mnTc3V6HAnUfQ/eluXPsEOTcecc9w9+WvO+huDVY9rPp/4ceQBkymhqahmyc?= =?us-ascii?Q?zq3h/EZMVwXCaOnKCwWrlGLIRXxFqIb7jLyz7qtAEj/Lf6HXZV2b0kdrWie0?= =?us-ascii?Q?q9wXueHX89o=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230040)(376014)(366016)(1800799024)(38070700018); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?uxvXFiTDlfhm8GbrGpUJ+q+OSulGU7aNB5Isxm4D+AluG7iIjh/Qa/SyPYDf?= =?us-ascii?Q?tC+C3bfthuAYHb84F7ZgjfjGMKl2Lp9Ywjln6npQ5J5ROfBfpABp+y/rAwEa?= =?us-ascii?Q?tEth1E+rIjJRbZUM4igAX82Re2PW+AxdGXDxqpiOoPXUlCKTPe/3qLzBCqdr?= =?us-ascii?Q?jP0rWm8gSmWnnaxS4f26nF87wbiUA4XPH2P1hHI/wqa5j8hSGZG4lzYsbdad?= =?us-ascii?Q?lyEBwytn2BzBGwmz6flsP9mpDlkWD0QQJliNitH+tsljmOwmNueRzl6sR7ra?= =?us-ascii?Q?Y8K4H7h8BAiTzzl/jZRy4exYbY3Gwt3/P55qJAQ3vEDiJ+7rkIGl34rDllLd?= =?us-ascii?Q?XjitNWCOsfTQbHqwdNUkzEqqhT6Ae2Ii1/swhQbe+yPEVSMuMA6wR8aJR/Gk?= =?us-ascii?Q?4ElCep2CNYd4pACLTt0gS6gAy1HVCbJr1+2Ws1KxY9t0BKtSO0aqUZnqBDOp?= =?us-ascii?Q?SBdH+3sK6BQb0qen1M/kStGlAbVUl7/RaB1gtdXL5OJ4rXtZn1tu2z7yF/LW?= =?us-ascii?Q?00Vq14Q/sUOCVcNB2/aWat7yvLiFTAc7lSX+V3vD9RthGBPoo7RM9YbB5z+9?= =?us-ascii?Q?Rq+YRGHnxm2RSvDZoxFnGaV1PJydJKKaxug3nykIZqo97yEXc79CJO6U3Ed3?= =?us-ascii?Q?XWHPRctDu/2oWnM5HMAKK4DmiZLbcwyILwles50R8Ab5TIFI96ZX97IfE2mj?= =?us-ascii?Q?h/r4+TedZtRE+LKpRbjVDslmG4wWT8ggivOd/nfL9/b3e29fPWWQGDPxpVSJ?= =?us-ascii?Q?IZzUlodW9D4VRTUgi1yzVG/VcZGXJ+ieNDRFbWvUH0nwWHm9Vw0K8HmOtUhX?= =?us-ascii?Q?CU50Ow4/ZTTkMFipi7bCMlslrootd/rmVM/qEujIn2aCbcaw22C7Xal0Yi0d?= =?us-ascii?Q?zP190CRUzQ9InD7Ae40MyoSMcpR+S1cWDyAiatJjJzT4xSvd9LBE6GeS93Cg?= =?us-ascii?Q?vScoZx59cl4YJGSQcUf4V2N3VLSygBHNlngL/O48LitQECiXsCv6S75HYbYT?= =?us-ascii?Q?nXPWCxPUeS5/XVd74hN5/haGNWB4eHzdVWHCpbASIax7PZRDea6moWhzLx/P?= =?us-ascii?Q?N/NA0t1+tIyqwvzZiOkP53VYVZaK+JVj1GKnyKQHod9u9Vyu1Sm2lxdS2Lke?= =?us-ascii?Q?zgsR4cuHVQbHRAoTM9pw7V2n2OtiuLBMJElB+MS9xEX6JjtiSe5uy1VMlA6V?= =?us-ascii?Q?u+7OVNsIEGE/HJsJMW2B0ysnCPC+2NcTv9OltaB01zsH5JkpSyZGAUPyZ7s3?= =?us-ascii?Q?DdBOBiF2mL3WnZ8hfotSTgUMqG6d2yg5ouGQ353AHgxIyT9Cmrd6oyKgMQtR?= =?us-ascii?Q?GAk0P37QFw+bJDsrLnV3k+I0Llx+geiJ/C+IGB7Z/CGCZTmUF8R8/dOYvzN3?= =?us-ascii?Q?gADX88Ptf00ohqZR0E2ewPKhSJnzMNrksTZmN7Z7SsACpdAhhua2hTxTlxSg?= =?us-ascii?Q?4WTbQInIW48U6aNpVNUQGdrjGQuweR/nT37pw031ywiGgFzq8uzjcuNvKjPA?= =?us-ascii?Q?/9x3ptzhub6ciszqdXjHzX3cCSJUhDlQT4iLf/nSwcZxxCyLvmvxtp1R/fxJ?= =?us-ascii?Q?DAPfCC19QJn2xi1ECOrBV5WYRmBVxsBkCVw0BS7j?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 1+Wm9M5/VIg8TPPQFi1f2mXj4OJVzME9kNDFxO5pR/aw62HSMEqxZsGtHFCI3s3hwAV4nJzg1cRDVziX8JvSsIELKbDgxi+43FU+CcOe09e0qdkH8T6hyUVQHIwIW1EFkuBZyV1A/sR2huVLnM9hf46j3L5WR60zIZ93k5ZkRehgpeMy6e0CLc4ROP09OrQMIlv9wGJDGudDlgEOhjfAEMyy0VR+pbFRNP2ofzvF4PHZ5iuQs/DllmphQcyNz3lrXnbREy4kxRaAgIDbtyOv+ptxii0MK2GawQVHJ9TrKMsLk2YrgTgAf5a3mOTsbnGH8QFk9ZriuFDRKfI6QSVx1qJ12wG5S+JREVnrUgbOWGoEnWBAZ+wbQOQLhTe11AHzouGVUJjFQ7oDbHR9Ewdhq7hVf1yGR+DzlCCHHaT1u3XeRRLXQJOfSCtXNIqbORxPxVY1QpXltQVZABSdNC6KEHXlzMp8NO03q9rOVEZhxDkrPKRLz+4LFRHipsWv6Y4lC8pWuUrNrm47HpqIymyOwqONl/BhEWaNri3L9gEUmPmlusnvccJWL9V46ZQzECcuRM8rDnBqJUazpCDV7PRrHFfUIi4FUMxslERmcNPXecwlLWZc9320l5TnE0bF/d2n X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: dc1ded77-deaf-4c2c-8630-08ddbe3cdc1f X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Jul 2025 16:31:15.6296 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: dsBG+02gA/q7sibTTS0U/DCiR/2iJpcS1jVKoKbRlYEB3raGBnpEHlvAasu2INT7QMgfasjkAPrH5if8DUZGOg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY3PR01MB9296 X-Proofpoint-ORIG-GUID: OZeMhaGP0SS3p5FeVfeXibF9YgPLo6ma X-Authority-Analysis: v=2.4 cv=LPFmQIW9 c=1 sm=1 tr=0 ts=686d47d6 cx=c_pps a=19K1aDEwnJ0RahI1emVHDw==:117 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=kj9zAlcOel0A:10 a=Wb1JkmetP80A:10 a=8rWy6zfcAAAA:8 a=jQOgFn-ZAAAA:8 a=jZVsG21pAAAA:8 a=uFxwEMWnrUFpSNHOfRYA:9 a=CjuIK1q_8ugA:10 a=qD6V08GEuMQA:10 a=CpI5luEOp_IA:10 a=vG2Rtv8y2ccA:10 a=YjdVzJdQTyZRADMV7wFX:22 a=mT82qxFQzDvLIExZS32s:22 a=3Sh2lD0sZASs_lUdrUhf:22 cc=ntf X-Proofpoint-GUID: OZeMhaGP0SS3p5FeVfeXibF9YgPLo6ma X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzA4MDEzOSBTYWx0ZWRfX6tH0qmmfBoqx S7GwYfrWndtPwilvWf/KJQ4pBLWIemLLpqowcjiuiIWWG2BmN4H+zNbHNrnJC8eEpHtKp+Ui1QR U/pwyNphbm6L9EaNjqC7CCiJNnJvB0wJMf36JcCcexdU/TBcvi6j8IS7fWlBUii2mSRu6DjIUiw wsOxtyicWZ1qnZGkxxOdV3cQRp40LKdr7feouF/B9ieo5zNuoBs4UO3tL/iPW7v16IMHvfofxAo OAM9TfejeZkF1scxoYnBf5bn8UVnyriE7/UFpwRN0S6yh+Cr9wz0t47dJoILpMFVtVpwQCtxhQX LwcPCdZCuL92EwmjAZCPflyprY29uAlKWlFcj41CKRhz80SgHhz7L+zn765St7DcdvZbrVn2w9T tgG9CXFmILJKoOnIP0Z7zqFwbMlZ0N3uok7CUglNlcYu8VqMG9Zh1nhvFM3A6lz+lmltSeCg X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 phishscore=0 impostorscore=0 adultscore=0 clxscore=1015 mlxscore=0 suspectscore=0 bulkscore=0 mlxlogscore=999 spamscore=0 lowpriorityscore=0 malwarescore=0 priorityscore=1501 classifier=spam authscore=0 authtc=n/a authcc=notification route=outbound adjust=0 reason=mlx scancount=1 engine=8.21.0-2505280000 definitions=main-2507080139 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Ivan, Thanks, this clears up my confusion. Using API[2] to create one mempool fo= r the network Rx and Tx queues must be MP/MC. The CPU Cycles spent on the = common_ring_mp_enqueue increase as more ports are transmitting. The transm= it operation causes the call for Rx and Tx queues results in fight for acce= ss to the mbuf mempool because of one mempool? This is why you suggested creating two mempools, one for each pair of ports= . If I go this route what are the precautions I need to take? I will try RTE_ETH_TX_OFFLOAD_MBUF_FAST_FREE offload flag first. Thanks, Ed -----Original Message----- From: Ivan Malov =20 Sent: Tuesday, July 8, 2025 10:49 AM To: Lombardo, Ed Cc: Stephen Hemminger ; users Subject: RE: dpdk Tx falling short External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. On Tue, 8 Jul 2025, Lombardo, Ed wrote: > Hi Ivan, > Yes, only the user space created rings. > Can you add more to your thoughts? I was seeking to address the probable confusion here. If the application cr= eates a SC / MP ring for its own pipiline logic using API [1] and then invo= kes another API [2] to create a common "mbuf mempool" to be used with Rx an= d Tx queues of the network ports, then the observed appearance of "common_r= ing_mp_enqueue" is likely attributed to the fact that API [2] creates a rin= g-based mempool internally, and in MP / MC mode by default. And the latter = ring is not the same as the one created by the application logic. These are= two independent rings. BTW, does your application set RTE_ETH_TX_OFFLOAD_MBUF_FAST_FREE offload fl= ag when configuring Tx port/queue offloads on the network ports? Thank you. [1] https://urldefense.com/v3/__https://doc.dpdk.org/api-25.03/rte__ring_8h= .html*a155cb48ef311eddae9b2e34808338b17__;Iw!!Nzg7nt7_!GXTS2DQR0JZFGhdahtcp= SBjmoh-AZ4dzS73R_J9A1I0JxlORLHvylHea80X_KHTZRcZV4qcMEvJd7Z7izij40zap9fvA$ [2] https://urldefense.com/v3/__https://doc.dpdk.org/api-25.03/rte__mbuf_8h= .html*a8f4abb0d54753d2fde515f35c1ba402a__;Iw!!Nzg7nt7_!GXTS2DQR0JZFGhdahtcp= SBjmoh-AZ4dzS73R_J9A1I0JxlORLHvylHea80X_KHTZRcZV4qcMEvJd7Z7izij407rwGv1P$ [3] https://urldefense.com/v3/__https://doc.dpdk.org/api-25.03/rte__mempool= _8h.html*a0b64d611bc140a4d2a0c94911580efd5__;Iw!!Nzg7nt7_!GXTS2DQR0JZFGhdah= tcpSBjmoh-AZ4dzS73R_J9A1I0JxlORLHvylHea80X_KHTZRcZV4qcMEvJd7Z7izij402Z4uOww= $=20 > > Ed > > -----Original Message----- > From: Ivan Malov > Sent: Tuesday, July 8, 2025 10:19 AM > To: Lombardo, Ed > Cc: Stephen Hemminger ; users > Subject: RE: dpdk Tx falling short > > External Email: This message originated outside of NETSCOUT. Do not click= links or open attachments unless you recognize the sender and know the con= tent is safe. > > Hi Ed, > > On Tue, 8 Jul 2025, Lombardo, Ed wrote: > >> Hi Stephen, >> When I replace rte_eth_tx_burst() with mbuf free bulk I do not see the t= x ring fill up. I think this is valuable information. Also, perf analysis= of the tx thread shows common_ring_mp_enqueue and rte_atomic32_cmpset, whe= re I did not expect to see if I created all the Tx rings as SP and SC (and= the workers and ack rings as well, essentially all the 16 rings). >> >> Perf report snippet: >> + 57.25% DPDK_TX_1 test [.] common_ring_mp_enqueue >> + 25.51% DPDK_TX_1 test [.] rte_atomic32_cmpset >> + 9.13% DPDK_TX_1 test [.] i40e_xmit_pkts >> + 6.50% DPDK_TX_1 test [.] rte_pause >> 0.21% DPDK_TX_1 test [.] rte_mempool_ops_enqueue_bul= k.isra.0 >> 0.20% DPDK_TX_1 test [.] dpdk_tx_thread >> >> The traffic load is constant 10 Gbps 84 bytes packets with no idles. Th= e burst size of 512 is a desired burst of mbufs, however the tx thread will= transmit what ever it can get from the Tx ring. >> >> I think if resolving why the perf analysis shows ring is MP when it has = been created as SP / SC should resolve this issue. > > The 'common_ring_mp_enqueue' is the enqueue method of mempool variant 'ri= ng', that is, based on RTE Ring internally. When you say that ring has been= created as SP / SC you seemingly refer to the regular RTE ring created by = your application logic, not the internal ring of the mempool. Am I missing = something? > > Thank you. > >> >> Thanks, >> ed >> >> -----Original Message----- >> From: Stephen Hemminger >> Sent: Tuesday, July 8, 2025 9:47 AM >> To: Lombardo, Ed >> Cc: Ivan Malov ; users >> Subject: Re: dpdk Tx falling short >> >> External Email: This message originated outside of NETSCOUT. Do not clic= k links or open attachments unless you recognize the sender and know the co= ntent is safe. >> >> On Tue, 8 Jul 2025 04:10:05 +0000 >> "Lombardo, Ed" wrote: >> >>> Hi Stephen, >>> I ensured that in every pipeline stage that enqueue or dequeues mbufs i= t uses the burst version, perf showed the repercussions of doing one mbuf d= equeue and enqueue. >>> For the receive stage rte_eth_rx_burst() is used and Tx stage we use rt= e_eth_tx_burst(). The burst size used in tx_thread for dequeue burst is 51= 2 Mbufs. >> >> You might try buffering like rte_eth_tx_buffer does. >> Need to add an additional mechanism to ensure that buffer gets flushed w= hen you detect idle period. >> >