From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4A9BB46B08 for ; Sat, 5 Jul 2025 19:33:32 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DD2154028B; Sat, 5 Jul 2025 19:33:31 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0b-00196b01.pphosted.com [67.231.157.166]) by mails.dpdk.org (Postfix) with ESMTP id 10A844025F for ; Sat, 5 Jul 2025 19:33:30 +0200 (CEST) Received: from pps.filterd (m0096262.ppops.net [127.0.0.1]) by mx0b-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 5658fIKS006890; Sat, 5 Jul 2025 13:33:22 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= netscout.com.09.24.2020; bh=QO0d3z8kSwVmiHv3bWpvUYJXlg2P+LN7FOJn WQI6Xmo=; b=rKFDJ84+8xDtPtI1oy17hq6vVXsJ2B3SNzzYcmZb75erxSMXdqOA 5B+DUNqjRukVsoEsvRANRa4N17PNVM8e4/yVjZI+ACpbdIWwSDxiWeuxS9yrXeuw /S9DkOvh3sAwveiJcEUMC7LZx7qfK4FomaGXTKuVRXdnB9t/gk1lM4YW7pSoEsvC KUGeLItteyyWQlWpoetBvy4YkHOPuGJ1mQgRNQCUtgGOBOVFM8L57yZLbsDJPSJR /K8b6XhZOctJRXh4UXEu2Tmqm8CTri5nUG2lYEbopy3FMRTlfGJjvc8MdMceUmPs 5beB+8uhFN3YnC+q7REuWpK/CFex/aSnXw== Received: from nam10-mw2-obe.outbound.protection.outlook.com (mail-mw2nam10lp2043.outbound.protection.outlook.com [104.47.55.43]) by mx0b-00196b01.pphosted.com (PPS) with ESMTPS id 47q0r409ep-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 05 Jul 2025 13:33:21 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=WVlzlnasEpK50ZXVqrx2WB2QG3RXvwaPA2cCSCMp8Gg3hF/iRJm/ADuDn9UQIpFaH8xVffQzyyTfuhO0gESc39olosomozsM1ZGdcK4/K5Vqg1rNgVgbXhf1FFOVLUWLWktV7Fu9UNkOpw0P4xDI1LqIT41hM3kmzakQu/auws6h6QJcXcDBNzCFFhqFfYZr/S0iyiM2jkrY2XDgIvR3CmnxX+5uEupAu7E1EwjwN0InVEgvisBPxWBaEYZ2qVyH3rkk7CYGZXXep2FoJvL0NOhndx8PGZ1Rkm1X0dRy3UQUvPiyneYey52M7xvz/HFalYiW1ay9DYzbLORoSuEN0g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=QO0d3z8kSwVmiHv3bWpvUYJXlg2P+LN7FOJnWQI6Xmo=; b=wwb6xvXYQS2Dghq7jHHOhcfyGQHZv2XsZrEC89Li4ooHvysugJQhmEnKo8CaZ0PuujWocla2zn65hG672+A6071t76zmAgHuGYXaIE05Z65lSTBbH0vfSGzD6ERz3kmsIqUJMAGnvGcDE4vhXM+FF33i8CymxlIo9Fp3WvFeu5DDMqCssoQFAvfxAqti7uU1yVeKDo0D9O3BFgcQAS0mj4er73doLmsWOYvlHXx8HvI/NcVt29eE6WB8/b7CplRBLoRABCxW//DzOsICkIssxvKZ71OpeIBHlqLuXHJViOs/SJYRtlLq14Ip1gykrfJT/j0DhlDI6XpXbh046eoVAg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by BY3PR01MB6563.prod.exchangelabs.com (2603:10b6:a03:367::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8901.23; Sat, 5 Jul 2025 17:33:07 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd%3]) with mapi id 15.20.8901.021; Sat, 5 Jul 2025 17:33:06 +0000 From: "Lombardo, Ed" To: Ivan Malov CC: users Subject: RE: dpdk Tx falling short Thread-Topic: dpdk Tx falling short Thread-Index: AdvsS4XiFhfr9tUWTZG/9hrfPmeo0QAjYaoAAD5VNvA= Date: Sat, 5 Jul 2025 17:33:05 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|BY3PR01MB6563:EE_ x-ms-office365-filtering-correlation-id: c3bf0d96-c9a4-4e87-410c-08ddbbea0064 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|1800799024|376014|366016|38070700018; x-microsoft-antispam-message-info: =?iso-8859-1?Q?DzgmA66BPIbUcd2d1RZowoyldl7peKmJrdqEfGvsz82HqUZJjha7cW10aE?= =?iso-8859-1?Q?bSiZE5k9R6y1JlVITCuP641JWK/dGmqAXNBhKSdkLdU3Q/Rovf0ErPMgEV?= =?iso-8859-1?Q?Kb7DJ8+TRrNomD3ILTir+J5nFq4I+QvJVc/g9RI3C8QDWT30bJKQ6/8AwY?= =?iso-8859-1?Q?UCZxRRal1/Nj1aOu50wmATZMIP3Oy8ZC3qE3HTWDU6zFxQN7+iZkz3MNgt?= =?iso-8859-1?Q?5mfoC38ZMXGNW2gZ//h3ZyfiCnyUqOVjScE80TothsjQK4tRL/Nw9A+7nG?= =?iso-8859-1?Q?T+oUA5EWsGMOxRd6lH1WjBdPkeHSWFVQ0G+QDmLN+CtGCJe+gFM6OgqdHa?= =?iso-8859-1?Q?fek7cgW4w3OqpIVBYz5BqIIuCITJVwpkRChoscNjJSlPRUdA9FvFRi+V1k?= =?iso-8859-1?Q?UgMGoBACxx87sq4JjN8yejDYb9YI9CrR+VwFmPV+yqZz7bOMtssXpP6RKw?= =?iso-8859-1?Q?Yeq7wfJNNWtnCHb0Mf+Ab9LmylMUy87alzfeNMU9H6gJMPZRND6Tk2hW+A?= =?iso-8859-1?Q?bXR90u/USifWzjdwK2X41T7YMK6vY6Shf7g5iqP+Myr/aIW7lExpYJlbTm?= =?iso-8859-1?Q?TocxEO9lGFrFZOG+0zpT9DlXEPeYl2PM7mYrL+wgtSnSk4ztccfa84goBQ?= =?iso-8859-1?Q?ARLepTajs9wDiEIlUO0YNXr2ZUVNXppdSJ5B/RwVTfyAig/OqvYfL4me5u?= =?iso-8859-1?Q?NNZlML5KCx2Yh/AsmLW4LItNBxCWlwqlLPsT7wc6Rrf5eXNStb8sKNZNMo?= =?iso-8859-1?Q?8g3Y1WUePAUMxdD4+I9cj++MhbhuDxhXS9SqlYODws0YEjTti82uZbC453?= =?iso-8859-1?Q?BAsOUtJDxwjioIxNbkvOYs5Fb59vTbkYIEjOQOKzd1p6T6P77I6g9KkI78?= =?iso-8859-1?Q?qsfn2fuPwlYl5724senY4mBfJUaVo0YXwAqMtstsBKKMBo3y58byGAi65j?= =?iso-8859-1?Q?r7ZzcUJ3bE4HfCac3shT8FH0iAHGHyUo5wa0QW0o5zuUhGvlddEn3dR+W/?= =?iso-8859-1?Q?onoDVkOIgCraJsCGr93qSj7YEAVbytf7r+qC4QGqYbTLqj6oKjybhQkIDN?= =?iso-8859-1?Q?/AKRBUImh+sVY5FRjPF4Op7SinhhqfnYdDRzUVrkMW8J9zeuIDKw2OxBKX?= =?iso-8859-1?Q?GqK7iUt0n3h5GFq7LiNjV+Nf4nreLPRt2jE/W1FHK12WxCtMqUVvEdJgHN?= =?iso-8859-1?Q?QOa3jt9NlgAYqN2ZRZSR9sHItYwql/2kfX4foJ+9xF32nmr9yX2Bop3YyT?= =?iso-8859-1?Q?xWRDlOsPhoiscRymbXG8BzeAMw6LzPln88UfUe6MWYCxIUK2mtfR4treMZ?= =?iso-8859-1?Q?W7k6Kq6Opy5sghGlMwsarV8Ow1wtDkYghMJFMHCfdxN+syKauSmUpXYlAm?= =?iso-8859-1?Q?itHXy2OIyAFDLT58mICv6IeYT7YM+gg4x9jg8mfGCkZI11F6Tz7WGBq2M7?= =?iso-8859-1?Q?gSI2OEXHquFztBSUAQc/Rv9WvcdIf/rC9ZOXWJAGJ1bWgHv7D9bmxItA6O?= =?iso-8859-1?Q?kNgf5dkRYk+Fnr1kTvMYm+xz3zncd4WJBCkjnwZhdWqw=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230040)(1800799024)(376014)(366016)(38070700018); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?jDo8HtaSlXmFe5G294AHZXS6FRv607ZSuPe+kE1o2BBMq53wpgi7GeDkRK?= =?iso-8859-1?Q?uQilII+xjUcy/8j+PzjvaXc02SFlTcWPAKDH1RqGb9XPoKj1eIeCRe1L5B?= =?iso-8859-1?Q?XwhcbxmVP+11YwDu8Sj/X/NvRuvnY1aM4KwbUP92QgOf5r6xVVHLh4z+WD?= =?iso-8859-1?Q?NCXmM7xmAC72RlxVCXMFSshzfeE1/enAHpqLCHALAQLJiJZQfbPm3veM70?= =?iso-8859-1?Q?nj4aJPp0KMbt2QnDaRVYgZ/BvCIxvTkrEfNc5qLeug7kFgTjVozd3/vhq6?= =?iso-8859-1?Q?XdRnUAwAqPcWlobd563+1YrkzsgKeDJf3NY4W/rudAxTtRRACE5V93YjmC?= =?iso-8859-1?Q?mxt1+b0pwOK6TCAsa25S/d1UBQ96/0/uN09a5ITa0udTFkcZPUb0KGtIiI?= =?iso-8859-1?Q?WlxJ1voOlmIzTRnrZ5nCsHt/8cp5Bu7clrA1JO9IY9/MvHZL2nMfcrsggU?= =?iso-8859-1?Q?prLOZjMpZHMIhTBb511up5SvvgoyQIZxYihozEiAHqJGolYzo8eS9Q8h+Q?= =?iso-8859-1?Q?Zr0PbthJhBPos4vhto6AoGDtva1YurITR6/qkWubm5FyiO/Gdv+6I0UvIa?= =?iso-8859-1?Q?bWN6/uyLBT2o3MYpBWs9IdhnbK6uNJNTZt+/gMGfAqg9X0TIZ7vePMHV6O?= =?iso-8859-1?Q?V3Bb4/mFrO6WtjCZWq8W/A/BvruWjOcx2SjWHhIvs4kNN6DDiCHnPjgNwq?= =?iso-8859-1?Q?sYMIloe/5K8KKD1A0is7zdQxWneDKxD20ADIATpcnjh2L3dVCHclUsIxDV?= =?iso-8859-1?Q?BgClkXE3Dmx2qWLG8iECOQn8MnjJvLKtHtrICi3v2ZTSFKJ9eGukvbcs8O?= =?iso-8859-1?Q?KZeROMyHn5MmCDqKgh+7Mlxz8TbsNrE8y8AA+ikFuPL1Su3C6jpro0g6/s?= =?iso-8859-1?Q?bKEFXdqGuCmbTdNorWcVglbuj33JUm7PFtTkyXgB5AUpEaE+OHDtqodZ9R?= =?iso-8859-1?Q?a5Y0SDOVQiNmJ+uQfou/0oN+yg8WoKyjmSBlCiwWsRkxBSc+onoPTW0qXf?= =?iso-8859-1?Q?PlD1H6309YhsuQd+gING2GOZRaXgxDj0dSZnlohvvDNj/zVXzVI5UgWPyd?= =?iso-8859-1?Q?wy+jPiFZXUugVN3dJ8gFJwYlyVsjikPsUw7a372V+WoNF+gwPTYk1miwQD?= =?iso-8859-1?Q?AMyftDjwb+kwUBlGJTAo5+2+/S/0xBo12CDnDR97bkwCppHwHfxywEjvvJ?= =?iso-8859-1?Q?oJ64/+bPJ8q6BcORi7VZj0lIaUxqpbxNJapODpq2UFVDOrLqpf8V5RupuN?= =?iso-8859-1?Q?M5UJkZJhM6aUJibiAyAST4o77MPmGvTAjpR4o9/524rrOsZ7DrYRINilHg?= =?iso-8859-1?Q?MfhGFLEvsaGygTObgpbe1naLN2EAflJcqPY2SbdPX4rK6Tc6JYJiGvMqCA?= =?iso-8859-1?Q?aywPCPQRXfC3d9tN1bOwhihV/NuQcAh/MiMznVss+lgvKAGUfMqNzWpDB1?= =?iso-8859-1?Q?mLvg1sMsXqqToL2lKIPoNWu/WOyxycCLgs3mFvU6+M+jU0B8bZfwVYLQ1N?= =?iso-8859-1?Q?qEkJvUDFp7/nzt+vb9FVSMa5ITOhc/3g7UbFWEN/Cp5skg8oANd/0RFdrk?= =?iso-8859-1?Q?fTkOWPdFsHfw6B/91hr+aAPi3BNoxxQnkAmG8Un1qToBAoFcJmt8XR/+F1?= =?iso-8859-1?Q?RtfAn2Xi9oQCM1CYBXrypBtB1OsQf/1qen?= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 43YFdUbtaSXi6xCnsAwo/rAWzmegnrQP/unGZFCpOyU3ze/Ieq37k7K0uIbOQP1CaKoBzJolt4WFT81i7/YlcI2jA7l3FGcIOUVoWhyKFS0qqAjJ40WPLNT0drd6uOCukZuxuydQ12f49JunvA4LOow07JkLEFK1rSpMZIOu24aYwdl9RUoSHcZ92C/WCqbik6fUX6LyLYf5IWRllMsk6Z6HXJg5O3GkgGYUxhLFYOiXxxP7xTPYhsCXP6fBK26i6rEjVjIn+gmeAEwAi32ccCt3d9E8Dhvktue/2SZ4bVBN5qDansiUw+z5YNlnD/Ci5dYdC5ZTAvrx5aKBq0inh1EzcplunKu9j27Kv8PkHW7uoPWPJZgY7+mbnyh6gJCGGjGcY7DnBGG45fY4u5rn87mIFOS/HqTcwwkXFlKYmjAKQbhnKJrjUh8LauCvEDTv1MnUC52TtbzoFJBpgbKK8b4OFA0Uggq7dGqBAWW/L17eS053J8uJFCk2Bmj12jn06CuHKtCQMG4ca9/Ll6mIUCX9LFhyh3kogQX4dUa5SA1r+7HDOu6rsOya/Z2KK7mnhCc9JX981QYEJcf6s8stfq5njK9YRfknHCdXnEfEsv14GeNNTsw4PWK8B6STHme2 X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: c3bf0d96-c9a4-4e87-410c-08ddbbea0064 X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Jul 2025 17:33:05.9414 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 8f4IjnvniJa9BmlNKWSf2z0PQCpzLsMp/R3ws+pd0jBhwvUzICXcSBQDmkRoCc7/pQV93MiNk218U1GDPdYINA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY3PR01MB6563 X-Authority-Analysis: v=2.4 cv=SLZCVPvH c=1 sm=1 tr=0 ts=686961e1 cx=c_pps a=2TzYObwzRp/N0knVItohZg==:117 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=8nJEP1OIZ-IA:10 a=Wb1JkmetP80A:10 a=jQOgFn-ZAAAA:8 a=8rWy6zfcAAAA:8 a=qQBYhcCFXXgQChYGG10A:9 a=wPNLvfGTeEIA:10 a=mT82qxFQzDvLIExZS32s:22 a=YjdVzJdQTyZRADMV7wFX:22 cc=ntf X-Proofpoint-Spam-Details-Enc: AW1haW4tMjUwNzA1MDExNiBTYWx0ZWRfXzexryEhEeEWg 2K1UN1hs+3Rrp92qLWDXJJ/LGzfWgCLs4EyKHCwXTYQpzB8HPxQ0fmj0Gy2fBvR8jrridZGaL8A O9kA9xnXXCTy+SozEqmoHC++yimBlWUh1Yk+1C47tqMMfm35ZB14EL6c0JI4WqaFFbfxEFsPdl5 Dc4zK0BUBtnnoy9A4oP5pW0lGphNL8pTkAa+9QNTnSgGoyQ0NDc188xu3JQIR5MS3wh8EqK0wQJ bAlR7mRJ3/zdqoeZdo2HFZ8jo60OwJsSvtiuDYStGeSHm1BlIRowsOfyRxetYmy+9EH86iDaKSX 63LBrVDD52MH39jzFZOEvzM5JLumWK4+yjplqy2U02lc+yUqRVtkjIvNxzGUi5SI2j5mFdwaUbh fJBusgWK5y02VYkieUjcHGMcx4914qeTUTQXFfhNcN1EZmhmCqZ3sQcrJ4aqQNx+KQZKkQns X-Proofpoint-GUID: U1whjSvtKoxdP-kVseDnM0Xh3ABScTwY X-Proofpoint-ORIG-GUID: U1whjSvtKoxdP-kVseDnM0Xh3ABScTwY X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 malwarescore=0 mlxlogscore=999 lowpriorityscore=0 suspectscore=0 clxscore=1011 priorityscore=1501 spamscore=0 phishscore=0 bulkscore=0 impostorscore=0 mlxscore=0 adultscore=0 classifier=spam authscore=0 authtc=n/a authcc=notification route=outbound adjust=0 reason=mlx scancount=1 engine=8.21.0-2505280000 definitions=main-2507050116 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Ivan, If I create dedicated mempools per port pair, how will this benefit the sit= uation? Thanks, Ed -----Original Message----- From: Ivan Malov =20 Sent: Friday, July 4, 2025 7:45 AM To: Lombardo, Ed Cc: users Subject: Re: dpdk Tx falling short External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. Hi Ed, You say there is only one mempool. Why? Have you tried using dedicated mempools, one per each port pair (0,2), (3,4= )? Thank you. On Thu, 3 Jul 2025, Lombardo, Ed wrote: >=20 > Hi, >=20 > I have run out of ideas and thought I would reach out to the dpdk communi= ty. >=20 > =A0 >=20 > I have a Sapphire Rapids dual CPU server and one E180 (also tried=20 > X710), both are 4x10G NICs. =A0When our application pipeline final stage= =20 > enqueues mbufs into the tx ring I expect the > rte_ring_dequeue_burst() to pull the mbufs from the tx ring and=20 > rte_eth_tx_burst() transmit them at line rate.=A0 What I see is when ther= e is one interface receiving 64-byte UDP in IPv4 the receive and transmit i= s at line rate (i.e. packets in one port and out another port of the NIC @1= 4.9 MPPS). >=20 > When I turn on another receive port then both transmit ports of the=20 > NIC shows Tx performance drops to 5 MPPS.=A0 The Tx ring is filling faste= r than Tx thread can dequeue and transmit mbufs. >=20 > =A0 >=20 > Packets arrive on ports 1 and 3 in my test setup.=A0 NIC is on NUMA Node = 1.=A0 Hugepage memory (6GB, 1GB page size) is on NUMA Node 1.=A0 The mbuf s= ize is 9KB. >=20 > =A0 >=20 > Rx Port 1 -> Tx Port 2 >=20 > Rx Port 3 -> Tx port 4 >=20 > =A0 >=20 > I monitor the mbufs available and they are: >=20 > *** DPDK Mempool Configuration *** >=20 > Number Sockets=A0=A0=A0=A0=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0=A0=A0 1 >=20 > Memory/Socket GB=A0=A0=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0 6 >=20 > Hugepage Size MB=A0=A0=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0 1024 >=20 > Overhead/socket MB=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A0512 >=20 > Usable mem/socket MB:=A0=A0=A0=A0=A0=A0=A0=A0 =A05629 >=20 > mbuf size Bytes=A0=A0=A0=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 = =A0=A0=A0=A0=A0=A09216 >=20 > nb mbufs per socket :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 640455 >=20 > total nb mbufs=A0=A0=A0=A0=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 = =A0=A0=A0=A0=A0=A0=A0=A0640455 >=20 > hugepages/socket GB :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A06 >=20 > mempool cache size=A0 :=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 =A0512 >=20 > =A0 >=20 > *** DPDK EAL args *** >=20 > EAL lcore arg=A0=A0=A0=A0=A0=A0 : -l 36=A0=A0 <<< NUMA Node 1 >=20 > EAL socket-mem arg=A0 : --socket-mem=3D0,6144 >=20 > =A0 >=20 > The number of rings in this configuration is 16 and all are the same size= (16384 * 8), and there is one mempool. >=20 > =A0 >=20 > The Tx rings are created as SP and SC when created. >=20 > =A0 >=20 > There is one Tx thread per NIC port, where its only task is to dequeue=20 > mbufs from the tx ring and call rte_eth_tx_burst() to transmit the mbufs.= =A0 The dequeue burst size is 512 and tx burst is equal to or less than 512= .=A0 The rte_eth_tx_burst() never returns less than the bust size given. >=20 > =A0 >=20 > Each Tx thread is on a dedicated CPU core and its sibling is unused. >=20 > We use cpushielding to keep noncritical threads from using these CPUs for= Tx threads.=A0 HTOP shows the Tx threads are the only threads using the ca= rved-out CPUs. >=20 > =A0 >=20 > In the Tx thread it uses the rte_ring_dequeue_burst() to get a burst=20 > of mbufs up to 512. >=20 > I added debug counters to keep track of how many mbufs are dequeued=20 > from the tx ring with rte_ring_dequeue_burst() that equals to the 512 and= a counter for less than 512. =A0The dequeue of the tx ring is always 512, = never less. >=20 > =A0 >=20 > =A0 >=20 > Note: if I skip the rte_eth_tx_burst() in the Tx threads and just=20 > dequeue the mbufs and bulk free the mbufs from the tx ring I do not see t= he tx ring fill-up, i.e., it is able to free the mbufs faster than they arr= ive on the tx ring. >=20 > =A0 >=20 > So, I suspect that the rte_eth_tx_burst() is the bottleneck to investigat= e, which involves the inner bows of DPDK and Intel NIC architecture. >=20 > =A0 >=20 > =A0 >=20 > =A0 >=20 > Any help to resolve my issue is greatly appreciated. >=20 > =A0 >=20 > Thanks, >=20 > Ed >=20 > =A0 >=20 > =A0 >=20 > =A0 >=20 >=20 >