From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6CC894653B for ; Wed, 9 Apr 2025 06:46:16 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 093C840430; Wed, 9 Apr 2025 06:46:16 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0a-00196b01.pphosted.com [67.231.149.170]) by mails.dpdk.org (Postfix) with ESMTP id CDD82402D7 for ; Wed, 9 Apr 2025 06:46:14 +0200 (CEST) Received: from pps.filterd (m0096263.ppops.net [127.0.0.1]) by mx0a-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 538L04m9005868; Wed, 9 Apr 2025 00:46:14 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s= netscout.com.09.24.2020; bh=FqWVuhDIzMNYttSpvPqqmyMjwdQNt1zVaoEH s11Jjsg=; b=n64GbdMCdQhbUluru480uxz7H9Ie70ocAeLmQ/mDUvFS2/HY6w13 1K9s9K7dOo3PgJhKOeA7QyOzx59UZ74VMQzOg9XLKsqUUS4nTdgutu5W+3DEYGmv CTQnZAhUWl0c1V4N4aN3smESlZ/BSzTrxnKYHmRCLXT4XLWseN8wRclwUxYhFd65 30XZjOnIPreJtoH3DBzAgk6z/4lGoyF1wWEFRSsOkhZiQQpBR86ozwRDEYvjMKK6 Ikk+ycrkAlaXa527CiPAk7ORsb+5bZwMB9O7gS6+ZGhMeXOsFTiLIxcbAixCKA8B bWIHvE7Z0jLrXHJeSD8JtJBjZe7LWbaKsA== Received: from sj2pr03cu002.outbound.protection.outlook.com (mail-westusazlp17013077.outbound.protection.outlook.com [40.93.1.77]) by mx0a-00196b01.pphosted.com (PPS) with ESMTPS id 45u18ev86b-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 09 Apr 2025 00:46:13 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=jNVqNZkT4ffAvv+kQvVOLRAKbUb+LNMyXxVXPkMvaotYUyK0eGAka6Vi72m4rp5Y+rXVwM3LSteHRiqJbM/IoGE/UamraJ0Lt55TcqaCJ1w6T0eYKLh5G9xxO/gBSU50OvDo7ZUduw4/0hcP4P5FybqiE2fsiPjlqLBQ1rddjZ9sgHs8LC6DMj6rLuK1+vADQ9nDnnlotXWRLGhZqwUhan4WhbWIS5FGAR7AvVEKn2ybIezv/rgCOIB9aAz2r8V+h8phO9ZElfdhgUxJV/OYcpKC8qAtQxCjN2ORmb6zLb0W+mEhUnQ+DEP2LNtjqzFqa9JbNMavE871jXw7qyTwfw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=FqWVuhDIzMNYttSpvPqqmyMjwdQNt1zVaoEHs11Jjsg=; b=XlGcUYhgiAa8QAOn1JPL+ph62IErse4jXousUedooo8QOh2Gmf4N3ujLuZMuSan2ZfyDuvREh45nmK2J/nVIprx8lBdhSshjINmpunvOIeCQTfbK2RSrQd7p5MsfQRO1vHhSFIFENWhhWTopyywy0ToaSJHhn5fAWgu1BgNysoV7RcFQPURyVKCxD0tZvY1PhNeyBIK/yfXuS/CUeq955HNhwHQlGOYS8R2ravZa4jEzPv9qt+k+LUEQZ/nfmpp6kydl87qA+RI629iRnuaI1TSSK/t2rUh+sugKcX8Zo3BNfJaHvlvH+42RMiYGieRlbHUoKYp9gma1nkCZagzbgg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by SA1PR01MB8111.prod.exchangelabs.com (2603:10b6:806:33b::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8534.53; Wed, 9 Apr 2025 04:46:10 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::80c4:7216:f070:e5fd%5]) with mapi id 15.20.8606.029; Wed, 9 Apr 2025 04:46:09 +0000 From: "Lombardo, Ed" To: Stephen Hemminger CC: Dmitry Kozlyuk , "users@dpdk.org" Subject: RE: mbuf refcnt issue Thread-Topic: mbuf refcnt issue Thread-Index: AdulnN5IfTxeCHcXQsa3xaXr7ECZhQAFBrWAAGffZNAAOS6kYAAzcomAAAGN4hA= Date: Wed, 9 Apr 2025 04:46:09 +0000 Message-ID: References: <20250408205341.68d37d0a@hermes.local> In-Reply-To: <20250408205341.68d37d0a@hermes.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|SA1PR01MB8111:EE_ x-ms-office365-filtering-correlation-id: a278e27a-75c1-440e-b05a-08dd7721729f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230040|366016|376014|1800799024|38070700018; x-microsoft-antispam-message-info: =?us-ascii?Q?fQnMn6/q7/w2J12Rt2Dqp3aV0E+wfLPs6Qid4qUxJm6kxP0Tf8i6oYaGvcQN?= =?us-ascii?Q?tP/Ew7vkiL65nnwTzH7kb4K+hRxWEokdYVcI3d3tRw+H7pvRpMN/Bdj69cfS?= =?us-ascii?Q?AfN0CQID1GfR+Orho4WXuTxA+JKA6BlHDVHk+uwx+3Un6+K/fsyJrxEmYIs0?= =?us-ascii?Q?nbhTMlhaNiyQD9T0xf4EWnnxYCNA+ay0hX8D/uxUMQhOPDlrg3Y9/WafX9wq?= =?us-ascii?Q?nIV/5dJmaMTapkeYt0i/Kpj3PqQVW2vFxGkNaFugziQpXDsL0OfxARt5EKVX?= =?us-ascii?Q?9+qE/5xmNeu9lwy6PilARVw1koSYCWlu9CnySE3eGgt1XOF2XcZXRCVFpvOm?= =?us-ascii?Q?CMLXt8N2k19W8Pzg+2SX9LzLllvUBNwNd/0U3ntcTdBtW60JTeE0MIwSxCAX?= =?us-ascii?Q?jFsWFEykidZ2CM0s3ruwjfktWRBGOdzg8GqcusFHWUg4pbvRuNrB13AfflFA?= =?us-ascii?Q?09jnYFzhLlxgfeeBahebaktU9q0eQXbzUdr7l+q5KQxjZcjJfT5YLlBh+QXq?= =?us-ascii?Q?nWNICjnqDkURzaZ3YfayLCPlX52hqTI1/G760MTy2xRub0goxI38TRhsl5bZ?= =?us-ascii?Q?gcLRwgdLA3MLEAlVPkpXZSF/6HRp3nOURVEGIBLuUfD/3ihpX0zwrkPF+JtW?= =?us-ascii?Q?Z5H35cDewtscGUx9OYF9KXj6XYmK42AvLlJkYXegjBv8mV6Gp91GkiRjLvZ6?= =?us-ascii?Q?DZgMRKhzo4pqU3xpwgrZfNOEAnbpL83IbXOpH2OnqnurYkzSpxCrEimNoRYr?= =?us-ascii?Q?3BfgAFOtYeGQTBmxis+yLDCwesF62Qj8nfOZg94E9hEXb95IewnseRHpceMQ?= =?us-ascii?Q?+zdIijiEqVgYKu1vyhcjJi7gY6m7kwlwW+avQgLryfnTUs7j8YptRx5nQb9c?= =?us-ascii?Q?Hj8PUB6o4DLqVYhqNpkSquk2cLhj/MfCtV55cBkPQFEC+JH1YuWoJduJgQ21?= =?us-ascii?Q?SatiFEMkV0M0ayeCtT809E/yOOKFsoNhLWmFzxXuF/TbxXnxHHtoB1MW5MK2?= =?us-ascii?Q?994POJPMjMzsPzHvkEWgmyVVX3Fx0mO628NIDV1NZrgFrzatuwR3N9uuJ10j?= =?us-ascii?Q?7yh2BTwcjkEObwVa4qdkI0MQLQwvYYvenxE+uT4V/oFf40f/YUm/iXP8wXuS?= =?us-ascii?Q?nSfvoj67rwFK5eiQsedAdXPJCD5yU1wPWcVwbWDmIR4m8JRoyvUGzZ2dLRbc?= =?us-ascii?Q?I3BGyhQSKFvme/tKehnJRDhRsg/rI5pzjY9Hu5/lX2VWBW1gspAN3T/JSaP6?= =?us-ascii?Q?6z9y0o7jseb7MmPqoofm1fZdEeLsHh5et5VG40Y2p4mKxT05jBa1Zb9vI01A?= =?us-ascii?Q?mJ6c2IK7I0H/i8kwsVBU1hRdh7iZ/VeF+IA3aPIudFbBdNGfAZDNOyA09vaY?= =?us-ascii?Q?8RvsN6kRbxRVcY2u2sRtrrVLAw6s6ocLpbh/hH/fqdQkuFaHUZ2fGwggrP8x?= =?us-ascii?Q?j8IbI25Hzz+kpGHnYE/G15QgI5g+S9ZrToQBQOwYIgwhB7fHo/OznQ=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230040)(366016)(376014)(1800799024)(38070700018); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?SdphGyRvC5flLS/yi+ySiC3/QJAtnWa2db7gcJk1fHvRDJjjcB0ZDKJZtQwJ?= =?us-ascii?Q?/WVs9bGsw1np3Xn4C6s5IK9Uq3QD7YHUJA7K89ohXDWbfBQHy1iz8RhMQ7bp?= =?us-ascii?Q?jMDXqNi0DOEgyI84XsQ/+RK3iB0QF0ixLU9AGRYkbTigI876Lz4sDCZFQiIr?= =?us-ascii?Q?gkshBsV7z5UyfSxHlC4+bz8UQ/yrD3bRCAoP5yzcpqmfhrI/y/U9PKnVkO8K?= =?us-ascii?Q?5UC88Mvgz486g4DHOZzwxJ6L/QNhCrSVfsSHgo56MbM7Iyq+qaajhH/AXfXg?= =?us-ascii?Q?2ejV7qWl6qzQ7PbdM5XSpc/QBYmTp0ss11PwY5kPPlMr1esLhCrxqCl2YiXb?= =?us-ascii?Q?D+SbHpkMfn9/jgsKPS2KF9u+TBXmTX5UlEtO23qRGcZTuEVaF87AJszLLmJi?= =?us-ascii?Q?ilPMKCo3HyoihGVpz3R+p+5tiJYfzRM9SZGTG+IoHCkZZj/koZaHxc5EFR7/?= =?us-ascii?Q?eMKahXB0FjX+ybFLMwSuxHllFhN/gN/QZHxzx0J6LzHMjJsR3DY7NC06l94O?= =?us-ascii?Q?2y7kOTdrUoYrwX5pFaMHsxlrbqfjYCYoCSkQz4y22R08zFXFaISk88EFIovt?= =?us-ascii?Q?OT0gd901QO+MogM7Alf0FgiCpzd00WlnWdgIIkbWrJ3k7d9VfrcBD10yVIb7?= =?us-ascii?Q?/x+r09pnSyBpYoCRPJuuQFXRQjgf/QrB6dZCZse6Ru2W977WQQo4ba7oQUGW?= =?us-ascii?Q?34kb36kX8cNQT5znseiZmSuYxsd8x6COEoNBMUXjEECTsXlAgjap/1WfE2vt?= =?us-ascii?Q?kkP1OKZm9zlzumtVnINtd+NNmVmZDntim64aXN3EAFdyRgJg6kshK2mWc/SS?= =?us-ascii?Q?3VAbORwP3WWbJHWeNPBcELx68thDYBfMfybntv3aKxu7RruT49YjShNKPJdG?= =?us-ascii?Q?xBQ1Fk0gXHj+ilH2Pnhcg9z46BDWmhOwa8rFjUfLB6MLLVol9UgcEILRVSxT?= =?us-ascii?Q?OPpeSOy15gfHziVOIu3dl4hcFGMHMzMV6FxSx9PiuzhySSjq+VVW1bLMkxz5?= =?us-ascii?Q?p2kQRvxfg+HHCBINtmiR3uPbe9LcS4kw1we+puWTwLpfGb1tUYBLtqcNfBua?= =?us-ascii?Q?uHJotEnlP2TebdTM3f05lNVabbCVNdblwUNohy4YmSoEtT/pMNKR5pORfb+s?= =?us-ascii?Q?/F6vFbVbcxFGsuLh2S3GbOyeMOrCZG1aVK3aJff3oAHEukaJB/TOmxU2dXT+?= =?us-ascii?Q?iNdIgefToQp0SEATklgr1JqU+NOf60rC3I6kpC8bkuLJyzKcJAK/3JAMY04I?= =?us-ascii?Q?Zm800OEOuB6DSgTurLzpVqyHu4dspAa6xsHKqmStwyFSJGYyq1GpXtJaglay?= =?us-ascii?Q?RsQOYZFquvZSRfj0M2zKyl+HxNm6VqkpxO2SfG/Qdm3+7AVw8/Ux6+w7PL6g?= =?us-ascii?Q?QlN2DoYSuSi/36iPaEj6os8eqvP8BqivPt115DyxLcoHtoNujKCMAXrZLVe7?= =?us-ascii?Q?idwAEwJoWWYsOmlw1Fw7VXfg5LsduTszi7yF5QvxwQNj81TaPN6tlEk/lK/u?= =?us-ascii?Q?qNoYUrFJCrhw87Bm5+0KFV8rU+8gBdiUmDTIX1Cnu9rQpaPxtHWvtgsgmo8a?= =?us-ascii?Q?90JhhdRadeyHx2kZYNwUuB5ei6Xpkr10NnLvIVez?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: 5Q5Z1GHDyxIdm4AcgLfQip/bxY+IA8XGzo/Z0eGT9RCFXXlsKJWfy3xZE1TXLs8uqggyHrUS804NpQonjZd3Iq3plKXxLHn/nM0PLSFUXE3ChV+5J7vbtOmzoeOCaP2JF8hHlAA4ZcLL8YELS1dzYtoxkqvhR1JCE+jtZBz498m8ipD0qImw6JcmAoubx/AvXygMSA6xKaD3VgjA7RuGtK3nblkgRUpp7po+z/URC/IsMz7Ap/V2N1sgZ8Oo7t6SaY9WVk8x2JWVZH/fr7DBcTSsK1uaPFznZEReQwYl5PubxK9N2pNR/MvQRyIPOwI/XFRqxPriRAqIALmot5f2T7XgZrw/Mo4cbVLthu7JUgwrH9146UE4QWjcoZDxXYonD1xqIKt1iP7Vpke9JtQhx7ZCeL3xCJ3wQWRX/Pe6SoUfTIE+4B4AEw20WareNbJQtaSVoCcrrySZUtb+kFztYTzNVaijz7U7d2c3a38U2mR8BCvx/JamCHR7XcCnVOleBZHLgkpcRCfmiT18QphpHCodVNjsuVIgCfjZjWd8j9snFme53n6p7Bs75g9ybV70jP5GwoFNioUks+yJUnO23BhJYK74o0v5+ayDdYisSxgQgpGzdPVefkIoGnS8aFWH X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: a278e27a-75c1-440e-b05a-08dd7721729f X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Apr 2025 04:46:09.6536 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: brJ21tw66JAmI0x9SyHQVBRljLt/CF+5GJhVSJxq2rDtzqwS8KjkXn1d7/hQWQKYlP/HFDo6RtO9/pxY1MP4ig== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR01MB8111 X-Proofpoint-GUID: RqsGtmmJzqNrTT2Mzd6KELnBBhtEXhR1 X-Proofpoint-ORIG-GUID: RqsGtmmJzqNrTT2Mzd6KELnBBhtEXhR1 X-Authority-Analysis: v=2.4 cv=VcP3PEp9 c=1 sm=1 tr=0 ts=67f5fb95 cx=c_pps a=1Ha7URm6ceckcZ/uwdfrUQ==:117 a=lCpzRmAYbLLaTzLvsPZ7Mbvzbb8=:19 a=wKuvFiaSGQ0qltdbU6+NXLB8nM8=:19 a=Ol13hO9ccFRV9qXi2t6ftBPywas=:19 a=xqWC_Br6kY4A:10 a=kj9zAlcOel0A:10 a=XR8D0OoHHMoA:10 a=jZVsG21pAAAA:8 a=jQOgFn-ZAAAA:8 a=pGLkceISAAAA:8 a=8rWy6zfcAAAA:8 a=1JanpFBW3UL9sWKDW1IA:9 a=CjuIK1q_8ugA:10 a=3Sh2lD0sZASs_lUdrUhf:22 a=mT82qxFQzDvLIExZS32s:22 a=YjdVzJdQTyZRADMV7wFX:22 cc=ntf X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 malwarescore=0 suspectscore=0 phishscore=0 lowpriorityscore=0 adultscore=0 mlxlogscore=999 mlxscore=0 bulkscore=0 priorityscore=1501 clxscore=1015 impostorscore=0 spamscore=0 classifier=spam authscore=0 authtc=n/a authcc=notification route=outbound adjust=0 reason=mlx scancount=1 engine=8.21.0-2502280000 definitions=main-2504090019 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Stephen, I am looking a the rte_mbuf.h file for rte_pktmbuf_free() and it is not cle= ar to me that it checks if the mbuf refcnt is 1 before decrementing it and = allowing the mbuf and segments (if any) to be returned to free pool. Could my application issue be I have tx threads that transmit packets and d= oes rte_pktmbuf_free(), while one other thread will perform rte_pktmbuf_fre= e() on the same mbuf? I ensured I bump the mbuf refcnt to 2 before other t= hreads can process the same mbuf. Thanks, Ed -----Original Message----- From: Stephen Hemminger =20 Sent: Tuesday, April 8, 2025 11:54 PM To: Lombardo, Ed Cc: Dmitry Kozlyuk ; users@dpdk.org Subject: Re: mbuf refcnt issue External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. On Tue, 8 Apr 2025 22:33:56 +0000 "Lombardo, Ed" wrote: > Hi Dmitry, > I added mbuf refcnt check at the point where we get the packets from DPDK= rte_eth_rx_burst() and I am finding many mbufs refcnt set to 2 when I expe= ct them to be 1. This is more evidence that something has gone wrong withi= n DPDK and the mempool management, perhaps, and I don't know how my setup w= ent into this state. I changed the traffic type from Telnet to Enterprise = traffic and rte_eth_tx_burst() no longer accepts mbufs.=20 Not likely a DPDK bug. More likely you are having application problems. Have you tried enabling things like RTE_LIBRTE_MBUF_DEBUG and RTE_LIBRTE_ME= MPOOL_DEBUG and RTE_ENABLE_ASSERT? Also using a current version of DPDK, address sanitizer, and latest GCC or = CLANG can uncover issues with use after free.