From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3C9C1A034F for ; Tue, 1 Mar 2022 22:30:34 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C7FAF40696; Tue, 1 Mar 2022 22:30:33 +0100 (CET) Received: from mx0a-00196b01.pphosted.com (mx0b-00196b01.pphosted.com [67.231.157.166]) by mails.dpdk.org (Postfix) with ESMTP id CA82840040 for ; Tue, 1 Mar 2022 22:30:32 +0100 (CET) Received: from pps.filterd (m0096262.ppops.net [127.0.0.1]) by mx0b-00196b01.pphosted.com (8.16.1.2/8.16.1.2) with ESMTP id 221Fb38g015723; Tue, 1 Mar 2022 16:30:32 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h=from : to : cc : subject : date : message-id : references : in-reply-to : content-type : content-transfer-encoding : mime-version; s=netscout.com.09.24.2020; bh=fv//KFdcblncqa692S3E/SRMHBhdU5+BzEWTuWRDabs=; b=WJrX16apD0rxKZ0Dcne3BxBxwqcvyebgsqERj8hE6S7FzdjGJ87xcKOdR0sE780qwiwU BjL4Nz41G+hjaQyuCE0lr75Y1ArNKe56JMTWTJVC+xCRPUpm91H+l6Lupr3iyIcdMvZM 3RWVFoIunHpWxxbNHxEoTcmAvGdxUj7OG35t4tu/MaeiL7VViaXdT+kV8Ev3lv8Yh7Zm yL4TMA9/eCh+wfubg+NgX6fOBb9ifi9MWSxAL/8A9Yn5nZK1FD9i5IsxeI1kBlEuIYCa SHsHIopx4ssYN/q7cDzC541QVt+wEUFx9NO6Kk/PvTw7OQgbg+AqWUaWsDUmYg1KG9NL 6A== Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11lp2168.outbound.protection.outlook.com [104.47.57.168]) by mx0b-00196b01.pphosted.com (PPS) with ESMTPS id 3ehk0d8uqq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 01 Mar 2022 16:30:31 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kwh3z1DVrNUcSeYy4HpO5d5Kg98MBiUw6QsmK/wu8ebiHKatbSzYw/Eob509goCrOi47jUSTWl7QD4JcIlaYy/6A0hivsf5RYNwQnomLPXC2wm+qqa6l+CChkYtJa1d3x+edT6t9FHZOotNKu2D7qx3gGN32eq1gmQ49tulJrrPByAIDXRwpC0mx38j5i42nwOZPba5fYvirewn5GiNf32Hp1euvz90pU8A/Sk36X9CqI1egoVwPixApOwL/RaaoyxrvHvXRFkSSsPjcc94zlZn9KRn7c+tLU8Qu3dTJYkCUQJBZVsEis26gVIobg81duN+i1UuQ8NK01aYNwhhaQQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=fv//KFdcblncqa692S3E/SRMHBhdU5+BzEWTuWRDabs=; b=nIvmmlzYV+mOEOAP1KGMKEaVOduoddOfTegxI4BLOKf0c6f8paTj9d9qrRPdr7ckIiWi1Z63AP99HOjamuhHWOpKlHq1unFGhAo3aE4qwbc1EeSazrzf2swq+GGarlMTk9FqAyhU9ONRaWRsPcBxEFf1A0ugYhbRipQW/2Ixk+EKQXyrmxB5/kAD+1aI9N80u6SEKSL/GSaVqhoFS/f9hWv1qrMqwJZxykpajIhJEVN+pIPWJi89v02V/Z7MqF1vYBM93l6TExpRdqz8aD6Ii40vQtmdnhVexF/u2R06wE3WLcMIUyilNE3Y1qZsgALSTQeNJfJhs9O4oXIaeBdQXw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from SJ0PR01MB6399.prod.exchangelabs.com (2603:10b6:a03:298::11) by MN2PR01MB5517.prod.exchangelabs.com (2603:10b6:208:117::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5017.25; Tue, 1 Mar 2022 21:30:29 +0000 Received: from SJ0PR01MB6399.prod.exchangelabs.com ([fe80::75a9:94c4:a954:dc0b]) by SJ0PR01MB6399.prod.exchangelabs.com ([fe80::75a9:94c4:a954:dc0b%9]) with mapi id 15.20.5017.027; Tue, 1 Mar 2022 21:30:28 +0000 From: "Lombardo, Ed" To: Stephen Hemminger CC: "users@dpdk.org" Subject: RE: How to increase mbuf size in dpdk version 17.11 Thread-Topic: How to increase mbuf size in dpdk version 17.11 Thread-Index: AdgtgvmYWBNf+aRRSn6QDROyekYkIAAI3y0AAAMjDRA= Date: Tue, 1 Mar 2022 21:30:28 +0000 Message-ID: References: <20220301115638.62387935@hermes.local> In-Reply-To: <20220301115638.62387935@hermes.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 4e5d7362-4de9-4de1-6269-08d9fbcab514 x-ms-traffictypediagnostic: MN2PR01MB5517:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: yjVgsrzhFzKFfpRiBJeYlmtKHroLCN19c/NYRzkRvqbq1pTS0ZwwWfWjV9GYzrNWl7tSeXamE4F8qrGRJRnYpqUhp6DiARKUfUJJkhch6MrQ0HVTABv2Phi64+NPBoQHOr27IR0aLXvoOxDR3GBTUKWGtkaImjGZcGxJHsp/lLutf2HeYO6j9mOczV1okxXOeTmU9AWCD6HTrH5IBBGn8hcuiAYAJ0EaBOWE9RcDkjrqAQPBxPgFREbhM15ZFJk2Oty/UZ5yr4EN3Wd/2kUWes3hGhUc49vREmczUzg9fzYMhBlQKxcRWKH0az2Z7SLHm28/DHGafC48jP94FxVQjf8KI65Bd0tpQZE49Cj2CHVnQvF5jw29RiVRv/EEFiKeyGYy2T4JAj+naMS32322dW/mEQmUdVARTGFSbBFQubD76kOO3oXVvUICt0dN7dN/bgFEE1j3rk0WudkALY/Yf5Y0/P2cNmnZ5EQOR0bhV7XuYRVmD9ZUC1f1oYk5puipug8QV+dCWxErImXdICrKiLHkpt2r/aLvCbQLxMKkHdUmOcuF3q0SdvIBJFW9s6+e9zel5kSSLC9z2b7B5qTButHDOBIYp2vSF28Mbl71qNV+p71uoDfM7kqMf3aaEexrhNDFDRPF4THpAyRjyHHcV/yFBkizF/Fl3mfjksuWUuBe0AiPD8YSMjWoTCecJkCXBIL1kL7Zgo+pdNnyAayiGA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR01MB6399.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230001)(366004)(83380400001)(186003)(122000001)(2906002)(71200400001)(38070700005)(76116006)(66946007)(66476007)(66556008)(66446008)(5660300002)(86362001)(4326008)(64756008)(52536014)(8936002)(316002)(8676002)(33656002)(508600001)(6916009)(53546011)(55016003)(38100700002)(9686003)(7696005)(6506007); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?75GFHNh24gA+orWOl6HAEy2zHhbNBJA5eo3s62Uik+AZIbBomk+Wj11vVekm?= =?us-ascii?Q?gP5iQIp06MPH3RrJYJU/lugi6/mRC8mAcyO5j/hrW2ES8fC8CCi7Du3QE3Hd?= =?us-ascii?Q?3PpKHJlZYY8VAs67n6wk0tlzjvEUIBy2jGTpENvxMI1EYrXosoyLo+U/knhK?= =?us-ascii?Q?davD9YhcV1IZH0RwvAAxkvgrkZ4C0qa/u65h9y3rq8deR2b4JssoWX8qPXY8?= =?us-ascii?Q?E4jrPoDFxun9o0VQMCoaBqkefMI6PEZuYaBbI0HeF0sZRz6qA9gUtYrDm7AG?= =?us-ascii?Q?+TQVteB/4o5jhLnfKHNJ/VEsjKn8rOehNooybnZVq9hfy7AvHl2O3jnikCfv?= =?us-ascii?Q?MfmSD64MXethEqOUt0wVNRryVcSz24ePHlInd/RiarP24BjhA2b6Yj2JaIu4?= =?us-ascii?Q?20cpWLwKEcbYFYkhNvJmpMs7Q7FghO3fzfiZiMC1xQ5mGmuHL69rlRHk44xF?= =?us-ascii?Q?G+uMRQ9fU6nV9oktL7U6qiptTPIkES3rRDSoz0sO56nIF63Ky4wwd3NjbUNN?= =?us-ascii?Q?FLQf4OOJqldMKf5mw8akc47c9SI37BSVGUszI8P/8jkvQ4Sv+5lwKQWXOsqv?= =?us-ascii?Q?p9aq2bhVj611qjL0CXFJdH5WBf4CN3rppr8JQMH6FxLcW++nQhDpHos/lT+W?= =?us-ascii?Q?X/Q8lu67U2T7u71GeYdw7vpUJlKNl0QfwoAjN/lVDbyd/aWpbeIIHUfgcwb8?= =?us-ascii?Q?0Zvig55B4Fm45GlBPd4IS6w+LP/D+HZDg7dhk9N9YO1aRuTise22btfX6AAi?= =?us-ascii?Q?aLQgWQtH7s+kD699DnH9VSYjjGNxeBLMyc9t1ARgSpmG9hKPMsAWW+4Kqwzp?= =?us-ascii?Q?f12bt5GX+tgzSC9lS2DgBAAFaz0TwiwlkqSxi4iuqnJ+JMLdSfrqQDBLajh4?= =?us-ascii?Q?n9P5XNXactSP0ZzbvgP2/zk4hw9B4wV8JBPapbeJ/wr2bas0FQ/QTzNn7MaS?= =?us-ascii?Q?ai4hVqfegm8gs63y+Bn1qNayntfIs19o/C13HS0BKJukLCLI91ILum4XO/Zg?= =?us-ascii?Q?vrlHInIIp3ACPlgK7r7I5ipcGWYzjkIDR0Jlg0tAXgTZgdlGZGaquv2/YBxW?= =?us-ascii?Q?ZVnE0Dy38Fo01iMf6piKgZArJBN/Vdhe4aszAPq8u/EDuv5MX8mINpOLCj2W?= =?us-ascii?Q?ncmCSShA0YUn+i+x6zwTXSx7sJ5WkRtsomRectW/TvecrCYjQUS4K+wLi6gs?= =?us-ascii?Q?IPGE7WKyYWsjlMLlFTkQuWPutqwRkdkTNyj7xtfxUbyuGDf7mJ57ecQbPWyu?= =?us-ascii?Q?CK9bXOcBuaNmh58x4W+dwiMgoT1fStWTSA7SPJaG0cL2jAMQWnUiyNZHEboB?= =?us-ascii?Q?0s1ULCOLf/TEPtNAS1lysOXE4QWTolk+ECej6Vt1HUg44yRar5fC3b4/NMOT?= =?us-ascii?Q?JKHrfEFuRMvoLMeOdDPj7ofbljzPXCavmbKMaa+emA3meNtKelbBEQbuupKL?= =?us-ascii?Q?cQk3L3RkOG6xf1WOJ1bDoT+JQWrwPziXAwVlWptf28myfU77rnkwOgPBYagv?= =?us-ascii?Q?vW+SZohPcHg+Awjbdrj6H92ifrMd9xArpZi+RFV981y6Sbqm79dl3CONvROO?= =?us-ascii?Q?sR5J9qSWicoP7NpdY3PAu5TxdVQLBlDoUmJosKinPtftuKWulol/jczYudEg?= =?us-ascii?Q?uEFx0/ot7bHTy2q52CPh20S7/2ImgYjhr1O2WurTJDntuG5xC+D0Zq6ptIup?= =?us-ascii?Q?IO46oGIgitOfU2YuO5LPDy6zGOQ=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SJ0PR01MB6399.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4e5d7362-4de9-4de1-6269-08d9fbcab514 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Mar 2022 21:30:28.8832 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 4fiaRnrQ50LjyWBQMzPaC2cB6Y74zUWZXG96UYT3WFbKDEsEMerY/213RffCbSG8VoNrhtv3syzJJT1gMbD4mA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR01MB5517 X-Proofpoint-GUID: At-_qeQ5xj9EBTq1SmC6I8V9Wr5w-UOh X-Proofpoint-ORIG-GUID: At-_qeQ5xj9EBTq1SmC6I8V9Wr5w-UOh X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 suspectscore=0 bulkscore=0 phishscore=0 priorityscore=1501 lowpriorityscore=0 clxscore=1011 mlxscore=0 malwarescore=0 spamscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2201110000 definitions=main-2203010108 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Stephen, The VM is configured to have 32 GB of memory. =20 Will dpdk consume the 2GB of hugepage memory for the mbufs? =20 I don't mind having less mbufs with mbuf size of 16K vs original mbuf size = of 2K. Thanks, Ed -----Original Message----- From: Stephen Hemminger =20 Sent: Tuesday, March 1, 2022 2:57 PM To: Lombardo, Ed Cc: users@dpdk.org Subject: Re: How to increase mbuf size in dpdk version 17.11 External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. On Tue, 1 Mar 2022 18:34:22 +0000 "Lombardo, Ed" wrote: > Hi, > I have an application built with dpdk 17.11. > During initialization I want to change the mbuf size from 2K to 16K. > I want to receive packet sizes of 8K or more in one mbuf. >=20 > The VM running the application is configured to have 2G hugepages. >=20 > I tried many things and I get an error when a packet arrives. >=20 > I read online that there is #define DEFAULT_MBUF_DATA_SIZE that I changed= from 2176 to ((2048*8)+128), where 128 is for headroom. > The call to rte_pktmbuf_pool_create() returns success with my changes. > From the rte_mempool_dump() - "rx_nombuf" - Total number of Rx mbuf alloc= ation failures. This value increments each time a packet arrives. >=20 > Is there any reference document explaining what causes this error? > Is there a user guide I should follow to make the mbuf size change, start= ing with the hugepage value? >=20 > Thanks, > Ed Did you check that you have enough memory in the system for the larger foot= print? Using 16K per mbuf is going to cause lots of memory to be consumed.