From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3CC9F43F6B; Thu, 2 May 2024 21:05:20 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B00C5402B2; Thu, 2 May 2024 21:05:19 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0b-00196b01.pphosted.com [67.231.157.166]) by mails.dpdk.org (Postfix) with ESMTP id 82C0F40299 for ; Thu, 2 May 2024 21:05:18 +0200 (CEST) Received: from pps.filterd (m0096262.ppops.net [127.0.0.1]) by mx0b-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 442E5Z5f029197 for ; Thu, 2 May 2024 15:05:17 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= from:to:subject:date:message-id:content-type:mime-version; s= netscout.com.09.24.2020; bh=SOOEaw7KI75KHFSbYjyziPKOPHihvtD9hxjL 32ZzdEg=; b=LdJSCtrJDesoEteNgmzQB0oaw8Xpr5JpYpMyzW8CfydEGLn42PQ8 La6wVo1jI2IiPhFkq81COFBgchdcY0rgQZWNVABIu6IxPQWfLfF9VbZylbkp9wRW nv9VNkBhdQj/wIlk+Qf6ZhITzcmwQjr+aiohNj4PyQG+6ihOYdcLhHrK+3wJLSNy wOYdvqcfP5M2K0kSi11xKl5n9dYxXOWjMdHDdTJFAlBrJrdmNiXdV/cowJ/EKUHS 0TwP7/Dc56vRMuZ2UA5dJcZ23URjd45dSeVxoXhluenTCkOgEwp8gyUFlzWFVXU4 AQF66ldaBdrHf+n/Ln7h2sU+XIqKrjNfLw== Received: from nam11-dm6-obe.outbound.protection.outlook.com (mail-dm6nam11lp2169.outbound.protection.outlook.com [104.47.57.169]) by mx0b-00196b01.pphosted.com (PPS) with ESMTPS id 3xrx1yy137-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 02 May 2024 15:05:17 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=CSKOFzUnRmgcCggwkikutlzzFG0kdTKNSIsztw2lNSAHwsR4UUlqQ/20lJWq+9r0Z/1vSN5tyE40EAhEL/+n1D9ti0SAFkhrQl2qTVpXh9Kuc6uAtz2Gw+OFPgezfn3O+cnNlvvZWLpapd6ByeWJPpGpBJInKNUHi0PPP/xcjZQPXR6LRE7qME9mHTiGA2tIy+bIHnUb9GNUIhGz+pkNDNv+XupzZVU72BZDfoqrZ/DwGeRR1v+7JcMya1p4sm4cBau3u/mULHmN5hXmXnXhRn65hFXYULav52r6Aafito/VZNEoSV9bCDPW6b7skSeViOV8wdegicoRxwj7J5qacw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=SOOEaw7KI75KHFSbYjyziPKOPHihvtD9hxjL32ZzdEg=; b=WUJUQRNUKOhu7Fjb8QIaxqt0nJbEvD08LmOQvLmB9RlrFYW2xcLg2RZ5zGoQ/PHUO1Kj97Uzx4CPRcMdv7n1n0yQq8iJPvNHtcIJFmzU3Imu/Nr2hvqVBbH3ji+eFeMMnQE8zjp/lSUMrZnUcf3pi+opITlbYTzHU53Cg85tb4unLWcoktmSOdwGwHKy7Hu0AfLqQ3UAvJitE7xedrtnlYpstM+/zavfcWhTWZLnplEK2bXdwJ5kb0S4IiQaXs0JqgtQnBZCxShcVf/SHVXZ71v7Wtc5sL30/srHjPfbYYeoZvkdqUDZ922NjQwe094KrY3KLrIFSDdAJ5KL5vUMrA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by PH0PR01MB6714.prod.exchangelabs.com (2603:10b6:510:94::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7544.30; Thu, 2 May 2024 19:05:13 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::44f2:5149:e583:9bf1]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::44f2:5149:e583:9bf1%5]) with mapi id 15.20.7544.023; Thu, 2 May 2024 19:05:13 +0000 From: "Lombardo, Ed" To: "dev@dpdk.org" Subject: Need help with reducing VIRT memory Thread-Topic: Need help with reducing VIRT memory Thread-Index: Adqcu3BiXzYpqqoETgaEa9S0ksiqXw== Date: Thu, 2 May 2024 19:05:13 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|PH0PR01MB6714:EE_ x-ms-office365-filtering-correlation-id: fa31e368-5992-4dc6-9a6e-08dc6adacbcb x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230031|376005|366007|1800799015|38070700009; x-microsoft-antispam-message-info: =?us-ascii?Q?5igYqqRdlpiwinwWXxPNnEjSQtQe/BNu3twATXlX+9XMWUAs53k69FN251s/?= =?us-ascii?Q?lBVEpU1IkikBeX0dZZj/c6SFuX2LD2e479TdS4/gPPX83DSp1gHYyBXvry/l?= =?us-ascii?Q?g58xjNzfhZH/m85yxGFoB25ZpuowH31hmiG9yTEDttf1DiWlf2uCzFhtEgTI?= =?us-ascii?Q?+W/5r2Y3riEQ54CHj/9Dufyq6CpUTJTfR43LlmDzQJz/vkfIYwD/08GdC3Ec?= =?us-ascii?Q?sjF4oXc+egnI7rLLb2823QP2fTWttyTiAfZ54ljFZ7vwHvOJyJKzdqs6lw7B?= =?us-ascii?Q?MQouQmSgJKANEDMHJL20p0bSWJulvGgv+Y3hBFPYrc58C13shyKPRdWDkz/3?= =?us-ascii?Q?FYeKy7i8yKOQ+tM6ZbWTRMlqJuY4kTpOSYudDI2L8khbWoy17H6cfHoTi3nA?= =?us-ascii?Q?jYqPmabSWNBBlMcUgy1Qb6cBj6q8cpmLYr2on2IiJ8S50zWO5Y+UuOxSePQ3?= =?us-ascii?Q?XhJmOVVoyxNw0OOe7SrwUFlWz3SxFqQpO4PqlQ8qTcDKuQd2Ck4lfDofFap6?= =?us-ascii?Q?if6AZrsKoqaXH0YftDxiwOSVCb/JS1S5o5koU87pjZ4qmW9MbSrCPclqIqjI?= =?us-ascii?Q?SZOEGl+OviRyCivAiJWWfCBTQTD87JNwZjMPXuflE+Qu6xia9Z0jv2EQeq83?= =?us-ascii?Q?xcvbuYAXqybiSHBIOOLp8IgXE61amq9wTkZxL14/wS/7NhVzPLXpJ3wHs6NX?= =?us-ascii?Q?f/FJXQhPZcYiodxge/cCpkV8DSTqGdXDZL5BgBrM1Zh4vRAkgrfsF+7w1j85?= =?us-ascii?Q?9Sze+HluG5dTLvUoIekebl1iUt6vIuDaqM/CBrYnX7mEKC2pXLen2S3Lgg3B?= =?us-ascii?Q?jx/fHcm9AP85MZC1/6KHxRtkNMQX0t8mp2ZbitSlv8WnoYjRQv66+rQJ8V4y?= =?us-ascii?Q?/i6YK2MQCa1MreUW29ptrEfcpSkCHElDACy5yD+LbxLlv6LLPcKkIlA4V74f?= =?us-ascii?Q?g3uzaIJq8UngNya8Yyu76Rd8dvo2Zm6a0BdqB8mU0PW5JSmUmUj21CPDo/dz?= =?us-ascii?Q?y28FCqYg34JasTx8WG9g5JhOQH6E4/uBMxb7Wge25yZn4QQB0MM17hEvT52a?= =?us-ascii?Q?L6VWeeYfWv7S84D1m5ahVDKtOdSp73bR0yTXajw5LqdnUWW/p7FE3C7bHoC0?= =?us-ascii?Q?m9yNzis/MbylKErvrtNiLiuMKAqK6pk0896ydad6Q8PTEraIoicfnLIF3E9P?= =?us-ascii?Q?a23bD00KSz0Ki30hHdQBdpKpBXLJ0NyjVie3Zm5R8uegxtPoZbQlb1CD3uvM?= =?us-ascii?Q?leZ4inlciF5Zc5+dh8LP9BDFLUJSFcNKAGS4/iArek+Iq0QOoxuavTtk2l9i?= =?us-ascii?Q?1Tkr8gl0/bbAIqDR+FdVVewzgsCAvOCa5iWvL6mBFpNaZw=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230031)(376005)(366007)(1800799015)(38070700009); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?KbqHrZ0y3/yteoPICS0uy3EUKoIBnfCCUjflwcl20/8RSjKZqN8GLx2kcikn?= =?us-ascii?Q?qQOjIHAl0nJ8HBRxkQIA/fA/kcdY0O4AS+VXlZlEG2e4ekTx2sVD4oAPjykP?= =?us-ascii?Q?mz2g5ubmnkRdu0kC/974uOX06wthSnv+H5KyKQWorAwb3Qs05OXD00cpODCe?= =?us-ascii?Q?8uxazW1V0FBD+RQsf8A9J3lYB/08f85JcubArYLEsrvV2X3szip4zMJgigG3?= =?us-ascii?Q?8o3eHByldrx68r1RggaA/At7oej3fFQCklR08rhcuw1Q38YKqKgfjA7RXWkH?= =?us-ascii?Q?tu5PdykNsWkcm2s/U1Q6yMdWlVBtXwgGXRmruHcVCNFJg8DINE7q4p5H0tTi?= =?us-ascii?Q?++w9vEAM0P8ZYEUskwS7gqLgNembvU+PQnFUoRM5fbUr/DsCiKzRLDa+Xah2?= =?us-ascii?Q?6xFtnDH7IX6G5C6u++7JB5CVmBbfW9tDBokHb92q7KYh4DLYHJcP70/R9j4A?= =?us-ascii?Q?O3RBP5CX8nUVjF/k4y6EVa13Et2vhzQR9hJmWid7BARzCiFNhpY16KATd+YY?= =?us-ascii?Q?0pMnKImQdG01LQ55MyMIecHMXHnh4nAT5dOGNbhaEKWeH8/0vuP1dIYfyv0Y?= =?us-ascii?Q?kT52PBMWocVo//jzpAIKhxbRHYAT6eD6UmQv2nejwBXeBsiEo0gwjCazwFu6?= =?us-ascii?Q?OLTBIL4VCsblKcZ8dwvUVYsDLJMylk9yM2PAHZ3XsUVlYmD+x2Pc82n4m4c4?= =?us-ascii?Q?pzTEYLBb5/6VyfcvA7SbgB9NknGoHAMHqT93t+kwk0G9RClX/Jma4XQehabe?= =?us-ascii?Q?SYx0HiS420EPab703ix8KTBwK8esfMNpQHQwZjz7Il/7RkIEytvBHtHsZ0tx?= =?us-ascii?Q?ZWngJbR5CJcwUW83ikjT+40rcjI+f+xOGtv4K14OWt6dCwc3gbLo/8QcE4lx?= =?us-ascii?Q?akWHMZ9ydxoZuaj2pwAre4VYq7DteuvqIuEzaYJwshiLWcU1NsYBEHDT2kMf?= =?us-ascii?Q?HuAORA2q0aGVBhYRt164b9+j4MgEEqstxXi7dwBSA10eFwZJ4HlP4OT+aHVl?= =?us-ascii?Q?vyCZWt+WcyHgZCF93BxI5It6xTWkfilVjMbPVglh2vE8UQrqfQx6HrSNTOmT?= =?us-ascii?Q?OgicI65+LieXzBmnB7YbEWgDa4b5aO/V7KmZbaFUT3uiL8ShgsS3dstHJ/jc?= =?us-ascii?Q?E21SO2fFJLP2IvfAw9OrKIreh1tN4UZKgsk7HUodPW5wwoRePB8xQ4T1TLiy?= =?us-ascii?Q?7NWzPnHT3FS3e+MnkzTYbOCDpLBfbMvYigP5bcBWdWgXQkUBNKaU2l+k9Zi8?= =?us-ascii?Q?RpxjBMJobxJWS/bw48o8noGwNxSdZ7xALq2BEkZU6OIJX5rWaBBDfab5HOc6?= =?us-ascii?Q?PO3C+nsNoKXeoaomH6hRnXCuxKIAKI65jsaVW1I3gnmxzDyh0K9ALIRPPQbR?= =?us-ascii?Q?Vor6AoJpvr1wwqhL21GmGUyrX7Nlimb9zIyQhipWGYaiTGDTEeplDJpZNPkG?= =?us-ascii?Q?tQ3OIR9jF/smpzKVsTZtxTBPYhApevqaMraD3evDs2SAtq7xVxlReJ0gyUY5?= =?us-ascii?Q?z0/64H7Nkjds9t0HBxBflB8rS1WUWVJh5orkUp/kwuVHo36gU09doWuOFg03?= =?us-ascii?Q?vsv99ofpl7Q/Lxzn4gmHPe/URNKsIV+rzvRc4Cno?= Content-Type: multipart/alternative; boundary="_000_CH3PR01MB8470BC421DA4DCE9E7840D978F182CH3PR01MB8470prod_" MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: fWuCC4IWVakxyw+7Vjf5sWtWI1PD+MoVoJlDc0nNfSVXsTb8PVS7pY+HM4akWWzQ4oAFg2NPs7Ka67EaCcq4CRcZzXTrbYJi1pY/Ussa2EbM3qCECPSqtTDkdySZyPnYnWdnX2DylfC4sigkV8iiitIT16iPFJfBTY7a6nrzb06dhhaBk6fazHrw2tImFuGh3LGpRTew849la44MAEgo5p89ldtFWyeXSVUZ9NmrgMIf59bF697mm+fpmjdVF9KincCJkrpXgYV1qJ04XA3x3h0g56Ie9d7z8XobKAtKQwBwbD5Ku9WHHKF36qRuzrP3kT24Fwlq6cXhCDsjkwroxeZaTtz5SJctEvrQgIaKCbXVjW0esKF/N7x4VuRHXfZnpLV5IftDOOiQWnayIqm8Q24oge1H9DzCTleCPkJYdsjKnAKJzL44jKPl1HHESFotk+x9yQeLaYMqo5RPoL2CpgBuif9FFpcCUQ+wXA8XzuLq12ZD082l5jcIDodJVB2RKq8L0xs37e1Yp0zVJRehRrRrDnC/P/a75gANM7vD4RVC/qdly2hUGrSVchhvqBpKOp2eubtVfnLAU7LHsGciH0ikE29v0T2ie8PlKUw1DFodx4+tHrcCeYznuQRawZL4 X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: fa31e368-5992-4dc6-9a6e-08dc6adacbcb X-MS-Exchange-CrossTenant-originalarrivaltime: 02 May 2024 19:05:13.3568 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 78YRQa5EZ5gw4iJUZfrtjmDw+4RLkFUUKaSzA9k4w1JNR/nsaqcpa/VLhTGLm+Xuxubo3gBwIWIZcx/zS+pl1Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR01MB6714 X-Proofpoint-GUID: UTMa5myrMWkL0BAoae-CN9uVDzyTWIl0 X-Proofpoint-ORIG-GUID: UTMa5myrMWkL0BAoae-CN9uVDzyTWIl0 X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 mlxlogscore=784 lowpriorityscore=0 malwarescore=0 adultscore=0 clxscore=1011 phishscore=0 priorityscore=1501 spamscore=0 impostorscore=0 mlxscore=0 suspectscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2404010003 definitions=main-2405020126 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --_000_CH3PR01MB8470BC421DA4DCE9E7840D978F182CH3PR01MB8470prod_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I have exhausted all my options and want to reach out to the dpdk developer= s for guidance. My situation is as follows: We were on DPDK 17.11.6 and upgraded to DPDK22.11.2 to support the Intel E8= 10. Also upgraded from CentOS7 to Oracle 91. In DPDK 22.11.2 the VIRT memory has skyrocketed and causes major issues wit= h our application that runs on 16 GB of memory (virtual appliances and low = end remote appliances). I have also tried DPDK 23.11 and 24.03 and I also see across the DPDK versi= ons that the VIRT memory has increase by a factor of 5 over DPDK 17.11 Our application process shows VIRT memory is 7.6 GB with DPDK 17.11.6, and with DPDK 22.11.2, 23.11.2 and 24.03 the VIRT memory is ~36.6GB Our application minimum configuration needs to run with 16 GB memory when D= PDK is enabled. Our application uses memory locking and rlimit settings to= get optimal performance. I understand that DPDK memory design has changed since DPDK 18.xx. We don't use hot-plug feature, encryption, security, telemetry, ipsec, or g= raph. Currently we configure 2x1G hugepages and single socket. I have tried to disable telemetry, cryptodev, etc in meson and only to find= they can not be disabled, they are mandatory. rte_eal_init() has argument "--legacy-mem", which brought down the VIRT mem= ory to 36.6GB, but not enough. Is there a developer guide to attack this problem in very low risk and time= ly fashion? Thank you, Ed --_000_CH3PR01MB8470BC421DA4DCE9E7840D978F182CH3PR01MB8470prod_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

I have exhausted all my options and want to reach ou= t to the dpdk developers for guidance.

 

My situation is as follows:

We were on DPDK 17.11.6 and upgraded to DPDK22.11.2 = to support the Intel E810.  Also upgraded from CentOS7 to Oracle 91.

In DPDK 22.11.2 the VIRT memory has skyrocketed and = causes major issues with our application that runs on 16 GB of memory (virt= ual appliances and low end remote appliances).

 

I have also tried DPDK 23.11 and 24.03 and I also se= e across the DPDK versions that the VIRT memory has increase by a factor of= 5 over DPDK 17.11

 

Our application process shows VIRT memory is 7.6 GB = with DPDK 17.11.6,

and with DPDK 22.11.2, 23.11.2 and 24.03 the VIRT me= mory is ~36.6GB

 

Our application minimum configuration needs to run w= ith 16 GB memory when DPDK is enabled.  Our application uses memory lo= cking and rlimit settings to get optimal performance.

 

I understand that DPDK memory design has changed sin= ce DPDK 18.xx.

 

We don’t use hot-plug feature, encryption, sec= urity, telemetry, ipsec, or graph.

Currently we configure 2x1G hugepages and single soc= ket.

I have tried to disable telemetry, cryptodev, etc in= meson and only to find they can not be disabled, they are mandatory.<= /o:p>

 

rte_eal_init() has argument “--legacy-mem̶= 1;, which brought down the VIRT memory to 36.6GB, but not enough.

Is there a developer guide to attack this problem in= very low risk and timely fashion?

 

Thank you,

Ed

--_000_CH3PR01MB8470BC421DA4DCE9E7840D978F182CH3PR01MB8470prod_--