From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9EFFD43F6C; Thu, 2 May 2024 22:58:45 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 509D6402C5; Thu, 2 May 2024 22:58:45 +0200 (CEST) Received: from mx0a-00196b01.pphosted.com (mx0a-00196b01.pphosted.com [67.231.149.170]) by mails.dpdk.org (Postfix) with ESMTP id 841AB402B2 for ; Thu, 2 May 2024 22:58:43 +0200 (CEST) Received: from pps.filterd (m0072398.ppops.net [127.0.0.1]) by mx0a-00196b01.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 442IPxuL024941; Thu, 2 May 2024 16:58:42 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netscout.com; h= from:to:cc:subject:date:message-id:references:in-reply-to :content-type:content-transfer-encoding:mime-version; s= netscout.com.09.24.2020; bh=H2T9ahVN4D0nivZeB2nmRurvcSVtwoGlb4Mk QRuf0CQ=; b=TEjEcQdhF9wSySdpCL7B0pRurapzeu3jXslbP21JSZQZ51AaUapY /tntRXI/xUjwfFv7I7C1YF47IWgDmHajhE1Msj/yChm+IxNWx5nBHk0UFyXlm2Ky OxIfRF0260hjhRQaRLNc8bvvrBuMRBPTcZgFv37czMY0PtYIOEjksarF7QUufkNF ef3ZYUszsNtK2tYVFgXX7u0Jemz3PqJvG+whqg0G7D4f+7d5eQ7KS6sq7/St4WZg ghRIxkvyb4T7Y/NhGcvBfReMMkecOzMH2AyXILr1b2eqcgMSDvPvmssUNpdApLaf WC5FvVGu0GzHqk8aOzO4XR7Csvkr3UT9jg== Received: from nam02-sn1-obe.outbound.protection.outlook.com (mail-sn1nam02lp2041.outbound.protection.outlook.com [104.47.57.41]) by mx0a-00196b01.pphosted.com (PPS) with ESMTPS id 3xrwgnq4ah-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 02 May 2024 16:58:42 -0400 (EDT) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SHPVJQtNrRqXg/dH78IhhYBcjz1jEhARuZhyct+vC0zCtzx6m46s+/P9mQsTloNdsHy1Hg+B7fV4EqeVu4KR4hJk3vdsSx4iT07l3yCYKKnXfatpV2iE6r+0Bd/QPD+hgSuZ6k7gX9hLhxUXVKVky8hF0NuwJIKkqzL9kSel4T3fN35SkOFcikf+Se8intiuTLJh4qhTW755Of31xf58VRP8yr9dqC3Jh1ZT9G3qt7dadzHbU4s0Lj33viET1Mq1/N2MDk5vyItexYQk/6xTHWQdxytE6ZWBkNcrcxPRH2VnKptRQ8Ahwj2LasvhNEtp93rOkIcXm3yeSx4/U0RNJw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=H2T9ahVN4D0nivZeB2nmRurvcSVtwoGlb4MkQRuf0CQ=; b=FKV7Mu8iA7WnoVC6RC7QQHtavFdmfeelLmT7thGJZRFSQ2yfNLOSIyCa5sHhVA5ulGXogMsWvPV5h/hWlzmvlWIJZ6Una1zfVkX1wjKUGWw9L6L3mBUpIEkSsAlKa1RhJR/Lyf4qtGTaT/9LjTI958q3SS6vNMM3IwcE3A+qf6mLmZti4t2IwHc5jBvjgLZ/XwH2x4oVBPnw6Ls46KVFS0S8X359c9Ci7UT/mLocvgQ66mRD8w/m9gtoK46gt2zbf1oYAwS4WExtmSNvwHzDSOzw4tQHOBl9I7I/h5G5odTaql/qfEvKUNZz+jKl4oYEdKxH4cw7JW7b22mVLx14lw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netscout.com; dmarc=pass action=none header.from=netscout.com; dkim=pass header.d=netscout.com; arc=none Received: from CH3PR01MB8470.prod.exchangelabs.com (2603:10b6:610:1a4::21) by SJ2PR01MB8401.prod.exchangelabs.com (2603:10b6:a03:53c::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7544.30; Thu, 2 May 2024 20:58:37 +0000 Received: from CH3PR01MB8470.prod.exchangelabs.com ([fe80::44f2:5149:e583:9bf1]) by CH3PR01MB8470.prod.exchangelabs.com ([fe80::44f2:5149:e583:9bf1%5]) with mapi id 15.20.7544.023; Thu, 2 May 2024 20:58:37 +0000 From: "Lombardo, Ed" To: Dmitry Kozlyuk CC: "dev@dpdk.org" Subject: RE: Need help with reducing VIRT memory Thread-Topic: Need help with reducing VIRT memory Thread-Index: Adqcu3BiXzYpqqoETgaEa9S0ksiqXwAEGosAAAF8anA= Date: Thu, 2 May 2024 20:58:37 +0000 Message-ID: References: <20240502230352.7bb1ef0d@sovereign> In-Reply-To: <20240502230352.7bb1ef0d@sovereign> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CH3PR01MB8470:EE_|SJ2PR01MB8401:EE_ x-ms-office365-filtering-correlation-id: a7399727-7521-4506-db4d-08dc6aeaa329 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; ARA:13230031|366007|1800799015|376005|38070700009; x-microsoft-antispam-message-info: =?us-ascii?Q?m5wLul+OmYFYG7nE7syxcevH48y15TC6s82THgGay3Gf/C+7ujyJ/iDDDpiI?= =?us-ascii?Q?E9WDaU+M3lDsfZ663z1ZX+wopdB8mBlbZPTphOUugetUBxG+f1jCOy8dnzlC?= =?us-ascii?Q?1CsYHOAidnQn5RmhzqSYMiTmrhpR25LzHqg1n5bKzzZKrdqAa7H69v1CKCii?= =?us-ascii?Q?IhSQllQF+ytlEQVbIMbfF9WR2mMsKqvUzOVSAzTBTIoSjqIs4OUsj6r7XmS/?= =?us-ascii?Q?I3H7SBeYAuj0WskZNRlan0GetS9F2OA99Uktf3amQn1JrhSTu/hcQf17Z7o8?= =?us-ascii?Q?hSySQIzi7gwTWemdLeVrDbStJxjRxX/fBKFkIpeDC9dxc3EjRxSZ3J3kx0Q+?= =?us-ascii?Q?VY20O1v5XK+vNDlNy0r40PrxOlwQf6Vh8dq9cXrFVzFYKW31JGmX0VMuWAFV?= =?us-ascii?Q?wED779uy8jEwH/RjTe3ELJpWwgSfYNz+K30FGkI5mV/qWysn0zsBOMYy51Iq?= =?us-ascii?Q?Obr0SzP1VYrpIPRntWtWhb6VsNzSmNPpk5bQHqSx6fldv7mtueOqKGWd6bns?= =?us-ascii?Q?x4fI4+5zi368YJ16q+KHXXkLxxgRYY7xzrzfbQ8I5jp2k9qPoZGaguiuOWFH?= =?us-ascii?Q?3QOvYfHBKcPa/aZAj9Vr+zxJjgq8HfCarvX2srzsGL5ZfYQWAL+sg0+GXolJ?= =?us-ascii?Q?fqJ0bwJ5ZpKLrtoVy5X1ubixL5SZK0N7QhMGzbIR8wk5eJff/THsRjszxLym?= =?us-ascii?Q?Y4Vl3JTvS+3jt9NJC4+mKHoYyWkJnMWrCW4rN4Zsdr1k8JyfXebkTAeKUzcW?= =?us-ascii?Q?ezNArQdH/6o/v1umjYskqF4Av7YcQN9U1fCUnUydXOdYVbRETdY3zTpEPenE?= =?us-ascii?Q?QnzmAUKG1nxFJGtScekpCBu2A9gO4QET5hX3Zu4u9IY4/fygOLbpVZN9dYJf?= =?us-ascii?Q?QrJTaupOYCx80cVTXfVsAcDiDScjllCL/+8vcj2jaWwBFP0fPHU2s1uA5DQb?= =?us-ascii?Q?fm5IKujy/uzinBUTGbUCQVXw716dLQ0Mjn57feAhXIGJfVYvHHHIpOffGhSp?= =?us-ascii?Q?D1Gcm2EpN9t7CryDnVx67BWiIMGlbXfgwkoni+ddOriNQJMEGlpcOXIbFysz?= =?us-ascii?Q?Cde4PuiHqmhTGrr6TQnmi7s9AfkZNmpCG54/k1jy6Hf8HVANydamrJygfX9O?= =?us-ascii?Q?K2WT9fn3WiLkKf21amum7Jgf6G17/uGrLodDhoLvWgwb92uB5fuU6vRHYTCd?= =?us-ascii?Q?IDy+cJZCLiq+bX2Kygs/6n61KV+Q9qF0ZdsjPW0IBRYqdGYs5w6jrH6AsbaX?= =?us-ascii?Q?Fswyw4BUgUa0wnVg+/Ei6YRrl1Wmuwyo7dHdGxK/ZA=3D=3D?= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH3PR01MB8470.prod.exchangelabs.com; PTR:; CAT:NONE; SFS:(13230031)(366007)(1800799015)(376005)(38070700009); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?AmAul4L91EtZbzUviAdliwiP2W9eanSupI3NCaL2WjCQj9hz2/L6Fu8H90vW?= =?us-ascii?Q?LNNsF3DxT5A9F5HwJ1G8Ux8gg21xAUFpAzUMoLbOO7Q/ZnG36t+VgLi0BwhJ?= =?us-ascii?Q?0RsrtZAm8m4JDSrKLdeqC1Rfzd+ruV3F5eIqQnhfl1lI+dBfyJtG0skdnoz6?= =?us-ascii?Q?FRE/Xy3nPUto9mc88Ktv/uPzX6GRIBvneWaf/aGei4Bagk4z/+YH6mWmh6lS?= =?us-ascii?Q?oohLwQEtfMBuu7b76IE2VNl/1jgdNnEWdSbsrQDbF0Y+6gQK3uylJ1AoK7y4?= =?us-ascii?Q?Pt15nCQClGylqS4ZcOB59lCFMSsa9MgzmU6EKNtVfJIkiLjpiA0Al7P27g7s?= =?us-ascii?Q?iQX593Z1MOQhUY1J3RLb+bV8RkBFJP1KwRg1P+TmkXE/YC3QwltbkmyMTmgj?= =?us-ascii?Q?HKaiGcr0SA/tI1OMXL4s0407La+QsAt/pJbg6p0T2dKznev94HJhenQdlsF6?= =?us-ascii?Q?xDq+AwdXGpom/eIoSofb6bkVkncBKLvpFUSOSKDNL46eRKlLLpdGZw2HKnbc?= =?us-ascii?Q?vlnNNs6YmnnwdCP0dhBY0M7G9Bfy0D2tf1vEK/YIOolOA5OYPFXp6vrfov71?= =?us-ascii?Q?fmfY5+Xnvf0CtnDlQ87FccLxv3d7iLn1YC1S/M8Ym+yzIsdxtRLcoSMWaWqU?= =?us-ascii?Q?5cIvdfQ/Qfl2GYZwZESz4HBkH9cMIgf/lAojD6XVcw7fhGBwZRXLP2hU51BN?= =?us-ascii?Q?WUF3KNB6RWCTJxsUArKfgd5RLdqD2MzPEsj5D6aMLNANezaVbSl1t8PCxdnU?= =?us-ascii?Q?1/0VO5dWb8mCtFQgzdy297e8L/XKsoYZMgzGlRf66bMCfA6ok40CBP5e5dW8?= =?us-ascii?Q?e0LLu9XCTD5ubTzK3ihoVRG771ABoMmheWT7W76nYJbAA4GhJn5eDsMrkR4C?= =?us-ascii?Q?+xVzi2xBEJPXWscLNTV4AWcXKVwybdbv5lCvpjjiqNpUjMATZRpJZgB54ocf?= =?us-ascii?Q?6HuFtlwGFla1AD4oN2MBrmzmTt9z89qfZ5RQaO5UxjMuguxcdaM5QQRtJ110?= =?us-ascii?Q?YfnniOpH0Ph/FcGY8dzNvlpMsRF8iGKvT6uVqh/YwfxyfCzKldv6fbMjlXcG?= =?us-ascii?Q?vg9OthB0oxOtaraWGxVbT+2RvPlvAzMvqTyx6OHBq7FWuxVrAmuxfe/saP7J?= =?us-ascii?Q?xMwQ0FQTGZ/RjEX0/geJWDrKdHu2NNCW7HJCmbBuWjUY4SwMQxUtJ+IcDBv1?= =?us-ascii?Q?0w90q/E/aA+LWdr16/blVofwaLYD35yxKXxaRxaISkBVQAbbh6MJMVvF/7Bg?= =?us-ascii?Q?h3MBeKyCT5AnCz5L+qfQQ+kFwxn+jYwFQix8F17fE/r3lbuQX3oD0gcsSK7O?= =?us-ascii?Q?yCm6F6MGi/iSOTX5D8fGSKa7RbN2ZLNlZai9pBmNKeqIGEkvRopeXyrciOQn?= =?us-ascii?Q?m1TWbWwP2lsnr9n3ldZV5HB3bVTKx77tBrHN/5e1KxCB02njCt30ztajVc79?= =?us-ascii?Q?KTesp2JD5ox7NotE59USXXAeDoLaJTnosw6U8n5r/Jp8ImhaQw3NXvLGNIc+?= =?us-ascii?Q?LUZ0R1CWRutuExSbDpCBsVW56EaChlFfDBcElk6t7zhmyYxMNQAj8uUs0omM?= =?us-ascii?Q?9xJA+XsP9v9/RJ31mSOLpdyVDbnGHFa55GTNPmxh?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-ExternalHop-MessageData-0: PAPPnGdgOhWGcUweCoRVKbR5FQ1sRo0Ha4V6KQRM3FS0c1mF4IQQaUMy2Iz6oNtg/QsLz+pLg9reGT4CDWW6SYm/dZPrC4h9aPpPdWZyxt+W9vSn+9l/cL9mytiXr+X4DqsTINQTrokS7oucjqPgsa+gehgHXIc31TBAQnRuDUviSl0u0oi3ombQ4erFsymLG46ZODvlUkq46gA552UyNgBOQ6RaIg5ZKmbeVLzhuudJhR9EyjVqXl9efqRe8skLj2LZXPCeJI9ftifjFz/VjtHfcQ7PDkhRqN/i/8bn9GZI8j4w5G5E0mDQUZh2xrxcHwszPF+hl36AAw7NmV4Z3VmrQ948KWLDUGN9JjPrUKGhxYjLRKGf5afwNsA/i6i883hyOq6NUUXgtnyPZsm9Dlbz4fW9acu4/nxDUs8nNccD13vC0UfkM0NiF0PJGjQ8VK8niUPbEmGf26V/d204yYerYQ4CaqhHZr5KWbeqb5K11fQ4CpihRXu7WoF+ZTfeXjLiJtLq3LZr42A98tPkGwOk17mwj41O+ceycerqFJXvkU00bv60cG+D3BVpU7F+7wKaopJHCNBQsoHZ9URfcJUupUlzUXmidy5gatg+IjdK9T3FLAewEK/gxu5+zWl9 X-OriginatorOrg: netscout.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CH3PR01MB8470.prod.exchangelabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: a7399727-7521-4506-db4d-08dc6aeaa329 X-MS-Exchange-CrossTenant-originalarrivaltime: 02 May 2024 20:58:37.1528 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 54f11205-d4aa-4809-bd36-0b542199c5b2 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: eyVLweYetf3cRuj94e+SS4zYtwsT42IwO5eS+FRx1RE8GpX70qFh+M0pGpkh4gZzOvC5kyDKSXct/P9Hi3npRQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ2PR01MB8401 X-Proofpoint-GUID: boqPnXINe-iXlleBZ3VggHHU1trcX18Z X-Proofpoint-ORIG-GUID: boqPnXINe-iXlleBZ3VggHHU1trcX18Z X-Proofpoint-Spam-Details: rule=outbound_policy_notspam policy=outbound_policy score=0 mlxlogscore=979 malwarescore=0 bulkscore=0 phishscore=0 adultscore=0 priorityscore=1501 impostorscore=0 mlxscore=0 lowpriorityscore=0 clxscore=1011 suspectscore=0 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.19.0-2404010003 definitions=main-2405020138 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Hi Dmitry, Yes. I will look into=20 The VM gives the following: [root@vSTREAMO9-234 bin]# prlimit -v RESOURCE DESCRIPTION SOFT HARD UNITS AS address space limit unlimited unlimited bytes I saw these optional configurations in my google searching, but was hesitan= t because of unknown impact. I will try this path next. It would be valuable to have meson be able to configure DPDK for low memory= devices. Thank you for replying. Regards, Ed -----Original Message----- From: Dmitry Kozlyuk =20 Sent: Thursday, May 2, 2024 4:04 PM To: Lombardo, Ed Cc: dev@dpdk.org Subject: Re: Need help with reducing VIRT memory External Email: This message originated outside of NETSCOUT. Do not click l= inks or open attachments unless you recognize the sender and know the conte= nt is safe. Hi Ed, I presume it's a revival of this thread: https://urldefense.com/v3/__http://inbox.dpdk.org/users/CH3PR01MB8470C9675= 763E14954D6E3B88F292@CH3PR01MB8470.prod.exchangelabs.com/__;!!Nzg7nt7_!EBEN= SvDUv9LcvbAw6vLkHgh11JdjksApffakP2JU30OJaPLCkZPZVzk4U8rRTJsxJVCeRubpFQy7TB2= -R6jDbrk4QpU$=20 2024-05-02 19:05 (UTC+0000), Lombardo, Ed: [...] > My situation is as follows: > We were on DPDK 17.11.6 and upgraded to DPDK22.11.2 to support the Intel = E810. Also upgraded from CentOS7 to Oracle 91. > In DPDK 22.11.2 the VIRT memory has skyrocketed and causes major issues w= ith our application that runs on 16 GB of memory (virtual appliances and lo= w end remote appliances). >=20 > I have also tried DPDK 23.11 and 24.03 and I also see across the DPDK=20 > versions that the VIRT memory has increase by a factor of 5 over DPDK=20 > 17.11 >=20 > Our application process shows VIRT memory is 7.6 GB with DPDK 17.11.6,=20 > and with DPDK 22.11.2, 23.11.2 and 24.03 the VIRT memory is ~36.6GB >=20 > Our application minimum configuration needs to run with 16 GB memory when= DPDK is enabled. As explained in the linked thread, high reserved VIRT does not mean high memory demand. Running DPDK on a 16 GB machine is perfectly viable. Something in your app or setup conflicts with the high VIRT reservation. > Our application uses memory locking and rlimit settings to get optimal pe= rformance. Does it use address space limit (prlimit -v)? If so, this limit may be hit. With default build options, DPDK reserves at least 32 GB of VIRT (one list)= per memory type (a combination of NUMA node + hugepage size). This is controlled by defines in : #define RTE_MAX_MEMSEG_LISTS 128 #define RTE_MAX_MEMSEG_PER_LIST 8192 #define RTE_MAX_MEM_MB_PER_LIST 32768 #define RTE_MAX_MEMSEG_PER_TYPE 32768 #define RTE_MAX_MEM_MB_PER_TYPE 65536 Try reducing those and rebuilding DPDK if the above is your case. Reducing these values will limit the amount of memory available to DPDK all= ocator in your app.