From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 65DE8A0547 for ; Wed, 29 Sep 2021 12:14:57 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D7B8D410D7; Wed, 29 Sep 2021 12:14:56 +0200 (CEST) Received: from mga12.intel.com (mga12.intel.com [192.55.52.136]) by mails.dpdk.org (Postfix) with ESMTP id 10DD040685 for ; Wed, 29 Sep 2021 12:14:54 +0200 (CEST) X-IronPort-AV: E=McAfee;i="6200,9189,10121"; a="204395788" X-IronPort-AV: E=Sophos;i="5.85,332,1624345200"; d="scan'208";a="204395788" Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga106.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 29 Sep 2021 03:14:53 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.85,332,1624345200"; d="scan'208";a="438400013" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by orsmga003.jf.intel.com with ESMTP; 29 Sep 2021 03:14:53 -0700 Received: from orsmsx607.amr.corp.intel.com (10.22.229.20) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.12; Wed, 29 Sep 2021 03:14:53 -0700 Received: from orsmsx602.amr.corp.intel.com (10.22.229.15) by ORSMSX607.amr.corp.intel.com (10.22.229.20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.12; Wed, 29 Sep 2021 03:14:51 -0700 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.12 via Frontend Transport; Wed, 29 Sep 2021 03:14:51 -0700 Received: from NAM04-MW2-obe.outbound.protection.outlook.com (104.47.73.173) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2242.12; Wed, 29 Sep 2021 03:14:44 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=HUEeCIXy0RYYyKKzDD4bX3IKfcZy9y8YfsWgbiNMNjNmMmh4xoeUOBJOcxcVCvk8GQI6bdBcqYPKd+4cfB+PoUCmqlMQoRa5Q0shAe6EFFr72D9cOr8CQGRK0wsz2oMyfm70Tk18WAV/OB41YGa8hTkm0pFibnV4xjfaEYeCZsmBs6tLOMoeLqdAQ5kISy+z7guaUzha3Tz9eVhEfIBgC/jbQ2w95Rz+ddmW5eOSf0S8jVI7rf10v2c+lanQKflKqEW3tvd8k1k+k6t+VYqdxOGThasI9tEIm0bIzbCZr1M7oSryx2mRjbugBIsnUDFHdzGvaXDLX1eO69cSoqXaJQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=pYw0MwZDv8gy4d27t1KAY8ao2qQF2li7ZgbZym+3sW8=; b=K0VZQuHdWPjJCG3GfMiEBCYDzTIy8OSm+QLsPozJsz1dzElm94kEeSv3tgzDEiSUgwpml/4RGdaYFEgOaXTAY05yn+zJtCtevNx+3MyY20nA5zdZFt7NTh7LZePqWeXOYRlp+2zzIE/CI5kwjxUyJE09KZEeGBG6vvel3hA33HP7FMKwh3yC1TyzceRc2QV/ohrWxuOU2/+7Jkj6U1IQbPVlantLDxq/5P2jkdw3iluVgChjpd1vEXsJMNN+v46SOX7Hab4A9DHPL5rG4vkP3prOHNEmlQgm+jYAt6XuT6ZKjpeiwQifL/cuffN3j8Kf6W4qzjPX/Ax/16tBQAXXCw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pYw0MwZDv8gy4d27t1KAY8ao2qQF2li7ZgbZym+3sW8=; b=XyuWYaWHU345MKVzhysufwFCi/YeSXDqpGR79MrJGw3UrDFrbMwtSv6i6PLa4wXvrXCgPkCuBBPRt5TJBe0FSli1S+vzy6rpQqGo9+PmyV93NkD9hEEZLY23ZxPSBP9Xq51i88P7UR1F9ZZVYlRmYtc3/sdugLbGzkwHmRWmN2s= Received: from PH0PR11MB5093.namprd11.prod.outlook.com (2603:10b6:510:3e::23) by PH0PR11MB5143.namprd11.prod.outlook.com (2603:10b6:510:3f::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4566.14; Wed, 29 Sep 2021 10:14:26 +0000 Received: from PH0PR11MB5093.namprd11.prod.outlook.com ([fe80::d145:710a:1bac:7e91]) by PH0PR11MB5093.namprd11.prod.outlook.com ([fe80::d145:710a:1bac:7e91%9]) with mapi id 15.20.4566.014; Wed, 29 Sep 2021 10:14:26 +0000 From: "Burakov, Anatoly" To: Thomas Monjalon , Mohammad Masumi CC: "users@dpdk.org" , "dmitry.kozliuk@gmail.com" , "Richardson, Bruce" , "stephen@networkplumber.org" Subject: RE: [dpdk-users] Memory allocation limits Thread-Topic: [dpdk-users] Memory allocation limits Thread-Index: AQHXtRip4LyPzzTjJEetjFiHZQTf0qu6ykkw Date: Wed, 29 Sep 2021 10:14:26 +0000 Message-ID: References: <1728391.6pqWS55XY0@thomas> In-Reply-To: <1728391.6pqWS55XY0@thomas> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.6.200.16 authentication-results: monjalon.net; dkim=none (message not signed) header.d=none;monjalon.net; dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 4db5d9cb-3187-4a9e-4f81-08d98331eac6 x-ms-traffictypediagnostic: PH0PR11MB5143: x-ld-processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6790; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: rW4gkr0/yS4n4x6W3azFWr4dXVIHAVtrxcpr/EISfmw6cO4Wwuxi/cIisEPA6l6q/ZNCOQHMSBrVQ0udqwOScEflAWUQGbJ9ARtEiA7Z8Le0rEo7GqFwQbe0CDfDobyr18QJXAey7vNOtfphqkxYEDVJCqd1585W2nizjywUxh+OeEJE1NVCmITcWvm1PtddNcLMhvC/ofmaIGV+4OzSIEEnMWSQV5Jb6Q5sv4jAnruBEA53R/JT6LLU15/aLdT6/WXBjOZ90NJXuMS2rn9GxoZ7BGYMu6m2C/BVSzskaGr9IRxjWk52DT7ryf/RLyroNmrh5+Vw9qBvRhzk5BYUBMFuDLXBjhq4+hnc3/nF92AWk5LX+50p/cQmSrwdJxy6Xw+jkO/N5vL1S869ObPIAL1AZG076P/I/SyeEaSRUxoqX3ety+aSLfTZ4UcbTQV2XcR96vzP9u//JMPmim2RFsNXxA4laOSeQr0ndk9i10MdiC3N4jgXcXrr1khlgoyyv5ZqBSAGoZHsM0u29vfIa27Ez4bPJ6ln+5pj5HH2LRt6EJTpyXjmAZaeKatcLK/0K+8xVyn6g1T71DzzS7pIAI0fVr+G6Gj2aOfkchFDc+ij3EjzkrBFcK+IIoen1v4G/bjbZmAHMdXU4MX0pv6Dqa5gEeuuqKDduslEpGSA/dLqFC7Vo42ixzJnO85lR78o3sE7LVkOTuwSTAOB0F4jwA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH0PR11MB5093.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(508600001)(83380400001)(86362001)(316002)(54906003)(38070700005)(110136005)(66446008)(64756008)(7696005)(66556008)(66476007)(186003)(5660300002)(8676002)(122000001)(33656002)(2906002)(9686003)(55016002)(8936002)(52536014)(38100700002)(71200400001)(76116006)(26005)(6506007)(4326008)(66946007)(53546011); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?YwHOjihn5K5ehz4Pw23SGhbB5PRkNbaTg7u8FhnK9c3UapYYp9HXvIsLXSFO?= =?us-ascii?Q?ixZ+TSEUqSh+iqGgsFUtU9s843zsW6+G1KvoFz6o+vfumA/t/ItZFIRoh1D3?= =?us-ascii?Q?jV/tM2Zkwg7jbJJ5HuEtDknYn1jbtGDCRFLDmd0cIy/5F5UPjxa0VRCaq3p6?= =?us-ascii?Q?8WhyoPmoJL6hbogcxYn+CLBOCQCJv4ONHgaLe/kuBvYXFHB3miEGIQhPUmjd?= =?us-ascii?Q?CAZy5OVaIo0uL/7TYzGpCiBhhNZweMAGRrfNnHUS/dt6jQvqeprDZcJ97ul8?= =?us-ascii?Q?55aO+ni1bGX/AW1T0W/CYn+0anz+FZK2k2OxzkkaGesKSv079O6iELRRTf5p?= =?us-ascii?Q?RHdA93CmM0XGiaXgrixTeoGICzZrC/RbGwFyIzgpmPg7flBJxpMENMfl5LZC?= =?us-ascii?Q?wLz1qxJvHhk5SesQJ0Dr3OOwAVoR9WTJ3SRHgX4WizU7XpkuWz1d3oXSOgAA?= =?us-ascii?Q?g8zWbJy+EOqoG6TFkGpMlZDiEeP6A+GWmkuiaZVbo28OyfuJKQFQfHym9Q2/?= =?us-ascii?Q?VGw0E/foSHQ9VwmEOacG2nWk0zWx8vpOrcWZJuqXv/OaTsDJ1aYagTTRV4ER?= =?us-ascii?Q?m3hFlKMFRNPkWGY9VK+RAwP45mt8mpFEdPDNRE5f1HsabtjnX9UYOHg+bqD0?= =?us-ascii?Q?BXCI6XDl4xppYKK/fmAFCQp+8llqDYoPK0sUIMqLrFspQ9MXknm8GUBSEXRN?= =?us-ascii?Q?U7d3B9h5tf/+Fy+SYzfMsHowxjelU/P2pYXGug4K7HSt+FRLqIbPR643Rhon?= =?us-ascii?Q?57PnrQG7H29aW96Sdws56sHh7O8ayv4u1oYHJI8dSkf8PFAhQk2z4Gkyvnkm?= =?us-ascii?Q?2Jacu8p/cbGCJPFQIt4XmmcWgPmu8ea0BjaxBceRFNcTaqrNIT8A39/VFk24?= =?us-ascii?Q?E3LsbyAciesZkmMDPNlZuBL0t621FVEw8HRMcMGodUobRBkv1iTERUnyHCk/?= =?us-ascii?Q?VWVErMRt2ApE0dfs3s/s33p7nXIJ4QGATmPAraP6TtqDnSSVDeDaAjfTCMUx?= =?us-ascii?Q?Rqr0eU02VyTskES/zT9O624bKS63I6DiXS83iTjp7rdR9c1YZZ7IuW4MRA+s?= =?us-ascii?Q?xaJkzkwzD0ezcnIxfKCsSynr/KmcmmCzpIqu3MpGO2orcYKTjGbTskck+A9P?= =?us-ascii?Q?Lw02NOj4SdlBF78WQaquZQbGAWO/Y2AUx3ouzHTQUQXQovtN+yFrdkH0a8WX?= =?us-ascii?Q?G+oGgrimszaPOGGKRKzzaGxEsPHjXudo1Iobdis4NkTC5oJ/uZkavBTNYrIi?= =?us-ascii?Q?D1T8yt33s99bxlEgHXf2gf6tcq0la8DTPNEndZBMWsMMDmAOX2uJKrLIWcmG?= =?us-ascii?Q?kO+JmH78lLb4UOoLbQ9bAdtz?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB5093.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 4db5d9cb-3187-4a9e-4f81-08d98331eac6 X-MS-Exchange-CrossTenant-originalarrivaltime: 29 Sep 2021 10:14:26.0527 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: oD8MnWFU6RFebYdku3yu1B/jV4pJSyx6QBJWNEY1Bicbd6/H1KWesmzTOQaFMe3Ua2rGOGoDNryq31nLBkq9iA0yGIG5bWR1C3HmyjLgFwY= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR11MB5143 X-OriginatorOrg: intel.com X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org > -----Original Message----- > From: Thomas Monjalon > Sent: Wednesday, September 29, 2021 10:59 AM > To: Mohammad Masumi > Cc: users@dpdk.org; Burakov, Anatoly ; > dmitry.kozliuk@gmail.com; Richardson, Bruce > ; stephen@networkplumber.org > Subject: Re: [dpdk-users] Memory allocation limits >=20 > 26/09/2021 17:52, Mohammad Masumi: > > Hi > > > > I have HP server with 768GB memory 384GB in each Numa but I can't > > allocate more than 64GB by rte_malloc by changing some parameters in > > rte_config.h it increased to 128GB How to increase heap size? >=20 > adding people Cc to help >=20 Hi, This is intentional. In order to increase the amount of contiguous allocati= on possible to perform in DPDK, you need to adjust the following values in = rte_config.h: #define RTE_MAX_MEMSEG_PER_LIST 8192 #define RTE_MAX_MEM_MB_PER_LIST 32768 #define RTE_MAX_MEMSEG_PER_TYPE 32768 #define RTE_MAX_MEM_MB_PER_TYPE 65536 I do not recommend arbitrarily changing them as this is untested, but incre= asing them proportionally (e.g. multiply all of them by 2 or 4) should not = break anything. Thanks, Anatoly