From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id C562AA0507 for ; Fri, 1 Apr 2022 22:43:52 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5178940E03; Fri, 1 Apr 2022 22:43:52 +0200 (CEST) Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2059.outbound.protection.outlook.com [40.107.223.59]) by mails.dpdk.org (Postfix) with ESMTP id 04A304067E for ; Fri, 1 Apr 2022 22:43:50 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IAC6JKO3LMdDLabneogPHvCZSilodvLqWfLF8vh2mb8DuwIfHKnZjkSjubSUQSdEpr8dD3xhMU9w2sa+r4LIhoVFmv5H34s+zNsDXbdJDOCUb/4SuSzuz6RMBul1dcjD4QodVLY0n7ZESA/zthY2CmCVIqOxYWEFRJDR3JVMw3lgN9smuZHZxMC23Ol11FuDQWheaJnVJTySXWrvrfk2aEzWb4z9b/A8dy8PRErIn+sUgHxHcTWNBuzMpkI8aXbisI/aAHLarWdQU+PrIqkHRbljLdysbDEh3aHoEGZ5zRWujkdj5/7FeaCbRhSr5njSkrohVK5BbC5H8Nnk+2vJYA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=MFOOac/TGDceecKDqTzSMTz5X71YoU/Lgx3NikRwNIo=; b=P2a7O+du7NksyXBnwuHML49P7Aj5XjlDZqw9BE9+PyOAmNxE9+4fPqn8x6Utpf7G4WexE4ign3uL5eXIioACOnJqLL7Qve6sBknSZ17JlVLIuIRy/VcwRVafA07auh1jhGqiTIndQJy2/Vq3oxFAElQknvqYxqytlitRmL2acemATfD+ltpSZYRJPLU4V/R2y70XAaaDZHQpf+7E9nwyGgwokRpNtAqDLQpDzyzbeVnOEDC+sKKYyS59fv/8Nlq+7S4/rI0pxCwW00wtDm6gfoTsudtqphQUc2BYdmW3SKgE5mxo4OM4nx6vScUu5Q23lM4YtILJZze4JDGDrSWNaw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netquestcorp.com; dmarc=pass action=none header.from=netquestcorp.com; dkim=pass header.d=netquestcorp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netquestcorp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=MFOOac/TGDceecKDqTzSMTz5X71YoU/Lgx3NikRwNIo=; b=XLcvc4zfRpQHOUHmwtKJenKK3qxfV0dNEO21NO20y7myISibEa0BBNFMn9FQHoEfOdkwgssNhe+e+9EcTngPVx//2URLx8WZm+NlSUlBPkWugYsa8bTEq3UFB0D3ZiEU+VXSkJLF13ctZWb2MSsrLfqcIlIFGRR3cKIAYIPWSJc= Received: from MN2PR17MB4045.namprd17.prod.outlook.com (2603:10b6:208:205::13) by MN2PR17MB3919.namprd17.prod.outlook.com (2603:10b6:208:20c::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5123.25; Fri, 1 Apr 2022 20:43:47 +0000 Received: from MN2PR17MB4045.namprd17.prod.outlook.com ([fe80::6947:4d05:d5e9:bfcb]) by MN2PR17MB4045.namprd17.prod.outlook.com ([fe80::6947:4d05:d5e9:bfcb%9]) with mapi id 15.20.5123.025; Fri, 1 Apr 2022 20:43:47 +0000 From: Dave Sclarsky To: "users@dpdk.org" Subject: Re: [dpdk-users] Memory allocation limits Thread-Topic: Re: [dpdk-users] Memory allocation limits Thread-Index: AdhGBQeMo75xnZppRyWLH9pVGcG3fg== Date: Fri, 1 Apr 2022 20:43:47 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=netquestcorp.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 606f936e-e856-42a1-f1d5-08da14205202 x-ms-traffictypediagnostic: MN2PR17MB3919:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: IA0Ki30ObEImcwlJop/5PCqCtjuXWxaYXQZ0zsGRYN1sVoGiUySUlmCu3V+D40FJ25EFkj1s6irx9mAOvp0nmqaq909ysgPYek0eaCnHKJ9Fd0g0Y/ZSdGjAReS1e+7uodf/8T0WyF3SjwIqeoUn8r3+ICF4Ir0jSIKg2TVtD5wDW7HQkQHavG3p3Yu/9/Qayth10/peyvPteUYpYmwQAiRvMl4sIKN+sW369pmJdQ/Y0JyzZNgX5dNHoYEcmXW7xBaJ9AyUaM09ueVOVD3tfjmV9T0EneeT4wP/VyxcVe/8+rShZOllT4TWa46WgSV4yrLG9LBZi8twwgqrJAQFEyCMCzBYM6TNwypTUWYdlF/rfxdCQqUZ3Sl43kYZsHD3UCz00D6xCeTjUEpegA8uBI7+kW7QNh3O3Nl2auBtl5hqsKYrb2fPjcFMzu6ohyu/Pvj1KrlAUH+SKJlJtaS8tH36vxioGAapGEWBpSXmeEI/xtHlbLHsaStUT0O3jJkRVXHHqwngTdRs5T06QGL3GFRrh/EJO7Cxb0MDOsxW6b8lcgwQgSpqnLELyhi83WZoNCuE81/QE0Iy+Nw/IFo7IlL6/lNwR+rn5KzYg+iRnhvWdJeMi1tKdoqO7oxGa6SgBJJoqk34s3rukSuUE/Gn+7zQMSvZwrApdrmlJ/oFThTbvHNaEqIM+K/aTJz6KFEytbWTJ/EC5lpcoQf8641Lqw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MN2PR17MB4045.namprd17.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230001)(366004)(136003)(396003)(346002)(376002)(39830400003)(6916009)(38100700002)(316002)(76116006)(64756008)(66446008)(52536014)(5660300002)(4744005)(8936002)(122000001)(8676002)(38070700005)(86362001)(66476007)(66556008)(66946007)(7696005)(6506007)(9686003)(2906002)(83380400001)(26005)(186003)(508600001)(55016003)(71200400001)(33656002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?QlUfz+5RXT8tLdKSx5ECuB2HH+AgAFIU3iHTYa0P2ewAq1ooyyccwUFMMliy?= =?us-ascii?Q?B+Qf0HeOG8JkxKuaoMz2vnY1oJP3tkVgk3s+Hkq6GaTe2iMhWokTuZLxZGnu?= =?us-ascii?Q?Ozmv+KiudazmqyYqWYgKRDDRB+J6CHaYMXeNfw5n/XqYxVaGCpZy9viy3HYm?= =?us-ascii?Q?BN3vgVmeu3ptm6xguZXdn4mNo2cvTuUHnQAqyCoosCNKJFALI+7+Or+B+h+k?= =?us-ascii?Q?u7VzloSPRLW52EJr5lHJxmq+NRbTShzRVpd1FqI+AsmBjtIuifjQ3D6EtDO/?= =?us-ascii?Q?whEhPnKc+EnwOy53BAC9LZ0w1A6p/6SUC/lf/BCaynFrMiLkMnzbkXrbCJ36?= =?us-ascii?Q?o4t95Eol/DD3WdvKeIFSTS0ZU2WuFUQWhKV0nq0hZf1mSWW40fPuvStACQIS?= =?us-ascii?Q?cG8iu4ONAd94uufrXGpL/fUOHl2/fFQH1NbMnABqaGGkehM/0cfUNGwEPAVv?= =?us-ascii?Q?9dIDyUssoxdldEACWVz8FQgx24a6nCe8TXyaAiJPLNtoItraj/sB2VHOBceK?= =?us-ascii?Q?J7AzV13mXIUl4i7W2BecxqQJD8qrF1fv/EdOO8yJqBpmYLBPRsoOuYDvhx66?= =?us-ascii?Q?TxoTK8RiIqmYFq/Py/0V0ZtEt5fD2LG6qJiJzzL07qEpR1BCw/dXJCh0bheT?= =?us-ascii?Q?EMVo0RN4mpom3x9WOvn+AtrS4ralE6ugEfYLrVIAeGsMvsyznb2TFu7qkc1M?= =?us-ascii?Q?Kzb7O6jFGDrIesxdUmesW5HGvK/e80CVQafIcbSP0raJUE+TIh2Q/Y191o9m?= =?us-ascii?Q?O5FAsGbXGgMg0tnnjJWWmC4RFHpoZ46Issr49Sh8pkCDUVngby7Fpq52qJkD?= =?us-ascii?Q?PmebXk52XiuvpDWfzAtWDPPX4Wx9x14zaPWvclZcFhZeobCkf+5BFPWP+uN/?= =?us-ascii?Q?idP8N6Wf5kvQ8bQG0Ng+T77GCzugTwo8e6flH8nzhKLT1mO6emYVwrlGg18M?= =?us-ascii?Q?yhK1AlbURCye9M8hqVqyyjSMLilJg9bet5U4BpTd6WEOFFPwJ2c6yDNw4ySz?= =?us-ascii?Q?VpjyJplbCa85Eg8Cz3ROFo+7CAOc90FV7h2f9QIQE4oq0ZbtCZNHrwlT1p6f?= =?us-ascii?Q?460nfT+HAAabdw+hy8UplQFOA35gA81JCwzPZbMHzo8861uaAejofZpiQx2S?= =?us-ascii?Q?D07ZA6tkafvnHfEUo+oXe0Lp8Nkc6PPahgBysABfaNPHTVXhJwUIynS7+lIi?= =?us-ascii?Q?lGLiL1RxndNKPrUxw1uOSBgO525uk5WdSYMbG7JLudljWamNfdr+ROI6Nujx?= =?us-ascii?Q?EN4jrA5j2KKZsdUn76YMJW97tvLy51m5ToBla/P87qEmmO2TUMB9jlMO2TDZ?= =?us-ascii?Q?Ls42txURtXWGSNQ7ynrGCYe5e+AwFE3V2EvpheiS/wvVqxhl9ouZq7RdiC7n?= =?us-ascii?Q?X5MyLE2EF8cf50RMgCBAYgBopbA5ZIknt+hWjgJXQLpkSYqA+ZZ3F7/zoC1h?= =?us-ascii?Q?h7mAExzPf6rU0M+W4RFLkKP8rBapgZsOWyvupNha+On+e6Vd9TzkCyZAJVOY?= =?us-ascii?Q?FQMDecwAxAIRl6dRdz+OqqBA/9wQhy/S3pfZvxlwKm8qeTDp3ogikXl+r8fL?= =?us-ascii?Q?SIMlUUOO9oE+qXHzV+AUp99ujXBhTdt8fhCQd8g0C9QzPtcW+LFAVDLR92NN?= =?us-ascii?Q?LpBmdS7Mp3MazL8SAcskvVzUK6WmpXJQ3efzggL9GHDhkuD2Uvcb7xuJ7aeh?= =?us-ascii?Q?hPB6mbphj2fz5W0v/yId8a5H72QNWcpuxRAkloGTvpO0jiP+FYIEnz/8DAQr?= =?us-ascii?Q?kNXGf9JUJX7LaK9+te6t5i+yggQQM88=3D?= Content-Type: multipart/alternative; boundary="_000_MN2PR17MB404541C817070B596DBBDCD3C8E09MN2PR17MB4045namp_" MIME-Version: 1.0 X-OriginatorOrg: netquestcorp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MN2PR17MB4045.namprd17.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 606f936e-e856-42a1-f1d5-08da14205202 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Apr 2022 20:43:47.2686 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: eb57c596-1b7a-41c8-b35c-ac7429c2e4ca X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: YrVVCTvoq69gXCkKXRKqgfZcW+T/L0rqCeUqhelM89z7Q7yt2AuledRTStCParVfZpYh9g3g9pOlTq0ON7sl/aKnshFZcc1Ekl5dCVrOK1k= X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN2PR17MB3919 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_MN2PR17MB404541C817070B596DBBDCD3C8E09MN2PR17MB4045namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I'm have a similar problem (but with a dell server with 512GB memory, 2= 56 in each numa). I can only allocate 128GB, 64 from each NUMA. If I try 130GB (65 from each= numa), I get "eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg= _list". I tried changing the config variables mentioned in "3.1.4.5 Maximum Amount = of Memory" , but no matter what I do to the RTE_MAX_MEMxxx values in rte_co= nfig.h the limit seems to be the same. I tried multiplying all of them by = 4,8,16...nothing helped. I also see that RTE_MAX_MEM_MB is "hard coded" to = 524288 for ARCH_64 in meson.build, which should be enough so I didn't try t= o change that one. Has anyone succeeded in allocating more than 128GB? --_000_MN2PR17MB404541C817070B596DBBDCD3C8E09MN2PR17MB4045namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi, I’m have a similar problem (but with a del= l server with 512GB memory, 256 in each numa).

I can only allocate 128GB, 64 from each NUMA.  = If I try 130GB (65 from each numa), I get “eal_memalloc_alloc_seg_bul= k(): couldn't find suitable memseg_list”.

I tried changing the config variables mentioned in &= #8220;3.1.4.5 Maximum Amount of Memory” , but no matter what I do to = the RTE_MAX_MEMxxx values in rte_config.h the limit seems to be the same.&n= bsp; I tried multiplying all of them by 4,8,16…nothing helped. I also see that RTE_MAX_MEM_MB is “hard coded” to 5242= 88 for ARCH_64 in meson.build, which should be enough so I didn’t try= to change that one.

 

Has anyone succeeded in allocating more than 128GB?<= o:p>

--_000_MN2PR17MB404541C817070B596DBBDCD3C8E09MN2PR17MB4045namp_--