From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <users-bounces@dpdk.org> Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5CE7A4627D for <public@inbox.dpdk.org>; Thu, 20 Feb 2025 15:55:11 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3170640041; Thu, 20 Feb 2025 15:55:11 +0100 (CET) Received: from mail-lj1-f174.google.com (mail-lj1-f174.google.com [209.85.208.174]) by mails.dpdk.org (Postfix) with ESMTP id D940F40041 for <users@dpdk.org>; Thu, 20 Feb 2025 15:55:09 +0100 (CET) Received: by mail-lj1-f174.google.com with SMTP id 38308e7fff4ca-30a317e4c27so8840971fa.2 for <users@dpdk.org>; Thu, 20 Feb 2025 06:55:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1740063309; x=1740668109; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=RSvylRnH6C0s2Nl5b2LreWVz0mPv8sajD10g4DEnfek=; b=YtmeorOnHfL3FEa+aW2UGBDv/rxSlXqxQG5Z0lVR9qD4d5Ot1rOrJmUed361aO3iwd ywpSniSSukaebnGLlNVddWiOTRqNKucHZCOi4EJVuXPaZMElevw8OJ+pDISYFAC9Ncfo k6nUbp6FQOUiYJpHmeb+Xbtms167m00Km7wZwKf++CmTe4CExUriNrS1POadlA1LRG7t /6LHCLxm9FnA16f0ifiXEXRGfCEukGo4q9PyfVLdCkj39Nyh6xMzhEGQwv0SCHb2x/cX dA+dKtzO30ylMisUyAL852k5gmvS7K010pknc0IqFyQ4EsSSuL7vudvE5QJqJIx7Hwot pqkw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1740063309; x=1740668109; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=RSvylRnH6C0s2Nl5b2LreWVz0mPv8sajD10g4DEnfek=; b=p8B8M1fHWsagFCYJARpUyJ8WdoCXZCLdjvAmYIAcQmuiws1VCMy+8rdVahBOl1w+av IoA0n47QVM500kyNcIEDY1sbDFj3hyJk9l+M4+n1M5y7lDyG0aM5jYVRXHkHpaD7MmPE PuCQHjplTulGu5sWYCOAuqCQUG58P7ERKEmDM9hyc6x9OP+sbmnburCL4z0SCGAsSz1B PdqbWqK+xDuJH1sTrKIFfsl+Yxjba52yNUw/DH/+Lkw0dQn1knw2HHoHvqj7KPgZtQjb N24bgARd9cDiY0DgjCP6e5MKF5DPCUjO55bMwsFIcQjqWPOO0RILB5f+L722/LhVIaVx BXFw== X-Gm-Message-State: AOJu0YxV1tmC3bG2FwagGMpDBlgFqlrvFBh+atcVI5qy9NfY9UoAnn6p lJ2IDLRdN/29zihSH4MuLnMcvSSAfu3cRYwA3MuopM/hxR7FWp3PgO+DMRiS X-Gm-Gg: ASbGncvbfqpiNhqX29viB3oTz/vUs+pLY3MgoTUYaVl6wcPxRzPCovkKb+aegyS9uwc KDEfNILEguULDXjw9ug+QOyMTWr8p46MnBgiRzkES6OtnproMr/KJaG8uSt41VSmBBfy/aHPg/i m/z4viSA6XeA+5y9rbLOS8MPoWUzBib6+BRbO9cK8AoTLDYCSJFiWiCE9GjJmZOzegJOaYBodNk 0u9a/X55ZjG8HgCNb/uc+xSwbx4X7fqM2j9B7A80ZGi/SefXYHKAluLCxjIGoGns7kDhZjO04gB nDMWwZeU5b3R0QOywlpqI/gAPRmefJtpKlHFjm8bJELHwkELEINu6W9crcJqZn0= X-Google-Smtp-Source: AGHT+IEm0Xbh1YAkm+zNVN9zZFIPlRi9YghTUPxPIz7nkYHDzTNmYv/W2f89LCXmqlEYD8fz2H8DmA== X-Received: by 2002:a2e:9ed5:0:b0:304:68e5:eabd with SMTP id 38308e7fff4ca-30927a2cdd9mr56487081fa.3.1740063308699; Thu, 20 Feb 2025 06:55:08 -0800 (PST) Received: from sovereign (broadband-109-173-43-194.ip.moscow.rt.ru. [109.173.43.194]) by smtp.gmail.com with ESMTPSA id 38308e7fff4ca-3091d025767sm23111241fa.54.2025.02.20.06.55.06 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 20 Feb 2025 06:55:07 -0800 (PST) Date: Thu, 20 Feb 2025 17:55:05 +0300 From: Dmitry Kozlyuk <dmitry.kozliuk@gmail.com> To: Lucas <lucascrijns@gmail.com> Cc: users@dpdk.org Subject: Re: Increase DPDK's virtual memory to more than 512 GiB Message-ID: <20250220175505.5116b4e0@sovereign> In-Reply-To: <CADTTPn8G453gJW4FPWOTU4Z8OvtG2g3fWUi1aexDnBzKkW1ceg@mail.gmail.com> References: <CADTTPn8Cgu3ShDWWGdd9whQQAmiFH9x9MaweZ4DR3XHdcww6Eg@mail.gmail.com> <20250220012828.21ae8b76@sovereign> <CADTTPn-zDTotOsCsnkuEQiRDdEfuLGVDo1hmuXetgGLd+TTP6Q@mail.gmail.com> <20250220142143.7cbecabd@sovereign> <CADTTPn8G453gJW4FPWOTU4Z8OvtG2g3fWUi1aexDnBzKkW1ceg@mail.gmail.com> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions <users.dpdk.org> List-Unsubscribe: <https://mails.dpdk.org/options/users>, <mailto:users-request@dpdk.org?subject=unsubscribe> List-Archive: <http://mails.dpdk.org/archives/users/> List-Post: <mailto:users@dpdk.org> List-Help: <mailto:users-request@dpdk.org?subject=help> List-Subscribe: <https://mails.dpdk.org/listinfo/users>, <mailto:users-request@dpdk.org?subject=subscribe> Errors-To: users-bounces@dpdk.org 2025-02-20 15:19 (UTC+0100), Lucas: > As for the issue, at 550 GB so 252'757'352 MBUFs (using default mbuf buf > size), it works now, with ring allocation. However, the physical memory > usage now goes up a lot and I end up swapping. It appears that not all > memory is in hugepages (not all pages are filled) and that perhaps the > kernel also allocates more memory. I have 755 GiB RAM available, so 600 GB > of mempool is pushing it. How is your system configured to reserve hugepages? DPDK always allocates hugepages; if none are available, allocation fails. Hugepages never swap AFAIK.