From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id EAF17432F3 for ; Fri, 10 Nov 2023 10:31:36 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id CFF2740291; Fri, 10 Nov 2023 10:31:36 +0100 (CET) Received: from mail-lf1-f47.google.com (mail-lf1-f47.google.com [209.85.167.47]) by mails.dpdk.org (Postfix) with ESMTP id 6416D40268 for ; Fri, 10 Nov 2023 10:31:36 +0100 (CET) Received: by mail-lf1-f47.google.com with SMTP id 2adb3069b0e04-507cd62472dso3261902e87.0 for ; Fri, 10 Nov 2023 01:31:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699608696; x=1700213496; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=oaes4nhQe89k33mKOoYXjDVrfbxsb18V4f9RWspiljo=; b=R0Fs8T/bBt8LpZD4hsiz/vdvVDhSF/WAr3ESE73QS8mnInDYOYB6NeXncBJF/4xcY3 Lhhn0wCPLn7pWFfBslnv6bfB3xreOMTmSS1XdisMzPSNTom9m5lilc0L6tccjlX6T5A4 K6fxE5adc17FlNXNa87hQtNAjJDtNRZeGYdAHMiYGsUrr3+kIpr5SJ5TW60SBuh58YCH 3p9oNBbLAZSpMKf6KDRJTBADPdEq5OGrPfDUNE8hmY35DqZSGK0frG57pTvfQ2KSzV2g WiYWgNmQDB7CmX3NdQB2Q98CImRiK2W9PwahP1NRoltygp9hrqAK7ocs0ZdvygSpP7YP jiqw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699608696; x=1700213496; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=oaes4nhQe89k33mKOoYXjDVrfbxsb18V4f9RWspiljo=; b=pwULtEZPidLpo0ksw6FGjFLKc/pM7ddzwwzLCX/KmeGLNFV9U77L4vZHDyMnWYwy2e 2ljGAqdKkevQoF9iR1Qmg/Ai8zZzxBtDw4WnaHI/LgWpLBH1l+6OhsA+wndFlQFhy+sR rz5tx2rZC2srFgKYo9GhOSQ+NXiKUq3Q9swnWX+ljH5/7ypdywIJnUXVF90sXZSqcwNo +Yaj5S5mWY0s3TiNBtm2pqFj5fJxYGF//XynQWe3g+zvPy2qtLoBxZgXXkdYT8CtZ4Wp PPytSuMNSpegmbyIUgxCAVRu9Tb5lm3UMj7Tt6+uNltcMBcP4SHq/9SBMw30bAEiOL7/ uV2w== X-Gm-Message-State: AOJu0YzYjYwSoJ7k+XjCQ+WxUJvO6UU8+tuha9Xw5vHw3trLLYw1IXbl jgovN7Js5Z1fXxY9L/BsZpRT5v7zmOI= X-Google-Smtp-Source: AGHT+IEACfvIv5CxRoKeOC/y6QgYjSGU49d49sbDOUb5bzuvGzP2QOXlSseGpSIih28rb13yiIXgkQ== X-Received: by 2002:ac2:5e99:0:b0:507:bd5f:a40a with SMTP id b25-20020ac25e99000000b00507bd5fa40amr571929lfq.23.1699608695463; Fri, 10 Nov 2023 01:31:35 -0800 (PST) Received: from sovereign (broadband-109-173-110-33.ip.moscow.rt.ru. [109.173.110.33]) by smtp.gmail.com with ESMTPSA id q11-20020a0565123a8b00b00505723e56acsm1321801lfu.273.2023.11.10.01.31.34 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 10 Nov 2023 01:31:34 -0800 (PST) Date: Fri, 10 Nov 2023 12:31:33 +0300 From: Dmitry Kozlyuk To: "Lombardo, Ed" Cc: users Subject: Re: DPDK 22.11.2 requires too much VIRT memory, how to reduce Message-ID: <20231110123133.2adbd2cc@sovereign> In-Reply-To: References: <20231109020550.365e80bc@sovereign> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Ed, 2023-11-10 00:16 (UTC+0000), Lombardo, Ed: > I finally finished testing all the options and found the VIRT value can be > reduced from 66 GB to 16 GB with --legacy-mem setting in EAL init argumen= t. Right. By default, DPDK can use up to 64 GB of hugepage memory, so it reserves 64 GB of VIRT (but does not map most of it), RES should be low until the app actually allocates something. In legacy mode, DPDK maps all available hugepage memory at startup, in your case 16 GB, VIRT and RES should be close. > So I therefore had to increase the VM memory from 16 GB to 24 GB (instead > of 80 GB without this setting). I don't understand why you have to do that. Possible VIRT is not limited by available RAM. DPDK should be able to reserve 64 GB of VIRT on a machine with 16 GB of RAM, it will just be unable to map more than 16 GB (obviously). > I wonder what do we give up with this setting? >=20 > All the other settings I tried and combinations of these had no impact (s= ocket-limit=3D2048, single-file-segments, no-shconf, and no-telemetry) on V= IRT memory. >=20 > Thanks, > Ed >=20 > -----Original Message----- > From: Dmitry Kozlyuk =20 > Sent: Wednesday, November 8, 2023 6:06 PM > To: Lombardo, Ed > Cc: users > Subject: Re: DPDK 22.11.2 requires too much VIRT memory, how to reduce >=20 > External Email: This message originated outside of NETSCOUT. Do not click= links or open attachments unless you recognize the sender and know the con= tent is safe. >=20 > 2023-11-08 22:26 (UTC+0000), Lombardo, Ed: > > Hi Dmitry, > > I went to the dpdk.org and I don=E2=80=99t see DPDK 23.11, > >=20 > > [cid:image001.png@01DA1268.AA1AC1F0] > >=20 > > Do you have a pre-release version? =20 >=20 > Sorry for the typo, I meant v22.11.2 that you're testing. >=20