From: Bruce Richardson <bruce.richardson@intel.com>
To: "Lombardo, Ed" <Ed.Lombardo@netscout.com>
Cc: Dmitry Kozlyuk <dmitry.kozliuk@gmail.com>,
"dev@dpdk.org" <dev@dpdk.org>, <anatoly.burakov@intel.com>
Subject: Re: Need help with reducing VIRT memory
Date: Fri, 3 May 2024 16:52:07 +0100 [thread overview]
Message-ID: <ZjUIJ4uRwryiXzis@bricha3-mobl1.ger.corp.intel.com> (raw)
In-Reply-To: <ZjUCa2lmHbEZ-rFo@bricha3-mobl1.ger.corp.intel.com>
On Fri, May 03, 2024 at 04:27:39PM +0100, Bruce Richardson wrote:
> On Fri, May 03, 2024 at 02:48:12PM +0000, Lombardo, Ed wrote:
> > Hi Dmitry,
> > I am not clear on the DPDK memory layout and how to tweak these #define values.
> >
> > #define RTE_MAX_MEMSEG_PER_LIST 8192
> > #define RTE_MAX_MEM_MB_PER_LIST 32768
> > #define RTE_MAX_MEMSEG_PER_TYPE 32768
> > #define RTE_MAX_MEM_MB_PER_TYPE 65536
> >
> > I want to limit how much DPDK grabs for memory, but grabs what it absolutely needs for our application.
>
> Hi,
>
> This is what DPDK does. What is being shown in the VIRT figures is the
> address space reservation DPDK has made, but not what memory it actually uses.
> Only sufficient hugepage memory to meet the demands of your app should be
> mapped by DPDK, the rest is unused address space that is not taking up any
> actual memory.
>
By way of illustration, here is the memory output for a testpmd process on
my system. I got this by running "top -b -p <testpmd-PID>"
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
2336969 bruce 20 0 256.2g 26432 19712 S 93.8 0.0 5:28.13 dpdk-testpmd
If we look at the memory relevant columns, indeed VIRT shows a huge value -
256G in my case. However, the actual RAM used by testpmd is given in the
"RES" (resident??) column, showing that testpmd actually is only using
26,432kB of memory in this instance, of which 19,712kB is shared memory
(mostly hugepages). In fact, testpmd actually has even more hugepage memory
than that mapped into it, but they must not be actually in use. [Anatoly,
can you confirm that this would be the case when using vfio-pci i.e. no
physical addresses to query?]
Regards,
/Bruce
next prev parent reply other threads:[~2024-05-03 15:52 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-05-02 19:05 Lombardo, Ed
2024-05-02 20:03 ` Dmitry Kozlyuk
2024-05-02 20:58 ` Lombardo, Ed
2024-05-03 14:48 ` Lombardo, Ed
2024-05-03 15:27 ` Bruce Richardson
2024-05-03 15:52 ` Bruce Richardson [this message]
2024-05-03 18:58 ` Morten Brørup
2024-05-03 20:07 ` Lombardo, Ed
2024-05-03 20:54 ` Dmitry Kozlyuk
2024-05-03 20:56 ` Dmitry Kozlyuk
2024-05-03 21:18 ` Lombardo, Ed
2024-05-04 6:51 ` Morten Brørup
2024-05-05 3:25 ` Lombardo, Ed
2024-05-05 9:35 ` Dmitry Kozlyuk
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZjUIJ4uRwryiXzis@bricha3-mobl1.ger.corp.intel.com \
--to=bruce.richardson@intel.com \
--cc=Ed.Lombardo@netscout.com \
--cc=anatoly.burakov@intel.com \
--cc=dev@dpdk.org \
--cc=dmitry.kozliuk@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).