DPDK usage discussions
 help / color / mirror / Atom feed
From: "Lombardo, Ed" <Ed.Lombardo@netscout.com>
To: Dmitry Kozlyuk <dmitry.kozliuk@gmail.com>
Cc: users <users@dpdk.org>
Subject: RE: hugepage mapping to memseg failure
Date: Wed, 11 Sep 2024 04:26:39 +0000	[thread overview]
Message-ID: <CH3PR01MB847011AA037506646CEE71988F9B2@CH3PR01MB8470.prod.exchangelabs.com> (raw)
In-Reply-To: <20240911013644.58eaf50e@sovereign>

Hi Dmitry,
Legacy memory mode was one way to reduce the VIRT memory drastically.  Our application restricts and locks down memory for performance purposes.  We need to continue to offer our customers our virtual application with minimum of 16 GB of memory.  With DPDK 22.11 the VIRT memory jumped to 66 GB.
 The VIRT memory jump caused problems with our application startup.  You had helped me reduce VIRT memory to ~8GB and this came close to what DPDK 17.11 provided us.

Thanks,
Ed

-----Original Message-----
From: Dmitry Kozlyuk <dmitry.kozliuk@gmail.com> 
Sent: Tuesday, September 10, 2024 6:37 PM
To: Lombardo, Ed <Ed.Lombardo@netscout.com>
Cc: users <users@dpdk.org>
Subject: Re: hugepage mapping to memseg failure

External Email: This message originated outside of NETSCOUT. Do not click links or open attachments unless you recognize the sender and know the content is safe.

2024-09-10 20:42 (UTC+0000), Lombardo, Ed:
> Hi Dmitry,
> If I use grub for hugepages will the hugepages always be contiguous and we won’t see the mapping to memsegs issue?

There are no guarantees about physical addresses.
On bare metal, getting continuous addresses at system startup is more likely.
On VM, I think, it is always less likely because host memory is fragmented.

> I am investigating your option 2 you provided to see how much VIRT memory increases.

There might be a third option.
If your HW and hypervisor permit accessing IOMMU from guests and if the NIC can be bound to vfio-pci driver, then you could use IOVA-as-VA (--iova-mode=va) and have no issues with physical addresses ever.

Out of curiosity, why legacy memory mode is preferable for your app?

      reply	other threads:[~2024-09-11  4:26 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-09-04 22:23 hugepage allocation mapping failure Lombardo, Ed
2024-09-06 13:42 ` hugepage mapping to memseg failure Lombardo, Ed
2024-09-07 20:35   ` Dmitry Kozlyuk
2024-09-10 20:42     ` Lombardo, Ed
2024-09-10 22:36       ` Dmitry Kozlyuk
2024-09-11  4:26         ` Lombardo, Ed [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CH3PR01MB847011AA037506646CEE71988F9B2@CH3PR01MB8470.prod.exchangelabs.com \
    --to=ed.lombardo@netscout.com \
    --cc=dmitry.kozliuk@gmail.com \
    --cc=users@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).