From: Valerii Malov <jazzvoid@gmail.com>
To: users@dpdk.org
Subject: [dpdk-users] rte_eal_memseg_init(), virtual memory usage and coredump size
Date: Thu, 2 Jul 2020 15:56:50 +0300 [thread overview]
Message-ID: <8e4b96ea-cacd-3056-0120-595a7c3f30ea@gmail.com> (raw)
Hi,
I've noticed since upgrading to one of the recent DPDK versions (I think
it was DPDK 19), Linux application started to allocate rather big chunks
of virtual memory. This causes coredump file size to blow up, and
playing around with coredump_filter doesn't seem to help, since this is
not hugepages memory.
After digging through initialization process, seems like
rte_eal_memseg_init() is the culprit. It preallocates chunks for each
memory "type", until it hits one of the ceilings, in my case it's
default RTE_MAX_MEM_MB_PER_TYPE, which happens to be default 64
gigabytes, so on 2 numa node system this results in nearly extra 128
gigabytes of virtual memory.
Surprisingly enough, in FreeBSD implementation of rte_eal_memseg_init()
virtual memory usage seems to be a concern due to coredump file size
specifically.
Are there any ways to reduce the coredump file size apart from building
DPDK with reduced RTE_MAX_MEM_MB_PER_TYPE? Am I missing something in
system configuration and Linux is not supposed to dump those unused
virtual memory pages? This behavior is expressed on CentOS7, but I
*think* it was also reproducible on more modern distributions.
Thanks in advance,
Valerii.
next reply other threads:[~2020-07-05 20:53 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-07-02 12:56 Valerii Malov [this message]
2020-07-06 2:49 ` Li Feng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=8e4b96ea-cacd-3056-0120-595a7c3f30ea@gmail.com \
--to=jazzvoid@gmail.com \
--cc=users@dpdk.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).