DPDK patches and discussions
 help / color / mirror / Atom feed
* [dpdk-dev] DPDK 18.05 only works with up to 4 NUMAs systems
@ 2018-06-22 16:37 Kumar, Ravi1
  2018-06-25 16:16 ` Burakov, Anatoly
  0 siblings, 1 reply; 13+ messages in thread
From: Kumar, Ravi1 @ 2018-06-22 16:37 UTC (permalink / raw)
  To: dev

Hi,

As the memory subsystem in DPDK 18.05 is reworked, it has introduced a problem for AMD EPYC 2P platforms.
The issue is that DPDK 18.05 only works with up to 4 NUMAs. For AMD EPYC 2P platforms, DPDK now only works with P0 (NUMA 0-3) and does not work with P1 (NUMA 4-7).

The problem can be fixed by reducing some of the default settings of the memory subsystem.

To solve this issue:
-              We can create our own config file for our integrated 10G NIC, that is for amd_xgbe PMD. This will make amd_xgbe immune to this problem.
-              However, when any other NIC (Intel, Mellanox, Cavium or Broadcom etc.) is plugged into NUMA 4-7, the problem will still be exposed.
-              If we only fix it in "config/common_base", it will cover all cases.

Our current workaround is:
Edit config file "./config/common_base" and change the following line
                CONFIG_RTE_MAX_MEM_MB_PER_TYPE=131072
TO
                CONFIG_RTE_MAX_MEM_MB_PER_TYPE=65536

Any better solution for this issue is welcome.

We would appreciate if this issue can be fixed in the next release (18.08) so the STOCK version of DPDK works on AMD EPYC 2P platforms.

Regards,
Ravi

^ permalink raw reply	[flat|nested] 13+ messages in thread
* Re: [dpdk-dev] DPDK 18.05 only works with up to 4 NUMAs systems
@ 2018-10-04 17:07 Sandeep Raman
  2018-10-05 15:31 ` Burakov, Anatoly
  0 siblings, 1 reply; 13+ messages in thread
From: Sandeep Raman @ 2018-10-04 17:07 UTC (permalink / raw)
  To: dev

Hi  Anatoly,

I made the changes per the patch http://patches.dpdk.org/patch/43298/,
however testpmd failed.
Alongwith the patch, CONFIG_RTE_MAX_MEM_MB was increased to 1048576.

Logs at https://pastebin.com/XPCDRD2h.

Cheers,

^ permalink raw reply	[flat|nested] 13+ messages in thread

end of thread, other threads:[~2018-10-05 15:35 UTC | newest]

Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-06-22 16:37 [dpdk-dev] DPDK 18.05 only works with up to 4 NUMAs systems Kumar, Ravi1
2018-06-25 16:16 ` Burakov, Anatoly
2018-06-28  7:03   ` Kumar, Ravi1
2018-06-28  8:42     ` Burakov, Anatoly
2018-07-14  9:44       ` Kumar, Ravi1
2018-07-16 10:35         ` Burakov, Anatoly
2018-07-24  8:09           ` Kumar, Ravi1
2018-07-24  9:03             ` Burakov, Anatoly
2018-07-24  9:39               ` Kumar, Ravi1
2018-10-05  8:32                 ` Burakov, Anatoly
2018-10-05  8:56                   ` Kumar, Ravi1
2018-10-04 17:07 Sandeep Raman
2018-10-05 15:31 ` Burakov, Anatoly

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).