From: Juraj Linkeš <juraj.linkes@pantheon.tech> To: Piotr Kubaj <pkubaj@anongoth.pl> Cc: David Christensen <drc@linux.vnet.ibm.com>, "thomas@monjalon.net" <thomas@monjalon.net>, "david.marchand@redhat.com" <david.marchand@redhat.com>, "bruce.richardson@intel.com" <bruce.richardson@intel.com>, "Honnappa.Nagarahalli@arm.com" <Honnappa.Nagarahalli@arm.com>, "Ruifeng.Wang@arm.com" <Ruifeng.Wang@arm.com>, "ferruh.yigit@intel.com" <ferruh.yigit@intel.com>, "jerinjacobk@gmail.com" <jerinjacobk@gmail.com>, "jerinj@marvell.com" <jerinj@marvell.com>, "stephen@networkplumber.org" <stephen@networkplumber.org>, "dev@dpdk.org" <dev@dpdk.org> Subject: Re: [dpdk-dev] [PATCH v5] build: optional NUMA and cpu counts detection Date: Tue, 31 Aug 2021 07:54:16 +0000 Message-ID: <ab45c677f71e48cc86fa1ae564be81cb@pantheon.tech> (raw) In-Reply-To: <YS19zhZhzq6V6VM1@KGPE-D16> > -----Original Message----- > From: Piotr Kubaj <pkubaj@anongoth.pl> > Sent: Tuesday, August 31, 2021 2:55 AM > To: Juraj Linkeš <juraj.linkes@pantheon.tech> > Cc: David Christensen <drc@linux.vnet.ibm.com>; thomas@monjalon.net; > david.marchand@redhat.com; bruce.richardson@intel.com; > Honnappa.Nagarahalli@arm.com; Ruifeng.Wang@arm.com; > ferruh.yigit@intel.com; jerinjacobk@gmail.com; jerinj@marvell.com; > stephen@networkplumber.org; dev@dpdk.org > Subject: Re: [PATCH v5] build: optional NUMA and cpu counts detection > > Hi, > > sorry for the late answer. Thanks for the answer anyway, better late than never. > > I suppose you mean sysctl command, not systemctl. > That's right. What does lscpu say? Are the NUMA nodes non-contiguous like this?: NUMA node0 CPU(s): 0-63 NUMA node8 CPU(s): 64-127 NUMA node252 CPU(s): NUMA node253 CPU(s): NUMA node254 CPU(s): NUMA node255 CPU(s): > On dual CPU systems, it returns 2. On single CPU ones, 1. I asked the previous question so that we know the actual numa node number of the second CPU. If it's 8, then sysctl does some renumeration and we can't use it. Bruce, maybe we should just parse lscpu output? That introduces a dependency, but that may not be such a big deal as lscpu is pretty common. > > On 21-08-03 10:21:50, Juraj Linkeš wrote: > > > > > > > -----Original Message----- > > > From: David Christensen <drc@linux.vnet.ibm.com> > > > Sent: Tuesday, August 3, 2021 1:29 AM > > > To: Juraj Linkeš <juraj.linkes@pantheon.tech>; thomas@monjalon.net; > > > david.marchand@redhat.com; bruce.richardson@intel.com; > > > Honnappa.Nagarahalli@arm.com; Ruifeng.Wang@arm.com; > > > ferruh.yigit@intel.com; jerinjacobk@gmail.com; jerinj@marvell.com; > > > stephen@networkplumber.org; Piotr Kubaj <pkubaj@FreeBSD.org> > > > Cc: dev@dpdk.org > > > Subject: Re: [PATCH v5] build: optional NUMA and cpu counts > > > detection > > > > > > > > > > > > On 8/2/21 5:44 AM, Juraj Linkeš wrote: > > > >> +if os.name == 'posix': > > > >> + if os.path.isdir('/sys/devices/system/node'): > > > >> + numa_nodes = glob.glob('/sys/devices/system/node/node*') > > > >> + numa_nodes.sort() > > > >> + print(int(os.path.basename(numa_nodes[-1])[4:]) + 1) > > > >> + else: > > > >> + subprocess.run(['sysctl', '-n', 'vm.ndomains'], > > > >> +check=False) > > > >> + > > > > > > > > Bruce, David, Thomas, > > > > > > > > Is DPDK actually supported on Power9 FreeBSD? Is anyone using this > > > combination? How can we address the open question of what exactly > > > does sysctl -n vm.ndomains return on a Power9 FreeBSD system? Or > > > should we just leave it as is? Or maybe add 1 to the output (as we do in other > cases)? > > > > > > Not supported within IBM, but you can buy OpenPOWER boxes from 3rd > > > parties such as Raptor Computing Systems so there may be customers > > > using DPDK on POWER with FreeBSD that I don't track. Adding Piotr > > > Kubaj who has commented on POWER/FreeBSD issues in this past. > > > > > > Dave > > > > Thanks, David. > > > > Piotr, to provide more context, we're trying to figure out what the highest > NUMA node on a system is. > > On P9 systems, here's how NUMA nodes look like in Linux: > > NUMA node0 CPU(s): 0-63 > > NUMA node8 CPU(s): 64-127 > > NUMA node252 CPU(s): > > NUMA node253 CPU(s): > > NUMA node254 CPU(s): > > NUMA node255 CPU(s): > > The highest NUMA with CPUs is node8. > > > > We're trying to get the highest NUMA with CPUs on P9 FreeBSD systems, but > we don't know whether FreeBSD NUMA layout looks the same (does FreeBSD > report non-contiguous NUMA nodes as Linxu above, or does it renumerate) a > what does "systemctl -n vm.ndomains" return. Could you check these for us?
next prev parent reply other threads:[~2021-08-31 8:01 UTC|newest] Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top 2020-11-20 12:55 [dpdk-dev] [PATCH v1 1/1] " Juraj Linkeš 2020-12-23 11:32 ` Juraj Linkeš 2021-03-31 9:06 ` [dpdk-dev] [PATCH v2] " Juraj Linkeš 2021-03-31 19:07 ` David Christensen 2021-04-16 12:43 ` Juraj Linkeš 2021-04-19 10:18 ` [dpdk-dev] [PATCH v3] " Juraj Linkeš 2021-04-28 19:33 ` David Christensen 2021-06-29 10:55 ` [dpdk-dev] [PATCH v4] " Juraj Linkeš 2021-06-29 11:28 ` Bruce Richardson 2021-07-06 8:56 ` Juraj Linkeš 2021-07-06 9:08 ` Bruce Richardson 2021-07-06 18:10 ` David Christensen 2021-07-16 13:53 ` Juraj Linkeš 2021-07-16 14:24 ` Bruce Richardson 2021-07-20 20:49 ` David Christensen 2021-07-21 12:41 ` Juraj Linkeš 2021-06-29 18:00 ` Stephen Hemminger 2021-07-21 13:04 ` [dpdk-dev] [PATCH v5] " Juraj Linkeš 2021-08-02 12:44 ` Juraj Linkeš 2021-08-02 23:29 ` David Christensen 2021-08-03 10:21 ` Juraj Linkeš 2021-08-31 0:54 ` Piotr Kubaj 2021-08-31 7:54 ` Juraj Linkeš [this message] 2021-08-31 8:02 ` Bruce Richardson 2021-09-09 7:20 ` Juraj Linkeš 2021-09-09 8:01 ` Bruce Richardson 2021-09-09 8:08 ` Thomas Monjalon 2021-09-09 8:42 ` Juraj Linkeš 2021-09-09 16:44 ` David Christensen 2021-08-31 12:32 ` Piotr Kubaj 2021-08-17 10:45 ` [dpdk-dev] [PATCH v6] " Juraj Linkeš 2021-09-16 7:46 ` Thomas Monjalon
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=ab45c677f71e48cc86fa1ae564be81cb@pantheon.tech \ --to=juraj.linkes@pantheon.tech \ --cc=Honnappa.Nagarahalli@arm.com \ --cc=Ruifeng.Wang@arm.com \ --cc=bruce.richardson@intel.com \ --cc=david.marchand@redhat.com \ --cc=dev@dpdk.org \ --cc=drc@linux.vnet.ibm.com \ --cc=ferruh.yigit@intel.com \ --cc=jerinj@marvell.com \ --cc=jerinjacobk@gmail.com \ --cc=pkubaj@anongoth.pl \ --cc=stephen@networkplumber.org \ --cc=thomas@monjalon.net \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: link
DPDK patches and discussions This inbox may be cloned and mirrored by anyone: git clone --mirror https://inbox.dpdk.org/dev/0 dev/git/0.git # If you have public-inbox 1.1+ installed, you may # initialize and index your mirror using the following commands: public-inbox-init -V2 dev dev/ https://inbox.dpdk.org/dev \ dev@dpdk.org public-inbox-index dev Example config snippet for mirrors. Newsgroup available over NNTP: nntp://inbox.dpdk.org/inbox.dpdk.dev AGPL code for this site: git clone https://public-inbox.org/public-inbox.git