From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f54.google.com (mail-wm0-f54.google.com [74.125.82.54]) by dpdk.org (Postfix) with ESMTP id 1BF1E1B87F for ; Fri, 9 Feb 2018 13:01:13 +0100 (CET) Received: by mail-wm0-f54.google.com with SMTP id t74so15021148wme.3 for ; Fri, 09 Feb 2018 04:01:13 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7txJ5U4teGDl/L30UxG7ryeIt3RGfkxzPCK4W1lHqQc=; b=W8T8oEZWN2rkmmsApOVSNf0ay6zifw1Ed/WqKt8ZG+Fy8Y4kYlrlgwAt/UWBsMazyb /kahi3h43wEYee1mUKf3PBKcA9wVA+LKYnLgVfxP5IPm+iZ4zTw0f4HFl4753bChTyO1 7Vt/rf52AINPCy27pdXyI3a1j0dWetgF5Dyj9o1l2ItWYY0hk4UOwqJ880wr/dLCxNMc SXtpGjq17wG1r+Ug5Oisn9U31pSZpA4Zhkka+cjUnGBdwHd4v56qHgy6e/S5vKOtRDZ4 YGzZZYTTuQrn+LRLAp+eEY4umBQezklU6JvzTfBBAhNlYTx1Fzg0vucPuCCasKSeUPiD 8oGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7txJ5U4teGDl/L30UxG7ryeIt3RGfkxzPCK4W1lHqQc=; b=WIfox7U4OglY+eDYLjgCOwU9t0muasGoqmFbyg7D3E7bU1hSf13S92cIZkohQKvwg+ hVgs2LevONBlBfbJ08TU4cybc8Emoxgy0mPGVShpMhLNVX/ZeHum4InT1AFhTq2s1+4Q rZR9RBCSv4eW0wpih1Fs+DoPf7noSZhxADl5Rpybru8x4uCeFYskmVjVwec10rBQ+4et nqZwqzGmzjR2aTIunZ6FPuowcY9mMj3xbPdkxv34SNNegs92IZmi1F3qCRrEm0GTznwR on5BF0q8jEcb2/tXNcOrAa0YkdYJR6VUikwVh0+J6NO55bDgTRnN8t8it4L8IhGBZqTJ MwpQ== X-Gm-Message-State: APf1xPDWJf0BtK+NXjxuOWky23mbyc6wOmyPhtoEPrbNwbF8JW1UzOxu ID4iPbnmelTkAsHOGu/ivVLqwiVxa5SvS2XrOpBGlQ== X-Google-Smtp-Source: AH8x226NB48KqefLIbpc2sOpLIA6B9EywkrFXvWS3slwOp5dBDEFvWK3vM7eqK+rndFQGMzuL7ZaspIBVYhRnNLsVvA= X-Received: by 10.80.149.146 with SMTP id w18mr3269616eda.229.1518177672842; Fri, 09 Feb 2018 04:01:12 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.185.37 with HTTP; Fri, 9 Feb 2018 04:01:12 -0800 (PST) In-Reply-To: <59AF69C657FD0841A61C55336867B5B0722463C2@IRSMSX103.ger.corp.intel.com> References: <20180209112740.GA4756@bricha3-MOBL3.ger.corp.intel.com> <59AF69C657FD0841A61C55336867B5B0722463C2@IRSMSX103.ger.corp.intel.com> From: Victor Huertas Date: Fri, 9 Feb 2018 13:01:12 +0100 Message-ID: To: "Richardson, Bruce" Cc: "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] [dpdk-dev] Nehalem Intel Xeon X5506 architecture and PCIe NIC association to Numa node X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Feb 2018 12:01:13 -0000 Nope, I use Eclipse CDT environment to compile (I add all the static libs manually and the executable is successfully generated). Regards, 2018-02-09 12:58 GMT+01:00 Richardson, Bruce : > Does it work with testpmd, built as part of DPDK? > > When you build the l3fwd-acl example do you use the DPDK build system? > > > > *From:* Victor Huertas [mailto:vhuertas@gmail.com] > *Sent:* Friday, February 9, 2018 11:54 AM > *To:* Richardson, Bruce > *Cc:* users@dpdk.org > *Subject:* Re: [dpdk-dev] Nehalem Intel Xeon X5506 architecture and PCIe > NIC association to Numa node > > > > Bruce, > > With igb_uio it happens the same: > > Network devices using DPDK-compatible driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:04:00.0 '82576 Gigabit Network Connection 10c9' drv=3Digb_uio > unused=3Dvfio-pci > 0000:04:00.1 '82576 Gigabit Network Connection 10c9' drv=3Digb_uio > unused=3Dvfio-pci > > Network devices using kernel driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:02:00.0 '82572EI Gigabit Ethernet Controller (Copper) 107d' if=3Deth= 1 > drv=3De1000e unused=3Digb_uio,vfio-pci *Active* > > Even I have linked the rte libs with the flag --whole-archive flag (I > found somewhere in google that this solved a similar problem) but with no > result. > > All the output I get when I run the app (it is the l3fwd-acl example) is > what you see below: > > cuda1@cuda1:~/git/dpdk-stable> sudo /home/cuda1/eclipse-workspace/DPDK_Te= st/Debug/DPDK_Test > -c 0x0f -n 2 -- -p 0x3 > EAL: Detected 8 lcore(s) > EAL: Probing VFIO support... > EAL: VFIO support initialized > port 0 is not present on the board > EAL: Error - exiting with code: 1 > Cause: check_port_config failed > > > > 2018-02-09 12:27 GMT+01:00 Bruce Richardson : > > Moving to users list, since that is more relevant than dev. > > On Thu, Feb 08, 2018 at 07:36:30PM +0100, Victor Huertas wrote: > > Bruce, > > > > > > My requirements are not that much (500 Mbps and 1 Gbps desirable). > > > > > > Thanks for your references links I will have a look at them. > > > > > > Regarding the NIC detection in the DPDK app by the DPDK EAL > initialization > > after successfully having loaded the vfio-pci, it happens something > strange. > > > > The nb_ports =3D rte_eth_dev_count(); is always returning 0. > > > > > > Therefore it shows an error telling that "port 0 is not present on the > > board". > > > > > > The EAL seems to detect the VFIOs as the only two logs that shows when > > initializing regarding VFIO are: > > > > > > EAL: Probing VFIO support... > > > > EAL: VFIO support initialized > > > > > > And nothing else... shouldn't the EAL detect the two NICs I associated = to > > the VFIO? very strange... > > > > > > Yes, it should. Can you please send full output on startup. > Also, can you try using igb_uio module instead of vfio and see if that > works for you. > > Regards, > /Bruce > > > > Regards, > > > > > > PD: I have changed the email address account in order to avoid sending > > these disturbing disclaimers. Sorry. > > > > > > -----Mensaje original----- > > De: Bruce Richardson [mailto:bruce.richardson@intel.com] > > Enviado el: jueves, 08 de febrero de 2018 17:42 > > Para: Huertas Garc=C3=ADa, V=C3=ADctor > > CC: dev@dpdk.org > > Asunto: Re: [dpdk-dev] Nehalem Intel Xeon X5506 architecture and PCIe N= IC > > association to Numa node > > > > > > > > On Thu, Feb 08, 2018 at 04:27:36PM +0000, Huertas Garc=C3=ADa, V=C3=ADc= tor wrote: > > > > > > > > > > Hi all, > > > > > > > > > > After having tried many ways to make the PCIe NIC card appear > associated > > to a numa node, I haven't been able to do it. > > > > > That is, every time I try to look at which numa node belongs it alway= s > > returns -1. > > > > > > > > > > $ cat /sys/bus/pci/devices/0000\:04\:00.1/numa_node > > > > > -1 > > > > > > > > > > $ cat /sys/bus/pci/devices/0000\:04\:00.0/numa_node > > > > > -1 > > > > > > > > > > Using lstopo, I confirm that all PCI cards are "outside" of any Numa > > node. > > > > > > > > > > I have read in previous posted messages in dpdk-dev community that th= is > > is normal in Nehalem generation Xeon architecture and there is nothing = I > > can do about it. Can somebody confirm this? > > > > > > > > For that generation architecture, it is indeed expected. The NICs are n= ot > > directly connected to any NUMA node. > > > > > > > > > If so, what implications could this have on packet capture and > > performance? > > > > > > > > Unsurprisingly, it's the case that newer platforms will perform better, > as > > you are missing out on performance benefits from improved cores and als= o > > features like Intel=C2=AE DDIO [1]. > > > > However, what I/O throughput are you hoping to get from your system? > > > > Depending on your requirements, what you have may be enough. Some peopl= e > > use DPDK on lower-end platforms because that is all that they need. You > may > > also find the chart on slide 6 of [2] of use to see how the max > throughput > > of a platform has improved over time (and has improved further since th= at > > chart was published). > > > > > > > > > > > > > > Are the NICs available in my DPDK applications? Do I have to > specifically > > "add" them by "-w 04:00.1 - w 04:00.0"? > > > > > > > > Yes, your NICs will still be available, even without NUMA affinity, and > no, > > you should not need to explicitly whitelist them - though you can if yo= u > > want. So long as they are bound to a uio or vfio driver (e.g. > > > > igb_uio or vfio-pci), they should be detected by DPDK EAL init and made > > available to your app. > > > > > > > > > Is RSS supported and usable from the DPDK application? > > > > > > > > Yes, at least for Intel NICs, and probably most other DPDK-supported NI= Cs > > too. > > > > > > > > > > > > > > Thanks a lot for your attention > > > > > > > > > > Victor > > > > > > > > > > > > > /Bruce > > > > > > > > [1] https://www.intel.com/content/www/us/en/io/data-direct-i-o-t > > echnology.html > > > > [2] https://dpdksummit.com/Archive/pdf/2016Germany/DPDK-2016- > > DPDK_FD_IO_Introduction.pdf > > > > > > > > PS: This is a public list, so email disclaimers are rather pointless. > > > > It's best if they can be removed from mails sent here. > > > > > > > > > > -- > > Victor > > > > > -- > > Victor > --=20 Victor