From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by dpdk.org (Postfix) with ESMTP id 081AA1B5EC for ; Thu, 10 Jan 2019 00:58:06 +0100 (CET) Received: from pps.filterd (m0098414.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.22/8.16.0.22) with SMTP id x09No23d005310 for ; Wed, 9 Jan 2019 18:58:06 -0500 Received: from smtp.notes.na.collabserv.com (smtp.notes.na.collabserv.com [158.85.210.110]) by mx0b-001b2d01.pphosted.com with ESMTP id 2pwsdvukt4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 09 Jan 2019 18:58:06 -0500 Received: from localhost by smtp.notes.na.collabserv.com with smtp.notes.na.collabserv.com ESMTP for from ; Wed, 9 Jan 2019 23:58:05 -0000 Received: from us1b3-smtp03.a3dr.sjc01.isc4sb.com (10.122.7.173) by smtp.notes.na.collabserv.com (10.122.47.50) with smtp.notes.na.collabserv.com ESMTP; Wed, 9 Jan 2019 23:58:01 -0000 Received: from us1b3-mail204.a3dr.sjc03.isc4sb.com ([10.168.5.196]) by us1b3-smtp03.a3dr.sjc01.isc4sb.com with ESMTP id 2019010923580176-1009658 ; Wed, 9 Jan 2019 23:58:01 +0000 In-Reply-To: <9C2829AB-34D1-4EB3-BADE-E660349E5E80@intel.com> From: "Daniel Waddington" To: "Wiles, Keith" Cc: "dev@dpdk.org" Date: Wed, 9 Jan 2019 23:58:01 +0000 MIME-Version: 1.0 Sensitivity: Importance: Normal X-Priority: 3 (Normal) References: <9C2829AB-34D1-4EB3-BADE-E660349E5E80@intel.com>, <73991857-48DE-4FE9-9798-045C42AC7B1C@intel.com> X-Mailer: IBM iNotes ($HaikuForm 1033) | IBM Domino Build SCN1812108_20180501T0841_FP24 December 05, 2018 at 21:42 X-LLNOutbound: False X-Disclaimed: 61803 X-TNEFEvaluated: 1 x-cbid: 19010923-7769-0000-0000-000005A306EB X-IBM-SpamModules-Scores: BY=0; FL=0; FP=0; FZ=0; HX=0; KW=0; PH=0; SC=0.40962; ST=0; TS=0; UL=0; ISC=; MB=0.000000 X-IBM-SpamModules-Versions: BY=3.00010375; HX=3.00000242; KW=3.00000007; PH=3.00000004; SC=3.00000274; SDB=6.01144195; UDB=6.00595738; IPR=6.00924457; BA=6.00006197; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00025056; XFM=3.00000015; UTC=2019-01-09 23:58:03 X-IBM-AV-DETECTION: SAVI=unsuspicious REMOTE=unsuspicious XFE=unused X-IBM-AV-VERSION: SAVI=2019-01-09 22:08:23 - 6.00009445 x-cbparentid: 19010923-7770-0000-0000-0000027F2E8F Message-Id: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-01-09_12:, , signatures=0 X-Proofpoint-Spam-Reason: safe Subject: Re: [dpdk-dev] DPDK on IBM Power9 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Jan 2019 23:58:07 -0000 Also, this is what the kernel shows. .... [ 2812.456773] pci 0000:01 : [PE# 00] Enabling 64-bit DMA bypass [ 2876.395586] pci 0000:01 : [PE# 00] Disabling 64-bit DMA bypass [ 2876.395593] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 2876.395705] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 2876.395711] pci 0000:01 : [PE# 00] Removing DMA window #1 [ 2876.399657] pci 0000:01 : [PE# 00] Setting up window#0 0..7fffffff p= g=3D1000 [ 2876.399663] pci 0000:01 : [PE# 00] Enabling 64-bit DMA bypass [ 6519.671051] pci 0000:01 : [PE# 00] Disabling 64-bit DMA bypass [ 6519.671059] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 6519.671174] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 6519.671180] pci 0000:01 : [PE# 00] Removing DMA window #1 [ 6519.675520] pci 0000:01 : [PE# 00] Setting up window#0 0..7fffffff p= g=3D1000 [ 6519.675526] pci 0000:01 : [PE# 00] Enabling 64-bit DMA bypass [ 9015.064426] pci 0000:01 : [PE# 00] Disabling 64-bit DMA bypass [ 9015.064432] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 9015.064527] pci 0000:01 : [PE# 00] Removing DMA window #0 [ 9015.064531] pci 0000:01 : [PE# 00] Removing DMA window #1 [ 9015.067168] pci 0000:01 : [PE# 00] Setting up window#0 0..7fffffff p= g=3D1000 [ 9015.067173] pci 0000:01 : [PE# 00] Enabling 64-bit DMA bypass Daniel -----"Wiles, Keith" wrote: ----- To: Daniel Waddington From: "Wiles, Keith" Date: 01/09/2019 03:35PM Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] DPDK on IBM Power9 > On Jan 9, 2019, at 5:22 PM, Daniel Waddington = wrote: >=20 > This NIC (000:01:00.0) is supported (Intel XL710). I assume that I can us= e VFIO instead of UIO. UIO is really bad from a security perspective. >=20 > I think its the "cannot create new DMA window, error 22" which is the fir= st indicator of the problem. >=20 > Daniel >=20 > -----"Wiles, Keith" wrote: ----- > To: Daniel Waddington > From: "Wiles, Keith" > Date: 01/09/2019 02:52PM > Cc: "dev@dpdk.org" > Subject: Re: [dpdk-dev] DPDK on IBM Power9 >=20 >=20 >> On Jan 9, 2019, at 4:25 PM, Daniel Waddington wrote: >>=20 >> Hi, >> I'm trying to run DPDK 18.11 on IBM Power9. Should it run? (I'n new to= DPDK on Power).=20 >> Thx, >> Daniel >> Below is what I get: >>=20 >> $ sudo ./examples/ethtool/ethtool-app/ppc=5F64-power8-linuxapp-gcc/app/e= thtool --iova-mode=3Dpa -c7 -w 0000:01:00.0 >> EAL: Detected 128 lcore(s) >> EAL: Detected 2 NUMA nodes >> EAL: Multi-process socket /var/run/dpdk/rte/mp=5Fsocket >> EAL: Probing VFIO support... >> EAL: VFIO support initialized >> EAL: PCI device 0000:01:00.0 on NUMA socket 0 >> EAL: probe driver: 8086:1583 net=5Fi40e >> EAL: using IOMMU type 7 (sPAPR) >> EAL: cannot create new DMA window, error 22 (Invalid argument) >> EAL: Could not create new DMA window >> EAL: 0000:01:00.0 DMA remapping failed, error 22 (Invalid argument) >> EAL: Requested device 0000:01:00.0 cannot be used >> Number of NICs: 0 >> EAL: Error - exiting with code: 1 >> Cause: No available NIC ports! >>=20 >=20 > From the message above you need support NIC for DPDK is all or you a NIC = needs to be bound to something like igb=5Fuio for linux. I have never run D= PDK on power before and not sure what is next other then using a supported = NIC. >=20 Yes you should be able to use VFIO. Did you bind the NIC to VFIO ? There should be some docs about how that is done. Beyond this I have not idea? >>=20 >>=20 >=20 > Regards, > Keith >=20 >=20 Regards, Keith