From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id 0B0631B2F8 for ; Mon, 30 Oct 2017 09:40:21 +0100 (CET) Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga105.fm.intel.com with ESMTP; 30 Oct 2017 01:40:20 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.44,319,1505804400"; d="scan'208";a="168864281" Received: from fmsmsx107.amr.corp.intel.com ([10.18.124.205]) by fmsmga005.fm.intel.com with ESMTP; 30 Oct 2017 01:40:20 -0700 Received: from fmsmsx121.amr.corp.intel.com (10.18.125.36) by fmsmsx107.amr.corp.intel.com (10.18.124.205) with Microsoft SMTP Server (TLS) id 14.3.319.2; Mon, 30 Oct 2017 01:40:20 -0700 Received: from shsmsx152.ccr.corp.intel.com (10.239.6.52) by fmsmsx121.amr.corp.intel.com (10.18.125.36) with Microsoft SMTP Server (TLS) id 14.3.319.2; Mon, 30 Oct 2017 01:40:20 -0700 Received: from shsmsx104.ccr.corp.intel.com ([169.254.5.152]) by SHSMSX152.ccr.corp.intel.com ([169.254.6.93]) with mapi id 14.03.0319.002; Mon, 30 Oct 2017 16:40:18 +0800 From: "Lin, Xueqin" To: =?iso-8859-1?Q?Ga=EBtan_Rivet?= , "Xu, Qian Q" CC: "Zhang, Helin" , Thomas Monjalon , "Pei, Yulong" , "Peng, Yuan" , "dev@dpdk.org" , "Glynn, Michael J" , "Liu, Yu Y" Thread-Topic: vfio-pci blocking issue Thread-Index: AdNRTx4UyirD9w82TfOyk30jMmdif///icaA//9z0SA= Date: Mon, 30 Oct 2017 08:40:16 +0000 Message-ID: <0D300480287911409D9FF92C1FA2A3355B2700D6@SHSMSX104.ccr.corp.intel.com> References: <82F45D86ADE5454A95A89742C8D1410E3B7F050C@shsmsx102.ccr.corp.intel.com> <20171030081408.GG10890@bidouze.vm.6wind.com> In-Reply-To: <20171030081408.GG10890@bidouze.vm.6wind.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dpdk-dev] vfio-pci blocking issue X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Oct 2017 08:40:23 -0000 Hi Rivet, Using your patch to include "eal_vfio.h" header file, vfio-pci could work n= ormally on my environment. Thanks. http://dpdk.org/ml/archives/dev/2017-October/080746.html Best regards, Xueqin -----Original Message----- From: Ga=EBtan Rivet [mailto:gaetan.rivet@6wind.com]=20 Sent: Monday, October 30, 2017 4:14 PM To: Xu, Qian Q Cc: Lin, Xueqin ; Zhang, Helin ; Thomas Monjalon ; Pei, Yulong ; Peng, Yuan ; dev@dpdk.org; Glynn, Michael J ; Liu, Yu Y Subject: Re: vfio-pci blocking issue Hi Xueqin, Thank you for the thorough test report. Multiple filings for this bug, please refer to the thread http://dpdk.org/ml/archives/dev/2017-October/080746.html Which will focus discussion. A first fix and a new proposition are availabl= e, please tell us if it works for you or if there are any other problem wit= h either of the solutions. On Mon, Oct 30, 2017 at 07:25:20AM +0000, Xu, Qian Q wrote: > We have found the blocking issue about vfio-pci in RC2, which blocked man= y test cases. It is a blocking issue for 17.11 release. Please help check. >=20 > Add more failed case as below: it will also cause the VF port can't be pr= obed. >=20 > ? Components version > dpdk 17.11 rc2 > ? Defect component version (release version or repo/branch/commit ID)=20 > ? Environment components version (QEMU, OVS, etc) ? HW platform info=20 > fvl10g ? Test Steps and Test Result 1. Created VFs and bind to=20 > vfio-pci ./usertools/dpdk-devbind.py --bind=3Digb_uio 81:00.0 81:00.1=20 > echo 1 > /sys/bus/pci/devices/0000:81:00.0/max_vfs > echo 1 > /sys/bus/pci/devices/0000:81:00.1/max_vfs > ./usertools/dpdk-devbind.py -s > 0000:05:02.0 'XL710/X710 Virtual Function 154c' if=3D drv=3Di40evf=20 > unused=3Digb_uio > 0000:05:06.0 'XL710/X710 Virtual Function 154c' if=3D drv=3Di40evf=20 > unused=3Digb_uio ./usertools/dpdk-devbind.py --bind=3Dvfio-pci 81:02.0=20 > 81:06.0 ./usertools/dpdk-devbind.py -s > 0000:81:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572'=20 > drv=3Digb_uio unused=3Dvfio-pci > 0000:81:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572'=20 > drv=3Digb_uio unused=3Dvfio-pci > 0000:81:02.0 'XL710/X710 Virtual Function 154c' drv=3Dvfio-pci=20 > unused=3Digb_uio > 0000:81:06.0 'XL710/X710 Virtual Function 154c' drv=3Dvfio-pci=20 > unused=3Digb_uio 2. up PF with testpmd,=20 > ./x86_64-native-linuxapp-gcc/app/testpmd -l 23-27 -n 4=20 > --socket-mem=3D1024,1024 --file-prefix=3Dpf -w 81:00.0 -w 81:00.1 - -i=20 > --rxq=3D4 --txq=3D4 3. start VFs with testpmd,=20 > ./x86_64-native-linuxapp-gcc/app/testpmd -l 28-32 -n 4=20 > --socket-mem=3D1024,1024 --file-prefix=3Dvf -w 81:02.0 -w 81:06.0 - -i=20 > --rxq=3D4 --txq=3D4 > EAL: Detected 88 lcore(s) > EAL: Some devices want iova as va but pa will be used because.. EAL:=20 > vfio-noiommu mode configured > EAL: Probing VFIO support... > EAL: VFIO support initialized > EAL: PCI device 0000:81:02.0 on NUMA socket 1 > EAL: probe driver: 8086:154c net_i40e_vf > EAL: Requested device 0000:81:02.0 cannot be used > EAL: PCI device 0000:81:06.0 on NUMA socket 1 > EAL: probe driver: 8086:154c net_i40e_vf > EAL: Requested device 0000:81:06.0 cannot be used > EAL: No probed ethernet devices > Interactive-mode selected > USER1: create a new mbuf pool : n=3D179456,=20 > size=3D2176, socket=3D0 > USER1: create a new mbuf pool : n=3D179456,=20 > size=3D2176, socket=3D1 Done > testpmd> > it can be seen "No probed ethernet devices" >=20 >=20 > From: Lin, Xueqin > Sent: Monday, October 30, 2017 1:59 PM > To: gaetan.rivet@6wind.com; Zhang, Helin > Cc: Xu, Qian Q ; Pei, Yulong=20 > ; Peng, Yuan > Subject: vfio-pci >=20 > Hi Rivet, >=20 > Some cases need to bind port to vfio-pci, for example, test inline inpsec= . >=20 > 1. modprobe vfio-pci >=20 > 2. bind port to vfio-pci >=20 > ./usertools/dpdk-devbind.py -b vfio-pci 81:00.0 81:00.1 >=20 > 3. Run ipsec > sudo ./build/ipsec-secgw -l 20,21 -w 81:00.0 -w 81:00.1 --vdev "crypto_= null" --log-level 8 --socket-mem 1024,1 -- -p 0xf -P -u 0x2 -j 9000\ > --config=3D"(0,0,20),(1,0,21)" -f ./enc.cfg Find error as below,= =20 > vfio-pci can't be used. >=20 > EAL: probe driver: 8086:10fb net_ixgbe > EAL: Requested device 0000:81:00.0 cannot be used > EAL: PCI device 0000:81:00.1 on NUMA socket 1 > EAL: probe driver: 8086:10fb net_ixgbe > EAL: Requested device 0000:81:00.1 cannot be used > EAL: Search driver crypto_null to probe device crypto_null > CRYPTODEV: [crypto_null] - Creating cryptodev crypto_null >=20 > Find your patch results in the error, block lots of vfio-pci cases, which= is urgent. > DPDK-4026 should meet= same issue. > If any wrong to use vfio-pci, could you give a guide? >=20 > commit 279b581c897d4bf01f2b35c7327e767400c3ee80 > Author: Gaetan Rivet > > Date: Thu Oct 26 12:05:52 2017 +0200 >=20 > vfio: expose functions >=20 > The following symbols are used by vfio implementations within the PCI= bus. > They need to be publicly available for the PCI bus to be outside the > EAL. >=20 >=20 > Best regards, > Xueqin >=20 -- Ga=EBtan Rivet 6WIND