From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 84BE22A1A for ; Fri, 19 Dec 2014 16:08:41 +0100 (CET) Received: from orsmga003.jf.intel.com ([10.7.209.27]) by orsmga102.jf.intel.com with ESMTP; 19 Dec 2014 07:06:15 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.04,691,1406617200"; d="scan'208";a="501559409" Received: from irsmsx104.ger.corp.intel.com ([163.33.3.159]) by orsmga003.jf.intel.com with ESMTP; 19 Dec 2014 07:03:34 -0800 Received: from irsmsx102.ger.corp.intel.com ([169.254.2.213]) by IRSMSX104.ger.corp.intel.com ([169.254.5.209]) with mapi id 14.03.0195.001; Fri, 19 Dec 2014 15:07:39 +0000 From: "Gray, Mark D" To: "dev@dpdk.org" Thread-Topic: vfio bind failing Thread-Index: AdAbcxJ+BJQsNgscQ26EEXaRi3GnqA== Date: Fri, 19 Dec 2014 15:07:39 +0000 Message-ID: <738D45BC1F695740A983F43CFE1B7EA92D7BAACE@IRSMSX102.ger.corp.intel.com> Accept-Language: en-IE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [163.33.239.182] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: [dpdk-dev] vfio bind failing X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Dec 2014 15:08:42 -0000 Hi, I am trying to enable vfio with a DPDK app. However, I cannot bind a NIC to= the vfio-pci driver * I have enabled it in the BIOS and in the kernel. [root@hostname tools]# cat /proc/cmdline BOOT_IMAGE=3D/boot/vmlinuz-3.16.7-200.fc20.x86_64 rhgb quiet default= _hugepagesz=3D1G hugepagesz=3D1G hugepages=3D16 iommu=3Don [root@hostname tools]# dmesg | grep -e DMAR -e IOMMU [ 0.000000] ACPI: DMAR 0x00000000BDFA9618 000120 (v01 INTEL S2600CP 06= 222004 INTL 20090903) [ 0.118209] dmar: IOMMU 0: reg_base_addr fbffe000 ver 1:0 cap d2078c106f= 0466 ecap f020de [ 0.118215] dmar: IOMMU 1: reg_base_addr ebffc000 ver 1:0 cap d2078c106f= 0466 ecap f020de [ 0.118341] IOAPIC id 2 under DRHD base 0xfbffe000 IOMMU 0 [ 0.118342] IOAPIC id 0 under DRHD base 0xebffc000 IOMMU 1 [ 0.118343] IOAPIC id 1 under DRHD base 0xebffc000 IOMMU 1 * I have inserted the kernel module [root@hostname tools]# modprobe vfio-pci [root@hostname tools]# lsmod | grep vfio vfio_iommu_type1 17632 0 vfio_pci 36425 0 vfio 20426 2 vfio_iommu_type1,vfio_pci * I ran ulimit -l to change to memlock limit to 64MB. I have run 'setup.sh'= to Setup VFIO permissions Option: 10 chmod /dev/vfio OK chmod /dev/vfio/* OK Current user memlock limit: 64 MB This is the maximum amount of memory you will be able to use with DPDK and VFIO if run as current user. To change this, please adjust limits.conf memlock limit for current user. =20 * I have run 'setup.sh' to try and bind some Niantics to the module but it = is failing with the following message (and the following dmesg error) Enter PCI address of device to bind to VFIO driver: 0000:05:00.0 Error: bind failed for 0000:05:00.0 - Cannot bind to driver vfio-pci Error: unbind failed for 0000:05:00.0 - Cannot open /sys/bus/pci/drivers//u= nbind Press enter to continue ...^C [root@hostname tools]# dmesg | tail [18020.508045] ixgbe 0000:05:00.0: removed PHC on p3p1 [18020.603477] ixgbe 0000:05:00.0: complete [18020.603731] vfio-pci: probe of 0000:05:00.0 failed with error -22 [18020.603839] vfio-pci: probe of 0000:05:00.0 failed with error -22 Any ideas? Thanks, Mark