From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 1AC28A0613 for ; Tue, 27 Aug 2019 18:19:59 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 6CF761C1E9; Tue, 27 Aug 2019 18:19:58 +0200 (CEST) Received: from smtprelay.hostedemail.com (smtprelay0053.hostedemail.com [216.40.44.53]) by dpdk.org (Postfix) with ESMTP id 1A93C1C1DC for ; Tue, 27 Aug 2019 18:19:56 +0200 (CEST) Received: from filter.hostedemail.com (clb03-v110.bra.tucows.net [216.40.38.60]) by smtprelay08.hostedemail.com (Postfix) with ESMTP id 31B1F182CED28 for ; Tue, 27 Aug 2019 16:19:55 +0000 (UTC) X-Session-Marker: 6470646B407472616E6365636F64652E636F2E756B X-Spam-Summary: 2, 0, 0, , d41d8cd98f00b204, dpdk@trancecode.co.uk, :, RULES_HIT:41:152:355:379:472:854:973:988:989:1260:1277:1311:1313:1314:1345:1381:1437:1515:1516:1518:1534:1542:1593:1594:1711:1730:1747:1777:1792:2198:2199:2393:2553:2559:2562:2693:2741:2904:3138:3139:3140:3141:3142:3354:3653:3865:3866:3867:3868:3870:3871:3872:3874:4250:4321:4362:5007:6117:6119:6120:6121:6261:6671:7901:7903:9008:9010:10004:10400:10848:10967:11657:11658:11783:11914:12043:12050:12297:12555:12663:12727:12737:12740:12895:12986:13007:13071:13161:13229:13548:13894:14180:14181:14571:14721:21063:21080:21451:21524:21554:21627:21795:21881:30051:30054:30055:30089:30090:30091, 0, RBL:86.150.137.26:@trancecode.co.uk:.lbl8.mailshell.net-62.14.15.186 64.201.201.201, CacheIP:none, Bayesian:0.5, 0.5, 0.5, Netcheck:none, DomainCache:0, MSF:not bulk, SPF:fn, MSBL:0, DNSBL:neutral, Custom_rules:0:0:0, LFtime:25, LUA_SUMMARY:none X-HE-Tag: eggs39_73a5c4c434f0f X-Filterd-Recvd-Size: 3648 Received: from localhost.localdomain (host86-150-137-26.range86-150.btcentralplus.com [86.150.137.26]) (Authenticated sender: dpdk@trancecode.co.uk) by omf03.hostedemail.com (Postfix) with ESMTPA for ; Tue, 27 Aug 2019 16:19:54 +0000 (UTC) To: users@dpdk.org From: dpdk Message-ID: <879b8fc6-c16e-716a-312d-0473c92e6fb1@trancecode.co.uk> Date: Tue, 27 Aug 2019 17:19:51 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Content-Language: en-US Subject: [dpdk-users] Problem using VFs with igb_uio or igb_uio X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hello list So while not a total newbie, I am relatively new to using DPDK so perhaps I am missing something. I have been using vpp for 3 months now and have done 5 successful installations on lab machines. The issue that I am having is with a rented supermicro server with Intel® Xeon® D-1531 and dual I350 NICs I have been able to install and build DPDK SDK 19.05, following along with the docs in the usual way, and vpp git current which use dpdk 19.08. Installation and build appears to function as expected including  ./usertools/dpdk-setup.sh  and sudo ./usertools/dpdk-devbind.py However whenever I attempt create a VF I get an error: this with  igb_uio loaded root@sd-151808:~/apt# cat /sys/bus/pci/devices/0000\:04\:00.1/max_vfs 0 root@sd-151808:~/apt# echo 2 > /sys/bus/pci/devices/0000\:04\:00.1/max_vfs -su: echo: write error: Cannot allocate memory similarly with vfio-pci loaded root@sd-151808:~/apt# cat /sys/bus/pci/devices/0000\:04\:00.1/sriov_totalvfs 8 root@sd-151808:~/apt# echo 2 > /sys/bus/pci/devices/0000\:04\:00.1/sriov_numvfs ; echo $? -su: echo: write error: No such file or directory 1 auser@sd-151808:/vpp$ sudo lsmod | grep uio igb_uio                16384  0 uio                    20480  1 igb_uio auser@sd-151808:/vpp$ dmesg | less [ 5344.181128] igb_uio: Use MSIX interrupt by default [ 5409.867025] igb_uio: Use MSIX interrupt by default [ 5439.469520] igb_uio 0000:04:00.1: mapping 1K dma=0x857118000 host=000000009fbe292f [ 5439.469522] igb_uio 0000:04:00.1: unmapping 1K dma=0x857118000 host=000000009fbe292f [ 5596.680830] igb_uio 0000:04:00.1: can't enable 2 VFs (bus 05 out of range of [bus 04]) auser@sd-151808:/vpp$ sudo less /var/log/syslog Aug 27 17:56:18 sd-151808 kernel: [ 5344.181128] igb_uio: Use MSIX interrupt by default Aug 27 17:57:24 sd-151808 kernel: [ 5409.867025] igb_uio: Use MSIX interrupt by default Aug 27 17:57:54 sd-151808 kernel: [ 5439.469520] igb_uio 0000:04:00.1: mapping 1K dma=0x857118000 host=000000009fbe292f Aug 27 17:57:54 sd-151808 kernel: [ 5439.469522] igb_uio 0000:04:00.1: unmapping 1K dma=0x857118000 host=000000009fbe292f Aug 27 18:00:31 sd-151808 kernel: [ 5596.680830] igb_uio 0000:04:00.1: can't enable 2 VFs (bus 05 out of range of [bus 04]) If it matters, the motivation for doing this was to use VFs to route some internet traffic directly to QEMU VMs and some to vpp. Any help at all will be greatly apprectiated. Thanks Colin p.s. I did try also later kernels than Debian 9 stock kernel user@sd-151808:/vpp$ uname -a Linux sd-151808 4.15.18-20-pve #1 SMP PVE 4.15.18-46 (Thu, 8 Aug 2019 10:42:06 +0200) x86_64 GNU/Linux and backports kernel root@sd-151808:~/apt# uname -a Linux sd-151808 4.19.0-0.bpo.5-amd64 #1 SMP Debian 4.19.37-5+deb10u2~bpo9+1 (2019-08-16) x86_64 GNU/Linux but the issue is the same.