From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f47.google.com (mail-wm0-f47.google.com [74.125.82.47]) by dpdk.org (Postfix) with ESMTP id 7BE4120F for ; Tue, 23 May 2017 10:12:21 +0200 (CEST) Received: by mail-wm0-f47.google.com with SMTP id d127so16339438wmf.0 for ; Tue, 23 May 2017 01:12:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=xw2+fqdWrCL+FnCvvwZAzGhusfvHZ4bbnx6aUj55sBU=; b=P06CG1JgK/1S+2LdlqV91j72S5X4o2zHraSONUDAffiA9ldONNqAFVs3wpF6IpyBuH WguA2qdgUlG+MA240M3x6nQM+2f5jBV4HvS5L54hSJM2d5raJYPWbXgMGMSJP4ASXC5U MMOyQo7UV3p9fiZ8V3teXUE8LKTR5Bt9ZWJA9XwcGnPKN6xcZh9Hmfuy0GRGYo2CbIAl G0sTFHJNKH/vfbrcmhtuDJ552/DjNZ4PbNt3GlrP03M4Xs6+tRqxIm/IPojjM2FuvScS RfZw5DXCIkGuBriEj9R0sQcd9c8tCTPQYt6muNWqvBIMdVk9ZPaGoMniuQmTSenTK9r3 l1/w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=xw2+fqdWrCL+FnCvvwZAzGhusfvHZ4bbnx6aUj55sBU=; b=VAW9nmLK6S0w0RWtZK7PwNFjEW8o7Vz1QBGQ5VWTxVpIZRUcgl8N1iWD8Ghxt9wcG8 qx/0IUpziHT7Zy/scwPQ6sW0porYkyzZs9dKcIrtTvtHcO8pXiHq0FBpZlgrJ+agRGwF N5gy4aR0i1uTijjIVt6MgcnF4ag/YHjkmHhjPkOVBiQG3aRMaTyPaGuxQPj2Heafpsm5 1AfYnhhk1E7BwScbvzoxFTSduRKcbu9YjwZvJ/80dAwxK7YP9Jgvp4a1X2m2xd8P6o1Q dikLuKsOjYnoQTG14mPNmbMUvxMExy5U2JP4Do4tj//bTYv4wqjT3XJjuexgX6lE2Ap4 Z6Kw== X-Gm-Message-State: AODbwcDsLECzmm9Loktjh5vsKNWnBDG244dzhrLDRVTgHuasjof5O8o7 uU7cDI1PDihJauYl X-Received: by 10.28.174.131 with SMTP id x125mr1206324wme.32.1495527140873; Tue, 23 May 2017 01:12:20 -0700 (PDT) Received: from 6wind.com (host.78.145.23.62.rev.coltfrance.com. [62.23.145.78]) by smtp.gmail.com with ESMTPSA id z77sm45936wrc.22.2017.05.23.01.12.19 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 May 2017 01:12:19 -0700 (PDT) Date: Tue, 23 May 2017 10:12:14 +0200 From: Adrien Mazarguil To: "Wu, Xiaoban" Cc: "users@dpdk.org" Message-ID: <20170523081214.GA1758@6wind.com> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Subject: Re: [dpdk-users] Mellanox 100G NIC, VF SR-IOV, docker container, EAL could not detect the device X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 May 2017 08:12:21 -0000 On Tue, May 23, 2017 at 05:39:36AM +0000, Wu, Xiaoban wrote: > Dear DPDK users, > > > I am trying to use the VF of the Mellanox 100G NIC enabled by SR-IOV. The following is what I have done. > > > 1. Add "intel_iommu=on iommu=pt" to kernel command line option, update-grub, and reboot > > 2. Install the MLNX-OFED, reboot > > 3. In default the card is in infiband mode, so I switched it to ethernet mode (in order to run DPDK application) and reboot. > > 4. mst start > > mlxconfig -d /dev/mst/mt4115_pciconf0 q #query > mlxconfig -d /dev/mst/mt4115_pciconf0 set SRIOV_EN=1 NUM_OF_VFS=1 > reboot > 5. echo 1 > /sys/bus/pci/devices/0000\:83\:00.0/mlx5_num_vfs > 6. modprobe vfio-pci > 7. dpdk-devbind.py --status > 8. dpdk-devbind.py -b vfio-pci 0000:83:00.1 > 9. ls -al /dev/vfio > 10. docker run -it --privileged --device=/dev/vfio/54:/dev/vfio/54 --device=/dev/vfio/vfio:/dev/vfio/vfio -v /mnt/huge/:/dev/hugepages/ -v /var/run:/var/run $IMAGEID bash > 11. $dpdkapp -c 0x01 --socket-mem=128,128 --file-prefix="docker1" > > However, in the EAL part, it does not list any usable devices > EAL: Detected 12 lcore(s) > EAL: Probing VFIO support... > EAL: VFIO support initialized > PMD: bnxt_rte_pmd_init() called for (null) > Error, rte_eth_dev_configure() returns negative! > > Can anybody please point out any possible solution? Looking forward to your reply. Thanks very much for your help. Seems like the issue is not related to your mlx5 device. From the above log it appears that you also have a bnxt device on that system which DPDK detects and attempts to use as it is running in blacklist mode. Perhaps that device was not configured properly. Try to white-list the devices you want to use by explicitly providing their PCI bus addresses through -w arguments instead. -- Adrien Mazarguil 6WIND