From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f47.google.com (mail-wm0-f47.google.com [74.125.82.47]) by dpdk.org (Postfix) with ESMTP id 5DA905A98 for ; Wed, 24 May 2017 09:51:30 +0200 (CEST) Received: by mail-wm0-f47.google.com with SMTP id d127so57093801wmf.0 for ; Wed, 24 May 2017 00:51:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=z1XLhzT23/fj11npQA6SaT28szzsnvOO1nP+rgvLenk=; b=VXJgVBTolCk1bSYheuZlxRYgf3cRviP62BYT4xf80uvKgjwJLDD34XhBjGtO9C6v// jtQvZvl/N+oTKPI2cqeZT+ZPlg1wxwp7mbUX5nDYizE/Y5K9eA6N6mebhP8a62e/cVij wbtihfN1LKHLlxxsb1bM8Rq4fKNDdoM7U0lT5ZCMQyoyvHzT9RJhgYOTuqliN6KW17jb rDGvDxI420ByBJaOK3d7yJl+H62h8u2W79uVeDNNcaTtcuXE63VQfKzEpFqO6Q6ofX/d I5SOkJ6lVXuUHRPwu656X2gVabw+YkZDXY+s4WPKOLbf/TftE9tDS/4cZ/we9uPa445X C9NQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=z1XLhzT23/fj11npQA6SaT28szzsnvOO1nP+rgvLenk=; b=a2i1e99wf03cWjcrMiRuIwVjQDqM5gsG735slKgV3eZbjIht5aljkgQYDHH9otbd5a Shpqrv/H8Pg5APaohy2WB8GQVcdpKX2j8si08qyOTt7TB6uEj222/+MHWvzylG64Qjd9 q6YW5PGaysGAEpbVEUiJxzgVjvsUGEj0gW7XltMgBP9MjTJTiRXdnCOGo+G9r6OhpbJ6 Xy7UxuC2lt3JYx3MImKHkkweq5IgsJSg8MLgG4OLQv1L1yzSOG159/TnUTYRfSOZzc9a Y0KVSs8dXJt+GfLd5q0+CtCQANTOnfGMQUYaZXPHBHUOAV6HXf7zrQpgb4ErVhg74yOK 3W+w== X-Gm-Message-State: AODbwcDhNwNV3+PRBsKzb10y6GAY89cwvACp2RPOVJQtWHA1TKeI6vOX Enz5M26kftWE0A7FTik= X-Received: by 10.28.20.14 with SMTP id 14mr5137665wmu.52.1495612288787; Wed, 24 May 2017 00:51:28 -0700 (PDT) Received: from 6wind.com (host.78.145.23.62.rev.coltfrance.com. [62.23.145.78]) by smtp.gmail.com with ESMTPSA id f2sm2554150wmh.27.2017.05.24.00.51.27 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 24 May 2017 00:51:27 -0700 (PDT) Date: Wed, 24 May 2017 09:51:22 +0200 From: Adrien Mazarguil To: "Wu, Xiaoban" Cc: "users@dpdk.org" Message-ID: <20170524075122.GF1758@6wind.com> References: <20170523081214.GA1758@6wind.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Subject: Re: [dpdk-users] Mellanox 100G NIC, VF SR-IOV, docker container, EAL could not detect the device X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 May 2017 07:51:30 -0000 On Wed, May 24, 2017 at 01:01:58AM +0000, Wu, Xiaoban wrote: > Hi Adrien, > > > Thanks very much for your reply. > > > However, after the -w option is used, the EAL still could not find the VF devices. > > $dpdk-app -c 0x01 --socket-mem=128,128 --file-prefix="docker1" -w 0000:83:00.1 > > > EAL: Detected 12 lcore(s) > EAL: Probing VFIO support... > EAL: VFIO support initialized > PMD: bnxt_rte_pmd_init() called for (null) > Error, rte_eth_dev_configure() returns negative! I didn't take Docker into account. Since there is no VM involved, you must *not* bind the devices to vfio-pci (do not run dpdk-devbind.py, no need to even modprobe vfio-pci). With mlx4/mlx5, doing so is only necessary when you intent to assign devices to a VM, otherwise the spawned VFs must remain managed by their original kernel drivers. You likely need to transfer the associated netdevices to your Docker instance for this to work though. You'll likely need to somehow transfer the related IB instances as well. At least that's the theory, I've never personally tried to use Docker with mlx4/mlx5 VFs. -- Adrien Mazarguil 6WIND