From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-vk0-f47.google.com (mail-vk0-f47.google.com [209.85.213.47]) by dpdk.org (Postfix) with ESMTP id 8916D919B for ; Fri, 22 Jan 2016 18:29:45 +0100 (CET) Received: by mail-vk0-f47.google.com with SMTP id n1so44813064vkb.3 for ; Fri, 22 Jan 2016 09:29:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=EUPK8Ptl8r9g1Jjpcb5JHnwbe/0P4HhTmsxwoglmFVw=; b=OoHE+kPaR1l46LCHmaI1iUiRedlusqmH1PLlnfwYoT8pBzSUC+PeCIMoz5nAwOOFW2 1YkqRKdnjo9TEfp5iMw1VRgJ6OCTxU1rlnDZFq3dmj7XBfg+Ok22uEVtQtWywriSyEUG M8TVMq6gYfP7Sp6dBU1Efa/E0AZrkBv3GTY/zsvSHqBdg7Q8On3GU/MegXtIVK8b2qLb 6gHGLjb6/W0vp1Q39jJircUJjTE2errZ9vbX84QNaO8e74Q5hKOnr1dvitFXZPsC6ZNS 0LBmS+JdEntY1gRwLsefp+C+K+n4NirV8LCIU4HP1egEo4L/Bcsp9OotzRuBZebQqaIy LSGA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=EUPK8Ptl8r9g1Jjpcb5JHnwbe/0P4HhTmsxwoglmFVw=; b=GVneA28+NDLooozMFoOSaAxcxkfHWsFBBdzdkPRDs/ijXb4H/WqkiKqwZd+lcMaHdI HPJZE0qbdHK93VUx//zAFuAkzIMjs759L+LfpdSULhNozMGaKq+Lv5bQhdBJeig2/4bv GfC9DAH68zoevA4eNM9+vmAYD7CTIXvfgTcuo+Z3fXx2VGQGtK4PnXSEX6/zwF/v9HSr mpkV2A6j6k//aAdYQJN7nt14JYkErTiDwf57IYgk0hNDb6t2Pnbo1x8YLiagSAcJ5Sr+ hvSNDhP5+jvqcxjEzgY7IzcV6pAJhYRPYeYdRjZu6S0UuKfEozUNRM1Zb7OlgAvy6fYw ILhQ== X-Gm-Message-State: AG10YOS20bVEr1tLBjgVfIYBtcE7Tkdw+w9PKfx7fKvlcf2e6ZN1B96a0GRxWOyETcOXcICvIQAd2J87GtX7yA== MIME-Version: 1.0 X-Received: by 10.31.166.208 with SMTP id p199mr2756360vke.122.1453483784983; Fri, 22 Jan 2016 09:29:44 -0800 (PST) Received: by 10.31.152.208 with HTTP; Fri, 22 Jan 2016 09:29:44 -0800 (PST) In-Reply-To: <1802842.TfXaaEq7Xm@xps13> References: <1802842.TfXaaEq7Xm@xps13> Date: Fri, 22 Jan 2016 09:29:44 -0800 Message-ID: From: Saurabh Mishra To: Thomas Monjalon Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Cc: Helin Zhang , users@dpdk.org Subject: Re: [dpdk-users] i40e with DPDK exits abruptly in rte_eal_init() X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Jan 2016 17:29:46 -0000 Hi, Thanks Thomas.. So this is the error we see on i40e PCI-passthrough of whole NIC: *Secondary Process:* EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 0 on socket 0 EAL: Support maximum 128 logical core(s) by configuration. EAL: Detected 2 lcore(s) EAL: Setting up physically contiguous memory... EAL: Analysing 1024 files EAL: Mapped segment 0 of size 0x22800000 EAL: Mapped segment 1 of size 0x200000 EAL: Mapped segment 2 of size 0x200000 EAL: Mapped segment 3 of size 0x57600000 EAL: Mapped segment 4 of size 0x400000 EAL: Mapped segment 5 of size 0x400000 EAL: Mapped segment 6 of size 0x400000 EAL: Mapped segment 7 of size 0x200000 EAL: Mapped segment 8 of size 0x2200000 EAL: Mapped segment 9 of size 0x200000 EAL: Mapped segment 10 of size 0x800000 EAL: Mapped segment 11 of size 0x600000 EAL: Mapped segment 12 of size 0x800000 EAL: Mapped segment 13 of size 0xa00000 EAL: Mapped segment 14 of size 0x400000 EAL: Mapped segment 15 of size 0x200000 EAL: Mapped segment 16 of size 0x200000 EAL: Mapped segment 17 of size 0x200000 EAL: Mapped segment 18 of size 0x200000 EAL: memzone_reserve_aligned_thread_unsafe(): memzone already exists RING: Cannot reserve memory EAL: TSC frequency is ~1799997 KHz EAL: Master lcore 1 is ready (tid=f7fe78c0;cpuset=[1]) EAL: PCI device 0000:03:00.0 on NUMA socket 0 EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd EAL: Not managed by a supported kernel driver, skipped EAL: PCI device 0000:1b:00.0 on NUMA socket 0 EAL: probe driver: 8086:1572 rte_i40e_pmd EAL: PCI memory mapped at 0x7fff6f1f3000 EAL: PCI memory mapped at 0x7ffff7faa000 EAL: Cannot mmap device resource file /sys/bus/pci/devices/0000:1b:00.0/resource3 to address: 0x7ffff7fac000 EAL: Error - exiting with code: 1 Cause: Requested device 0000:1b:00.0 cannot be used # ./dpdk-2.2.0/tools/dpdk_nic_bind.py --status Network devices using DPDK-compatible driver ============================================ 0000:1b:00.0 'Device 1572' drv=uio_pci_generic unused=i40e Network devices using kernel driver =================================== 0000:03:00.0 'VMXNET3 Ethernet Controller' if=eth0 drv=vmxnet3 unused=uio_pci_generic *Active* Other network devices ===================== # grep Huge /proc/meminfo AnonHugePages: 118784 kB HugePages_Total: 1024 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB # *Primary Process:* EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 0 on socket 0 EAL: Support maximum 128 logical core(s) by configuration. EAL: Detected 2 lcore(s) EAL: Setting up physically contiguous memory... EAL: cannot open /proc/self/numa_maps, consider that all memory is in socket_id 0 EAL: Ask a virtual area of 0x22800000 bytes EAL: Virtual area found at 0x7fffd0a00000 (size = 0x22800000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fffd0600000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fffd0200000 (size = 0x200000) EAL: Ask a virtual area of 0x57600000 bytes EAL: Virtual area found at 0x7fff78a00000 (size = 0x57600000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7fff78400000 (size = 0x400000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7fff77e00000 (size = 0x400000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7fff77800000 (size = 0x400000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff77400000 (size = 0x200000) EAL: Ask a virtual area of 0x2200000 bytes EAL: Virtual area found at 0x7fff75000000 (size = 0x2200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff74c00000 (size = 0x200000) EAL: Ask a virtual area of 0x800000 bytes EAL: Virtual area found at 0x7fff74200000 (size = 0x800000) EAL: Ask a virtual area of 0x600000 bytes EAL: Virtual area found at 0x7fff73a00000 (size = 0x600000) EAL: Ask a virtual area of 0x800000 bytes EAL: Virtual area found at 0x7fff73000000 (size = 0x800000) EAL: Ask a virtual area of 0xa00000 bytes EAL: Virtual area found at 0x7fff72400000 (size = 0xa00000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7fff71e00000 (size = 0x400000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff71a00000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff71600000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff71200000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fff70e00000 (size = 0x200000) EAL: Requesting 1024 pages of size 2MB from socket 0 EAL: TSC frequency is ~1799997 KHz EAL: Master lcore 1 is ready (tid=f7fe78a0;cpuset=[1]) EAL: PCI device 0000:03:00.0 on NUMA socket 0 EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd EAL: Not managed by a supported kernel driver, skipped EAL: PCI device 0000:1b:00.0 on NUMA socket 0 EAL: probe driver: 8086:1572 rte_i40e_pmd EAL: PCI memory mapped at 0x7fff6f1f3000 EAL: PCI memory mapped at 0x7ffff7fac000 # On Fri, Jan 22, 2016 at 2:12 AM, Thomas Monjalon wrote: > Hi, > > Thanks for asking. > There are a couple of requests hidden in this message. > The maintainer of i40e is Helin (CC'ed). > > 2016-01-21 14:54, Saurabh Mishra: > > Hi, > > > > We have noticed that i40e if we do PCI-pass through of whole NIC to VM on > > ESXi 6.0, the DPDK exits abruptly in rte_eal_init()? > > This looks to be a bug report :) > > > We are passing following parameters: > > > > char *eal_argv[] = {"fakeelf", > > > > "-c2", > > > > "-n4", > > > > "--proc-type=primary",}; > > > > > > int ret = rte_eal_init(4, eal_argv); > > > > The code works with Intel '82599ES 10-Gigabit SFI/SFP+ ' adapter in > > PCI-passthrough or SR-IOV mode however i40e it does not work. > > You probably have the feeling that i40e does not work as other PMDs, > maybe wondering what are the special extended PCI configs. > > > [root@localhost:~] esxcfg-nics -l > > > > [.] > > > > vmnic6 0000:07:00.0 i40e Up 10000Mbps Full 3c:fd:fe:04:11:c0 > > 1500 Intel Corporation Ethernet Controller X710 for 10GbE SFP+ > > > > vmnic7 0000:07:00.1 i40e Up 10000Mbps Full 3c:fd:fe:04:11:c2 > > 1500 Intel Corporation Ethernet Controller X710 for 10GbE SFP+ > > > > > > We have turned on following config in DPDK: > > > > CONFIG_RTE_PCI_CONFIG=y > > > > CONFIG_RTE_PCI_EXTENDED_TAG="on" > > CONFIG_RTE_LIBRTE_I40E_16BYTE_RX_DESC=y > > > > > > Is there any special handling in DPDK for i40e adapter in terms of > config? > > So you had no help when reading the code comments neither in the doc. > Indeed the only doc about i40e is the SR-IOV VF page: > http://dpdk.org/doc/guides/nics/intel_vf.html > > Please Helin, check the issue and the lack of documentation. > Thanks >