From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <helmut.edgar100@gmail.com> Received: from mail-wj0-f172.google.com (mail-wj0-f172.google.com [209.85.210.172]) by dpdk.org (Postfix) with ESMTP id C6C8A370 for <users@dpdk.org>; Thu, 15 Dec 2016 14:32:05 +0100 (CET) Received: by mail-wj0-f172.google.com with SMTP id v7so65544385wjy.2 for <users@dpdk.org>; Thu, 15 Dec 2016 05:32:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=B284wXjGD+/9cX+8YDn3nC1Sbwgc3js5LJLP+cy8UrQ=; b=fobagFZl60nX282GwAtGinOVILklmzUo+px/bHkWRb97Li34B/QkipbUG/XmdFGcKm dUwmBN0XX1E4JSvjq3NrVYVHgaEstVGCOoORY+LRy2CQq0zdO26n9Z0R/U3pHi6+4Lun 26uQLD9+T6Uh72PPiYkHRlq7rgMTiPzROuV7W20EJSyt0K9yBUs4vDuyy8A/jHjPgeVy ncLxTHwiiPQXNijNbo4g5AGU4VkNX7jZxd38iDwDHSYz5H/ztjRtL4FICozQhF2G1lDu P622qDZEeSV0puiyyLz3ivZB8EFBqgqsbDD3cC/VhBdqrsqNds8MMJrl1rlQ5LLt1Oz8 0YBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=B284wXjGD+/9cX+8YDn3nC1Sbwgc3js5LJLP+cy8UrQ=; b=gFD1vVKSl5kqwHhEgQB5FJmvwSglE8i4b8FMHAPD3BGu2cdSo+wI4GiqoYAW1q4DVM aH6YV3qJyc2XMaAt9ulmcsgb89+webv980uSjbwpM9BF1+RTC5YnD7aN0hsEQqfOKMGY PwxeHV5JLFlzNUFGl0duk/tKAfoI8Qj1/nNfG8KWeOfnmx0lniDJ/Eyvml0kZLQA4MNO xJBS2LZtpqQuUy/Y/G9PEg0FbAhjI/s9ZVDxnxnmVfZSM/Yu+s0/X3NWdfy1rwLqVQZT jNlqbmg4Nduf4ch2DeclwbXbQNWd+0T35O2hNVsoRHj5BzVuFgfx0d12gE+w1oEY17vQ wdQA== X-Gm-Message-State: AKaTC001OhritLwk+0KlLTmORFHPJzbq6dI8oQ1WnNUFtTuTccUtrvrubsF8SIAHhgmzbWSYg2qdMJLMaQIjLA== X-Received: by 10.194.138.111 with SMTP id qp15mr1492884wjb.3.1481808725272; Thu, 15 Dec 2016 05:32:05 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.175.70 with HTTP; Thu, 15 Dec 2016 05:32:04 -0800 (PST) In-Reply-To: <D2D84874-8E8B-4CB0-B3B5-859ADBE62E2F@intel.com> References: <CABc_bMBYNa7jdhqu2SNZkwtoJskCwQWGOZrB71RYzBZx5-OTfw@mail.gmail.com> <CABc_bMBMxhbkGSg82tw7CKLw7AiccEESLAJaHGA6PAaYAPCmTg@mail.gmail.com> <CABc_bMB2vnXEpacfeiWiC5X-x8iuB7jO6fR67n5jj67Pspcf2g@mail.gmail.com> <CABc_bMB7C2zRjEkFbtAyk7buaP=QWwxCSwz=60AVJT_rjoPZTQ@mail.gmail.com> <CABc_bMDgU62=i5uE52d12VGd8wUzqHq9siOjYKSh8v811TYpug@mail.gmail.com> <CABc_bMCn9LivEn_PJCh+dQy7pPypLdmE+eZFQZtzphsHEgr08g@mail.gmail.com> <CABc_bMADQ3PaZz5ovLmGu=3_w2pTO3c6BvNPM6-BUzJ5BXjxLQ@mail.gmail.com> <CABc_bMBJ+NZLuo___qw_cBB=z=5nzgVx6rMd15nMiSYf_q3WoQ@mail.gmail.com> <CABc_bMC6qP3K-kqVQORc9XKfbcXX63UfN=AdZ+sksHUN+Bx5kw@mail.gmail.com> <CABc_bMDowcZKMrKc8omf-JqpUW=uPn-fq8sfLYk=AktbH9-aNw@mail.gmail.com> <CABc_bMACisgaHBZedG05ZzJ3wzmudgBeTHdRr93M3-QOGKDKNw@mail.gmail.com> <CABc_bMCTRDYy+9ZO6py+KupRStR=Rc4md+J0NhPcyTqaZhKxTA@mail.gmail.com> <CABc_bMAu8BkZXzBSZLWNs=R6AJgMAw9WrTki=cEzMzjC7Z8LAQ@mail.gmail.com> <CABc_bMDtzYE4NvhAT8nqi3qZbzV4WauzJLW-tcY_Wi5i88F7yQ@mail.gmail.com> <CABc_bMAr0EjgH4f7UT-oi353FBqYwxt-UgfP6candcP=jkuyLg@mail.gmail.com> <CABc_bMCyJ4o94T=VRWPjfyhXP1T3uDmeYVsu+0OrXi1AqUkLrg@mail.gmail.com> <CABc_bMBK=AQ31=mQX0f7HMXs6REqj_bkqQ9KPD96vbtoKKHWCw@mail.gmail.com> <CABc_bMA8z6XBEtnxwPE_LDpngx_DYRathn17KqFxNx2V5DFbng@mail.gmail.com> <CABc_bMBwFAL5rc5goMP9pt+2z=TOM=VNfp76AznZ3jend9aS_Q@mail.gmail.com> <CABc_bMBr1c_Evd5zxB89SinNFVMUGHFTBDoLusVHdMySBCyaBA@mail.gmail.com> <CABc_bMChD5hpWmj1zhvZ5tocsxDCFH0QdE34TKWXsdo_danH-Q@mail.gmail.com> <CABc_bMCqu-4V4gn=JPqO491BF6Cnjj=4SaAey9qyTQcha134yw@mail.gmail.com> <CABc_bMBwYrCyWOjkzUjucwJcHxfHSDV3hthZ4PTtkBcerp_sbA@mail.gmail.com> <D2D84874-8E8B-4CB0-B3B5-859ADBE62E2F@intel.com> From: edgar helmut <helmut.edgar100@gmail.com> Date: Thu, 15 Dec 2016 15:32:04 +0200 Message-ID: <CABc_bMDkX+JF7qQY6pRrJWY0A2if8E=0UUFdD97Z2SBE2mN78Q@mail.gmail.com> To: "Wiles, Keith" <keith.wiles@intel.com> Cc: "users@dpdk.org" <users@dpdk.org> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Dpdk poor performance on virtual machine X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions <users.dpdk.org> List-Unsubscribe: <http://dpdk.org/ml/options/users>, <mailto:users-request@dpdk.org?subject=unsubscribe> List-Archive: <http://dpdk.org/ml/archives/users/> List-Post: <mailto:users@dpdk.org> List-Help: <mailto:users-request@dpdk.org?subject=help> List-Subscribe: <http://dpdk.org/ml/listinfo/users>, <mailto:users-request@dpdk.org?subject=subscribe> X-List-Received-Date: Thu, 15 Dec 2016 13:32:05 -0000 I have one single socket which is Intel(R) Xeon(R) CPU E5-2640 v4 @ 2.40GHz= . I just made two more steps: 1. setting iommu=3Dpt for better usage of the igb_uio 2. using taskset and isolcpu so now it looks like the relevant dpdk cores use dedicated cores. It improved the performance though I still see significant difference between the vm and the host which I can't fully explain. any further idea? Regards, Edgar On Thu, Dec 15, 2016 at 2:54 PM, Wiles, Keith <keith.wiles@intel.com> wrote= : > > > On Dec 15, 2016, at 1:20 AM, edgar helmut <helmut.edgar100@gmail.com> > wrote: > > > > Hi. > > Some help is needed to understand performance issue on virtual machine. > > > > Running testpmd over the host functions well (testpmd forwards 10g > between > > two 82599 ports). > > However same application running on a virtual machine over same host > > results with huge degradation in performance. > > The testpmd then is not even able to read 100mbps from nic without drop= s, > > and from a profile i made it looks like a dpdk application runs more th= an > > 10 times slower than over host=E2=80=A6 > > Not sure I understand the overall setup, but did you make sure the NIC/PC= I > bus is on the same socket as the VM. If you have multiple sockets on your > platform. If you have to access the NIC across the QPI it could explain > some of the performance drop. Not sure that much drop is this problem. > > > > > Setup is ubuntu 16.04 for host and ubuntu 14.04 for guest. > > Qemu is 2.3.0 (though I tried with a newer as well). > > NICs are connected to guest using pci passthrough, and guest's cpu is s= et > > as passthrough (same as host). > > On guest start the host allocates transparent hugepages (AnonHugePages) > so > > i assume the guest memory is backed with real hugepages on the host. > > I tried binding with igb_uio and with uio_pci_generic but both results > with > > same performance. > > > > Due to the performance difference i guess i miss something. > > > > Please advise what may i miss here? > > Is this a native penalty of qemu?? > > > > Thanks > > Edgar > > Regards, > Keith > >