From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <clearasu@gmail.com>
Received: from mail-lf0-f42.google.com (mail-lf0-f42.google.com
 [209.85.215.42]) by dpdk.org (Postfix) with ESMTP id 04D528E7A
 for <dev@dpdk.org>; Thu, 21 Jan 2016 00:51:28 +0100 (CET)
Received: by mail-lf0-f42.google.com with SMTP id 17so16343143lfz.1
 for <dev@dpdk.org>; Wed, 20 Jan 2016 15:51:27 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:date:message-id:subject:from:to:content-type;
 bh=h65xLObBftIGSmrjoXaJgum7pzis4RvHU2ggiYhqpo0=;
 b=nH3vM1sgMuk6GDDlC2LyL/5/t9WQ6uNlYwQNpJxFMSDGttPbNSLLGBWc+wzYn1djdJ
 nJIINnU+hNxeuOuJg5fEfHdiPWsfigQGOOVmzFJVLIGI2nmpATvLVqgW7eK0MZhgDeoM
 USpKUEz9xCkrueb/YnBZfuYQQwGaGT7f2dTwjV6QV+tfh9uMCK1g/du6kRi48MIjkXPC
 J9rClfMilM+zIl+/GsW0h6kpFlhIiQEXnQAkMLNXRrOTkVZx9/jcEfBTyLVAAuga5V9S
 DGqP2vVqVrROFufp6Vlm4VIoNFiguWY402LGHA/XNm7G5mZ0SC24UGdPxpoPV8geYEFB
 EJPw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20130820;
 h=x-gm-message-state:mime-version:date:message-id:subject:from:to
 :content-type;
 bh=h65xLObBftIGSmrjoXaJgum7pzis4RvHU2ggiYhqpo0=;
 b=iyzO2wFcoAvOBgNYv+2nbciKwc+rCkgYNLAxN/tN9Zl08wY0BBlm/g1uTszkJUI/HF
 0i+/Y5YlMCLtJUR6lN8dGWeutcSB1G9RgbaG/5kxjdK+pSNlCyJ1WnpCUwvFo9oqcKrl
 8NWIbeTcbBF/hU9ML941VS11QDf5xU1ZnH2AI1Cx1o1i77bRCc/EtMr1SIMOnvaYQajW
 v3zX8kByckiRK/44a2C1f102kUffs7dB0cbI/CmIJwDqtpFZmhMF6eUFd5Vf8YD8PZwH
 7snIbZXo4kAso1H4M8QpxKyEpgqstZmRixFaRGb+C+vl1f086yKgUxJ4N5q8WmIYvCEF
 KiBA==
X-Gm-Message-State: ALoCoQkr6UyruPu2QSUqccbmwqela+8IR4BqWeQmku0WmfeqnkX7GiX9k29k4oBD0/ZOSxRgIsLA9rSe7olQaFa9wl8VWK87yw==
MIME-Version: 1.0
X-Received: by 10.25.162.11 with SMTP id l11mr14344685lfe.30.1453333887234;
 Wed, 20 Jan 2016 15:51:27 -0800 (PST)
Received: by 10.114.173.1 with HTTP; Wed, 20 Jan 2016 15:51:27 -0800 (PST)
Date: Wed, 20 Jan 2016 15:51:27 -0800
Message-ID: <CAKj5MjtyCmu_+smtGctWYJUjvUSFOuB3UAzM85rdKoRxig3k-Q@mail.gmail.com>
From: Clarylin L <clearasu@gmail.com>
To: dev@dpdk.org
Content-Type: text/plain; charset=UTF-8
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: [dpdk-dev] L3 Forwarding performance of DPDK on virtio
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: patches and discussions about DPDK <dev.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Wed, 20 Jan 2016 23:51:28 -0000

I am running dpdk within a virtual guest as a L3 forwarder.


The VM has two ports connecting to two linux bridges (in turn connecting
two physical ports). DPDK is used to forward between these two ports (one
port connected to traffic generator and the other connected to sink). I
used iperf to test the throughput.


If the VM/DPDK is running on passthrough, it can achieve around 10G
end-to-end (from traffic generator to sink) throughput. However if the
VM/DPDK is running on virtio (virtio-net-pmd), it achieves just 150M
throughput, which is a huge degrade.


On the virtio, I also measured the throughput between the traffic generator
and its connected port on VM, as well as throughput between the sink and
it's VM port. Both legs show around 7.5G throughput. So I guess forwarding
within the VM (from one port to the other) would be a big killer of the
performance.


Any suggestion on how I can root cause the poor performance issue, or any
idea on performance tuning techniques for virtio? thanks a lot!