From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qg0-f46.google.com (mail-qg0-f46.google.com [209.85.192.46]) by dpdk.org (Postfix) with ESMTP id D0FDB2BDC for ; Wed, 25 May 2016 08:08:09 +0200 (CEST) Received: by mail-qg0-f46.google.com with SMTP id 90so17611607qgz.1 for ; Tue, 24 May 2016 23:08:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=canonical-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=arNm01KbnhtmKlsZIsmMD/+ibI616pR1zwwS275BHSA=; b=ZJv/Ne5edQZ2OXSduZUdYGPCcW13tuAKwDRX9ib3yASBTpEXX7c1+P6tyT0+JVwBFQ ZdtDcQOvEKbzYaJqOjoSnZ3TFH3y25Oh5GwsAtuLtgEYFuH9L47b2xSTHhGnmrUJKf1n rKF6gpOVT2vYgxNw1l7I5nWL2/wn1iWv5HJmO6n2TQ/ylMlkyCtefafveAdmUSWRBXsQ tCQa+/Q2nS2U5y+uV+qDTbET8Run1JWX4+OG9O9n0089pCt/Z6ljCWfIQZG7fz8cyjko UOiKEk+wh8MY07E5LPvKO1wlgBK1MhfGfeClS4Q9SJD3UcZaQPNmyAFF5awKMEzej+A2 oErA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=arNm01KbnhtmKlsZIsmMD/+ibI616pR1zwwS275BHSA=; b=AHVF5I0QNcGnHToHNzuQ38lokrZ68HajRapXuHJ8KK6BoyocP5Y9tgQ6fim2/2M1uh HhODVqLUM2l4KsbzcXLWZVt6SYQOIb8icn7ka5rjnbrBEcMrfj1E5ILf6bhmQ6Th2O5O bNSAbof45PSdaQoRtWgPtOOUIMwyRyEUbCmzHSrtl8tu+4oK1b2qJIY55AKwekk/gXSq d4hSI6Lh9YvI8wnQfSdDFioFiI42B5QHlAb9GzHO3sJiDlcwMO12HFhKmsg/IIfWsu29 zHaNP1lEfqx3jyXzMbz27dgpGvoqYRYumz200cQfFYSYSpJfCaIa8dOWnJ0bgNeCCpl9 UI9g== X-Gm-Message-State: ALyK8tLx5FeeEjsaVMMa/B/xkpvmZviPikM9M+7VWmtLpAybhe5BOsQfQoQu/cvWA6AYo9QqcrWQwkEAtEP99fIz X-Received: by 10.140.161.67 with SMTP id h64mr1904123qhh.96.1464156489207; Tue, 24 May 2016 23:08:09 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.97.3 with HTTP; Tue, 24 May 2016 23:07:49 -0700 (PDT) In-Reply-To: References: From: Christian Ehrhardt Date: Wed, 25 May 2016 08:07:49 +0200 Message-ID: To: =?UTF-8?B?TWFydGlueCAtIOOCuOOCp+ODvOODoOOCug==?= Cc: "" , dev , qemu-stable@nongnu.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] If 1 KVM Guest loads the virtio-pci, on top of dpdkvhostuser OVS socket interface, it slows down everything! X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 May 2016 06:08:10 -0000 Hi again, another forgotten case. I currently I lack the HW to fully reproduce this, but the video summary is pretty good and shows the issue in an impressive way. Also the description is good and here as well I wonder if anybody else could reproduce this. Any hints / insights are welcome. P.S. and also again - two list cross posting, but here as well it is yet unclear which it belongs to so I'll keep it as well Christian Ehrhardt Software Engineer, Ubuntu Server Canonical Ltd On Sun, May 22, 2016 at 6:35 PM, Martinx - =E3=82=B8=E3=82=A7=E3=83=BC=E3= =83=A0=E3=82=BA wrote: > Guys, > > I'm seeing a strange problem here, in my OVS+DPDK deployment, on top of > Ubuntu 16.04 (DPDK 2.2 and OVS 2.5). > > Here is what I'm trying to do: run OVS with DPDK at the host, for KVM > Guests that also, will be running more DPDK Apps. > > The host have 2 x 10G NICs, for OVS+DPDK and each KVM Guest receives its > own VLAN tagged traffic (or all tags). > > There is an IXIA Traffic Generator sending 10G of traffic on both > directions (20G total). > > Exemplifying, the problem is, lets say that I already have 2 VMs (or 10) > running DPDK Apps (on top of dpdkvhostuser), everything is working as > expected, then, if I boot the 3rd (or 11) KVM Guest, the OVS+DPDK bridge = at > the host, slows down, a lot! The 3rd (or 11) VM affects not only the host= , > but also, all the other neighbors VMs!!! > > NOTE: This problem appear since the boot of VM 1. > > Soon as you, inside of the 3rd VM, bind the VirtIO NIC to the > DPDK-Compative Drivers, the speed comes back to normal. If you bind it ba= ck > to "virtio-pci", boom! The OVS+DPDK at the host and all VMs loses too muc= h > speed. > > This problem is detailed at the following bug report: > > -- > The OVS+DPDK dpdkvhostuser socket bridge, only works as expected, if the > KVM Guest also have DPDK drivers loaded: > > https://bugs.launchpad.net/ubuntu/+source/openvswitch/+bug/1577256 > -- > > Also, I've recorded a ~15 min screen cast video about this problem, so, > you guys can see exactly what is happening here. > > https://www.youtube.com/v/yHnaSikd9XY?version=3D3&vq=3Dhd720&autoplay=3D1 > > * At 5:25, I'm starting a VM that will boot up and load a DPDK App; > > * At 5:33, OVS+DPDK is messed up, it loses speed; > The KVM running with virtio-pci drivers breaks OVS+DPDK at the host; > > * At 6:50, DPDK inside of the KVM guest loads up its drivers, kicking > "virtio-pci", speed back to normal at the host; > > * At 7:43, started another KVM Guest, now, while virtio-pci driver is > running, the OVS+DPDK at the host and the other VM, are very, very slow; > > * At 8:52, the second VM loads up DPDK Drivers, kicking virtio-pci, the > speed is back to normal at the host, and on the other VM too; > > * At 10:00, the Ubuntu VM loads up virtio-pci drivers on its boot, the > speed dropped at the hosts and on the other VMs; > > * 11:57, I'm starting "service dpdk start" inside of the Ubuntu guest, t= o > kick up virtio-pci, and bang! Speed is back to normal everywhere; > > * 12:51, I'm trying to unbind the DPDK Drivers and return the virtio-pci= , > I forgot the syntax while recording the video, which is: "dpdk_nic_bind -= b > virtio-pci", so, I just rebooted it. But both "reboot" or "rebind to > virtio-pci" triggers the bug. > > > NOTE: I tried to subscriber to qemu-devel but, it is not working, I'm not > receiving the confirmation e-mail, while qemu-stable worked. I don't know > if it worth sending it to Linux Kernel too... > > > Regards, > Thiago >