From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mailout2.w1.samsung.com (mailout2.w1.samsung.com [210.118.77.12]) by dpdk.org (Postfix) with ESMTP id 286D0902 for ; Wed, 16 Dec 2015 13:43:09 +0100 (CET) Received: from eucpsbgm1.samsung.com (unknown [203.254.199.244]) by mailout2.w1.samsung.com (Oracle Communications Messaging Server 7.0.5.31.0 64bit (built May 5 2014)) with ESMTP id <0NZG00FFCBBVJ490@mailout2.w1.samsung.com> for dev@dpdk.org; Wed, 16 Dec 2015 12:43:07 +0000 (GMT) X-AuditID: cbfec7f4-f79026d00000418a-d4-56715c5bc2b1 Received: from eusync3.samsung.com ( [203.254.199.213]) by eucpsbgm1.samsung.com (EUCPMTA) with SMTP id 39.1C.16778.B5C51765; Wed, 16 Dec 2015 12:43:07 +0000 (GMT) Received: from fedinw7x64 ([106.109.131.169]) by eusync3.samsung.com (Oracle Communications Messaging Server 7.0.5.31.0 64bit (built May 5 2014)) with ESMTPA id <0NZG0037JBBUXD30@eusync3.samsung.com>; Wed, 16 Dec 2015 12:43:07 +0000 (GMT) From: Pavel Fedin To: 'Yuanhan Liu' References: <20151215100548.GD32243@pxdev.xzpeter.org> <00b601d13733$97e063a0$c7a12ae0$@samsung.com> <20151215133612.GJ29571@yliu-dev.sh.intel.com> <00ca01d1373f$3dd4ab30$b97e0190$@samsung.com> <20151215135907.GK29571@yliu-dev.sh.intel.com> <00f101d13749$0eb97330$2c2c5990$@samsung.com> <20151216072818.GO29571@yliu-dev.sh.intel.com> <005501d137f8$e89c0090$b9d401b0$@samsung.com> <20151216120817.GQ29571@yliu-dev.sh.intel.com> In-reply-to: <20151216120817.GQ29571@yliu-dev.sh.intel.com> Date: Wed, 16 Dec 2015 15:43:06 +0300 Message-id: <006d01d137ff$50650180$f12f0480$@samsung.com> MIME-version: 1.0 Content-type: text/plain; charset=us-ascii Content-transfer-encoding: 7bit X-Mailer: Microsoft Outlook 14.0 Thread-index: AQLUijOVh6KUKPTe2Hcz0FOrXNobyQF4nG1RAiBA49ACTY45+wKAPlxDAdBFtKgB2CnrfwG9Ov7wAopDp5gBtm2DWQHdkCV/nCeTyQA= Content-language: ru X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFvrILMWRmVeSWpSXmKPExsVy+t/xq7rRMYVhBlN+y1q8+7SdyWLL/m/s Ft0999gtFh84zGxxfcIFVgdWj4v9dxg9fi1Yyuox72Sgx/t9V9kCWKK4bFJSczLLUov07RK4 Mn4uvMxWsEOtovv+LpYGxusyXYycHBICJhL3199jh7DFJC7cW8/WxcjFISSwlFGi5d9BZgjn O6PEvjV32UCq2ATUJU5//cACYosI6Et82trKAlLELNDFKNE9ZR4zSEJI4ASLxI7bhiA2p4C1 xOR3L8AahAV8JV4ufcLUxcjBwSKgKjF5hhlImFfAUuLkwitsELagxI/J98DKmQW0JNbvPM4E YctLbF7zlhniUgWJHWdfM0LcUCHRcv8iM0SNiMS0f/eYJzAKzUIyahaSUbOQjJqFpGUBI8sq RtHU0uSC4qT0XEO94sTc4tK8dL3k/NxNjJCI+LKDcfExq0OMAhyMSjy8FyILwoRYE8uKK3MP MUpwMCuJ8D6UKwwT4k1JrKxKLcqPLyrNSS0+xCjNwaIkzjt31/sQIYH0xJLU7NTUgtQimCwT B6dUA2NjEX/Yrn/Jzw898taY8L1Iyta9hEHxxpa/cgK6W3SNZ1x5nHz7wNyKAEFvhn7z/HdJ LqK8L1fFLf0atji8i1nYRfyNrYR8N8f/ookveMRL7BfPnj5lw+EJZd+uG+v/lZnBuWidyQ4r g586/P1rPsQw8p6wT+M7LnqvMLZM9eWq2ht53Bd5liqxFGckGmoxFxUnAgC5sFKthAIAAA== Cc: dev@dpdk.org, 'Victor Kaplansky' Subject: Re: [dpdk-dev] [PATCH 0/4 for 2.3] vhost-user live migration support X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Dec 2015 12:43:09 -0000 Hello! > However, I'm more curious about the ping loss? Did you still see > that? And to be more specific, have the wireshark captured the > GRAP from the guest? Yes, everything is fine. root@nfv_test_x86_64 /var/log/libvirt/qemu # tshark -i ovs-br0 Running as user "root" and group "root". This could be dangerous. Capturing on 'ovs-br0' 1 0.000000 RealtekU_3b:83:1a -> Broadcast ARP 42 Gratuitous ARP for 192.168.6.2 (Request) 2 0.000024 fe80::5054:ff:fe3b:831a -> ff02::1 ICMPv6 86 Neighbor Advertisement fe80::5054:ff:fe3b:831a (ovr) is at 52:54:00:3b:83:1a 3 0.049490 RealtekU_3b:83:1a -> Broadcast ARP 42 Gratuitous ARP for 192.168.6.2 (Request) 4 0.049497 fe80::5054:ff:fe3b:831a -> ff02::1 ICMPv6 86 Neighbor Advertisement fe80::5054:ff:fe3b:831a (ovr) is at 52:54:00:3b:83:1a 5 0.199485 RealtekU_3b:83:1a -> Broadcast ARP 42 Gratuitous ARP for 192.168.6.2 (Request) 6 0.199492 fe80::5054:ff:fe3b:831a -> ff02::1 ICMPv6 86 Neighbor Advertisement fe80::5054:ff:fe3b:831a (ovr) is at 52:54:00:3b:83:1a 7 0.449500 RealtekU_3b:83:1a -> Broadcast ARP 42 Gratuitous ARP for 192.168.6.2 (Request) 8 0.449508 fe80::5054:ff:fe3b:831a -> ff02::1 ICMPv6 86 Neighbor Advertisement fe80::5054:ff:fe3b:831a (ovr) is at 52:54:00:3b:83:1a 9 0.517229 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=70/17920, ttl=64 10 0.517277 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=70/17920, ttl=64 (request in 9) 11 0.799521 RealtekU_3b:83:1a -> Broadcast ARP 42 Gratuitous ARP for 192.168.6.2 (Request) 12 0.799553 fe80::5054:ff:fe3b:831a -> ff02::1 ICMPv6 86 Neighbor Advertisement fe80::5054:ff:fe3b:831a (ovr) is at 52:54:00:3b:83:1a 13 1.517210 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=71/18176, ttl=64 14 1.517238 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=71/18176, ttl=64 (request in 13) 15 2.517219 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=72/18432, ttl=64 16 2.517256 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=72/18432, ttl=64 (request in 15) 17 3.517497 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=73/18688, ttl=64 18 3.517518 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=73/18688, ttl=64 (request in 17) 19 4.517219 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=74/18944, ttl=64 20 4.517237 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=74/18944, ttl=64 (request in 19) 21 5.517222 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=75/19200, ttl=64 22 5.517242 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=75/19200, ttl=64 (request in 21) 23 6.517235 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=76/19456, ttl=64 24 6.517256 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=76/19456, ttl=64 (request in 23) 25 6.531466 be:e1:71:c1:47:4d -> RealtekU_3b:83:1a ARP 42 Who has 192.168.6.2? Tell 192.168.6.1 26 6.531619 RealtekU_3b:83:1a -> be:e1:71:c1:47:4d ARP 42 192.168.6.2 is at 52:54:00:3b:83:1a 27 7.517212 192.168.6.2 -> 192.168.6.1 ICMP 98 Echo (ping) request id=0x04af, seq=77/19712, ttl=64 28 7.517229 192.168.6.1 -> 192.168.6.2 ICMP 98 Echo (ping) reply id=0x04af, seq=77/19712, ttl=64 (request in 27) But there's one important detail here. Any replicated network interfaces (LOCAL port in my example) should be fully cloned on both hosts, including MAC addresses. Otherwise after the migration the guest continues to send packets to old MAC, and, obvious, there's still ping loss until it redoes the ARP for its ping target. > And what's the output of 'grep virtio /proc/interrupts' inside guest? 11: 0 0 0 0 IO-APIC 11-fasteoi uhci_hcd:usb1, virtio3 24: 0 0 0 0 PCI-MSI 114688-edge virtio2-config 25: 3544 0 0 0 PCI-MSI 114689-edge virtio2-req.0 26: 10 0 0 0 PCI-MSI 49152-edge virtio0-config 27: 852 0 0 0 PCI-MSI 49153-edge virtio0-input.0 28: 3 0 0 0 PCI-MSI 49154-edge virtio0-output.0 29: 10 0 0 0 PCI-MSI 65536-edge virtio1-config 30: 172 0 0 0 PCI-MSI 65537-edge virtio1-input.0 31: 1 0 0 0 PCI-MSI 65538-edge virtio1-output.0 Kind regards, Pavel Fedin Expert Engineer Samsung Electronics Research center Russia