From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C27EDA0577; Mon, 13 Apr 2020 11:30:02 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 99C281BF9D; Mon, 13 Apr 2020 11:29:23 +0200 (CEST) Received: from inbox.dpdk.org (xvm-172-178.dc0.ghst.net [95.142.172.178]) by dpdk.org (Postfix) with ESMTP id 3C2D41BF31 for ; Mon, 13 Apr 2020 11:29:20 +0200 (CEST) Received: by inbox.dpdk.org (Postfix, from userid 33) id 1EFC4A0588; Mon, 13 Apr 2020 11:29:20 +0200 (CEST) From: bugzilla@dpdk.org To: dev@dpdk.org Date: Mon, 13 Apr 2020 09:29:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: DPDK X-Bugzilla-Component: vhost/virtio X-Bugzilla-Version: 20.02 X-Bugzilla-Keywords: X-Bugzilla-Severity: minor X-Bugzilla-Who: sunil.pai.g@intel.com X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: dev@dpdk.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All MIME-Version: 1.0 Subject: [dpdk-dev] [Bug 448] Post-copy-Live migration with 8 vhost queues succeeds with warning from QEMU X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" https://bugs.dpdk.org/show_bug.cgi?id=3D448 Bug ID: 448 Summary: Post-copy-Live migration with 8 vhost queues succeeds with warning from QEMU Product: DPDK Version: 20.02 Hardware: x86 OS: Linux Status: UNCONFIRMED Severity: minor Priority: Normal Component: vhost/virtio Assignee: dev@dpdk.org Reporter: sunil.pai.g@intel.com Target Milestone: --- Overview: Even though Post-copy Live migration succeeds, QEMU reports the following warning with 8 vhost queues: qemu-system-x86_64: vhost_user_set_mem_table_postcopy: Received unexpected = msg type.Expected 5 received 30 qemu-system-x86_64: vhost_set_mem_table failed: Resource temporarily unavailable (11) qemu-system-x86_64: unable to start vhost net: 11: falling back on userspace virtio Steps to Reproduce: 1.download and build dpdk for x86_64-native-linuxapp-gcc with CONFIG_RTE_LIBRTE_VHOST_POSTCOPY=3Dy on both source and destination host. 2.Set 8192 2MB huge pages on both destination and source host 3.Run DPDK's Testpmd application on source: ./testpmd -m 512 --file-prefix=3Dsrc -l 0,2 -n 4 --vdev 'net_vhost0,iface=3D/tmp/vu-src,queues=3D8' -- --portmask=3D1 -i --rxq=3D8 = --txq=3D8 --nb-cores=3D1 --eth-peer=3D0,52:54:00:11:22:12 --no-mlockall=20 4.Run DPDK's Testpmd application on destination: ./testpmd -m 512 --file-prefix=3Ddst -l 0,2 -n 4 --vdev 'net_vhost0,iface=3D/tmp/vu-dst,queues=3D8,postcopy-support=3D1' -- --portm= ask=3D1 -i --rxq=3D8 --txq=3D8 --nb-cores=3D1 --eth-peer=3D0,52:54:00:11:22:12 --no-ml= ockall 5.Run QEMU on src host: export VM_NAME=3Dvhost-vm export GUEST_MEM=3D4096M export VM_PATH=3D~/Downloads/grpc-2.qcow2 export qemu_queues=3D8 export qemu_vectors=3D18 export QEMU=3D~/qemu-latest/qemu/x86_64-softmmu/qemu-system-x86_64 taskset -c 5-8 $QEMU -name $vhost-vm -cpu host -enable-kvm \ -m $GUEST_MEM -drive file=3D$VM_PATH --nographic \ -numa node,memdev=3Dmem -mem-prealloc -smp sockets=3D1,cores=3D4 \ -object memory-backend-file,id=3Dmem,size=3D$GUEST_MEM,mem-path=3D/dev/hugepages,sh= are=3Don \ -chardev socket,id=3Dchar0,path=3D/tmp/vu-src \ -netdev type=3Dvhost-user,id=3Dmynet1,chardev=3Dchar0,vhostforce,queues=3D$qemu_que= ues \ -device virtio-net-pci,mac=3D00:00:00:00:00:01,netdev=3Dmynet1,mq=3Don,mrg_rxbuf=3D= on,rx_queue_size=3D1024,tx_queue_size=3D1024,vectors=3D$qemu_vectors \ -monitor telnet::1234,server,nowait \ -net user,hostfwd=3Dtcp::10023-:22 -net nic & 6.Run QEMU on dst host: export VM_NAME=3Dvhost-vm export GUEST_MEM=3D4096M export VM_PATH=3D~/Downloads/grpc-2.qcow2 export qemu_queues=3D8 export qemu_vectors=3D18 export QEMU=3D~/qemu-latest/qemu/x86_64-softmmu/qemu-system-x86_64 taskset -c 5-8 $QEMU -name $VM_NAME -cpu host -enable-kvm \ -m $GUEST_MEM -drive file=3D$VM_PATH --nographic \ -numa node,memdev=3Dmem -mem-prealloc -smp sockets=3D1,cores=3D4 \ -object memory-backend-file,id=3Dmem,size=3D$GUEST_MEM,mem-path=3D/dev/hugepages,sh= are=3Don \ -chardev socket,id=3Dchar0,path=3D/tmp/vu-src \ -netdev type=3Dvhost-user,id=3Dmynet1,chardev=3Dchar0,vhostforce,queues=3D$qemu_que= ues \ -device virtio-net-pci,mac=3D00:00:00:00:00:01,netdev=3Dmynet1,mq=3Don,mrg_rxbuf=3D= on,rx_queue_size=3D1024,tx_queue_size=3D1024,vectors=3D$qemu_vectors \ -monitor telnet::1234,server,nowait \ -incoming tcp:0:4444 \ -net user,hostfwd=3Dtcp::10023-:22 -net nic & 7.In both testpmd prompts, start flooding the virtio-net device: testpmd> set fwd txonly testpmd> start 8.In destination's Qemu monitor, enable postcopy: (qemu) migrate_set_capability postcopy-ram on 9.In source's Qemu monitor, enable postcopy and launch migration: (qemu) migrate_set_capability postcopy-ram on (qemu) migrate -d tcp::4444 (qemu) migrate_start_postcopy Actual Results: Even though migration succeeds, on dst host following message is seen on console: qemu-system-x86_64: vhost_user_set_mem_table_postcopy: Received unexpected = msg type.Expected 5 received 30 qemu-system-x86_64: vhost_set_mem_table failed: Resource temporarily unavailable (11) qemu-system-x86_64: unable to start vhost net: 11: falling back on userspace virtio Expected Results: No Warning or error messages from QEMU Version information: QEMU-version: master branch [v5.0.0-rc1] DPDK-version: master branch [v20.02] Environment Information: Operating System: Ubuntu 18.04.4 LTS Kernel: Linux 4.15.0-74-generic Architecture: x86-64 Additional information: This error is not seen when number of vhost queues is set to 1 --=20 You are receiving this mail because: You are the assignee for the bug.=