From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 61961A00E6 for ; Mon, 8 Jul 2019 07:32:12 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 243E54C8D; Mon, 8 Jul 2019 07:32:12 +0200 (CEST) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 8072E325F for ; Mon, 8 Jul 2019 07:32:10 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 07 Jul 2019 22:32:09 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.63,465,1557212400"; d="scan'208";a="363695545" Received: from npg-dpdk-project-yinanwang-1.sh.intel.com ([10.67.110.201]) by fmsmga005.fm.intel.com with ESMTP; 07 Jul 2019 22:32:08 -0700 From: Yinan To: dts@dpdk.org Cc: Wang Yinan Date: Sun, 7 Jul 2019 22:29:04 +0000 Message-Id: <20190707222904.93666-1-yinan.wang@intel.com> X-Mailer: git-send-email 2.17.1 Subject: [dts] [PATCH v1] test_plans: add test plan for virtio pvp regression test X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" From: Wang Yinan Signed-off-by: Wang Yinan --- .../virtio_pvp_regression_test_plan.rst | 276 ++++++++++++++++++ 1 file changed, 276 insertions(+) create mode 100644 test_plans/virtio_pvp_regression_test_plan.rst diff --git a/test_plans/virtio_pvp_regression_test_plan.rst b/test_plans/virtio_pvp_regression_test_plan.rst new file mode 100644 index 0000000..32374b0 --- /dev/null +++ b/test_plans/virtio_pvp_regression_test_plan.rst @@ -0,0 +1,276 @@ +.. Copyright (c) <2019>, Intel Corporation + All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + - Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + + - Redistributions in binary form must reproduce the above copyright + notice, this list of conditions and the following disclaimer in + the documentation and/or other materials provided with the + distribution. + + - Neither the name of Intel Corporation nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED + OF THE POSSIBILITY OF SUCH DAMAGE. + +========================================== +vhost/virtio-pmd qemu regression test plan +========================================== + +Add feature combind cases to capture regression issue: cover 2 queues + reconnect + multi qemu version + multi-paths with virtio1.0 and virtio0.95. + +Test flow +========= + +TG --> NIC --> Vhost --> Virtio--> Vhost --> NIC --> TG + +Test Case 1: pvp test with virtio 0.95 mergeable path +===================================================== + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=on,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. + +Test Case 2: pvp test with virtio 0.95 normal path +================================================== + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. + +Test Case 3: pvp test with virtio 0.95 vrctor_rx path +===================================================== + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 3 -- -i \ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. + +Test Case 4: pvp test with virtio 1.0 mergeable path +==================================================== + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=on,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. + +Test Case 5: pvp test with virtio 1.0 normal path +================================================= + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. + +Test Case 6: pvp test with virtio 1.0 vrctor_rx path +==================================================== + +1. Bind one port to igb_uio, then launch testpmd by below command:: + + rm -rf vhost-net* + ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \ + --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0:: + + qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \ + -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \ + -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \ + -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \ + -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \ + -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \ + -chardev socket,id=char0,path=./vhost-net,server \ + -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \ + -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \ + -vnc :10 + +3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads:: + + ./testpmd -c 0x7 -n 3 -- -i \ + --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024 + testpmd>set fwd mac + testpmd>start + +4. Send 64B and 1518B packets by packet generator separately, show throughput with below command:: + + testpmd>show port stats all + +5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue. + +6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue. \ No newline at end of file -- 2.17.1