From: Yinan <yinan.wang@intel.com>
To: dts@dpdk.org
Cc: Wang Yinan <yinan.wang@intel.com>
Subject: [dts] [PATCH v1] test_plans: add test plan for virtio pvp regression test
Date: Sun, 7 Jul 2019 22:29:04 +0000 [thread overview]
Message-ID: <20190707222904.93666-1-yinan.wang@intel.com> (raw)
From: Wang Yinan <yinan.wang@intel.com>
Signed-off-by: Wang Yinan <yinan.wang@intel.com>
---
.../virtio_pvp_regression_test_plan.rst | 276 ++++++++++++++++++
1 file changed, 276 insertions(+)
create mode 100644 test_plans/virtio_pvp_regression_test_plan.rst
diff --git a/test_plans/virtio_pvp_regression_test_plan.rst b/test_plans/virtio_pvp_regression_test_plan.rst
new file mode 100644
index 0000000..32374b0
--- /dev/null
+++ b/test_plans/virtio_pvp_regression_test_plan.rst
@@ -0,0 +1,276 @@
+.. Copyright (c) <2019>, Intel Corporation
+ All rights reserved.
+
+ Redistribution and use in source and binary forms, with or without
+ modification, are permitted provided that the following conditions
+ are met:
+
+ - Redistributions of source code must retain the above copyright
+ notice, this list of conditions and the following disclaimer.
+
+ - Redistributions in binary form must reproduce the above copyright
+ notice, this list of conditions and the following disclaimer in
+ the documentation and/or other materials provided with the
+ distribution.
+
+ - Neither the name of Intel Corporation nor the names of its
+ contributors may be used to endorse or promote products derived
+ from this software without specific prior written permission.
+
+ THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+ "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+ LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
+ FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
+ COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
+ INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+ (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+ SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
+ HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
+ STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
+ ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
+ OF THE POSSIBILITY OF SUCH DAMAGE.
+
+==========================================
+vhost/virtio-pmd qemu regression test plan
+==========================================
+
+Add feature combind cases to capture regression issue: cover 2 queues + reconnect + multi qemu version + multi-paths with virtio1.0 and virtio0.95.
+
+Test flow
+=========
+
+TG --> NIC --> Vhost --> Virtio--> Vhost --> NIC --> TG
+
+Test Case 1: pvp test with virtio 0.95 mergeable path
+=====================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=on,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
+
+Test Case 2: pvp test with virtio 0.95 normal path
+==================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
+
+Test Case 3: pvp test with virtio 0.95 vrctor_rx path
+=====================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 3 -- -i \
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
+
+Test Case 4: pvp test with virtio 1.0 mergeable path
+====================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=on,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
+
+Test Case 5: pvp test with virtio 1.0 normal path
+=================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 4 -- -i --enable-hw-vlan-strip\
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
+
+Test Case 6: pvp test with virtio 1.0 vrctor_rx path
+====================================================
+
+1. Bind one port to igb_uio, then launch testpmd by below command::
+
+ rm -rf vhost-net*
+ ./testpmd -l 1-3 -n 4 --socket-mem 1024,1024 \
+ --vdev 'eth_vhost0,iface=vhost-net,queues=2,client=1' -- -i --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+2. Check dut machine already has installed different version qemu, includes [qemu_2.7, qemu_2.8, qemu_2.9, qemu_2.10, qemu_2.11, qemu_2.12, qemu_3.0], launch VM with different qemu version separately, note: we need add "disable-modern=false" to enable virtio 1.0::
+
+ qemu-system-x86_64 -name vm2 -enable-kvm -cpu host -smp 3 -m 4096 \
+ -object memory-backend-file,id=mem,size=4096M,mem-path=/mnt/huge,share=on \
+ -numa node,memdev=mem -mem-prealloc -drive file=/home/osimg/ubuntu16.img \
+ -chardev socket,path=/tmp/vm2_qga0.sock,server,nowait,id=vm2_qga0 -device virtio-serial \
+ -device virtserialport,chardev=vm2_qga0,name=org.qemu.guest_agent.2 -daemonize \
+ -monitor unix:/tmp/vm2_monitor.sock,server,nowait -net nic,vlan=2,macaddr=00:00:00:08:e8:aa,addr=1f -net user,vlan=2,hostfwd=tcp:127.0.0.1:6002-:22 \
+ -chardev socket,id=char0,path=./vhost-net,server \
+ -netdev type=vhost-user,id=netdev0,chardev=char0,vhostforce,queues=2 \
+ -device virtio-net-pci,netdev=netdev0,mac=52:54:00:00:00:01,disable-modern=false,mrg_rxbuf=off,rx_queue_size=1024,tx_queue_size=1024,mq=on,vectors=15 \
+ -vnc :10
+
+3. On VM, bind virtio net to igb_uio and run testpmd without tx-offloads::
+
+ ./testpmd -c 0x7 -n 3 -- -i \
+ --nb-cores=2 --rxq=2 --txq=2 --txd=1024 --rxd=1024
+ testpmd>set fwd mac
+ testpmd>start
+
+4. Send 64B and 1518B packets by packet generator separately, show throughput with below command::
+
+ testpmd>show port stats all
+
+5. Quit vhost-user, then re-launch, check if the reconnect can work and ensure the traffic can continue.
+
+6. Kill VM, then re-launch VM, check if the reconnect can work and ensure the traffic can continue.
\ No newline at end of file
--
2.17.1
next reply other threads:[~2019-07-08 5:32 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-07-07 22:29 Yinan [this message]
2019-07-10 5:44 ` Tu, Lijuan
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190707222904.93666-1-yinan.wang@intel.com \
--to=yinan.wang@intel.com \
--cc=dts@dpdk.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).