From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 63207A05D3 for ; Mon, 22 Apr 2019 10:33:56 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 2897B1B432; Mon, 22 Apr 2019 10:33:56 +0200 (CEST) Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by dpdk.org (Postfix) with ESMTP id 6395C1B206 for ; Mon, 22 Apr 2019 10:33:54 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga104.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 22 Apr 2019 01:33:53 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.60,381,1549958400"; d="scan'208";a="317907403" Received: from npg-dpdk-project-yinanwang-1.sh.intel.com ([10.67.110.176]) by orsmga005.jf.intel.com with ESMTP; 22 Apr 2019 01:33:51 -0700 From: Yinan To: dts@dpdk.org Cc: Wang Yinan Date: Mon, 22 Apr 2019 01:31:28 +0000 Message-Id: <20190422013128.27858-1-yinan.wang@intel.com> X-Mailer: git-send-email 2.17.1 Subject: [dts] [PATCH v2] test_plans/loopback_multi_paths_port_restart: add test plan for loopback multi path port restart test X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" From: Wang Yinan Signed-off-by: Wang Yinan --- ...ack_multi_paths_port_restart_test_plan.rst | 194 ++++++++++++------ 1 file changed, 127 insertions(+), 67 deletions(-) diff --git a/test_plans/loopback_multi_paths_port_restart_test_plan.rst b/test_plans/loopback_multi_paths_port_restart_test_plan.rst index 115a5e8..e7ec1df 100644 --- a/test_plans/loopback_multi_paths_port_restart_test_plan.rst +++ b/test_plans/loopback_multi_paths_port_restart_test_plan.rst @@ -30,35 +30,33 @@ ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. -=========================================== -Loopback multi-paths and port restart Tests -=========================================== +================================================================= +vhost/virtio loopback with multi-paths and port restart test plan +================================================================= Description =========== -Benchmark vhost/virtio-user loopback test with 7 RX/TX PATHs. -Includes Mergeable, Normal, Vector_RX, Inorder mergeable, -Inorder no-mergeable, Virtio 1.1 mergeable, Virtio 1.1 no-mergeable Path. +Benchmark vhost/virtio-user loopback test with 8 rx/tx paths. +Includes mergeable, normal, vector_rx, inorder mergeable, +inorder no-mergeable, virtio 1.1 mergeable, virtio 1.1 inorder, virtio 1.1 normal path. Also cover port restart test with each path. - - -Test Case 1:loopback test with Virtio 1.1 mergeable path -=========================================================================== +Test Case 1: loopback test with virtio 1.1 mergeable path +========================================================= 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \ --legacy-mem --no-pci --file-prefix=virtio \ - --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=1 \ + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=1,in_order=0 \ -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --txd=1024 --rxd=1024 >set fwd mac >start @@ -67,71 +65,118 @@ Test Case 1:loopback test with Virtio 1.1 mergeable path testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Repeat below command to get throughput 10 times,then calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 testpmd>show port stats all +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: -Test Case 2: loopback test with Virtio 1.1 no-mergeable path -=========================================================================== + testpmd>port start 0 + testpmd>start tx_first 32 + testpmd>show port stats all + +Test Case 2: loopback test with virtio 1.1 normal path +====================================================== 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \ --legacy-mem --no-pci --file-prefix=virtio \ - --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=0 \ + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=0,in_order=0 \ -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --txd=1024 --rxd=1024 >set fwd mac >start -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 testpmd>show port stats all -Test Case 3: loopback test with Inorder mergeable path -=========================================================================== +Test Case 3: loopback test with virtio 1.1 inorder path +======================================================= 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 + testpmd>set fwd mac + +2. Launch virtio-user by below command:: + + ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \ + --legacy-mem --no-pci --file-prefix=virtio \ + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,in_order=1,mrg_rxbuf=0 \ + -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --txd=1024 --rxd=1024 >set fwd mac + >start + +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: + + testpmd>set txpkts [frame_size] + testpmd>start tx_first 32 + +4. Get throughput 10 times and calculate the average throughput:: + + testpmd>show port stats all + +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: + + testpmd>stop + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 + testpmd>show port stats all + +Test Case 4: loopback test with inorder mergeable path +====================================================== + +1. Launch vhost by below command:: + + rm -rf vhost-net* + ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ + --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 + testpmd>set fwd mac 2. Launch virtio-user by below command:: ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \ --legacy-mem --no-pci --file-prefix=virtio \ - --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_order=1 \ + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_order=1,mrg_rxbuf=1 \ -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --txd=1024 --rxd=1024 >set fwd mac >start @@ -140,28 +185,32 @@ Test Case 3: loopback test with Inorder mergeable path testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 testpmd>show port stats all -Test Case 4: loopback test with Inorder no-mergeable path -=========================================================================== +Test Case 5: loopback test with inorder no-mergeable path +========================================================= 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: @@ -172,32 +221,36 @@ Test Case 4: loopback test with Inorder no-mergeable path >set fwd mac >start -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 testpmd>show port stats all -Test Case 5: loopback test with Mergeable path -=========================================================================== +Test Case 6: loopback test with mergeable path +============================================== 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: @@ -208,37 +261,36 @@ Test Case 5: loopback test with Mergeable path >set fwd mac >start -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart 100 times by below command and re-calculate the average througnput:: +5. Port restart at vhost side 100 times and re-calculate the average throughput, verify the throughput is not zero after port restart:: testpmd>stop - testpmd>start + testpmd>port stop 0 + testpmd>port start 0 ... testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 + testpmd>port start 0 + testpmd>start tx_first 32 testpmd>show port stats all - - -Test Case 6: loopback test with Normal path -=========================================================================== +Test Case 7: loopback test with normal path +=========================================== 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: @@ -253,28 +305,32 @@ Test Case 6: loopback test with Normal path testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 testpmd>show port stats all -Test Case 7: loopback test with Vector_RX path -=========================================================================== +Test Case 8: loopback test with vector_rx path +============================================== 1. Launch vhost by below command:: rm -rf vhost-net* ./testpmd -n 4 -l 2-4 --socket-mem 1024,1024 --legacy-mem --no-pci \ --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -- -i --nb-cores=1 --txd=1024 --rxd=1024 - >set fwd mac + testpmd>set fwd mac 2. Launch virtio-user by below command:: @@ -285,19 +341,23 @@ Test Case 7: loopback test with Vector_RX path >set fwd mac >start -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs in [64, 128, 256, 512, 1024, 1518]:: testpmd>set txpkts [frame_size] testpmd>start tx_first 32 - testpmd>start 4. Get throughput 10 times and calculate the average throughput:: testpmd>show port stats all -5. Port restart by below command and re-calculate the average througnput:: +5. Stop port at vhost side and re-calculate the average throughput, verify the throughput is zero after port stop:: testpmd>stop - testpmd>clear port stats all - testpmd>start - testpmd>show port stats all \ No newline at end of file + testpmd>port stop 0 + testpmd>show port stats all + +6. Restart port at vhost side and re-calculate the average throughput, verify the throughput is not zero after port restart:: + + testpmd>port start 0 + testpmd>start tx_first 32 + testpmd>show port stats all -- 2.17.1