From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 6FD4E1B4D3 for ; Thu, 10 Jan 2019 06:49:02 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga003.jf.intel.com ([10.7.209.27]) by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Jan 2019 21:49:01 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.56,460,1539673200"; d="scan'208";a="116963308" Received: from fmsmsx108.amr.corp.intel.com ([10.18.124.206]) by orsmga003.jf.intel.com with ESMTP; 09 Jan 2019 21:49:01 -0800 Received: from fmsmsx113.amr.corp.intel.com (10.18.116.7) by FMSMSX108.amr.corp.intel.com (10.18.124.206) with Microsoft SMTP Server (TLS) id 14.3.408.0; Wed, 9 Jan 2019 21:49:00 -0800 Received: from shsmsx104.ccr.corp.intel.com (10.239.4.70) by FMSMSX113.amr.corp.intel.com (10.18.116.7) with Microsoft SMTP Server (TLS) id 14.3.408.0; Wed, 9 Jan 2019 21:49:00 -0800 Received: from shsmsx102.ccr.corp.intel.com ([169.254.2.63]) by SHSMSX104.ccr.corp.intel.com ([169.254.5.159]) with mapi id 14.03.0415.000; Thu, 10 Jan 2019 13:48:58 +0800 From: "Yao, Lei A" To: "Wang, Yinan" , "dts@dpdk.org" CC: "Wang, Yinan" Thread-Topic: [dts] [PATCH v2] test_plans/loopback_multi_paths_port_restart_performance: add test plan of Loopback multi-paths and port start Thread-Index: AQHUqKRxunKNNf9S3U+PYIPIfY9Kd6Wn/VOg Date: Thu, 10 Jan 2019 05:48:57 +0000 Message-ID: <2DBBFF226F7CF64BAFCA79B681719D954960A36D@shsmsx102.ccr.corp.intel.com> References: <20190109222010.104965-1-yinan.wang@intel.com> In-Reply-To: <20190109222010.104965-1-yinan.wang@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiZDQyZThlNmYtOGQzNi00NDZlLTg4YTYtZThkZjE4NDdhYjRmIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiMTlNNlwvYnhDcWFYUXNWYjMzZENybG9HXC80Wm9cL1NIbDVJeDhMaUNvOTBYWEpFUmNrbTVYcWhEakUyUmxXNStYRyJ9 x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.400.15 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH v2] test_plans/loopback_multi_paths_port_restart_performance: add test plan of Loopback multi-paths and port start X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Jan 2019 05:49:03 -0000 > -----Original Message----- > From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of Yinan > Sent: Thursday, January 10, 2019 6:20 AM > To: dts@dpdk.org > Cc: Wang, Yinan > Subject: [dts] [PATCH v2] > test_plans/loopback_multi_paths_port_restart_performance: add test plan > of Loopback multi-paths and port start >=20 > From: Wang Yinan >=20 > Signed-off-by: Wang Yinan > --- > ...ths_port_restart_performance_test_plan.rst | 310 > ++++++++++++++++++ > 1 file changed, 310 insertions(+) > create mode 100644 > test_plans/loopback_multi_paths_port_restart_performance_test_plan.rst >=20 > diff --git > a/test_plans/loopback_multi_paths_port_restart_performance_test_plan.r > st > b/test_plans/loopback_multi_paths_port_restart_performance_test_plan.r > st > new file mode 100644 > index 0000000..aa825cb > --- /dev/null > +++ > b/test_plans/loopback_multi_paths_port_restart_performance_test_plan.r > st > @@ -0,0 +1,310 @@ > +.. Copyright (c) <2010-2017>, Intel Corporation > + All rights reserved. > + > + Redistribution and use in source and binary forms, with or without > + modification, are permitted provided that the following conditions > + are met: > + > + - Redistributions of source code must retain the above copyright > + notice, this list of conditions and the following disclaimer. > + > + - Redistributions in binary form must reproduce the above copyright > + notice, this list of conditions and the following disclaimer in > + the documentation and/or other materials provided with the > + distribution. > + > + - Neither the name of Intel Corporation nor the names of its > + contributors may be used to endorse or promote products derived > + from this software without specific prior written permission. > + > + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS > + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, > INDIRECT, > + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES > + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE > GOODS OR > + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) > + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN > CONTRACT, > + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) > + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF > ADVISED > + OF THE POSSIBILITY OF SUCH DAMAGE. > + > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > +Loopback multi-paths and port restart Tests > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D The Title of this test suite should include "vhost/virtio" > + > + > +Description > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +Benchmark vhost/virtio-user loopback performance for 7 RX/TX PATHs. > +Includes Mergeable, Normal, Vector_RX,Inorder_mergeable, > +Inorder_no_mergeable, VIRTIO1.1_mergeable, VIRTIO1.1_normal Path. > +Also cover port restart test with each path. > + > +Test Case 1: vhost/virtio-user Loopback Virtio 1.1 mergeable path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D Suggest change to "vhost/virtio-user loopback test with Virtio 1.1 mergeabl= e path" > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. This step isn't necessary > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ remove x86_64-native-linuxapp-gcc, this is X86 specific > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,packed_vq=3D1,mrg_rxbuf=3D1 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size Add [] for frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 2: vhost/virtio-user Loopback Virtio 1.1 no-mergeable path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. The same as Test Case1, remove > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,packed_vq=3D1,mrg_rxbuf=3D0 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 3: vhost/virtio-user Loopback In-order mergeable path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,in_order=3D1,mrg_rxbuf=3D1 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 4: vhost/virtio-user Loopback In-order no-mergeable path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,in_order=3D1,mrg_rxbuf=3D0 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 5: vhost/virtio-user Loopback Mergeable path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,in_order=3D0,mrg_rxbuf=3D1 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 6: vhost/virtio-user Loopback Normal path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,in_order=3D0,mrg_rxbuf=3D0 \ > + -- -i --tx-offloads=3D0x0 --enable-hw-vlan-strip --rss-ip --nb-cores= =3D1 -- > txd=3D1024 --rxd=3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > + > +Test Case 7: vhost/virtio-user Loopback Vector_RX path > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Modify TX packet size of the testpmd to frame_size, then re-compile t= he > DPDK. > + > +2. Not bind nic port to igb_uio, launch vhost testpmd by below command:: > + > + rm -rf vhost-net* > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 2-4 --socket-mem > 1024,1024 --legacy-mem \ > + --file-prefix=3Dvhost --vdev 'net_vhost0,iface=3Dvhost- > net,queues=3D1,client=3D0' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 > + >set fwd mac > + > +3. Launch virtio-user by below command:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -n 4 -l 5-6 --socket-mem > 1024,1024 \ > + --legacy-mem --no-pci --file-prefix=3Dvirtio \ > + --vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost- > net,in_order=3D0,mrg_rxbuf=3D0 \ > + -- -i --tx-offloads=3D0x0 --rss-ip --nb-cores=3D1 --txd=3D1024 --rxd= =3D1024 > + >set fwd mac > + >start > + > +4. Send packets with vhost-testpmd:: > + > + testpmd>set txpkts frame_size > + testpmd>start tx_first 32 > + testpmd>start > + > +5. Get throughput 10 times and calculate the average throughput:: > + > + testpmd>show port stats all > + > +6. Port restart by below command and re-calculate the average througnput= :: > + > + testpmd>stop > + testpmd>clear port stats all > + testpmd>start > + testpmd>show port stats all > \ No newline at end of file > -- > 2.17.1