From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 66C3AA00E6 for ; Mon, 15 Apr 2019 03:36:31 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 413965B3A; Mon, 15 Apr 2019 03:36:31 +0200 (CEST) Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by dpdk.org (Postfix) with ESMTP id F3E8B5B38 for ; Mon, 15 Apr 2019 03:36:29 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga007.fm.intel.com ([10.253.24.52]) by orsmga103.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 14 Apr 2019 18:36:28 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.60,351,1549958400"; d="scan'208";a="142968578" Received: from fmsmsx108.amr.corp.intel.com ([10.18.124.206]) by fmsmga007.fm.intel.com with ESMTP; 14 Apr 2019 18:36:28 -0700 Received: from fmsmsx122.amr.corp.intel.com (10.18.125.37) by FMSMSX108.amr.corp.intel.com (10.18.124.206) with Microsoft SMTP Server (TLS) id 14.3.408.0; Sun, 14 Apr 2019 18:36:28 -0700 Received: from shsmsx103.ccr.corp.intel.com (10.239.4.69) by fmsmsx122.amr.corp.intel.com (10.18.125.37) with Microsoft SMTP Server (TLS) id 14.3.408.0; Sun, 14 Apr 2019 18:36:27 -0700 Received: from shsmsx104.ccr.corp.intel.com ([169.254.5.92]) by SHSMSX103.ccr.corp.intel.com ([169.254.4.93]) with mapi id 14.03.0415.000; Mon, 15 Apr 2019 09:36:26 +0800 From: "Wang, Yinan" To: "Ma, LihongX" , "dts@dpdk.org" Thread-Topic: [dts][PATCH V2] Add testsuite of pvp virtio user multi queues Thread-Index: AQHU8PPX3+Ju+a7780u2hvDF6zzDp6Y8dVJA Date: Mon, 15 Apr 2019 01:36:24 +0000 Message-ID: References: <1555021937-3159-1-git-send-email-lihongx.ma@intel.com> In-Reply-To: <1555021937-3159-1-git-send-email-lihongx.ma@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiNGVhNWNhYWMtMTYyMC00ZDI3LTlkNWUtNzM4ZWEyOTBjNWE3IiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiSXZWNU1HSGJRVmVRZlUyV1owNVd6cGlhR1lHN2w2S2FDM1d6WEVVWDlEUnZ0Y0I4ZWlEVnIyVVZhM2JtXC8zcVMifQ== x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.600.7 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH V2] Add testsuite of pvp virtio user multi queues X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Acked-by: Wang, Yinan > -----Original Message----- > From: Ma, LihongX > Sent: 2019=1B$BG/=1B(B4=1B$B7n=1B(B12=1B$BF|=1B(B 6:32 > To: dts@dpdk.org; Wang, Yinan > Cc: Ma, LihongX > Subject: [dts][PATCH V2] Add testsuite of pvp virtio user multi queues >=20 > Signed-off-by: lihong > --- > tests/TestSuite_pvp_virtio_user_multi_queues.py | 305 > ++++++++++++++++++++++++ > 1 file changed, 305 insertions(+) > create mode 100644 tests/TestSuite_pvp_virtio_user_multi_queues.py >=20 > diff --git a/tests/TestSuite_pvp_virtio_user_multi_queues.py > b/tests/TestSuite_pvp_virtio_user_multi_queues.py > new file mode 100644 > index 0000000..ebe65ba > --- /dev/null > +++ b/tests/TestSuite_pvp_virtio_user_multi_queues.py > @@ -0,0 +1,305 @@ > +# BSD LICENSE > +# > +# Copyright(c) 2010-2019 Intel Corporation. All rights reserved. > +# All rights reserved. > +# > +# Redistribution and use in source and binary forms, with or without # > +modification, are permitted provided that the following conditions # > +are met: > +# > +# * Redistributions of source code must retain the above copyright > +# notice, this list of conditions and the following disclaimer. > +# * Redistributions in binary form must reproduce the above copyright > +# notice, this list of conditions and the following disclaimer in > +# the documentation and/or other materials provided with the > +# distribution. > +# * Neither the name of Intel Corporation nor the names of its > +# contributors may be used to endorse or promote products derived > +# from this software without specific prior written permission. > +# > +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS # > +"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT # > +LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS > FOR # > +A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT # > +OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, # > +SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT > # > +LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF > USE, # > +DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND > ON ANY # > +THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT # > +(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE > USE # > +OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. > + > +""" > +DPDK Test suite. > +Test vhost/virtio-user loopback multi-queues on 8 tx/rx path. > +Includes Mergeable, Normal, Vector_RX, Inorder mergeable, Inorder > +no-mergeable, Virtio 1.1 mergeable, Virtio 1.1 no-mergeable Path, > +Virtio 1.1 inorder no-mergeable Path. > +""" > + > +import utils > +import time > +import re > +from settings import HEADER_SIZE > +from test_case import TestCase > +from etgen import IxiaPacketGenerator > + > + > +class TestPVPVirtioMultiQueues(TestCase, IxiaPacketGenerator): > + > + def set_up_all(self): > + """ > + Run at the start of each test suite. > + """ > + > self.tester.extend_external_packet_generator(TestPVPVirtioMultiQueues, se= lf) > + self.frame_sizes =3D [64, 128, 256, 512, 1024, 1518] > + self.core_config =3D "1S/6C/1T" > + self.queue_number =3D 2 > + self.port_number =3D 2 > + self.dut_ports =3D self.dut.get_ports() > + self.verify(len(self.dut_ports) >=3D 1, "Insufficient ports for = testing") > + self.ports_socket =3D self.dut.get_numa_id(self.dut_ports[0]) > + self.cores_num =3D len([n for n in self.dut.cores if int(n['sock= et']) > + =3D=3D self.ports_socket]) > + self.verify(self.cores_num >=3D 6, > + "There has not enought cores to test this case") > + self.headers_size =3D HEADER_SIZE['eth'] + HEADER_SIZE['ip'] + \ > + HEADER_SIZE['udp'] > + self.core_list =3D self.dut.get_core_list( > + self.core_config, socket=3Dself.ports_socket) > + self.core_list_user =3D self.core_list[0:3] > + self.core_list_host =3D self.core_list[3:6] > + self.core_mask_user =3D utils.create_mask(self.core_list_user) > + self.core_mask_host =3D utils.create_mask(self.core_list_host) > + self.dst_mac =3D self.dut.get_mac_address(self.dut_ports[0]) > + > + self.logger.info("you can config packet_size in file %s.cfg," % > self.suite_name + \ > + "in region 'suite' like packet_sizes=3D[64, 128, > 256]") > + # get the frame_sizes from cfg file > + if 'packet_sizes' in self.get_suite_cfg(): > + self.frame_sizes =3D self.get_suite_cfg()['packet_sizes'] > + > + def set_up(self): > + """ > + Run before each test case. > + """ > + # Prepare the result table > + self.dut.send_expect("rm -rf ./vhost-net*", "#") > + self.dut.send_expect("killall -s INT testpmd", "#") > + self.table_header =3D ["Frame", "Mode", "Throughput(Mpps)", "% > linerate"] > + self.result_table_create(self.table_header) > + > + self.vhost_user =3D self.dut.new_session(suite=3D"vhost-user") > + self.virtio_user =3D self.dut.new_session(suite=3D"virtio-user") > + > + def ip(self, port, frag, src, proto, tos, dst, chksum, len, options,= version, > flags, ihl, ttl, id): > + """ > + Configure IP protocol. > + """ > + self.add_tcl_cmd("protocol config -name ip") > + self.add_tcl_cmd('ip config -sourceIpAddr "%s"' % src) > + self.add_tcl_cmd('ip config -destIpAddrMode ipRandom') > + self.add_tcl_cmd("ip config -ttl %d" % ttl) > + self.add_tcl_cmd("ip config -totalLength %d" % len) > + self.add_tcl_cmd("ip config -fragment %d" % frag) > + self.add_tcl_cmd("ip config -ipProtocol %d" % proto) > + self.add_tcl_cmd("ip config -identifier %d" % id) > + self.add_tcl_cmd("stream config -framesize %d" % (len + 18)) > + self.add_tcl_cmd("ip set %d %d %d" % (self.chasId, > + port['card'], port['port'])) > + > + def start_vhost_testpmd(self): > + """ > + start testpmd on vhost > + """ > + command_line_client =3D self.dut.target + "/app/testpmd -n %d -c= %s > --socket-mem 1024,1024" + \ > + " --legacy-mem --file-prefix=3Dvhost --vde= v > " + \ > + > "'net_vhost0,iface=3Dvhost-net,queues=3D2,client=3D0' -- -i --nb-cores=3D= 2 " + \ > + "--rxq=3D2 --txq=3D2 --rss-ip" > + command_line_client =3D command_line_client % ( > + self.dut.get_memory_channels(), self.core_mask_host) > + self.vhost_user.send_expect(command_line_client, "testpmd> ", > 120) > + self.vhost_user.send_expect("set fwd mac", "testpmd> ", 120) > + self.vhost_user.send_expect("start", "testpmd> ", 120) > + > + def start_virtio_testpmd(self, args): > + """ > + start testpmd on virtio > + """ > + command_line_user =3D self.dut.target + "/app/testpmd -n %d -c %= s " > + \ > + " --socket-mem 1024,1024 --legacy-mem > --no-pci --file-prefix=3Dvirtio " + \ > + > "--vdev=3Dnet_virtio_user0,mac=3D00:01:02:03:04:05,path=3D./vhost-net,que= ues=3D2, > %s " + \ > + "-- -i %s --rss-ip --nb-cores=3D2 --rxq=3D2 > --txq=3D2" > + command_line_user =3D command_line_user % ( > + self.dut.get_memory_channels(), self.core_mask_user, > + args["version"], args["path"]) > + self.virtio_user.send_expect(command_line_user, "testpmd> ", 120= ) > + self.virtio_user.send_expect("set fwd mac", "testpmd> ", 120) > + self.virtio_user.send_expect("start", "testpmd> ", 120) > + > + def update_result_table(self, frame_size, case_info, Mpps, throughpu= t): > + results_row =3D [frame_size] > + results_row.append(case_info) > + results_row.append(Mpps) > + results_row.append(throughput) > + self.result_table_add(results_row) > + > + def check_packets_of_each_queue(self, frame_size): > + """ > + check each queue has receive packets > + """ > + out =3D self.vhost_user.send_expect("stop", "testpmd> ", 60) > + for port_index in range(0, self.port_number): > + for queue_index in range(0, self.queue_number): > + queue_info =3D > re.findall("RX\s*Port=3D\s*%d/Queue=3D\s*%d" % > + (port_index, queue_index), out) > + queue =3D queue_info[0] > + index =3D out.find(queue) > + rx =3D re.search("RX-packets:\s*(\d*)", out[index:]) > + tx =3D re.search("TX-packets:\s*(\d*)", out[index:]) > + rx_packets =3D int(rx.group(1)) > + tx_packets =3D int(tx.group(1)) > + self.verify(rx_packets > 0 and tx_packets > 0, > + "The queue %d rx-packets or tx-packets is 0 about > " % > + queue_index + \ > + "frame_size:%d, rx-packets:%d, tx-packets:%d" % > + (frame_size, rx_packets, tx_packets)) > + > + self.vhost_user.send_expect("start", "testpmd> ", 60) > + > + def send_and_verify(self, case_info): > + """ > + start to send packets and calculate avg throughput > + """ > + for frame_size in self.frame_sizes: > + payload_size =3D frame_size - self.headers_size > + tgen_input =3D [] > + port =3D self.tester.get_local_port(self.dut_ports[0]) > + > self.tester.scapy_append('a=3D[Ether(dst=3D"%s")/IP(src=3D"0.240.74.101",= proto=3D25 > 5)/UDP()/("X"*%d)]' % (self.dst_mac, payload_size)) > + self.tester.scapy_append('wrpcap("multiqueue.pcap", a)') > + self.tester.scapy_execute() > + > + tgen_input.append((port, port, "multiqueue.pcap")) > + _, pps =3D self.tester.traffic_generator_throughput(tgen_inp= ut) > + Mpps =3D pps / 1000000.0 > + self.verify(Mpps > 0, "can not receive packets of frame > size %d" % (frame_size)) > + throughput =3D Mpps * 100 / \ > + float(self.wirespeed(self.nic, frame_size, 1)) > + > + self.update_result_table(frame_size, case_info, Mpps, > throughput) > + self.check_packets_of_each_queue(frame_size) > + self.result_table_print() > + > + def close_all_testpmd(self): > + """ > + close all testpmd of vhost and virtio > + """ > + self.vhost_user.send_expect("quit", "#", 60) > + self.virtio_user.send_expect("quit", "#", 60) > + > + def close_all_session(self): > + """ > + close all session of vhost and vhost-user > + """ > + self.dut.close_session(self.virtio_user) > + self.dut.close_session(self.vhost_user) > + > + def test_perf_pvp_viritouser_multi_queue_virtio11_mergeable(self): > + """ > + performance for Vhost PVP virtio 1.1 Mergeable Path. > + """ > + virtio_pmd_arg =3D {"version": > "in_order=3D0,packed_vq=3D1,mrg_rxbuf=3D1", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virtio_1.1 mergeable on") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_virtio11_normal(self): > + """ > + performance for Vhost PVP virtio1.1 Normal Path. > + """ > + virtio_pmd_arg =3D {"version": > "in_order=3D0,packed_vq=3D1,mrg_rxbuf=3D0", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virtio_1.1 mergeable off") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_virtio11_inorder(self): > + """ > + performance for Vhost PVP virtio1.1 inorder Path. > + """ > + virtio_pmd_arg =3D {"version": > "in_order=3D1,packed_vq=3D1,mrg_rxbuf=3D0", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virtio_1.1 inorder") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_inorder_mergeable(self): > + """ > + performance for Vhost PVP In_order mergeable Path. > + """ > + virtio_pmd_arg =3D {"version": > "packed_vq=3D0,in_order=3D1,mrg_rxbuf=3D1", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("inoder mergeable on") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_inorder_no_mergeable(self): > + """ > + performance for Vhost PVP In_order no_mergeable Path. > + """ > + virtio_pmd_arg =3D {"version": > "packed_vq=3D0,in_order=3D1,mrg_rxbuf=3D0", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("inoder mergeable off") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_mulit_queue_mergeable(self): > + """ > + performance for Vhost PVP Mergeable Path. > + """ > + virtio_pmd_arg =3D {"version": > "packed_vq=3D0,in_order=3D0,mrg_rxbuf=3D1", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virito mergeable") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_normal(self): > + """ > + performance for Vhost PVP Normal Path. > + """ > + virtio_pmd_arg =3D {"version": > "packed_vq=3D0,in_order=3D0,mrg_rxbuf=3D0", > + "path": "--tx-offloads=3D0x0 > --enable-hw-vlan-strip"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virtio normal") > + self.close_all_testpmd() > + > + def test_perf_pvp_viritouser_multi_queue_vector_rx(self): > + """ > + performance for Vhost PVP Vector_RX Path > + """ > + virtio_pmd_arg =3D {"version": > "packed_vq=3D0,in_order=3D0,mrg_rxbuf=3D0", > + "path": "--tx-offloads=3D0x0"} > + self.start_vhost_testpmd() > + self.start_virtio_testpmd(virtio_pmd_arg) > + self.send_and_verify("virito vector rx") > + self.close_all_testpmd() > + > + def tear_down(self): > + """ > + Run after each test case. > + """ > + self.dut.send_expect("killall -s INT testpmd", "#") > + self.close_all_session() > + > + def tear_down_all(self): > + """ > + Run after each test suite. > + """ > + pass > -- > 2.7.4