From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id DD8AFA00E6 for ; Wed, 10 Jul 2019 09:20:20 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id CA8391DBA; Wed, 10 Jul 2019 09:20:20 +0200 (CEST) Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by dpdk.org (Postfix) with ESMTP id 18C5E3DC for ; Wed, 10 Jul 2019 09:20:18 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga102.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 10 Jul 2019 00:20:17 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.63,473,1557212400"; d="scan'208";a="168229408" Received: from fmsmsx103.amr.corp.intel.com ([10.18.124.201]) by orsmga003.jf.intel.com with ESMTP; 10 Jul 2019 00:20:15 -0700 Received: from fmsmsx609.amr.corp.intel.com (10.18.126.89) by FMSMSX103.amr.corp.intel.com (10.18.124.201) with Microsoft SMTP Server (TLS) id 14.3.439.0; Wed, 10 Jul 2019 00:19:10 -0700 Received: from fmsmsx609.amr.corp.intel.com (10.18.126.89) by fmsmsx609.amr.corp.intel.com (10.18.126.89) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Wed, 10 Jul 2019 00:19:08 -0700 Received: from shsmsx107.ccr.corp.intel.com (10.239.4.96) by fmsmsx609.amr.corp.intel.com (10.18.126.89) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1713.5 via Frontend Transport; Wed, 10 Jul 2019 00:19:07 -0700 Received: from shsmsx101.ccr.corp.intel.com ([169.254.1.134]) by SHSMSX107.ccr.corp.intel.com ([169.254.9.162]) with mapi id 14.03.0439.000; Wed, 10 Jul 2019 15:19:06 +0800 From: "Tu, Lijuan" To: "Ma, LihongX" , "dts@dpdk.org" CC: "Wang, Yinan" , "Ma, LihongX" Thread-Topic: [dts] [PATCH V2 2/2][virtio container] tests: add testsuite virtio user for container Thread-Index: AQHVLLYSzOTIVN67E0W0ROaecjWrNqbDhgww Date: Wed, 10 Jul 2019 07:19:05 +0000 Message-ID: <8CE3E05A3F976642AAB0F4675D0AD20E0BADECEE@SHSMSX101.ccr.corp.intel.com> References: <1561592326-2619-1-git-send-email-lihongx.ma@intel.com> <1561592326-2619-2-git-send-email-lihongx.ma@intel.com> In-Reply-To: <1561592326-2619-2-git-send-email-lihongx.ma@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.0.600.7 dlp-reaction: no-action x-ctpclassification: CTP_NT x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiOWYyOGE3YmItY2IzZi00ZTBkLWI0ZDItOGU4Y2RjNDBiMzk3IiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiUm4ySE1sK0k4QTBQbFFFMjBXT1NJU3FBTDZLc1lxTDFyK3ZpM1JNR0ZCckdSYjRxbDV5RHh3N3BZZTliR3NxTyJ9 x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH V2 2/2][virtio container] tests: add testsuite virtio user for container X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Applied, thanks > -----Original Message----- > From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of lihong > Sent: Thursday, June 27, 2019 7:39 AM > To: dts@dpdk.org > Cc: Wang, Yinan ; Ma, LihongX > > Subject: [dts] [PATCH V2 2/2][virtio container] tests: add testsuite virt= io user > for container >=20 > Signed-off-by: lihong > --- > ...stSuite_virtio_user_for_container_networking.py | 210 > +++++++++++++++++++++ > 1 file changed, 210 insertions(+) > create mode 100644 > tests/TestSuite_virtio_user_for_container_networking.py >=20 > diff --git a/tests/TestSuite_virtio_user_for_container_networking.py > b/tests/TestSuite_virtio_user_for_container_networking.py > new file mode 100644 > index 0000000..c914a88 > --- /dev/null > +++ b/tests/TestSuite_virtio_user_for_container_networking.py > @@ -0,0 +1,210 @@ > +# BSD LICENSE > +# > +# Copyright(c) <2019> Intel Corporation. > +# All rights reserved. > +# > +# Redistribution and use in source and binary forms, with or without # > +modification, are permitted provided that the following conditions # > +are met: > +# > +# * Redistributions of source code must retain the above copyright > +# notice, this list of conditions and the following disclaimer. > +# * Redistributions in binary form must reproduce the above copyright > +# notice, this list of conditions and the following disclaimer in > +# the documentation and/or other materials provided with the > +# distribution. > +# * Neither the name of Intel Corporation nor the names of its > +# contributors may be used to endorse or promote products derived > +# from this software without specific prior written permission. > +# > +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS # > +"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT # > +LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS > FOR # > +A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT # > +OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, # > +SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT > # > +LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF > USE, # > +DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND > ON ANY # > +THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT # > +(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE > USE # > +OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. > + > +""" > +DPDK Test suite. > +Virtio user for container networking > +""" > + > +import utils > +import time > +from test_case import TestCase > +from settings import HEADER_SIZE > +from pktgen import PacketGeneratorHelper > + > + > +class TestVirtioUserForContainer(TestCase): > + > + def set_up_all(self): > + """ > + Run at the start of each test suite. > + """ > + self.frame_sizes =3D [64, 128, 256, 512, 1024, 1518] > + self.queue_number =3D 1 > + self.nb_cores =3D 1 > + self.dut_ports =3D self.dut.get_ports() > + self.mem_channels =3D self.dut.get_memory_channels() > + self.ports_socket =3D self.dut.get_numa_id(self.dut_ports[0]) > + self.cores_num =3D len([n for n in self.dut.cores if int(n['sock= et']) =3D=3D > + self.ports_socket]) > + self.verify(len(self.dut_ports) >=3D 1, 'Insufficient ports for = testing') > + self.headers_size =3D HEADER_SIZE['eth'] + HEADER_SIZE['ip'] + > + HEADER_SIZE['udp'] > + > + self.verify('docker_image' in self.get_suite_cfg(), > + 'Pls config docker image in the conf %s' % self.suite_na= me) > + self.docker_image =3D self.get_suite_cfg()['docker_image'] > + self.container_base_dir =3D self.dut.base_dir > + self.container_base_dir =3D self.container_base_dir.replace('~',= '/root') > + self.logger.info("You can config packet_size in file %s.cfg," % > self.suite_name + \ > + " in region 'suite' like packet_sizes=3D[64, 128= , 256]") > + if 'packet_sizes' in self.get_suite_cfg(): > + self.frame_sizes =3D self.get_suite_cfg()['packet_sizes'] > + # create an instance to set stream field setting > + self.pktgen_helper =3D PacketGeneratorHelper() > + > + def set_up(self): > + """ > + Run before each test case. > + """ > + self.dut.send_expect('rm -rf ./vhost-net*', '# ') > + self.dut.send_expect('killall -s INT testpmd', '# ') > + self.vhost_user =3D self.dut.new_session(suite=3D'vhost-user') > + self.virtio_user =3D self.dut.new_session(suite=3D'virtio-user') > + # Prepare the result table > + self.virtio_mac =3D '00:11:22:33:44:10' > + self.table_header =3D ['Frame'] > + self.table_header.append('Mode') > + self.table_header.append('Mpps') > + self.table_header.append('Queue Num') > + self.table_header.append('% linerate') > + self.result_table_create(self.table_header) > + > + def get_core_mask(self): > + core_config =3D '1S/%dC/1T' % (self.nb_cores*2 + 2) > + self.verify(self.cores_num >=3D (self.nb_cores*2 + 2), > + 'There has not enought cores to test this case %s' % > + self.running_case) > + core_list =3D self.dut.get_core_list( > + core_config, socket=3Dself.ports_socket) > + core_list_vhost_user =3D core_list[0:self.nb_cores+1] > + core_list_virtio_user =3D core_list[self.nb_cores+1:self.nb_core= s*2+2] > + self.core_mask_vhost_user =3D utils.create_mask(core_list_vhost_= user) > + self.core_mask_virtio_user =3D > + utils.create_mask(core_list_virtio_user) > + > + def send_and_verify(self): > + """ > + Send packet with packet generator and verify > + """ > + for frame_size in self.frame_sizes: > + payload_size =3D frame_size - self.headers_size > + tgen_input =3D [] > + rx_port =3D self.tester.get_local_port(self.dut_ports[0]) > + tx_port =3D self.tester.get_local_port(self.dut_ports[0]) > + self.tester.scapy_append( > + 'wrpcap("vhost.pcap", [Ether(dst=3D"%s")/IP()/UDP()/("X"= *%d)])' % > + (self.virtio_mac, payload_size)) > + tgen_input.append((tx_port, rx_port, "vhost.pcap")) > + > + self.tester.scapy_execute() > + self.tester.pktgen.clear_streams() > + streams =3D > self.pktgen_helper.prepare_stream_from_tginput(tgen_input, 100, > + None, self.tester.pktgen) > + _, pps =3D self.tester.pktgen.measure_throughput(stream_ids= =3Dstreams) > + Mpps =3D pps / 1000000.0 > + self.verify(Mpps > 0, '%s can not receive packets of frame s= ize %d' % > (self.running_case, frame_size)) > + throughput =3D Mpps * 100 / \ > + float(self.wirespeed(self.nic, frame_size, 1)) > + > + results_row =3D [frame_size] > + results_row.append('virtio in container') > + results_row.append(Mpps) > + results_row.append(self.queue_number) > + results_row.append(throughput) > + self.result_table_add(results_row) > + > + def launch_testpmd_as_vhost(self): > + """ > + start testpmd as vhost > + """ > + command_line_client =3D self.dut.target + '/app/testpmd ' + \ > + '-c %s -n %d --socket-mem 1024,1024 --file= -prefix=3Dvhost ' + > \ > + '--vdev "net_vhost0,iface=3Dvhost-net,queu= es=3D%d,client=3D0" ' > + \ > + '-- -i --nb-cores=3D%d' > + command_line_client =3D command_line_client % > (self.core_mask_vhost_user, > + self.mem_channels, self.queue_nu= mber, > + self.nb_cores) > + self.vhost_user.send_expect(command_line_client, 'testpmd> ', 30= ) > + self.vhost_user.send_expect('start', 'testpmd> ', 30) > + > + def launch_testpmd_as_virtio_in_container(self): > + """ > + start testpmd as virtio > + """ > + command_line_user =3D 'docker run -i -t --privileged -v %s/vhost= - > net:/tmp/vhost-net ' + \ > + '-v /mnt/huge:/dev/hugepages ' + \ > + '-v %s:%s %s .%s/%s/app/testpmd -c %s -n %d = ' + \ > + '-m 1024 --no-pci --file-prefix=3Dcontainer = ' + \ > + '-- > vdev=3Dvirtio_user0,mac=3D00:11:22:33:44:10,path=3D/tmp/vhost-net,queues= =3D%d ' > + \ > + '-- -i --rxq=3D%d --txq=3D%d --nb-cores=3D%d= ' > + command_line_user =3D command_line_user % (self.container_base_d= ir, > + self.container_base_dir, self.container_base_dir, self.docke= r_image, > + self.container_base_dir, self.dut.target, self.core_mask_vir= tio_user, > + self.mem_channels, self.queue_number, self.queue_number, > + self.queue_number, self.nb_cores) > + self.virtio_user.send_expect(command_line_user, 'testpmd> ', 120= ) > + self.virtio_user.send_expect('start', 'testpmd> ', 120) > + > + def close_all_apps(self): > + """ > + close testpmd and vhost-switch > + """ > + self.virtio_user.send_expect('quit', '# ', 60) > + self.vhost_user.send_expect('quit', '# ', 60) > + self.dut.close_session(self.vhost_user) > + self.dut.close_session(self.virtio_user) > + > + def test_perf_packet_fwd_for_container(self): > + """ > + packet forward test for container networking > + """ > + self.queue_number =3D 1 > + self.nb_cores =3D 1 > + self.get_core_mask() > + self.launch_testpmd_as_vhost() > + self.launch_testpmd_as_virtio_in_container() > + self.send_and_verify() > + self.result_table_print() > + self.close_all_apps() > + > + def test_perf_packet_fwd_with_multi_queues_for_container(self): > + """ > + packet forward with multi-queues for container networking > + """ > + self.queue_number =3D 2 > + self.nb_cores =3D 2 > + self.get_core_mask() > + self.launch_testpmd_as_vhost() > + self.launch_testpmd_as_virtio_in_container() > + self.send_and_verify() > + self.result_table_print() > + self.close_all_apps() > + > + def tear_down(self): > + """ > + Run after each test case. > + """ > + self.dut.send_expect('killall -s INT testpmd', '# ') > + > + def tear_down_all(self): > + """ > + Run after each test suite. > + """ > + pass > -- > 2.7.4