From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga18.intel.com (mga18.intel.com [134.134.136.126]) by dpdk.org (Postfix) with ESMTP id CC9671F28 for ; Mon, 25 Jun 2018 04:10:36 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga005.jf.intel.com ([10.7.209.41]) by orsmga106.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 24 Jun 2018 19:10:33 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,268,1526367600"; d="scan'208";a="235262816" Received: from fmsmsx108.amr.corp.intel.com ([10.18.124.206]) by orsmga005.jf.intel.com with ESMTP; 24 Jun 2018 19:10:33 -0700 Received: from fmsmsx101.amr.corp.intel.com (10.18.124.199) by FMSMSX108.amr.corp.intel.com (10.18.124.206) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 24 Jun 2018 19:10:33 -0700 Received: from shsmsx151.ccr.corp.intel.com (10.239.6.50) by fmsmsx101.amr.corp.intel.com (10.18.124.199) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 24 Jun 2018 19:10:32 -0700 Received: from shsmsx103.ccr.corp.intel.com ([169.254.4.51]) by SHSMSX151.ccr.corp.intel.com ([169.254.3.116]) with mapi id 14.03.0319.002; Mon, 25 Jun 2018 10:10:30 +0800 From: "Liu, Yong" To: "Peng, Yuan" , "dts@dpdk.org" CC: "Peng, Yuan" Thread-Topic: [dts] [PATCH v3] tests: Add TestSuite_runtime_queue_number.py Thread-Index: AQHUCQ35jAhXUiZFi0m0GE4Uim48SaRwQAeg Date: Mon, 25 Jun 2018 02:10:30 +0000 Message-ID: <86228AFD5BCD8E4EBFD2B90117B5E81E630C9254@SHSMSX103.ccr.corp.intel.com> References: <1529550904-62727-1-git-send-email-yuan.peng@intel.com> In-Reply-To: <1529550904-62727-1-git-send-email-yuan.peng@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiZjMzN2I0M2MtZjBmNC00YTYwLWFjZjctYjc2MWNmM2VhYTI2IiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoibU9FVXlWTHE3VG5EeUE3UWtZck1qd0YwUVBNOWdNVEJRXC9IYkgxQzFSUTdBNk9xdkJWc2ozWGVcL0xsNUNUbmtyIn0= x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.200.100 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH v3] tests: Add TestSuite_runtime_queue_number.py X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2018 02:10:37 -0000 Thanks, Yuan. Two comments are inline. > -----Original Message----- > From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of Peng Yuan > Sent: Thursday, June 21, 2018 11:15 AM > To: dts@dpdk.org > Cc: Peng, Yuan > Subject: [dts] [PATCH v3] tests: Add TestSuite_runtime_queue_number.py >=20 > Add automation tests: TestSuite_runtime_queue_number.py >=20 > Signed-off-by: Peng Yuan >=20 > diff --git a/tests/TestSuite_runtime_queue_number.py > b/tests/TestSuite_runtime_queue_number.py > new file mode 100644 > index 0000000..6cab9c0 > --- /dev/null > +++ b/tests/TestSuite_runtime_queue_number.py > @@ -0,0 +1,318 @@ > +# BSD LICENSE > +# > +# Copyright(c) 2010-2018 Intel Corporation. All rights reserved. > +# All rights reserved. > +# > +# Redistribution and use in source and binary forms, with or without > +# modification, are permitted provided that the following conditions > +# are met: > +# > +# * Redistributions of source code must retain the above copyright > +# notice, this list of conditions and the following disclaimer. > +# * Redistributions in binary form must reproduce the above copyright > +# notice, this list of conditions and the following disclaimer in > +# the documentation and/or other materials provided with the > +# distribution. > +# * Neither the name of Intel Corporation nor the names of its > +# contributors may be used to endorse or promote products derived > +# from this software without specific prior written permission. > +# > +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS > +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT > +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR > +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT > +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, > +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT > +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, > +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY > +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT > +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE > +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. > + > +""" > +DPDK Test suite. > + > +Set the VF max queue number when running the DPDK APP instead of > compiling. > + > +""" > + > +import utils > +import time > +import re > + > +from test_case import TestCase > +from settings import HEADER_SIZE > +from pmd_output import PmdOutput > +from settings import DRIVERS > + > +from packet import Packet > + > + > +class TestRuntime_Queue_Number(TestCase): > + > + def set_up_all(self): > + """ > + Run at the start of each test suite. > + Run time Queue Number Prerequistites > + """ > + self.verify(self.nic in ["fortville_eagle", "fortville_spirit", > + "fortville_spirit_single", > "fortpark_TLV"], "NIC Unsupported: " + str(self.nic)) > + > + # Based on h/w type, choose how many ports to use > + self.dut_ports =3D self.dut.get_ports(self.nic) > + # Verify that enough ports are available > + self.verify(len(self.dut_ports) >=3D 1, "Insufficient ports") > + > + localPort =3D self.tester.get_local_port(self.dut_ports[0]) > + self.tester_intf =3D self.tester.get_interface(localPort) > + self.tester_mac =3D self.tester.get_mac(localPort) > + self.pf_interface =3D self.dut.ports_info[self.dut_ports[0]]['in= tf'] > + self.pf_mac =3D self.dut.get_mac_address(0) > + self.pf_pci =3D self.dut.ports_info[self.dut_ports[0]]['pci'] > + self.pmdout =3D PmdOutput(self.dut) > + self.cores =3D "1S/4C/1T" > + > + self.session_secondary =3D self.dut.new_session() > + self.session_third =3D self.dut.new_session() > + self.vf_mac =3D "00:11:22:33:44:55" > + > + def set_up(self): > + """ > + Run before each test case. > + """ > + pass > + > + def setup_env(self, vfs_num): > + """ > + This is to set up vf environment. > + The pf is bound to dpdk driver. > + """ > + # assigned number of VFs > + self.dut.generate_sriov_vfs_by_port(self.dut_ports[0], vfs_num, > self.drivername) > + self.sriov_vfs_port =3D > self.dut.ports_info[self.dut_ports[0]]['vfs_port'] > + > + try: > + for port in self.sriov_vfs_port: > + port.bind_driver(driver=3D"vfio-pci") > + except Exception as e: > + self.destroy_env() > + raise Exception(e) > + > + def destroy_env(self): > + """ > + This is to stop testpmd and destroy vf environment. > + """ > + self.session_third.send_expect("quit", "# ") > + time.sleep(2) > + self.session_secondary.send_expect("quit", "# ") > + time.sleep(2) > + self.dut.send_expect("quit", "# ") > + time.sleep(2) > + self.dut.destroy_sriov_vfs_by_port(self.dut_ports[0]) > + > + def verify_result(self, outstring, max_rxqn, max_txqn, cur_rxqn, > cur_txqn): > + """ > + verify the packet to the expected queue or be dropped > + """ > + self.verify("Max possible RX queues: %d" % max_rxqn in outstring= , > "the vf RX max queue number is not set successfully") > + self.verify("Max possible TX queues: %d" % max_txqn in outstring= , > "the vf TX max queue number is not set successfully") > + self.verify("Current number of RX queues: %d" % cur_rxqn in > outstring, "the vf RX queue number is not set successfully") > + self.verify("Current number of TX queues: %d" % cur_txqn in > outstring, "the vf TX queue number is not set successfully") > + > + def send_packet(self, itf): > + """ > + Sends packets. > + """ > + self.tester.scapy_foreground() > + time.sleep(2) > + for i in range(32): > + packet =3D r'sendp([Ether(dst=3D"%s", > src=3Dget_if_hwaddr("%s"))/IP(src=3D"192.168.0.%d", dst=3D"192.168.0.%d")= ], > iface=3D"%s")' % ( > + self.vf_mac, itf, i + 1, i + 2, itf) > + self.tester.scapy_append(packet) > + self.tester.scapy_execute() > + time.sleep(2) > + > + def check_packet_queue(self, out): > + """ > + get the queue which packet enter. > + """ > + self.verify("Queue=3D 0" in out and "Queue=3D 1" in out and "Que= ue=3D > 2" in out and "Queue=3D 3" in out > + and "Queue=3D 4" in out and "Queue=3D 5" in out and > "Queue=3D 6" in out and "Queue=3D 7" in out, "there is some queues doesn'= t > work") > + lines =3D out.split("\r\n") > + reta_line =3D {} > + queue_flag =3D 0 > + packet_sumnum =3D 0 > + # collect the hash result and the queue id > + for line in lines: > + line =3D line.strip() > + if queue_flag =3D=3D 1: > + result_scanner =3D r"RX-packets:\s?([0-9]+)" > + scanner =3D re.compile(result_scanner, re.DOTALL) > + m =3D scanner.search(line) > + packet_num =3D m.group(1) > + packet_sumnum =3D packet_sumnum + int(packet_num) > + queue_flag =3D 0 > + elif line.strip().startswith("------- Forward"): > + queue_flag =3D 1 > + elif line.strip().startswith("RX-packets"): > + result_scanner =3D r"RX-packets:\s?([0-9]+)" > + scanner =3D re.compile(result_scanner, re.DOTALL) > + m =3D scanner.search(line) > + packet_rec =3D m.group(1) > + > + self.verify(packet_sumnum =3D=3D int(packet_rec) =3D=3D 32, "The= re are > some packets lost.") Look like similar function has been implemented in other suite, I recommend= to implement it in pmd_ouput module.=20 > + > + def test_set_valid_vf_max_qn(self): > + """ > + try to set all the valid queue number of VF > + """ > + self.setup_env(2) > + max_qn =3D (1, 2, 4, 8, 16) > + # set all the valid queue number per VF > + for i in max_qn: > + # start testpmd on pf > + self.pmdout.start_testpmd("%s" % self.cores, eal_param=3D"- > w %s,queue-num-per-vf=3D%d --file-prefix=3Dtest1 --socket-mem 1024,1024 -= - > legacy-mem" % (self.pf_pci, i)) Please not use legacy-mem mode, it won't be the default option of dpdk.=20 > + # start testpmd on vf0 > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 > -n 4 -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -= i - > -rxq=3D%d --txq=3D%d" % (self.target, self.sriov_vfs_port[0].pci, i, i), > "testpmd>", 120) > + outstring =3D self.session_secondary.send_expect("show port > info all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3Di, max_txqn=3Di, > cur_rxqn=3Di, cur_txqn=3Di) > + self.session_secondary.send_expect("quit", "# ") > + time.sleep(2) > + self.dut.send_expect("quit", "# ") > + time.sleep(2) > + > + def test_set_invalid_vf_max_qn(self): > + """ > + try to set several invalid queue number of VF > + """ > + self.setup_env(2) > + max_qn =3D (0, 6, 17, 32) > + # set several invalid queue number per vf > + for i in max_qn: > + # start testpmd on pf > + out =3D self.pmdout.start_testpmd("%s" % self.cores, > eal_param=3D"-w %s,queue-num-per-vf=3D%d --file-prefix=3Dtest1 --socket-m= em > 1024,1024 --legacy-mem" % (self.pf_pci, i)) > + self.verify("Wrong VF queue number =3D %d" % i in out, "the > setting of invalid vf max queue number failed.") > + # start testpmd on vf0 > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 > -n 4 -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -= i" % > (self.target, self.sriov_vfs_port[0].pci), "testpmd>", 120) > + outstring =3D self.session_secondary.send_expect("show port > info all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D4, max_txqn=3D4, > cur_rxqn=3D1, cur_txqn=3D1) > + self.session_secondary.send_expect("quit", "# ") > + time.sleep(2) > + self.dut.send_expect("quit", "# ") > + time.sleep(2) > + > + def test_set_vf_qn(self): > + """ > + set vf queue number with testpmd eal parameters. > + """ > + self.setup_env(2) > + self.pmdout.start_testpmd("%s" % self.cores, eal_param=3D"- > w %s,queue-num-per-vf=3D8 --file-prefix=3Dtest1 --socket-mem 1024,1024 -- > legacy-mem" % self.pf_pci) > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 -n = 4 > -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -i -- > rxq=3D9 --txq=3D9" % (self.target, self.sriov_vfs_port[0].pci), "# ", 120= ) > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 -n = 4 > -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -i -- > rxq=3D3 --txq=3D3" % (self.target, self.sriov_vfs_port[0].pci), "testpmd>= ", > 120) > + outstring =3D self.session_secondary.send_expect("show port info > all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D3, > cur_txqn=3D3) > + > + def test_set_vf_qn_in_testpmd(self): > + """ > + set vf queue number with testpmd command. > + """ > + self.setup_env(2) > + self.pmdout.start_testpmd("%s" % self.cores, eal_param=3D"- > w %s,queue-num-per-vf=3D8 --file-prefix=3Dtest1 --socket-mem 1024,1024 -- > legacy-mem" % self.pf_pci) > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 -n = 4 > -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -i" % > (self.target, self.sriov_vfs_port[0].pci), "testpmd>", 120) > + outstring =3D self.session_secondary.send_expect("show port info > all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D1, > cur_txqn=3D1) > + self.session_secondary.send_expect("port stop all", "testpmd> ") > + self.session_secondary.send_expect("port config all rxq 8", > "testpmd> ") > + self.session_secondary.send_expect("port config all txq 8", > "testpmd> ") > + self.session_secondary.send_expect("port start all", "testpmd> "= ) > + outstring =3D self.session_secondary.send_expect("show port info > all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D8, > cur_txqn=3D8) > + self.session_secondary.send_expect("port stop all", "testpmd> ") > + self.session_secondary.send_expect("port config all rxq 9", > "Fail") > + self.session_secondary.send_expect("port config all txq 9", > "Fail") > + self.session_secondary.send_expect("port start all", "testpmd> "= ) > + outstring =3D self.session_secondary.send_expect("show port info > all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D8, > cur_txqn=3D8) > + > + def test_set_32vfs_1pf(self): > + """ > + set max queue number when setting 32 VFs on 1 PF port. > + """ > + self.setup_env(32) > + # failed to set VF max queue num to 16. > + out =3D self.pmdout.start_testpmd("%s" % self.cores, eal_param= =3D"- > w %s,queue-num-per-vf=3D16 --file-prefix=3Dtest1 --socket-mem 1024,1024 -= - > legacy-mem" % self.pf_pci) > + self.verify("exceeds the hardware maximum 384" in out, "the queu= e > num exceeds the hardware maximum 384") > + self.dut.send_expect("quit", "# ") > + # succeed in setting VF max queue num to 8 > + self.pmdout.start_testpmd("%s" % self.cores, eal_param=3D"- > w %s,queue-num-per-vf=3D8 --file-prefix=3Dtest1 --socket-mem 1024,1024 -- > legacy-mem" % self.pf_pci) > + # start testpmd on vf0 > + self.session_secondary.send_expect("./%s/app/testpmd -c 0xf0 -n = 4 > -w %s --file-prefix=3Dtest2 --socket-mem 1024,1024 --legacy-mem -- -i -- > rxq=3D%d --txq=3D%d" % (self.target, self.sriov_vfs_port[0].pci, 8, 8), > "testpmd>", 120) > + # start testpmd on vf31 with different rxq/txq number > + self.session_third.send_expect("./%s/app/testpmd -c 0xf00 -n 4 - > w %s --file-prefix=3Dtest3 --socket-mem 1024,1024 --legacy-mem -- -i" % > (self.target, self.sriov_vfs_port[31].pci), "testpmd>", 120) > + # check the max queue number and current queue number > + outstring =3D self.session_secondary.send_expect("show port info > all", "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D8, > cur_txqn=3D8) > + outstring =3D self.session_third.send_expect("show port info all= ", > "testpmd> ", 120) > + self.verify_result(outstring, max_rxqn=3D8, max_txqn=3D8, cur_rx= qn=3D1, > cur_txqn=3D1) > + # modify the queue number of VF1 to max queue number > + self.session_third.send_expect("stop", "testpmd> ", 120) > + self.session_third.send_expect("port stop all", "testpmd> ", 120= ) > + self.session_third.send_expect("port config all rxq 8", "testpmd= > > ", 120) > + self.session_third.send_expect("port config all txq 8", "testpmd= > > ", 120) > + self.session_third.send_expect("port start all", "testpmd> ", 12= 0) > + > + # check all the queues can be used to distributed packets. > + self.session_secondary.send_expect("set fwd rxonly", "testpmd> "= , > 120) > + self.session_secondary.send_expect("set verbose 1", "testpmd> ", > 120) > + self.session_secondary.send_expect("start", "testpmd> ", 120) > + time.sleep(2) > + self.send_packet(self.tester_intf) > + out =3D self.session_secondary.send_expect("stop", "testpmd> ", = 120) > + time.sleep(2) > + self.check_packet_queue(out) > + > + # check all the queues can be used to distributed packets. > + self.session_third.send_expect("set fwd rxonly", "testpmd> ", 12= 0) > + self.session_third.send_expect("set verbose 1", "testpmd> ", 120= ) > + self.session_third.send_expect("start", "testpmd> ", 120) > + time.sleep(2) > + self.send_packet(self.tester_intf) > + out =3D self.session_third.send_expect("stop", "testpmd> ", 120) > + time.sleep(2) > + self.check_packet_queue(out) > + > + def test_vf_bound_to_kerneldriver(self): > + """ > + set vf queue number when vf bound to kernel driver. > + """ > + self.setup_env(2) > + # bind vf to kernel driver > + for port in self.sriov_vfs_port: > + port.bind_driver(driver=3D"i40evf") > + # set vf max queue number to 8 > + self.pmdout.start_testpmd("%s" % self.cores, eal_param=3D"- > w %s,queue-num-per-vf=3D8 --file-prefix=3Dtest1 --socket-mem 1024,1024 -- > legacy-mem" % self.pf_pci) > + # get the vf interface > + for port in self.sriov_vfs_port: > + vf_intf =3D port.get_interface_name() > + # list all the vf rx/tx queues of one of the vfs > + outstring =3D self.session_secondary.send_expect("ethtool -S %s"= % > vf_intf, "# ", 120) > + self.verify("rx-7.packets" in outstring, "the vf RX max queue > number is not set successfully") > + self.verify("tx-7.packets" in outstring, "the vf TX max queue > number is not set successfully") > + self.dut.send_expect("quit", "# ") > + for port in self.sriov_vfs_port: > + port.bind_driver(driver=3D"vfio-pci") > + > + def tear_down(self): > + """ > + Run after each test case. > + """ > + self.destroy_env() > + self.dut.kill_all() > + > + def tear_down_all(self): > + """ > + Run after each test suite. > + """ > + self.dut.kill_all() > + self.dut.close_session(self.session_secondary) > + self.dut.close_session(self.session_third) > -- > 2.7.4