From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga06.intel.com (mga06.intel.com [134.134.136.31]) by dpdk.org (Postfix) with ESMTP id 318751B678 for ; Wed, 31 Jan 2018 08:29:11 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by orsmga104.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 30 Jan 2018 23:29:11 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.46,438,1511856000"; d="scan'208";a="15775132" Received: from fmsmsx104.amr.corp.intel.com ([10.18.124.202]) by fmsmga002.fm.intel.com with ESMTP; 30 Jan 2018 23:29:10 -0800 Received: from fmsmsx157.amr.corp.intel.com (10.18.116.73) by fmsmsx104.amr.corp.intel.com (10.18.124.202) with Microsoft SMTP Server (TLS) id 14.3.319.2; Tue, 30 Jan 2018 23:29:10 -0800 Received: from shsmsx151.ccr.corp.intel.com (10.239.6.50) by FMSMSX157.amr.corp.intel.com (10.18.116.73) with Microsoft SMTP Server (TLS) id 14.3.319.2; Tue, 30 Jan 2018 23:29:10 -0800 Received: from shsmsx103.ccr.corp.intel.com ([169.254.4.145]) by SHSMSX151.ccr.corp.intel.com ([169.254.3.116]) with mapi id 14.03.0319.002; Wed, 31 Jan 2018 15:29:08 +0800 From: "Liu, Yong" To: "Wang, FeiX Y" , "dts@dpdk.org" CC: "Pei, Yulong" , "Wang, FeiX Y" Thread-Topic: [dts] [DTS][PATCH V3 2/3]: test_plans/nic_single_core_perf_test_plan.rst: add test plan for nic_single_core_perf Thread-Index: AQHTmaJZXYeppRAbXE+dOIBpt10TdqONlALg Date: Wed, 31 Jan 2018 07:29:08 +0000 Message-ID: <86228AFD5BCD8E4EBFD2B90117B5E81E62F7E029@SHSMSX103.ccr.corp.intel.com> References: <1517309005-25423-1-git-send-email-feix.y.wang@intel.com> In-Reply-To: <1517309005-25423-1-git-send-email-feix.y.wang@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiMmY5MDI4NzYtMzk4Yy00ZjYxLTgxZGItMGIyNzM1NDZhMTdlIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjIuNS4xOCIsIlRydXN0ZWRMYWJlbEhhc2giOiJVejNVVE1sNHN3ejFOSVl6d0FEQnA1MkVYU0FCNnR0ZmcxSDZwaW1abG5adHNmWUhUK25oTDd6OXk5Q0xWcXYrIn0= x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.0.116 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [DTS][PATCH V3 2/3]: test_plans/nic_single_core_perf_test_plan.rst: add test plan for nic_single_core_perf X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Jan 2018 07:29:12 -0000 Fei,=20 Some comments are inline. Please try to keep each line in 79 characters. > -----Original Message----- > From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of wang fei > Sent: Tuesday, January 30, 2018 6:43 PM > To: dts@dpdk.org > Cc: Pei, Yulong ; Wang, FeiX Y > > Subject: [dts] [DTS][PATCH V3 2/3]: > test_plans/nic_single_core_perf_test_plan.rst: add test plan for > nic_single_core_perf >=20 > For next branch: add the test plan for the test suite nic_single_core_per= f >=20 > Signed-off-by: wang fei > --- > test_plans/nic_single_core_perf_test_plan.rst | 116 > ++++++++++++++++++++++++++ > 1 file changed, 116 insertions(+) > create mode 100644 test_plans/nic_single_core_perf_test_plan.rst >=20 > diff --git a/test_plans/nic_single_core_perf_test_plan.rst > b/test_plans/nic_single_core_perf_test_plan.rst > new file mode 100644 > index 0000000..ec67ad4 > --- /dev/null > +++ b/test_plans/nic_single_core_perf_test_plan.rst > @@ -0,0 +1,116 @@ > +.. Copyright (c) <2016>, Intel Corporation > + All rights reserved. > + > + Redistribution and use in source and binary forms, with or without > + modification, are permitted provided that the following conditions > + are met: > + > + - Redistributions of source code must retain the above copyright > + notice, this list of conditions and the following disclaimer. > + > + - Redistributions in binary form must reproduce the above copyright > + notice, this list of conditions and the following disclaimer in > + the documentation and/or other materials provided with the > + distribution. > + > + - Neither the name of Intel Corporation nor the names of its > + contributors may be used to endorse or promote products derived > + from this software without specific prior written permission. > + > + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS > + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT > + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS > + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES > + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR > + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) > + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, > + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) > + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED > + OF THE POSSIBILITY OF SUCH DAMAGE. > + > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > =3D > +Benchmark the performance of single core forwarding with > FVL25G/40G/NNT10G > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > =3D > + > +Prerequisites > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Hardware: > + 1) nic_single_core_perf test for FVL25G: two dual port FVL25G nics , > all installed on the same socket, pick one port per nic I guess that all NIC should installed on socket 0. So the statement will be= like: FVL25: Two dual ports FVL25 NICs, both installed on socket 0.=20 > + 2) nic_single_core_perf test for FVL40G: two dual port FVL40G nics , > all installed on the same socket, pick one port per nic > + 3) nic_single_core_perf test for NNT10G : four 82599 nics, all > installed on the same socket, pick one port per nic > + > +2. Software: > + dpdk: git clone http://dpdk.org/git/dpdk > + scapy: http://www.secdev.org/projects/scapy/ > + dts (next branch): git clone http://dpdk.org/git/tools/dts, then "gi= t > checkout next" > + Trex source code: http://trex-tgn.cisco.com/trex/release/v2.26.tar.g= z > + python-prettytable(uesed to output the test result matrix as a > separate .txt file): > + apt install python-prettytable (for ubuntu os) > + or dnf install python-prettytable (for fedora os). > + > +3. Connect all the selected nic ports to traffic > generator(IXIA,TREX,PKTGEN) ports(TG ports). > + 2 TG 25g ports for FVL25G ports > + 2 TG 40g ports for FVL40G ports > + 4 TG 10g ports for 4 NNT10G ports > + > +Test Case : nic_single_core_perf > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Please use case name "Single Core Performance Measurement".=20 > +1) Bind tested ports to igb_uio > + > +2) Start testpmd:: > + > + ./x86_64-native-linuxapp-gcc/app/testpmd -c 0x6 -n 4 -- -i -- > portmask=3D0xf --txd=3D128 --rxd=3D128 > + testpmd> start > + > +3) Configure traffic generator to send traffic > + configure one below stream for each TG port > + dst mac: peer nic port mac > + src ip : random > + dst ip : random > + packet length : 64 byte > + > +4) check throughput and compare it with the expected value. > + > +5) for NNT10G, repeat above step 1-4 for txd=3Drxd=3D512,2048 separatel= y. > + for FVL25G and FVL40G nic, just test txd=3Drxd=3D512,2048 following = above > steps 1-4. > + > +6) print out below test results table for NNT10G, FVL25G, FVL40G > separately Simplify the description like:=20 Result tables for different NIC: > + FVL40G: > ++------------+---------+------------+------------+---------------------+ > +| Frame Size | txd/rxd | Throughput | Rate | Expected throughput | > ++=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > +| 64 | 512 | xxxxxx | xxx % | xxx Mpps | > ++------------+---------+------------+------------+---------------------+ > +| 64 | 2048 | xxxxxx | xxx % | xxx Mpps | > ++------------+---------+------------+------------+---------------------+ > + > + FVL25G: > ++------------+---------+-------------+---------+---------------------+ > +| Frame Size | TXD/RXD | Throughput | Rate | Expected Throughput | > ++------------+---------+-------------+---------+---------------------+ > +| 64 | 512 | xxxxxx Mpps | xxx % | xxx Mpps | > +| 64 | 2048 | xxxxxx Mpps | xxx % | xxx Mpps | > ++------------+---------+-------------+---------+---------------------+ > + > + for NNT10G: > ++------------+---------+-------------+---------+---------------------+ > +| Frame Size | TXD/RXD | Throughput | Rate | Expected Throughput | > ++------------+---------+-------------+---------+---------------------+ > +| 64 | 128 | xxxxxx Mpps | xxx % | xxx Mpps | > +| 64 | 512 | xxxxxx Mpps | xxx % | xxx Mpps | > +| 64 | 2048 | xxxxxx Mpps | xxx % | xxx Mpps | > ++------------+---------+-------------+---------+---------------------+ > + > +Note : The values for the Expected throughput may vary due to different > platform and OS, and traffic generator, Please take care the grammar. "Expected" should be "expected".=20 > + please correct thest values accordingly. (the above FVL 25G and > NNT10G expected throughput values "thest" should "threshold".=20 > + were got from the combination of Purly,Ubuntu 16.04, and traffic > generator IXIA, and the FVL40G > + expected throughput value was got from the combination of > Broadwell,Ubuntu 16.04, and traffic > + generator IXIA) Why the criteria performance stats are from different settings? Open-lab setting are different for those NICs? > + > +Case assert failure if the actual throughputs lower exceed 1 Mpps than > the expected throughput. > + Please use below sentence. Case will raise failure if actual throughputs have more than 1Mpps gap from= expected ones.=20 > + > + > -- > 2.7.4