From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C4030A2EFC for ; Fri, 20 Sep 2019 08:41:53 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 941A01F29E; Fri, 20 Sep 2019 08:41:53 +0200 (CEST) Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by dpdk.org (Postfix) with ESMTP id D512E1F29B for ; Fri, 20 Sep 2019 08:41:50 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga006.fm.intel.com ([10.253.24.20]) by fmsmga102.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 19 Sep 2019 23:41:47 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.64,527,1559545200"; d="scan'208";a="388558567" Received: from fmsmsx106.amr.corp.intel.com ([10.18.124.204]) by fmsmga006.fm.intel.com with ESMTP; 19 Sep 2019 23:41:47 -0700 Received: from fmsmsx152.amr.corp.intel.com (10.18.125.5) by FMSMSX106.amr.corp.intel.com (10.18.124.204) with Microsoft SMTP Server (TLS) id 14.3.439.0; Thu, 19 Sep 2019 23:41:47 -0700 Received: from shsmsx102.ccr.corp.intel.com (10.239.4.154) by FMSMSX152.amr.corp.intel.com (10.18.125.5) with Microsoft SMTP Server (TLS) id 14.3.439.0; Thu, 19 Sep 2019 23:41:47 -0700 Received: from shsmsx101.ccr.corp.intel.com ([169.254.1.92]) by shsmsx102.ccr.corp.intel.com ([169.254.2.113]) with mapi id 14.03.0439.000; Fri, 20 Sep 2019 14:41:45 +0800 From: "Tu, Lijuan" To: "Han, YingyaX" , "dts@dpdk.org" , "Peng, Yuan" CC: "Han, YingyaX" Thread-Topic: [dts] [PATCH V1]test_plan: add performance_thread test plan Thread-Index: AQHVYwAQGbFWS3sdtUyLT3J5Jn/+sqc0NuQg Date: Fri, 20 Sep 2019 06:41:44 +0000 Message-ID: <8CE3E05A3F976642AAB0F4675D0AD20E0BB24D69@SHSMSX101.ccr.corp.intel.com> References: <20190904170600.4518-1-yingyax.han@intel.com> In-Reply-To: <20190904170600.4518-1-yingyax.han@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.2.0.6 dlp-reaction: no-action x-ctpclassification: CTP_NT x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiYTIxMTYwNTMtZTVlMC00ZDNhLThjNjAtYjdhOTIxYTBlOWIzIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiSHp2ZDVKXC90RHI2V1d4SkhBM3E1eFwvd21PcHRPSnVqK1pEZ3ljWUZzYjNqc01Hamhlak91U0F3RmI3ajZzcWI3In0= x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH V1]test_plan: add performance_thread test plan X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Applied, thanks > -----Original Message----- > From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of hanyingya > Sent: Thursday, September 5, 2019 1:06 AM > To: dts@dpdk.org; Peng, Yuan > Cc: Han, YingyaX > Subject: [dts] [PATCH V1]test_plan: add performance_thread test plan >=20 > Signed-off-by: hanyingya > --- > test_plans/performance_thread_test_plan.rst | 227 ++++++++++++++++++++ > 1 file changed, 227 insertions(+) > create mode 100644 test_plans/performance_thread_test_plan.rst >=20 > diff --git a/test_plans/performance_thread_test_plan.rst > b/test_plans/performance_thread_test_plan.rst > new file mode 100644 > index 0000000..66de604 > --- /dev/null > +++ b/test_plans/performance_thread_test_plan.rst > @@ -0,0 +1,227 @@ > +.. Copyright (c) <2011-2019>, Intel Corporation > + All rights reserved. > + > + Redistribution and use in source and binary forms, with or without > + modification, are permitted provided that the following conditions > + are met: > + > + - Redistributions of source code must retain the above copyright > + notice, this list of conditions and the following disclaimer. > + > + - Redistributions in binary form must reproduce the above copyright > + notice, this list of conditions and the following disclaimer in > + the documentation and/or other materials provided with the > + distribution. > + > + - Neither the name of Intel Corporation nor the names of its > + contributors may be used to endorse or promote products derived > + from this software without specific prior written permission. > + > + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT > + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS > + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, > INDIRECT, > + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES > + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS > OR > + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) > + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN > CONTRACT, > + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) > + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF > ADVISED > + OF THE POSSIBILITY OF SUCH DAMAGE. > + > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > +Performance-thread performance Tests > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +The Performance-Thread results are produced using ``l3fwd-thread`` > application. > + > +For more information about Performance Thread sameple applicaton > please > +refer to > +link: http://doc.dpdk.org/guides/sample_app_ug/performance_thread.html > + > +Prerequisites > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Hardware requirements: > + > + - For each CPU socket, each memory channel should be populated with > at least 1x DIMM > + - Board is populated with 4x 1GbE or 10GbE ports. Special PCIe > restrictions may > + be required for performance. For example, the following requiremen= ts > should be > + met for Intel 82599 (Niantic) NICs: > + > + - NICs are plugged into PCIe Gen2 or Gen3 slots > + - For PCIe Gen2 slots, the number of lanes should be 8x or highe= r > + - A single port from each NIC should be used, so for 4x ports, 4= x NICs > should > + be used > + > + - NIC ports connected to traffic generator. It is assumed that the N= IC > ports > + P0, P1 (as identified by the DPDK application) are connected to th= e > + traffic generator ports TG0, TG1. The application-side port mask o= f > + NIC ports P0, P1 is noted as PORTMASK in this section. > + > +2. BIOS requirements: > + > + - Intel Hyper-Threading Technology is ENABLED > + - Hardware Prefetcher is DISABLED > + - Adjacent Cache Line Prefetch is DISABLED > + - Direct Cache Access is DISABLED > + > +3. Linux kernel requirements: > + > + - Linux kernel has the following features enabled: huge page support= , UIO, > HPET > + - Appropriate number of huge pages are reserved at kernel boot time > + - The IDs of the hardware threads (logical cores) per each CPU socke= t can > be > + determined by parsing the file /proc/cpuinfo. The naming conventio= n > for the > + logical cores is: C{x.y.z} =3D hyper-thread z of physical core y o= f CPU socket > x, > + with typical values of x =3D 0 .. 3, y =3D 0 .. 7, z =3D 0 .. 1. L= ogical cores > + C{0.0.1} and C{0.0.1} should be avoided while executing the test, = as they > are > + used by the Linux kernel for running regular processes. > + > +4. The application options to be used in below test cases are listed as > +well as the general description.:: > + > + ./build/l3fwd-thread [EAL options] -- \ > + -p PORTMASK [-P] > + --rx(port,queue,lcore,thread)[,(port,queue,lcore,thread)] > + --tx(lcore,thread)[,(lcore,thread)] > + [--enable-jumbo] [--max-pkt-len PKTLEN]] > + [--no-lthreads] > + > + For other options please refer to URL memtioned above for detail > explanation. > + > +5. Traffic generator requirements > + > +The flows need to be configured and started by the traffic generator: > + > + +------+---------+------------+---------------+------------+---------+ > + | Flow | Traffic | MAC | MAC | IPV4 | IPV4 | > + | | Gen. | Src. | Dst. | Src. | Dest. | > + | | Port | Address | Address | Address | Address | > + > +=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D > =3D=3D=3D=3D=3D+ > + | 1 | TG0 | Random MAC | DUT Port0 Mac | Random IP | 2.1.1.1 | > + +------+---------+------------+---------------+------------+---------+ > + | 2 | TG1 | Random Mac | DUT port1 Mac | Random IP | 1.1.1.1 | > + > + +------+---------+------------+---------------+------------+---------+ > + > +6. Test results table. > + > +Frame sizes should be configured from 64,128,256,512,1024,2000, etc > + > + +------------+---------+------------------+--------------+ > + | Frame Size | S/C/T | Throughput(Mpps) | Line Rate(%) | > + +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D+ > + | 64 | | | | > + +------------+---------+------------------+--------------+ > + | 128 | | | | > + +------------+---------+------------------+--------------+ > + | 256 | | | | > + +------------+---------+------------------+--------------+ > + | 512 | | | | > + +------------+---------+------------------+--------------+ > + | 1024 | | | | > + +------------+---------+------------------+--------------+ > + | 2000 | | | | > + +------------+---------+------------------+--------------+ > + > + > +Test Case: one_lcore_per_pcore performance > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Launch app with descriptor parameters:: > + > + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp- > gcc/l3fwd-thread \ > + -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-len 2500 \ > + --rx=3D"(0,0,0,0)(1,0,0,0)" --tx=3D"(1,0)" --no-lthread > + > + (Note: option "--stat-lcore" is not enabled in the automation > + scripts) > + > +2. Send traffic and verify performance. > + > +3. Repeat above tests with below command lines respectively > + > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | # | Command Line = | > + > +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > + | 1 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(2,0)(3,1) = \ > | > + | | --no-lthread = | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 2 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | --rx=3D"(0,0,0,0)(0,1,1,1)(1,0,2,2)(1,1,3,3)" = \ > | > + | | --tx=3D"(4,0)(5,1)(6,2)(7,3)" --no-lthread > | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 3 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | -- > rx=3D"(0,0,0,0)(0,1,1,1)(0,2,2,2)(0,3,3,3)(1,0,4,4)(1,1,5,5)(1,2,6,6)(1,3= ,7,7)" \ | > + | | --tx=3D"(8,0)(9,1)(10,2)(11,3)(12,4)(13,5)(14,6= )(15,7)" \ > | > + | | --no-lthread = | > + > + +-----+--------------------------------------------------------------- > + ------------------------------------+ > + > +4. Check test results and full out the above result table. > + > + > +Test Case: n_lcore_per_pcore performance > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Launch app with descriptor parameters:: > + > + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp- > gcc/l3fwd-thread \ > + --lcores=3D"2,(0-1)@0" -- -P -p 3 --enable-jumbo --max-pkt-len 2500= \ > + --rx=3D"(0,0,0,0)(1,0,0,0)" --tx=3D"(1,0)" > + > + (Note: option "--stat-lcore" is not enabled in the automation > + scripts) > + > +2. Send traffic and verify performance both directional and > +bi-directional > + > +3. Repeat above tests with below command lines respectively > + > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | # | Command Line = | > + > +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > + | 1 | ./l3fwd-thread -n 4 --lcores=3D"(0-3)@0,4" -- -P -p 3 --enable= -jumbo -- > max-pkt-len 2500 \ | > + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(2,0)(3,1) = \ > | > + | | --no-lthread = | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 2 | ./l3fwd-thread -n 4 --lcores=3D"(0-7)@0,8" -- -P -p 3-P -p 3 -= -enable- > jumbo --max-pkt-len 2500 \ | > + | | --rx=3D"(0,0,0,0)(0,1,1,1)(1,0,2,2)(1,1,3,3)" = \ > | > + | | --tx=3D"(4,0)(5,1)(6,2)(7,3)" --no-lthread > | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 3 | ./l3fwd-thread -n 4 --lcores=3D"(0-15)@0,16" -- -P -p 3 --enab= le-jumbo - > -max-pkt-len 2500 \ | > + | | -- > rx=3D"(0,0,0,0)(0,1,1,1)(0,2,2,2)(0,3,3,3)(1,0,4,4)(1,1,5,5)(1,2,6,6)(1,3= ,7,7)" \ | > + | | --tx=3D"(8,0)(9,1)(10,2)(11,3)(12,4)(13,5)(14,6= )(15,7)" \ > | > + | | --no-lthread = | > + > + +-----+--------------------------------------------------------------- > + ------------------------------------+ > + > +4. Check test results and full out the above result table. > + > + > +Test Case: n_lthread_per_pcore performance > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +1. Launch app with descriptor parameters:: > + > + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp- > gcc/l3fwd-thread \ > + -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-len 2500 \ > + ----tx=3D"(0,0)" --tx=3D"(0,0)" > + > + (Note: option "--stat-lcore" is not enabled in the automation > + scripts) > + > +2. Send traffic and verify performance both directional and > +bi-directional > + > +3. Repeat above tests with below command lines respectively > + > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | # | Command Line = | > + > +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+ > + | 1 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(0,0),(0,1)= " > | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 2 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | --rx=3D"(0,0,0,0)(0,1,0,1)(1,0,0,2)(1,1,0,3)" = \ > | > + | | --tx=3D"(0,0)(0,1)(0,2)(0,3)" = | > + +-----+---------------------------------------------------------------= --------------------------------- > ---+ > + | 3 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-= len 2500 > \ | > + | | -- > rx=3D"(0,0,0,0)(0,1,0,1)(0,2,0,2)(0,3,0,3)(1,0,0,4)(1,1,0,5)(1,2,0,6)(1,3= ,0,7)" \ | > + | | --tx=3D"(0,0)(0,1)(0,2)(0,3)(0,4)(0,5)(0,6)(0,7= )" \ > | > + > + +-----+--------------------------------------------------------------- > + ------------------------------------+ > + > +4. Check test results and full out the above result table. > -- > 2.17.1