From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 24853A2EFC for ; Wed, 18 Sep 2019 07:37:08 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 0B2DC1BF83; Wed, 18 Sep 2019 07:37:08 +0200 (CEST) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 3DDE51BF81 for ; Wed, 18 Sep 2019 07:37:06 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 17 Sep 2019 22:37:05 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.64,519,1559545200"; d="scan'208";a="216824256" Received: from fmsmsx104.amr.corp.intel.com ([10.18.124.202]) by fmsmga002.fm.intel.com with ESMTP; 17 Sep 2019 22:37:04 -0700 Received: from fmsmsx154.amr.corp.intel.com (10.18.116.70) by fmsmsx104.amr.corp.intel.com (10.18.124.202) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 17 Sep 2019 22:37:04 -0700 Received: from shsmsx154.ccr.corp.intel.com (10.239.6.54) by FMSMSX154.amr.corp.intel.com (10.18.116.70) with Microsoft SMTP Server (TLS) id 14.3.439.0; Tue, 17 Sep 2019 22:37:04 -0700 Received: from shsmsx103.ccr.corp.intel.com ([169.254.4.140]) by SHSMSX154.ccr.corp.intel.com ([169.254.7.195]) with mapi id 14.03.0439.000; Wed, 18 Sep 2019 13:37:02 +0800 From: "Peng, Yuan" To: "Han, YingyaX" , "dts@dpdk.org" Thread-Topic: [dts][PATCH V1]test_plan: add performance_thread test plan Thread-Index: AQHVYv/8AC94ByNv6UWNdXr8G7eJvqcxACoQ Date: Wed, 18 Sep 2019 05:37:01 +0000 Message-ID: <67D543A150B29E4CAAE53918F64EDAEA3776051D@SHSMSX103.ccr.corp.intel.com> References: <20190904170600.4518-1-yingyax.han@intel.com> In-Reply-To: <20190904170600.4518-1-yingyax.han@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH V1]test_plan: add performance_thread test plan X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Acked-by Peng, Yuan -----Original Message----- From: Han, YingyaX=20 Sent: Thursday, September 5, 2019 1:06 AM To: dts@dpdk.org; Peng, Yuan Cc: Han, YingyaX Subject: [dts][PATCH V1]test_plan: add performance_thread test plan Signed-off-by: hanyingya --- test_plans/performance_thread_test_plan.rst | 227 ++++++++++++++++++++ 1 file changed, 227 insertions(+) create mode 100644 test_plans/performance_thread_test_plan.rst diff --git a/test_plans/performance_thread_test_plan.rst b/test_plans/perfo= rmance_thread_test_plan.rst new file mode 100644 index 0000000..66de604 --- /dev/null +++ b/test_plans/performance_thread_test_plan.rst @@ -0,0 +1,227 @@ +.. Copyright (c) <2011-2019>, Intel Corporation + All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + - Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + + - Redistributions in binary form must reproduce the above copyright + notice, this list of conditions and the following disclaimer in + the documentation and/or other materials provided with the + distribution. + + - Neither the name of Intel Corporation nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED + OF THE POSSIBILITY OF SUCH DAMAGE. + +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D +Performance-thread performance Tests +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + +The Performance-Thread results are produced using ``l3fwd-thread`` applica= tion. + +For more information about Performance Thread sameple applicaton please=20 +refer to +link: http://doc.dpdk.org/guides/sample_app_ug/performance_thread.html + +Prerequisites +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + +1. Hardware requirements: + + - For each CPU socket, each memory channel should be populated with at= least 1x DIMM + - Board is populated with 4x 1GbE or 10GbE ports. Special PCIe restric= tions may + be required for performance. For example, the following requirements= should be + met for Intel 82599 (Niantic) NICs: + + - NICs are plugged into PCIe Gen2 or Gen3 slots + - For PCIe Gen2 slots, the number of lanes should be 8x or higher + - A single port from each NIC should be used, so for 4x ports, 4x = NICs should + be used + + - NIC ports connected to traffic generator. It is assumed that the NIC= ports + P0, P1 (as identified by the DPDK application) are connected to the + traffic generator ports TG0, TG1. The application-side port mask of + NIC ports P0, P1 is noted as PORTMASK in this section. + +2. BIOS requirements: + + - Intel Hyper-Threading Technology is ENABLED + - Hardware Prefetcher is DISABLED + - Adjacent Cache Line Prefetch is DISABLED + - Direct Cache Access is DISABLED + +3. Linux kernel requirements: + + - Linux kernel has the following features enabled: huge page support, = UIO, HPET + - Appropriate number of huge pages are reserved at kernel boot time + - The IDs of the hardware threads (logical cores) per each CPU socket = can be + determined by parsing the file /proc/cpuinfo. The naming convention = for the + logical cores is: C{x.y.z} =3D hyper-thread z of physical core y of = CPU socket x, + with typical values of x =3D 0 .. 3, y =3D 0 .. 7, z =3D 0 .. 1. Log= ical cores + C{0.0.1} and C{0.0.1} should be avoided while executing the test, as= they are + used by the Linux kernel for running regular processes. + +4. The application options to be used in below test cases are listed as=20 +well as the general description.:: + + ./build/l3fwd-thread [EAL options] -- \ + -p PORTMASK [-P] + --rx(port,queue,lcore,thread)[,(port,queue,lcore,thread)] + --tx(lcore,thread)[,(lcore,thread)] + [--enable-jumbo] [--max-pkt-len PKTLEN]] + [--no-lthreads] + + For other options please refer to URL memtioned above for detail explan= ation. + +5. Traffic generator requirements + +The flows need to be configured and started by the traffic generator: + + +------+---------+------------+---------------+------------+---------+ + | Flow | Traffic | MAC | MAC | IPV4 | IPV4 | + | | Gen. | Src. | Dst. | Src. | Dest. | + | | Port | Address | Address | Address | Address | + +=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+ + | 1 | TG0 | Random MAC | DUT Port0 Mac | Random IP | 2.1.1.1 | + +------+---------+------------+---------------+------------+---------+ + | 2 | TG1 | Random Mac | DUT port1 Mac | Random IP | 1.1.1.1 | + =20 + +------+---------+------------+---------------+------------+---------+ + +6. Test results table. + +Frame sizes should be configured from 64,128,256,512,1024,2000, etc + + +------------+---------+------------------+--------------+ + | Frame Size | S/C/T | Throughput(Mpps) | Line Rate(%) | =20 + +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D+ + | 64 | | | | + +------------+---------+------------------+--------------+ + | 128 | | | | + +------------+---------+------------------+--------------+ + | 256 | | | | + +------------+---------+------------------+--------------+ + | 512 | | | | + +------------+---------+------------------+--------------+ + | 1024 | | | | + +------------+---------+------------------+--------------+ + | 2000 | | | | + +------------+---------+------------------+--------------+ + + +Test Case: one_lcore_per_pcore performance=20 +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + +1. Launch app with descriptor parameters:: + + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp-gcc/= l3fwd-thread \ + -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-len 2500 \ + --rx=3D"(0,0,0,0)(1,0,0,0)" --tx=3D"(1,0)" --no-lthread + + (Note: option "--stat-lcore" is not enabled in the automation=20 + scripts) + +2. Send traffic and verify performance. + +3. Repeat above tests with below command lines respectively + + +-----+-----------------------------------------------------------------= ----------------------------------+ + | # | Command Line = | + +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D+ + | 1 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(2,0)(3,1) \ = | + | | --no-lthread = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 2 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,1,1)(1,0,2,2)(1,1,3,3)" \ = | + | | --tx=3D"(4,0)(5,1)(6,2)(7,3)" --no-lthread = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 3 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,1,1)(0,2,2,2)(0,3,3,3)(1,0,= 4,4)(1,1,5,5)(1,2,6,6)(1,3,7,7)" \ | + | | --tx=3D"(8,0)(9,1)(10,2)(11,3)(12,4)(13,5)(14,6)(= 15,7)" \ | + | | --no-lthread = | + =20 + +-----+--------------------------------------------------------------- + ------------------------------------+ + +4. Check test results and full out the above result table. + + +Test Case: n_lcore_per_pcore performance=20 +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + +1. Launch app with descriptor parameters:: + + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp-gcc/= l3fwd-thread \ + --lcores=3D"2,(0-1)@0" -- -P -p 3 --enable-jumbo --max-pkt-len 2500 \ + --rx=3D"(0,0,0,0)(1,0,0,0)" --tx=3D"(1,0)" + + (Note: option "--stat-lcore" is not enabled in the automation=20 + scripts) + +2. Send traffic and verify performance both directional and=20 +bi-directional + +3. Repeat above tests with below command lines respectively + + +-----+-----------------------------------------------------------------= ----------------------------------+ + | # | Command Line = | + +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D+ + | 1 | ./l3fwd-thread -n 4 --lcores=3D"(0-3)@0,4" -- -P -p 3 --enable-j= umbo --max-pkt-len 2500 \ | + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(2,0)(3,1) \ = | + | | --no-lthread = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 2 | ./l3fwd-thread -n 4 --lcores=3D"(0-7)@0,8" -- -P -p 3-P -p 3 --e= nable-jumbo --max-pkt-len 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,1,1)(1,0,2,2)(1,1,3,3)" \ = | + | | --tx=3D"(4,0)(5,1)(6,2)(7,3)" --no-lthread = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 3 | ./l3fwd-thread -n 4 --lcores=3D"(0-15)@0,16" -- -P -p 3 --enable= -jumbo --max-pkt-len 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,1,1)(0,2,2,2)(0,3,3,3)(1,0,= 4,4)(1,1,5,5)(1,2,6,6)(1,3,7,7)" \ | + | | --tx=3D"(8,0)(9,1)(10,2)(11,3)(12,4)(13,5)(14,6)(= 15,7)" \ | + | | --no-lthread = | + =20 + +-----+--------------------------------------------------------------- + ------------------------------------+ + +4. Check test results and full out the above result table. + + +Test Case: n_lthread_per_pcore performance=20 +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D + +1. Launch app with descriptor parameters:: + + ./examples/performance-thread/l3fwd-thread/x86_64-native-linuxapp-gcc/= l3fwd-thread \ + -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-len 2500 \ + ----tx=3D"(0,0)" --tx=3D"(0,0)" + + (Note: option "--stat-lcore" is not enabled in the automation=20 + scripts) + +2. Send traffic and verify performance both directional and=20 +bi-directional + +3. Repeat above tests with below command lines respectively + + +-----+-----------------------------------------------------------------= ----------------------------------+ + | # | Command Line = | + +=3D=3D=3D=3D=3D+=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D+ + | 1 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(1,0,1,1) --tx=3D"(0,0),(0,1)" = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 2 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,0,1)(1,0,0,2)(1,1,0,3)" \ = | + | | --tx=3D"(0,0)(0,1)(0,2)(0,3)" = | + +-----+-----------------------------------------------------------------= ----------------------------------+ + | 3 | ./l3fwd-thread -c ff -n 4 -- -P -p 3 --enable-jumbo --max-pkt-le= n 2500 \ | + | | --rx=3D"(0,0,0,0)(0,1,0,1)(0,2,0,2)(0,3,0,3)(1,0,= 0,4)(1,1,0,5)(1,2,0,6)(1,3,0,7)" \ | + | | --tx=3D"(0,0)(0,1)(0,2)(0,3)(0,4)(0,5)(0,6)(0,7)"= \ | + =20 + +-----+--------------------------------------------------------------- + ------------------------------------+ + +4. Check test results and full out the above result table. -- 2.17.1