From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id 210871B3EC for ; Thu, 31 Jan 2019 09:07:59 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga105.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 31 Jan 2019 00:07:59 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.56,543,1539673200"; d="scan'208";a="139439487" Received: from fmsmsx107.amr.corp.intel.com ([10.18.124.205]) by fmsmga002.fm.intel.com with ESMTP; 31 Jan 2019 00:07:59 -0800 Received: from shsmsx105.ccr.corp.intel.com (10.239.4.158) by fmsmsx107.amr.corp.intel.com (10.18.124.205) with Microsoft SMTP Server (TLS) id 14.3.408.0; Thu, 31 Jan 2019 00:07:58 -0800 Received: from shsmsx101.ccr.corp.intel.com ([169.254.1.110]) by SHSMSX105.ccr.corp.intel.com ([169.254.11.253]) with mapi id 14.03.0415.000; Thu, 31 Jan 2019 16:07:56 +0800 From: "Tu, Lijuan" To: "dts@dpdk.org" , "jplsek@iol.unh.edu" Thread-Topic: [next] [PATCH V1] conf/nic_single_core_perf: take 0.00 instead of actual performance numbers Thread-Index: AQHUuGVOUBTnbvU3rkGPAC9wwtjnnaXJB0mA Date: Thu, 31 Jan 2019 08:07:56 +0000 Message-ID: <8CE3E05A3F976642AAB0F4675D0AD20E0BA1F650@SHSMSX101.ccr.corp.intel.com> References: <1548859948-91368-1-git-send-email-lijuan.tu@intel.com> In-Reply-To: <1548859948-91368-1-git-send-email-lijuan.tu@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.0.400.15 dlp-reaction: no-action x-ctpclassification: CTP_NT x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiMDY2YzFiNGUtNDkzNC00Y2U0LWI5NDMtOWQxZWI5YTA5MGMyIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiQUhJcklFSkRjY1I1d0R1Ylh5VnE5YWI4UzlDdXQ3QllqRDI4Vm1ZKzVQbERucnkwMCtVQkdGTE1FTUVyaFhhUyJ9 x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [next] [PATCH V1] conf/nic_single_core_perf: take 0.00 instead of actual performance numbers X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 Jan 2019 08:08:00 -0000 Applied, thanks > -----Original Message----- > From: Tu, Lijuan > Sent: Wednesday, January 30, 2019 10:52 PM > To: dts@dpdk.org; jplsek@iol.unh.edu > Cc: Tu, Lijuan > Subject: [next] [PATCH V1] conf/nic_single_core_perf: take 0.00 instead o= f > actual performance numbers >=20 > Since some NIC vendors might not public their performance numbers, keep > performance numbers private and local, it's a good option for DTS. >=20 > Signed-off-by: Lijuan Tu > --- > conf/nic_single_core_perf.cfg | 42 +++++++++++++++++++++++--------------= ----- > 1 file changed, 23 insertions(+), 19 deletions(-) >=20 > diff --git a/conf/nic_single_core_perf.cfg b/conf/nic_single_core_perf.cf= g index > da1a050..6ecb524 100644 > --- a/conf/nic_single_core_perf.cfg > +++ b/conf/nic_single_core_perf.cfg > @@ -1,39 +1,43 @@ > # Throughput numbers vary in different environment. > -# Change these configuration on demand. > +# Users could change these configuration on demand: > +# > # - test_parameters defines the combination of frame size and descripto= r # > numbers, and the pattern is > # {'frame size': ['descriptor number #1', 'descriptor number #2']} > +# > # - test_duration is how many seconds each combination performance will= # > be recorded. > +# > # - accepted_tolerance defines the accepted tolerance between test # r= esults > and expected numbers. > +# > # - expected_throughput is a dictionary defining expected throughput # > numbers based on NIC, and the pattern is # {'NIC': {'frame size': {'desc= riptor > number': 'excepted throughput'}}} -# Default numbers of fortville_spirit = and > niantic is generated on this -# environment: > -# * Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz > -# * Trex v3.23 > +# Every user should fill it out with your actual numbers. To keep the # > +expected throughput private, dts takes 0.00 as default. > +# > # - if update_expected =3D=3D Ture, and add argument "--update-expected= " in # > bash command, all objects in this file will changed after the run # for > example: ./dts --update-expected > +# > +# Highlights: > +# At the begining, please change test_parameters according to your # > +requirements, then run ./dts --update-expected to get the absolute # > +results which will replace the default numbers 0.00 in this configuratio= n. > +# So you will have your own private configuration, and could start your > +# tests as ususal. >=20 > [suite] > update_expected =3D True > test_parameters =3D {64: [512, 2048]} > test_duration =3D 60 > accepted_tolerance =3D 1 > -expected_throughput =3D {'fortville_spirit': {64: {512: 62.35, 2048: 47.= 89}}, > - 'niantic': {64: {128: 53.435, 512: 53.699, 2048: 42.798}}, > - 'fortville_25g': {64: {512: 62.35, 2048: 47.651}}, > - 'ConnectX4_LX_MT4117': {'40G': {64: {128: 31.635, 256: 32.473, 512: = 30.72, > 2048: 26.94}}, > - '25G': {64: {128: 28.178, 256: 34.581, 512: = 30.528, 2048: > 26.004}}}, > - 'ConnectX5_MT4121': {64: {128: 42.161, 256: 56.651, 512: 47.091, 204= 8: > 40.104}}} > - > -# legacy formate for reference > -throughput_nnt =3D {64: {128: 53.435, 512: 53.699, 2048: 42.798}} - > throughput_fvl25g =3D {64: {512: 43.777, 2048: 43.651}} -throughput_fvl40= g =3D {64: > {512: 62.35, 2048: 47.89}} > -throughput_cx5 =3D {64: {128: 42.161, 256: 56.651, 512: 47.091, 2048: 40= .104}} - > throughput_cx4lx25g =3D {64: {128: 28.178, 256: 34.581, 512: 30.528, 2048= : > 26.004}} -throughput_cx4lx40g =3D {64: {128: 31.635, 256: 32.473, 512: 30= .72, > 2048: 26.94}} > +expected_throughput =3D { > + 'fortville_spirit': {64: {512: 0.00, 2048: 0.00}}, > + 'niantic': {64: {128: 0.00, 512: 0.00, 2048: 0.00}}, > + 'fortville_25g': {64: {512: 0.00, 2048: 0.00}}, > + 'ConnectX4_LX_MT4117': {'40G': {64: {128: 0.00, 256: 0.00, 512: 0.00= , 2048: > 0.00}}, > + '25G': {64: {128: 0.00, 256: 0.00, 512: 0.00= , 2048: 0.00}}}, > + 'ConnectX5_MT4121': {64: {128: 0.00, 256: 0.00, 512: 0.00, 2048: > +0.00}} } > -- > 1.8.3.1