From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga06.intel.com (mga06.intel.com [134.134.136.31]) by dpdk.org (Postfix) with ESMTP id 82D558D9C for ; Sun, 20 May 2018 19:41:56 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by orsmga104.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 20 May 2018 10:41:54 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.49,423,1520924400"; d="scan'208,217";a="48272799" Received: from irsmsx108.ger.corp.intel.com ([163.33.3.3]) by fmsmga002.fm.intel.com with ESMTP; 20 May 2018 10:41:52 -0700 Received: from irsmsx103.ger.corp.intel.com ([169.254.3.179]) by IRSMSX108.ger.corp.intel.com ([169.254.11.150]) with mapi id 14.03.0319.002; Sun, 20 May 2018 18:41:51 +0100 From: "Parthasarathy, JananeeX M" To: Thomas Monjalon CC: "dev@dpdk.org" , "Burakov, Anatoly" , "Pattan, Reshma" Thread-Topic: [dpdk-dev] [PATCH v2] app/test: enhance sanity script Thread-Index: AQHT6EriFzQ6TPg0Ok21YjueH/1+AqQuLXuAgALQLND///FvAIAEkN1g///8YQCAA3WFoA== Date: Sun, 20 May 2018 17:41:50 +0000 Message-ID: <7AE31235A30B41498D1C31348DC858BD5B3D64D6@IRSMSX103.ger.corp.intel.com> References: <1524835241-12778-1-git-send-email-reshma.pattan@intel.com> <117420816.XQrphXIzck@xps> <7AE31235A30B41498D1C31348DC858BD5B3D6087@IRSMSX103.ger.corp.intel.com> <12834353.uf7ZmsVvok@xps> In-Reply-To: <12834353.uf7ZmsVvok@xps> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-version: 11.0.200.100 dlp-reaction: no-action x-originating-ip: [163.33.239.181] MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 20 May 2018 17:41:57 -0000 Hello Thomas, -----Original Message----- From: Thomas Monjalon [mailto:thomas@monjalon.net] Sent: Friday, May 18, 2018 7:18 PM To: Parthasarathy, JananeeX M Cc: dev@dpdk.org; Burakov, Anatoly ; Pattan, Res= hma Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script 18/05/2018 15:32, Parthasarathy, JananeeX M: > From: Thomas Monjalon [mailto:thomas@monjalon.net] > > 15/05/2018 18:14, Parthasarathy, JananeeX M: > > > From: Thomas Monjalon [mailto:thomas@monjalon.net] > > > > I think we need to keep a fast subset of tests. > > > > Please check in mk/rte.sdktest.mk: > > PERFLIST=3Dring_perf,mempool_perf,memcpy_perf,hash_perf,t= imer_perf > > test-fast: BLACKLIST=3D-$(PERFLIST) > > We have added the below test cases to blacklist in mk/rte.sdktest.mk > reciprocal_division,reciprocal_division_perf,lpm_perf,red_all > > Now time taken is around 4mins. > Please let us know is there any minimum time limit for test execution. > Is this time duration fine? 4 minutes, it's a bit long for developer oriented tests. We need to distinguish which tests are enough for quick tests, and which on= es can be in another category for full validation purpose. Please can you make a summary of which tests you are adding, and propose a = priority classification. Thanks Please find below the test cases newly added to sanity script (autotest_dat= a.py) with priority classification. P1 - Main test cases P2 - Cryptodev test cases which requires dependent libraries (Can be adde= d if the environment is set accordingly) P3 - Perf test cases and others which takes more time (> 10s) (these will = be in the blacklist test cases) P4 - Logging/Dump test cases (to be checked whether these are really necess= ary) The blacklist is updated in makefile "rte.sdktest.mk" with below list of te= st cases to reduce the total test execution time. Blacklist test cases are ring_perf,mempool_perf,memcpy_perf,hash_perf,timer= _perf,reciprocal_division,reciprocal_division_perf,lpm_perf, red_all,barrier,hash_multiwriter,timer_racecond,efd,hash_= functions,eventdev_selftest_sw,member_perf,efd_perf,lpm6_perf,red_perf,dist= ributor_perf Currently after the above blacklist update, the total execution time of "ma= ke test-fast" is 54s. Eventdev selftest octeontx P1 Event ring autotest P1 Table autotest P1 Flow classify autotest P1 Dump struct sizes P4 Dump mempool P4 Dump malloc stats P4 Dump devargs P4 Dump log types P4 Dump_ring P4 Quit P4 Set rxtx anchor P4 Set rxtx sc P4 Event eth rx adapter autotest P1 Rawdev autotest P1 Kvargs autotest P1 Dump physmem P1 Dump memzone P4 Devargs autotest P4 Link bonding autotest P1 Link bonding mode4 autotest P1 Link bonding rssconf autotest P1 Crc autotest P1 Distributor autotest P1 Reorder autotest P1 Barrier autotest P3 User delay P1 Bitmap test P1 Hash scaling autotest P1 Hash multiwriter autotest P3 Service autotest P1 Timer racecond autotest P3 Member autotest P3 Efd_autotest P3 Thash autotest P1 Hash function autotest P3 Cryptodev sw mrvl autotest P2 Cryptodev dpaa2 sec autotest P2 Cryptodev dpaa sec autotest P2 Cryptodev qat autotest P2 Cryptodev aesni mb autotest P2 Cryptodev openssl autotest P2 Cryptodev scheduler autotest P2 Cryptodev aesni gcm autotest P2 Cryptodev null autotest P2 Cryptodev sw snow3g autotest P2 Cryptodev sw kasumi autotest P2 Cryptodev_sw_zuc_autotest P2 Reciprocal division P3 Red all P3 Mempool performance autotest P3 Memcpy performance autotest P3 Hash performance autotest P3 Timer performance autotest P3 Reciprocal division perf P3 Member perf autotest P3 Efd perf autotest P3 Lpm perf autotest P3 Lpm6 perf autotest P3 Red_perf P3 Distributor perf autotest P3 Ring pmd perf autotest P1 Pmd perf autotest P1 Ring performance autotest P1 Thanks M.P.Jananee -------------------------------------------------------------- Intel Research and Development Ireland Limited Registered in Ireland Registered Office: Collinstown Industrial Park, Leixlip, County Kildare Registered Number: 308263 This e-mail and any attachments may contain confidential material for the s= ole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact = the sender and delete all copies.