From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <jananeex.m.parthasarathy@intel.com>
Received: from mga09.intel.com (mga09.intel.com [134.134.136.24])
 by dpdk.org (Postfix) with ESMTP id D6BC5D004
 for <dev@dpdk.org>; Fri, 18 May 2018 15:33:34 +0200 (CEST)
X-Amp-Result: SKIPPED(no attachment in message)
X-Amp-File-Uploaded: False
Received: from orsmga003.jf.intel.com ([10.7.209.27])
 by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384;
 18 May 2018 06:33:33 -0700
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.49,415,1520924400"; d="scan'208";a="51956888"
Received: from irsmsx105.ger.corp.intel.com ([163.33.3.28])
 by orsmga003.jf.intel.com with ESMTP; 18 May 2018 06:33:32 -0700
Received: from irsmsx103.ger.corp.intel.com ([169.254.3.179]) by
 irsmsx105.ger.corp.intel.com ([169.254.7.214]) with mapi id 14.03.0319.002;
 Fri, 18 May 2018 14:32:59 +0100
From: "Parthasarathy, JananeeX M" <jananeex.m.parthasarathy@intel.com>
To: Thomas Monjalon <thomas@monjalon.net>
CC: "dev@dpdk.org" <dev@dpdk.org>, "Burakov, Anatoly"
 <anatoly.burakov@intel.com>, "Pattan, Reshma" <reshma.pattan@intel.com>
Thread-Topic: [dpdk-dev] [PATCH v2] app/test: enhance sanity script
Thread-Index: AQHT6EriFzQ6TPg0Ok21YjueH/1+AqQuLXuAgALQLND///FvAIAEkN1g
Date: Fri, 18 May 2018 13:32:58 +0000
Message-ID: <7AE31235A30B41498D1C31348DC858BD5B3D6087@IRSMSX103.ger.corp.intel.com>
References: <1524835241-12778-1-git-send-email-reshma.pattan@intel.com>
 <2992140.TScDacoaO3@xps>
 <7AE31235A30B41498D1C31348DC858BD5B3D4DED@IRSMSX103.ger.corp.intel.com>
 <117420816.XQrphXIzck@xps>
In-Reply-To: <117420816.XQrphXIzck@xps>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
dlp-product: dlpe-windows
dlp-version: 11.0.200.100
dlp-reaction: no-action
x-originating-ip: [163.33.239.181]
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Fri, 18 May 2018 13:33:35 -0000

Hi Thomas,

-----Original Message-----
From: Thomas Monjalon [mailto:thomas@monjalon.net] =

Sent: Tuesday, May 15, 2018 9:47 PM
To: Parthasarathy, JananeeX M <jananeex.m.parthasarathy@intel.com>
Cc: dev@dpdk.org; Burakov, Anatoly <anatoly.burakov@intel.com>; Pattan, Res=
hma <reshma.pattan@intel.com>
Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script

15/05/2018 18:14, Parthasarathy, JananeeX M:
> From: Thomas Monjalon [mailto:thomas@monjalon.net]
> > 10/05/2018 12:36, Jananee Parthasarathy:
> > > 1. Sanity Script is enhanced with additional test cases being =

> > > added to autotest_data.py
> > =

> > How long they are?
> > How did you choose to group them?
> =

> It took approximately ~30 min, but longer duration is due to failed test =
cases (15m) which times out due to crash.

What was the duration of make test before your patch?

Using "make test-fast", total run time is 32s.
Earlier, we had run the tests directly using the python script in test/test=
 folder as
  Eg:    ./autotest.py ./build/app/test may7_log
This has run all the test cases which took long time.

I think we need to keep a fast subset of tests.
Please check in mk/rte.sdktest.mk:
	PERFLIST=3Dring_perf,mempool_perf,memcpy_perf,hash_perf,timer_perf
	test-fast: BLACKLIST=3D-$(PERFLIST)

We have added the below test cases to blacklist in mk/rte.sdktest.mk
reciprocal_division,reciprocal_division_perf,lpm_perf,red_all

Now time taken is around 4mins. =

Please let us know is there any minimum time limit for test execution.
Is this time duration fine?
	=

Thanks
M.P.Jananee
--------------------------------------------------------------
Intel Research and Development Ireland Limited
Registered in Ireland
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare
Registered Number: 308263


This e-mail and any attachments may contain confidential material for the s=
ole
use of the intended recipient(s). Any review or distribution by others is
strictly prohibited. If you are not the intended recipient, please contact =
the
sender and delete all copies.