From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <thomas@monjalon.net>
Received: from out1-smtp.messagingengine.com (out1-smtp.messagingengine.com
 [66.111.4.25]) by dpdk.org (Postfix) with ESMTP id E542D4CC0
 for <dev@dpdk.org>; Fri, 18 May 2018 15:48:04 +0200 (CEST)
Received: from compute1.internal (compute1.nyi.internal [10.202.2.41])
 by mailout.nyi.internal (Postfix) with ESMTP id 7BC5721DB4;
 Fri, 18 May 2018 09:48:04 -0400 (EDT)
Received: from mailfrontend1 ([10.202.2.162])
 by compute1.internal (MEProxy); Fri, 18 May 2018 09:48:04 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=monjalon.net; h=
 cc:content-transfer-encoding:content-type:date:from:in-reply-to
 :message-id:mime-version:references:subject:to:x-me-sender
 :x-me-sender:x-sasl-enc; s=mesmtp; bh=aAPfLzIrFd0NdqYcDVAUmsGEoM
 LzBEPJcKo+sarsjao=; b=f7EF2eoJuH4yH6hUiNjR3yX475vhmqQ9cnB7R7Z7Rr
 V0P36Iy+fx5H8+uJPBwlvG3C906DZhqmnCuTFf2jYpFy6f//2gEe5SazO1jZClct
 DO5GL5fLwleh18V5ERHoOxq/0W3/U2W7/tzPaS72oub3Gu5aGQEads41/MlsFvtH
 M=
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-transfer-encoding:content-type
 :date:from:in-reply-to:message-id:mime-version:references
 :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=aAPfLz
 IrFd0NdqYcDVAUmsGEoMLzBEPJcKo+sarsjao=; b=dnpQ6L6wF3ZJpI3cNOHU86
 9oTPxhYjtgFa15lQYVyo7EH40USZXGVc9NOpxJzAFfkk7v+QUYcCdT7Xpc4zGBno
 TO8AswGXLOsZ1wyxlDV3oYgxeZYrPN7W2R3ZotM+O2vX1NKLIMB2k2F4CxWF+n7c
 AVchO8ZDxHqHOFpa/OGYJHAudOz+84v+h2m2ez+qq/GU0Po0BRD1zSbrmZNkUZjs
 5Ma/pb6I8/U73XPdYf8OyFxZKsuzgXxI6G47+wCaisqRxyGkI1s9T9+/KnPRwmVf
 bsUVIka5zFzCfmjrwtf5Uu9ivio/u6w5oxeS3sjT9ZUYUDxCQK+L4Df/xm4y6rmg
 ==
X-ME-Proxy: <xmx:lNn-WtWiFQko17WtAtnwF4nbZmCcQny5xw-VFR1efWzDhUr0DqBcng>
X-ME-Proxy: <xmx:lNn-Wgu1AfRkt50kaYLECctyq5RBATHE-lz1gAFn5GF8QOq3d9QjdQ>
X-ME-Proxy: <xmx:lNn-Wm2JxgFktNwk73QjHbNUeCllKmRXG-XgDKF4fDRocr15oKKKug>
X-ME-Proxy: <xmx:lNn-Wk7wnmaw6ev9UTeFVEPMYe2do-iacWgNJG7lir7ql0jLESF4QA>
X-ME-Proxy: <xmx:lNn-WmOTV-TfDUSK-UBFceZM-5qcr_LGlj561ORxsFqVAbvdurFReA>
X-ME-Proxy: <xmx:lNn-WgtkXwfJN-RohK9Wyg8ZdB6q8Ze3CcjDh3mveXPE6jlvHOI5qQ>
X-ME-Sender: <xms:lNn-WjhZFMzouHsbhU5QOXtIXux07FIcKiSxh845Sn30c0jbEFnNkA>
Received: from xps.localnet (184.203.134.77.rev.sfr.net [77.134.203.184])
 by mail.messagingengine.com (Postfix) with ESMTPA id 9178FE43C8;
 Fri, 18 May 2018 09:48:03 -0400 (EDT)
From: Thomas Monjalon <thomas@monjalon.net>
To: "Parthasarathy, JananeeX M" <jananeex.m.parthasarathy@intel.com>
Cc: "dev@dpdk.org" <dev@dpdk.org>, "Burakov,
 Anatoly" <anatoly.burakov@intel.com>, "Pattan,
 Reshma" <reshma.pattan@intel.com>
Date: Fri, 18 May 2018 15:48:02 +0200
Message-ID: <12834353.uf7ZmsVvok@xps>
In-Reply-To: <7AE31235A30B41498D1C31348DC858BD5B3D6087@IRSMSX103.ger.corp.intel.com>
References: <1524835241-12778-1-git-send-email-reshma.pattan@intel.com>
 <117420816.XQrphXIzck@xps>
 <7AE31235A30B41498D1C31348DC858BD5B3D6087@IRSMSX103.ger.corp.intel.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="us-ascii"
Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Fri, 18 May 2018 13:48:05 -0000

18/05/2018 15:32, Parthasarathy, JananeeX M:
> From: Thomas Monjalon [mailto:thomas@monjalon.net] 
> > 15/05/2018 18:14, Parthasarathy, JananeeX M:
> > > From: Thomas Monjalon [mailto:thomas@monjalon.net]
> > 
> > I think we need to keep a fast subset of tests.
> > 
> > Please check in mk/rte.sdktest.mk:
> > 	PERFLIST=ring_perf,mempool_perf,memcpy_perf,hash_perf,timer_perf
> > 	test-fast: BLACKLIST=-$(PERFLIST)
> 
> We have added the below test cases to blacklist in mk/rte.sdktest.mk
> reciprocal_division,reciprocal_division_perf,lpm_perf,red_all
> 
> Now time taken is around 4mins.
> Please let us know is there any minimum time limit for test execution.
> Is this time duration fine?

4 minutes, it's a bit long for developer oriented tests.
We need to distinguish which tests are enough for quick tests,
and which ones can be in another category for full validation purpose.

Please can you make a summary of which tests you are adding,
and propose a priority classification.
Thanks