From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <thomas@monjalon.net>
Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com
 [66.111.4.26]) by dpdk.org (Postfix) with ESMTP id 8B1FE1B768
 for <dev@dpdk.org>; Tue, 15 May 2018 18:17:30 +0200 (CEST)
Received: from compute1.internal (compute1.nyi.internal [10.202.2.41])
 by mailout.nyi.internal (Postfix) with ESMTP id 0EB3F220EE;
 Tue, 15 May 2018 12:17:30 -0400 (EDT)
Received: from mailfrontend1 ([10.202.2.162])
 by compute1.internal (MEProxy); Tue, 15 May 2018 12:17:30 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=monjalon.net; h=
 cc:content-transfer-encoding:content-type:date:from:in-reply-to
 :message-id:mime-version:references:subject:to:x-me-sender
 :x-me-sender:x-sasl-enc; s=mesmtp; bh=qWJpFqVgM6u2xzvb+ZjckzqlrK
 SaIyFpdHwrwB1KHEE=; b=e6jka6Pji8b9Nzw0tNMYS8QUmn/nY7/TtpoExTbLc0
 O9f/D4QCPApUGju56rKv1ByItigsHqL+mCLDS9/SHoNm3mBFJwQQCNSn+GgxQH8a
 E6UQbM8j7dyKZmdqYZuZ+pdP4Hi01CGq5c0EU5kKT2CX4z9A3r5nGbJNn+J7JhIf
 Y=
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-transfer-encoding:content-type
 :date:from:in-reply-to:message-id:mime-version:references
 :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=qWJpFq
 VgM6u2xzvb+ZjckzqlrKSaIyFpdHwrwB1KHEE=; b=jZbJku8f+pe93lz1v7qj9j
 vstdw1upCJSOxVtzzmlSMpcAVH5nmkGnBsHOk898jat6qKERGE1p5CUbqm6sGKPn
 78swn5xZWQPjIN/21aG+axPNS6h08LdS4Eo+DSZbPKuV7qKucPb6i1m7hwYHY52A
 mfnEJf0gKoln+fS8T/X2/zPea6HvSGA/+5GShoYf3W/DKXg3vWuCMTs5I/xfu6Eb
 7NW22YdkTLFsMK2/pus9DSSaEKaLPh4Anjn7h2/Sk9njZsvOSBSg38ZbM1yUpbWf
 4dbLqX8qk+jKuvUu3hBwBODNHEedjiy2BdxqiKPIMvEozbvx+51rTtT6gpGFv4pw
 ==
X-ME-Sender: <xms:GQj7Wi_nMpjLjTHF2W1imKm9rVNU3RN3F1ANvBaWSuc203N_d0iqMQ>
Received: from xps.localnet (184.203.134.77.rev.sfr.net [77.134.203.184])
 by mail.messagingengine.com (Postfix) with ESMTPA id 486D8E4FD2;
 Tue, 15 May 2018 12:17:29 -0400 (EDT)
From: Thomas Monjalon <thomas@monjalon.net>
To: "Parthasarathy, JananeeX M" <jananeex.m.parthasarathy@intel.com>
Cc: "dev@dpdk.org" <dev@dpdk.org>, "Burakov,
 Anatoly" <anatoly.burakov@intel.com>, "Pattan,
 Reshma" <reshma.pattan@intel.com>
Date: Tue, 15 May 2018 18:17:28 +0200
Message-ID: <117420816.XQrphXIzck@xps>
In-Reply-To: <7AE31235A30B41498D1C31348DC858BD5B3D4DED@IRSMSX103.ger.corp.intel.com>
References: <1524835241-12778-1-git-send-email-reshma.pattan@intel.com>
 <2992140.TScDacoaO3@xps>
 <7AE31235A30B41498D1C31348DC858BD5B3D4DED@IRSMSX103.ger.corp.intel.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="us-ascii"
Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 15 May 2018 16:17:30 -0000

15/05/2018 18:14, Parthasarathy, JananeeX M:
> From: Thomas Monjalon [mailto:thomas@monjalon.net] 
> > 10/05/2018 12:36, Jananee Parthasarathy:
> > > 1. Sanity Script is enhanced with additional test cases being added to
> > > autotest_data.py
> > 
> > How long they are?
> > How did you choose to group them?
> 
> It took approximately ~30 min, but longer duration is due to failed test cases (15m) which times out due to crash.

What was the duration of make test before your patch?

I think we need to keep a fast subset of tests.
Please check in mk/rte.sdktest.mk:
	PERFLIST=ring_perf,mempool_perf,memcpy_perf,hash_perf,timer_perf
	test-fast: BLACKLIST=-$(PERFLIST)