Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script

["Parthasarathy, JananeeX M" <jananeex.m.parthasarathy@intel.com>]

Hi Thomas,

-----Original Message-----
From: Thomas Monjalon [mailto:thomas@monjalon.net] 
Sent: Tuesday, May 15, 2018 9:47 PM
To: Parthasarathy, JananeeX M <jananeex.m.parthasarathy@intel.com>
Cc: dev@dpdk.org; Burakov, Anatoly <anatoly.burakov@intel.com>; Pattan, Reshma <reshma.pattan@intel.com>
Subject: Re: [dpdk-dev] [PATCH v2] app/test: enhance sanity script

15/05/2018 18:14, Parthasarathy, JananeeX M:
> From: Thomas Monjalon [mailto:thomas@monjalon.net]
> > 10/05/2018 12:36, Jananee Parthasarathy:
> > > 1. Sanity Script is enhanced with additional test cases being 
> > > added to autotest_data.py
> > 
> > How long they are?
> > How did you choose to group them?
> 
> It took approximately ~30 min, but longer duration is due to failed test cases (15m) which times out due to crash.

What was the duration of make test before your patch?

Using "make test-fast", total run time is 32s.
Earlier, we had run the tests directly using the python script in test/test folder as
  Eg:    ./autotest.py ./build/app/test may7_log
This has run all the test cases which took long time.

I think we need to keep a fast subset of tests.
Please check in mk/rte.sdktest.mk:
	PERFLIST=ring_perf,mempool_perf,memcpy_perf,hash_perf,timer_perf
	test-fast: BLACKLIST=-$(PERFLIST)

We have added the below test cases to blacklist in mk/rte.sdktest.mk
reciprocal_division,reciprocal_division_perf,lpm_perf,red_all

Now time taken is around 4mins. 
Please let us know is there any minimum time limit for test execution.
Is this time duration fine?
	
Thanks
M.P.Jananee
--------------------------------------------------------------
Intel Research and Development Ireland Limited
Registered in Ireland
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare
Registered Number: 308263


This e-mail and any attachments may contain confidential material for the sole
use of the intended recipient(s). Any review or distribution by others is
strictly prohibited. If you are not the intended recipient, please contact the
sender and delete all copies.