DPDK patches and discussions
 help / color / mirror / Atom feed
From: Aaron Conole <aconole@redhat.com>
To: dev@dpdk.org
Subject: [dpdk-dev] [RFC 2/3] meson-tests: separate slower tests
Date: Fri, 29 Mar 2019 13:22:40 -0400	[thread overview]
Message-ID: <20190329172241.11916-3-aconole@redhat.com> (raw)
In-Reply-To: <20190329172241.11916-1-aconole@redhat.com>

When running some tests in the CI environment, the run time can take
in excess of 10 minutes to produce output.  This causes the entire CI run
not to succeed.  Separate these tests so that they can be run from a
normal environment, and deselected in a CI environment.

There's also a small whitespace fix bundled in for the perf_tests block.

Signed-off-by: Aaron Conole <aconole@redhat.com>
---
 app/test/meson.build | 34 ++++++++++++++++++++++++----------
 1 file changed, 24 insertions(+), 10 deletions(-)

diff --git a/app/test/meson.build b/app/test/meson.build
index 975b38daa..1b0ff0523 100644
--- a/app/test/meson.build
+++ b/app/test/meson.build
@@ -171,7 +171,6 @@ fast_parallel_test_names = [
         'red_autotest',
         'ring_autotest',
         'ring_pmd_autotest',
-        'rwlock_autotest',
         'sched_autotest',
         'spinlock_autotest',
         'string_autotest',
@@ -214,15 +213,21 @@ fast_non_parallel_test_names = [
         'thash_autotest',
 ]
 
+# These test cases are non-parallel and also take > 10m to execute in
+# some environments (such as CI systems), so allow deselecting them
+slow_test_names = [
+        'rwlock_autotest',
+        'mempool_perf_autotest',
+        'reciprocal_division',
+        'reciprocal_division_perf',
+]
+
 # All test cases in perf_test_names list are non-parallel
 perf_test_names = [
         'ring_perf_autotest',
-        'mempool_perf_autotest',
         'memcpy_perf_autotest',
         'hash_perf_autotest',
         'timer_perf_autotest',
-        'reciprocal_division',
-        'reciprocal_division_perf',
         'lpm_perf_autotest',
         'red_all',
         'barrier_autotest',
@@ -332,7 +337,7 @@ if get_option('tests')
 		install_rpath: driver_install_path,
 		install: false)
 
-	# some perf tests (eg: memcpy perf autotest)take very long
+	# some tests (eg: the slow tests) take very long
 	# to complete, so timeout to 10 minutes
 	timeout_seconds = 600
 	timeout_seconds_fast = 10
@@ -359,13 +364,22 @@ if get_option('tests')
 			suite : 'fast-tests')
 	endforeach
 
+	foreach arg : slow_test_names
+		test(arg, dpdk_test,
+			env : ['DPDK_TEST=' + arg],
+			args : test_args + ['--file-prefix=@0@'.format(arg)],
+			timeout : timeout_seconds,
+			is_parallel : false,
+			suite : 'slow-tests')
+	endforeach
+
 	foreach arg : perf_test_names
 		test(arg, dpdk_test,
-		env : ['DPDK_TEST=' + arg],
-		args : test_args + ['--file-prefix=@0@'.format(arg)],
-		timeout : timeout_seconds,
-		is_parallel : false,
-		suite : 'perf-tests')
+			env : ['DPDK_TEST=' + arg],
+			args : test_args + ['--file-prefix=@0@'.format(arg)],
+			timeout : timeout_seconds,
+			is_parallel : false,
+			suite : 'perf-tests')
 	endforeach
 
 	foreach arg : driver_test_names
-- 
2.19.1

  parent reply	other threads:[~2019-03-29 17:22 UTC|newest]

Thread overview: 38+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-03-29 17:22 [dpdk-dev] [RFC 0/3] ci: enable unit tests for non-aarch64 platforms Aaron Conole
2019-03-29 17:22 ` Aaron Conole
2019-03-29 17:22 ` [dpdk-dev] [RFC 1/3] test/meson: auto detect number of cores Aaron Conole
2019-03-29 17:22   ` Aaron Conole
2019-04-01 13:48   ` David Marchand
2019-04-01 13:48     ` David Marchand
2019-04-01 14:07     ` Aaron Conole
2019-04-01 14:07       ` Aaron Conole
2019-04-01 16:23   ` Pattan, Reshma
2019-04-01 16:23     ` Pattan, Reshma
2019-04-01 17:48     ` Aaron Conole
2019-04-01 17:48       ` Aaron Conole
2019-04-01 19:39       ` Thomas Monjalon
2019-04-01 19:39         ` Thomas Monjalon
2019-04-01 19:58         ` Aaron Conole
2019-04-01 19:58           ` Aaron Conole
2019-03-29 17:22 ` Aaron Conole [this message]
2019-03-29 17:22   ` [dpdk-dev] [RFC 2/3] meson-tests: separate slower tests Aaron Conole
2019-03-29 17:22 ` [dpdk-dev] [RFC 3/3] ci: enable tests on non-arm platforms Aaron Conole
2019-03-29 17:22   ` Aaron Conole
2019-04-17  8:32   ` Jerin Jacob Kollanukkaran
2019-04-17  8:32     ` Jerin Jacob Kollanukkaran
2019-04-17 12:39     ` Aaron Conole
2019-04-17 12:39       ` Aaron Conole
2019-04-17 15:32       ` [dpdk-dev] [EXT] " Jerin Jacob Kollanukkaran
2019-04-17 15:32         ` Jerin Jacob Kollanukkaran
2019-04-01 19:15 ` [dpdk-dev] [RFC 0/3] ci: enable unit tests for non-aarch64 platforms David Marchand
2019-04-01 19:15   ` David Marchand
2019-04-01 19:28   ` Aaron Conole
2019-04-01 19:28     ` Aaron Conole
2019-04-01 19:29     ` David Marchand
2019-04-01 19:29       ` David Marchand
2019-04-02  9:37       ` Bruce Richardson
2019-04-02  9:37         ` Bruce Richardson
2019-04-02 10:09         ` David Marchand
2019-04-02 10:09           ` David Marchand
2019-04-02 12:49           ` Aaron Conole
2019-04-02 12:49             ` Aaron Conole

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20190329172241.11916-3-aconole@redhat.com \
    --to=aconole@redhat.com \
    --cc=dev@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).