[dpdk-dev] [PATCH 1/2] test: create a list of extra tests

[dpdk-dev] [PATCH 1/2] test: create a list of extra tests

[David Marchand]

We removed some tests from the "CI" (fast-tests) list because they
were not reliable enough or did not make sense as non regression tests.
Since we still build those tests code, leave an option for users to call
them.
This list can also serve as a point where to document why test X is not
suitable for the "CI" list.

Signed-off-by: David Marchand <david.marchand@redhat.com>
---
 app/test/meson.build | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

diff --git a/app/test/meson.build b/app/test/meson.build
index 20f36a1803..200790eda0 100644
--- a/app/test/meson.build
+++ b/app/test/meson.build
@@ -287,6 +287,14 @@ fast_tests = [
         ['trace_autotest', true],
 ]
 
+# Tests known to have issues or which don't belong in other tests lists.
+extra_test_names = [
+        # ee00af60170b ("test: remove strict timing requirements some tests")
+        'alarm_autotest',
+        'cycles_autotest',
+        'delay_us_sleep_autotest',
+]
+
 perf_test_names = [
         'ring_perf_autotest',
         'mempool_perf_autotest',
@@ -525,3 +533,11 @@ foreach arg : dump_test_names
             is_parallel : false,
             suite : 'debug-tests')
 endforeach
+
+foreach arg : extra_test_names
+    test(arg, dpdk_test,
+            env : ['DPDK_TEST=' + arg],
+            timeout : timeout_seconds,
+            is_parallel : false,
+            suite : 'extra-tests')
+endforeach
-- 
2.23.0

[dpdk-dev] [PATCH 2/2] test: move RED to extra tests list

[David Marchand]

This test gives random failures, disable it.
See: https://bugs.dpdk.org/show_bug.cgi?id=826

Signed-off-by: David Marchand <david.marchand@redhat.com>
---
 app/test/meson.build | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/app/test/meson.build b/app/test/meson.build
index 200790eda0..71fce2efda 100644
--- a/app/test/meson.build
+++ b/app/test/meson.build
@@ -248,7 +248,6 @@ fast_tests = [
         ['pflock_autotest', true],
         ['prefetch_autotest', true],
         ['rcu_qsbr_autotest', true],
-        ['red_autotest', true],
         ['rib_autotest', true],
         ['rib6_autotest', true],
         ['ring_autotest', true],
@@ -293,6 +292,8 @@ extra_test_names = [
         'alarm_autotest',
         'cycles_autotest',
         'delay_us_sleep_autotest',
+        # https://bugs.dpdk.org/show_bug.cgi?id=826
+        'red_autotest',
 ]
 
 perf_test_names = [
-- 
2.23.0

Re: [dpdk-dev] [PATCH 2/2] test: move RED to extra tests list

[David Marchand]

On Wed, Oct 27, 2021 at 4:05 PM David Marchand
<david.marchand@redhat.com> wrote:
>
> This test gives random failures, disable it.
> See: https://bugs.dpdk.org/show_bug.cgi?id=826
>
> Signed-off-by: David Marchand <david.marchand@redhat.com>

There was no objection and it helps stabilising CI (removing a random
false positive).
Series applied with one nit from Thomas.


-- 
David Marchand