[PATCH V1 0/2] modify the test suite to be consistent with the test plan

test suite reviews and discussions
 help / color / mirror / Atom feed

* [PATCH V1 0/2] modify the test suite to be consistent with the test plan
@ 2023-07-04 10:59 Dukai Yuan
  2023-07-04 10:59 ` [dts][PATCH V1 1/2] tests/pvp_multi_paths_virtio_single_core_performance: keep test suite " Dukai Yuan
  2023-07-04 10:59 ` [dts][PATCH V1 2/2] conf/pvp_multi_paths_virtio_single_core_performance: update the configuration file to fit the test suite Dukai Yuan
  0 siblings, 2 replies; 3+ messages in thread
From: Dukai Yuan @ 2023-07-04 10:59 UTC (permalink / raw)
  To: dts; +Cc: Dukai Yuan

*** BLURB HERE ***

Dukai Yuan (2):
  tests/pvp_multi_paths_virtio_single_core_performance: keep test suite consistent with the test plan
  conf/pvp_multi_paths_virtio_single_core_performance: update the configuration file to fit the test suite

 ...i_paths_virtio_single_core_performance.cfg | 12 ++---
 ...ti_paths_virtio_single_core_performance.py | 50 +++++++++----------
 2 files changed, 31 insertions(+), 31 deletions(-)

-- 
2.31.1


^ permalink raw reply	[flat|nested] 3+ messages in thread

* [dts][PATCH V1 1/2] tests/pvp_multi_paths_virtio_single_core_performance: keep test suite consistent with the test plan
  2023-07-04 10:59 [PATCH V1 0/2] modify the test suite to be consistent with the test plan Dukai Yuan
@ 2023-07-04 10:59 ` Dukai Yuan
  2023-07-04 10:59 ` [dts][PATCH V1 2/2] conf/pvp_multi_paths_virtio_single_core_performance: update the configuration file to fit the test suite Dukai Yuan
  1 sibling, 0 replies; 3+ messages in thread
From: Dukai Yuan @ 2023-07-04 10:59 UTC (permalink / raw)
  To: dts; +Cc: Dukai Yuan

Some differences exist between the test suite and the test plan, 
so modify the scripts to be consistent with the test plan.

Signed-off-by: Dukai Yuan <dukaix.yuan@intel.com>
---
 ...ti_paths_virtio_single_core_performance.py | 50 +++++++++----------
 1 file changed, 25 insertions(+), 25 deletions(-)

diff --git a/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py b/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py
index fa7940c6..f88d037f 100644
--- a/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py
+++ b/tests/TestSuite_pvp_multi_paths_virtio_single_core_performance.py
@@ -302,7 +302,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
 
     def test_perf_virtio_single_core_virtio11_mergeable(self):
         """
-        performance for Vhost PVP virtio 1.1 Mergeable Path.
+        Case 1:performance for Vhost PVP virtio 1.1 mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -314,16 +314,16 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio_1.1_mergeable on")
+        self.send_and_verify("virtio1.1_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
         self.handle_expected()
         self.handle_results()
 
-    def test_perf_virtio_single_core_virtio11_normal(self):
+    def test_perf_virtio_single_core_virtio11_non_mergeable(self):
         """
-        performance for Vhost PVP virtio1.1 Normal Path.
+        Case 2:performance for Vhost PVP virtio1.1 non-mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -335,7 +335,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio_1.1_normal")
+        self.send_and_verify("virtio1.1_non_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
@@ -344,7 +344,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
 
     def test_perf_virtio_single_core_virtio11_inorder_mergeable(self):
         """
-        performance for Vhost PVP virtio 1.1 inorder  Mergeable Path.
+        Case 8:performance for Vhost PVP virtio 1.1 inorder  mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -356,16 +356,16 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio_1.1_inorder_mergeable on")
+        self.send_and_verify("virtio1.1_inorder_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
         self.handle_expected()
         self.handle_results()
 
-    def test_perf_virtio_single_core_virtio11_inorder_normal(self):
+    def test_perf_virtio_single_core_virtio11_inorder_non_mergeable(self):
         """
-        performance for Vhost PVP virtio1.1 inorder Normal Path.
+        Case 9:performance for Vhost PVP virtio1.1 inorder non-mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -377,7 +377,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio_1.1_inorder_normal")
+        self.send_and_verify("virtio1.1_inorder_non_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
@@ -386,7 +386,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
 
     def test_perf_virtio_single_core_virtio11_vectorized(self):
         """
-        performance for Vhost PVP virtio1.1 vectorized Path.
+        Case 10:performance for Vhost PVP virtio1.1 vectorized Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -398,7 +398,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio_1.1_inorder_normal")
+        self.send_and_verify("virtio1.1_vectorized")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
@@ -407,7 +407,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
 
     def test_perf_virtio_single_core_inorder_mergeable(self):
         """
-        performance for Vhost PVP In_order mergeable Path.
+        Case 3:performance for Vhost PVP in_order mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -419,16 +419,16 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("inoder mergeable on")
+        self.send_and_verify("virtio1.0_inorder_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
         self.handle_expected()
         self.handle_results()
 
-    def test_perf_virtio_single_core_inorder_normal(self):
+    def test_perf_virtio_single_core_inorder_non_mergeable(self):
         """
-        performance for Vhost PVP In_order normal Path.
+        Case 4:performance for Vhost PVP in_order non-mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -440,7 +440,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("inoder mergeable off")
+        self.send_and_verify("virtio1.0_inorder_non_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
@@ -449,7 +449,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
 
     def test_perf_virtio_single_core_mergeable(self):
         """
-        performance for Vhost PVP Mergeable Path.
+        Case 5:performance for Vhost PVP mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -461,16 +461,16 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virito mergeable")
+        self.send_and_verify("virtio1.0_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
         self.handle_expected()
         self.handle_results()
 
-    def test_perf_virtio_single_core_normal(self):
+    def test_perf_virtio_single_core_non_mergeable(self):
         """
-        performance for Vhost PVP Normal Path.
+        Case 6:performance for Vhost PVP non-mergeable Path.
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -482,16 +482,16 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virito normal")
+        self.send_and_verify("virito1.0_non_mergeable")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
         self.handle_expected()
         self.handle_results()
 
-    def test_perf_virtio_single_core_vector_rx(self):
+    def test_perf_virtio_single_core_vectorized_rx(self):
         """
-        performance for Vhost PVP Vector Path
+        Case 7:performance for Vhost PVP vectorized Path
         """
         self.test_target = self.running_case
         self.expected_throughput = self.get_suite_cfg()["expected_throughput"][
@@ -503,7 +503,7 @@ class TestPVPMultiPathsVirtioSingleCorePerformance(TestCase):
         }
         self.start_vhost_testpmd()
         self.start_virtio_testpmd(virtio_pmd_arg)
-        self.send_and_verify("virtio vector rx")
+        self.send_and_verify("virtio1.0_vectorized_rx")
         self.close_all_testpmd()
         self.logger.info("result of all framesize result")
         self.result_table_print()
-- 
2.31.1


^ permalink raw reply	[flat|nested] 3+ messages in thread

* [dts][PATCH V1 2/2] conf/pvp_multi_paths_virtio_single_core_performance: update the configuration file to fit the test suite
  2023-07-04 10:59 [PATCH V1 0/2] modify the test suite to be consistent with the test plan Dukai Yuan
  2023-07-04 10:59 ` [dts][PATCH V1 1/2] tests/pvp_multi_paths_virtio_single_core_performance: keep test suite " Dukai Yuan
@ 2023-07-04 10:59 ` Dukai Yuan
  1 sibling, 0 replies; 3+ messages in thread
From: Dukai Yuan @ 2023-07-04 10:59 UTC (permalink / raw)
  To: dts; +Cc: Dukai Yuan

Update the configuration file to fit the test suite.

Signed-off-by: Dukai Yuan <dukaix.yuan@intel.com>
---
 ...vp_multi_paths_virtio_single_core_performance.cfg | 12 ++++++------
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/conf/pvp_multi_paths_virtio_single_core_performance.cfg b/conf/pvp_multi_paths_virtio_single_core_performance.cfg
index a1495e42..0f89b8af 100644
--- a/conf/pvp_multi_paths_virtio_single_core_performance.cfg
+++ b/conf/pvp_multi_paths_virtio_single_core_performance.cfg
@@ -5,13 +5,13 @@ test_duration = 60
 accepted_tolerance = 2
 expected_throughput = {
     'test_perf_virtio_single_core_virtio11_vectorized': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
+    'test_perf_virtio_single_core_virtio11_inorder_non_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
     'test_perf_virtio_single_core_virtio11_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_virtio11_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
+    'test_perf_virtio_single_core_virtio11_non_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
     'test_perf_virtio_single_core_virtio11_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_virtio11_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
+    'test_perf_virtio_single_core_virtio11_inorder_non_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
     'test_perf_virtio_single_core_inorder_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_inorder_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
+    'test_perf_virtio_single_core_inorder_non_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
     'test_perf_virtio_single_core_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_normal': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
-    'test_perf_virtio_single_core_vector_rx': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}}
+    'test_perf_virtio_single_core_non_mergeable': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}},
+    'test_perf_virtio_single_core_vectorized_rx': {64: {1024: 0.000}, 128: {1024: 0.000}, 256: {1024: 0.000}, 512: {1024: 0.000}, 1024: {1024: 0.000}, 1518: {1024: 0.000}}}
-- 
2.31.1


^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2023-07-04  3:23 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-07-04 10:59 [PATCH V1 0/2] modify the test suite to be consistent with the test plan Dukai Yuan
2023-07-04 10:59 ` [dts][PATCH V1 1/2] tests/pvp_multi_paths_virtio_single_core_performance: keep test suite " Dukai Yuan
2023-07-04 10:59 ` [dts][PATCH V1 2/2] conf/pvp_multi_paths_virtio_single_core_performance: update the configuration file to fit the test suite Dukai Yuan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).