test suite reviews and discussions
 help / color / mirror / Atom feed
From: Xiao Qimai <qimaix.xiao@intel.com>
To: dts@dpdk.org
Cc: Xiao Qimai <qimaix.xiao@intel.com>
Subject: [dts] [PATCH V2 14/17]vhost_multi_queue_qemu: update mpps value to check perf
Date: Fri,  5 Jun 2020 17:18:21 +0800	[thread overview]
Message-ID: <1591348704-433901-15-git-send-email-qimaix.xiao@intel.com> (raw)
In-Reply-To: <1591348704-433901-1-git-send-email-qimaix.xiao@intel.com>

Signed-off-by: Xiao Qimai <qimaix.xiao@intel.com>
---
 tests/TestSuite_vhost_multi_queue_qemu.py | 17 +++++++++++++----
 1 file changed, 13 insertions(+), 4 deletions(-)

diff --git a/tests/TestSuite_vhost_multi_queue_qemu.py b/tests/TestSuite_vhost_multi_queue_qemu.py
index c111846..88524d0 100644
--- a/tests/TestSuite_vhost_multi_queue_qemu.py
+++ b/tests/TestSuite_vhost_multi_queue_qemu.py
@@ -58,7 +58,7 @@ class TestVhostMultiQueueQemu(TestCase):
         self.cores = self.dut.get_core_list("1S/3C/1T", socket=self.socket)
         self.verify(len(self.cores) >= 3, "Insufficient cores for speed testing")
         self.pci_info = self.dut.ports_info[0]['pci']
-
+        self.frame_sizes = [64, 128, 256, 512, 1024, 1500]
         self.queue_number = 2
         # Using file to save the vhost sample output since in jumboframe case,
         # there will be lots of output
@@ -87,8 +87,6 @@ class TestVhostMultiQueueQemu(TestCase):
         self.dut.send_expect("rm -rf ./vhost.out", "#")
         self.dut.send_expect("rm -rf %s/vhost-net*" % self.base_dir, "#")
         self.dut.send_expect("killall -s INT testpmd", "#")
-
-        self.frame_sizes = [64, 128, 256, 512, 1024, 1500]
         self.vm_testpmd_vector = self.target + "/app/testpmd -c %s -n 3" + \
                                  " -- -i --tx-offloads=0x0 " + \
                                  " --rxq=%d --txq=%d --rss-ip --nb-cores=2" % (self.queue_number, self.queue_number)
@@ -137,6 +135,15 @@ class TestVhostMultiQueueQemu(TestCase):
         self.verify(len(cores) >= 3, "Insufficient cores for speed testing, add the cpu number in cfg file.")
         self.vm_coremask = utils.create_mask(cores)
 
+    @property
+    def check_value(self):
+        check_dict = dict.fromkeys(self.frame_sizes)
+        linerate = {64: 0.09, 128: 0.15, 256: 0.25, 512: 0.40, 1024: 0.50, 1280: 0.55, 1500: 0.60}
+        for size in self.frame_sizes:
+            speed = self.wirespeed(self.nic, size, self.number_of_ports)
+            check_dict[size] = round(speed * linerate[size], 2)
+        return check_dict
+
     def vhost_performance(self):
         """
         Verify the testpmd can receive and forward the data
@@ -168,7 +175,9 @@ class TestVhostMultiQueueQemu(TestCase):
                                      self.number_of_ports))
             data_row = [frame_size, str(Mpps), str(pct), "Mergeable Multiqueue Performance"]
             self.result_table_add(data_row)
-            self.verify(Mpps != 0, "The receive data of frame-size: %d is 0" % frame_size)
+            self.verify(Mpps > self.check_value[frame_size],
+                        "%s of frame size %d speed verify failed, expect %s, result %s" % (
+                            self.running_case, frame_size, self.check_value[frame_size], Mpps))
         self.result_table_print()
 
     def send_and_verify(self, verify_type):
-- 
1.8.3.1


  parent reply	other threads:[~2020-06-05  9:27 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-06-05  9:18 [dts] [PATCH V2 00/17] update mpps in virtio cases to check performance Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 01/17]loopback_multi_paths_port_restart: update mpps value to check perf Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 02/17]loopback_multi_queues: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 03/17]loopback_virtio_user_server_mode: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 04/17]pvp_diff_qemu_version: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 05/17]pvp_multi_paths_performance: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 06/17]pvp_multi_paths_vhost_single_core_performance: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 07/17]pvp_multi_paths_virtio_single_core_performance: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 08/17]pvp_qemu_multi_paths_port_restart: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 09/17]pvp_vhost_user_built_in_net_driver: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 10/17]pvp_virtio_user_2M_hugepages: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 11/17]pvp_virtio_user_4k_pages: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 12/17]pvp_virtio_user_multi_queues_port_restart: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 13/17]vhost_dequeue_zero_copy: " Xiao Qimai
2020-06-05  9:18 ` Xiao Qimai [this message]
2020-06-05  9:18 ` [dts] [PATCH V2 15/17]virtio_pvp_regression: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 16/17]virtio_user_for_container_networking: " Xiao Qimai
2020-06-05  9:18 ` [dts] [PATCH V2 17/17]vm2vm_virtio_pmd: " Xiao Qimai
2020-06-05  9:30 ` [dts] [PATCH V2 00/17] update mpps in virtio cases to check performance Xiao, QimaiX
2020-06-08  6:34   ` Wang, Yinan
2020-06-11 12:36   ` Tu, Lijuan
2020-06-12  4:48   ` Wang, Yinan
2020-06-19  3:20 ` Tu, Lijuan

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1591348704-433901-15-git-send-email-qimaix.xiao@intel.com \
    --to=qimaix.xiao@intel.com \
    --cc=dts@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).