From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2AA5CA00C4; Fri, 5 Jun 2020 11:26:49 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 21A091D5FB; Fri, 5 Jun 2020 11:26:49 +0200 (CEST) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 90F5B1D60B for ; Fri, 5 Jun 2020 11:26:47 +0200 (CEST) IronPort-SDR: lTDysdkw80iKsZOhVNKFpBvWDuGHb+xaDc2fWbHOh6NVX3tXMGd3POV5WSRdhI9Z34wlcpL8l6 hU8LmRvyVQxw== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga002.jf.intel.com ([10.7.209.21]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Jun 2020 02:26:47 -0700 IronPort-SDR: Yx+IrWX5cAjWk5XsnB+NJD+Ei/hFvCmz7N4E01KDzf4mJbDyQztOP5iiL/+aPLKybJHDldMiUy BQ6VqnbYoyMw== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,475,1583222400"; d="scan'208";a="287676972" Received: from unknown (HELO xqm-virtio_tester.sh.intel.com) ([10.240.183.52]) by orsmga002.jf.intel.com with ESMTP; 05 Jun 2020 02:26:46 -0700 From: Xiao Qimai To: dts@dpdk.org Cc: Xiao Qimai Date: Fri, 5 Jun 2020 17:18:11 +0800 Message-Id: <1591348704-433901-5-git-send-email-qimaix.xiao@intel.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1591348704-433901-1-git-send-email-qimaix.xiao@intel.com> References: <1591348704-433901-1-git-send-email-qimaix.xiao@intel.com> Subject: [dts] [PATCH V2 04/17]pvp_diff_qemu_version: update mpps value to check perf X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Signed-off-by: Xiao Qimai --- tests/TestSuite_pvp_diff_qemu_version.py | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-) diff --git a/tests/TestSuite_pvp_diff_qemu_version.py b/tests/TestSuite_pvp_diff_qemu_version.py index b9ce822..91b7bd3 100644 --- a/tests/TestSuite_pvp_diff_qemu_version.py +++ b/tests/TestSuite_pvp_diff_qemu_version.py @@ -81,6 +81,7 @@ class TestVhostPVPDiffQemuVersion(TestCase): self.pktgen_helper = PacketGeneratorHelper() self.base_dir = self.dut.base_dir.replace('~', '/root') self.pci_info = self.dut.ports_info[0]['pci'] + self.number_of_ports = 1 def set_up(self): """ @@ -220,6 +221,15 @@ class TestVhostPVPDiffQemuVersion(TestCase): self.vm_dut.send_expect("set fwd mac", "testpmd> ", 20) self.vm_dut.send_expect("start", "testpmd> ") + @property + def check_value(self): + check_dict = dict.fromkeys(self.frame_sizes) + linerate = {64: 0.07, 128: 0.10, 256: 0.17, 512: 0.18, 1024: 0.35, 1280: 0.40, 1500: 0.45} + for size in self.frame_sizes: + speed = self.wirespeed(self.nic, size, self.number_of_ports) + check_dict[size] = round(speed * linerate[size], 2) + return check_dict + def send_verify(self, qemu_version, vlan_id1=0, tag="Performance"): self.result_table_create(self.header_row) for frame_size in self.frame_sizes: @@ -243,7 +253,9 @@ class TestVhostPVPDiffQemuVersion(TestCase): _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams, options=traffic_opt) Mpps = pps / 1000000.0 pct = Mpps * 100 / float(self.wirespeed(self.nic, frame_size, 1)) - self.verify(Mpps != 0, "can not received data of frame size %d" % frame_size) + self.verify(Mpps > self.check_value[frame_size], + "%s of frame size %d speed verify failed, expect %s, result %s" % ( + self.running_case, frame_size, self.check_value[frame_size], Mpps)) # update print table info data_row = [qemu_version, frame_size, str(Mpps), str(pct), tag] self.result_table_add(data_row) -- 1.8.3.1