From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 093B9A00C5; Fri, 5 Jun 2020 11:27:04 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id F085A1D631; Fri, 5 Jun 2020 11:27:03 +0200 (CEST) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id C7EC31D60A for ; Fri, 5 Jun 2020 11:27:02 +0200 (CEST) IronPort-SDR: ejP4orCpy/7m1GfNbR6QvsxCt5qoS4lEHes69Q7VtYEx3ocuzGn+iqULe6T02uCoj2Lus7WcsT JZgWR4Ox5c4w== X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga002.jf.intel.com ([10.7.209.21]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Jun 2020 02:27:02 -0700 IronPort-SDR: dd2ORo4dPuUOijD0LeffgiaREW9HmGrRhnBchq1Ky1sHjU8obk96mMW2ylMYkkJTWxLTOivtDx EseO7PozPvGw== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.73,475,1583222400"; d="scan'208";a="287677080" Received: from unknown (HELO xqm-virtio_tester.sh.intel.com) ([10.240.183.52]) by orsmga002.jf.intel.com with ESMTP; 05 Jun 2020 02:27:01 -0700 From: Xiao Qimai To: dts@dpdk.org Cc: Xiao Qimai Date: Fri, 5 Jun 2020 17:18:22 +0800 Message-Id: <1591348704-433901-16-git-send-email-qimaix.xiao@intel.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1591348704-433901-1-git-send-email-qimaix.xiao@intel.com> References: <1591348704-433901-1-git-send-email-qimaix.xiao@intel.com> Subject: [dts] [PATCH V2 15/17]virtio_pvp_regression: update mpps value to check perf X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Signed-off-by: Xiao Qimai --- tests/TestSuite_virtio_pvp_regression.py | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-) diff --git a/tests/TestSuite_virtio_pvp_regression.py b/tests/TestSuite_virtio_pvp_regression.py index 6a67fed..d9e0d30 100644 --- a/tests/TestSuite_virtio_pvp_regression.py +++ b/tests/TestSuite_virtio_pvp_regression.py @@ -55,6 +55,7 @@ class TestVirtioPVPRegression(TestCase): # Get and verify the ports self.dut_ports = self.dut.get_ports() self.pf = self.dut_ports[0] + self.number_of_ports = 1 # Get the port's socket netdev = self.dut.ports_info[self.pf]['port'] self.pci_info = self.dut.ports_info[self.pf]['pci'] @@ -302,6 +303,15 @@ class TestVirtioPVPRegression(TestCase): self.vhost.send_expect("start", "testpmd> ", 60) + @property + def check_value(self): + check_dict = dict.fromkeys(self.frame_sizes) + linerate = {64: 0.08, 128: 0.10, 256: 0.17, 512: 0.18, 1024: 0.40, 1280: 0.45, 1518: 0.50} + for size in self.frame_sizes: + speed = self.wirespeed(self.nic, size, self.number_of_ports) + check_dict[size] = round(speed * linerate[size], 2) + return check_dict + def send_verify(self, case_info, qemu_version, tag): for frame_size in self.frame_sizes: info = "Running test %s, and %d frame size." % (self.running_case, frame_size) @@ -326,7 +336,9 @@ class TestVirtioPVPRegression(TestCase): _, pps = self.tester.pktgen.measure_throughput(stream_ids=streams, options=traffic_opt) Mpps = pps / 1000000.0 pct = Mpps * 100 / float(self.wirespeed(self.nic, frame_size, 1)) - self.verify(Mpps != 0, "can not received data of frame size %d" % frame_size) + self.verify(Mpps > self.check_value[frame_size], + "%s of frame size %d speed verify failed, expect %s, result %s" % ( + self.running_case, frame_size, self.check_value[frame_size], Mpps)) # check each queue has data self.check_packets_of_each_queue(frame_size) # update print table info -- 1.8.3.1