From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id B38CEA056F; Tue, 3 Mar 2020 02:58:58 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id A93401BFF2; Tue, 3 Mar 2020 02:58:58 +0100 (CET) Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by dpdk.org (Postfix) with ESMTP id A39CD1BFF0 for ; Tue, 3 Mar 2020 02:58:57 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 02 Mar 2020 17:58:56 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.70,509,1574150400"; d="scan'208";a="286836090" Received: from fmsmsx103.amr.corp.intel.com ([10.18.124.201]) by FMSMGA003.fm.intel.com with ESMTP; 02 Mar 2020 17:58:56 -0800 Received: from shsmsx603.ccr.corp.intel.com (10.109.6.143) by FMSMSX103.amr.corp.intel.com (10.18.124.201) with Microsoft SMTP Server (TLS) id 14.3.439.0; Mon, 2 Mar 2020 17:58:56 -0800 Received: from shsmsx603.ccr.corp.intel.com (10.109.6.143) by SHSMSX603.ccr.corp.intel.com (10.109.6.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Tue, 3 Mar 2020 09:58:54 +0800 Received: from shsmsx603.ccr.corp.intel.com ([10.109.6.143]) by SHSMSX603.ccr.corp.intel.com ([10.109.6.143]) with mapi id 15.01.1713.004; Tue, 3 Mar 2020 09:58:54 +0800 From: "Ma, LihongX" To: "dts@dpdk.org" Thread-Topic: [dts][PATCH V1] tests/perf_virtio_user: write throughput value to report when case is failed Thread-Index: AQHV8P8w/F0x4TK0MEq8zVWnMq69qqg2HIRg Date: Tue, 3 Mar 2020 01:58:54 +0000 Message-ID: References: <1583173758-5410-1-git-send-email-lihongx.ma@intel.com> In-Reply-To: <1583173758-5410-1-git-send-email-lihongx.ma@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.36] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dts] [PATCH V1] tests/perf_virtio_user: write throughput value to report when case is failed X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Tested-by:ma,lihong Regards, Ma,lihong -----Original Message----- From: Ma, LihongX=20 Sent: Tuesday, March 3, 2020 2:29 AM To: dts@dpdk.org Cc: Ma, LihongX Subject: [dts][PATCH V1] tests/perf_virtio_user: write throughput value to = report when case is failed Signed-off-by: lihong --- tests/TestSuite_perf_virtio_user_loopback.py | 5 +++-- tests/TestSuite_perf_virtio_user_pvp.py | 3 +-- 2 files changed, 4 insertions(+), 4 deletions(-) diff --git a/tests/TestSuite_perf_virtio_user_loopback.py b/tests/TestSuite= _perf_virtio_user_loopback.py index 0fb97dd..822e6d9 100644 --- a/tests/TestSuite_perf_virtio_user_loopback.py +++ b/tests/TestSuite_perf_virtio_user_loopback.py @@ -142,6 +142,8 @@ class TestPerfVirtioUserLoopback(TestCase): """ results =3D 0.0 results_row =3D [] + out =3D self.vhost.send_expect("show port stats all", "testpmd>", = 60) + time.sleep(5) for i in range(10): out =3D self.vhost.send_expect("show port stats all", "testpmd= >", 60) time.sleep(5) @@ -261,7 +263,6 @@ class TestPerfVirtioUserLoopback(TestCase): row_dict0['status'] =3D 'PASS' else: row_dict0['status'] =3D 'FAIL' - self.verify(row_dict0['status'] =3D=3D 'PASS', 'The throug= hput is not in correct range') row_dict1 =3D dict(name=3D"Throughput", value=3Dresult_thr= oughput, unit=3D"Mpps", delta=3Ddelta) row_dict2 =3D dict(name=3D"Txd/Rxd", value=3Drow_in["TXD/R= XD"], unit=3D"descriptor") row_dict3 =3D dict(name=3D"frame_size", value=3Drow_in["Fr= ame Size"], unit=3D"bytes") @@ -274,7 +275,7 @@ class TestPerfVirtioUserLoo= pback(TestCase): '{0:s}_{1}.json'.format( self.nic, self.suite_name)), 'w') as fp= : json.dump(self.json_obj, fp) - self.verify("Fail" not in status_result, "Exceeded Gap") + self.verify("FAIL" not in status_result, "Exceeded Gap") =20 def test_perf_loopback_packed_ring_inorder_mergeable(self): """ diff --git a/tests/TestSuite_perf_virtio_user_pvp.py b/tests/TestSuite_perf= _virtio_user_pvp.py index 2073426..344dba5 100644 --- a/tests/TestSuite_perf_virtio_user_pvp.py +++ b/tests/TestSuite_perf_virtio_user_pvp.py @@ -358,7 +358,6 @@ class TestVirtioSingleCorePerf(TestCase): row_dict0['status'] =3D 'PASS' else: row_dict0['status'] =3D 'FAIL' - self.verify(row_dict0['status'] =3D=3D 'PASS', 'The throug= hput is not in correct range') row_dict1 =3D dict(name=3D"Throughput", value=3Dresult_thr= oughput, unit=3D"Mpps", delta=3Ddelta) row_dict2 =3D dict(name=3D"Txd/Rxd", value=3Drow_in["TXD/R= XD"], unit=3D"descriptor") row_dict3 =3D dict(name=3D"frame_size", value=3Drow_in["Fr= ame Size"], unit=3D"bytes") @@ -371,7 +370,7 @@ class TestVirtioSingleCoreP= erf(TestCase): '{0:s}_{1}.json'.format( self.nic, self.suite_name)), 'w') as fp= : json.dump(self.json_obj, fp) - self.verify("Fail" not in status_result, "Exceeded Gap") + self.verify("FAIL" not in status_result, "Exceeded Gap") =20 def tear_down(self): """ -- 2.7.4