From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by dpdk.org (Postfix) with ESMTP id A7579F72 for ; Mon, 23 Jul 2018 04:49:34 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by fmsmga107.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 22 Jul 2018 19:49:33 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,391,1526367600"; d="scan'208";a="75005967" Received: from juan.sh.intel.com ([10.67.118.154]) by orsmga001.jf.intel.com with ESMTP; 22 Jul 2018 19:49:32 -0700 From: Lijuan Tu To: dts@dpdk.org Cc: Lijuan Tu Date: Mon, 23 Jul 2018 19:18:41 +0800 Message-Id: <1532344724-109725-1-git-send-email-lijuan.tu@intel.com> X-Mailer: git-send-email 1.8.3.1 Subject: [dts] [next] [PATCH V2 0/3] support update-expected to meet Open Lab requirement X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jul 2018 02:49:35 -0000 The Linux Foundation's DPDK Project has established a DPDK Performance Test Lab. Its specification requires DTS to support an --update-expected argument which will cause the script to update all expected values based on the results of the current test run. So far, single core performance test has been deployed, and more test cases will be deployed in future. Currently single core performance test script has many hardcode, remove them and make it more appropriate to meet the DPDK Performance Test Lab Specification. Lijuan Tu (3): framework: support argument: --update-expected. tests/nic_single_core_perf: remove hardcode conf/nic_single_core_perf: redefine elements conf/nic_single_core_perf.cfg | 37 +++- framework/config.py | 11 + framework/dts.py | 6 +- framework/main.py | 6 +- framework/settings.py | 1 + framework/test_case.py | 24 +- tests/TestSuite_nic_single_core_perf.py | 374 ++++++++++++++++---------------- 7 files changed, 262 insertions(+), 197 deletions(-) -- 1.8.3.1