From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 97C884C94 for ; Fri, 20 Jul 2018 08:53:06 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga003.jf.intel.com ([10.7.209.27]) by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 19 Jul 2018 23:53:04 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,377,1526367600"; d="scan'208";a="68449276" Received: from juan.sh.intel.com ([10.67.118.154]) by orsmga003.jf.intel.com with ESMTP; 19 Jul 2018 23:53:03 -0700 From: Lijuan Tu To: dts@dpdk.org, pmacarth@iol.unh.edu, alialnu@mellanox.com Cc: Lijuan Tu Date: Fri, 20 Jul 2018 23:22:01 +0800 Message-Id: <1532100124-64769-1-git-send-email-lijuan.tu@intel.com> X-Mailer: git-send-email 1.8.3.1 Subject: [dts] [next] [PATCH 0/3] support update-expected to meet Open Lab requirement X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2018 06:53:07 -0000 The Linux Foundation's DPDK Project has established a DPDK Performance Test Lab. It's specification require DTS to support an --update-expected argument which will cause the script to update all expected values based on the results of the current test run. So far, single core performance test are deployed, and more test cases will be deployed in future. Current single core performance test script has many hardcode, remove them and make it more easily to meet the DPDK Performance Test Lab Specification. Lijuan Tu (3): framework: support argument: --update-expected. tests/nic_single_core_perf: remove hardcode conf/nic_single_core_perf: redefine elements conf/nic_single_core_perf.cfg | 33 ++- framework/config.py | 11 + framework/dts.py | 6 +- framework/main.py | 6 +- framework/settings.py | 1 + framework/test_case.py | 22 +- tests/TestSuite_nic_single_core_perf.py | 374 ++++++++++++++++---------------- 7 files changed, 256 insertions(+), 197 deletions(-) -- 1.8.3.1