From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by dpdk.org (Postfix) with ESMTP id B8C91F94 for ; Tue, 24 Jul 2018 03:51:12 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga001.jf.intel.com ([10.7.209.18]) by fmsmga103.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 23 Jul 2018 18:51:10 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.51,394,1526367600"; d="scan'208";a="75337970" Received: from juan.sh.intel.com ([10.67.118.154]) by orsmga001.jf.intel.com with ESMTP; 23 Jul 2018 18:50:54 -0700 From: Lijuan Tu To: dts@dpdk.org Cc: Lijuan Tu Date: Tue, 24 Jul 2018 18:20:02 +0800 Message-Id: <1532427605-127449-1-git-send-email-lijuan.tu@intel.com> X-Mailer: git-send-email 1.8.3.1 Subject: [dts] [next] [PATCH V3 0/3] support update-expected to meet Open Lab requirement X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jul 2018 01:51:14 -0000 The Linux Foundation's DPDK Project has established a DPDK Performance Test Lab. Its specification requires DTS to support an --update-expected argument which will cause the script to update all expected values based on the results of the current test run. So far, single core performance test has been deployed, and more test cases will be deployed in future. Currently single core performance test script has many hardcode, remove them and make it more appropriate to meet the DPDK Performance Test Lab Specification. Lijuan Tu (3): framework: support argument: --update-expected. tests/nic_single_core_perf: remove hardcode conf/nic_single_core_perf: redefine elements conf/nic_single_core_perf.cfg | 37 +++- framework/config.py | 11 + framework/dts.py | 6 +- framework/main.py | 6 +- framework/settings.py | 1 + framework/test_case.py | 22 +- tests/TestSuite_nic_single_core_perf.py | 378 ++++++++++++++++---------------- 7 files changed, 264 insertions(+), 197 deletions(-) -- 1.8.3.1