From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 1BEA3A0543; Wed, 24 Aug 2022 18:25:00 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 05FE640DDE; Wed, 24 Aug 2022 18:25:00 +0200 (CEST) Received: from lb.pantheon.sk (lb.pantheon.sk [46.229.239.20]) by mails.dpdk.org (Postfix) with ESMTP id 4C3FD4067B for ; Wed, 24 Aug 2022 18:24:58 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by lb.pantheon.sk (Postfix) with ESMTP id 0EAA7CD271; Wed, 24 Aug 2022 18:24:56 +0200 (CEST) X-Virus-Scanned: amavisd-new at siecit.sk Received: from lb.pantheon.sk ([127.0.0.1]) by localhost (lb.pantheon.sk [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id nk7aCh3GP-M1; Wed, 24 Aug 2022 18:24:55 +0200 (CEST) Received: from entguard.lab.pantheon.local (unknown [46.229.239.141]) by lb.pantheon.sk (Postfix) with ESMTP id 89D5BCD261; Wed, 24 Aug 2022 18:24:54 +0200 (CEST) From: =?UTF-8?q?Juraj=20Linke=C5=A1?= To: thomas@monjalon.net, david.marchand@redhat.com, ronan.randles@intel.com, Honnappa.Nagarahalli@arm.com, ohilyard@iol.unh.edu, lijuan.tu@intel.com Cc: dev@dpdk.org, =?UTF-8?q?Juraj=20Linke=C5=A1?= Subject: [RFC PATCH v1 00/10] dts: add hello world testcase Date: Wed, 24 Aug 2022 16:24:44 +0000 Message-Id: <20220824162454.394285-1-juraj.linkes@pantheon.tech> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org The patch is built on top of the existing SSH connection patch submitted earlier and contains the rest of the code to run the most basic testcase, hello world, which just runs the hello world application and verifies the output. The code added is mostly about setting up the testbed, building DPDK on the system under test and then running the testcases defined in one testsuite. There are three areas which I'm planning on improving: 1. Revisit how the methods in Node, SutNode and TrafficGeneratorNode can be redistributed so that we have a clean split of code that common to both node types and that's specific to both. 2. Add abstraction that handle OS differences. 3. Better split of code into commits. A new version with the above changes will be submitted in around two-three weeks time. Juraj Linkeš (10): dts: hello world config options dts: hello world cli parameters and env vars dts: ssh connection additions for hello world dts: add basic node management methods dts: add system under test node dts: add traffic generator node dts: add testcase and basic test results dts: add test runner and statistics collector dts: add hello world testplan dts: add hello world testsuite dts/conf.yaml | 20 +- dts/framework/config/__init__.py | 141 ++++- dts/framework/config/conf_yaml_schema.json | 139 ++++- dts/framework/dts.py | 174 +++++- dts/framework/exception.py | 15 + dts/framework/logger.py | 9 +- dts/framework/node.py | 395 +++++++++++++- dts/framework/settings.py | 96 +++- dts/framework/ssh_connection.py | 19 + dts/framework/ssh_pexpect.py | 61 ++- dts/framework/stats_reporter.py | 70 +++ dts/framework/sut_node.py | 603 +++++++++++++++++++++ dts/framework/test_case.py | 274 ++++++++++ dts/framework/test_result.py | 218 ++++++++ dts/framework/tg_node.py | 78 +++ dts/framework/utils.py | 14 + dts/test_plans/hello_world_test_plan.rst | 68 +++ dts/tests/TestSuite_hello_world.py | 80 +++ 18 files changed, 2432 insertions(+), 42 deletions(-) create mode 100644 dts/framework/stats_reporter.py create mode 100644 dts/framework/sut_node.py create mode 100644 dts/framework/test_case.py create mode 100644 dts/framework/test_result.py create mode 100644 dts/framework/tg_node.py create mode 100644 dts/test_plans/hello_world_test_plan.rst create mode 100644 dts/tests/TestSuite_hello_world.py -- 2.30.2