From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 840D842E6E; Fri, 14 Jul 2023 09:35:15 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 27313410EE; Fri, 14 Jul 2023 09:35:15 +0200 (CEST) Received: from mail-ej1-f47.google.com (mail-ej1-f47.google.com [209.85.218.47]) by mails.dpdk.org (Postfix) with ESMTP id 36AC340685 for ; Fri, 14 Jul 2023 09:35:10 +0200 (CEST) Received: by mail-ej1-f47.google.com with SMTP id a640c23a62f3a-992b66e5affso211553666b.3 for ; Fri, 14 Jul 2023 00:35:10 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pantheon.tech; s=google; t=1689320110; x=1691912110; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=ejFUPjKXPRJbDQZBvhZOglS/34DjGx68dHI0Jz/bEUM=; b=BR5YaVjdwlUWDVI0hi8Oui0pOyjBlnBFkDCtk3rvuNOirw3DqPT15yKGw31d9lTKQ5 40NeHwmRYwN9j0uMhnSetr9ZwUPP1Jjvv7UF5ocBqZKFE8KyY4wJhX54kG5I3UBrLP9P z3BpszfKiAQShW/fZUWao5Ies740iQKih6ahOeAUCfMtC6VhOCU2f5rG+dzCT3rvlDRN GvJw7C0EsazNSf2tZ5/rGZX8dj9hi8YXIMWxUzCY9GpcSXj5UGBtYG/q/rg0J3d5fz47 6ImJ3RPHDtVhVnMXDpH0yl+fKo2dyAOjY/1IrEyQeXIGyMFI1wXqDXmKnBbIsScOo0N5 UqOg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1689320110; x=1691912110; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=ejFUPjKXPRJbDQZBvhZOglS/34DjGx68dHI0Jz/bEUM=; b=KfYMIFg68qnAuuUuXwefvAr8CkVRAP5xyARxjPzm7o92ZdFG5Z8gx8dEU0hMJlV+Ha Eoju1eBzM5RDOc+Y+fmEhmiXgqDcXbaGyIcSS86JqO/4+UvJlAcbw4uCermvh0/iB/ai i8TEWEii918WStluQ6Y4KNGY/x2F4klmF1VR8l/OlgW5vvHTprj5+cSwHd2b2nxWXwzi yGwPw4RBwokf+lh0MZyArkOq5DiRUxl17iYWZc0+4xrFdj4z/vB6d138VejihjmomDT/ gmPFCgMVdSwhqWuSt+97AJah7s/SQNXlTzpqQe5swB9l+1tP9dYqPOt2V1bh5geeI5KG UTJA== X-Gm-Message-State: ABy/qLYWpChSQ/AxxpAS8/5PHr8qm48LluCoO4khvdkbGNk9t9nhWnEY ho87K0V4oRVfzzmkbpcKzyzC8Aeg3TittL25adoymA== X-Google-Smtp-Source: APBJJlFKhoSlo3pYSezHyJgE1uH7NP3NprBuvMnclxKsYq+3SW0uaH1sZzQVFefdHqVBwEjHHuDwPr6LWRHrszrpWD0= X-Received: by 2002:a17:906:738c:b0:993:f2b4:13c9 with SMTP id f12-20020a170906738c00b00993f2b413c9mr3441050ejl.21.1689320109786; Fri, 14 Jul 2023 00:35:09 -0700 (PDT) MIME-Version: 1.0 References: <20230713165347.21997-2-jspewock@iol.unh.edu> <20230713165347.21997-3-jspewock@iol.unh.edu> In-Reply-To: <20230713165347.21997-3-jspewock@iol.unh.edu> From: =?UTF-8?Q?Juraj_Linke=C5=A1?= Date: Fri, 14 Jul 2023 09:34:58 +0200 Message-ID: Subject: Re: [PATCH v7 1/1] dts: add smoke tests To: jspewock@iol.unh.edu Cc: Honnappa.Nagarahalli@arm.com, thomas@monjalon.net, lijuan.tu@intel.com, wathsala.vithanage@arm.com, probb@iol.unh.edu, dev@dpdk.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Thu, Jul 13, 2023 at 6:54=E2=80=AFPM wrote: > > From: Jeremy Spewock > > Adds a new test suite for running smoke tests that verify general > configuration aspects of the system under test. If any of these tests > fail, the DTS execution terminates as part of a "fail-fast" model. > > Signed-off-by: Jeremy Spewock > --- > dts/conf.yaml | 17 +- > dts/framework/config/__init__.py | 107 +++++++++-- > dts/framework/config/conf_yaml_schema.json | 142 +++++++++++++- > dts/framework/dts.py | 87 ++++++--- > dts/framework/exception.py | 12 ++ > dts/framework/remote_session/__init__.py | 11 +- > dts/framework/remote_session/os_session.py | 53 +++++- > dts/framework/remote_session/posix_session.py | 29 ++- > .../remote_session/remote/__init__.py | 10 + > .../remote/interactive_remote_session.py | 82 ++++++++ > .../remote/interactive_shell.py | 78 ++++++++ > .../remote_session/remote/testpmd_shell.py | 74 ++++++++ > dts/framework/test_result.py | 37 +++- > dts/framework/test_suite.py | 10 +- > dts/framework/testbed_model/node.py | 2 + > dts/framework/testbed_model/sut_node.py | 176 +++++++++++++----- > dts/framework/utils.py | 3 + > dts/tests/TestSuite_smoke_tests.py | 113 +++++++++++ > 18 files changed, 945 insertions(+), 98 deletions(-) > create mode 100644 dts/framework/remote_session/remote/interactive_remot= e_session.py > create mode 100644 dts/framework/remote_session/remote/interactive_shell= .py > create mode 100644 dts/framework/remote_session/remote/testpmd_shell.py > create mode 100644 dts/tests/TestSuite_smoke_tests.py Reviewed-by: Juraj Linke=C5=A1 Thanks for the patch.