[PATCH 0/2] dts: smoke test bugfixes

[PATCH 0/2] dts: smoke test bugfixes

[Patrick Robb]

There are two smoke test bugfixes which have come in from our 25.03 DTS
development and which should be resolved with this series.

1. The patchseries which we merged for 25.03 which added the testsuite
specific configs inadvertently broke enabling smoke tests, as we build
the tests config model using the test suite list coming in from the
parsed test_run.yaml, before smoke_tests have been added. Then, later in
the execution this produces a key error. I think that adding a
placeholder smoke tests test suite config is the most reasonable
solution to this. Users are unlikely to specify any test config for
smoke tests as they don't require any, although if they happen to do so,
I understand this change to be non-breaking (and I gave it a test run).

2. I am also seeing the smoke test which relies on regex on
dpdk-devbind.py status output is failing on at least one of our systems
currently. The fact that this broke is rather peculiar since regex
syntax is obviously stable, and my reading of the current regex is that
it "should" work. In any case, I simply changed the regex to a pattern
which is more permissive and still captures the driver in use, which is
what is needed for the testsuite.

Patrick Robb (2):
  dts: include smoke tests in tests config
  dts: update dpdk-devbind script regex

 dts/framework/config/test_run.py   | 3 +++
 dts/tests/TestSuite_smoke_tests.py | 2 +-
 2 files changed, 4 insertions(+), 1 deletion(-)

-- 
2.48.1

[PATCH 1/2] dts: include smoke tests in tests config

[Patrick Robb]

The tests config is created by parsing the testrun config
earlier in the DTS execution than when the smoke_tests
testsuite is added. This situation causes a key error
on the tests_config dictionary when smoke_tests is enabled.
This commit creates a placeholder TestSuiteConfig for
smoke tests in the function which is responsible for
creating the tests config model, resolving the issue.

Fixes: 184d21f08db4 ("dts: add per-test-suite configuration")

Signed-off-by: Patrick Robb <probb@iol.unh.edu>
---
 dts/framework/config/test_run.py | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/dts/framework/config/test_run.py b/dts/framework/config/test_run.py
index 06fe28143c..9bbed10f33 100644
--- a/dts/framework/config/test_run.py
+++ b/dts/framework/config/test_run.py
@@ -303,6 +303,9 @@ def make_test_suite_config_field(config_obj: type["BaseConfig"]):
 
 def create_test_suites_config_model(test_suites: Iterable[TestSuiteConfig]) -> type[BaseModel]:
     """Create model for the test suites configuration."""
+
+    test_suites += [TestSuiteConfig(test_suite="smoke_tests")]
+
     test_suites_kwargs = {
         t.test_suite_name: make_test_suite_config_field(t.test_suite_spec.config_obj)
         for t in test_suites
-- 
2.48.1

[PATCH 2/2] dts: update dpdk-devbind script regex

[Patrick Robb]

The current regex used for matching against the
dpdk-devbind status output is no longer matching
correctly. This commit introduces a more permissive
pattern which will yield the device driver in use.

Signed-off-by: Patrick Robb <probb@iol.unh.edu>
---
 dts/tests/TestSuite_smoke_tests.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/dts/tests/TestSuite_smoke_tests.py b/dts/tests/TestSuite_smoke_tests.py
index 352b92ce6c..9e4d06a1c4 100644
--- a/dts/tests/TestSuite_smoke_tests.py
+++ b/dts/tests/TestSuite_smoke_tests.py
@@ -135,7 +135,7 @@ def test_device_bound_to_driver(self) -> None:
             # with the address for the nic we are on in the loop and then captures the
             # name of the driver in a group
             devbind_info_for_nic = re.search(
-                rf"{nic.pci}[^\\n]*drv=([\\d\\w-]*) [^\\n]*",
+                rf"{nic.pci}.*drv=(\S+) [^\\n]*",
                 all_nics_in_dpdk_devbind,
             )
             self.verify(
-- 
2.48.1

Re: [PATCH 1/2] dts: include smoke tests in tests config

[Patrick Robb]

[-- Attachment #1: Type: text/plain, Size: 519 bytes --]

Thanks Luca for the info - there is also 1 other fix needed. I'll send a v2.

On Thu, Apr 3, 2025 at 9:45 AM Luca Vizzarro <Luca.Vizzarro@arm.com> wrote:

> Hi Patrick,
>
> this looks good, easy and quick fix. I am afraid that you can't append
> to an `Iterable` type though. I've also confirmed this with mypy:
>
>    Unsupported left operand type for + ("Iterable[TestSuiteConfig]")
>
> I guess the easiest fix is to just change the argument type to `list`
> from `Iterable`.
>
> Best,
> Luca
>
>

[-- Attachment #2: Type: text/html, Size: 872 bytes --]

Re: [PATCH 1/2] dts: include smoke tests in tests config

[Luca Vizzarro]

Hi Patrick,

this looks good, easy and quick fix. I am afraid that you can't append 
to an `Iterable` type though. I've also confirmed this with mypy:

   Unsupported left operand type for + ("Iterable[TestSuiteConfig]")

I guess the easiest fix is to just change the argument type to `list` 
from `Iterable`.

Best,
Luca

Re: [PATCH 2/2] dts: update dpdk-devbind script regex

[Luca Vizzarro]

Reviewed-by: Luca Vizzarro <luca.vizzarro@arm.com>