[dts][PATCH V3 0/3] add new dsa test_plans and testsuite

[dts][PATCH V3 0/3] add new dsa test_plans and testsuite

[Wei Ling]

Add new dsa test_plans and testsuite to test dpdk-dma application
and example of how to use the DMAdev API to make a packet copy
application use DSA channel with DPDK driver and Kernel driver.

Wei Ling (3):
  test_plans/index: add dsa_test_plan
  test_plans/dsa: add dsa testplan
  tests/dsa: add dsa testsuite

 test_plans/dsa_test_plan.rst | 353 +++++++++++++++++++++++++
 test_plans/index.rst         |   1 +
 tests/TestSuite_dsa.py       | 481 +++++++++++++++++++++++++++++++++++
 3 files changed, 835 insertions(+)
 create mode 100644 test_plans/dsa_test_plan.rst
 create mode 100644 tests/TestSuite_dsa.py

-- 
2.25.1

[dts][PATCH V3 1/3] test_plans/index: add dsa_test_plan

[Wei Ling]

Add dsa_test_plan in test_plans/index.rst.

Signed-off-by: Wei Ling <weix.ling@intel.com>
---
 test_plans/index.rst | 1 +
 1 file changed, 1 insertion(+)

diff --git a/test_plans/index.rst b/test_plans/index.rst
index 0770a935..9281c6b2 100644
--- a/test_plans/index.rst
+++ b/test_plans/index.rst
@@ -287,6 +287,7 @@ The following are the test plans for the DPDK DTS automated test system.
     flow_filtering_test_plan
     af_xdp_test_plan
     cbdma_test_plan
+    dsa_test_plan
     flexible_rxd_test_plan
     ipsec_gw_and_library_test_plan
     port_control_test_plan
-- 
2.25.1

[dts][PATCH V3 2/3] test_plans/dsa: add dsa testplan

[Wei Ling]

Add new dsa test_plan to test dpdk-dma application
and example of how to use the DMAdev API to make a packet copy
application use DSA channel with DPDK driver and Kernel driver.

Signed-off-by: Wei Ling <weix.ling@intel.com>
---
 test_plans/dsa_test_plan.rst | 353 +++++++++++++++++++++++++++++++++++
 1 file changed, 353 insertions(+)
 create mode 100644 test_plans/dsa_test_plan.rst

diff --git a/test_plans/dsa_test_plan.rst b/test_plans/dsa_test_plan.rst
new file mode 100644
index 00000000..e4516250
--- /dev/null
+++ b/test_plans/dsa_test_plan.rst
@@ -0,0 +1,353 @@
+.. SPDX-License-Identifier: BSD-3-Clause
+   Copyright(c) 2023 Intel Corporation
+
+=============
+DSA test plan
+=============
+
+Description
+===========
+
+This sample is intended as a demonstration of the basic components of a DPDK
+forwarding application and example of how to use the DMAdev API to make a packet
+copy application.
+
+Also while forwarding, the MAC addresses are affected as follows:
+
+*   The source MAC address is replaced by the TX port MAC address
+
+*   The destination MAC address is replaced by  02:00:00:00:00:TX_PORT_ID
+
+This application can be used to compare performance of using software packet
+copy with copy done using a DMA device for different sizes of packets.
+The example will print out statistics each second. The stats shows
+received/send packets and packets dropped or failed to copy.
+
+In order to run the hardware copy application, the copying device
+needs to be bound to user-space IO driver.
+
+Refer to the "DMAdev library" chapter in the "Programmers guide" for information
+on using the library.
+
+The application requires a number of command line options:
+
+.. code-block:: console
+
+    ./<build_dir>/examples/dpdk-dma [EAL options] -- [-p MASK] [-q NQ] [-s RS] [-c <sw|hw>]
+        [--[no-]mac-updating] [-b BS] [-f FS] [-i SI]
+
+where,
+
+*   p MASK: A hexadecimal bitmask of the ports to configure (default is all)
+
+*   q NQ: Number of Rx queues used per port equivalent to DMA channels
+    per port (default is 1)
+
+*   c CT: Performed packet copy type: software (sw) or hardware using
+    DMA (hw) (default is hw)
+
+*   s RS: Size of dmadev descriptor ring for hardware copy mode or rte_ring for
+    software copy mode (default is 2048)
+
+*   --[no-]mac-updating: Whether MAC address of packets should be changed
+    or not (default is mac-updating)
+
+*   b BS: set the DMA batch size
+
+*   f FS: set the max frame size
+
+*   i SI: set the interval, in second, between statistics prints (default is 1)
+
+The application can be launched in various configurations depending on
+provided parameters. The app can use up to 2 lcores: one of them receives
+incoming traffic and makes a copy of each packet. The second lcore then
+updates MAC address and sends the copy. If one lcore per port is used,
+both operations are done sequentially. For each configuration an additional
+lcore is needed since the main lcore does not handle traffic but is
+responsible for configuration, statistics printing and safe shutdown of
+all ports and devices.
+
+The application can use a maximum of 8 ports.
+
+To run the application in a Linux environment with 3 lcores (the main lcore,
+plus two forwarding cores), a single port (port 0), software copying and MAC
+updating issue the command:
+
+    $ ./<build_dir>/examples/dpdk-dma -l 0-2 -n 2 -- -p 0x1 --mac-updating -c sw
+
+To run the application in a Linux environment with 2 lcores (the main lcore,
+plus one forwarding core), 2 ports (ports 0 and 1), hardware copying and no MAC
+updating issue the command:
+
+    $ ./<build_dir>/examples/dpdk-dma -l 0-1 -n 1 -- -p 0x3 --no-mac-updating -c hw
+
+Prerequisites
+=============
+
+Test flow
+---------
+    
+NIC RX -> copy packet -> free original -> update mac addresses -> NIC TX
+
+General set up
+--------------
+1. Compile DPDK::
+
+    # CC=gcc meson --werror -Denable_kmods=True -Dlibdir=lib -Dexamples=all --default-library=static <dpdk build dir>
+    # ninja -C <dpdk build dir> -j 110
+    For example:
+    CC=gcc meson --werror -Denable_kmods=True -Dlibdir=lib -Dexamples=all --default-library=static x86_64-native-linuxapp-gcc
+    ninja -C x86_64-native-linuxapp-gcc -j 110
+
+Test case
+=========
+
+Test Case 1: DMA basic test with differnet size packets using DSA dpdk driver
+-----------------------------------------------------------------------------
+
+1.Bind 1 DSA port and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=1 -- -p 0x1 -q 1 --mac-updating -c hw
+
+3.Send different size packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC.
+
+4.Check performance from “Total packets Tx” and check log includes "Worker Threads = 1, Copy Mode = hw".
+
+Test Case 2: DMA test with multi-threads using DSA dpdk driver
+--------------------------------------------------------------
+
+1.Bind 1 DSA port and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app with three cores::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=1 -- -p 0x1 -q 1 --mac-updating -c hw
+
+3. Send different size packets from TG to NIC.
+
+4.Check performance from “Total packets Tx” and check log includes "Worker Threads = 2, Copy Mode = hw".
+
+Test Case 3: DMA test with multi NIC ports using DSA dpdk driver
+----------------------------------------------------------------
+
+1.Bind 1 DSA port and 2 NIC ports to vfio-pci driver.
+
+2.Launch dma app with multi-ports::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-4 -n 2 -a 0000:29:00.0 -a 0000:29:00.1 -a 0000:6a:01.0,max_queues=2 -- -p 0x3 -q 1 --mac-updating -c hw
+
+3.Send different size packets (64B, 256B, 512B, 1024B, IMIX) from TG to two NIC ports.
+
+4.Check stats of two ports, each port's performance shows in “Total packets Tx” and each port's log includes "Worker Threads = 2, Copy Mode = hw".
+
+Test Case 4: DMA test with multi-queues using DSA dpdk driver
+-------------------------------------------------------------
+
+1.Bind 1 DSA port and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app with multi-queues::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=2 -- -p 0x1 -q 2 --mac-updating -c hw
+
+3. Send random ip packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC port.
+
+4. Check stats of dma app, "Worker Threads = 2, Copy Mode = hw, Rx Queues = 2" and each dma channel can enqueue packets.
+
+5. Repeat step2 to step4 with queue number 4 and qemu number 8, at the same time, set max_queues equal to queue number.
+Check performance gains status when queue numbers added.
+
+Test Case 5: DMA performance comparison between mac-updating and no-mac-updating using DSA dpdk driver
+------------------------------------------------------------------------------------------------------
+
+1.Bind 1 DSA port and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=2 -- -p 0x1 -q 2 --no-mac-updating -c hw
+
+3. Send random ip packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC port.
+
+4. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+
+5.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=2 -- -p 0x1 -q 2 --mac-updating -c hw
+
+6. Send random ip packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC port.
+
+7. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+  
+Test Case 6: DMA performance comparison between SW copies and HW copies using DSA dpdk driver  
+---------------------------------------------------------------------------------------------
+
+1.Bind 1 DSA port and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app with SW mode::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=4 -- -p 0x1 -q 4 --mac-updating  -c sw
+
+3. Send random ip packets with different packet size,includes [64, 128, 256, 512, 1024, 1518] from TG.
+
+4. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+
+5.Launch dma app with HW mode::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a 0000:6a:01.0,max_queues=4 -- -p 0x1 -q 4 --mac-updating -c hw
+
+6. Send random ip packets with different packet size,includes [64, 128, 256, 512, 1024, 1518] from TG.
+
+7. Check performance from dma app and compare with hw copy test::
+
+    Total packets Tx:                   xxx [pps]
+
+Test Case 7: DMA basic test with differnet size packets using DSA kernel driver
+-------------------------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and 1 NIC port to vfio-pci driver::
+
+   <dpdk dir># ./usertools/dpdk-devbind.py -b vfio-pci 29:00.0
+
+   ls /dev/dsa #check wq configure, reset if exist
+   <dpdk dir># ./usertools/dpdk-devbind.py -u 6a:01.0
+   <dpdk dir># ./usertools/dpdk-devbind.py -b idxd 6a:01.0
+   ./drivers/dma/idxd/dpdk_idxd_cfg.py -q 1 0
+   ls /dev/dsa #check wq configure success
+
+2.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a wq0.0 -- -p 0x1 -q 1 --mac-updating -c hw
+
+3.Send different size packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC.
+
+4.Check performance from “Total packets Tx” and check log includes "Worker Threads = 1, Copy Mode = hw".
+
+Test Case 8: DMA test with multi-threads using DSA kernel driver
+----------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and 1 NIC port to vfio-pci driver.
+
+2.Launch dma app with three cores::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a wq0.0 -- -p 0x1 -q 1 --mac-updating -c hw
+
+3. Send different size packets from TG to NIC.
+
+4.Check performance from “Total packets Tx” and check log includes "Worker Threads = 2, Copy Mode = hw".
+
+Test Case 9: DMA test with multi NIC ports using DSA kernel driver
+------------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and two NIC ports to vfio-pci driver::
+
+   <dpdk dir># ./usertools/dpdk-devbind.py -b vfio-pci 29:00.0
+
+   ls /dev/dsa #check wq configure, reset if exist
+   <dpdk dir># ./usertools/dpdk-devbind.py -u 6a:01.0
+   <dpdk dir># ./usertools/dpdk-devbind.py -b idxd 6a:01.0
+   ./drivers/dma/idxd/dpdk_idxd_cfg.py -q 2 0
+   ls /dev/dsa #check wq configure success
+
+2.Launch dma app with multi-ports::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-4 -n 2 -a 0000:29:00.0 -a 0000:29:00.1 -a wq0.0 -a wq0.1 -- -p 0x3 -q 1 --mac-updating -c hw
+
+3.Send different size packets (64B, 256B, 512B, 1024B, IMIX) from TG to two NIC ports.
+
+4.Check stats of two ports, each port's performance shows in “Total packets Tx” and each port's log includes "Worker Threads = 2, Copy Mode = hw".
+
+Test Case 10: DMA test with multi-queues using DSA kernel driver
+----------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and 1 NIC port to vfio-pci driver::
+
+   <dpdk dir># ./usertools/dpdk-devbind.py -b vfio-pci 29:00.0
+
+   ls /dev/dsa #check wq configure, reset if exist
+   <dpdk dir># ./usertools/dpdk-devbind.py -u 6a:01.0
+   <dpdk dir># ./usertools/dpdk-devbind.py -b idxd 6a:01.0
+   ./drivers/dma/idxd/dpdk_idxd_cfg.py -q 2 0
+   ls /dev/dsa #check wq configure success
+
+2.Launch dma app with multi-queues::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a wq0.0 -a wq0.1 -- -p 0x1 -q 2 --mac-updating -c hw
+
+3. Send random ip packets (64B, 256B, 512B, 1024B, IMIX) from TG to NIC port.
+
+4. Check stats of dma app, "Worker Threads = 2, Copy Mode = hw, Rx Queues = 2" and each dma channel can enqueue packets.
+
+5. Repeat step2 to step4 with queue number 4 and qemu number 8, at the same time, reset and create WQ with the same number of queue numbers.
+Check performance gains status when queue numbers added.
+
+Test Case 11: DMA performance comparison between mac-updating and no-mac-updating using DSA kernel driver
+---------------------------------------------------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and 1 NIC port to vfio-pci driver::
+
+   <dpdk dir># ./usertools/dpdk-devbind.py -b vfio-pci 29:00.0
+
+   ls /dev/dsa #check wq configure, reset if exist
+   <dpdk dir># ./usertools/dpdk-devbind.py -u 6a:01.0
+   <dpdk dir># ./usertools/dpdk-devbind.py -b idxd 6a:01.0
+   ./drivers/dma/idxd/dpdk_idxd_cfg.py -q 2 0
+   ls /dev/dsa #check wq configure success
+
+2.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a wq0.0 -a wq0.1 -- -p 0x1 -q 2 --no-mac-updating -c hw
+
+3. Send random ip 64B packets from TG.
+
+4. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+
+5.Launch dma app::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-1 -n 2 -a 0000:29:00.0 -a wq0.0 -a wq0.1 -- -p 0x1 -q 2 --mac-updating -c hw
+
+6. Send random ip 64B packets from TG.
+
+7. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+
+Test Case 12: DMA performance comparison between SW copies and HW copies using DSA kernel driver  
+------------------------------------------------------------------------------------------------
+
+1.Bind 1 DSA port to idxd driver and 1 NIC port to vfio-pci driver::
+
+   <dpdk dir># ./usertools/dpdk-devbind.py -b vfio-pci 29:00.0
+
+   ls /dev/dsa #check wq configure, reset if exist
+   <dpdk dir># ./usertools/dpdk-devbind.py -u 6a:01.0
+   <dpdk dir># ./usertools/dpdk-devbind.py -b idxd 6a:01.0
+   ./drivers/dma/idxd/dpdk_idxd_cfg.py -q 4 0
+   ls /dev/dsa #check wq configure success
+
+2.Launch dma app with SW mode::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a wq0.0 -a wq0.1 -a wq0.2 -a wq0.3 -- -p 0x1 -q 4 --mac-updating  -c sw
+
+3. Send random ip packets with different packet size,includes [64, 128, 256, 512, 1024, 1518] from TG.
+
+4. Check performance from dma app::
+
+    Total packets Tx:                   xxx [pps]
+
+5.Launch dma app with HW mode::
+
+   ./x86_64-native-linuxapp-gcc/examples/dpdk-dma -l 0-2 -n 2 -a 0000:29:00.0 -a wq0.0 -a wq0.1 -a wq0.2 -a wq0.3 -- -p 0x1 -q 4 --mac-updating -c hw
+
+6. Send random ip packets with different packet size,includes [64, 128, 256, 512, 1024, 1518] from TG.
+
+7. Check performance from dma app and compare with hw copy test::
+
+    Total packets Tx:                   xxx [pps]
-- 
2.25.1

[dts][PATCH V3 3/3] tests/dsa: add dsa testsuite

[Wei Ling]

Add new dsa testsuite to test dpdk-dma application
and example of how to use the DMAdev API to make a packet copy
application use DSA channel with DPDK driver and Kernel driver.

Signed-off-by: Wei Ling <weix.ling@intel.com>
---
 tests/TestSuite_dsa.py | 481 +++++++++++++++++++++++++++++++++++++++++
 1 file changed, 481 insertions(+)
 create mode 100644 tests/TestSuite_dsa.py

diff --git a/tests/TestSuite_dsa.py b/tests/TestSuite_dsa.py
new file mode 100644
index 00000000..c9572e06
--- /dev/null
+++ b/tests/TestSuite_dsa.py
@@ -0,0 +1,481 @@
+# SPDX-License-Identifier: BSD-3-Clause
+# Copyright(c) 2023 Intel Corporation
+#
+
+import re
+import time
+
+from framework.packet import Packet
+from framework.pktgen import TRANSMIT_CONT
+from framework.test_case import TestCase
+
+from .virtio_common import dsa_common as DC
+
+
+class TestDSA(TestCase):
+    def set_up_all(self):
+        """
+        Run at the start of each test suite.
+        """
+        self.frame_sizes = [64, 256, 512, 1024, 1518]
+        self.dut_ports = self.dut.get_ports()
+        self.verify(len(self.dut_ports) >= 1, "Insufficient ports for testing")
+        self.ports_socket = self.dut.get_numa_id(self.dut_ports[0])
+        out = self.dut.build_dpdk_apps("./examples/dma")
+        self.verify("Error" not in out, "compilation dma error")
+        self.dma_path = self.dut.apps_name["dma"]
+        self.dma_name = self.dma_path.split("/")[-1]
+        self.core_num = 1
+        self.DC = DC(self)
+
+    def set_up(self):
+        """
+        Run before each test case.
+        """
+        # Prepare the result table
+        self.table_header = ["Frame"]
+        self.table_header.append("Mpps")
+        self.table_header.append("Worker Threads")
+        self.table_header.append("Copy Mode")
+        self.table_header.append("Updating MAC")
+        self.table_header.append("Rx Queues")
+        self.table_header.append("% linerate")
+        self.result_table_create(self.table_header)
+        self.dut.send_expect("killall -I %s" % self.dma_name, "#", 20)
+
+    def get_core_list(self):
+        """
+        get cores list depend on self.work_thread
+        """
+        core_config = "1S/%dC/1T" % self.core_num
+        core_list = self.dut.get_core_list(core_config, socket=self.ports_socket)
+        return core_list
+
+    def launch_dma_app(self, eal_params):
+        """
+        launch dma with different params
+        """
+        port_info = 0
+        for i in range(self.nic_port_num):
+            port_info |= 1 << i
+        updating_mac = (
+            "--mac-updating" if self.updating_mac == "enabled" else "--no-mac-updating"
+        )
+        rx_queues = self.rx_queues / self.nic_port_num
+        cmd = "%s %s -- -p %s -q %d %s -c %s" % (
+            self.dma_path,
+            eal_params,
+            hex(port_info),
+            rx_queues,
+            updating_mac,
+            self.copy_mode,
+        )
+        expected = self.dma_path.split("/")[-1].strip()
+        self.dut.send_expect(cmd, expected)
+        time.sleep(3)
+        out = self.dut.get_session_output(timeout=1)
+        self.logger.info("out before: {}".format(out))
+        """
+        when start DSA app, default cores num is 2, it will only one thread
+        when the cores num > 2, there will have 2 thread, and the max value of thread
+        num is 2.
+        """
+        self.work_thread = 2 if self.core_num > 2 else 1
+        work_thread_info = "Worker Threads = %d" % self.work_thread
+        copy_mode_info = "Copy Mode = %s" % self.copy_mode
+        update_mac_info = "Updating MAC = %s" % self.updating_mac
+        rx_queues_info = "Rx Queues = %d" % rx_queues
+        self.verify(
+            work_thread_info in out
+            and copy_mode_info in out
+            and update_mac_info in out
+            and rx_queues_info in out,
+            "The output info not match setting for the cmd, please check",
+        )
+
+    def config_stream(self, frame_size):
+        stream_ids = []
+        for port in range(self.nic_port_num):
+            tx_port = self.tester.get_local_port(self.dut_ports[port])
+            rx_port = tx_port
+            if self.nic_port_num > 1:
+                if port % self.nic_port_num == 0:
+                    rx_port = self.tester.get_local_port(self.dut_ports[port + 1])
+                else:
+                    rx_port = self.tester.get_local_port(self.dut_ports[port - 1])
+            dst_mac = self.dut.get_mac_address(self.dut_ports[port])
+            # pkt config
+            pkt = Packet(pkt_type="UDP", pkt_len=frame_size)
+            # pkt.config_layer("ether", {"dst": "%s" % dst_mac})
+            pkt.config_layer("udp", {"src": 1111, "dst": 1112})
+            pkt.save_pcapfile(
+                self.tester, "%s/dsa_%d.pcap" % (self.tester.tmp_file, port)
+            )
+            stream_option = {
+                "pcap": "%s/dsa_%d.pcap" % (self.tester.tmp_file, port),
+                "fields_config": {
+                    "ether": {
+                        "dst": {
+                            "action": "random",
+                        }
+                    },
+                    "ip": {
+                        "src": {
+                            "action": "random",
+                            "start": "16.0.0.1",
+                            "step": 1,
+                            "end": "16.0.0.64",
+                        }
+                    },
+                },
+                "stream_config": {
+                    "rate": 100,
+                    "transmit_mode": TRANSMIT_CONT,
+                },
+            }
+            stream_id = self.tester.pktgen.add_stream(
+                tx_port, tx_port, "%s/dsa_%d.pcap" % (self.tester.tmp_file, port)
+            )
+            self.tester.pktgen.config_stream(stream_id, stream_option)
+            stream_ids.append(stream_id)
+        return stream_ids
+
+    def send_and_verify(self, check_each_queue=True):
+        """
+        Send packet with packet generator and verify
+        """
+        for frame_size in self.frame_sizes:
+            self.tester.pktgen.clear_streams()
+            stream_ids = self.config_stream(frame_size)
+            traffic_opt = {"method": "throughput", "rate": 100, "duration": 20}
+            self.logger.info(
+                "start to send %d frame size packets from pktgen" % frame_size
+            )
+            _, pps = self.tester.pktgen.measure(stream_ids, traffic_opt)
+            self.verify(
+                pps > 0,
+                "%s can not receive packets of frame size %d"
+                % (self.running_case, frame_size),
+            )
+            self.update_result_tables(frame_size, pps)
+            if check_each_queue:
+                self.check_enqueue_packets_of_each_channel()
+
+    def check_enqueue_packets_of_each_channel(self):
+        """
+        Check stats of dma app, each dma channel can enqueue packets
+        """
+        out = self.dut.get_session_output(timeout=2)
+        index = out.rfind("Statistics for port 0")
+        out = out[index:]
+        data_info = re.findall("Total completed ops:\s*(\d*)", out)
+        self.verify(
+            (len(data_info) - 1) == self.rx_queues,
+            "There miss some queue, the run queue is "
+            "%d, and expect queue num is %d" % ((len(data_info) - 1), self.rx_queues),
+        )
+        for index in range(self.rx_queues):
+            self.verify(
+                data_info[index] != 0, "the queue %d can not enqueues data" % index
+            )
+
+    def update_result_tables(self, frame_size, pps):
+        Mpps = pps / 1000000.0
+        linerate = (
+            Mpps * 100 / float(self.wirespeed(self.nic, frame_size, self.nic_port_num))
+        )
+        self.work_thread = 2 if self.core_num > 2 else 1
+        results_row = [frame_size]
+        results_row.append(Mpps)
+        results_row.append(self.work_thread)
+        results_row.append(self.copy_mode)
+        results_row.append(self.updating_mac)
+        results_row.append(self.rx_queues / self.nic_port_num)
+        results_row.append(linerate)
+        self.result_table_add(results_row)
+
+    def test_perf_dsa_basic_test_using_dpdk_driver(self):
+        """
+        Test Case 1: DMA basic test with differnet size packets using DSA dpdk driver
+        """
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 2
+        self.rx_queues = 1
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports, port_options=port_options
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_threads_using_dpdk_driver(self):
+        """
+        Test Case 2: DMA test with multi-threads using DSA dpdk driver
+        """
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 3
+        self.rx_queues = 1
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports, port_options=port_options
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_nic_ports_using_dpdk_driver(self):
+        """
+        Test Case 3: DMA test with multi nic ports using DSA dpdk driver
+        """
+        self.verify(len(self.dut_ports) >= 2, "Insufficient ports for testing")
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 5
+        self.rx_queues = 2
+        self.nic_port_num = 2
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports, port_options=port_options
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_queues_using_dpdk_driver(self):
+        """
+        Test Case 4: DMA test with multi-queues using DSA dpdk driver
+        """
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 3
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        queue_list = [2, 4, 8]
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        for self.rx_queues in queue_list:
+            port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+            eal_params = self.dut.create_eal_parameters(
+                cores=self.get_core_list(), ports=ports, port_options=port_options
+            )
+            self.launch_dma_app(eal_params=eal_params)
+            self.send_and_verify(check_each_queue=True)
+            self.dut.send_expect("^c", "# ")
+        self.result_table_print()
+
+    def test_perf_dsa_with_diff_update_mac_using_dpdk_driver(self):
+        """
+        Test Case 5: DMA performance comparison between mac-updating and no-mac-updating using DSA dpdk driver
+        """
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 2
+        self.rx_queues = 2
+        self.nic_port_num = 1
+        self.updating_mac = "disabled"
+        self.copy_mode = "hw"
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports, port_options=port_options
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+
+        self.dut.send_expect("^c", "# ")
+        self.updating_mac = "enabled"
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_diff_copy_mode_using_dpdk_driver(self):
+        """
+        Test Case 6: DMA performance comparison between SW copies and HW copies using DSA dpdk driver
+        """
+        dsas = self.DC.bind_dsa_to_dpdk_driver(
+            dsa_num=1, driver_name="vfio-pci", socket=self.ports_socket
+        )
+        self.core_num = 3
+        self.rx_queues = 4
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "sw"
+        ports = dsas
+        for i in range(self.nic_port_num):
+            ports.append(self.dut.ports_info[i]["pci"])
+        port_options = {dsas[0]: "max_queues=%s" % self.rx_queues}
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports, port_options=port_options
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=False)
+
+        self.dut.send_expect("^c", "# ")
+        self.copy_mode = "hw"
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_basic_test_using_kernel_driver(self):
+        """
+        Test Case 7: DMA basic test with differnet size packets using DSA kernel driver
+        """
+        self.DC.create_wq(wq_num=1, dsa_idxs=[0])
+        self.core_num = 2
+        self.rx_queues = 1
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = [self.dut.ports_info[0]["pci"]]
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_thread_using_kernel_driver(self):
+        """
+        Test Case 8: DMA test with multi-threads using DSA kernel driver
+        """
+        self.DC.create_wq(wq_num=1, dsa_idxs=[0])
+        self.core_num = 3
+        self.rx_queues = 1
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = [self.dut.ports_info[0]["pci"]]
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_nic_ports_using_kernle_driver(self):
+        """
+        Test Case 9: DMA test with multi nic ports using DSA kernel driver
+        """
+        self.verify(len(self.dut_ports) >= 2, "Insufficient ports for testing")
+        self.DC.create_wq(wq_num=2, dsa_idxs=[0])
+        self.core_num = 5
+        self.rx_queues = 2
+        self.nic_port_num = 2
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        ports = [self.dut.ports_info[0]["pci"], self.dut.ports_info[1]["pci"]]
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_multi_queues_using_kernel_driver(self):
+        """
+        Test Case 10: DMA test with multi-queues using DSA kernel driver
+        """
+        self.DC.create_wq(wq_num=8, dsa_idxs=[0])
+        self.core_num = 3
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "hw"
+        queue_list = [2, 4, 8]
+        for self.rx_queues in queue_list:
+            ports = [self.dut.ports_info[0]["pci"]]
+            eal_params = self.dut.create_eal_parameters(
+                cores=self.get_core_list(), ports=ports
+            )
+            self.launch_dma_app(eal_params=eal_params)
+            self.send_and_verify(check_each_queue=True)
+            self.dut.send_expect("^c", "# ")
+        self.result_table_print()
+
+    def test_perf_dsa_with_diff_update_mac_using_kernel_driver(self):
+        """
+        Test Case 11: DMA performance comparison between mac-updating and no-mac-updating using DSA kernel driver
+        """
+        self.DC.create_wq(wq_num=2, dsa_idxs=[0])
+        self.core_num = 2
+        self.rx_queues = 2
+        self.nic_port_num = 1
+        self.updating_mac = "disabled"
+        self.copy_mode = "hw"
+        ports = [self.dut.ports_info[0]["pci"]]
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+
+        self.dut.send_expect("^c", "# ")
+        self.updating_mac = "enabled"
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def test_perf_dsa_with_diff_copy_mode_using_kernel_driver(self):
+        """
+        Test Case 12: DMA performance comparison between SW copies and HW copies using DSA kernel driver
+        """
+        self.DC.create_wq(wq_num=4, dsa_idxs=[0])
+        self.core_num = 3
+        self.rx_queues = 4
+        self.nic_port_num = 1
+        self.updating_mac = "enabled"
+        self.copy_mode = "sw"
+        ports = [self.dut.ports_info[0]["pci"]]
+        eal_params = self.dut.create_eal_parameters(
+            cores=self.get_core_list(), ports=ports
+        )
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=False)
+
+        self.dut.send_expect("^c", "# ")
+        self.copy_mode = "hw"
+        self.launch_dma_app(eal_params=eal_params)
+        self.send_and_verify(check_each_queue=True)
+        self.result_table_print()
+
+    def tear_down(self):
+        """
+        Run after each test case.
+        """
+        self.dut.send_expect("^c", "# ")
+        self.dut.send_expect("killall -I %s" % self.dma_name, "#", 20)
+        self.dut.kill_all()
+
+    def tear_down_all(self):
+        """
+        Run after each test suite.
+        """
+        pass
-- 
2.25.1

[dts][PATCH V3 3/3] tests/dsa: add dsa testsuite

[lijuan.tu]

On Mon, 27 Mar 2023 14:12:18 +0800, Wei Ling <weix.ling@intel.com> wrote:
> Add new dsa testsuite to test dpdk-dma application
> and example of how to use the DMAdev API to make a packet copy
> application use DSA channel with DPDK driver and Kernel driver.
> 
> Signed-off-by: Wei Ling <weix.ling@intel.com>


Series applied, thanks