From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id C59D5454F1; Tue, 25 Jun 2024 17:54:08 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id CE57B427C2; Tue, 25 Jun 2024 17:54:01 +0200 (CEST) Received: from mail-il1-f227.google.com (mail-il1-f227.google.com [209.85.166.227]) by mails.dpdk.org (Postfix) with ESMTP id 0DF8F4279E for ; Tue, 25 Jun 2024 17:53:59 +0200 (CEST) Received: by mail-il1-f227.google.com with SMTP id e9e14a558f8ab-375e0e258b7so23841915ab.1 for ; Tue, 25 Jun 2024 08:53:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1719330838; x=1719935638; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=4SfGIe7bR+SFypR1IuR19PMFUOn9f12qqNzDYihhyOE=; b=VwyL6x1flLe44r0y7qxc9zViuC7gL7TY/sRwYdYUlbnlqynnt6hWPDXQrCcTU3+Vbf ADqp+t69To9LKjgncNPOWG1YClcp2UFvTSmK7O8ibnaTeXTYDHCPCe3dwZi+H+uzcm2m j3t3eBjhu4WcmdwRdz9IxgJIbY/LzAVD/zsNI= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1719330838; x=1719935638; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=4SfGIe7bR+SFypR1IuR19PMFUOn9f12qqNzDYihhyOE=; b=ex7IfXdlsRX1GOoUq2p1CTQsMz6D9JKGUuLGBtWfbU/Gk5O9aqYGbRjLpI3+Dz/v2z gjp/77ZSDX4Gb+DUuFm9rj5QNMqyLBbLtG6+i5VjJd4QiwYgTUeSjMZlmSLPR/OlpsFB KfRjgEzODVQD2sRHPP7kgrf4cGe/SwIVKRH/cmnCAcVqgQRawwu/Byn+TlMUHiygR5eJ D4DSveU4fdhaq0osNQqcREnmN+8OfeapP6imRUfzhvk041GRJ+Fu9SUo5aBT12/yfwVJ fCAmHSCsVsboNSPvomRgfvOt8q5ui4M/2DRo8JmLSIXsT/tyb9EvA/7aAHnYcKK0O9Qn D1BA== X-Gm-Message-State: AOJu0Yy4TnUnOCOGzOaD3m2jC+hkf1acKhaUKQphWMIzSvExom9EnU+c h3UJWfUQy3RUzSEVJzDmr+FAqiSGm246OCHSIxceN9ckYd+cpU1pDi5qliYawtEGCh6JGH9EEyf EykVNPVvyARcN2bdgdiG3fD/bKKVWJm25 X-Google-Smtp-Source: AGHT+IExLoJ8tQtMzBrYpEeqlbaun5mNdrqIb6AvrW85q4nJA2kAuLHme/18F5H9kS08v6R9Wt2/MzYd2ckS X-Received: by 2002:a05:6e02:20cf:b0:376:3fc4:1180 with SMTP id e9e14a558f8ab-3763fc4128dmr105405895ab.17.1719330838416; Tue, 25 Jun 2024 08:53:58 -0700 (PDT) Received: from postal.iol.unh.edu (postal.iol.unh.edu. [132.177.123.84]) by smtp-relay.gmail.com with ESMTPS id e9e14a558f8ab-3762f31cb21sm4640585ab.27.2024.06.25.08.53.57 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 25 Jun 2024 08:53:58 -0700 (PDT) X-Relaying-Domain: iol.unh.edu Received: from iol.unh.edu (unknown [IPv6:2606:4100:3880:1257::1083]) by postal.iol.unh.edu (Postfix) with ESMTP id 1F6D5605C373; Tue, 25 Jun 2024 11:53:57 -0400 (EDT) From: jspewock@iol.unh.edu To: Honnappa.Nagarahalli@arm.com, wathsala.vithanage@arm.com, npratte@iol.unh.edu, thomas@monjalon.net, juraj.linkes@pantheon.tech, probb@iol.unh.edu, Luca.Vizzarro@arm.com, paul.szczepanek@arm.com, yoan.picchi@foss.arm.com Cc: dev@dpdk.org, Jeremy Spewock Subject: [PATCH v1 2/4] dts: add port queue modification and forwarding stats to testpmd Date: Tue, 25 Jun 2024 11:53:30 -0400 Message-ID: <20240625155332.2400-3-jspewock@iol.unh.edu> X-Mailer: git-send-email 2.45.2 In-Reply-To: <20240625155332.2400-1-jspewock@iol.unh.edu> References: <20240625155332.2400-1-jspewock@iol.unh.edu> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Jeremy Spewock This patch adds methods for querying and modifying port queue state and configuration. In addition to this, it also adds the ability to capture the forwarding statistics that get outputted when you send the "stop" command in testpmd. Querying of port queue information is handled through a TextParser dataclass in case there is future need for using more of the output from the command used to query the information. Signed-off-by: Jeremy Spewock --- dts/framework/remote_session/testpmd_shell.py | 225 +++++++++++++++++- 1 file changed, 223 insertions(+), 2 deletions(-) diff --git a/dts/framework/remote_session/testpmd_shell.py b/dts/framework/remote_session/testpmd_shell.py index ec22f72221..e628d60dbe 100644 --- a/dts/framework/remote_session/testpmd_shell.py +++ b/dts/framework/remote_session/testpmd_shell.py @@ -19,7 +19,7 @@ from dataclasses import dataclass, field from enum import Flag, auto from pathlib import PurePath -from typing import ClassVar +from typing import ClassVar, cast from typing_extensions import Self, Unpack @@ -541,6 +541,48 @@ class TestPmdPort(TextParser): ) +@dataclass +class TestPmdPortQueue(TextParser): + """Dataclass representation of the common parts of the testpmd `show rxq/txq info` commands.""" + + #: + prefetch_threshold: int = field(metadata=TextParser.find_int(r"prefetch threshold: (\d+)")) + #: + host_threshold: int = field(metadata=TextParser.find_int(r"host threshold: (\d+)")) + #: + writeback_threshold: int = field(metadata=TextParser.find_int(r"writeback threshold: (\d+)")) + #: + free_threshold: int = field(metadata=TextParser.find_int(r"free threshold: (\d+)")) + #: + deferred_start: bool = field(metadata=TextParser.find("deferred start: on")) + #: The number of RXD/TXDs is just the ring size of the queue. + ring_size: int = field(metadata=TextParser.find_int(r"Number of (?:RXDs|TXDs): (\d+)")) + #: + is_queue_started: bool = field(metadata=TextParser.find("queue state: started")) + #: + burst_mode: str = field(metadata=TextParser.find(r"Burst mode: ([^\r\n]+)")) + + +@dataclass +class TestPmdTxPortQueue(TestPmdPortQueue): + """Dataclass representation for testpmd `show txq info` command.""" + + #: + rs_threshold: int = field(metadata=TextParser.find_int(r"RS threshold: (\d+)")) + + +@dataclass +class TestPmdRxPortQueue(TestPmdPortQueue): + """Dataclass representation for testpmd `show rxq info` command.""" + + #: + mempool: str = field(metadata=TextParser.find(r"Mempool: ([^\r\n]+)")) + #: + can_drop_packets: bool = field(metadata=TextParser.find(r"drop packets: on")) + #: + is_scattering_packets: bool = field(metadata=TextParser.find(r"scattered packets: on")) + + @dataclass class TestPmdPortStats(TextParser): """Port statistics.""" @@ -645,7 +687,7 @@ def start(self, verify: bool = True) -> None: "Not all ports came up after starting packet forwarding in testpmd." ) - def stop(self, verify: bool = True) -> None: + def stop(self, verify: bool = True) -> str: """Stop packet forwarding. Args: @@ -653,6 +695,9 @@ def stop(self, verify: bool = True) -> None: forwarding was stopped successfully or not started. If neither is found, it is considered an error. + Returns: + Output gathered from sending the stop command. + Raises: InteractiveCommandExecutionError: If `verify` is :data:`True` and the command to stop forwarding results in an error. @@ -665,6 +710,7 @@ def stop(self, verify: bool = True) -> None: ): self._logger.debug(f"Failed to stop packet forwarding: \n{stop_cmd_output}") raise InteractiveCommandExecutionError("Testpmd failed to stop packet forwarding.") + return stop_cmd_output def get_devices(self) -> list[TestPmdDevice]: """Get a list of device names that are known to testpmd. @@ -806,6 +852,181 @@ def show_port_stats(self, port_id: int) -> TestPmdPortStats: return TestPmdPortStats.parse(output) + def show_port_queue_info( + self, port_id: int, queue_id: int, is_rx_queue: bool + ) -> TestPmdPortQueue: + """Get the info for a queue on a given port. + + Args: + port_id: ID of the port where the queue resides. + queue_id: ID of the queue to query. + is_rx_queue: Whether to check an RX or TX queue. If :data:`True` an RX queue will be + queried, otherwise a TX queue will be queried. + + Raises: + InteractiveCommandExecutionError: If there is a failure when getting the info for the + queue. + + Returns: + Information about the queue on the given port. + """ + queue_type = "rxq" if is_rx_queue else "txq" + queue_info = self.send_command( + f"show {queue_type} info {port_id} {queue_id}", skip_first_line=True + ) + if queue_info.startswith("ETHDEV: Invalid"): + raise InteractiveCommandExecutionError( + f"Could not get the info for {queue_type} {queue_id} on port {port_id}" + ) + return ( + TestPmdRxPortQueue.parse(queue_info) + if is_rx_queue + else TestPmdTxPortQueue.parse(queue_info) + ) + + def show_port_rx_queue_info(self, port_id: int, queue_id: int) -> TestPmdRxPortQueue: + """Get port queue info and cast to :class:`TestPmdRxPortQueue`. + + Wrapper around :meth:`show_port_queue_info` that casts the more generic type into the + correct subclass. + + Args: + port_id: ID of the port where the queue resides. + queue_id: ID of the queue to query. + + Returns: + Information about the Rx queue on the given port. + """ + return cast(TestPmdRxPortQueue, self.show_port_queue_info(port_id, queue_id, True)) + + def show_port_tx_queue_info(self, port_id: int, queue_id: int) -> TestPmdTxPortQueue: + """Get port queue info and cast to :class:`TestPmdTxPortQueue`. + + Wrapper around :meth:`show_port_queue_info` that casts the more generic type into the + correct subclass. + + Args: + port_id: ID of the port where the queue resides. + queue_id: ID of the queue to query. + + Returns: + Information about the Tx queue on the given port. + """ + return cast(TestPmdTxPortQueue, self.show_port_queue_info(port_id, queue_id, False)) + + def stop_port_queue( + self, port_id: int, queue_id: int, is_rx_queue: bool, verify: bool = True + ) -> None: + """Stops a given queue on a port. + + Args: + port_id: ID of the port that the queue belongs to. + queue_id: ID of the queue to stop. + is_rx_queue: Type of queue to stop. If :data:`True` an RX queue will be stopped, + otherwise a TX queue will be stopped. + verify: If :data:`True` an additional command will be sent to verify the queue stopped. + Defaults to :data:`True`. + + Raises: + InteractiveCommandExecutionError: If `verify` is :data:`True` and the queue fails to + stop. + """ + port_type = "rxq" if is_rx_queue else "txq" + stop_cmd_output = self.send_command(f"port {port_id} {port_type} {queue_id} stop") + if verify: + if self.show_port_queue_info(port_id, queue_id, is_rx_queue).is_queue_started: + self._logger.debug( + f"Failed to stop {port_type} {queue_id} on port {port_id}:\n{stop_cmd_output}" + ) + raise InteractiveCommandExecutionError( + f"Test pmd failed to stop {port_type} {queue_id} on port {port_id}" + ) + + def start_port_queue( + self, port_id: int, queue_id: int, is_rx_queue: bool, verify: bool = True + ) -> None: + """Starts a given queue on a port. + + First sets up the port queue, then starts it. + + Args: + port_id: ID of the port that the queue belongs to. + queue_id: ID of the queue to start. + is_rx_queue: Type of queue to start. If :data:`True` an RX queue will be started, + otherwise a TX queue will be started. + verify: if :data:`True` an additional command will be sent to verify that the queue was + started. Defaults to :data:`True`. + + Raises: + InteractiveCommandExecutionError: If `verify` is :data:`True` and the queue fails to + start. + """ + port_type = "rxq" if is_rx_queue else "txq" + self.setup_port_queue(port_id, queue_id, is_rx_queue) + start_cmd_output = self.send_command(f"port {port_id} {port_type} {queue_id} start") + if verify: + if not self.show_port_queue_info(port_id, queue_id, is_rx_queue).is_queue_started: + self._logger.debug( + f"Failed to start {port_type} {queue_id} on port {port_id}:\n{start_cmd_output}" + ) + raise InteractiveCommandExecutionError( + f"Test pmd failed to start {port_type} {queue_id} on port {port_id}" + ) + + def setup_port_queue(self, port_id: int, queue_id: int, is_rx_queue: bool) -> None: + """Setup a given queue on a port. + + This functionality cannot be verified because the setup action only takes effect when the + queue is started. + + Args: + port_id: ID of the port where the queue resides. + queue_id: ID of the queue to setup. + is_rx_queue: Type of queue to setup. If :data:`True` an RX queue will be setup, + otherwise a TX queue will be setup. + """ + self.send_command(f"port {port_id} {'rxq' if is_rx_queue else 'txq'} {queue_id} setup") + + def set_queue_ring_size( + self, + port_id: int, + queue_id: int, + size: int, + is_rx_queue: bool, + verify: bool = True, + ) -> None: + """Update the ring size of an Rx/Tx queue on a given port. + + Queue is setup after setting the ring size so that the queue info reflects this change and + it can be verified. + + Args: + port_id: The port that the queue resides on. + queue_id: The ID of the queue on the port. + size: The size to update the ring size to. + is_rx_queue: Whether to modify an RX or TX queue. If :data:`True` an RX queue will be + updated, otherwise a TX queue will be updated. + verify: If :data:`True` an additional command will be sent to check the ring size of + the queue in an attempt to validate that the size was changes properly. + + Raises: + InteractiveCommandExecutionError: If `verify` is :data:`True` and there is a failure + when updating ring size. + """ + queue_type = "rxq" if is_rx_queue else "txq" + self.send_command(f"port config {port_id} {queue_type} {queue_id} ring_size {size}") + self.setup_port_queue(port_id, queue_id, is_rx_queue) + if verify: + curr_ring_size = self.show_port_queue_info(port_id, queue_id, is_rx_queue).ring_size + if curr_ring_size != size: + self._logger.debug( + f"Failed up update ring size of queue {queue_id} on port {port_id}. Current" + f" ring size is {curr_ring_size}." + ) + raise InteractiveCommandExecutionError( + f"Failed to update ring size of queue {queue_id} on port {port_id}" + ) + def close(self) -> None: """Overrides :meth:`~.interactive_shell.close`.""" self.send_command("quit", "") -- 2.45.2