From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 0E2C442DD9;
	Wed,  5 Jul 2023 13:11:44 +0200 (CEST)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id B8EA442BC9;
	Wed,  5 Jul 2023 13:11:20 +0200 (CEST)
Received: from NAM11-BN8-obe.outbound.protection.outlook.com
 (mail-bn8nam11on2041.outbound.protection.outlook.com [40.107.236.41])
 by mails.dpdk.org (Postfix) with ESMTP id E3E7040FAE
 for <dev@dpdk.org>; Wed,  5 Jul 2023 13:11:19 +0200 (CEST)
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=GNhNV6FsUKJVYs2cR/gR4yqTP9oXHl8uwTBaGC4ZFGPfhX8CzyF0bDQ86n7Bs3AeHKGNtO7cSboSgNbpznPR203NwGuYQ26ezvzeI5mux+SbRsMs4Jv2cl5bDPCSbmkabHkJXBaWgNyTnhM3kKvtC/mxVFuiq88TJ10JR5gUEwYrAqqIBWzCqu5jnAw8AktrJva8kuEyHRgyiMPFMJUwX8d82lLq+muIlz5gMtITuZ4Y9BviaIqW4I8lolPPnYOgyeJZQjx+0BsFQliqOO3aeSP+5qkylLXCHfDwkoyu1vU7XX7oZCaWtAWbh3RsPnAsiS9dva/wgF0H7dR1KfWAvA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; 
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
 bh=Zrc1juTuIMGABBUREkW+A4JVfHtTYTJx09SyLHnMBe4=;
 b=TsRvzB7T7HeizMFUn/qK17kXkXmQz4fwy+p02N54oHLnJImvuCMsvXieXqoF8tzygXni7ZRnsdMkhNUyz8tWglX8t6TFAr+qYZy6ngJrDItsWAlaoH6qOoW6WCWInZs6Jkcw/fak6zP8xtB7nCPJXIbf92ZLJQpgAJ+1e2Sb5EfGjMBG7/EYNwONeCLTH5uTWNhuxhlbAimNlyqWKNrS9Yx4A9qfN8S0lu4wviMlrKirbUtBHiwrsfDGIjW5gXclAHvHmQi/faBXLJ9iK61pHC7ji48llMzcuCpd2zLG1AcegjyZLVdVGPDIEqaFx8aBGWd5qElW9+IGxRyVsO3uog==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is
 216.228.117.161) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com;
 dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com;
 dkim=none (message not signed); arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com;
 s=selector2;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=Zrc1juTuIMGABBUREkW+A4JVfHtTYTJx09SyLHnMBe4=;
 b=T3uRGNnjDiMi09u/bB7sOoO5Ku/JL4wxKg6e1roJ45fZYpYU97t+zdD8NWW7yIiF2ubqYzNOPVXEAe1q5Iyf9dfFJQb30pc+lBTcK4vRrDE6pcKV4fO3tmuajQW0xCdoQLlzPtCPukbgMZdkobOtlCnCMLpcphHMaop4KG2vWdZLbvrRyQpMwcahVHLbJMzTjnEg2gMn3+77sJCCk0bJ6c967ofGaf4keBY4nPaFvERv1qKcLvyCr6gLAO0B6wRzciVpqd6BRWAZiKj2AI7CO+u2/nU3HW82yNtPtm0EGDg4AA5iiOZQAkZXQfI9rtnpweu15R5bSBhRttV2xWqt6g==
Received: from BN9PR03CA0523.namprd03.prod.outlook.com (2603:10b6:408:131::18)
 by BL1PR12MB5352.namprd12.prod.outlook.com (2603:10b6:208:314::10)
 with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6565.17; Wed, 5 Jul
 2023 11:11:14 +0000
Received: from BN8NAM11FT075.eop-nam11.prod.protection.outlook.com
 (2603:10b6:408:131:cafe::13) by BN9PR03CA0523.outlook.office365.com
 (2603:10b6:408:131::18) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6565.23 via Frontend
 Transport; Wed, 5 Jul 2023 11:11:14 +0000
X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.161)
 smtp.mailfrom=nvidia.com;
 dkim=none (message not signed)
 header.d=none;dmarc=pass action=none header.from=nvidia.com;
Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates
 216.228.117.161 as permitted sender) receiver=protection.outlook.com;
 client-ip=216.228.117.161; helo=mail.nvidia.com; pr=C
Received: from mail.nvidia.com (216.228.117.161) by
 BN8NAM11FT075.mail.protection.outlook.com (10.13.176.208) with Microsoft SMTP
 Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.20.6521.45 via Frontend Transport; Wed, 5 Jul 2023 11:11:13 +0000
Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com
 (10.129.200.67) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.5; Wed, 5 Jul 2023
 04:11:01 -0700
Received: from nvidia.com (10.126.230.35) by rnnvmail201.nvidia.com
 (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37; Wed, 5 Jul 2023
 04:11:00 -0700
From: Viacheslav Ovsiienko <viacheslavo@nvidia.com>
To: <dev@dpdk.org>
CC: <jerinj@marvell.com>, <rasland@nvidia.com>
Subject: [PATCH v4 4/4] doc: add mlx5 datapath tracing feature description
Date: Wed, 5 Jul 2023 14:10:38 +0300
Message-ID: <20230705111038.9935-5-viacheslavo@nvidia.com>
X-Mailer: git-send-email 2.18.1
In-Reply-To: <20230705111038.9935-1-viacheslavo@nvidia.com>
References: <20230420100803.494-1-viacheslavo@nvidia.com>
 <20230705111038.9935-1-viacheslavo@nvidia.com>
MIME-Version: 1.0
Content-Type: text/plain
X-Originating-IP: [10.126.230.35]
X-ClientProxiedBy: rnnvmail203.nvidia.com (10.129.68.9) To
 rnnvmail201.nvidia.com (10.129.68.8)
X-EOPAttributedMessage: 0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: BN8NAM11FT075:EE_|BL1PR12MB5352:EE_
X-MS-Office365-Filtering-Correlation-Id: c2b7d226-89ad-4708-fee4-08db7d488bcd
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: tNtOd6/kbNsvCQTZvX5jHlrKVjpUZBzNIWoNfwACjXdbajHifwKiD5e7G8CrHpOMCZWY9fmhCRu8L657WsUvRgbWCv5MFKRqdLssVQjDQWeTYO+649DD93bh+uhbOld9OjzqgiY6M21ZEONig/bcQfwx75uWxODfyDCNzko1nPDe/JdTP/0g8gxoLIh/CBHTa5oyfpRSr1/3NTflwtR+1e7Nimc8v6TJ+gT8399Ve6p9S/j5grTVasHGMfdov7+JbtXqIvp7Ur3qVq0d7ybtjM6xXpV2kn7OPQV+RdHw3TQNYsbyzF/mMcF/LXmil7Lta4s73/a5e/eUrQRGc0zxIisWl6clzMdt4sGzGM9BbnBP5/289XQdWe06uOaMvwJ0UewimQ5SYPLPOZgnBfy71fo7wSB1Mc1Q7Rg7C/6Mv32/alJpRpiuDQuYEQ0+YNk74u2gRJE9z7V5RgsWucOswpmQk8beTd6w7WRWlpxGi9zlUqROX50GAgiTQNyHf665q2gs2swUkM//IIe/B2BCBLucUJo90+8nEsjwALc/tBUFnAK14x8chlYDJWXx8RFvJ71c6DcAFpEwTCQmWOiI8LLSyHAHQipecbxlAvXpIz1DqaZS6+btYxw4WTYuvWUyHpGIWbQDn+xQhhYGbgawY6HF2y8LOEfm3P5kskWUmRm/EwVYmQlb0fwxPFc+bBdH+4oWM811V6/W01WcE4lHXo3ohc1/ZVckwtfzQ+gVoarvvYr5LBzHI+acjGJ7EaWkytMEs+HE61NCqs5sl10sH89xO9qoI6hSEufgu5b9t+k=
X-Forefront-Antispam-Report: CIP:216.228.117.161; CTRY:US; LANG:en; SCL:1; SRV:;
 IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge2.nvidia.com; CAT:NONE;
 SFS:(13230028)(4636009)(39860400002)(136003)(346002)(376002)(396003)(451199021)(46966006)(40470700004)(36840700001)(41300700001)(54906003)(55016003)(40480700001)(7696005)(36756003)(5660300002)(316002)(2906002)(8936002)(8676002)(6916009)(70586007)(4326008)(70206006)(40460700003)(426003)(82740400003)(336012)(966005)(6666004)(478600001)(107886003)(82310400005)(186003)(86362001)(6286002)(2616005)(356005)(7636003)(26005)(83380400001)(47076005)(36860700001)(1076003)(16526019);
 DIR:OUT; SFP:1101; 
X-OriginatorOrg: Nvidia.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Jul 2023 11:11:13.7676 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: c2b7d226-89ad-4708-fee4-08db7d488bcd
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.161];
 Helo=[mail.nvidia.com]
X-MS-Exchange-CrossTenant-AuthSource: BN8NAM11FT075.eop-nam11.prod.protection.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR12MB5352
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

The mlx5 provides the send scheduling on specific moment of time,
and for the related kind of applications it would be extremely useful
to have extra debug information - when and how packets were scheduled
and when the actual sending was completed by the NIC hardware (it helps
application to track the internal delay issues).

The patch adds the documentation for feature usage.

Signed-off-by: Viacheslav Ovsiienko <viacheslavo@nvidia.com>
---
 doc/guides/nics/mlx5.rst | 78 ++++++++++++++++++++++++++++++++++++++++
 1 file changed, 78 insertions(+)

diff --git a/doc/guides/nics/mlx5.rst b/doc/guides/nics/mlx5.rst
index b9843edbd9..1c8fc6f6d4 100644
--- a/doc/guides/nics/mlx5.rst
+++ b/doc/guides/nics/mlx5.rst
@@ -2077,3 +2077,81 @@ where:
 * ``sw_queue_id``: queue index in range [64536, 65535].
   This range is the highest 1000 numbers.
 * ``hw_queue_id``: queue index given by HW in queue creation.
+
+
+Tx datapath tracing
+^^^^^^^^^^^^^^^^^^^
+
+The mlx5 provides the Tx datapath tracing capability with extra debug
+information - when and how packets were scheduled and when the actual
+sending was completed by the NIC hardware. The feature engages the
+existing DPDK datapath tracing capability.
+
+Usage of the mlx5 Tx datapath tracing:
+
+#. Build DPDK application with enabled datapath tracking
+
+   * The meson option should be specified: ``--enable_trace_fp=true``
+   * The c_args should be specified:  ``-DALLOW_EXPERIMENTAL_API``
+
+   .. code-block:: console
+
+      meson configure --buildtype=debug -Denable_trace_fp=true
+         -Dc_args='-DRTE_LIBRTE_MLX5_DEBUG -DRTE_ENABLE_ASSERT -DALLOW_EXPERIMENTAL_API' build
+
+      meson configure --buildtype=release -Denable_trace_fp=true
+         -Dc_args='-DRTE_ENABLE_ASSERT -DALLOW_EXPERIMENTAL_API' build
+
+#. Configure the NIC
+
+   If the sending completion timings are important the NIC should be configured
+   to provide realtime timestamps, the ``REAL_TIME_CLOCK_ENABLE`` NV settings
+   parameter should be configured as TRUE.
+
+   .. code-block:: console
+
+      mlxconfig -d /dev/mst/mt4125_pciconf0 s REAL_TIME_CLOCK_ENABLE=1
+
+#. Run application with EAL parameters configuring the tracing in mlx5 Tx datapath
+
+    * ``--trace=pmd.net.mlx5.tx`` - the regular expression enabling the tracepoints
+      with matching names at least "pmd.net.mlx5.tx" must be enabled to gather all
+      events needed to analyze mlx5 Tx datapath and its timings. By default all
+      tracepoints are disabled.
+
+#. Store the file with gathered tracing information
+
+#. Install or build the ``babeltrace2`` package
+
+   The gathered trace data can be analyzed with a developed Python script.
+   To parse the trace, the data script uses the ``babeltrace2`` library.
+   The package should be either installed or built from source code as
+   shown below.
+
+   .. code-block:: console
+
+      git clone https://github.com/efficios/babeltrace.git
+      cd babeltrace
+      ./bootstrap
+      ./configure -help
+      ./configure --disable-api-doc --disable-man-pages
+                  --disable-python-bindings-doc --enable-python-plugins
+                  --enable-python-binding
+
+#. Run analyzing scrypt (in Python) to combine related events (packet firing and
+   completion) and see the output in human-readable view
+
+   The analyzing script is located in the folder: ``./drivers/net/mlx5/tools``
+   It requires Python3.6, ``babeltrace2`` packages and it takes the only parameter
+   of trace data file.
+
+   .. code-block:: console
+
+      ./mlx5_trace.py /var/log/rte-2023-01-23-AM-11-52-39
+
+#. Interpreting the Script Output Data
+
+   All the timings are given in nanoseconds.
+   The list of Tx bursts per port/queue is presented in the output.
+   Each list element contains the list of built WQEs with specific opcodes, and
+   each WQE contains the list of the encompassed packets to send.
-- 
2.18.1