From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from dpdk.org (dpdk.org [92.243.14.124])
by inbox.dpdk.org (Postfix) with ESMTP id BD248A04AF;
Fri, 21 Aug 2020 18:31:12 +0200 (CEST)
Received: from [92.243.14.124] (localhost [127.0.0.1])
by dpdk.org (Postfix) with ESMTP id DB46A1C11A;
Fri, 21 Aug 2020 18:30:12 +0200 (CEST)
Received: from mga18.intel.com (mga18.intel.com [134.134.136.126])
by dpdk.org (Postfix) with ESMTP id 0EF171C119
for <dev@dpdk.org>; Fri, 21 Aug 2020 18:30:10 +0200 (CEST)
IronPort-SDR: gZAqa8gtcJUk4D4bIdV2DKPKes9V5Uho85m5NOs4QJ8IIJoqxvdHpvHrDGZONsgJoFx0gCB1tx
7ZjyhSFcksQg==
X-IronPort-AV: E=McAfee;i="6000,8403,9719"; a="143209509"
X-IronPort-AV: E=Sophos;i="5.76,337,1592895600"; d="scan'208";a="143209509"
X-Amp-Result: SKIPPED(no attachment in message)
X-Amp-File-Uploaded: False
Received: from orsmga006.jf.intel.com ([10.7.209.51])
by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;
21 Aug 2020 09:30:10 -0700
IronPort-SDR: QZpMaoQpnmMfdos2w0yA9HAUZKotWAzkSn9Ney2lQdWb0JBKrh7z0U+2ygvMXp+rhwuLJwWJrN
R8JHCx1k6YBA==
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.76,337,1592895600"; d="scan'208";a="297992741"
Received: from silpixa00399126.ir.intel.com ([10.237.222.56])
by orsmga006.jf.intel.com with ESMTP; 21 Aug 2020 09:30:08 -0700
From: Bruce Richardson <bruce.richardson@intel.com>
To: dev@dpdk.org
Cc: cheng1.jiang@intel.com, patrick.fu@intel.com, ping.yu@intel.com,
kevin.laatz@intel.com, Bruce Richardson <bruce.richardson@intel.com>
Date: Fri, 21 Aug 2020 17:29:33 +0100
Message-Id: <20200821162944.29840-8-bruce.richardson@intel.com>
X-Mailer: git-send-email 2.25.1
In-Reply-To: <20200821162944.29840-1-bruce.richardson@intel.com>
References: <20200721095140.719297-1-bruce.richardson@intel.com>
<20200821162944.29840-1-bruce.richardson@intel.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Subject: [dpdk-dev] [PATCH v2 07/18] raw/ioat: include example configuration
script
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
<mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
<mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org
Sender: "dev" <dev-bounces@dpdk.org>
Devices managed by the idxd kernel driver must be configured for DPDK use
before it can be used by the ioat driver. This example script serves both
as a quick way to get the driver set up with a simple configuration, and as
the basis for users to modify it and create their own configuration
scripts.
Signed-off-by: Bruce Richardson <bruce.richardson@intel.com>
---
doc/guides/rawdevs/ioat.rst | 2 +
drivers/raw/ioat/dpdk_idxd_cfg.py | 79 +++++++++++++++++++++++++++++++
2 files changed, 81 insertions(+)
create mode 100755 drivers/raw/ioat/dpdk_idxd_cfg.py
diff --git a/doc/guides/rawdevs/ioat.rst b/doc/guides/rawdevs/ioat.rst
index 43a69ec4c6..8d241d7e77 100644
--- a/doc/guides/rawdevs/ioat.rst
+++ b/doc/guides/rawdevs/ioat.rst
@@ -50,6 +50,8 @@ The `accel-config <https://github.com/intel/idxd-config>`_ utility library can b
.. note::
The device configuration can also be done by directly interacting with the sysfs nodes.
+ An example of how this may be done can be seen in the script ``dpdk_idxd_cfg.py``
+ included in the driver source directory.
There are some mandatory configuration steps before being able to use a device with an application.
The internal engines, which do the copies or other operations,
diff --git a/drivers/raw/ioat/dpdk_idxd_cfg.py b/drivers/raw/ioat/dpdk_idxd_cfg.py
new file mode 100755
index 0000000000..bce4bb5bd4
--- /dev/null
+++ b/drivers/raw/ioat/dpdk_idxd_cfg.py
@@ -0,0 +1,79 @@
+#!/usr/bin/env python3
+# SPDX-License-Identifier: BSD-3-Clause
+# Copyright(c) 2020 Intel Corporation
+
+"""
+Configure an entire Intel DSA instance, using idxd kernel driver, for DPDK use
+"""
+
+import sys
+import argparse
+import os
+import os.path
+
+
+class SysfsDir:
+ "Used to read/write paths in a sysfs directory"
+ def __init__(self, path):
+ self.path = path
+
+ def read_int(self, filename):
+ "Return a value from sysfs file"
+ with open(os.path.join(self.path, filename)) as f:
+ return int(f.readline())
+
+ def write_values(self, values):
+ "write dictionary, where key is filename and value is value to write"
+ for filename, contents in values.items():
+ with open(os.path.join(self.path, filename), "w") as f:
+ f.write(str(contents))
+
+
+def configure_dsa(dsa_id, queues):
+ "Configure the DSA instance with appropriate number of queues"
+ dsa_dir = SysfsDir(f"/sys/bus/dsa/devices/dsa{dsa_id}")
+ drv_dir = SysfsDir("/sys/bus/dsa/drivers/dsa")
+
+ max_groups = dsa_dir.read_int("max_groups")
+ max_engines = dsa_dir.read_int("max_engines")
+ max_queues = dsa_dir.read_int("max_work_queues")
+ max_tokens = dsa_dir.read_int("max_tokens")
+
+ # we want one engine per group
+ nb_groups = min(max_engines, max_groups)
+ for grp in range(nb_groups):
+ dsa_dir.write_values({f"engine{dsa_id}.{grp}/group_id": grp})
+
+ nb_queues = min(queues, max_queues)
+ if queues > nb_queues:
+ print(f"Setting number of queues to max supported value: {max_queues}")
+
+ # configure each queue
+ for q in range(nb_queues):
+ wq_dir = SysfsDir(os.path.join(dsa_dir.path, f"wq{dsa_id}.{q}"))
+ wq_dir.write_values({"group_id": q % nb_groups,
+ "type": "user",
+ "mode": "dedicated",
+ "name": f"dpdk_wq{dsa_id}.{q}",
+ "priority": 1,
+ "size": int(max_tokens / nb_queues)})
+
+ # enable device and then queues
+ drv_dir.write_values({"bind": f"dsa{dsa_id}"})
+ for q in range(nb_queues):
+ drv_dir.write_values({"bind": f"wq{dsa_id}.{q}"})
+
+
+def main(args):
+ "Main function, does arg parsing and calls config function"
+ arg_p = argparse.ArgumentParser(
+ description="Configure whole DSA device instance for DPDK use")
+ arg_p.add_argument('dsa_id', type=int, help="DSA instance number")
+ arg_p.add_argument('-q', metavar='queues', type=int, default=255,
+ help="Number of queues to set up")
+ parsed_args = arg_p.parse_args(args[1:])
+ configure_dsa(parsed_args.dsa_id, parsed_args.q)
+
+
+if __name__ == "__main__":
+ main(sys.argv)
--
2.25.1