From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A998141B9D; Wed, 1 Feb 2023 10:23:17 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8EE564114A; Wed, 1 Feb 2023 10:23:17 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id B8718406A2 for ; Wed, 1 Feb 2023 10:23:15 +0100 (CET) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 3116Lf5U026253 for ; Wed, 1 Feb 2023 01:23:14 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-type; s=pfpt0220; bh=jQj0TpS1m4N0RdGDgiAti9BmvvRRJmm9Fb33sUsY2ok=; b=F0BR5gVrOEGnYGmh8ZP+Fi5fm1gLchqQSdO1zWk8NJqMiPWRuFRupO2UU1D5pnwMd3gs zDoA/vUn8ROFydZoR3/J9EQotLEu2TKSd7p57ro8rAnZTkDu7Hbs9ZnCNtq0GWbN7rjq XPyz/LSNCsJOocouO4uTwykgcjYklxQ4RbYw12L3sr2j7KxrUKTSPdj5XyX3v9kWmKlI l6Glrs4HFBUu43p5soU+G8Ie2Uo4BZBVrcGPxLbUNcpa0quze+oJc0oCezgK6IB16nfb qYOCNjMg/QdWSzNXIB4CkPBv8eMx4DbAlMwhs5ZeSKAZmWVBQMzPLLlbwViQtX7f9hRG 9Q== Received: from dc5-exch01.marvell.com ([199.233.59.181]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3nfjr8rgv2-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for ; Wed, 01 Feb 2023 01:23:14 -0800 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Wed, 1 Feb 2023 01:23:13 -0800 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.42 via Frontend Transport; Wed, 1 Feb 2023 01:23:13 -0800 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id 9E6A85B6923; Wed, 1 Feb 2023 01:23:12 -0800 (PST) From: Srikanth Yalavarthi To: CC: , , , , Srikanth Yalavarthi Subject: [PATCH v4 00/39] Implementation of ML CNXK driver Date: Wed, 1 Feb 2023 01:22:31 -0800 Message-ID: <20230201092310.23252-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20221208200220.20267-1-syalavarthi@marvell.com> References: <20221208200220.20267-1-syalavarthi@marvell.com> MIME-Version: 1.0 Content-Type: text/plain X-Proofpoint-GUID: lgw1uabEXy7sYspmK0wpTg-cNEt610yh X-Proofpoint-ORIG-GUID: lgw1uabEXy7sYspmK0wpTg-cNEt610yh X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.930,Hydra:6.0.562,FMLib:17.11.122.1 definitions=2023-02-01_03,2023-01-31_01,2022-06-22_01 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Marvell ML CNXK Driver ---------------------- This patch series implements common Machine Learning (ML) ROC code and driver for Marvell Octeon 10 (cnxk) platform. ML inferencing is supported on cnxk platform through an integrated ML inferencing processor. The current driver supports programming the ML hardware engine through offload mode. All APIs proposed in the DPDK ML device specification are supported on the cnxk platform. v4: * Update function names of ML common code * Added support for configurable OCM page size * Minor typo fixes v3: * Skip installation of internal headers * Update internal comments and code cleanup v2: * Typo and formatting fixes Srikanth Yalavarthi (39): common/cnxk: add ML headers and ROC code for cnxk ml/cnxk: add skeleton for ML cnxk driver ml/cnxk: enable probe and remove of ML device ml/cnxk: add driver support to get device info ml/cnxk: add support for configure and close ml/cnxk: parse ML firmware path from device args ml/cnxk: enable firmware load and device reset ml/cnxk: enable support for simulator environment ml/cnxk: enable support for device start and stop ml/cnxk: add support to create device queue-pairs ml/cnxk: add functions to load and unload models ml/cnxk: enable validity checks for model metadata ml/cnxk: add internal structures for derived info ml/cnxk: add internal structures for tiles and OCM ml/cnxk: add structures for slow and fast path JDs ml/cnxk: find OCM mask and page slots for a model ml/cnxk: add support to reserve and free OCM pages ml/cnxk: enable support to start an ML model ml/cnxk: enable support to stop an ML models ml/cnxk: enable support to get model information ml/cnxk: enable support to update model params ml/cnxk: add support to get IO buffer sizes ml/cnxk: enable quantization and dequantization ml/cnxk: enable support to dump device debug info ml/cnxk: add driver support for device selftest ml/cnxk: enqueue a burst of inference requests ml/cnxk: dequeue a burst of inference requests ml/cnxk: add internal function for sync mode run ml/cnxk: enable support for firmware error codes ml/cnxk: add support to get and reset device stats ml/cnxk: add support to handle extended dev stats ml/cnxk: enable support to get xstats in cycles ml/cnxk: add support to report DPE FW warnings ml/cnxk: add support to enable model data caching ml/cnxk: add support to select OCM allocation mode ml/cnxk: add support to use lock during jcmd enq ml/cnxk: add support to select poll memory region ml/cnxk: add user guide for marvell cnxk ml driver ml/cnxk: enable support for configurable ocm page MAINTAINERS | 11 + doc/guides/index.rst | 1 + doc/guides/mldevs/cnxk.rst | 254 +++ doc/guides/mldevs/index.rst | 14 + drivers/common/cnxk/hw/ml.h | 170 ++ drivers/common/cnxk/meson.build | 1 + drivers/common/cnxk/roc_api.h | 4 + drivers/common/cnxk/roc_constants.h | 2 + drivers/common/cnxk/roc_dev_priv.h | 1 + drivers/common/cnxk/roc_ml.c | 626 ++++++++ drivers/common/cnxk/roc_ml.h | 152 ++ drivers/common/cnxk/roc_ml_priv.h | 24 + drivers/common/cnxk/roc_platform.c | 1 + drivers/common/cnxk/roc_platform.h | 2 + drivers/common/cnxk/roc_priv.h | 3 + drivers/common/cnxk/version.map | 29 + drivers/meson.build | 1 + drivers/ml/cnxk/cn10k_ml_dev.c | 870 ++++++++++ drivers/ml/cnxk/cn10k_ml_dev.h | 429 +++++ drivers/ml/cnxk/cn10k_ml_model.c | 413 +++++ drivers/ml/cnxk/cn10k_ml_model.h | 508 ++++++ drivers/ml/cnxk/cn10k_ml_ocm.c | 519 ++++++ drivers/ml/cnxk/cn10k_ml_ocm.h | 85 + drivers/ml/cnxk/cn10k_ml_ops.c | 2316 +++++++++++++++++++++++++++ drivers/ml/cnxk/cn10k_ml_ops.h | 94 ++ drivers/ml/cnxk/meson.build | 32 + drivers/ml/meson.build | 8 + 27 files changed, 6570 insertions(+) create mode 100644 doc/guides/mldevs/cnxk.rst create mode 100644 doc/guides/mldevs/index.rst create mode 100644 drivers/common/cnxk/hw/ml.h create mode 100644 drivers/common/cnxk/roc_ml.c create mode 100644 drivers/common/cnxk/roc_ml.h create mode 100644 drivers/common/cnxk/roc_ml_priv.h create mode 100644 drivers/ml/cnxk/cn10k_ml_dev.c create mode 100644 drivers/ml/cnxk/cn10k_ml_dev.h create mode 100644 drivers/ml/cnxk/cn10k_ml_model.c create mode 100644 drivers/ml/cnxk/cn10k_ml_model.h create mode 100644 drivers/ml/cnxk/cn10k_ml_ocm.c create mode 100644 drivers/ml/cnxk/cn10k_ml_ocm.h create mode 100644 drivers/ml/cnxk/cn10k_ml_ops.c create mode 100644 drivers/ml/cnxk/cn10k_ml_ops.h create mode 100644 drivers/ml/cnxk/meson.build create mode 100644 drivers/ml/meson.build -- 2.17.1