From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id D64BF41D3D; Fri, 10 Mar 2023 09:20:25 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B593740ED9; Fri, 10 Mar 2023 09:20:25 +0100 (CET) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 0DA1A40141 for ; Fri, 10 Mar 2023 09:20:23 +0100 (CET) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id 32A7aV15009730 for ; Fri, 10 Mar 2023 00:20:23 -0800 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h=from : to : cc : subject : date : message-id : in-reply-to : references : mime-version : content-type; s=pfpt0220; bh=6q82UxIKEDpsNv28n6F0Kl9mYN0G6z7HvpQ72PubbFI=; b=DQXv+Na4GKcBIFlDl9nx/39EKUvuUZvst3YYKAt8HX2u6tZ1nRFKSFIYsE7X/ZRivwtu MMgBWkUrO3s323CpCf7ynKXqjnNyKJ5coWMoYZLmRAdbiaW0UYxXeL3VYL+IEjBc+UdI IPzu5OjU2syrmE7CDHMcUo88WMXDO2ap4kvYgr/lPRWsaBbgGVfDC55vkuG/VRnRu8ll i5DleeOCKVQTJrMF6zzJVrl5yrvrl2mUyFa56xWs+n3Fsy6lJfZfP0ayt5j1q8dFNgzL xZJC5LdcRhjC88cd56O+5+vsv3Xm2mrQh9nZeQAF15S/vB478ZeArY9AHuXJ2eH/rgUN tQ== Received: from dc5-exch02.marvell.com ([199.233.59.182]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 3p7n7dj0a4-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT) for ; Fri, 10 Mar 2023 00:20:22 -0800 Received: from DC5-EXCH01.marvell.com (10.69.176.38) by DC5-EXCH02.marvell.com (10.69.176.39) with Microsoft SMTP Server (TLS) id 15.0.1497.42; Fri, 10 Mar 2023 00:20:21 -0800 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH01.marvell.com (10.69.176.38) with Microsoft SMTP Server id 15.0.1497.42 via Frontend Transport; Fri, 10 Mar 2023 00:20:20 -0800 Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233]) by maili.marvell.com (Postfix) with ESMTP id F035E5C68E7; Fri, 10 Mar 2023 00:20:17 -0800 (PST) From: Srikanth Yalavarthi To: CC: , , , , , , Subject: [PATCH v6 00/39] Implementation of ML CNXK driver Date: Fri, 10 Mar 2023 00:19:36 -0800 Message-ID: <20230310082015.20200-1-syalavarthi@marvell.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20221208200220.20267-1-syalavarthi@marvell.com> References: <20221208200220.20267-1-syalavarthi@marvell.com> MIME-Version: 1.0 Content-Type: text/plain X-Proofpoint-GUID: VHf14CYsaULQTsRBrO_UI9gbvUD5FEyA X-Proofpoint-ORIG-GUID: VHf14CYsaULQTsRBrO_UI9gbvUD5FEyA X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22 definitions=2023-03-10_02,2023-03-09_01,2023-02-09_01 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Marvell ML CNXK Driver ---------------------- This patch series implements common Machine Learning (ML) ROC code and driver for Marvell Octeon 10 (cnxk) platform. ML inferencing is supported on cnxk platform through an integrated ML inferencing processor. The current driver supports programming the ML hardware engine through offload mode. All APIs proposed in the DPDK ML device specification are supported on the cnxk platform. v6: * Fixed release notes content * Rebased the patch series v5: * Updated model_id to uint16_t * Updated release notes for 23.03 v4: * Update function names of ML common code * Added support for configurable OCM page size * Minor typo fixes v3: * Skip installation of internal headers * Update internal comments and code cleanup v2: * Typo and formatting fixes Srikanth Yalavarthi (39): common/cnxk: add ML headers and ROC code for cnxk ml/cnxk: add skeleton for ML cnxk driver ml/cnxk: enable probe and remove of ML device ml/cnxk: add driver support to get device info ml/cnxk: add support for configure and close ml/cnxk: parse ML firmware path from device args ml/cnxk: enable firmware load and device reset ml/cnxk: enable support for simulator environment ml/cnxk: enable support for device start and stop ml/cnxk: add support to create device queue-pairs ml/cnxk: add functions to load and unload models ml/cnxk: enable validity checks for model metadata ml/cnxk: add internal structures for derived info ml/cnxk: add internal structures for tiles and OCM ml/cnxk: add structures for slow and fast path JDs ml/cnxk: find OCM mask and page slots for a model ml/cnxk: add support to reserve and free OCM pages ml/cnxk: enable support to start an ML model ml/cnxk: enable support to stop an ML models ml/cnxk: enable support to get model information ml/cnxk: enable support to update model params ml/cnxk: add support to get IO buffer sizes ml/cnxk: enable quantization and dequantization ml/cnxk: enable support to dump device debug info ml/cnxk: add driver support for device selftest ml/cnxk: enqueue a burst of inference requests ml/cnxk: dequeue a burst of inference requests ml/cnxk: add internal function for sync mode run ml/cnxk: enable support for firmware error codes ml/cnxk: add support to get and reset device stats ml/cnxk: add support to handle extended dev stats ml/cnxk: enable support to get xstats in cycles ml/cnxk: add support to report DPE FW warnings ml/cnxk: add support to enable model data caching ml/cnxk: add support to select OCM allocation mode ml/cnxk: add support to use lock during jcmd enq ml/cnxk: add support to select poll memory region ml/cnxk: add user guide for marvell cnxk ml driver ml/cnxk: add support for configurable ocm page MAINTAINERS | 11 + doc/guides/index.rst | 1 + doc/guides/mldevs/cnxk.rst | 254 +++ doc/guides/mldevs/index.rst | 14 + doc/guides/rel_notes/release_23_03.rst | 7 + drivers/common/cnxk/hw/ml.h | 170 ++ drivers/common/cnxk/meson.build | 1 + drivers/common/cnxk/roc_api.h | 4 + drivers/common/cnxk/roc_constants.h | 2 + drivers/common/cnxk/roc_dev_priv.h | 1 + drivers/common/cnxk/roc_ml.c | 626 +++++++ drivers/common/cnxk/roc_ml.h | 152 ++ drivers/common/cnxk/roc_ml_priv.h | 24 + drivers/common/cnxk/roc_platform.c | 1 + drivers/common/cnxk/roc_platform.h | 2 + drivers/common/cnxk/roc_priv.h | 3 + drivers/common/cnxk/version.map | 29 + drivers/meson.build | 1 + drivers/ml/cnxk/cn10k_ml_dev.c | 870 +++++++++ drivers/ml/cnxk/cn10k_ml_dev.h | 429 +++++ drivers/ml/cnxk/cn10k_ml_model.c | 413 +++++ drivers/ml/cnxk/cn10k_ml_model.h | 508 ++++++ drivers/ml/cnxk/cn10k_ml_ocm.c | 519 ++++++ drivers/ml/cnxk/cn10k_ml_ocm.h | 85 + drivers/ml/cnxk/cn10k_ml_ops.c | 2316 ++++++++++++++++++++++++ drivers/ml/cnxk/cn10k_ml_ops.h | 94 + drivers/ml/cnxk/meson.build | 32 + drivers/ml/meson.build | 8 + 28 files changed, 6577 insertions(+) create mode 100644 doc/guides/mldevs/cnxk.rst create mode 100644 doc/guides/mldevs/index.rst create mode 100644 drivers/common/cnxk/hw/ml.h create mode 100644 drivers/common/cnxk/roc_ml.c create mode 100644 drivers/common/cnxk/roc_ml.h create mode 100644 drivers/common/cnxk/roc_ml_priv.h create mode 100644 drivers/ml/cnxk/cn10k_ml_dev.c create mode 100644 drivers/ml/cnxk/cn10k_ml_dev.h create mode 100644 drivers/ml/cnxk/cn10k_ml_model.c create mode 100644 drivers/ml/cnxk/cn10k_ml_model.h create mode 100644 drivers/ml/cnxk/cn10k_ml_ocm.c create mode 100644 drivers/ml/cnxk/cn10k_ml_ocm.h create mode 100644 drivers/ml/cnxk/cn10k_ml_ops.c create mode 100644 drivers/ml/cnxk/cn10k_ml_ops.h create mode 100644 drivers/ml/cnxk/meson.build create mode 100644 drivers/ml/meson.build -- 2.17.1