From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
by inbox.dpdk.org (Postfix) with ESMTP id 7EB8B41DD0;
Fri, 10 Mar 2023 09:23:47 +0100 (CET)
Received: from mails.dpdk.org (localhost [127.0.0.1])
by mails.dpdk.org (Postfix) with ESMTP id 4366242FA2;
Fri, 10 Mar 2023 09:21:06 +0100 (CET)
Received: from mx0b-0016f401.pphosted.com (mx0b-0016f401.pphosted.com
[67.231.156.173])
by mails.dpdk.org (Postfix) with ESMTP id E2C0A42C24
for <dev@dpdk.org>; Fri, 10 Mar 2023 09:20:33 +0100 (CET)
Received: from pps.filterd (m0045851.ppops.net [127.0.0.1])
by mx0b-0016f401.pphosted.com (8.17.1.19/8.17.1.19) with ESMTP id
32A7uIdI021875 for <dev@dpdk.org>; Fri, 10 Mar 2023 00:20:33 -0800
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com;
h=from : to : cc :
subject : date : message-id : in-reply-to : references : mime-version :
content-type; s=pfpt0220; bh=chKjMBg3yM5P1HINXXujah3hK3XVMn61vvJ47XuTeNM=;
b=F1bgJk0JNlxxI5mfjlBE2EerOAZhMRNcF7N960shTcIjpvZL5mLTSWAILwFoWOTFQXmM
4PJfRJ6PxH+Cm3/zybpAqeldGiZeUPAK1q4N865ywOnXsEG1u0jrOwNWNrnvltXfpVXM
aVR7e/UvT2e2FUOxktMmsU0vne9EeysVotwCuZKzOL3Ik0msA+iZPPfp40GWktzEVw8a
m1JIFFeV7+Lb2UXbhRlJUVq1Z59ZvOROTbSyxN8HVfWak62c6W69oTLKoE9dqXbHwUSS
wCOcPxvVCpNi7QBqfG9L+Q5f+68dDTNAUt9VQd3XE2oWec8+C5egF5U85u6UWpL3hcBU 8A==
Received: from dc5-exch01.marvell.com ([199.233.59.181])
by mx0b-0016f401.pphosted.com (PPS) with ESMTPS id 3p80k782tf-17
(version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384 bits=256 verify=NOT)
for <dev@dpdk.org>; Fri, 10 Mar 2023 00:20:33 -0800
Received: from DC5-EXCH02.marvell.com (10.69.176.39) by DC5-EXCH01.marvell.com
(10.69.176.38) with Microsoft SMTP Server (TLS) id 15.0.1497.42;
Fri, 10 Mar 2023 00:20:23 -0800
Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH02.marvell.com
(10.69.176.39) with Microsoft SMTP Server id 15.0.1497.42 via Frontend
Transport; Fri, 10 Mar 2023 00:20:24 -0800
Received: from ml-host-33.caveonetworks.com (unknown [10.110.143.233])
by maili.marvell.com (Postfix) with ESMTP id F0F855C68EE;
Fri, 10 Mar 2023 00:20:22 -0800 (PST)
From: Srikanth Yalavarthi <syalavarthi@marvell.com>
To: Srikanth Yalavarthi <syalavarthi@marvell.com>
CC: <dev@dpdk.org>, <sshankarnara@marvell.com>, <jerinj@marvell.com>,
<aprabhu@marvell.com>, <ptakkar@marvell.com>, <pshukla@marvell.com>
Subject: [PATCH v6 28/39] ml/cnxk: add internal function for sync mode run
Date: Fri, 10 Mar 2023 00:20:04 -0800
Message-ID: <20230310082015.20200-29-syalavarthi@marvell.com>
X-Mailer: git-send-email 2.17.1
In-Reply-To: <20230310082015.20200-1-syalavarthi@marvell.com>
References: <20221208200220.20267-1-syalavarthi@marvell.com>
<20230310082015.20200-1-syalavarthi@marvell.com>
MIME-Version: 1.0
Content-Type: text/plain
X-Proofpoint-GUID: Oi7eNntbzeHQToiK-nO8t5JK2phN4Azj
X-Proofpoint-ORIG-GUID: Oi7eNntbzeHQToiK-nO8t5JK2phN4Azj
X-Proofpoint-Virus-Version: vendor=baseguard
engine=ICAP:2.0.254,Aquarius:18.0.942,Hydra:6.0.573,FMLib:17.11.170.22
definitions=2023-03-10_02,2023-03-09_01,2023-02-09_01
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
<mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
<mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org
Added internal function to execute ML inference requests
in synchronous mode. Sync mode inference execution is used
to launch inference requests without using a queue-pair.
Signed-off-by: Srikanth Yalavarthi <syalavarthi@marvell.com>
---
drivers/ml/cnxk/cn10k_ml_ops.c | 53 ++++++++++++++++++++++++++++++++++
drivers/ml/cnxk/cn10k_ml_ops.h | 1 +
2 files changed, 54 insertions(+)
diff --git a/drivers/ml/cnxk/cn10k_ml_ops.c b/drivers/ml/cnxk/cn10k_ml_ops.c
index 51f1c92a8d..87778c37bb 100644
--- a/drivers/ml/cnxk/cn10k_ml_ops.c
+++ b/drivers/ml/cnxk/cn10k_ml_ops.c
@@ -1533,6 +1533,59 @@ cn10k_ml_dequeue_burst(struct rte_ml_dev *dev, uint16_t qp_id, struct rte_ml_op
return count;
}
+__rte_hot int
+cn10k_ml_inference_sync(struct rte_ml_dev *dev, struct rte_ml_op *op)
+{
+ struct cn10k_ml_model *model;
+ struct cn10k_ml_dev *mldev;
+ struct cn10k_ml_req *req;
+ bool timeout;
+ int ret = 0;
+
+ mldev = dev->data->dev_private;
+ model = dev->data->models[op->model_id];
+ req = model->req;
+
+ cn10k_ml_prep_fp_job_descriptor(dev, req, op);
+
+ memset(&req->result, 0, sizeof(struct cn10k_ml_result));
+ req->result.user_ptr = op->user_ptr;
+
+ plt_write64(ML_CN10K_POLL_JOB_START, &req->status);
+ req->jcmd.w1.s.jobptr = PLT_U64_CAST(&req->jd);
+
+ timeout = true;
+ req->timeout = plt_tsc_cycles() + ML_CN10K_CMD_TIMEOUT * plt_tsc_hz();
+ do {
+ if (roc_ml_jcmdq_enqueue_lf(&mldev->roc, &req->jcmd)) {
+ req->op = op;
+ timeout = false;
+ break;
+ }
+ } while (plt_tsc_cycles() < req->timeout);
+
+ if (timeout) {
+ ret = -EBUSY;
+ goto error_enqueue;
+ }
+
+ timeout = true;
+ do {
+ if (plt_read64(&req->status) == ML_CN10K_POLL_JOB_FINISH) {
+ timeout = false;
+ break;
+ }
+ } while (plt_tsc_cycles() < req->timeout);
+
+ if (timeout)
+ ret = -ETIME;
+ else
+ cn10k_ml_result_update(dev, -1, &req->result, req->op);
+
+error_enqueue:
+ return ret;
+}
+
struct rte_ml_dev_ops cn10k_ml_ops = {
/* Device control ops */
.dev_info_get = cn10k_ml_dev_info_get,
diff --git a/drivers/ml/cnxk/cn10k_ml_ops.h b/drivers/ml/cnxk/cn10k_ml_ops.h
index f6aab4a609..7c35bf7539 100644
--- a/drivers/ml/cnxk/cn10k_ml_ops.h
+++ b/drivers/ml/cnxk/cn10k_ml_ops.h
@@ -75,5 +75,6 @@ __rte_hot uint16_t cn10k_ml_enqueue_burst(struct rte_ml_dev *dev, uint16_t qp_id
struct rte_ml_op **ops, uint16_t nb_ops);
__rte_hot uint16_t cn10k_ml_dequeue_burst(struct rte_ml_dev *dev, uint16_t qp_id,
struct rte_ml_op **ops, uint16_t nb_ops);
+__rte_hot int cn10k_ml_inference_sync(struct rte_ml_dev *dev, struct rte_ml_op *op);
#endif /* _CN10K_ML_OPS_H_ */
--
2.17.1