From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <Anoob.Joseph@cavium.com>
Received: from NAM03-DM3-obe.outbound.protection.outlook.com
 (mail-dm3nam03on0065.outbound.protection.outlook.com [104.47.41.65])
 by dpdk.org (Postfix) with ESMTP id 81DA01B192
 for <dev@dpdk.org>; Tue,  9 Oct 2018 11:09:17 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=agjNRXeuz1OIILYVhWjfyzprtWcZD50fWBFFp3KrBLQ=;
 b=UBIcanaqFlKX++HYiHLNVClxh601/OcFjcR0R1wQSDb3ajyCDnkJ/SrgKSaFdGlvhNwj+MKbSVvl9FmS7xPEfcWYm4qwvU/Ta3TXfY/5Wm38dKzw+KgwAQEOMvHRFbxenaYZzGHJRMKQJaBm5gmsojofnFww+y8yZO1RvSFFO4I=
Authentication-Results: spf=none (sender IP is )
 smtp.mailfrom=Anoob.Joseph@cavium.com; 
Received: from ajoseph83.caveonetworks.com.com (115.113.156.2) by
 BN7PR07MB4897.namprd07.prod.outlook.com (2603:10b6:406:ef::26) with Microsoft
 SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.20.1207.28; Tue, 9 Oct 2018 09:09:12 +0000
From: Anoob Joseph <anoob.joseph@caviumnetworks.com>
To: Akhil Goyal <akhil.goyal@nxp.com>,
 Pablo de Lara <pablo.de.lara.guarch@intel.com>,
 Thomas Monjalon <thomas@monjalon.net>
Cc: Murthy NSSR <nidadavolu.murthy@caviumnetworks.com>,
 Jerin Jacob <jerin.jacob@caviumnetworks.com>,
 Narayana Prasad <narayanaprasad.athreya@caviumnetworks.com>,
 Ankur Dwivedi <ankur.dwivedi@caviumnetworks.com>,
 Anoob Joseph <anoob.joseph@caviumnetworks.com>,
 Nithin Dabilpuram <nithin.dabilpuram@caviumnetworks.com>,
 Ragothaman Jayaraman <rjayaraman@caviumnetworks.com>,
 Srisivasubramanian S <ssrinivasan@caviumnetworks.com>,
 Tejasree Kondoj <kondoj.tejasree@caviumnetworks.com>, dev@dpdk.org
Date: Tue,  9 Oct 2018 14:37:42 +0530
Message-Id: <1539076076-19786-10-git-send-email-anoob.joseph@caviumnetworks.com>
X-Mailer: git-send-email 2.7.4
In-Reply-To: <1539076076-19786-1-git-send-email-anoob.joseph@caviumnetworks.com>
References: <1538744363-30340-1-git-send-email-anoob.joseph@caviumnetworks.com>
 <1539076076-19786-1-git-send-email-anoob.joseph@caviumnetworks.com>
MIME-Version: 1.0
Content-Type: text/plain
X-Originating-IP: [115.113.156.2]
X-ClientProxiedBy: PN1PR0101CA0004.INDPRD01.PROD.OUTLOOK.COM
 (2603:1096:c00:e::14) To BN7PR07MB4897.namprd07.prod.outlook.com
 (2603:10b6:406:ef::26)
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: cd0b7ad3-8ed1-49b4-a58b-08d62dc6e345
X-Microsoft-Antispam: BCL:0; PCL:0;
 RULEID:(7020095)(4652040)(8989299)(4534185)(7168020)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(7193020);
 SRVR:BN7PR07MB4897; 
X-Microsoft-Exchange-Diagnostics: 1; BN7PR07MB4897;
 3:0YKodWS7q/7ksxy4nIfBTJ3bgHZJzJ4AjtifWpd51W9jWGyNlQkt8nAYlMejSF3YTRx+WP9Yn8iUBS6gcG6GTZ/RAVDx5lBX3RqfEWt5bTeXL1sW1xugXscTcu/oNPkmI2XHFroPjHGVqOftU8NMBATc6dz31uyUEWjhR330oo/pjZseQOby5vKawBTAEFh8XQCVtZtxsTatdjOW3JvREjdkwElVKiFbJFs4pGvwRT9awxtT2C7+0WKYRJMzgrDc;
 25:OLaJ7iyrbgJJ5nn+9qU8ncb44clt1aIP12KCR1syo9Cxlq/OnODyyhHwNgsVW8m30983RT2LJ+jPSLL279gnzsMUpoNPdZfjYKFYPkzBd4NhcdcCDFHOOsgpto53pQEiWQ285duqx3SGS69txrC2GKw0soKlal+W2L3X6KtByXSIApxur/hqKBqpLHp33r12C8xYO4vigpmNWJ8a/CoO9OcEmI9ssm/lF+y/tZ8uFPM+Urc8jeEPcLw2/6uQd24iUgXg9D1nO2PXwyk0dHttU9HTn4LHOXZTQE0HLRlUuJd7M4/OzizosVI4cEnBKfR1d1hj1CZTBLQ1ujfB1qN48g==;
 31:ks9JxPDLPiqesL+uiWWQ3VjA33kjvU+us/hu7gSf4cYHI9QENH2CBQJ0j9x8IGg15wZThd0eeprLvJ1M6Gm3Yf7z2nT+RjrGLwQDLVvDetXWKehLK50mQ0u4UstPyXJLRnAvbf8dnkmSYsXnjfaPEceBeaVOXZeXUFq6fV8CwMfNoUS2lFnkKhdCqZqdXdaqrIimFB7E6fkOsioRVoMEhAZn9Gj090AFL+lc7IRM/is=
X-MS-TrafficTypeDiagnostic: BN7PR07MB4897:
X-Microsoft-Exchange-Diagnostics: 1; BN7PR07MB4897;
 20:a1XeJW4kEE0gPaGQ7/FOyYIRdGi8P/OacD+o+OdjN/w7l+44l0vD+DOtY3zb/jy38psE0Wiql3QNJH0TuvOhxFF71+Oifswb2vZy9F7zMvC62kOpeq1fniXee7TOaRZObVXCZSETCas2e25EILwO+VfQkOijHF2FwT9xrJPatdGDTnif/wLAKLP8KBw8b6Gq1ogiSDtWXr1EAF+yGxu3rx/1Si+f0zysHqTytBfmi0B6AVOYYDFtsvDz/4W8YCSRJTs2Ijqj5u7S4xQY1f48KDi1tzkLSe18OTQJOzZ+j8z4Hi6ounW+/jtN0uMUFOklfiYAg+LRHQsH9/tBNe8h9w2ZSIjZSCs4GXs4oTYx//2OKIWbVF52VCtzA8TR2eZPbIUvXKxUyWHzWFLhukI+ElMgIt0R10JB653BnFfcJnJ8FMrp9HzeEXmx2T3c+UiLkV6Us1KZdSCfMPWqD7T8Ul3Vok3NgnlO8uVlrQzWiU8xGeES/gAocxAcJMT7wp0bVecX/MZybg4f8kZfi8I1dSA/gUIC9QG7RtJwxC6f20WU1m3Z47Qk7OvM52aF+nINaY4jpoZTSQ5hBaSONgLJLHm6tdDahofRXnRnJh/+tRI=;
 4:DTXrRg9R8OgKHCsMnu69Cslsk+BNMhPnivNKdr97QvTGAeH7lLyEYQUqHMRG7O0Wiqf4drV2PPknvuWTuzNSrXjUNt//qz0kKbIVTUMwQ4jIpB6mYWTpSXhvLxjqc9xKCq+SkT9gySdraNSuzCjHgS6s3GpjsZNLVrjuA9Ug/vVy4SVUnfmLLnD+LeABc4KpvcDmsfYHGSsJiDrILsGiBw1wm91Os7zbk2eY8+CFGPX+dHqwIVmDZbHaOAUdwNasNVqEvPEydMIPDVWnf9PIvg==
X-Microsoft-Antispam-PRVS: <BN7PR07MB48970D48B6BB2D3F9DB94365F8E70@BN7PR07MB4897.namprd07.prod.outlook.com>
X-Exchange-Antispam-Report-Test: UriScan:;
X-MS-Exchange-SenderADCheck: 1
X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0;
 RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(3002001)(93006095)(10201501046)(3231355)(944501410)(52105095)(149066)(150057)(6041310)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(20161123564045)(20161123558120)(201708071742011)(7699051);
 SRVR:BN7PR07MB4897; BCL:0; PCL:0; RULEID:; SRVR:BN7PR07MB4897; 
X-Forefront-PRVS: 08200063E9
X-Forefront-Antispam-Report: SFV:NSPM;
 SFS:(10009020)(396003)(366004)(376002)(136003)(346002)(39860400002)(199004)(189003)(42882007)(47776003)(106356001)(6666003)(186003)(5660300001)(26005)(68736007)(16526019)(8936002)(25786009)(6116002)(2906002)(81156014)(50226002)(305945005)(81166006)(7736002)(3846002)(105586002)(478600001)(8676002)(54906003)(110136005)(48376002)(16586007)(14444005)(6486002)(6506007)(50466002)(316002)(53936002)(386003)(51416003)(52116002)(76176011)(11346002)(6512007)(44832011)(446003)(36756003)(55236004)(956004)(2616005)(4744004)(486006)(4326008)(66066001)(97736004)(72206003)(476003);
 DIR:OUT; SFP:1101; SCL:1; SRVR:BN7PR07MB4897;
 H:ajoseph83.caveonetworks.com.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords;
 A:1; MX:1; 
Received-SPF: None (protection.outlook.com: cavium.com does not designate
 permitted sender hosts)
X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BN7PR07MB4897;
 23:HhQvTBao8r3aa2/gJAuxpQDwA0gU1ceNgixT9/k+m?=
 =?us-ascii?Q?zujl8UqPtzJYVDt5tO6MGZRU9vPDGJCVaz2ZOPv2p2sLBefv9zigSHMIbt7/?=
 =?us-ascii?Q?5VaSAe5ukunJ/qf6hmapNdFDAIB2ASzlyZdQi2lbS5T7HgwJkepMBYwNNeqm?=
 =?us-ascii?Q?/Ndt5z0f9cEPe1bVQWv33nhb9O2JVXbjxjk+7hXT8g2j4qaq54jibLHatyy9?=
 =?us-ascii?Q?aGYiBeSJ2MaPn15Xt35Jb+bMVhMQuqBaQQ7GZ0jXDLB62Al6v5HVXJBUhX1I?=
 =?us-ascii?Q?uLmatDQ+FRHaEaVhPxXr7Dwm3xJfLXxPc4RkJjwwzktMqq5ENs1eLWz8sQn5?=
 =?us-ascii?Q?BucFmJxA3e0F38GIQmWRL2Jlu9C94CeYMr2pRKW4LmfZRFg+Aw9ylZc4F1eM?=
 =?us-ascii?Q?NynrIL3dBEmC31L82M7UoIai8bkqAzv1gCmc67PNkMeNkEugmfUHB5THLaQd?=
 =?us-ascii?Q?tLaxIZAc/HRP38fv39M8H8t1zXYSDY6K2fdwAz+Ze0fr3ZssPl9mcQfNY+Ej?=
 =?us-ascii?Q?/F78ZEqScdkYUh0/7tpYPvjJq+oEwFdre32xwQRcdXlpr7Q0avVBdP2k4OzK?=
 =?us-ascii?Q?4NL3th0yw16u63woVlMIQ5QTw/8EmaRNGA0WSoahrYrepvU2XlAk7ZORxpzM?=
 =?us-ascii?Q?Epi0pGVDBzZ7tdk3J4/nYRkcnyMGNzbIo1Zv8GNcvkf6rSW8BHw81gTNZJu0?=
 =?us-ascii?Q?yjC1MKWOvoVGhZSiJ464Ihl12qP9U8YYWLsvV9eoEvF99sd2oY3Wz5oA2Qc5?=
 =?us-ascii?Q?5J59d4OJTb3d6oMUUGr6Hr2jftv8G8W5sd8SBt/s7vgzG3Mefm3KrLINPbUV?=
 =?us-ascii?Q?sYoeiNfQOQucNcxk2H1FKuOKTNY9CL0TMOn6sBAAJGfQhYwmYlCYqhJY1Zqi?=
 =?us-ascii?Q?u2up8gyPjkcnQ88yi3qsG48pH+Y+FCyz8KbMm1BfelYnL04HjyZZJN1jS6MA?=
 =?us-ascii?Q?SsfFVt0i/YkvKbbYcYNmdjImiuvyVAgSGVuX1RE9r+qnXus+cjkgrr4Kz6ep?=
 =?us-ascii?Q?9Ru3uxNpqZa2MnWlVSBYuP84BDyVZH4g0T7xY503+wUCrpeLTwxyyk/z7Tkz?=
 =?us-ascii?Q?SDSkpqX8CimVwqmqY3eOLamJQb53PdcL2Q4gyaPSwIFJemQim11Yw2MrWvOP?=
 =?us-ascii?Q?UqKS7+mtHGTXeLxQPVOpOEP8wkzGYnJTUZe4IyAmimsH45jVLRKE14i8ozyQ?=
 =?us-ascii?Q?/tumEpiQl8kjDM9spIA/HTZwKdltJGd6rylAGA2RujI9jV8gmqWg62zYDdVW?=
 =?us-ascii?Q?3Nbfuem3elyASgwnXBZikk/Xq5hTtqWt+5VzboDpcNzwdE/OgkDd2tNvGwB1?=
 =?us-ascii?B?UT09?=
X-Microsoft-Antispam-Message-Info: DMHqM/R0cTcrzpZigZRhIX6mtrUPq/EUj+CW5Nn7T03NN1y9Ckx96/kIWvR4vRhODFlHImtIPEejz6gbBLdnVAM8z0DTsgm54TuQpV5h4+hqeNVDBHQqOHIxyN+W8aUYa2AQS2EHJyd0fmFVVhlpBICKTwODBETChSbrnjKiPyXsXkVrCkqoskgPUpCw0lbpKOoTaEM/zvWcUA3JgkONhNTvvnqqWcy8scaST92HgQ+aLpk5B8UkxNwz0HW2j5JbWj4lwz276NXS293Yx11dVUW/ILDKYDSrXNHxZ6/XTPuG7d2gO1wjCoEdd7/PkO+fKHvugR2pgpneocXyAQ2CynuBIdz+Zt+oLFx3H6UdjaQ=
X-Microsoft-Exchange-Diagnostics: 1; BN7PR07MB4897;
 6:egKS49eKGNBclZcj422RfS68lhbU9Re4PemBUUFBI/hDAmQIGlHw+O78G5P9Nyah2THcnrihq7+sVnGfRN7ZROMfmLgsmsn1z9HDQ+b2iQiQtPlhjUnqJMEIv7pEzmjfH7zA3fBCKJ6oJDh5QGFlIs4LRWKkvrdcFpGSPmk9fb3DbVjDHb6/LTenTZbpf+qf3R6/UcSYULpO8DXYf8VCttNoZB2VbOz1iJZABmkTR10cOyUeTz2DGzwjAifhyvDGn6wBgc97e9BhX8+EnBEwmbw3GqE8lYAcJHCvqsEU2DjCzxDGP6AO/vFain9kDjVmCXyLrv1kaQlGL9WFJ1djYmTpH+KrUcFLRNJrO6+Opb8xIWFw9LuofCjNP6JFlWxYYrmKgtvH01TC7my81j2il9LqsroJBHggV/X/jOOZwSeCwGy5Uf6pKjhGKIHdgmgBhS1TW0YxiX1BFC9vgNj23w==;
 5:ogWHx5w2gQ/kzXjui+r4NHzAIOkL1vSN6AoB1egy+Mlr3KgHaiO0HD9uSQWJqPsB0GRSpm6HM5XA27C58IulkhBduOo1iacqa64ImIy/ag4jcO7HrYB47Hl0rQ1FMFI5obSkeswwq9XOVlIKvZ7FTeoXo+fGUlGfNzXgcFA1Fzo=;
 7:WyfuvNijS2tT+OGPKjtW8DUZ3nIUmh4Sl4Ny1B8bIB4QU8MsC4zSrr6oDx09dCY/saoZTV0uLwrrnadCzKI1ahqkcsDQFX+/WRwvoxOJN2R5EJj0+d6+AAHBCAEeI0vIb9A+OMUpsgXmzmZne9U211S2DxG8CrojkzsbCdo9Ey4G7qh83aY1k8Eehneg1cfmmtmgzGyDjQ0XJZ6fkAcAHzmOd2LkZWwqyfeKg+OV3V5CMH+jYtAffHWVDr/4jrt9
SpamDiagnosticOutput: 1:99
SpamDiagnosticMetadata: NSPM
X-OriginatorOrg: caviumnetworks.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Oct 2018 09:09:12.5187 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: cd0b7ad3-8ed1-49b4-a58b-08d62dc6e345
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 711e4ccf-2e9b-4bcf-a551-4094005b6194
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN7PR07MB4897
Subject: [dpdk-dev] [PATCH v4 09/23] crypto/octeontx: add queue pair
	functions
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 09 Oct 2018 09:09:18 -0000

From: Murthy NSSR <nidadavolu.murthy@caviumnetworks.com>

Adding queue pair setup and release functions

Signed-off-by: Ankur Dwivedi <ankur.dwivedi@caviumnetworks.com>
Signed-off-by: Anoob Joseph <anoob.joseph@caviumnetworks.com>
Signed-off-by: Murthy NSSR <nidadavolu.murthy@caviumnetworks.com>
Signed-off-by: Nithin Dabilpuram <nithin.dabilpuram@caviumnetworks.com>
Signed-off-by: Ragothaman Jayaraman <rjayaraman@caviumnetworks.com>
Signed-off-by: Srisivasubramanian S <ssrinivasan@caviumnetworks.com>
Signed-off-by: Tejasree Kondoj <kondoj.tejasree@caviumnetworks.com>
---
 drivers/common/cpt/cpt_common.h                   |   3 +
 drivers/common/cpt/cpt_hw_types.h                 |   3 +
 drivers/crypto/octeontx/otx_cryptodev_hw_access.c | 280 ++++++++++++++++++++++
 drivers/crypto/octeontx/otx_cryptodev_hw_access.h |   9 +
 drivers/crypto/octeontx/otx_cryptodev_ops.c       |  82 ++++++-
 5 files changed, 375 insertions(+), 2 deletions(-)

diff --git a/drivers/common/cpt/cpt_common.h b/drivers/common/cpt/cpt_common.h
index 88f4902..7333c13 100644
--- a/drivers/common/cpt/cpt_common.h
+++ b/drivers/common/cpt/cpt_common.h
@@ -15,6 +15,9 @@
  */
 #define CRYPTO_OCTEONTX		0x1
 
+#define CPT_COUNT_THOLD		32
+#define CPT_TIMER_THOLD		0x3F
+
 #define AE_TYPE 1
 #define SE_TYPE 2
 
diff --git a/drivers/common/cpt/cpt_hw_types.h b/drivers/common/cpt/cpt_hw_types.h
index 0a98621..cff59c7 100644
--- a/drivers/common/cpt/cpt_hw_types.h
+++ b/drivers/common/cpt/cpt_hw_types.h
@@ -20,6 +20,9 @@
 #define CPT_VF_INTR_HWERR_MASK  (1<<5)
 #define CPT_VF_INTR_FAULT_MASK  (1<<6)
 
+#define CPT_INST_SIZE           (64)
+#define CPT_NEXT_CHUNK_PTR_SIZE (8)
+
 /*
  * CPT_INST_S software command definitions
  * Words EI (0-3)
diff --git a/drivers/crypto/octeontx/otx_cryptodev_hw_access.c b/drivers/crypto/octeontx/otx_cryptodev_hw_access.c
index 303bcc0..5e705a8 100644
--- a/drivers/crypto/octeontx/otx_cryptodev_hw_access.c
+++ b/drivers/crypto/octeontx/otx_cryptodev_hw_access.c
@@ -1,11 +1,14 @@
 /* SPDX-License-Identifier: BSD-3-Clause
  * Copyright(c) 2018 Cavium, Inc
  */
+#include <assert.h>
 #include <string.h>
 #include <unistd.h>
 
 #include <rte_branch_prediction.h>
 #include <rte_common.h>
+#include <rte_errno.h>
+#include <rte_memzone.h>
 
 #include "otx_cryptodev_hw_access.h"
 #include "otx_cryptodev_mbox.h"
@@ -177,6 +180,133 @@ otx_cpt_clear_dovf_intr(struct cpt_vf *cptvf)
 		      CPTX_VQX_MISC_INT(0, 0), vqx_misc_int.u);
 }
 
+/* Write to VQX_CTL register
+ */
+static void
+otx_cpt_write_vq_ctl(struct cpt_vf *cptvf, bool val)
+{
+	cptx_vqx_ctl_t vqx_ctl;
+
+	vqx_ctl.u = CPT_READ_CSR(CPT_CSR_REG_BASE(cptvf),
+				 CPTX_VQX_CTL(0, 0));
+	vqx_ctl.s.ena = val;
+	CPT_WRITE_CSR(CPT_CSR_REG_BASE(cptvf),
+		      CPTX_VQX_CTL(0, 0), vqx_ctl.u);
+}
+
+/* Write to VQX_INPROG register
+ */
+static void
+otx_cpt_write_vq_inprog(struct cpt_vf *cptvf, uint8_t val)
+{
+	cptx_vqx_inprog_t vqx_inprg;
+
+	vqx_inprg.u = CPT_READ_CSR(CPT_CSR_REG_BASE(cptvf),
+				   CPTX_VQX_INPROG(0, 0));
+	vqx_inprg.s.inflight = val;
+	CPT_WRITE_CSR(CPT_CSR_REG_BASE(cptvf),
+		      CPTX_VQX_INPROG(0, 0), vqx_inprg.u);
+}
+
+/* Write to VQX_DONE_WAIT NUMWAIT register
+ */
+static void
+otx_cpt_write_vq_done_numwait(struct cpt_vf *cptvf, uint32_t val)
+{
+	cptx_vqx_done_wait_t vqx_dwait;
+
+	vqx_dwait.u = CPT_READ_CSR(CPT_CSR_REG_BASE(cptvf),
+				   CPTX_VQX_DONE_WAIT(0, 0));
+	vqx_dwait.s.num_wait = val;
+	CPT_WRITE_CSR(CPT_CSR_REG_BASE(cptvf),
+		      CPTX_VQX_DONE_WAIT(0, 0), vqx_dwait.u);
+}
+
+/* Write to VQX_DONE_WAIT NUM_WAIT register
+ */
+static void
+otx_cpt_write_vq_done_timewait(struct cpt_vf *cptvf, uint16_t val)
+{
+	cptx_vqx_done_wait_t vqx_dwait;
+
+	vqx_dwait.u = CPT_READ_CSR(CPT_CSR_REG_BASE(cptvf),
+				   CPTX_VQX_DONE_WAIT(0, 0));
+	vqx_dwait.s.time_wait = val;
+	CPT_WRITE_CSR(CPT_CSR_REG_BASE(cptvf),
+		      CPTX_VQX_DONE_WAIT(0, 0), vqx_dwait.u);
+}
+
+/* Write to VQX_SADDR register
+ */
+static void
+otx_cpt_write_vq_saddr(struct cpt_vf *cptvf, uint64_t val)
+{
+	cptx_vqx_saddr_t vqx_saddr;
+
+	vqx_saddr.u = val;
+	CPT_WRITE_CSR(CPT_CSR_REG_BASE(cptvf),
+		      CPTX_VQX_SADDR(0, 0), vqx_saddr.u);
+}
+
+static void
+otx_cpt_vfvq_init(struct cpt_vf *cptvf)
+{
+	uint64_t base_addr = 0;
+
+	/* Disable the VQ */
+	otx_cpt_write_vq_ctl(cptvf, 0);
+
+	/* Reset the doorbell */
+	otx_cpt_write_vq_doorbell(cptvf, 0);
+	/* Clear inflight */
+	otx_cpt_write_vq_inprog(cptvf, 0);
+
+	/* Write VQ SADDR */
+	base_addr = (uint64_t)(cptvf->cqueue.chead[0].dma_addr);
+	otx_cpt_write_vq_saddr(cptvf, base_addr);
+
+	/* Configure timerhold / coalescence */
+	otx_cpt_write_vq_done_timewait(cptvf, CPT_TIMER_THOLD);
+	otx_cpt_write_vq_done_numwait(cptvf, CPT_COUNT_THOLD);
+
+	/* Enable the VQ */
+	otx_cpt_write_vq_ctl(cptvf, 1);
+}
+
+static int
+cpt_vq_init(struct cpt_vf *cptvf, uint8_t group)
+{
+	int err;
+
+	/* Convey VQ LEN to PF */
+	err = otx_cpt_send_vq_size_msg(cptvf);
+	if (err) {
+		CPT_LOG_ERR("%s: PF not responding to QLEN msg",
+			    cptvf->dev_name);
+		err = -EBUSY;
+		goto cleanup;
+	}
+
+	/* CPT VF device initialization */
+	otx_cpt_vfvq_init(cptvf);
+
+	/* Send msg to PF to assign currnet Q to required group */
+	cptvf->vfgrp = group;
+	err = otx_cpt_send_vf_grp_msg(cptvf, group);
+	if (err) {
+		CPT_LOG_ERR("%s: PF not responding to VF_GRP msg",
+			    cptvf->dev_name);
+		err = -EBUSY;
+		goto cleanup;
+	}
+
+	CPT_LOG_DP_DEBUG("%s: %s done", cptvf->dev_name, __func__);
+	return 0;
+
+cleanup:
+	return err;
+}
+
 void
 otx_cpt_poll_misc(struct cpt_vf *cptvf)
 {
@@ -263,6 +393,156 @@ otx_cpt_deinit_device(void *dev)
 }
 
 int
+otx_cpt_get_resource(void *dev, uint8_t group, struct cpt_instance **instance)
+{
+	int ret = -ENOENT, len, qlen, i;
+	int chunk_len, chunks, chunk_size;
+	struct cpt_vf *cptvf = (struct cpt_vf *)dev;
+	struct cpt_instance *cpt_instance;
+	struct command_chunk *chunk_head = NULL, *chunk_prev = NULL;
+	struct command_chunk *chunk = NULL;
+	uint8_t *mem;
+	const struct rte_memzone *rz;
+	uint64_t dma_addr = 0, alloc_len, used_len;
+	uint64_t *next_ptr;
+	uint64_t pg_sz = sysconf(_SC_PAGESIZE);
+
+	CPT_LOG_DP_DEBUG("Initializing cpt resource %s", cptvf->dev_name);
+
+	cpt_instance = &cptvf->instance;
+
+	memset(&cptvf->cqueue, 0, sizeof(cptvf->cqueue));
+	memset(&cptvf->pqueue, 0, sizeof(cptvf->pqueue));
+
+	/* Chunks are of fixed size buffers */
+	chunks = DEFAULT_CMD_QCHUNKS;
+	chunk_len = DEFAULT_CMD_QCHUNK_SIZE;
+
+	qlen = chunks * chunk_len;
+	/* Chunk size includes 8 bytes of next chunk ptr */
+	chunk_size = chunk_len * CPT_INST_SIZE + CPT_NEXT_CHUNK_PTR_SIZE;
+
+	/* For command chunk structures */
+	len = chunks * RTE_ALIGN(sizeof(struct command_chunk), 8);
+
+	/* For pending queue */
+	len += qlen * RTE_ALIGN(sizeof(struct rid), 8);
+
+	/* So that instruction queues start as pg size aligned */
+	len = RTE_ALIGN(len, pg_sz);
+
+	/* For Instruction queues */
+	len += chunks * RTE_ALIGN(chunk_size, 128);
+
+	/* Wastage after instruction queues */
+	len = RTE_ALIGN(len, pg_sz);
+
+	rz = rte_memzone_reserve_aligned(cptvf->dev_name, len, cptvf->node,
+					 RTE_MEMZONE_SIZE_HINT_ONLY |
+					 RTE_MEMZONE_256MB,
+					 RTE_CACHE_LINE_SIZE);
+	if (!rz) {
+		ret = rte_errno;
+		goto cleanup;
+	}
+
+	mem = rz->addr;
+	dma_addr = rz->phys_addr;
+	alloc_len = len;
+
+	memset(mem, 0, len);
+
+	cpt_instance->rsvd = (uintptr_t)rz;
+
+	/* Pending queue setup */
+	cptvf->pqueue.rid_queue = (struct rid *)mem;
+	cptvf->pqueue.enq_tail = 0;
+	cptvf->pqueue.deq_head = 0;
+	cptvf->pqueue.pending_count = 0;
+
+	mem +=  qlen * RTE_ALIGN(sizeof(struct rid), 8);
+	len -=  qlen * RTE_ALIGN(sizeof(struct rid), 8);
+	dma_addr += qlen * RTE_ALIGN(sizeof(struct rid), 8);
+
+	/* Alignment wastage */
+	used_len = alloc_len - len;
+	mem += RTE_ALIGN(used_len, pg_sz) - used_len;
+	len -= RTE_ALIGN(used_len, pg_sz) - used_len;
+	dma_addr += RTE_ALIGN(used_len, pg_sz) - used_len;
+
+	/* Init instruction queues */
+	chunk_head = &cptvf->cqueue.chead[0];
+	i = qlen;
+
+	chunk_prev = NULL;
+	for (i = 0; i < DEFAULT_CMD_QCHUNKS; i++) {
+		int csize;
+
+		chunk = &cptvf->cqueue.chead[i];
+		chunk->head = mem;
+		chunk->dma_addr = dma_addr;
+
+		csize = RTE_ALIGN(chunk_size, 128);
+		mem += csize;
+		dma_addr += csize;
+		len -= csize;
+
+		if (chunk_prev) {
+			next_ptr = (uint64_t *)(chunk_prev->head +
+						chunk_size - 8);
+			*next_ptr = (uint64_t)chunk->dma_addr;
+		}
+		chunk_prev = chunk;
+	}
+	/* Circular loop */
+	next_ptr = (uint64_t *)(chunk_prev->head + chunk_size - 8);
+	*next_ptr = (uint64_t)chunk_head->dma_addr;
+
+	assert(!len);
+
+	/* This is used for CPT(0)_PF_Q(0..15)_CTL.size config */
+	cptvf->qsize = chunk_size / 8;
+	cptvf->cqueue.qhead = chunk_head->head;
+	cptvf->cqueue.idx = 0;
+	cptvf->cqueue.cchunk = 0;
+
+	if (cpt_vq_init(cptvf, group)) {
+		CPT_LOG_ERR("Failed to initialize CPT VQ of device %s",
+			    cptvf->dev_name);
+		ret = -EBUSY;
+		goto cleanup;
+	}
+
+	*instance = cpt_instance;
+
+	CPT_LOG_DP_DEBUG("Crypto device (%s) initialized", cptvf->dev_name);
+
+	return 0;
+cleanup:
+	rte_memzone_free(rz);
+	*instance = NULL;
+	return ret;
+}
+
+int
+otx_cpt_put_resource(struct cpt_instance *instance)
+{
+	struct cpt_vf *cptvf = (struct cpt_vf *)instance;
+	struct rte_memzone *rz;
+
+	if (!cptvf) {
+		CPT_LOG_ERR("Invalid CPTVF handle");
+		return -EINVAL;
+	}
+
+	CPT_LOG_DP_DEBUG("Releasing cpt device %s", cptvf->dev_name);
+
+	rz = (struct rte_memzone *)instance->rsvd;
+	rte_memzone_free(rz);
+	return 0;
+}
+
+int
 otx_cpt_start_device(void *dev)
 {
 	int rc;
diff --git a/drivers/crypto/octeontx/otx_cryptodev_hw_access.h b/drivers/crypto/octeontx/otx_cryptodev_hw_access.h
index b795983..2698df6 100644
--- a/drivers/crypto/octeontx/otx_cryptodev_hw_access.h
+++ b/drivers/crypto/octeontx/otx_cryptodev_hw_access.h
@@ -17,6 +17,9 @@
 
 /* Default command queue length */
 #define DEFAULT_CMD_QCHUNKS		2
+#define DEFAULT_CMD_QCHUNK_SIZE		1023
+#define DEFAULT_CMD_QLEN \
+		(DEFAULT_CMD_QCHUNK_SIZE * DEFAULT_CMD_QCHUNKS)
 
 #define CPT_CSR_REG_BASE(cpt)		((cpt)->reg_base)
 
@@ -147,6 +150,12 @@ int
 otx_cpt_deinit_device(void *dev);
 
 int
+otx_cpt_get_resource(void *dev, uint8_t group, struct cpt_instance **instance);
+
+int
+otx_cpt_put_resource(struct cpt_instance *instance);
+
+int
 otx_cpt_start_device(void *cptvf);
 
 void
diff --git a/drivers/crypto/octeontx/otx_cryptodev_ops.c b/drivers/crypto/octeontx/otx_cryptodev_ops.c
index 905b37a..ed33334 100644
--- a/drivers/crypto/octeontx/otx_cryptodev_ops.c
+++ b/drivers/crypto/octeontx/otx_cryptodev_ops.c
@@ -23,6 +23,11 @@ static struct rte_mempool *otx_cpt_meta_pool;
 static int otx_cpt_op_mlen;
 static int otx_cpt_op_sb_mlen;
 
+/* Forward declarations */
+
+static int
+otx_cpt_que_pair_release(struct rte_cryptodev *dev, uint16_t que_pair_id);
+
 /*
  * Initializes global variables used by fast-path code
  *
@@ -131,9 +136,16 @@ static int
 otx_cpt_dev_close(struct rte_cryptodev *c_dev)
 {
 	void *cptvf = c_dev->data->dev_private;
+	int i, ret;
 
 	CPT_PMD_INIT_FUNC_TRACE();
 
+	for (i = 0; i < c_dev->data->nb_queue_pairs; i++) {
+		ret = otx_cpt_que_pair_release(c_dev, i);
+		if (ret)
+			return ret;
+	}
+
 	otx_cpt_periodic_alarm_stop(cptvf);
 	otx_cpt_deinit_device(cptvf);
 
@@ -168,6 +180,72 @@ otx_cpt_stats_reset(struct rte_cryptodev *dev __rte_unused)
 	CPT_PMD_INIT_FUNC_TRACE();
 }
 
+static int
+otx_cpt_que_pair_setup(struct rte_cryptodev *dev,
+		       uint16_t que_pair_id,
+		       const struct rte_cryptodev_qp_conf *qp_conf,
+		       int socket_id __rte_unused,
+		       struct rte_mempool *session_pool __rte_unused)
+{
+	void *cptvf = dev->data->dev_private;
+	struct cpt_instance *instance = NULL;
+	struct rte_pci_device *pci_dev;
+	int ret = -1;
+
+	CPT_PMD_INIT_FUNC_TRACE();
+
+	if (dev->data->queue_pairs[que_pair_id] != NULL) {
+		ret = otx_cpt_que_pair_release(dev, que_pair_id);
+		if (ret)
+			return ret;
+	}
+
+	if (qp_conf->nb_descriptors > DEFAULT_CMD_QLEN) {
+		CPT_LOG_INFO("Number of descriptors too big %d, using default "
+			     "queue length of %d", qp_conf->nb_descriptors,
+			     DEFAULT_CMD_QLEN);
+	}
+
+	pci_dev = RTE_DEV_TO_PCI(dev->device);
+
+	if (pci_dev->mem_resource[0].addr == NULL) {
+		CPT_LOG_ERR("PCI mem address null");
+		return -EIO;
+	}
+
+	ret = otx_cpt_get_resource(cptvf, 0, &instance);
+	if (ret != 0) {
+		CPT_LOG_ERR("Error getting instance handle from device %s : "
+			    "ret = %d", dev->data->name, ret);
+		return ret;
+	}
+
+	instance->queue_id = que_pair_id;
+	dev->data->queue_pairs[que_pair_id] = instance;
+
+	return 0;
+}
+
+static int
+otx_cpt_que_pair_release(struct rte_cryptodev *dev, uint16_t que_pair_id)
+{
+	struct cpt_instance *instance = dev->data->queue_pairs[que_pair_id];
+	int ret;
+
+	CPT_PMD_INIT_FUNC_TRACE();
+
+	ret = otx_cpt_put_resource(instance);
+	if (ret != 0) {
+		CPT_LOG_ERR("Error putting instance handle of device %s : "
+			    "ret = %d", dev->data->name, ret);
+		return ret;
+	}
+
+	dev->data->queue_pairs[que_pair_id] = NULL;
+
+	return 0;
+}
+
 static struct rte_cryptodev_ops cptvf_ops = {
 	/* Device related operations */
 	.dev_configure = otx_cpt_dev_config,
@@ -178,8 +256,8 @@ static struct rte_cryptodev_ops cptvf_ops = {
 
 	.stats_get = otx_cpt_stats_get,
 	.stats_reset = otx_cpt_stats_reset,
-	.queue_pair_setup = NULL,
-	.queue_pair_release = NULL,
+	.queue_pair_setup = otx_cpt_que_pair_setup,
+	.queue_pair_release = otx_cpt_que_pair_release,
 	.queue_pair_count = NULL,
 
 	/* Crypto related operations */
-- 
2.7.4