From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 31572A034E; Wed, 9 Feb 2022 16:39:18 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A86F941157; Wed, 9 Feb 2022 16:39:12 +0100 (CET) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by mails.dpdk.org (Postfix) with ESMTP id 12CBC41143 for ; Wed, 9 Feb 2022 16:39:08 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1644421150; x=1675957150; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=06iFUiIHJ1QkL+BlRTVv7jqOaCrY0xJdHlMu3NeBuqo=; b=TgA17U/tgUv2ILyGW0szZdWsRBxqNJ57nVTYuiyA1qVLrYSiNp9wOGdS 1+gYKEQ+m6usTvj9RM9Wpd/es6rflbii7Es2T0+SbC799A7LPU3f7Cqak FLYxUBTatM9fSDh1g3GxJ3Wp251Lrkf9/HXVqNaliFiBSDS8za10tKitF 1n0+qEe+nPlOs//kbKUpZvS0r+VEiSbFEcHM1UMlQEKraAd7fUqXbFAZ/ RbYQSfjUeJshMW0reEiJUjdCBo1VcuQJfJ5jRAzv+QLzjVfGOz7Np7yAA ilOuvzpKFI8UTzDOjXMZM3aD/Z9THyszUTIl7b8m64PpQcDpgRC+DWs5u w==; X-IronPort-AV: E=McAfee;i="6200,9189,10252"; a="312523454" X-IronPort-AV: E=Sophos;i="5.88,356,1635231600"; d="scan'208";a="312523454" Received: from orsmga003.jf.intel.com ([10.7.209.27]) by orsmga105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 09 Feb 2022 07:39:08 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.88,356,1635231600"; d="scan'208";a="482362813" Received: from silpixa00400355.ir.intel.com (HELO silpixa00400355.ger.corp.intel.com) ([10.237.222.49]) by orsmga003.jf.intel.com with ESMTP; 09 Feb 2022 07:39:04 -0800 From: Ciara Power To: dev@dpdk.org Cc: roy.fan.zhang@intel.com, gakhil@marvell.com, anoobj@marvell.com, mdr@ashroe.eu, Ciara Power , Declan Doherty , Ankur Dwivedi , Tejasree Kondoj , John Griffin , Fiona Trahe , Deepak Kumar Jain Subject: [PATCH v4 2/5] crypto: use single buffer for asymmetric session Date: Wed, 9 Feb 2022 15:38:51 +0000 Message-Id: <20220209153854.2740455-3-ciara.power@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20220209153854.2740455-1-ciara.power@intel.com> References: <20220209153854.2740455-1-ciara.power@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Rather than using a session buffer that contains pointers to private session data elsewhere, have a single session buffer. This session is created for a driver ID, and the mempool element contains space for the max session private data needed for any driver. Signed-off-by: Ciara Power Acked-by: Fan Zhang --- v4: - Merged asym crypto session clear and free functions. - Reordered some function parameters. - Updated trace function for asym crypto session create. - Fixed cnxk clear, the PMD no longer needs to put private data back into a mempool. - Renamed struct field for max private session size. - Replaced __extension__ with RTE_STD_C11. - Moved some parameter validity checks to before functional code. - Reworded release note. - Removed mempool parameter from session configure function. - Removed docs code additions, these are included due to patch 1 changing sample doc to use literal includes. v3: - Corrected formatting of struct comments. - Increased size of max_priv_session_sz to uint16_t. - Removed trace for asym session init function that was previously removed. - Added documentation. v2: - Renamed function typedef from "free" to "clear" as session private data isn't being freed in that function. - Moved user data API to separate patch. - Minor fixes to comments, formatting, return values. --- app/test-crypto-perf/cperf_ops.c | 14 +- app/test-crypto-perf/cperf_test_throughput.c | 8 +- app/test/test_cryptodev_asym.c | 272 +++++-------------- doc/guides/prog_guide/cryptodev_lib.rst | 21 +- doc/guides/rel_notes/release_22_03.rst | 7 + drivers/crypto/cnxk/cn10k_cryptodev_ops.c | 6 +- drivers/crypto/cnxk/cn9k_cryptodev_ops.c | 6 +- drivers/crypto/cnxk/cnxk_cryptodev_ops.c | 21 +- drivers/crypto/cnxk/cnxk_cryptodev_ops.h | 3 +- drivers/crypto/octeontx/otx_cryptodev_ops.c | 30 +- drivers/crypto/openssl/rte_openssl_pmd.c | 5 +- drivers/crypto/openssl/rte_openssl_pmd_ops.c | 24 +- drivers/crypto/qat/qat_asym.c | 54 +--- drivers/crypto/qat/qat_asym.h | 5 +- lib/cryptodev/cryptodev_pmd.h | 21 +- lib/cryptodev/cryptodev_trace_points.c | 9 +- lib/cryptodev/rte_cryptodev.c | 213 ++++++++------- lib/cryptodev/rte_cryptodev.h | 94 +++---- lib/cryptodev/rte_cryptodev_trace.h | 38 ++- lib/cryptodev/version.map | 7 +- 20 files changed, 308 insertions(+), 550 deletions(-) diff --git a/app/test-crypto-perf/cperf_ops.c b/app/test-crypto-perf/cperf_ops.c index d975ae1ab8..b125c699de 100644 --- a/app/test-crypto-perf/cperf_ops.c +++ b/app/test-crypto-perf/cperf_ops.c @@ -735,7 +735,6 @@ cperf_create_session(struct rte_mempool *sess_mp, struct rte_crypto_sym_xform aead_xform; struct rte_cryptodev_sym_session *sess = NULL; struct rte_crypto_asym_xform xform = {0}; - int rc; if (options->op_type == CPERF_ASYM_MODEX) { xform.next = NULL; @@ -745,19 +744,10 @@ cperf_create_session(struct rte_mempool *sess_mp, xform.modex.exponent.data = perf_mod_e; xform.modex.exponent.length = sizeof(perf_mod_e); - sess = (void *)rte_cryptodev_asym_session_create(sess_mp); + sess = (void *)rte_cryptodev_asym_session_create(dev_id, &xform, sess_mp); if (sess == NULL) return NULL; - rc = rte_cryptodev_asym_session_init(dev_id, (void *)sess, - &xform, priv_mp); - if (rc < 0) { - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, - (void *)sess); - rte_cryptodev_asym_session_free((void *)sess); - } - return NULL; - } + return sess; } #ifdef RTE_LIB_SECURITY diff --git a/app/test-crypto-perf/cperf_test_throughput.c b/app/test-crypto-perf/cperf_test_throughput.c index 51512af2ad..ee21ff27f7 100644 --- a/app/test-crypto-perf/cperf_test_throughput.c +++ b/app/test-crypto-perf/cperf_test_throughput.c @@ -35,11 +35,9 @@ cperf_throughput_test_free(struct cperf_throughput_ctx *ctx) if (!ctx) return; if (ctx->sess) { - if (ctx->options->op_type == CPERF_ASYM_MODEX) { - rte_cryptodev_asym_session_clear(ctx->dev_id, - (void *)ctx->sess); - rte_cryptodev_asym_session_free((void *)ctx->sess); - } + if (ctx->options->op_type == CPERF_ASYM_MODEX) + rte_cryptodev_asym_session_free(ctx->dev_id, + (void *)ctx->sess); #ifdef RTE_LIB_SECURITY else if (ctx->options->op_type == CPERF_PDCP || ctx->options->op_type == CPERF_DOCSIS || diff --git a/app/test/test_cryptodev_asym.c b/app/test/test_cryptodev_asym.c index 8d7290f9ed..3e27d93380 100644 --- a/app/test/test_cryptodev_asym.c +++ b/app/test/test_cryptodev_asym.c @@ -452,7 +452,8 @@ test_cryptodev_asym_op(struct crypto_testsuite_params_asym *ts_params, } if (!sessionless) { - sess = rte_cryptodev_asym_session_create(ts_params->session_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &xform_tc, + ts_params->session_mpool); if (!sess) { snprintf(test_msg, ASYM_TEST_MSG_LEN, "line %u " @@ -462,15 +463,6 @@ test_cryptodev_asym_op(struct crypto_testsuite_params_asym *ts_params, goto error_exit; } - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform_tc, - ts_params->session_mpool) < 0) { - snprintf(test_msg, ASYM_TEST_MSG_LEN, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); - status = TEST_FAILED; - goto error_exit; - } - rte_crypto_op_attach_asym_session(op, sess); } else { asym_op->xform = &xform_tc; @@ -512,10 +504,8 @@ test_cryptodev_asym_op(struct crypto_testsuite_params_asym *ts_params, snprintf(test_msg, ASYM_TEST_MSG_LEN, "SESSIONLESS PASS"); error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); @@ -669,18 +659,11 @@ test_rsa_sign_verify(void) return TEST_SKIPPED; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &rsa_xform, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "Session creation failed for " "sign_verify\n"); - return TEST_FAILED; - } - - if (rte_cryptodev_asym_session_init(dev_id, sess, &rsa_xform, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, "Unable to config asym session for " - "sign_verify\n"); status = TEST_FAILED; goto error_exit; } @@ -688,9 +671,7 @@ test_rsa_sign_verify(void) status = queue_ops_rsa_sign_verify(sess); error_exit: - - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); + rte_cryptodev_asym_session_free(dev_id, sess); TEST_ASSERT_EQUAL(status, 0, "Test failed"); @@ -718,17 +699,10 @@ test_rsa_enc_dec(void) return TEST_SKIPPED; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &rsa_xform, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "Session creation failed for enc_dec\n"); - return TEST_FAILED; - } - - if (rte_cryptodev_asym_session_init(dev_id, sess, &rsa_xform, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, "Unable to config asym session for " - "enc_dec\n"); status = TEST_FAILED; goto error_exit; } @@ -737,8 +711,7 @@ test_rsa_enc_dec(void) error_exit: - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); + rte_cryptodev_asym_session_free(dev_id, sess); TEST_ASSERT_EQUAL(status, 0, "Test failed"); @@ -765,28 +738,20 @@ test_rsa_sign_verify_crt(void) return TEST_SKIPPED; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &rsa_xform_crt, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "Session creation failed for " "sign_verify_crt\n"); status = TEST_FAILED; - return status; - } - - if (rte_cryptodev_asym_session_init(dev_id, sess, &rsa_xform_crt, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, "Unable to config asym session for " - "sign_verify_crt\n"); - status = TEST_FAILED; goto error_exit; } + status = queue_ops_rsa_sign_verify(sess); error_exit: - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); + rte_cryptodev_asym_session_free(dev_id, sess); TEST_ASSERT_EQUAL(status, 0, "Test failed"); @@ -813,27 +778,20 @@ test_rsa_enc_dec_crt(void) return TEST_SKIPPED; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &rsa_xform_crt, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "Session creation failed for " "enc_dec_crt\n"); - return TEST_FAILED; - } - - if (rte_cryptodev_asym_session_init(dev_id, sess, &rsa_xform_crt, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, "Unable to config asym session for " - "enc_dec_crt\n"); status = TEST_FAILED; goto error_exit; } + status = queue_ops_rsa_enc_dec(sess); error_exit: - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); + rte_cryptodev_asym_session_free(dev_id, sess); TEST_ASSERT_EQUAL(status, 0, "Test failed"); @@ -927,7 +885,6 @@ testsuite_setup(void) /* configure qp */ ts_params->qp_conf.nb_descriptors = DEFAULT_NUM_OPS_INFLIGHT; ts_params->qp_conf.mp_session = ts_params->session_mpool; - ts_params->qp_conf.mp_session_private = ts_params->session_mpool; for (qp_id = 0; qp_id < info.max_nb_queue_pairs; qp_id++) { TEST_ASSERT_SUCCESS(rte_cryptodev_queue_pair_setup( dev_id, qp_id, &ts_params->qp_conf, @@ -936,21 +893,9 @@ testsuite_setup(void) qp_id, dev_id); } - /* setup asym session pool */ - unsigned int session_size = RTE_MAX( - rte_cryptodev_asym_get_private_session_size(dev_id), - rte_cryptodev_asym_get_header_session_size()); - /* - * Create mempool with TEST_NUM_SESSIONS * 2, - * to include the session headers - */ - ts_params->session_mpool = rte_mempool_create( - "test_asym_sess_mp", - TEST_NUM_SESSIONS * 2, - session_size, - 0, 0, NULL, NULL, NULL, - NULL, SOCKET_ID_ANY, - 0); + ts_params->session_mpool = rte_cryptodev_asym_session_pool_create( + "test_asym_sess_mp", TEST_NUM_SESSIONS * 2, 0, + SOCKET_ID_ANY); TEST_ASSERT_NOT_NULL(ts_params->session_mpool, "session mempool allocation failed"); @@ -1107,14 +1052,6 @@ test_dh_gen_shared_sec(struct rte_crypto_asym_xform *xfrm) struct rte_crypto_asym_xform xform = *xfrm; uint8_t peer[] = "01234567890123456789012345678901234567890123456789"; - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed"); - status = TEST_FAILED; - goto error_exit; - } /* set up crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (!op) { @@ -1137,11 +1074,11 @@ test_dh_gen_shared_sec(struct rte_crypto_asym_xform *xfrm) asym_op->dh.shared_secret.data = output; asym_op->dh.shared_secret.length = sizeof(output); - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); + "line %u FAILED: %s", __LINE__, + "Session creation failed"); status = TEST_FAILED; goto error_exit; } @@ -1176,10 +1113,8 @@ test_dh_gen_shared_sec(struct rte_crypto_asym_xform *xfrm) asym_op->dh.shared_secret.length); error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); return status; @@ -1199,14 +1134,6 @@ test_dh_gen_priv_key(struct rte_crypto_asym_xform *xfrm) uint8_t output[TEST_DH_MOD_LEN]; struct rte_crypto_asym_xform xform = *xfrm; - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed"); - status = TEST_FAILED; - goto error_exit; - } /* set up crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (!op) { @@ -1225,11 +1152,11 @@ test_dh_gen_priv_key(struct rte_crypto_asym_xform *xfrm) asym_op->dh.priv_key.data = output; asym_op->dh.priv_key.length = sizeof(output); - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); + "line %u FAILED: %s", __LINE__, + "Session creation failed"); status = TEST_FAILED; goto error_exit; } @@ -1265,10 +1192,8 @@ test_dh_gen_priv_key(struct rte_crypto_asym_xform *xfrm) error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); @@ -1290,14 +1215,6 @@ test_dh_gen_pub_key(struct rte_crypto_asym_xform *xfrm) uint8_t output[TEST_DH_MOD_LEN]; struct rte_crypto_asym_xform xform = *xfrm; - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed"); - status = TEST_FAILED; - goto error_exit; - } /* set up crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (!op) { @@ -1324,11 +1241,11 @@ test_dh_gen_pub_key(struct rte_crypto_asym_xform *xfrm) 0); asym_op->dh.priv_key = dh_test_params.priv_key; - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); + "line %u FAILED: %s", __LINE__, + "Session creation failed"); status = TEST_FAILED; goto error_exit; } @@ -1365,10 +1282,8 @@ test_dh_gen_pub_key(struct rte_crypto_asym_xform *xfrm) asym_op->dh.priv_key.data, asym_op->dh.priv_key.length); error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); @@ -1391,15 +1306,6 @@ test_dh_gen_kp(struct rte_crypto_asym_xform *xfrm) struct rte_crypto_asym_xform pub_key_xform; struct rte_crypto_asym_xform xform = *xfrm; - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed"); - status = TEST_FAILED; - goto error_exit; - } - /* set up crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (!op) { @@ -1423,11 +1329,12 @@ test_dh_gen_kp(struct rte_crypto_asym_xform *xfrm) asym_op->dh.pub_key.length = sizeof(out_pub_key); asym_op->dh.priv_key.data = out_prv_key; asym_op->dh.priv_key.length = sizeof(out_prv_key); - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); + "line %u FAILED: %s", __LINE__, + "Session creation failed"); status = TEST_FAILED; goto error_exit; } @@ -1462,10 +1369,8 @@ test_dh_gen_kp(struct rte_crypto_asym_xform *xfrm) out_pub_key, asym_op->dh.pub_key.length); error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); @@ -1514,7 +1419,7 @@ test_mod_inv(void) return TEST_SKIPPED; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &modinv_xform, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "line %u " "FAILED: %s", __LINE__, @@ -1523,15 +1428,6 @@ test_mod_inv(void) goto error_exit; } - if (rte_cryptodev_asym_session_init(dev_id, sess, &modinv_xform, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); - status = TEST_FAILED; - goto error_exit; - } - /* generate crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (!op) { @@ -1583,10 +1479,8 @@ test_mod_inv(void) } error_exit: - if (sess) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess) + rte_cryptodev_asym_session_free(dev_id, sess); if (op) rte_crypto_op_free(op); @@ -1649,7 +1543,7 @@ test_mod_exp(void) goto error_exit; } - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &modex_xform, sess_mpool); if (!sess) { RTE_LOG(ERR, USER1, "line %u " @@ -1659,15 +1553,6 @@ test_mod_exp(void) goto error_exit; } - if (rte_cryptodev_asym_session_init(dev_id, sess, &modex_xform, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); - status = TEST_FAILED; - goto error_exit; - } - asym_op = op->asym; memcpy(input, base, sizeof(base)); asym_op->modex.base.data = input; @@ -1706,10 +1591,8 @@ test_mod_exp(void) } error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); @@ -1771,7 +1654,7 @@ test_dsa_sign(void) uint8_t s[TEST_DH_MOD_LEN]; uint8_t dgst[] = "35d81554afaad2cf18f3a1770d5fedc4ea5be344"; - sess = rte_cryptodev_asym_session_create(sess_mpool); + sess = rte_cryptodev_asym_session_create(dev_id, &dsa_xform, sess_mpool); if (sess == NULL) { RTE_LOG(ERR, USER1, "line %u FAILED: %s", __LINE__, @@ -1800,15 +1683,6 @@ test_dsa_sign(void) debug_hexdump(stdout, "priv_key: ", dsa_xform.dsa.x.data, dsa_xform.dsa.x.length); - if (rte_cryptodev_asym_session_init(dev_id, sess, &dsa_xform, - sess_mpool) < 0) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", - __LINE__, "unabled to config sym session"); - status = TEST_FAILED; - goto error_exit; - } - /* attach asymmetric crypto session to crypto operations */ rte_crypto_op_attach_asym_session(op, sess); asym_op->dsa.op_type = RTE_CRYPTO_ASYM_OP_SIGN; @@ -1882,10 +1756,8 @@ test_dsa_sign(void) status = TEST_FAILED; } error_exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); return status; @@ -1944,15 +1816,6 @@ test_ecdsa_sign_verify(enum curve curve_id) rte_cryptodev_info_get(dev_id, &dev_info); - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed\n"); - status = TEST_FAILED; - goto exit; - } - /* Setup crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (op == NULL) { @@ -1970,11 +1833,11 @@ test_ecdsa_sign_verify(enum curve curve_id) xform.xform_type = RTE_CRYPTO_ASYM_XFORM_ECDSA; xform.ec.curve_id = input_params.curve; - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, "line %u FAILED: %s", __LINE__, - "Unable to config asym session\n"); + "Session creation failed\n"); status = TEST_FAILED; goto exit; } @@ -2082,10 +1945,8 @@ test_ecdsa_sign_verify(enum curve curve_id) } exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); return status; @@ -2157,15 +2018,6 @@ test_ecpm(enum curve curve_id) rte_cryptodev_info_get(dev_id, &dev_info); - sess = rte_cryptodev_asym_session_create(sess_mpool); - if (sess == NULL) { - RTE_LOG(ERR, USER1, - "line %u FAILED: %s", __LINE__, - "Session creation failed\n"); - status = TEST_FAILED; - goto exit; - } - /* Setup crypto op data structure */ op = rte_crypto_op_alloc(op_mpool, RTE_CRYPTO_OP_TYPE_ASYMMETRIC); if (op == NULL) { @@ -2183,11 +2035,11 @@ test_ecpm(enum curve curve_id) xform.xform_type = RTE_CRYPTO_ASYM_XFORM_ECPM; xform.ec.curve_id = input_params.curve; - if (rte_cryptodev_asym_session_init(dev_id, sess, &xform, - sess_mpool) < 0) { + sess = rte_cryptodev_asym_session_create(dev_id, &xform, sess_mpool); + if (sess == NULL) { RTE_LOG(ERR, USER1, "line %u FAILED: %s", __LINE__, - "Unable to config asym session\n"); + "Session creation failed\n"); status = TEST_FAILED; goto exit; } @@ -2255,10 +2107,8 @@ test_ecpm(enum curve curve_id) } exit: - if (sess != NULL) { - rte_cryptodev_asym_session_clear(dev_id, sess); - rte_cryptodev_asym_session_free(sess); - } + if (sess != NULL) + rte_cryptodev_asym_session_free(dev_id, sess); if (op != NULL) rte_crypto_op_free(op); return status; diff --git a/doc/guides/prog_guide/cryptodev_lib.rst b/doc/guides/prog_guide/cryptodev_lib.rst index 9f33f7a177..b4dbd384bf 100644 --- a/doc/guides/prog_guide/cryptodev_lib.rst +++ b/doc/guides/prog_guide/cryptodev_lib.rst @@ -1038,20 +1038,17 @@ It is the application's responsibility to create and manage the session mempools Application using both symmetric and asymmetric sessions should allocate and maintain different sessions pools for each type. -An application can use ``rte_cryptodev_get_asym_session_private_size()`` to -get the private size of asymmetric session on a given crypto device. This -function would allow an application to calculate the max device asymmetric -session size of all crypto devices to create a single session mempool. -If instead an application creates multiple asymmetric session mempools, -the Crypto device framework also provides ``rte_cryptodev_asym_get_header_session_size()`` to get -the size of an uninitialized session. +An application can use ``rte_cryptodev_asym_session_pool_create()`` to create a mempool +with a specified number of elements. The element size will allow for the session header, +and the max private session size. +The max private session size is chosen based on available crypto devices, +the biggest private session size is used. This means any of those devices can be used, +and the mempool element will have available space for its private session data. Once the session mempools have been created, ``rte_cryptodev_asym_session_create()`` -is used to allocate an uninitialized asymmetric session from the given mempool. -The session then must be initialized using ``rte_cryptodev_asym_session_init()`` -for each of the required crypto devices. An asymmetric transform chain -is used to specify the operation and its parameters. See the section below for -details on transforms. +is used to allocate and initialize an asymmetric session from the given mempool. +An asymmetric transform chain is used to specify the operation and its parameters. +See the section below for details on transforms. When a session is no longer used, user must call ``rte_cryptodev_asym_session_clear()`` for each of the crypto devices that are using the session, to free all driver diff --git a/doc/guides/rel_notes/release_22_03.rst b/doc/guides/rel_notes/release_22_03.rst index a820cc5596..ea4c5309a0 100644 --- a/doc/guides/rel_notes/release_22_03.rst +++ b/doc/guides/rel_notes/release_22_03.rst @@ -112,6 +112,13 @@ API Changes * ethdev: Old public macros and enumeration constants without ``RTE_ETH_`` prefix, which are kept for backward compatibility, are marked as deprecated. +* cryptodev: The asymmetric session handling was modified to use a single + mempool object. An API ``rte_cryptodev_asym_session_pool_create`` was added + to create a mempool with element size big enough to hold the generic asymmetric + session header and max size for a device private session data. + The API ``rte_cryptodev_asym_session_init`` was removed as the initialization + is now moved to ``rte_cryptodev_asym_session_create``. + ABI Changes ----------- diff --git a/drivers/crypto/cnxk/cn10k_cryptodev_ops.c b/drivers/crypto/cnxk/cn10k_cryptodev_ops.c index d217bbf383..7390f976c6 100644 --- a/drivers/crypto/cnxk/cn10k_cryptodev_ops.c +++ b/drivers/crypto/cnxk/cn10k_cryptodev_ops.c @@ -157,8 +157,7 @@ cn10k_cpt_fill_inst(struct cnxk_cpt_qp *qp, struct rte_crypto_op *ops[], if (op->sess_type == RTE_CRYPTO_OP_WITH_SESSION) { asym_op = op->asym; - ae_sess = get_asym_session_private_data( - asym_op->session, cn10k_cryptodev_driver_id); + ae_sess = get_asym_session_private_data(asym_op->session); ret = cnxk_ae_enqueue(qp, op, infl_req, &inst[0], ae_sess); if (unlikely(ret)) @@ -431,8 +430,7 @@ cn10k_cpt_dequeue_post_process(struct cnxk_cpt_qp *qp, uintptr_t *mdata = infl_req->mdata; struct cnxk_ae_sess *sess; - sess = get_asym_session_private_data( - op->session, cn10k_cryptodev_driver_id); + sess = get_asym_session_private_data(op->session); cnxk_ae_post_process(cop, sess, (uint8_t *)mdata[0]); } diff --git a/drivers/crypto/cnxk/cn9k_cryptodev_ops.c b/drivers/crypto/cnxk/cn9k_cryptodev_ops.c index ac1953b66d..59a06af30e 100644 --- a/drivers/crypto/cnxk/cn9k_cryptodev_ops.c +++ b/drivers/crypto/cnxk/cn9k_cryptodev_ops.c @@ -138,8 +138,7 @@ cn9k_cpt_inst_prep(struct cnxk_cpt_qp *qp, struct rte_crypto_op *op, if (op->sess_type == RTE_CRYPTO_OP_WITH_SESSION) { asym_op = op->asym; - sess = get_asym_session_private_data( - asym_op->session, cn9k_cryptodev_driver_id); + sess = get_asym_session_private_data(asym_op->session); ret = cnxk_ae_enqueue(qp, op, infl_req, inst, sess); inst->w7.u64 = sess->cpt_inst_w7; } else { @@ -453,8 +452,7 @@ cn9k_cpt_dequeue_post_process(struct cnxk_cpt_qp *qp, struct rte_crypto_op *cop, uintptr_t *mdata = infl_req->mdata; struct cnxk_ae_sess *sess; - sess = get_asym_session_private_data( - op->session, cn9k_cryptodev_driver_id); + sess = get_asym_session_private_data(op->session); cnxk_ae_post_process(cop, sess, (uint8_t *)mdata[0]); } diff --git a/drivers/crypto/cnxk/cnxk_cryptodev_ops.c b/drivers/crypto/cnxk/cnxk_cryptodev_ops.c index a5fb68da02..7bfac186f9 100644 --- a/drivers/crypto/cnxk/cnxk_cryptodev_ops.c +++ b/drivers/crypto/cnxk/cnxk_cryptodev_ops.c @@ -658,10 +658,9 @@ void cnxk_ae_session_clear(struct rte_cryptodev *dev, struct rte_cryptodev_asym_session *sess) { - struct rte_mempool *sess_mp; struct cnxk_ae_sess *priv; - priv = get_asym_session_private_data(sess, dev->driver_id); + priv = get_asym_session_private_data(sess); if (priv == NULL) return; @@ -670,40 +669,28 @@ cnxk_ae_session_clear(struct rte_cryptodev *dev, /* Reset and free object back to pool */ memset(priv, 0, cnxk_ae_session_size_get(dev)); - sess_mp = rte_mempool_from_obj(priv); - set_asym_session_private_data(sess, dev->driver_id, NULL); - rte_mempool_put(sess_mp, priv); } int cnxk_ae_session_cfg(struct rte_cryptodev *dev, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *pool) + struct rte_cryptodev_asym_session *sess) { struct cnxk_cpt_vf *vf = dev->data->dev_private; struct roc_cpt *roc_cpt = &vf->cpt; - struct cnxk_ae_sess *priv; + struct cnxk_ae_sess *priv = get_asym_session_private_data(sess); union cpt_inst_w7 w7; int ret; - if (rte_mempool_get(pool, (void **)&priv)) - return -ENOMEM; - - memset(priv, 0, sizeof(struct cnxk_ae_sess)); - ret = cnxk_ae_fill_session_parameters(priv, xform); - if (ret) { - rte_mempool_put(pool, priv); + if (ret) return ret; - } w7.u64 = 0; w7.s.egrp = roc_cpt->eng_grp[CPT_ENG_TYPE_AE]; priv->cpt_inst_w7 = w7.u64; priv->cnxk_fpm_iova = vf->cnxk_fpm_iova; priv->ec_grp = vf->ec_grp; - set_asym_session_private_data(sess, dev->driver_id, priv); return 0; } diff --git a/drivers/crypto/cnxk/cnxk_cryptodev_ops.h b/drivers/crypto/cnxk/cnxk_cryptodev_ops.h index 0656ba9675..ab0f00ee7c 100644 --- a/drivers/crypto/cnxk/cnxk_cryptodev_ops.h +++ b/drivers/crypto/cnxk/cnxk_cryptodev_ops.h @@ -122,8 +122,7 @@ void cnxk_ae_session_clear(struct rte_cryptodev *dev, struct rte_cryptodev_asym_session *sess); int cnxk_ae_session_cfg(struct rte_cryptodev *dev, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *pool); + struct rte_cryptodev_asym_session *sess); void cnxk_cpt_dump_on_err(struct cnxk_cpt_qp *qp); static inline union rte_event_crypto_metadata * diff --git a/drivers/crypto/octeontx/otx_cryptodev_ops.c b/drivers/crypto/octeontx/otx_cryptodev_ops.c index f7ca8a8a8e..cf3947f1ab 100644 --- a/drivers/crypto/octeontx/otx_cryptodev_ops.c +++ b/drivers/crypto/octeontx/otx_cryptodev_ops.c @@ -375,35 +375,23 @@ otx_cpt_asym_session_size_get(struct rte_cryptodev *dev __rte_unused) } static int -otx_cpt_asym_session_cfg(struct rte_cryptodev *dev, +otx_cpt_asym_session_cfg(struct rte_cryptodev *dev __rte_unused, struct rte_crypto_asym_xform *xform __rte_unused, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *pool) + struct rte_cryptodev_asym_session *sess) { - struct cpt_asym_sess_misc *priv; + struct cpt_asym_sess_misc *priv = get_asym_session_private_data(sess); int ret; CPT_PMD_INIT_FUNC_TRACE(); - if (rte_mempool_get(pool, (void **)&priv)) { - CPT_LOG_ERR("Could not allocate session private data"); - return -ENOMEM; - } - - memset(priv, 0, sizeof(struct cpt_asym_sess_misc)); - ret = cpt_fill_asym_session_parameters(priv, xform); if (ret) { CPT_LOG_ERR("Could not configure session parameters"); - - /* Return session to mempool */ - rte_mempool_put(pool, priv); return ret; } priv->cpt_inst_w7 = 0; - set_asym_session_private_data(sess, dev->driver_id, priv); return 0; } @@ -412,11 +400,10 @@ otx_cpt_asym_session_clear(struct rte_cryptodev *dev, struct rte_cryptodev_asym_session *sess) { struct cpt_asym_sess_misc *priv; - struct rte_mempool *sess_mp; CPT_PMD_INIT_FUNC_TRACE(); - priv = get_asym_session_private_data(sess, dev->driver_id); + priv = get_asym_session_private_data(sess); if (priv == NULL) return; @@ -424,9 +411,6 @@ otx_cpt_asym_session_clear(struct rte_cryptodev *dev, /* Free resources allocated during session configure */ cpt_free_asym_session_parameters(priv); memset(priv, 0, otx_cpt_asym_session_size_get(dev)); - sess_mp = rte_mempool_from_obj(priv); - set_asym_session_private_data(sess, dev->driver_id, NULL); - rte_mempool_put(sess_mp, priv); } static __rte_always_inline void * __rte_hot @@ -471,8 +455,7 @@ otx_cpt_enq_single_asym(struct cpt_instance *instance, return NULL; } - sess = get_asym_session_private_data(asym_op->session, - otx_cryptodev_driver_id); + sess = get_asym_session_private_data(asym_op->session); /* Store phys_addr of the mdata to meta_buf */ params.meta_buf = rte_mempool_virt2iova(mdata); @@ -852,8 +835,7 @@ otx_cpt_asym_post_process(struct rte_crypto_op *cop, struct rte_crypto_asym_op *op = cop->asym; struct cpt_asym_sess_misc *sess; - sess = get_asym_session_private_data(op->session, - otx_cryptodev_driver_id); + sess = get_asym_session_private_data(op->session); switch (sess->xfrm_type) { case RTE_CRYPTO_ASYM_XFORM_RSA: diff --git a/drivers/crypto/openssl/rte_openssl_pmd.c b/drivers/crypto/openssl/rte_openssl_pmd.c index 5794ed8159..1e7e5f6849 100644 --- a/drivers/crypto/openssl/rte_openssl_pmd.c +++ b/drivers/crypto/openssl/rte_openssl_pmd.c @@ -747,10 +747,7 @@ get_session(struct openssl_qp *qp, struct rte_crypto_op *op) cryptodev_driver_id); } else { if (likely(op->asym->session != NULL)) - asym_sess = (struct openssl_asym_session *) - get_asym_session_private_data( - op->asym->session, - cryptodev_driver_id); + asym_sess = get_asym_session_private_data(op->asym->session); if (asym_sess == NULL) op->status = RTE_CRYPTO_OP_STATUS_INVALID_SESSION; diff --git a/drivers/crypto/openssl/rte_openssl_pmd_ops.c b/drivers/crypto/openssl/rte_openssl_pmd_ops.c index 52715f86f8..92b9524bf3 100644 --- a/drivers/crypto/openssl/rte_openssl_pmd_ops.c +++ b/drivers/crypto/openssl/rte_openssl_pmd_ops.c @@ -1119,8 +1119,7 @@ static int openssl_set_asym_session_parameters( static int openssl_pmd_asym_session_configure(struct rte_cryptodev *dev __rte_unused, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *mempool) + struct rte_cryptodev_asym_session *sess) { void *asym_sess_private_data; int ret; @@ -1130,25 +1129,14 @@ openssl_pmd_asym_session_configure(struct rte_cryptodev *dev __rte_unused, return -EINVAL; } - if (rte_mempool_get(mempool, &asym_sess_private_data)) { - CDEV_LOG_ERR( - "Couldn't get object from session mempool"); - return -ENOMEM; - } - + asym_sess_private_data = get_asym_session_private_data(sess); ret = openssl_set_asym_session_parameters(asym_sess_private_data, xform); if (ret != 0) { OPENSSL_LOG(ERR, "failed configure session parameters"); - - /* Return session to mempool */ - rte_mempool_put(mempool, asym_sess_private_data); return ret; } - set_asym_session_private_data(sess, dev->driver_id, - asym_sess_private_data); - return 0; } @@ -1206,19 +1194,15 @@ static void openssl_reset_asym_session(struct openssl_asym_session *sess) * so it doesn't leave key material behind */ static void -openssl_pmd_asym_session_clear(struct rte_cryptodev *dev, +openssl_pmd_asym_session_clear(struct rte_cryptodev *dev __rte_unused, struct rte_cryptodev_asym_session *sess) { - uint8_t index = dev->driver_id; - void *sess_priv = get_asym_session_private_data(sess, index); + void *sess_priv = get_asym_session_private_data(sess); /* Zero out the whole structure */ if (sess_priv) { openssl_reset_asym_session(sess_priv); memset(sess_priv, 0, sizeof(struct openssl_asym_session)); - struct rte_mempool *sess_mp = rte_mempool_from_obj(sess_priv); - set_asym_session_private_data(sess, index, NULL); - rte_mempool_put(sess_mp, sess_priv); } } diff --git a/drivers/crypto/qat/qat_asym.c b/drivers/crypto/qat/qat_asym.c index 09d8761c5f..6576e8c87c 100644 --- a/drivers/crypto/qat/qat_asym.c +++ b/drivers/crypto/qat/qat_asym.c @@ -491,9 +491,7 @@ qat_asym_build_request(void *in_op, op->status = RTE_CRYPTO_OP_STATUS_NOT_PROCESSED; if (op->sess_type == RTE_CRYPTO_OP_WITH_SESSION) { - ctx = (struct qat_asym_session *) - get_asym_session_private_data( - op->asym->session, qat_asym_driver_id); + ctx = get_asym_session_private_data(op->asym->session); if (unlikely(ctx == NULL)) { QAT_LOG(ERR, "Session has not been created for this device"); goto error; @@ -711,8 +709,7 @@ qat_asym_process_response(void **op, uint8_t *resp, } if (rx_op->sess_type == RTE_CRYPTO_OP_WITH_SESSION) { - ctx = (struct qat_asym_session *)get_asym_session_private_data( - rx_op->asym->session, qat_asym_driver_id); + ctx = get_asym_session_private_data(rx_op->asym->session); qat_asym_collect_response(rx_op, cookie, ctx->xform); } else if (rx_op->sess_type == RTE_CRYPTO_OP_SESSIONLESS) { qat_asym_collect_response(rx_op, cookie, rx_op->asym->xform); @@ -726,61 +723,42 @@ qat_asym_process_response(void **op, uint8_t *resp, } int -qat_asym_session_configure(struct rte_cryptodev *dev, +qat_asym_session_configure(struct rte_cryptodev *dev __rte_unused, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *mempool) + struct rte_cryptodev_asym_session *sess) { - int err = 0; - void *sess_private_data; struct qat_asym_session *session; - if (rte_mempool_get(mempool, &sess_private_data)) { - QAT_LOG(ERR, - "Couldn't get object from session mempool"); - return -ENOMEM; - } - - session = sess_private_data; + session = get_asym_session_private_data(sess); if (xform->xform_type == RTE_CRYPTO_ASYM_XFORM_MODEX) { if (xform->modex.exponent.length == 0 || xform->modex.modulus.length == 0) { QAT_LOG(ERR, "Invalid mod exp input parameter"); - err = -EINVAL; - goto error; + return -EINVAL; } } else if (xform->xform_type == RTE_CRYPTO_ASYM_XFORM_MODINV) { if (xform->modinv.modulus.length == 0) { QAT_LOG(ERR, "Invalid mod inv input parameter"); - err = -EINVAL; - goto error; + return -EINVAL; } } else if (xform->xform_type == RTE_CRYPTO_ASYM_XFORM_RSA) { if (xform->rsa.n.length == 0) { QAT_LOG(ERR, "Invalid rsa input parameter"); - err = -EINVAL; - goto error; + return -EINVAL; } } else if (xform->xform_type >= RTE_CRYPTO_ASYM_XFORM_TYPE_LIST_END || xform->xform_type <= RTE_CRYPTO_ASYM_XFORM_NONE) { QAT_LOG(ERR, "Invalid asymmetric crypto xform"); - err = -EINVAL; - goto error; + return -EINVAL; } else { QAT_LOG(ERR, "Asymmetric crypto xform not implemented"); - err = -EINVAL; - goto error; + return -EINVAL; } session->xform = xform; - qat_asym_build_req_tmpl(sess_private_data); - set_asym_session_private_data(sess, dev->driver_id, - sess_private_data); + qat_asym_build_req_tmpl(session); return 0; -error: - rte_mempool_put(mempool, sess_private_data); - return err; } unsigned int qat_asym_session_get_private_size( @@ -793,15 +771,9 @@ void qat_asym_session_clear(struct rte_cryptodev *dev, struct rte_cryptodev_asym_session *sess) { - uint8_t index = dev->driver_id; - void *sess_priv = get_asym_session_private_data(sess, index); + void *sess_priv = get_asym_session_private_data(sess); struct qat_asym_session *s = (struct qat_asym_session *)sess_priv; - if (sess_priv) { + if (sess_priv) memset(s, 0, qat_asym_session_get_private_size(dev)); - struct rte_mempool *sess_mp = rte_mempool_from_obj(sess_priv); - - set_asym_session_private_data(sess, index, NULL); - rte_mempool_put(sess_mp, sess_priv); - } } diff --git a/drivers/crypto/qat/qat_asym.h b/drivers/crypto/qat/qat_asym.h index 308b6b2e0b..c9242a12ca 100644 --- a/drivers/crypto/qat/qat_asym.h +++ b/drivers/crypto/qat/qat_asym.h @@ -46,10 +46,9 @@ struct qat_asym_session { }; int -qat_asym_session_configure(struct rte_cryptodev *dev, +qat_asym_session_configure(struct rte_cryptodev *dev __rte_unused, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *sess, - struct rte_mempool *mempool); + struct rte_cryptodev_asym_session *sess); unsigned int qat_asym_session_get_private_size(struct rte_cryptodev *dev); diff --git a/lib/cryptodev/cryptodev_pmd.h b/lib/cryptodev/cryptodev_pmd.h index b9146f652c..aeaccfa611 100644 --- a/lib/cryptodev/cryptodev_pmd.h +++ b/lib/cryptodev/cryptodev_pmd.h @@ -319,7 +319,6 @@ typedef int (*cryptodev_sym_configure_session_t)(struct rte_cryptodev *dev, * @param dev Crypto device pointer * @param xform Single or chain of crypto xforms * @param session Pointer to cryptodev's private session structure - * @param mp Mempool where the private session is allocated * * @return * - Returns 0 if private session structure have been created successfully. @@ -329,8 +328,7 @@ typedef int (*cryptodev_sym_configure_session_t)(struct rte_cryptodev *dev, */ typedef int (*cryptodev_asym_configure_session_t)(struct rte_cryptodev *dev, struct rte_crypto_asym_xform *xform, - struct rte_cryptodev_asym_session *session, - struct rte_mempool *mp); + struct rte_cryptodev_asym_session *session); /** * Free driver private session data. * @@ -340,12 +338,12 @@ typedef int (*cryptodev_asym_configure_session_t)(struct rte_cryptodev *dev, typedef void (*cryptodev_sym_free_session_t)(struct rte_cryptodev *dev, struct rte_cryptodev_sym_session *sess); /** - * Free asymmetric session private data. + * Clear asymmetric session private data. * * @param dev Crypto device pointer * @param sess Cryptodev session structure */ -typedef void (*cryptodev_asym_free_session_t)(struct rte_cryptodev *dev, +typedef void (*cryptodev_asym_clear_session_t)(struct rte_cryptodev *dev, struct rte_cryptodev_asym_session *sess); /** * Perform actual crypto processing (encrypt/digest or auth/decrypt) @@ -429,7 +427,7 @@ struct rte_cryptodev_ops { /**< Configure asymmetric Crypto session. */ cryptodev_sym_free_session_t sym_session_clear; /**< Clear a Crypto sessions private data. */ - cryptodev_asym_free_session_t asym_session_clear; + cryptodev_asym_clear_session_t asym_session_clear; /**< Clear a Crypto sessions private data. */ union { cryptodev_sym_cpu_crypto_process_t sym_cpu_process; @@ -628,16 +626,9 @@ set_sym_session_private_data(struct rte_cryptodev_sym_session *sess, } static inline void * -get_asym_session_private_data(const struct rte_cryptodev_asym_session *sess, - uint8_t driver_id) { - return sess->sess_private_data[driver_id]; -} - -static inline void -set_asym_session_private_data(struct rte_cryptodev_asym_session *sess, - uint8_t driver_id, void *private_data) +get_asym_session_private_data(struct rte_cryptodev_asym_session *sess) { - sess->sess_private_data[driver_id] = private_data; + return sess->sess_private_data; } #endif /* _CRYPTODEV_PMD_H_ */ diff --git a/lib/cryptodev/cryptodev_trace_points.c b/lib/cryptodev/cryptodev_trace_points.c index 5d58951fd5..c5bfe08b79 100644 --- a/lib/cryptodev/cryptodev_trace_points.c +++ b/lib/cryptodev/cryptodev_trace_points.c @@ -24,6 +24,9 @@ RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_queue_pair_setup, RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_sym_session_pool_create, lib.cryptodev.sym.pool.create) +RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_asym_session_pool_create, + lib.cryptodev.asym.pool.create) + RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_sym_session_create, lib.cryptodev.sym.create) @@ -39,15 +42,9 @@ RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_asym_session_free, RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_sym_session_init, lib.cryptodev.sym.init) -RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_asym_session_init, - lib.cryptodev.asym.init) - RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_sym_session_clear, lib.cryptodev.sym.clear) -RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_asym_session_clear, - lib.cryptodev.asym.clear) - RTE_TRACE_POINT_REGISTER(rte_cryptodev_trace_enqueue_burst, lib.cryptodev.enq.burst) diff --git a/lib/cryptodev/rte_cryptodev.c b/lib/cryptodev/rte_cryptodev.c index a40536c5ea..d4cdc56912 100644 --- a/lib/cryptodev/rte_cryptodev.c +++ b/lib/cryptodev/rte_cryptodev.c @@ -195,7 +195,7 @@ const char *rte_crypto_asym_op_strings[] = { }; /** - * The private data structure stored in the session mempool private data. + * The private data structure stored in the sym session mempool private data. */ struct rte_cryptodev_sym_session_pool_private_data { uint16_t nb_drivers; @@ -204,6 +204,14 @@ struct rte_cryptodev_sym_session_pool_private_data { /**< session user data will be placed after sess_data */ }; +/** + * The private data structure stored in the asym session mempool private data. + */ +struct rte_cryptodev_asym_session_pool_private_data { + uint16_t max_priv_session_sz; + /**< Size of private session data used when creating mempool */ +}; + int rte_cryptodev_get_cipher_algo_enum(enum rte_crypto_cipher_algorithm *algo_enum, const char *algo_string) @@ -1751,47 +1759,6 @@ rte_cryptodev_sym_session_init(uint8_t dev_id, return 0; } -int -rte_cryptodev_asym_session_init(uint8_t dev_id, - struct rte_cryptodev_asym_session *sess, - struct rte_crypto_asym_xform *xforms, - struct rte_mempool *mp) -{ - struct rte_cryptodev *dev; - uint8_t index; - int ret; - - if (!rte_cryptodev_is_valid_dev(dev_id)) { - CDEV_LOG_ERR("Invalid dev_id=%" PRIu8, dev_id); - return -EINVAL; - } - - dev = rte_cryptodev_pmd_get_dev(dev_id); - - if (sess == NULL || xforms == NULL || dev == NULL) - return -EINVAL; - - index = dev->driver_id; - - RTE_FUNC_PTR_OR_ERR_RET(*dev->dev_ops->asym_session_configure, - -ENOTSUP); - - if (sess->sess_private_data[index] == NULL) { - ret = dev->dev_ops->asym_session_configure(dev, - xforms, - sess, mp); - if (ret < 0) { - CDEV_LOG_ERR( - "dev_id %d failed to configure session details", - dev_id); - return ret; - } - } - - rte_cryptodev_trace_asym_session_init(dev_id, sess, xforms, mp); - return 0; -} - struct rte_mempool * rte_cryptodev_sym_session_pool_create(const char *name, uint32_t nb_elts, uint32_t elt_size, uint32_t cache_size, uint16_t user_data_size, @@ -1834,6 +1801,53 @@ rte_cryptodev_sym_session_pool_create(const char *name, uint32_t nb_elts, return mp; } +struct rte_mempool * +rte_cryptodev_asym_session_pool_create(const char *name, uint32_t nb_elts, + uint32_t cache_size, int socket_id) +{ + struct rte_mempool *mp; + struct rte_cryptodev_asym_session_pool_private_data *pool_priv; + uint32_t obj_sz, obj_sz_aligned; + uint8_t dev_id, priv_sz, max_priv_sz = 0; + + for (dev_id = 0; dev_id < RTE_CRYPTO_MAX_DEVS; dev_id++) + if (rte_cryptodev_is_valid_dev(dev_id)) { + priv_sz = rte_cryptodev_asym_get_private_session_size(dev_id); + if (priv_sz > max_priv_sz) + max_priv_sz = priv_sz; + } + if (max_priv_sz == 0) { + CDEV_LOG_INFO("Could not set max private session size\n"); + return NULL; + } + + obj_sz = rte_cryptodev_asym_get_header_session_size() + max_priv_sz; + obj_sz_aligned = RTE_ALIGN_CEIL(obj_sz, RTE_CACHE_LINE_SIZE); + + mp = rte_mempool_create(name, nb_elts, obj_sz_aligned, cache_size, + (uint32_t)(sizeof(*pool_priv)), + NULL, NULL, NULL, NULL, + socket_id, 0); + if (mp == NULL) { + CDEV_LOG_ERR("%s(name=%s) failed, rte_errno=%d\n", + __func__, name, rte_errno); + return NULL; + } + + pool_priv = rte_mempool_get_priv(mp); + if (!pool_priv) { + CDEV_LOG_ERR("%s(name=%s) failed to get private data\n", + __func__, name); + rte_mempool_free(mp); + return NULL; + } + pool_priv->max_priv_session_sz = max_priv_sz; + + rte_cryptodev_trace_asym_session_pool_create(name, nb_elts, + cache_size, mp); + return mp; +} + static unsigned int rte_cryptodev_sym_session_data_size(struct rte_cryptodev_sym_session *sess) { @@ -1895,19 +1909,44 @@ rte_cryptodev_sym_session_create(struct rte_mempool *mp) } struct rte_cryptodev_asym_session * -rte_cryptodev_asym_session_create(struct rte_mempool *mp) +rte_cryptodev_asym_session_create(uint8_t dev_id, + struct rte_crypto_asym_xform *xforms, struct rte_mempool *mp) { struct rte_cryptodev_asym_session *sess; - unsigned int session_size = + uint32_t session_priv_data_sz; + struct rte_cryptodev_asym_session_pool_private_data *pool_priv; + unsigned int session_header_size = rte_cryptodev_asym_get_header_session_size(); + struct rte_cryptodev *dev; + int ret; + + if (!rte_cryptodev_is_valid_dev(dev_id)) { + CDEV_LOG_ERR("Invalid dev_id=%" PRIu8, dev_id); + return NULL; + } + + dev = rte_cryptodev_pmd_get_dev(dev_id); + + if (dev == NULL) + return NULL; if (!mp) { CDEV_LOG_ERR("invalid mempool\n"); return NULL; } + session_priv_data_sz = rte_cryptodev_asym_get_private_session_size( + dev_id); + pool_priv = rte_mempool_get_priv(mp); + + if (pool_priv->max_priv_session_sz < session_priv_data_sz) { + CDEV_LOG_DEBUG( + "The private session data size used when creating the mempool is smaller than this device's private session data."); + return NULL; + } + /* Verify if provided mempool can hold elements big enough. */ - if (mp->elt_size < session_size) { + if (mp->elt_size < session_header_size + session_priv_data_sz) { CDEV_LOG_ERR( "mempool elements too small to hold session objects"); return NULL; @@ -1919,12 +1958,25 @@ rte_cryptodev_asym_session_create(struct rte_mempool *mp) return NULL; } - /* Clear device session pointer. - * Include the flag indicating presence of private data - */ - memset(sess, 0, session_size); + sess->driver_id = dev->driver_id; + sess->max_priv_data_sz = pool_priv->max_priv_session_sz; + + /* Clear device session pointer.*/ + memset(sess->sess_private_data, 0, session_priv_data_sz); + + RTE_FUNC_PTR_OR_ERR_RET(*dev->dev_ops->asym_session_configure, NULL); - rte_cryptodev_trace_asym_session_create(mp, sess); + if (sess->sess_private_data[0] == 0) { + ret = dev->dev_ops->asym_session_configure(dev, xforms, sess); + if (ret < 0) { + CDEV_LOG_ERR( + "dev_id %d failed to configure session details", + dev_id); + return NULL; + } + } + + rte_cryptodev_trace_asym_session_create(dev_id, xforms, mp, sess); return sess; } @@ -1959,30 +2011,6 @@ rte_cryptodev_sym_session_clear(uint8_t dev_id, return 0; } -int -rte_cryptodev_asym_session_clear(uint8_t dev_id, - struct rte_cryptodev_asym_session *sess) -{ - struct rte_cryptodev *dev; - - if (!rte_cryptodev_is_valid_dev(dev_id)) { - CDEV_LOG_ERR("Invalid dev_id=%" PRIu8, dev_id); - return -EINVAL; - } - - dev = rte_cryptodev_pmd_get_dev(dev_id); - - if (dev == NULL || sess == NULL) - return -EINVAL; - - RTE_FUNC_PTR_OR_ERR_RET(*dev->dev_ops->asym_session_clear, -ENOTSUP); - - dev->dev_ops->asym_session_clear(dev, sess); - - rte_cryptodev_trace_sym_session_clear(dev_id, sess); - return 0; -} - int rte_cryptodev_sym_session_free(struct rte_cryptodev_sym_session *sess) { @@ -2007,27 +2035,31 @@ rte_cryptodev_sym_session_free(struct rte_cryptodev_sym_session *sess) } int -rte_cryptodev_asym_session_free(struct rte_cryptodev_asym_session *sess) +rte_cryptodev_asym_session_free(uint8_t dev_id, + struct rte_cryptodev_asym_session *sess) { - uint8_t i; - void *sess_priv; struct rte_mempool *sess_mp; + struct rte_cryptodev *dev; - if (sess == NULL) + if (!rte_cryptodev_is_valid_dev(dev_id)) { + CDEV_LOG_ERR("Invalid dev_id=%" PRIu8, dev_id); return -EINVAL; - - /* Check that all device private data has been freed */ - for (i = 0; i < nb_drivers; i++) { - sess_priv = get_asym_session_private_data(sess, i); - if (sess_priv != NULL) - return -EBUSY; } + dev = rte_cryptodev_pmd_get_dev(dev_id); + + if (dev == NULL || sess == NULL) + return -EINVAL; + + RTE_FUNC_PTR_OR_ERR_RET(*dev->dev_ops->asym_session_clear, -ENOTSUP); + + dev->dev_ops->asym_session_clear(dev, sess); + /* Return session to mempool */ sess_mp = rte_mempool_from_obj(sess); rte_mempool_put(sess_mp, sess); - rte_cryptodev_trace_asym_session_free(sess); + rte_cryptodev_trace_asym_session_free(dev_id, sess); return 0; } @@ -2061,12 +2093,7 @@ rte_cryptodev_sym_get_existing_header_session_size( unsigned int rte_cryptodev_asym_get_header_session_size(void) { - /* - * Header contains pointers to the private data - * of all registered drivers, and a flag which - * indicates presence of private data - */ - return ((sizeof(void *) * nb_drivers) + sizeof(uint8_t)); + return sizeof(struct rte_cryptodev_asym_session); } unsigned int @@ -2092,7 +2119,6 @@ unsigned int rte_cryptodev_asym_get_private_session_size(uint8_t dev_id) { struct rte_cryptodev *dev; - unsigned int header_size = sizeof(void *) * nb_drivers; unsigned int priv_sess_size; if (!rte_cryptodev_is_valid_dev(dev_id)) @@ -2104,11 +2130,8 @@ rte_cryptodev_asym_get_private_session_size(uint8_t dev_id) return 0; priv_sess_size = (*dev->dev_ops->asym_session_get_size)(dev); - if (priv_sess_size < header_size) - return header_size; return priv_sess_size; - } int diff --git a/lib/cryptodev/rte_cryptodev.h b/lib/cryptodev/rte_cryptodev.h index 59ea5a54df..a0ac81eaa0 100644 --- a/lib/cryptodev/rte_cryptodev.h +++ b/lib/cryptodev/rte_cryptodev.h @@ -919,9 +919,13 @@ struct rte_cryptodev_sym_session { }; /** Cryptodev asymmetric crypto session */ -struct rte_cryptodev_asym_session { - __extension__ void *sess_private_data[0]; - /**< Private asymmetric session material */ +RTE_STD_C11 struct rte_cryptodev_asym_session { + uint8_t driver_id; + /**< Session driver ID. */ + uint16_t max_priv_data_sz; + /**< Size of private data used when creating mempool */ + uint8_t padding[5]; + uint8_t sess_private_data[0]; }; /** @@ -956,6 +960,29 @@ rte_cryptodev_sym_session_pool_create(const char *name, uint32_t nb_elts, uint32_t elt_size, uint32_t cache_size, uint16_t priv_size, int socket_id); +/** + * Create an asymmetric session mempool. + * + * @param name + * The unique mempool name. + * @param nb_elts + * The number of elements in the mempool. + * @param cache_size + * The number of per-lcore cache elements + * @param socket_id + * The *socket_id* argument is the socket identifier in the case of + * NUMA. The value can be *SOCKET_ID_ANY* if there is no NUMA + * constraint for the reserved zone. + * + * @return + * - On success return mempool + * - On failure returns NULL + */ +__rte_experimental +struct rte_mempool * +rte_cryptodev_asym_session_pool_create(const char *name, uint32_t nb_elts, + uint32_t cache_size, int socket_id); + /** * Create symmetric crypto session header (generic with no private data) * @@ -971,15 +998,19 @@ rte_cryptodev_sym_session_create(struct rte_mempool *mempool); /** * Create asymmetric crypto session header (generic with no private data) * - * @param mempool mempool to allocate asymmetric session - * objects from + * @param dev_id ID of device that we want the session to be used on + * @param xforms Asymmetric crypto transform operations to apply on flow + * processed with this session + * @param mp mempool to allocate asymmetric session + * objects from * @return * - On success return pointer to asym-session * - On failure returns NULL */ __rte_experimental struct rte_cryptodev_asym_session * -rte_cryptodev_asym_session_create(struct rte_mempool *mempool); +rte_cryptodev_asym_session_create(uint8_t dev_id, + struct rte_crypto_asym_xform *xforms, struct rte_mempool *mp); /** * Frees symmetric crypto session header, after checking that all @@ -997,20 +1028,20 @@ int rte_cryptodev_sym_session_free(struct rte_cryptodev_sym_session *sess); /** - * Frees asymmetric crypto session header, after checking that all - * the device private data has been freed, returning it - * to its original mempool. + * Clears and frees asymmetric crypto session header and private data, + * returning it to its original mempool. * + * @param dev_id ID of device that uses the asymmetric session. * @param sess Session header to be freed. * * @return * - 0 if successful. - * - -EINVAL if session is NULL. - * - -EBUSY if not all device private data has been freed. + * - -EINVAL if device is invalid or session is NULL. */ __rte_experimental int -rte_cryptodev_asym_session_free(struct rte_cryptodev_asym_session *sess); +rte_cryptodev_asym_session_free(uint8_t dev_id, + struct rte_cryptodev_asym_session *sess); /** * Fill out private data for the device id, based on its device type. @@ -1034,28 +1065,6 @@ rte_cryptodev_sym_session_init(uint8_t dev_id, struct rte_crypto_sym_xform *xforms, struct rte_mempool *mempool); -/** - * Initialize asymmetric session on a device with specific asymmetric xform - * - * @param dev_id ID of device that we want the session to be used on - * @param sess Session to be set up on a device - * @param xforms Asymmetric crypto transform operations to apply on flow - * processed with this session - * @param mempool Mempool to be used for internal allocation. - * - * @return - * - On success, zero. - * - -EINVAL if input parameters are invalid. - * - -ENOTSUP if crypto device does not support the crypto transform. - * - -ENOMEM if the private session could not be allocated. - */ -__rte_experimental -int -rte_cryptodev_asym_session_init(uint8_t dev_id, - struct rte_cryptodev_asym_session *sess, - struct rte_crypto_asym_xform *xforms, - struct rte_mempool *mempool); - /** * Frees private data for the device id, based on its device type, * returning it to its mempool. It is the application's responsibility @@ -1074,21 +1083,6 @@ int rte_cryptodev_sym_session_clear(uint8_t dev_id, struct rte_cryptodev_sym_session *sess); -/** - * Frees resources held by asymmetric session during rte_cryptodev_session_init - * - * @param dev_id ID of device that uses the asymmetric session. - * @param sess Asymmetric session setup on device using - * rte_cryptodev_session_init - * @return - * - 0 if successful. - * - -EINVAL if device is invalid or session is NULL. - */ -__rte_experimental -int -rte_cryptodev_asym_session_clear(uint8_t dev_id, - struct rte_cryptodev_asym_session *sess); - /** * Get the size of the header session, for all registered drivers excluding * the user data size. @@ -1116,7 +1110,7 @@ rte_cryptodev_sym_get_existing_header_session_size( struct rte_cryptodev_sym_session *sess); /** - * Get the size of the asymmetric session header, for all registered drivers. + * Get the size of the asymmetric session header. * * @return * Size of the asymmetric header session. diff --git a/lib/cryptodev/rte_cryptodev_trace.h b/lib/cryptodev/rte_cryptodev_trace.h index d1f4f069a3..f4e1c870df 100644 --- a/lib/cryptodev/rte_cryptodev_trace.h +++ b/lib/cryptodev/rte_cryptodev_trace.h @@ -83,10 +83,22 @@ RTE_TRACE_POINT( rte_trace_point_emit_u16(sess->user_data_sz); ) +RTE_TRACE_POINT( + rte_cryptodev_trace_asym_session_pool_create, + RTE_TRACE_POINT_ARGS(const char *name, uint32_t nb_elts, + uint32_t cache_size, void *mempool), + rte_trace_point_emit_string(name); + rte_trace_point_emit_u32(nb_elts); + rte_trace_point_emit_u32(cache_size); + rte_trace_point_emit_ptr(mempool); +) + RTE_TRACE_POINT( rte_cryptodev_trace_asym_session_create, - RTE_TRACE_POINT_ARGS(void *mempool, - struct rte_cryptodev_asym_session *sess), + RTE_TRACE_POINT_ARGS(uint8_t dev_id, void *xforms, + void *mempool, struct rte_cryptodev_asym_session *sess), + rte_trace_point_emit_u8(dev_id); + rte_trace_point_emit_ptr(xforms); rte_trace_point_emit_ptr(mempool); rte_trace_point_emit_ptr(sess); ) @@ -99,7 +111,9 @@ RTE_TRACE_POINT( RTE_TRACE_POINT( rte_cryptodev_trace_asym_session_free, - RTE_TRACE_POINT_ARGS(struct rte_cryptodev_asym_session *sess), + RTE_TRACE_POINT_ARGS(uint8_t dev_id, + struct rte_cryptodev_asym_session *sess), + rte_trace_point_emit_u8(dev_id); rte_trace_point_emit_ptr(sess); ) @@ -117,17 +131,6 @@ RTE_TRACE_POINT( rte_trace_point_emit_ptr(mempool); ) -RTE_TRACE_POINT( - rte_cryptodev_trace_asym_session_init, - RTE_TRACE_POINT_ARGS(uint8_t dev_id, - struct rte_cryptodev_asym_session *sess, void *xforms, - void *mempool), - rte_trace_point_emit_u8(dev_id); - rte_trace_point_emit_ptr(sess); - rte_trace_point_emit_ptr(xforms); - rte_trace_point_emit_ptr(mempool); -) - RTE_TRACE_POINT( rte_cryptodev_trace_sym_session_clear, RTE_TRACE_POINT_ARGS(uint8_t dev_id, void *sess), @@ -135,13 +138,6 @@ RTE_TRACE_POINT( rte_trace_point_emit_ptr(sess); ) -RTE_TRACE_POINT( - rte_cryptodev_trace_asym_session_clear, - RTE_TRACE_POINT_ARGS(uint8_t dev_id, void *sess), - rte_trace_point_emit_u8(dev_id); - rte_trace_point_emit_ptr(sess); -) - #ifdef __cplusplus } #endif diff --git a/lib/cryptodev/version.map b/lib/cryptodev/version.map index c50745fa8c..44d1aff0e2 100644 --- a/lib/cryptodev/version.map +++ b/lib/cryptodev/version.map @@ -55,10 +55,8 @@ EXPERIMENTAL { rte_cryptodev_asym_get_header_session_size; rte_cryptodev_asym_get_private_session_size; rte_cryptodev_asym_get_xform_enum; - rte_cryptodev_asym_session_clear; rte_cryptodev_asym_session_create; rte_cryptodev_asym_session_free; - rte_cryptodev_asym_session_init; rte_cryptodev_asym_xform_capability_check_modlen; rte_cryptodev_asym_xform_capability_check_optype; rte_cryptodev_sym_cpu_crypto_process; @@ -81,9 +79,7 @@ EXPERIMENTAL { __rte_cryptodev_trace_sym_session_free; __rte_cryptodev_trace_asym_session_free; __rte_cryptodev_trace_sym_session_init; - __rte_cryptodev_trace_asym_session_init; __rte_cryptodev_trace_sym_session_clear; - __rte_cryptodev_trace_asym_session_clear; __rte_cryptodev_trace_dequeue_burst; __rte_cryptodev_trace_enqueue_burst; @@ -104,6 +100,9 @@ EXPERIMENTAL { rte_cryptodev_remove_deq_callback; rte_cryptodev_remove_enq_callback; + # added 22.03 + rte_cryptodev_asym_session_pool_create; + __rte_cryptodev_trace_asym_session_pool_create; }; INTERNAL { -- 2.25.1