From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8841245BD6; Fri, 25 Oct 2024 14:30:03 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 71C03402DA; Fri, 25 Oct 2024 14:30:03 +0200 (CEST) Received: from mx0b-0016f401.pphosted.com (mx0a-0016f401.pphosted.com [67.231.148.174]) by mails.dpdk.org (Postfix) with ESMTP id 2EFC8402F0 for ; Fri, 25 Oct 2024 14:29:56 +0200 (CEST) Received: from pps.filterd (m0045849.ppops.net [127.0.0.1]) by mx0a-0016f401.pphosted.com (8.18.1.2/8.18.1.2) with ESMTP id 49PAjYUI026507; Fri, 25 Oct 2024 05:29:55 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=marvell.com; h= cc:content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to; s=pfpt0220; bh=4 +hmDkK9tUtQjgDx0K00R4ndU2wG9KARqAwMEJbTmnw=; b=DW5aGHA6+IQ/HU5eg 3DvY88W8HhlHLw5i7WqMl1gyjog8YEHFtiH8ZoQ8kII5w4+6WYVuMzTIUWEDZsz4 m7Gkn3CV0EGmwuRJd3umRduC9OyfGFGuxQ1G+lXJaIljqwSZO6cs3S5pl54eb9OG kz7frEUekrJCTBQMJuFjIw6Nx+a4yHc0coHHRcuoixvVezap5ARRhN+CCrld3rWh 1OBDnmbFM9ZYh2C+G8yeg3aYV1ZJXzdBxHy0CJlBBwOTMKTJbyonZkkUFkBYQ7bZ 6SQ7sA5AErInWudnmFNxxEgiQ36aSDGEnnb6eDRBPGX+jIyU94b0H2HRcmnlJZWN /xBhQ== Received: from dc5-exch05.marvell.com ([199.233.59.128]) by mx0a-0016f401.pphosted.com (PPS) with ESMTPS id 42g76e8ep5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 25 Oct 2024 05:29:55 -0700 (PDT) Received: from DC5-EXCH05.marvell.com (10.69.176.209) by DC5-EXCH05.marvell.com (10.69.176.209) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.1544.4; Fri, 25 Oct 2024 05:29:54 -0700 Received: from maili.marvell.com (10.69.176.80) by DC5-EXCH05.marvell.com (10.69.176.209) with Microsoft SMTP Server id 15.2.1544.4 via Frontend Transport; Fri, 25 Oct 2024 05:29:54 -0700 Received: from MININT-80QBFE8.corp.innovium.com (MININT-80QBFE8.marvell.com [10.28.164.106]) by maili.marvell.com (Postfix) with ESMTP id 934523F7090; Fri, 25 Oct 2024 05:29:49 -0700 (PDT) From: To: , , , Nithin Dabilpuram , Kiran Kumar K , Sunil Kumar Kori , Satha Rao , Harman Kalra , Ankur Dwivedi , Anoob Joseph , Tejasree Kondoj , "Pavan Nikhilesh" , Shijith Thotton CC: Subject: [PATCH v6 02/22] common/cnxk: implement SSO HW info Date: Fri, 25 Oct 2024 17:59:24 +0530 Message-ID: <20241025122944.27745-2-pbhagavatula@marvell.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20241025122944.27745-1-pbhagavatula@marvell.com> References: <20241025081353.25759-1-pbhagavatula@marvell.com> <20241025122944.27745-1-pbhagavatula@marvell.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Proofpoint-ORIG-GUID: wJl2p-v6BHc3n2pSXjkkqmhVDBEPLjx0 X-Proofpoint-GUID: wJl2p-v6BHc3n2pSXjkkqmhVDBEPLjx0 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.293,Aquarius:18.0.1039,Hydra:6.0.680,FMLib:17.12.60.29 definitions=2024-09-06_09,2024-09-06_01,2024-09-02_01 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Pavan Nikhilesh Add SSO HW info mbox to get hardware capabilities, and reuse them instead of depending on hardcoded values. Remove redundant includes. Signed-off-by: Pavan Nikhilesh --- drivers/common/cnxk/roc_mbox.h | 28 ++++++++++ drivers/common/cnxk/roc_sso.c | 58 ++++++++++++++++++--- drivers/common/cnxk/roc_sso.h | 9 ++-- drivers/common/cnxk/version.map | 1 + drivers/crypto/cnxk/cn10k_cryptodev_ops.c | 5 +- drivers/crypto/cnxk/cn9k_cryptodev_ops.c | 9 +--- drivers/event/cnxk/cn10k_eventdev.c | 1 + drivers/event/cnxk/cn10k_eventdev.h | 1 + drivers/event/cnxk/cn10k_worker.c | 6 ++- drivers/event/cnxk/cnxk_eventdev.c | 4 +- drivers/event/cnxk/cnxk_eventdev.h | 3 -- drivers/event/cnxk/cnxk_eventdev_selftest.c | 2 + drivers/event/cnxk/cnxk_eventdev_stats.c | 2 + drivers/event/cnxk/cnxk_tim_evdev.c | 2 +- drivers/event/cnxk/cnxk_tim_worker.c | 2 + drivers/event/cnxk/cnxk_worker.c | 4 +- 16 files changed, 103 insertions(+), 34 deletions(-) diff --git a/drivers/common/cnxk/roc_mbox.h b/drivers/common/cnxk/roc_mbox.h index dd65946e9e..63139b5517 100644 --- a/drivers/common/cnxk/roc_mbox.h +++ b/drivers/common/cnxk/roc_mbox.h @@ -147,6 +147,7 @@ struct mbox_msghdr { msg_rsp) \ M(SSO_GRP_STASH_CONFIG, 0x614, sso_grp_stash_config, \ sso_grp_stash_cfg, msg_rsp) \ + M(SSO_GET_HW_INFO, 0x617, sso_get_hw_info, msg_req, sso_hw_info) \ /* TIM mbox IDs (range 0x800 - 0x9FF) */ \ M(TIM_LF_ALLOC, 0x800, tim_lf_alloc, tim_lf_alloc_req, \ tim_lf_alloc_rsp) \ @@ -2119,6 +2120,33 @@ struct ssow_chng_mship { uint16_t __io hwgrps[MAX_RVU_BLKLF_CNT]; /* Array of hwgrps. */ }; +struct sso_feat_info { + uint8_t __io hw_flr : 1; + uint8_t __io hw_prefetch : 1; + uint8_t __io sw_prefetch : 1; + uint8_t __io lsw : 1; + uint8_t __io fwd_grp : 1; + uint8_t __io eva_present : 1; + uint8_t __io no_nsched : 1; + uint8_t __io tag_cfg : 1; + uint8_t __io gwc_per_core; + uint16_t __io hws; + uint16_t __io hwgrps; + uint16_t __io hwgrps_per_pf; + uint16_t __io iue; + uint16_t __io taq_lines; + uint16_t __io taq_ent_per_line; + uint16_t __io xaq_buf_size; + uint16_t __io xaq_wq_entries; + uint32_t __io eva_ctx_per_hwgrp; + uint64_t __io rsvd[2]; +}; + +struct sso_hw_info { + struct mbox_msghdr hdr; + struct sso_feat_info feat; +}; + struct sso_hw_setconfig { struct mbox_msghdr hdr; uint32_t __io npa_aura_id; diff --git a/drivers/common/cnxk/roc_sso.c b/drivers/common/cnxk/roc_sso.c index 2e3b134bfc..8a219b985b 100644 --- a/drivers/common/cnxk/roc_sso.c +++ b/drivers/common/cnxk/roc_sso.c @@ -191,7 +191,7 @@ sso_rsrc_get(struct roc_sso *roc_sso) goto exit; } - roc_sso->max_hwgrp = rsrc_cnt->sso; + roc_sso->max_hwgrp = PLT_MIN(rsrc_cnt->sso, roc_sso->feat.hwgrps_per_pf); roc_sso->max_hws = rsrc_cnt->ssow; rc = 0; @@ -200,6 +200,37 @@ sso_rsrc_get(struct roc_sso *roc_sso) return rc; } +static int +sso_hw_info_get(struct roc_sso *roc_sso) +{ + struct dev *dev = &roc_sso_to_sso_priv(roc_sso)->dev; + struct mbox *mbox = mbox_get(dev->mbox); + struct sso_hw_info *rsp; + int rc; + + mbox_alloc_msg_sso_get_hw_info(mbox); + rc = mbox_process_msg(mbox, (void **)&rsp); + if (rc && rc != MBOX_MSG_INVALID) { + plt_err("Failed to get SSO HW info"); + rc = -EIO; + goto exit; + } + + if (rc == MBOX_MSG_INVALID) { + roc_sso->feat.hwgrps_per_pf = ROC_SSO_MAX_HWGRP_PER_PF; + } else { + mbox_memcpy(&roc_sso->feat, &rsp->feat, sizeof(roc_sso->feat)); + + if (!roc_sso->feat.hwgrps_per_pf) + roc_sso->feat.hwgrps_per_pf = ROC_SSO_MAX_HWGRP_PER_PF; + } + + rc = 0; +exit: + mbox_put(mbox); + return rc; +} + void sso_hws_link_modify(uint8_t hws, uintptr_t base, struct plt_bitmap *bmp, uint16_t hwgrp[], uint16_t n, uint8_t set, uint16_t enable) @@ -319,6 +350,12 @@ roc_sso_hwgrp_base_get(struct roc_sso *roc_sso, uint16_t hwgrp) return dev->bar2 + (RVU_BLOCK_ADDR_SSO << 20 | hwgrp << 12); } +uint16_t +roc_sso_pf_func_get(void) +{ + return idev_sso_pffunc_get(); +} + uint64_t roc_sso_ns_to_gw(uint64_t base, uint64_t ns) { @@ -670,9 +707,8 @@ roc_sso_hwgrp_init_xaq_aura(struct roc_sso *roc_sso, uint32_t nb_xae) struct dev *dev = &sso->dev; int rc; - rc = sso_hwgrp_init_xaq_aura(dev, &roc_sso->xaq, nb_xae, - roc_sso->xae_waes, roc_sso->xaq_buf_size, - roc_sso->nb_hwgrp); + rc = sso_hwgrp_init_xaq_aura(dev, &roc_sso->xaq, nb_xae, roc_sso->feat.xaq_wq_entries, + roc_sso->feat.xaq_buf_size, roc_sso->nb_hwgrp); return rc; } @@ -953,9 +989,11 @@ roc_sso_rsrc_init(struct roc_sso *roc_sso, uint8_t nb_hws, uint16_t nb_hwgrp, ui goto hwgrp_alloc_fail; } - roc_sso->xaq_buf_size = rsp_hwgrp->xaq_buf_size; - roc_sso->xae_waes = rsp_hwgrp->xaq_wq_entries; - roc_sso->iue = rsp_hwgrp->in_unit_entries; + if (!roc_sso->feat.xaq_buf_size || !roc_sso->feat.xaq_wq_entries || !roc_sso->feat.iue) { + roc_sso->feat.xaq_buf_size = rsp_hwgrp->xaq_buf_size; + roc_sso->feat.xaq_wq_entries = rsp_hwgrp->xaq_wq_entries; + roc_sso->feat.iue = rsp_hwgrp->in_unit_entries; + } rc = sso_msix_fill(roc_sso, nb_hws, nb_hwgrp); if (rc < 0) { @@ -1059,6 +1097,12 @@ roc_sso_dev_init(struct roc_sso *roc_sso) goto fail; } + rc = sso_hw_info_get(roc_sso); + if (rc < 0) { + plt_err("Failed to get SSO HW info"); + goto fail; + } + rc = sso_rsrc_get(roc_sso); if (rc < 0) { plt_err("Failed to get SSO resources"); diff --git a/drivers/common/cnxk/roc_sso.h b/drivers/common/cnxk/roc_sso.h index 4ac901762e..021db22c86 100644 --- a/drivers/common/cnxk/roc_sso.h +++ b/drivers/common/cnxk/roc_sso.h @@ -8,7 +8,7 @@ #include "hw/ssow.h" #define ROC_SSO_AW_PER_LMT_LINE_LOG2 3 -#define ROC_SSO_XAE_PER_XAQ 352 +#define ROC_SSO_MAX_HWGRP_PER_PF 256 struct roc_sso_hwgrp_qos { uint16_t hwgrp; @@ -57,9 +57,7 @@ struct roc_sso { uintptr_t lmt_base; struct roc_sso_xaq_data xaq; /* HW Const. */ - uint32_t xae_waes; - uint32_t xaq_buf_size; - uint32_t iue; + struct sso_feat_info feat; /* Private data. */ #define ROC_SSO_MEM_SZ (16 * 1024) uint8_t reserved[ROC_SSO_MEM_SZ] __plt_cache_aligned; @@ -103,6 +101,9 @@ int __roc_api roc_sso_hwgrp_stash_config(struct roc_sso *roc_sso, void __roc_api roc_sso_hws_gwc_invalidate(struct roc_sso *roc_sso, uint8_t *hws, uint8_t nb_hws); +/* Utility function */ +uint16_t __roc_api roc_sso_pf_func_get(void); + /* Debug */ void __roc_api roc_sso_dump(struct roc_sso *roc_sso, uint8_t nb_hws, uint16_t hwgrp, FILE *f); diff --git a/drivers/common/cnxk/version.map b/drivers/common/cnxk/version.map index 877333b80c..de748ac409 100644 --- a/drivers/common/cnxk/version.map +++ b/drivers/common/cnxk/version.map @@ -516,6 +516,7 @@ INTERNAL { roc_sso_hws_gwc_invalidate; roc_sso_hws_unlink; roc_sso_ns_to_gw; + roc_sso_pf_func_get; roc_sso_rsrc_fini; roc_sso_rsrc_init; roc_tim_fini; diff --git a/drivers/crypto/cnxk/cn10k_cryptodev_ops.c b/drivers/crypto/cnxk/cn10k_cryptodev_ops.c index 88ea032bcb..dbebc5aef1 100644 --- a/drivers/crypto/cnxk/cn10k_cryptodev_ops.c +++ b/drivers/crypto/cnxk/cn10k_cryptodev_ops.c @@ -11,10 +11,7 @@ #include -#include "roc_cpt.h" -#include "roc_idev.h" -#include "roc_sso.h" -#include "roc_sso_dp.h" +#include "roc_api.h" #include "cn10k_cryptodev.h" #include "cn10k_cryptodev_event_dp.h" diff --git a/drivers/crypto/cnxk/cn9k_cryptodev_ops.c b/drivers/crypto/cnxk/cn9k_cryptodev_ops.c index ae00af5019..8d10bc9f9b 100644 --- a/drivers/crypto/cnxk/cn9k_cryptodev_ops.c +++ b/drivers/crypto/cnxk/cn9k_cryptodev_ops.c @@ -8,14 +8,7 @@ #include #include -#include "roc_cpt.h" -#if defined(__aarch64__) -#include "roc_io.h" -#else -#include "roc_io_generic.h" -#endif -#include "roc_sso.h" -#include "roc_sso_dp.h" +#include "roc_api.h" #include "cn9k_cryptodev.h" #include "cn9k_cryptodev_ops.h" diff --git a/drivers/event/cnxk/cn10k_eventdev.c b/drivers/event/cnxk/cn10k_eventdev.c index 4a2c88c8c6..c7af0fac11 100644 --- a/drivers/event/cnxk/cn10k_eventdev.c +++ b/drivers/event/cnxk/cn10k_eventdev.c @@ -64,6 +64,7 @@ cn10k_sso_init_hws_mem(void *arg, uint8_t port_id) ws->gw_wdata = cn10k_sso_gw_mode_wdata(dev); ws->gw_rdata = SSO_TT_EMPTY << 32; ws->lmt_base = dev->sso.lmt_base; + ws->xae_waes = dev->sso.feat.xaq_wq_entries; return ws; } diff --git a/drivers/event/cnxk/cn10k_eventdev.h b/drivers/event/cnxk/cn10k_eventdev.h index b8395aa314..4f0eab8acb 100644 --- a/drivers/event/cnxk/cn10k_eventdev.h +++ b/drivers/event/cnxk/cn10k_eventdev.h @@ -23,6 +23,7 @@ struct __rte_cache_aligned cn10k_sso_hws { int64_t __rte_atomic *fc_cache_space; uintptr_t aw_lmt; uintptr_t grp_base; + uint16_t xae_waes; int32_t xaq_lmt; /* Tx Fastpath data */ alignas(RTE_CACHE_LINE_SIZE) uintptr_t lmt_base; diff --git a/drivers/event/cnxk/cn10k_worker.c b/drivers/event/cnxk/cn10k_worker.c index 06ad7437d5..80077ec8a1 100644 --- a/drivers/event/cnxk/cn10k_worker.c +++ b/drivers/event/cnxk/cn10k_worker.c @@ -2,6 +2,8 @@ * Copyright(C) 2021 Marvell. */ +#include "roc_api.h" + #include "cn10k_worker.h" #include "cnxk_eventdev.h" #include "cnxk_worker.h" @@ -81,7 +83,7 @@ static inline int32_t sso_read_xaq_space(struct cn10k_sso_hws *ws) { return (ws->xaq_lmt - rte_atomic_load_explicit(ws->fc_mem, rte_memory_order_relaxed)) * - ROC_SSO_XAE_PER_XAQ; + ws->xae_waes; } static inline void @@ -394,7 +396,7 @@ cn10k_sso_hws_enq_new_burst(void *port, const struct rte_event ev[], int32_t space; /* Do a common back-pressure check and return */ - space = sso_read_xaq_space(ws) - ROC_SSO_XAE_PER_XAQ; + space = sso_read_xaq_space(ws) - ws->xae_waes; if (space <= 0) return 0; nb_events = space < nb_events ? space : nb_events; diff --git a/drivers/event/cnxk/cnxk_eventdev.c b/drivers/event/cnxk/cnxk_eventdev.c index 84a55511a3..ab7420ab79 100644 --- a/drivers/event/cnxk/cnxk_eventdev.c +++ b/drivers/event/cnxk/cnxk_eventdev.c @@ -2,7 +2,7 @@ * Copyright(C) 2021 Marvell. */ -#include "roc_npa.h" +#include "roc_api.h" #include "cnxk_eventdev.h" #include "cnxk_eventdev_dp.h" @@ -47,7 +47,7 @@ cnxk_sso_xaq_allocate(struct cnxk_sso_evdev *dev) if (dev->num_events > 0) xae_cnt = dev->num_events; else - xae_cnt = dev->sso.iue; + xae_cnt = dev->sso.feat.iue; if (dev->xae_cnt) xae_cnt += dev->xae_cnt; diff --git a/drivers/event/cnxk/cnxk_eventdev.h b/drivers/event/cnxk/cnxk_eventdev.h index 982bbb6a9b..904a9b022d 100644 --- a/drivers/event/cnxk/cnxk_eventdev.h +++ b/drivers/event/cnxk/cnxk_eventdev.h @@ -21,9 +21,6 @@ #include "cnxk_eventdev_dp.h" -#include "roc_platform.h" -#include "roc_sso.h" - #include "cnxk_tim_evdev.h" #define CNXK_SSO_XAE_CNT "xae_cnt" diff --git a/drivers/event/cnxk/cnxk_eventdev_selftest.c b/drivers/event/cnxk/cnxk_eventdev_selftest.c index a4615c1356..311de3d92b 100644 --- a/drivers/event/cnxk/cnxk_eventdev_selftest.c +++ b/drivers/event/cnxk/cnxk_eventdev_selftest.c @@ -18,6 +18,8 @@ #include #include +#include "roc_api.h" + #include "cnxk_eventdev.h" #include "cnxk_eventdev_dp.h" diff --git a/drivers/event/cnxk/cnxk_eventdev_stats.c b/drivers/event/cnxk/cnxk_eventdev_stats.c index a8a87a06e4..6dea91aedf 100644 --- a/drivers/event/cnxk/cnxk_eventdev_stats.c +++ b/drivers/event/cnxk/cnxk_eventdev_stats.c @@ -2,6 +2,8 @@ * Copyright(C) 2021 Marvell. */ +#include "roc_api.h" + #include "cnxk_eventdev.h" #include "cnxk_eventdev_dp.h" diff --git a/drivers/event/cnxk/cnxk_tim_evdev.c b/drivers/event/cnxk/cnxk_tim_evdev.c index 74a6da5070..27a4dfb490 100644 --- a/drivers/event/cnxk/cnxk_tim_evdev.c +++ b/drivers/event/cnxk/cnxk_tim_evdev.c @@ -4,7 +4,7 @@ #include -#include "roc_npa.h" +#include "roc_api.h" #include "cnxk_eventdev.h" #include "cnxk_tim_evdev.h" diff --git a/drivers/event/cnxk/cnxk_tim_worker.c b/drivers/event/cnxk/cnxk_tim_worker.c index db31f91818..5e96f6f188 100644 --- a/drivers/event/cnxk/cnxk_tim_worker.c +++ b/drivers/event/cnxk/cnxk_tim_worker.c @@ -2,6 +2,8 @@ * Copyright(C) 2021 Marvell. */ +#include "roc_api.h" + #include "cnxk_tim_evdev.h" #include "cnxk_tim_worker.h" diff --git a/drivers/event/cnxk/cnxk_worker.c b/drivers/event/cnxk/cnxk_worker.c index 60876abcff..a07c9185d9 100644 --- a/drivers/event/cnxk/cnxk_worker.c +++ b/drivers/event/cnxk/cnxk_worker.c @@ -6,9 +6,7 @@ #include #include -#include "roc_platform.h" -#include "roc_sso.h" -#include "roc_sso_dp.h" +#include "roc_api.h" struct pwords { uint64_t u[5]; -- 2.25.1