From: Ajit Khaparde <ajit.khaparde@broadcom.com>
To: dpdk-dev <dev@dpdk.org>
Cc: Ferruh Yigit <ferruh.yigit@intel.com>,
Randy Schacher <stuart.schacher@broadcom.com>,
Peter Spreadborough <peter.spreadborough@broadcom.com>,
Farah Smith <farah.smith@broadcom.com>
Subject: Re: [dpdk-dev] [PATCH] net/bnxt: remove EEM system memory support
Date: Wed, 29 Jul 2020 07:01:48 -0700 [thread overview]
Message-ID: <CACZ4nhsrCp=E3KJ2a-gHqhWe1ufTiswiBtJrZEggSGoMVpOX5A@mail.gmail.com> (raw)
In-Reply-To: <20200729004256.46924-1-ajit.khaparde@broadcom.com>
On Tue, Jul 28, 2020 at 5:43 PM Ajit Khaparde <ajit.khaparde@broadcom.com>
wrote:
> From: Randy Schacher <stuart.schacher@broadcom.com>
>
> Remove the memory management scheme for Extended Exact Match
> using system memory. Using host memory scheme instead which
> was the default anyway.
>
> Fixes: b2da02480cb7 ("net/bnxt: support EEM system memory")
>
> Signed-off-by: Randy Schacher <stuart.schacher@broadcom.com>
> Signed-off-by: Ajit Khaparde <ajit.khaparde@broadcom.com>
> Reviewed-by: Peter Spreadborough <peter.spreadborough@broadcom.com>
> Reviewed-by: Farah Smith <farah.smith@broadcom.com>
>
Patch applied to dpdk-next-net-brcm. Thanks
> ---
> config/common_base | 1 -
> drivers/net/bnxt/Makefile | 3 -
> drivers/net/bnxt/bnxt_hwrm.c | 27 --
> drivers/net/bnxt/meson.build | 1 -
> drivers/net/bnxt/tf_core/Makefile | 4 -
> drivers/net/bnxt/tf_core/tf_device.c | 4 -
> drivers/net/bnxt/tf_core/tf_em.h | 22 +-
> drivers/net/bnxt/tf_core/tf_em_common.c | 60 ---
> drivers/net/bnxt/tf_core/tf_em_system.c | 521 ------------------------
> drivers/net/bnxt/tf_core/tf_tbl.h | 7 -
> drivers/net/bnxt/tf_core/tfp.c | 12 -
> 11 files changed, 2 insertions(+), 660 deletions(-)
> delete mode 100644 drivers/net/bnxt/tf_core/tf_em_system.c
>
> diff --git a/config/common_base b/config/common_base
> index f76585f16..971351a09 100644
> --- a/config/common_base
> +++ b/config/common_base
> @@ -220,7 +220,6 @@ CONFIG_RTE_LIBRTE_BNX2X_DEBUG_PERIODIC=n
> # Compile burst-oriented Broadcom BNXT PMD driver
> #
> CONFIG_RTE_LIBRTE_BNXT_PMD=y
> -CONFIG_RTE_LIBRTE_BNXT_PMD_SYSTEM=n
>
> #
> # Compile burst-oriented Chelsio Terminator (CXGBE) PMD
> diff --git a/drivers/net/bnxt/Makefile b/drivers/net/bnxt/Makefile
> index 2c4cdd1c4..0c5b74918 100644
> --- a/drivers/net/bnxt/Makefile
> +++ b/drivers/net/bnxt/Makefile
> @@ -52,9 +52,6 @@ CFLAGS += -I$(SRCDIR) -I$(SRCDIR)/tf_ulp
> -I$(SRCDIR)/tf_core -I$(SRCDIR)/hcapi
> include $(SRCDIR)/tf_ulp/Makefile
> include $(SRCDIR)/tf_core/Makefile
> include $(SRCDIR)/hcapi/Makefile
> -ifeq ($(CONFIG_RTE_LIBRTE_BNXT_PMD_SYSTEM), y)
> -CFLAGS += -DTF_USE_SYSTEM_MEM
> -endif
> endif
>
> #
> diff --git a/drivers/net/bnxt/bnxt_hwrm.c b/drivers/net/bnxt/bnxt_hwrm.c
> index f5f0dfe73..8296d1d44 100644
> --- a/drivers/net/bnxt/bnxt_hwrm.c
> +++ b/drivers/net/bnxt/bnxt_hwrm.c
> @@ -5534,30 +5534,3 @@ int bnxt_hwrm_cfa_vfr_free(struct bnxt *bp,
> uint16_t vf_idx)
> PMD_DRV_LOG(DEBUG, "VFR %d freed\n", vf_idx);
> return rc;
> }
> -
> -#ifdef RTE_LIBRTE_BNXT_PMD_SYSTEM
> -int
> -bnxt_hwrm_oem_cmd(struct bnxt *bp, uint32_t entry_num)
> -{
> - struct hwrm_oem_cmd_input req = {0};
> - struct hwrm_oem_cmd_output *resp = bp->hwrm_cmd_resp_addr;
> - struct bnxt_dmabuf_info oem_data;
> - int rc = 0;
> -
> - HWRM_PREP(&req, HWRM_OEM_CMD, BNXT_USE_CHIMP_MB);
> - req.IANA = 0x14e4;
> -
> - memset(&oem_data, 0, sizeof(struct bnxt_dmabuf_info));
> - oem_data.entry_num = (entry_num);
> - memcpy(&req.oem_data[0], &oem_data, sizeof(struct
> bnxt_dmabuf_info));
> -
> - rc = bnxt_hwrm_send_message(bp, &req, sizeof(req),
> BNXT_USE_CHIMP_MB);
> - HWRM_CHECK_RESULT();
> -
> - bp->dmabuf.entry_num = entry_num;
> -
> - HWRM_UNLOCK();
> -
> - return rc;
> -}
> -#endif /* RTE_LIBRTE_BNXT_PMD_SYSTEM */
> diff --git a/drivers/net/bnxt/meson.build b/drivers/net/bnxt/meson.build
> index 190469e29..a89d1f97c 100644
> --- a/drivers/net/bnxt/meson.build
> +++ b/drivers/net/bnxt/meson.build
> @@ -29,7 +29,6 @@ sources = files('bnxt_cpr.c',
> 'tf_core/rand.c',
> 'tf_core/stack.c',
> 'tf_core/tf_em_common.c',
> - 'tf_core/tf_em_host.c',
> 'tf_core/tf_em_internal.c',
> 'tf_core/tf_rm.c',
> 'tf_core/tf_tbl.c',
> diff --git a/drivers/net/bnxt/tf_core/Makefile
> b/drivers/net/bnxt/tf_core/Makefile
> index cf6aaec6c..84840366a 100644
> --- a/drivers/net/bnxt/tf_core/Makefile
> +++ b/drivers/net/bnxt/tf_core/Makefile
> @@ -16,11 +16,7 @@ SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_msg.c
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_tbl.c
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_em_common.c
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_em_internal.c
> -ifeq ($(CONFIG_RTE_LIBRTE_BNXT_PMD_SYSTEM), n)
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_em_host.c
> -else
> -SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD_SYSTEM) += tf_core/tf_em_system.c
> -endif
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_session.c
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_device.c
> SRCS-$(CONFIG_RTE_LIBRTE_BNXT_PMD) += tf_core/tf_device_p4.c
> diff --git a/drivers/net/bnxt/tf_core/tf_device.c
> b/drivers/net/bnxt/tf_core/tf_device.c
> index f08f7eba7..112944095 100644
> --- a/drivers/net/bnxt/tf_core/tf_device.c
> +++ b/drivers/net/bnxt/tf_core/tf_device.c
> @@ -92,11 +92,7 @@ tf_dev_bind_p4(struct tf *tfp,
> em_cfg.num_elements = TF_EM_TBL_TYPE_MAX;
> em_cfg.cfg = tf_em_ext_p4;
> em_cfg.resources = resources;
> -#ifdef TF_USE_SYSTEM_MEM
> - em_cfg.mem_type = TF_EEM_MEM_TYPE_SYSTEM;
> -#else
> em_cfg.mem_type = TF_EEM_MEM_TYPE_HOST;
> -#endif
> rc = tf_em_ext_common_bind(tfp, &em_cfg);
> if (rc) {
> TFP_DRV_LOG(ERR,
> diff --git a/drivers/net/bnxt/tf_core/tf_em.h
> b/drivers/net/bnxt/tf_core/tf_em.h
> index ae2e64dd7..2a67e4760 100644
> --- a/drivers/net/bnxt/tf_core/tf_em.h
> +++ b/drivers/net/bnxt/tf_core/tf_em.h
> @@ -9,15 +9,6 @@
> #include "tf_core.h"
> #include "tf_session.h"
>
> -#ifdef TF_USE_SYSTEM_MEM
> -/**
> - * Select EEM sysmem mmap export to be done at init
> - * or on the first write to EEM.
> - */
> -#define TF_EM_SYSMEM_DELAY_EXPORT 1
> -#else
> -#define TF_EM_SYSMEM_DELAY_EXPORT 0
> -#endif
>
> #define SUPPORT_CFA_HW_P4 1
> #define SUPPORT_CFA_HW_P58 0
> @@ -85,13 +76,8 @@
> /*
> * System memory always uses 4K pages
> */
> -#ifdef TF_USE_SYSTEM_MEM
> -#define TF_EM_PAGE_SIZE (1 << TF_EM_PAGE_SIZE_4K)
> -#define TF_EM_PAGE_ALIGNMENT (1 << TF_EM_PAGE_SIZE_4K)
> -#else
> #define TF_EM_PAGE_SIZE (1 << TF_EM_PAGE_SHIFT)
> #define TF_EM_PAGE_ALIGNMENT (1 << TF_EM_PAGE_SHIFT)
> -#endif
>
> /*
> * Used to build GFID:
> @@ -176,13 +162,9 @@ struct tf_em_cfg_parms {
> *
> * @ref tf_em_ext_common_unbind
> *
> - * @ref tf_em_ext_host_alloc
> - *
> - * @ref tf_em_ext_host_free
> - *
> - * @ref tf_em_ext_system_alloc
> + * @ref tf_em_ext_alloc
> *
> - * @ref tf_em_ext_system_free
> + * @ref tf_em_ext_free
> *
> * @ref tf_em_ext_common_free
> *
> diff --git a/drivers/net/bnxt/tf_core/tf_em_common.c
> b/drivers/net/bnxt/tf_core/tf_em_common.c
> index 0037fce42..0d8b90871 100644
> --- a/drivers/net/bnxt/tf_core/tf_em_common.c
> +++ b/drivers/net/bnxt/tf_core/tf_em_common.c
> @@ -783,34 +783,6 @@ tf_insert_eem_entry(struct tf_tbl_scope_cb
> *tbl_scope_cb,
> uint64_t big_hash;
> int rc;
>
> -#if (TF_EM_SYSMEM_DELAY_EXPORT == 1)
> - if (!tbl_scope_cb->valid) {
> - rc = offload_system_mmap(tbl_scope_cb);
> -
> - if (rc) {
> - struct tf_rm_free_parms fparms = { 0 };
> - uint32_t rm_tbl_scope_id;
> -
> - TFP_DRV_LOG(ERR,
> - "System alloc mmap failed\n");
> -
> - rm_tbl_scope_id =
> - tf_tbl_scope_adjust(parms->tbl_scope_id);
> -
> - if (rm_tbl_scope_id == TF_TBL_SCOPE_INVALID)
> - return -EINVAL;
> -
> - /* Free Table control block */
> - fparms.rm_db = eem_db[TF_DIR_RX];
> - fparms.db_index = TF_EM_TBL_TYPE_TBL_SCOPE;
> - fparms.index = parms->tbl_scope_id;
> - tf_rm_free(&fparms);
> - return -EINVAL;
> - }
> -
> - tbl_scope_cb->valid = true;
> - }
> -#endif
> /* Get mask to use on hash */
> mask =
> tf_em_get_key_mask(tbl_scope_cb->em_ctx_info[parms->dir].em_tables[TF_KEY0_TABLE].num_entries);
>
> @@ -1128,38 +1100,6 @@ int tf_tbl_ext_common_set(struct tf *tfp,
> return -EINVAL;
> }
>
> -#if (TF_EM_SYSMEM_DELAY_EXPORT == 1)
> - if (!tbl_scope_cb->valid) {
> - rc = offload_system_mmap(tbl_scope_cb);
> -
> - if (rc) {
> - struct tf_rm_free_parms fparms = { 0 };
> - uint32_t rm_tbl_scope_id;
> -
> - /* TODO: support allocation of table scope from
> - * min in HCAPI RM. For now call adjust function
> - * on value obtained from RM.
> - */
> - rm_tbl_scope_id =
> - tf_tbl_scope_adjust(parms->tbl_scope_id);
> -
> - if (rm_tbl_scope_id == TF_TBL_SCOPE_INVALID)
> - return -EINVAL;
> -
> - TFP_DRV_LOG(ERR,
> - "System alloc mmap failed\n");
> - /* Free Table control block */
> - fparms.rm_db = eem_db[TF_DIR_RX];
> - fparms.db_index = TF_EM_TBL_TYPE_TBL_SCOPE;
> - fparms.index = rm_tbl_scope_id;
> - tf_rm_free(&fparms);
> - return -EINVAL;
> - }
> -
> - tbl_scope_cb->valid = true;
> - }
> -#endif
> -
> op.opcode = HCAPI_CFA_HWOPS_PUT;
> key_tbl.base0 =
> (uint8_t
> *)&tbl_scope_cb->em_ctx_info[parms->dir].em_tables[TF_RECORD_TABLE];
> diff --git a/drivers/net/bnxt/tf_core/tf_em_system.c
> b/drivers/net/bnxt/tf_core/tf_em_system.c
> deleted file mode 100644
> index 32ee1ee69..000000000
> --- a/drivers/net/bnxt/tf_core/tf_em_system.c
> +++ /dev/null
> @@ -1,521 +0,0 @@
> -/* SPDX-License-Identifier: BSD-3-Clause
> - * Copyright(c) 2019-2020 Broadcom
> - * All rights reserved.
> - */
> -
> -#include <string.h>
> -#include <sys/types.h>
> -#include <sys/stat.h>
> -#include <fcntl.h>
> -#include <stdbool.h>
> -#include <math.h>
> -#include <sys/param.h>
> -#include <sys/mman.h>
> -#include <sys/ioctl.h>
> -#include <unistd.h>
> -
> -#include <rte_common.h>
> -#include <rte_errno.h>
> -#include <rte_log.h>
> -
> -#include "tf_core.h"
> -#include "tf_util.h"
> -#include "tf_common.h"
> -#include "tf_em.h"
> -#include "tf_em_common.h"
> -#include "tf_msg.h"
> -#include "tfp.h"
> -#include "lookup3.h"
> -#include "tf_ext_flow_handle.h"
> -
> -#include "bnxt.h"
> -
> -enum tf_em_req_type {
> - TF_EM_BNXT_LFC_CFA_EEM_DMABUF_EXPORT_REQ = 5,
> -};
> -
> -struct tf_em_bnxt_lfc_req_hdr {
> - uint32_t ver;
> - uint32_t bus;
> - uint32_t devfn;
> - enum tf_em_req_type req_type;
> -};
> -
> -struct tf_em_bnxt_lfc_cfa_eem_std_hdr {
> - uint16_t version;
> - uint16_t size;
> - uint32_t flags;
> - #define TF_EM_BNXT_LFC_EEM_CFG_PRIMARY_FUNC (1 << 0)
> -};
> -
> -struct tf_em_bnxt_lfc_dmabuf_fd {
> - int fd[TF_DIR_MAX][TF_MAX_TABLE];
> -};
> -
> -#ifndef __user
> -#define __user
> -#endif
> -
> -struct tf_em_bnxt_lfc_cfa_eem_dmabuf_export_req {
> - struct tf_em_bnxt_lfc_cfa_eem_std_hdr std;
> - uint8_t dir;
> - uint32_t flags;
> - void __user *dma_fd;
> -};
> -
> -struct tf_em_bnxt_lfc_req {
> - struct tf_em_bnxt_lfc_req_hdr hdr;
> - union {
> - struct tf_em_bnxt_lfc_cfa_eem_dmabuf_export_req
> - eem_dmabuf_export_req;
> - uint64_t hreq;
> - } req;
> -};
> -
> -#define TF_EEM_BNXT_LFC_IOCTL_MAGIC 0x98
> -#define BNXT_LFC_REQ \
> - _IOW(TF_EEM_BNXT_LFC_IOCTL_MAGIC, 1, struct tf_em_bnxt_lfc_req)
> -
> -/**
> - * EM DBs.
> - */
> -extern void *eem_db[TF_DIR_MAX];
> -
> -extern struct tf_tbl_scope_cb tbl_scopes[TF_NUM_TBL_SCOPE];
> -
> -static void
> -tf_em_dmabuf_mem_unmap(struct hcapi_cfa_em_table *tbl)
> -{
> - struct hcapi_cfa_em_page_tbl *tp;
> - int level;
> - uint32_t page_no, pg_count;
> -
> - for (level = (tbl->num_lvl - 1); level < tbl->num_lvl; level++) {
> - tp = &tbl->pg_tbl[level];
> -
> - pg_count = tbl->page_cnt[level];
> - for (page_no = 0; page_no < pg_count; page_no++) {
> - if (tp->pg_va_tbl != NULL &&
> - tp->pg_va_tbl[page_no] != NULL &&
> - tp->pg_size != 0) {
> - (void)munmap(tp->pg_va_tbl[page_no],
> - tp->pg_size);
> - }
> - }
> -
> - tfp_free((void *)tp->pg_va_tbl);
> - tfp_free((void *)tp->pg_pa_tbl);
> - }
> -}
> -
> -/**
> - * Unregisters EM Ctx in Firmware
> - *
> - * [in] tfp
> - * Pointer to a TruFlow handle
> - *
> - * [in] tbl_scope_cb
> - * Pointer to a table scope control block
> - *
> - * [in] dir
> - * Receive or transmit direction
> - */
> -static void
> -tf_em_ctx_unreg(struct tf_tbl_scope_cb *tbl_scope_cb,
> - int dir)
> -{
> - struct hcapi_cfa_em_ctx_mem_info *ctxp =
> - &tbl_scope_cb->em_ctx_info[dir];
> - struct hcapi_cfa_em_table *tbl;
> - int i;
> -
> - for (i = TF_KEY0_TABLE; i < TF_MAX_TABLE; i++) {
> - tbl = &ctxp->em_tables[i];
> - tf_em_dmabuf_mem_unmap(tbl);
> - }
> -}
> -
> -static int tf_export_tbl_scope(int lfc_fd,
> - int *fd,
> - int bus,
> - int devfn)
> -{
> - struct tf_em_bnxt_lfc_req tf_lfc_req;
> - struct tf_em_bnxt_lfc_dmabuf_fd *dma_fd;
> - struct tfp_calloc_parms mparms;
> - int rc;
> -
> - memset(&tf_lfc_req, 0, sizeof(struct tf_em_bnxt_lfc_req));
> - tf_lfc_req.hdr.ver = 1;
> - tf_lfc_req.hdr.bus = bus;
> - tf_lfc_req.hdr.devfn = devfn;
> - tf_lfc_req.hdr.req_type = TF_EM_BNXT_LFC_CFA_EEM_DMABUF_EXPORT_REQ;
> - tf_lfc_req.req.eem_dmabuf_export_req.flags = O_ACCMODE;
> - tf_lfc_req.req.eem_dmabuf_export_req.std.version = 1;
> -
> - mparms.nitems = 1;
> - mparms.size = sizeof(struct tf_em_bnxt_lfc_dmabuf_fd);
> - mparms.alignment = 0;
> - tfp_calloc(&mparms);
> - dma_fd = (struct tf_em_bnxt_lfc_dmabuf_fd *)mparms.mem_va;
> - tf_lfc_req.req.eem_dmabuf_export_req.dma_fd = dma_fd;
> -
> - rc = ioctl(lfc_fd, BNXT_LFC_REQ, &tf_lfc_req);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "EXT EEM export chanel_fd %d, rc=%d\n",
> - lfc_fd,
> - rc);
> - tfp_free(dma_fd);
> - return rc;
> - }
> -
> - memcpy(fd, dma_fd->fd, sizeof(dma_fd->fd));
> - tfp_free(dma_fd);
> -
> - return rc;
> -}
> -
> -static int
> -tf_em_dmabuf_mem_map(struct hcapi_cfa_em_table *tbl,
> - int dmabuf_fd)
> -{
> - struct hcapi_cfa_em_page_tbl *tp;
> - int level;
> - uint32_t page_no;
> - uint32_t pg_count;
> - uint32_t offset;
> - struct tfp_calloc_parms parms;
> -
> - for (level = (tbl->num_lvl - 1); level < tbl->num_lvl; level++) {
> - tp = &tbl->pg_tbl[level];
> -
> - pg_count = tbl->page_cnt[level];
> - offset = 0;
> -
> - parms.nitems = pg_count;
> - parms.size = sizeof(void *);
> - parms.alignment = 0;
> -
> - if ((tfp_calloc(&parms)) != 0)
> - return -ENOMEM;
> -
> - tp->pg_va_tbl = parms.mem_va;
> - parms.nitems = pg_count;
> - parms.size = sizeof(void *);
> - parms.alignment = 0;
> -
> - if ((tfp_calloc(&parms)) != 0) {
> - tfp_free((void *)tp->pg_va_tbl);
> - return -ENOMEM;
> - }
> -
> - tp->pg_pa_tbl = parms.mem_va;
> - tp->pg_count = 0;
> - tp->pg_size = TF_EM_PAGE_SIZE;
> -
> - for (page_no = 0; page_no < pg_count; page_no++) {
> - tp->pg_va_tbl[page_no] = mmap(NULL,
> - TF_EM_PAGE_SIZE,
> - PROT_READ |
> PROT_WRITE,
> - MAP_SHARED,
> - dmabuf_fd,
> - offset);
> - if (tp->pg_va_tbl[page_no] == (void *)-1) {
> - TFP_DRV_LOG(ERR,
> - "MMap memory error. level:%d page:%d pg_count:%d - %s\n",
> - level,
> - page_no,
> - pg_count,
> - strerror(errno));
> - return -ENOMEM;
> - }
> - offset += tp->pg_size;
> - tp->pg_count++;
> - }
> - }
> -
> - return 0;
> -}
> -
> -static int tf_mmap_tbl_scope(struct tf_tbl_scope_cb *tbl_scope_cb,
> - enum tf_dir dir,
> - int tbl_type,
> - int dmabuf_fd)
> -{
> - struct hcapi_cfa_em_table *tbl;
> -
> - if (tbl_type == TF_EFC_TABLE)
> - return 0;
> -
> - tbl = &tbl_scope_cb->em_ctx_info[dir].em_tables[tbl_type];
> - return tf_em_dmabuf_mem_map(tbl, dmabuf_fd);
> -}
> -
> -#define TF_LFC_DEVICE "/dev/bnxt_lfc"
> -
> -static int
> -tf_prepare_dmabuf_bnxt_lfc_device(struct tf_tbl_scope_cb *tbl_scope_cb)
> -{
> - int lfc_fd;
> -
> - lfc_fd = open(TF_LFC_DEVICE, O_RDWR);
> - if (!lfc_fd) {
> - TFP_DRV_LOG(ERR,
> - "EEM: open %s device error\n",
> - TF_LFC_DEVICE);
> - return -ENOENT;
> - }
> -
> - tbl_scope_cb->lfc_fd = lfc_fd;
> -
> - return 0;
> -}
> -
> -int offload_system_mmap(struct tf_tbl_scope_cb *tbl_scope_cb)
> -{
> - int rc;
> - int dmabuf_fd;
> - enum tf_dir dir;
> - enum hcapi_cfa_em_table_type tbl_type;
> -
> - rc = tf_prepare_dmabuf_bnxt_lfc_device(tbl_scope_cb);
> - if (rc) {
> - TFP_DRV_LOG(ERR, "EEM: Prepare bnxt_lfc channel failed\n");
> - return rc;
> - }
> -
> - rc = tf_export_tbl_scope(tbl_scope_cb->lfc_fd,
> - (int *)tbl_scope_cb->fd,
> - tbl_scope_cb->bus,
> - tbl_scope_cb->devfn);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "export dmabuf fd failed\n");
> - return rc;
> - }
> -
> - tbl_scope_cb->valid = true;
> -
> - for (dir = 0; dir < TF_DIR_MAX; dir++) {
> - for (tbl_type = TF_KEY0_TABLE; tbl_type <
> - TF_MAX_TABLE; tbl_type++) {
> - if (tbl_type == TF_EFC_TABLE)
> - continue;
> -
> - dmabuf_fd = tbl_scope_cb->fd[(dir ? 0 :
> 1)][tbl_type];
> - rc = tf_mmap_tbl_scope(tbl_scope_cb,
> - dir,
> - tbl_type,
> - dmabuf_fd);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "dir:%d tbl:%d mmap failed rc
> %d\n",
> - dir,
> - tbl_type,
> - rc);
> - break;
> - }
> - }
> - }
> - return 0;
> -}
> -
> -static int
> -tf_destroy_dmabuf_bnxt_lfc_device(struct tf_tbl_scope_cb *tbl_scope_cb)
> -{
> - close(tbl_scope_cb->lfc_fd);
> -
> - return 0;
> -}
> -
> -static int
> -tf_dmabuf_alloc(struct tf *tfp, struct tf_tbl_scope_cb *tbl_scope_cb)
> -{
> - int rc;
> -
> - rc = tfp_msg_hwrm_oem_cmd(tfp,
> -
> tbl_scope_cb->em_ctx_info[TF_DIR_RX].em_tables[TF_KEY0_TABLE].num_entries);
> - if (rc)
> - PMD_DRV_LOG(ERR, "EEM: Failed to prepare system memory
> rc:%d\n",
> - rc);
> -
> - return 0;
> -}
> -
> -static int
> -tf_dmabuf_free(struct tf *tfp, struct tf_tbl_scope_cb *tbl_scope_cb)
> -{
> - int rc;
> -
> - rc = tfp_msg_hwrm_oem_cmd(tfp, 0);
> - if (rc)
> - TFP_DRV_LOG(ERR, "EEM: Failed to cleanup system memory\n");
> -
> - tf_destroy_dmabuf_bnxt_lfc_device(tbl_scope_cb);
> -
> - return 0;
> -}
> -
> -int
> -tf_em_ext_alloc(struct tf *tfp,
> - struct tf_alloc_tbl_scope_parms *parms)
> -{
> - int rc;
> - struct tf_session *tfs;
> - struct tf_tbl_scope_cb *tbl_scope_cb;
> - struct tf_free_tbl_scope_parms free_parms;
> - int dir;
> - int i;
> - struct hcapi_cfa_em_table *em_tables;
> -
> - TF_CHECK_PARMS2(tfp, parms);
> -
> - /* Retrieve the session information */
> - rc = tf_session_get_session(tfp, &tfs);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "Failed to lookup session, rc:%s\n",
> - strerror(-rc));
> - return rc;
> - }
> -
> - rc = tf_tbl_scope_alloc(&parms->tbl_scope_id);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "Failed to allocate table scope\n");
> - return rc;
> - }
> -
> - tbl_scope_cb = &tbl_scopes[parms->tbl_scope_id];
> - tbl_scope_cb->index = parms->tbl_scope_id;
> - tbl_scope_cb->tbl_scope_id = parms->tbl_scope_id;
> - tbl_scope_cb->bus = tfs->session_id.internal.bus;
> - tbl_scope_cb->devfn = tfs->session_id.internal.device;
> -
> - for (dir = 0; dir < TF_DIR_MAX; dir++) {
> - rc = tf_msg_em_qcaps(tfp,
> - dir,
> - &tbl_scope_cb->em_caps[dir]);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "EEM: Unable to query for EEM
> capability,"
> - " rc:%s\n",
> - strerror(-rc));
> - goto cleanup;
> - }
> - }
> -
> - /*
> - * Validate and setup table sizes
> - */
> - if (tf_em_validate_num_entries(tbl_scope_cb, parms))
> - goto cleanup;
> -
> - rc = tf_dmabuf_alloc(tfp, tbl_scope_cb);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "System DMA buff alloc failed\n");
> - return -EIO;
> - }
> -
> - for (dir = 0; dir < TF_DIR_MAX; dir++) {
> - for (i = TF_KEY0_TABLE; i < TF_MAX_TABLE; i++) {
> - if (i == TF_EFC_TABLE)
> - continue;
> -
> - em_tables =
> -
> &tbl_scope_cb->em_ctx_info[dir].em_tables[i];
> -
> - rc = tf_em_size_table(em_tables, TF_EM_PAGE_SIZE);
> - if (rc) {
> - TFP_DRV_LOG(ERR, "Size table failed\n");
> - goto cleanup;
> - }
> - }
> -
> - em_tables = tbl_scope_cb->em_ctx_info[dir].em_tables;
> - rc = tf_create_tbl_pool_external(dir,
> - tbl_scope_cb,
> -
> em_tables[TF_RECORD_TABLE].num_entries,
> -
> em_tables[TF_RECORD_TABLE].entry_size);
> -
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "%s TBL: Unable to allocate idx pools
> %s\n",
> - tf_dir_2_str(dir),
> - strerror(-rc));
> - goto cleanup_full;
> - }
> - }
> -
> -#if (TF_EM_SYSMEM_DELAY_EXPORT == 0)
> - rc = offload_system_mmap(tbl_scope_cb);
> -
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "System alloc mmap failed\n");
> - goto cleanup_full;
> - }
> -#endif
> -
> - return rc;
> -
> -cleanup_full:
> - free_parms.tbl_scope_id = parms->tbl_scope_id;
> - tf_em_ext_free(tfp, &free_parms);
> - return -EINVAL;
> -
> -cleanup:
> - /* Free Table control block */
> - tf_tbl_scope_free(parms->tbl_scope_id);
> - return -EINVAL;
> -}
> -
> -int
> -tf_em_ext_free(struct tf *tfp,
> - struct tf_free_tbl_scope_parms *parms)
> -{
> - int rc;
> - struct tf_session *tfs;
> - struct tf_tbl_scope_cb *tbl_scope_cb;
> - int dir;
> -
> - TF_CHECK_PARMS2(tfp, parms);
> -
> - /* Retrieve the session information */
> - rc = tf_session_get_session(tfp, &tfs);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "Failed to lookup session, rc:%s\n",
> - strerror(-rc));
> - return rc;
> - }
> -
> - tbl_scope_cb = &tbl_scopes[parms->tbl_scope_id];
> -
> - rc = tf_tbl_scope_free(parms->tbl_scope_id);
> - if (rc) {
> - TFP_DRV_LOG(ERR,
> - "Failed to free table scope\n");
> - }
> -
> - for (dir = 0; dir < TF_DIR_MAX; dir++) {
> - /* Free associated external pools
> - */
> - tf_destroy_tbl_pool_external(dir,
> - tbl_scope_cb);
> -
> - /* Unmap memory */
> - tf_em_ctx_unreg(tbl_scope_cb, dir);
> -
> - tf_msg_em_op(tfp,
> - dir,
> - HWRM_TF_EXT_EM_OP_INPUT_OP_EXT_EM_DISABLE);
> - }
> -
> - tf_dmabuf_free(tfp, tbl_scope_cb);
> - tbl_scope_cb->valid = false;
> -
> - return rc;
> -}
> diff --git a/drivers/net/bnxt/tf_core/tf_tbl.h
> b/drivers/net/bnxt/tf_core/tf_tbl.h
> index 930fcc324..2a5d24c94 100644
> --- a/drivers/net/bnxt/tf_core/tf_tbl.h
> +++ b/drivers/net/bnxt/tf_core/tf_tbl.h
> @@ -38,13 +38,6 @@ struct tf_em_caps {
> */
> struct tf_tbl_scope_cb {
> uint32_t tbl_scope_id;
> -#ifdef TF_USE_SYSTEM_MEM
> - int lfc_fd;
> - uint32_t bus;
> - uint32_t devfn;
> - int fd[TF_DIR_MAX][TF_MAX_TABLE];
> - bool valid;
> -#endif
> int index;
> struct hcapi_cfa_em_ctx_mem_info em_ctx_info[TF_DIR_MAX];
> struct tf_em_caps em_caps[TF_DIR_MAX];
> diff --git a/drivers/net/bnxt/tf_core/tfp.c
> b/drivers/net/bnxt/tf_core/tfp.c
> index 3eade3127..426a182a9 100644
> --- a/drivers/net/bnxt/tf_core/tfp.c
> +++ b/drivers/net/bnxt/tf_core/tfp.c
> @@ -87,18 +87,6 @@ tfp_send_msg_tunneled(struct tf *tfp,
> return rc;
> }
>
> -#ifdef TF_USE_SYSTEM_MEM
> -int
> -tfp_msg_hwrm_oem_cmd(struct tf *tfp,
> - uint32_t max_flows)
> -{
> - return bnxt_hwrm_oem_cmd(container_of(tfp,
> - struct bnxt,
> - tfp),
> - max_flows);
> -}
> -#endif /* TF_USE_SYSTEM_MEM */
> -
> /**
> * Allocates zero'ed memory from the heap.
> *
> --
> 2.21.1 (Apple Git-122.3)
>
>
next prev parent reply other threads:[~2020-07-29 14:02 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2020-07-29 0:42 Ajit Khaparde
2020-07-29 14:01 ` Ajit Khaparde [this message]
2020-07-29 16:24 ` Ferruh Yigit
2020-07-29 21:24 ` Ajit Khaparde
2020-07-29 21:57 ` Ferruh Yigit
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='CACZ4nhsrCp=E3KJ2a-gHqhWe1ufTiswiBtJrZEggSGoMVpOX5A@mail.gmail.com' \
--to=ajit.khaparde@broadcom.com \
--cc=dev@dpdk.org \
--cc=farah.smith@broadcom.com \
--cc=ferruh.yigit@intel.com \
--cc=peter.spreadborough@broadcom.com \
--cc=stuart.schacher@broadcom.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).