From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 79074A0353; Thu, 24 Feb 2022 04:12:17 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id CD5EF426D4; Thu, 24 Feb 2022 04:11:24 +0100 (CET) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2057.outbound.protection.outlook.com [40.107.237.57]) by mails.dpdk.org (Postfix) with ESMTP id CE40D411E6 for ; Thu, 24 Feb 2022 04:11:19 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=l3SSBxhwBITh9Kv5iWKt1BvuCbRqhDO29YC0cxoAG1ZbcfgL5PlTmqggdvEo7uDrCAyWb+X3PcMcA2TOyjZjyFvduqSDRe8FPao8TSwGCUqke3T2vR2FXAZRp+ZMYBIQbfW19XS3pEa+msnAF74n8hUVxd22sWIK3EhO4kFFLt4Qf75CsrgCLY/yHN5zLWe/BqTk2nADY2O9f/TJLUWjL2zOp+t/bsE/1RSCRTrtz+mlKtjF2T5iR9UsRGO+T6hx7ZixO2yNNpo2+yK7wl7ai6ZEZBFUPsD+hT5Numt0GjjIFIT61a7B9hSMX6ANN7mymej7EUI0UQH0lmgZrYAAoA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Wysg6Bo6K3N4117kW1BkMC1PGkE01UesRceqG8wZxg4=; b=Kew/nvGBvI4MpDeSzv9Bk1YA9gqJtx7J4hhvNZwLZ3zvcWaj5meCgVbj047EvFkE0cB+G40k1rNlG+WjqYST/nBk2MAHAzVbhOhqG04QBs0dHHTw5lAJrIKna5mjAUmL3H7okgzcoGUxt/XkKYgdgWPTWMBPs9anznTxpmfQViVK5YvCTVYvqWlDJcFUood7pHq1hSqoNCCSEjMnEJAxAY1rJo72W3zSG0Q9VqPdKWEoA5esvsZGBMArDwjMv6jZo+SNPEElGSeeylya+HBIRZCdBEwsPGamk7FTcLzd7ujwLVxnq8QGhcNIqVEKfUiXQs+rYHDjEEQC/MG6liTY9g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 12.22.5.235) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Wysg6Bo6K3N4117kW1BkMC1PGkE01UesRceqG8wZxg4=; b=fNWwMkMaEy8r1IIEVFAiL/LK8z9xfasyjgtR2QM+fHOY0DbwXHISHUQQHFfCYxvmfl6yq+bxsdMP/tRU/F/WVFIUVkrTYmPrIITRn5m5A8RLblROf9aiwxWuh9OUv32h5DjFwd0ApD3PT2Om3z1GH+MMiWcVRItexuSqn0FqTRt/1jy4NnjXZQRJoIiuBEaa1oyhwQfyiqs9YeQZ1pi2xAKYcDVLx6ixFoz0gUFL0qtvO9yThkXGJsivmzuBSvNlCfChEnSDGKa75/f0ORXleBbqdPO/Y+rjtO1nSR7eu7gvb01Et/2EtXliCyw8mqYz3CevGX7+36lsckN6/lDJvg== Received: from DM6PR05CA0055.namprd05.prod.outlook.com (2603:10b6:5:335::24) by BL0PR12MB2450.namprd12.prod.outlook.com (2603:10b6:207:4d::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4995.16; Thu, 24 Feb 2022 03:11:17 +0000 Received: from DM6NAM11FT035.eop-nam11.prod.protection.outlook.com (2603:10b6:5:335:cafe::7f) by DM6PR05CA0055.outlook.office365.com (2603:10b6:5:335::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5017.23 via Frontend Transport; Thu, 24 Feb 2022 03:11:17 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 12.22.5.235) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 12.22.5.235 as permitted sender) receiver=protection.outlook.com; client-ip=12.22.5.235; helo=mail.nvidia.com; Received: from mail.nvidia.com (12.22.5.235) by DM6NAM11FT035.mail.protection.outlook.com (10.13.172.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.5017.22 via Frontend Transport; Thu, 24 Feb 2022 03:11:17 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by DRHQMAIL107.nvidia.com (10.27.9.16) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Thu, 24 Feb 2022 03:10:53 +0000 Received: from nvidia.com (10.126.231.35) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.9; Wed, 23 Feb 2022 19:10:50 -0800 From: Suanming Mou To: , CC: , , Subject: [PATCH v3 04/14] net/mlx5: add port flow configuration Date: Thu, 24 Feb 2022 05:10:19 +0200 Message-ID: <20220224031029.14049-5-suanmingm@nvidia.com> X-Mailer: git-send-email 2.18.1 In-Reply-To: <20220224031029.14049-1-suanmingm@nvidia.com> References: <20220210162926.20436-1-suanmingm@nvidia.com> <20220224031029.14049-1-suanmingm@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [10.126.231.35] X-ClientProxiedBy: rnnvmail201.nvidia.com (10.129.68.8) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 0c5f9ca1-ca88-46a8-ebf0-08d9f74352c6 X-MS-TrafficTypeDiagnostic: BL0PR12MB2450:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: RCkio6q30XgrcpU9wmBWiD2m1ogefo8qYR2dcFpQxyU1+DYe9l5TG+ThlD7IgiQ4dCX+zD7TkgwRGPJ5xfR97GfWFycqTOYnrgtSG2hNhpTG4yl7ToExyw4/taXpNRa7JP+NI3EmrocUy8rR/q1iB8JjsWxO00FCppfzHE944+PoMCRj+BGB/0WaNfQwntuMgD6zKIDlaKRW71iDpRf23wfSNaALhttAR9TuvvKNZZWbKgZNgcMpgki+SCsXkSO3XnquWABNp21Fo2aEWWGVmPm3KN8SMW6wIXzIgm85CC+ARrbtFqRIvVJy3iwyQsXJO95rqVNclW9jd+7bZkHOZqUNm2gUpnYlwOoZGjpOrUb93purBWjsR8QgNQ/QlIBEMm+qHG73WfnzObLjkL5yIbINahvO2bT8lU62JnNSfT0RieD9KabvBMVKXl98xc+x1VzNWxmcO00xEf+t7gWIFjxnTC7kcAM9Aci1jze+JcNLXo1n+9lw1utiD32dg8W+ylpot8kVNU6rl+tBs4Ajl01WXsjgIIcK2xmtJ4XKwRfROiAIF4kEjLtR0sLFvjf2+N6I2zovt5bYwGlwy0Wna5kGAq89tFXRmj1+P2L62j3ZdtAQRGUfsR54uq5aQir20dsMlCPc2khoCxCoZGqim8MEMl1ccMIeC1xV6wzmKbTWHewiqFaWvJeeUG02VtnyoWWxzaKQXXChQBkL+t2rZA9cvZAkc7by6B/c7f+oPpI= X-Forefront-Antispam-Report: CIP:12.22.5.235; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:mail.nvidia.com; PTR:InfoNoRecords; CAT:NONE; SFS:(13230001)(4636009)(46966006)(40470700004)(36840700001)(316002)(70206006)(70586007)(55016003)(6636002)(356005)(4326008)(8676002)(110136005)(36756003)(47076005)(36860700001)(83380400001)(81166007)(54906003)(186003)(336012)(82310400004)(30864003)(508600001)(8936002)(1076003)(5660300002)(16526019)(2616005)(6286002)(426003)(26005)(6666004)(7696005)(2906002)(40460700003)(86362001)(21314003)(36900700001); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 24 Feb 2022 03:11:17.2023 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 0c5f9ca1-ca88-46a8-ebf0-08d9f74352c6 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[12.22.5.235]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: DM6NAM11FT035.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR12MB2450 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org The hardware steering is backend to support rte_flow_async API in mlx5 PMD. The port configuration function creates the queues and needed flow management resources. The PMD layer configuration function allocates the queues' context and per-queue job descriptor pool. The job descriptor pool size is equal to the queue size, and the job descriptors will be popped from pool with LIFO strategy to convey the flow information during flow insertion/destruction. Then, while polling the queued operation result, the flow information will be extracted from the job descriptor and the descriptor will be pushed back to the LIFO pool. The commit creates the flow port queues and the job descriptor pools. Signed-off-by: Suanming Mou Acked-by: Viacheslav Ovsiienko --- drivers/net/mlx5/mlx5.c | 3 + drivers/net/mlx5/mlx5.h | 30 +++++- drivers/net/mlx5/mlx5_flow.c | 86 +++++++++++++++++ drivers/net/mlx5/mlx5_flow.h | 15 +++ drivers/net/mlx5/mlx5_flow_hw.c | 159 ++++++++++++++++++++++++++++++++ 5 files changed, 292 insertions(+), 1 deletion(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index f49d30c05c..0079aa83c1 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -1820,6 +1820,9 @@ mlx5_dev_close(struct rte_eth_dev *dev) /* Free the eCPRI flex parser resource. */ mlx5_flex_parser_ecpri_release(dev); mlx5_flex_item_port_cleanup(dev); +#if defined(HAVE_IBV_FLOW_DV_SUPPORT) || !defined(HAVE_INFINIBAND_VERBS_H) + flow_hw_resource_release(dev); +#endif if (priv->rxq_privs != NULL) { /* XXX race condition if mlx5_rx_burst() is still running. */ rte_delay_us_sleep(1000); diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index b2259fc1fb..f0edf7f559 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -33,7 +33,9 @@ #include "mlx5_utils.h" #include "mlx5_os.h" #include "mlx5_autoconf.h" - +#if defined(HAVE_IBV_FLOW_DV_SUPPORT) || !defined(HAVE_INFINIBAND_VERBS_H) +#include "mlx5_dr.h" +#endif #define MLX5_SH(dev) (((struct mlx5_priv *)(dev)->data->dev_private)->sh) @@ -320,6 +322,26 @@ struct mlx5_lb_ctx { uint16_t refcnt; /* Reference count for representors. */ }; +/* HW steering queue job descriptor type. */ +enum { + MLX5_HW_Q_JOB_TYPE_CREATE, /* Flow create job type. */ + MLX5_HW_Q_JOB_TYPE_DESTROY, /* Flow destroy job type. */ +}; + +/* HW steering flow management job descriptor. */ +struct mlx5_hw_q_job { + uint32_t type; /* Job type. */ + struct rte_flow *flow; /* Flow attached to the job. */ + void *user_data; /* Job user data. */ +}; + +/* HW steering job descriptor LIFO pool. */ +struct mlx5_hw_q { + uint32_t job_idx; /* Free job index. */ + uint32_t size; /* LIFO size. */ + struct mlx5_hw_q_job **job; /* LIFO header. */ +} __rte_cache_aligned; + #define MLX5_COUNTERS_PER_POOL 512 #define MLX5_MAX_PENDING_QUERIES 4 #define MLX5_CNT_CONTAINER_RESIZE 64 @@ -1479,6 +1501,12 @@ struct mlx5_priv { struct mlx5_flex_item flex_item[MLX5_PORT_FLEX_ITEM_NUM]; /* Flex items have been created on the port. */ uint32_t flex_item_map; /* Map of allocated flex item elements. */ +#if defined(HAVE_IBV_FLOW_DV_SUPPORT) || !defined(HAVE_INFINIBAND_VERBS_H) + struct mlx5dr_context *dr_ctx; /**< HW steering DR context. */ + uint32_t nb_queue; /* HW steering queue number. */ + /* HW steering queue polling mechanism job descriptor LIFO. */ + struct mlx5_hw_q *hw_q; +#endif }; #define PORT_ID(priv) ((priv)->dev_data->port_id) diff --git a/drivers/net/mlx5/mlx5_flow.c b/drivers/net/mlx5/mlx5_flow.c index cdb40c0756..554ebc804d 100644 --- a/drivers/net/mlx5/mlx5_flow.c +++ b/drivers/net/mlx5/mlx5_flow.c @@ -805,6 +805,17 @@ static int mlx5_flow_flex_item_release(struct rte_eth_dev *dev, const struct rte_flow_item_flex_handle *handle, struct rte_flow_error *error); +static int +mlx5_flow_info_get(struct rte_eth_dev *dev, + struct rte_flow_port_info *port_info, + struct rte_flow_queue_info *queue_info, + struct rte_flow_error *error); +static int +mlx5_flow_port_configure(struct rte_eth_dev *dev, + const struct rte_flow_port_attr *port_attr, + uint16_t nb_queue, + const struct rte_flow_queue_attr *queue_attr[], + struct rte_flow_error *err); static const struct rte_flow_ops mlx5_flow_ops = { .validate = mlx5_flow_validate, @@ -826,6 +837,8 @@ static const struct rte_flow_ops mlx5_flow_ops = { .get_restore_info = mlx5_flow_tunnel_get_restore_info, .flex_item_create = mlx5_flow_flex_item_create, .flex_item_release = mlx5_flow_flex_item_release, + .info_get = mlx5_flow_info_get, + .configure = mlx5_flow_port_configure, }; /* Tunnel information. */ @@ -3429,6 +3442,12 @@ flow_get_drv_type(struct rte_eth_dev *dev, const struct rte_flow_attr *attr) if (type != MLX5_FLOW_TYPE_MAX) return type; + /* + * Currently when dv_flow_en == 2, only HW steering engine is + * supported. New engines can also be chosen here if ready. + */ + if (priv->sh->config.dv_flow_en == 2) + return MLX5_FLOW_TYPE_HW; /* If no OS specific type - continue with DV/VERBS selection */ if (attr->transfer && priv->sh->config.dv_esw_en) type = MLX5_FLOW_TYPE_DV; @@ -7838,6 +7857,73 @@ mlx5_counter_query(struct rte_eth_dev *dev, uint32_t cnt, return -ENOTSUP; } +/** + * Get information about HWS pre-configurable resources. + * + * @param[in] dev + * Pointer to the rte_eth_dev structure. + * @param[out] port_info + * Pointer to port information. + * @param[out] queue_info + * Pointer to queue information. + * @param[out] error + * Pointer to error structure. + * + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +mlx5_flow_info_get(struct rte_eth_dev *dev, + struct rte_flow_port_info *port_info, + struct rte_flow_queue_info *queue_info, + struct rte_flow_error *error) +{ + const struct mlx5_flow_driver_ops *fops; + + if (flow_get_drv_type(dev, NULL) != MLX5_FLOW_TYPE_HW) + return rte_flow_error_set(error, ENOTSUP, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, + NULL, + "info get with incorrect steering mode"); + fops = flow_get_drv_ops(MLX5_FLOW_TYPE_HW); + return fops->info_get(dev, port_info, queue_info, error); +} + +/** + * Configure port HWS resources. + * + * @param[in] dev + * Pointer to the rte_eth_dev structure. + * @param[in] port_attr + * Port configuration attributes. + * @param[in] nb_queue + * Number of queue. + * @param[in] queue_attr + * Array that holds attributes for each flow queue. + * @param[out] error + * Pointer to error structure. + * + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +mlx5_flow_port_configure(struct rte_eth_dev *dev, + const struct rte_flow_port_attr *port_attr, + uint16_t nb_queue, + const struct rte_flow_queue_attr *queue_attr[], + struct rte_flow_error *error) +{ + const struct mlx5_flow_driver_ops *fops; + + if (flow_get_drv_type(dev, NULL) != MLX5_FLOW_TYPE_HW) + return rte_flow_error_set(error, ENOTSUP, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, + NULL, + "port configure with incorrect steering mode"); + fops = flow_get_drv_ops(MLX5_FLOW_TYPE_HW); + return fops->configure(dev, port_attr, nb_queue, queue_attr, error); +} + /** * Allocate a new memory for the counter values wrapped by all the needed * management. diff --git a/drivers/net/mlx5/mlx5_flow.h b/drivers/net/mlx5/mlx5_flow.h index b70ef0c1b8..9f0dc4bde7 100644 --- a/drivers/net/mlx5/mlx5_flow.h +++ b/drivers/net/mlx5/mlx5_flow.h @@ -1257,6 +1257,17 @@ typedef int (*mlx5_flow_item_update_t) const struct rte_flow_item_flex_handle *handle, const struct rte_flow_item_flex_conf *conf, struct rte_flow_error *error); +typedef int (*mlx5_flow_info_get_t) + (struct rte_eth_dev *dev, + struct rte_flow_port_info *port_info, + struct rte_flow_queue_info *queue_info, + struct rte_flow_error *error); +typedef int (*mlx5_flow_port_configure_t) + (struct rte_eth_dev *dev, + const struct rte_flow_port_attr *port_attr, + uint16_t nb_queue, + const struct rte_flow_queue_attr *queue_attr[], + struct rte_flow_error *err); struct mlx5_flow_driver_ops { mlx5_flow_validate_t validate; @@ -1295,6 +1306,8 @@ struct mlx5_flow_driver_ops { mlx5_flow_item_create_t item_create; mlx5_flow_item_release_t item_release; mlx5_flow_item_update_t item_update; + mlx5_flow_info_get_t info_get; + mlx5_flow_port_configure_t configure; }; /* mlx5_flow.c */ @@ -1762,4 +1775,6 @@ const struct mlx5_flow_tunnel * mlx5_get_tof(const struct rte_flow_item *items, const struct rte_flow_action *actions, enum mlx5_tof_rule_type *rule_type); +void +flow_hw_resource_release(struct rte_eth_dev *dev); #endif /* RTE_PMD_MLX5_FLOW_H_ */ diff --git a/drivers/net/mlx5/mlx5_flow_hw.c b/drivers/net/mlx5/mlx5_flow_hw.c index 729d5914a8..e5b2ae91d8 100644 --- a/drivers/net/mlx5/mlx5_flow_hw.c +++ b/drivers/net/mlx5/mlx5_flow_hw.c @@ -4,10 +4,169 @@ #include +#include +#include "mlx5_defs.h" #include "mlx5_flow.h" #if defined(HAVE_IBV_FLOW_DV_SUPPORT) || !defined(HAVE_INFINIBAND_VERBS_H) const struct mlx5_flow_driver_ops mlx5_flow_hw_drv_ops; +/** + * Get information about HWS pre-configurable resources. + * + * @param[in] dev + * Pointer to the rte_eth_dev structure. + * @param[out] port_info + * Pointer to port information. + * @param[out] queue_info + * Pointer to queue information. + * @param[out] error + * Pointer to error structure. + * + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +flow_hw_info_get(struct rte_eth_dev *dev __rte_unused, + struct rte_flow_port_info *port_info __rte_unused, + struct rte_flow_queue_info *queue_info __rte_unused, + struct rte_flow_error *error __rte_unused) +{ + /* Nothing to be updated currently. */ + memset(port_info, 0, sizeof(*port_info)); + /* Queue size is unlimited from low-level. */ + queue_info->max_size = UINT32_MAX; + return 0; +} + +/** + * Configure port HWS resources. + * + * @param[in] dev + * Pointer to the rte_eth_dev structure. + * @param[in] port_attr + * Port configuration attributes. + * @param[in] nb_queue + * Number of queue. + * @param[in] queue_attr + * Array that holds attributes for each flow queue. + * @param[out] error + * Pointer to error structure. + * + * @return + * 0 on success, a negative errno value otherwise and rte_errno is set. + */ +static int +flow_hw_configure(struct rte_eth_dev *dev, + const struct rte_flow_port_attr *port_attr, + uint16_t nb_queue, + const struct rte_flow_queue_attr *queue_attr[], + struct rte_flow_error *error) +{ + struct mlx5_priv *priv = dev->data->dev_private; + struct mlx5dr_context *dr_ctx = NULL; + struct mlx5dr_context_attr dr_ctx_attr = {0}; + struct mlx5_hw_q *hw_q; + struct mlx5_hw_q_job *job = NULL; + uint32_t mem_size, i, j; + + if (!port_attr || !nb_queue || !queue_attr) { + rte_errno = EINVAL; + goto err; + } + /* In case re-configuring, release existing context at first. */ + if (priv->dr_ctx) { + /* */ + for (i = 0; i < nb_queue; i++) { + hw_q = &priv->hw_q[i]; + /* Make sure all queues are empty. */ + if (hw_q->size != hw_q->job_idx) { + rte_errno = EBUSY; + goto err; + } + } + flow_hw_resource_release(dev); + } + /* Allocate the queue job descriptor LIFO. */ + mem_size = sizeof(priv->hw_q[0]) * nb_queue; + for (i = 0; i < nb_queue; i++) { + /* + * Check if the queues' size are all the same as the + * limitation from HWS layer. + */ + if (queue_attr[i]->size != queue_attr[0]->size) { + rte_errno = EINVAL; + goto err; + } + mem_size += (sizeof(struct mlx5_hw_q_job *) + + sizeof(struct mlx5_hw_q_job)) * + queue_attr[0]->size; + } + priv->hw_q = mlx5_malloc(MLX5_MEM_ZERO, mem_size, + 64, SOCKET_ID_ANY); + if (!priv->hw_q) { + rte_errno = ENOMEM; + goto err; + } + for (i = 0; i < nb_queue; i++) { + priv->hw_q[i].job_idx = queue_attr[i]->size; + priv->hw_q[i].size = queue_attr[i]->size; + if (i == 0) + priv->hw_q[i].job = (struct mlx5_hw_q_job **) + &priv->hw_q[nb_queue]; + else + priv->hw_q[i].job = (struct mlx5_hw_q_job **) + &job[queue_attr[i - 1]->size]; + job = (struct mlx5_hw_q_job *) + &priv->hw_q[i].job[queue_attr[i]->size]; + for (j = 0; j < queue_attr[i]->size; j++) + priv->hw_q[i].job[j] = &job[j]; + } + dr_ctx_attr.pd = priv->sh->cdev->pd; + dr_ctx_attr.queues = nb_queue; + /* Queue size should all be the same. Take the first one. */ + dr_ctx_attr.queue_size = queue_attr[0]->size; + dr_ctx = mlx5dr_context_open(priv->sh->cdev->ctx, &dr_ctx_attr); + /* rte_errno has been updated by HWS layer. */ + if (!dr_ctx) + goto err; + priv->dr_ctx = dr_ctx; + priv->nb_queue = nb_queue; + return 0; +err: + if (dr_ctx) + claim_zero(mlx5dr_context_close(dr_ctx)); + mlx5_free(priv->hw_q); + priv->hw_q = NULL; + return rte_flow_error_set(error, rte_errno, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, + "fail to configure port"); +} + +/** + * Release HWS resources. + * + * @param[in] dev + * Pointer to the rte_eth_dev structure. + */ +void +flow_hw_resource_release(struct rte_eth_dev *dev) +{ + struct mlx5_priv *priv = dev->data->dev_private; + + if (!priv->dr_ctx) + return; + mlx5_free(priv->hw_q); + priv->hw_q = NULL; + claim_zero(mlx5dr_context_close(priv->dr_ctx)); + priv->dr_ctx = NULL; + priv->nb_queue = 0; +} + +const struct mlx5_flow_driver_ops mlx5_flow_hw_drv_ops = { + .info_get = flow_hw_info_get, + .configure = flow_hw_configure, +}; + #endif -- 2.25.1