From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80049.outbound.protection.outlook.com [40.107.8.49]) by dpdk.org (Postfix) with ESMTP id DDAF81B146 for ; Wed, 20 Mar 2019 16:39:12 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7Zf6CG1AIpW9b0Vs7yGfsA1W043V110fw1X3HSwbcE4=; b=Cz21eBXCpqnCwcH/VehNhVSEJRBHw4yT1Xl47AHtSSG7nZry4cwCd81IqkT47413JF8kCT3RAFAmGjesyQs+Yxdqm7pRdJtnrA02aqe6yQ+JXFDsfjYzzNAOyrm98W5YClI0TgfMBL7Af8NlztecIj9qH45dwU9LlfS/zMZQLoo= Received: from AM4PR05MB3425.eurprd05.prod.outlook.com (10.171.190.15) by AM4PR05MB3156.eurprd05.prod.outlook.com (10.171.186.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1709.14; Wed, 20 Mar 2019 15:39:10 +0000 Received: from AM4PR05MB3425.eurprd05.prod.outlook.com ([fe80::4cb3:d1fa:a6a:1d11]) by AM4PR05MB3425.eurprd05.prod.outlook.com ([fe80::4cb3:d1fa:a6a:1d11%3]) with mapi id 15.20.1709.015; Wed, 20 Mar 2019 15:39:10 +0000 From: Ori Kam To: Shahaf Shuler , Yongseok Koh , Matan Azrad CC: "dev@dpdk.org" , Ori Kam , Slava Ovsiienko Thread-Topic: [PATCH 2/3] net/mlx5: add Direct Rules API Thread-Index: AQHU3zMOFMgGK8KgJEGibAIebLrApA== Date: Wed, 20 Mar 2019 15:39:07 +0000 Message-ID: <1553096315-91832-3-git-send-email-orika@mellanox.com> References: <1553096315-91832-1-git-send-email-orika@mellanox.com> In-Reply-To: <1553096315-91832-1-git-send-email-orika@mellanox.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: LNXP123CA0004.GBRP123.PROD.OUTLOOK.COM (2603:10a6:600:d2::16) To AM4PR05MB3425.eurprd05.prod.outlook.com (2603:10a6:205:b::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=orika@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-mailer: git-send-email 1.8.3.1 x-originating-ip: [37.142.13.130] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 3409ef05-ee83-44dc-0417-08d6ad4a30c8 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7153060)(7193020); SRVR:AM4PR05MB3156; x-ms-traffictypediagnostic: AM4PR05MB3156: x-microsoft-antispam-prvs: x-forefront-prvs: 098291215C x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(39860400002)(376002)(136003)(396003)(366004)(189003)(199004)(106356001)(99286004)(36756003)(105586002)(53946003)(6666004)(50226002)(446003)(11346002)(478600001)(4720700003)(305945005)(316002)(6512007)(54906003)(107886003)(110136005)(6636002)(186003)(66066001)(7736002)(26005)(30864003)(71190400001)(14454004)(71200400001)(8936002)(68736007)(76176011)(3846002)(6486002)(52116002)(102836004)(5660300002)(6506007)(386003)(6116002)(4326008)(81166006)(81156014)(476003)(2616005)(486006)(256004)(53936002)(14444005)(8676002)(86362001)(6436002)(2906002)(97736004)(25786009)(579004)(559001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM4PR05MB3156; H:AM4PR05MB3425.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: dlnbkzzYP51lW8KbcrH2xYJnHONkllbjGR+goB6j1HL2khD5aIxRocRgyk+gTFzq4oXNcgPEWnkhyzoIIZlZrtm5c8RjscP34qpgZkHsh12fQG8HBOt7M7hNL5I9lfaVR+mKy7UhCkBLlt8fdIyQEoxaCVGOv21aqyW8msXpuDWKdv5dfGIoSaLPY3/XoJ8+ySXe53d5GYvHbUfMAynkHE8IMI5zRwZVE7xl8Fx5y2mi60tKYPRo4jB2duqknU4LEzmDZS77gTJWTctZyPSP+Qh4krjtq0R/T6UxuxRP3QIf58yio76OkWyKO2U4yxxQaKeb1GdtxugYMz5xM7nZsvojm66rKdbzy0TBzS+BdKGVPRXRR6uUvAEc1zcUbzPlddV9tX/K7lgGArTNQQG4SYf7NeEMvpadiYrK7IyyQSw= Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3409ef05-ee83-44dc-0417-08d6ad4a30c8 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Mar 2019 15:39:08.0736 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR05MB3156 Subject: [dpdk-dev] [PATCH 2/3] net/mlx5: add Direct Rules API X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Mar 2019 15:39:13 -0000 Adds calls to the Direct Rules API inside the glue functions. Due to difference in parameters between the Direct Rules and Direct Verbs some of the glue functions API was updated. Signed-off-by: Ori Kam --- drivers/net/mlx5/Makefile | 5 ++ drivers/net/mlx5/mlx5.c | 21 +++++ drivers/net/mlx5/mlx5.h | 15 ++++ drivers/net/mlx5/mlx5_flow.c | 1 + drivers/net/mlx5/mlx5_flow.h | 6 +- drivers/net/mlx5/mlx5_flow_dv.c | 81 ++++++++++++++++--- drivers/net/mlx5/mlx5_glue.c | 170 ++++++++++++++++++++++++++++++++++--= ---- drivers/net/mlx5/mlx5_glue.h | 31 +++++--- drivers/net/mlx5/mlx5_prm.h | 24 +++++- 9 files changed, 307 insertions(+), 47 deletions(-) diff --git a/drivers/net/mlx5/Makefile b/drivers/net/mlx5/Makefile index 9a7da18..1ed299d 100644 --- a/drivers/net/mlx5/Makefile +++ b/drivers/net/mlx5/Makefile @@ -156,6 +156,11 @@ mlx5_autoconf.h.new: $(RTE_SDK)/buildtools/auto-config= -h.sh func mlx5dv_create_flow_action_packet_reformat \ $(AUTOCONF_OUTPUT) $Q sh -- '$<' '$@' \ + HAVE_MLX5DV_DR \ + infiniband/mlx5dv.h \ + enum MLX5DV_DR_NS_TYPE_TERMINATING \ + $(AUTOCONF_OUTPUT) + $Q sh -- '$<' '$@' \ HAVE_IBV_DEVX_OBJ \ infiniband/mlx5dv.h \ func mlx5dv_devx_obj_create \ diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index ae4b716..ad1975c 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -762,6 +762,9 @@ int own_domain_id =3D 0; uint16_t port_id; unsigned int i; +#ifdef HAVE_MLX5DV_DR + void *ns; +#endif =20 /* Determine if this port representor is supposed to be spawned. */ if (switch_info->representor && dpdk_dev->devargs) { @@ -1219,6 +1222,24 @@ priv->tcf_context =3D NULL; } } +#ifdef HAVE_MLX5DV_DR + ns =3D mlx5dv_dr_create_ns(ctx, + MLX5DV_DR_NS_DOMAIN_INGRESS_BYPASS); + if (ns =3D=3D NULL) { + DRV_LOG(ERR, "mlx5dv_dr_create_ns failed"); + err =3D errno; + goto error; + } + priv->rx_ns =3D ns; + ns =3D mlx5dv_dr_create_ns(ctx, + MLX5DV_DR_NS_DOMAIN_EGRESS_BYPASS); + if (ns =3D=3D NULL) { + DRV_LOG(ERR, "mlx5dv_dr_create_ns failed"); + err =3D errno; + goto error; + } + priv->tx_ns =3D ns; +#endif TAILQ_INIT(&priv->flows); TAILQ_INIT(&priv->ctrl_flows); /* Hint libmlx5 to use PMD allocator for data plane resources */ diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index c0aa891..a0d4961 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -187,6 +187,15 @@ struct mlx5_drop { =20 struct mlx5_flow_tcf_context; =20 +/* Table structure. */ +struct mlx5_flow_tbl_resource { + void *obj; /**< Pointer to DR table object. */ + rte_atomic32_t refcnt; /**< Reference counter. */ +}; + +#define MLX5_MAX_TABLES 1024 +#define MLX5_GROUP_FACTOR 1 + struct mlx5_priv { LIST_ENTRY(mlx5_priv) mem_event_cb; /**< Called by memory event callback. */ @@ -259,6 +268,12 @@ struct mlx5_priv { /* UAR same-page access control required in 32bit implementations. */ #endif struct mlx5_flow_tcf_context *tcf_context; /* TC flower context. */ + void *rx_ns; /* RX Direct Rules name space handle. */ + struct mlx5_flow_tbl_resource rx_tbl[MLX5_MAX_TABLES]; + /* RX Direct Rules tables. */ + void *tx_ns; /* TX Direct Rules name space handle. */ + struct mlx5_flow_tbl_resource tx_tbl[MLX5_MAX_TABLES]; + /* TX Direct Rules tables/ */ }; =20 #define PORT_ID(priv) ((priv)->dev_data->port_id) diff --git a/drivers/net/mlx5/mlx5_flow.c b/drivers/net/mlx5/mlx5_flow.c index dea38e2..010d61a 100644 --- a/drivers/net/mlx5/mlx5_flow.c +++ b/drivers/net/mlx5/mlx5_flow.c @@ -2082,6 +2082,7 @@ uint32_t mlx5_flow_adjust_priority(struct rte_eth_dev= *dev, int32_t priority, flow_size +=3D RTE_ALIGN_CEIL(sizeof(uint16_t), sizeof(void *)); flow =3D rte_calloc(__func__, 1, flow_size, 0); flow->drv_type =3D flow_get_drv_type(dev, attr); + flow->ingress =3D attr->ingress; assert(flow->drv_type > MLX5_FLOW_TYPE_MIN && flow->drv_type < MLX5_FLOW_TYPE_MAX); flow->queue =3D (void *)(flow + 1); diff --git a/drivers/net/mlx5/mlx5_flow.h b/drivers/net/mlx5/mlx5_flow.h index 4f69ae2..8ba37a0 100644 --- a/drivers/net/mlx5/mlx5_flow.h +++ b/drivers/net/mlx5/mlx5_flow.h @@ -204,6 +204,7 @@ struct mlx5_flow_dv_matcher { uint16_t crc; /**< CRC of key. */ uint16_t priority; /**< Priority of matcher. */ uint8_t egress; /**< Egress matcher. */ + uint32_t group; /**< The matcher group. */ struct mlx5_flow_dv_match_params mask; /**< Matcher mask. */ }; =20 @@ -220,6 +221,7 @@ struct mlx5_flow_dv_encap_decap_resource { size_t size; uint8_t reformat_type; uint8_t ft_type; + uint64_t flags; /**< Flags for RDMA API. */ }; =20 /* Tag resource structure. */ @@ -348,7 +350,7 @@ struct mlx5_flow_counter { /* Flow structure. */ struct rte_flow { TAILQ_ENTRY(rte_flow) next; /**< Pointer to the next flow structure. */ - enum mlx5_flow_drv_type drv_type; /**< Drvier type. */ + enum mlx5_flow_drv_type drv_type; /**< Driver type. */ struct mlx5_flow_counter *counter; /**< Holds flow counter. */ struct mlx5_flow_dv_tag_resource *tag_resource; /**< pointer to the tag action. */ @@ -360,6 +362,8 @@ struct rte_flow { uint64_t actions; /**< Bit-fields of detected actions, see MLX5_FLOW_ACTION_*. */ struct mlx5_fdir *fdir; /**< Pointer to associated FDIR if any. */ + uint8_t ingress; /**< 1 if the flow is ingress. */ + uint32_t group; /**< The group index. */ }; =20 typedef int (*mlx5_flow_validate_t)(struct rte_eth_dev *dev, diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_d= v.c index 0eb3a28..228ba3f 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -805,11 +805,20 @@ struct field_modify_info modify_tcp[] =3D { { struct mlx5_priv *priv =3D dev->data->dev_private; struct mlx5_flow_dv_encap_decap_resource *cache_resource; + struct rte_flow *flow =3D dev_flow->flow; + struct mlx5dv_dr_ns *ns; + + resource->flags =3D flow->group ? 0 : 1; + if (flow->ingress) + ns =3D priv->rx_ns; + else + ns =3D priv->tx_ns; =20 /* Lookup a matching resource from cache. */ LIST_FOREACH(cache_resource, &priv->encaps_decaps, next) { if (resource->reformat_type =3D=3D cache_resource->reformat_type && resource->ft_type =3D=3D cache_resource->ft_type && + resource->flags =3D=3D cache_resource->flags && resource->size =3D=3D cache_resource->size && !memcmp((const void *)resource->buf, (const void *)cache_resource->buf, @@ -831,10 +840,10 @@ struct field_modify_info modify_tcp[] =3D { *cache_resource =3D *resource; cache_resource->verbs_action =3D mlx5_glue->dv_create_flow_action_packet_reformat - (priv->ctx, cache_resource->size, - (cache_resource->size ? cache_resource->buf : NULL), - cache_resource->reformat_type, - cache_resource->ft_type); + (priv->ctx, cache_resource->reformat_type, + cache_resource->ft_type, ns, cache_resource->flags, + cache_resource->size, + (cache_resource->size ? cache_resource->buf : NULL)); if (!cache_resource->verbs_action) { rte_free(cache_resource); return rte_flow_error_set(error, ENOMEM, @@ -1438,6 +1447,10 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_priv *priv =3D dev->data->dev_private; struct mlx5_flow_dv_modify_hdr_resource *cache_resource; =20 + struct mlx5dv_dr_ns *ns =3D + resource->ft_type =3D=3D MLX5DV_FLOW_TABLE_TYPE_NIC_TX ? + priv->tx_ns : priv->rx_ns; + /* Lookup a matching resource from cache. */ LIST_FOREACH(cache_resource, &priv->modify_cmds, next) { if (resource->ft_type =3D=3D cache_resource->ft_type && @@ -1463,11 +1476,11 @@ struct field_modify_info modify_tcp[] =3D { *cache_resource =3D *resource; cache_resource->verbs_action =3D mlx5_glue->dv_create_flow_action_modify_header - (priv->ctx, + (priv->ctx, cache_resource->ft_type, + ns, 0, cache_resource->actions_num * sizeof(cache_resource->actions[0]), - (uint64_t *)cache_resource->actions, - cache_resource->ft_type); + (uint64_t *)cache_resource->actions); if (!cache_resource->verbs_action) { rte_free(cache_resource); return rte_flow_error_set(error, ENOMEM, @@ -1592,11 +1605,13 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_priv *priv =3D dev->data->dev_private; uint32_t priority_max =3D priv->config.flow_prio - 1; =20 +#ifdef HAVE_MLX5DV_DR if (attributes->group) return rte_flow_error_set(error, ENOTSUP, RTE_FLOW_ERROR_TYPE_ATTR_GROUP, NULL, "groups is not supported"); +#endif if (attributes->priority !=3D MLX5_FLOW_PRIO_RSVD && attributes->priority >=3D priority_max) return rte_flow_error_set(error, ENOTSUP, @@ -2723,7 +2738,11 @@ struct field_modify_info modify_tcp[] =3D { match_criteria_enable |=3D (!HEADER_IS_ZERO(match_criteria, misc_parameters_2)) << MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT; - +#ifdef HAVE_MLX5DV_DR + match_criteria_enable |=3D + (!HEADER_IS_ZERO(match_criteria, misc_parameters_3)) << + MLX5_MATCH_CRITERIA_ENABLE_MISC3_BIT; +#endif return match_criteria_enable; } =20 @@ -2754,12 +2773,14 @@ struct field_modify_info modify_tcp[] =3D { .type =3D IBV_FLOW_ATTR_NORMAL, .match_mask =3D (void *)&matcher->mask, }; + struct mlx5_flow_tbl_resource *tbl; =20 /* Lookup from cache. */ LIST_FOREACH(cache_matcher, &priv->matchers, next) { if (matcher->crc =3D=3D cache_matcher->crc && matcher->priority =3D=3D cache_matcher->priority && matcher->egress =3D=3D cache_matcher->egress && + matcher->group =3D=3D cache_matcher->group && !memcmp((const void *)matcher->mask.buf, (const void *)cache_matcher->mask.buf, cache_matcher->mask.size)) { @@ -2774,6 +2795,27 @@ struct field_modify_info modify_tcp[] =3D { return 0; } } +#ifdef HAVE_MLX5DV_DR + if (matcher->egress) { + tbl =3D &priv->tx_tbl[matcher->group]; + if (!tbl->obj) + tbl->obj =3D mlx5_glue->dr_create_flow_tbl + (priv->tx_ns, + matcher->group * MLX5_GROUP_FACTOR); + } else { + tbl =3D &priv->rx_tbl[matcher->group]; + if (!tbl->obj) + tbl->obj =3D mlx5_glue->dr_create_flow_tbl + (priv->rx_ns, + matcher->group * MLX5_GROUP_FACTOR); + } + if (!tbl->obj) + return rte_flow_error_set(error, ENOMEM, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, + NULL, "cannot create table"); + + rte_atomic32_inc(&tbl->refcnt); +#endif /* Register new matcher. */ cache_matcher =3D rte_calloc(__func__, 1, sizeof(*cache_matcher), 0); if (!cache_matcher) @@ -2787,9 +2829,16 @@ struct field_modify_info modify_tcp[] =3D { if (matcher->egress) dv_attr.flags |=3D IBV_FLOW_ATTR_FLAGS_EGRESS; cache_matcher->matcher_object =3D - mlx5_glue->dv_create_flow_matcher(priv->ctx, &dv_attr); + mlx5_glue->dv_create_flow_matcher(priv->ctx, &dv_attr, + tbl->obj); if (!cache_matcher->matcher_object) { rte_free(cache_matcher); +#ifdef HAVE_MLX5DV_DR + if (rte_atomic32_dec_and_test(&tbl->refcnt)) { + mlx5_glue->dr_destroy_flow_tbl(tbl->obj); + tbl->obj =3D NULL; + } +#endif return rte_flow_error_set(error, ENOMEM, RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, "cannot create matcher"); @@ -2801,6 +2850,7 @@ struct field_modify_info modify_tcp[] =3D { cache_matcher->priority, cache_matcher->egress ? "tx" : "rx", (void *)cache_matcher, rte_atomic32_read(&cache_matcher->refcnt)); + rte_atomic32_inc(&tbl->refcnt); return 0; } =20 @@ -3276,6 +3326,7 @@ struct field_modify_info modify_tcp[] =3D { matcher.priority =3D mlx5_flow_adjust_priority(dev, priority, matcher.priority); matcher.egress =3D attr->egress; + matcher.group =3D attr->group; if (flow_dv_matcher_register(dev, &matcher, dev_flow, error)) return -rte_errno; return 0; @@ -3391,6 +3442,8 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_flow *flow) { struct mlx5_flow_dv_matcher *matcher =3D flow->dv.matcher; + struct mlx5_priv *priv =3D dev->data->dev_private; + struct mlx5_flow_tbl_resource *tbl; =20 assert(matcher->matcher_object); DRV_LOG(DEBUG, "port %u matcher %p: refcnt %d--", @@ -3400,6 +3453,14 @@ struct field_modify_info modify_tcp[] =3D { claim_zero(mlx5_glue->dv_destroy_flow_matcher (matcher->matcher_object)); LIST_REMOVE(matcher, next); + if (matcher->egress) + tbl =3D &priv->tx_tbl[matcher->group]; + else + tbl =3D &priv->rx_tbl[matcher->group]; + if (rte_atomic32_dec_and_test(&tbl->refcnt)) { + mlx5_glue->dr_destroy_flow_tbl(tbl->obj); + tbl->obj =3D NULL; + } rte_free(matcher); DRV_LOG(DEBUG, "port %u matcher %p: removed", dev->data->port_id, (void *)matcher); @@ -3489,7 +3550,7 @@ struct field_modify_info modify_tcp[] =3D { LIST_FOREACH(dev_flow, &flow->dev_flows, next) { dv =3D &dev_flow->dv; if (dv->flow) { - claim_zero(mlx5_glue->destroy_flow(dv->flow)); + claim_zero(mlx5_glue->dv_destroy_flow(dv->flow)); dv->flow =3D NULL; } if (dv->hrxq) { diff --git a/drivers/net/mlx5/mlx5_glue.c b/drivers/net/mlx5/mlx5_glue.c index cfd939d..f509f85 100644 --- a/drivers/net/mlx5/mlx5_glue.c +++ b/drivers/net/mlx5/mlx5_glue.c @@ -178,6 +178,9 @@ mlx5_glue_destroy_flow_action(void *action) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_action(action); +#else struct mlx5dv_flow_action_attr *attr =3D action; int res =3D 0; switch (attr->type) { @@ -189,6 +192,7 @@ } free(action); return res; +#endif #else (void)action; return ENOTSUP; @@ -365,6 +369,53 @@ return ibv_cq_ex_to_cq(cq); } =20 +static void * +mlx5_glue_dr_create_flow_tbl(void *ns, uint32_t level) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_ft(ns, level); +#else + (void)ns; + (void)level; + return NULL; +#endif +} + +static int +mlx5_glue_dr_destroy_flow_tbl(void *tbl) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_ft(tbl); +#else + (void)tbl; + return 0; +#endif +} + +static void * +mlx5_glue_dr_create_ns(struct ibv_context *ctx, + enum mlx5dv_dr_ns_domain domain) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_ns(ctx, domain); +#else + (void)ctx; + (void)domain; + return NULL; +#endif +} + +static int +mlx5_glue_dr_destroy_ns(void *ns) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_ns(ns); +#else + (void)ns; + return 0; +#endif +} + static struct ibv_cq_ex * mlx5_glue_dv_create_cq(struct ibv_context *context, struct ibv_cq_init_attr_ex *cq_attr, @@ -423,26 +474,40 @@ #endif } =20 -static struct mlx5dv_flow_matcher * +static void * mlx5_glue_dv_create_flow_matcher(struct ibv_context *context, - struct mlx5dv_flow_matcher_attr *matcher_attr) + struct mlx5dv_flow_matcher_attr *matcher_attr, + void *tbl) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)context; + return mlx5dv_dr_create_matcher(tbl, matcher_attr->priority, + matcher_attr->match_criteria_enable, + matcher_attr->match_mask); +#else + (void)tbl; return mlx5dv_create_flow_matcher(context, matcher_attr); +#endif #else (void)context; (void)matcher_attr; + (void)tbl; return NULL; #endif } =20 -static struct ibv_flow * -mlx5_glue_dv_create_flow(struct mlx5dv_flow_matcher *matcher, - struct mlx5dv_flow_match_parameters *match_value, +static void * +mlx5_glue_dv_create_flow(void *matcher, + void *match_value, size_t num_actions, void *actions[]) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_rule(matcher, match_value, num_actions, + (struct mlx5dv_dr_action **)actions); +#else struct mlx5dv_flow_action_attr actions_attr[8]; =20 if (num_actions > 8) @@ -452,6 +517,7 @@ *((struct mlx5dv_flow_action_attr *)(actions[i])); return mlx5dv_create_flow(matcher, match_value, num_actions, actions_attr); +#endif #else (void)matcher; (void)match_value; @@ -461,21 +527,13 @@ #endif } =20 -static int -mlx5_glue_dv_destroy_flow_matcher(struct mlx5dv_flow_matcher *matcher) -{ -#ifdef HAVE_IBV_FLOW_DV_SUPPORT - return mlx5dv_destroy_flow_matcher(matcher); -#else - (void)matcher; - return 0; -#endif -} - static void * mlx5_glue_dv_create_flow_action_counter(void *counter_obj, uint32_t offset= ) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_devx_counter(counter_obj, offset); +#else struct mlx5dv_flow_action_attr *action; =20 (void)offset; @@ -485,6 +543,7 @@ action->type =3D MLX5DV_FLOW_ACTION_COUNTER_DEVX; action->obj =3D counter_obj; return action; +#endif #else (void)counter_obj; (void)offset; @@ -496,6 +555,9 @@ mlx5_glue_dv_create_flow_action_dest_ibv_qp(void *qp) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_dest_ibv_qp(qp); +#else struct mlx5dv_flow_action_attr *action; =20 action =3D malloc(sizeof(*action)); @@ -504,6 +566,7 @@ action->type =3D MLX5DV_FLOW_ACTION_DEST_IBV_QP; action->obj =3D qp; return action; +#endif #else (void)qp; return NULL; @@ -513,13 +576,22 @@ static void * mlx5_glue_dv_create_flow_action_modify_header (struct ibv_context *ctx, + enum mlx5dv_flow_table_type ft_type, + void *ns, uint64_t flags, size_t actions_sz, - uint64_t actions[], - enum mlx5dv_flow_table_type ft_type) + uint64_t actions[]) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)ctx; + (void)ft_type; + return mlx5dv_dr_create_action_modify_header(ns, flags, actions_sz, + actions); +#else struct mlx5dv_flow_action_attr *action; =20 + (void)ns; + (void)flags; action =3D malloc(sizeof(*action)); if (!action) return NULL; @@ -527,11 +599,14 @@ action->action =3D mlx5dv_create_flow_action_modify_header (ctx, actions_sz, actions, ft_type); return action; +#endif #else (void)ctx; + (void)ft_type; + (void)ns; + (void)flags; (void)actions_sz; (void)actions; - (void)ft_type; return NULL; #endif } @@ -539,12 +614,20 @@ static void * mlx5_glue_dv_create_flow_action_packet_reformat (struct ibv_context *ctx, - size_t data_sz, - void *data, enum mlx5dv_flow_action_packet_reformat_type reformat_type, - enum mlx5dv_flow_table_type ft_type) + enum mlx5dv_flow_table_type ft_type, struct mlx5dv_dr_ns *ns, + uint32_t flags, size_t data_sz, void *data) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)ctx; + (void)ft_type; + return mlx5dv_dr_create_action_packet_reformat(ns, flags, + reformat_type, data_sz, + data); +#else + (void)ns; + (void)flags; struct mlx5dv_flow_action_attr *action; =20 action =3D malloc(sizeof(*action)); @@ -554,12 +637,15 @@ action->action =3D mlx5dv_create_flow_action_packet_reformat (ctx, data_sz, data, reformat_type, ft_type); return action; +#endif #else (void)ctx; - (void)data_sz; - (void)data; (void)reformat_type; (void)ft_type; + (void)ns; + (void)flags; + (void)data_sz; + (void)data; return NULL; #endif } @@ -568,6 +654,9 @@ mlx5_glue_dv_create_flow_action_tag(uint32_t tag) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_tag(tag); +#else struct mlx5dv_flow_action_attr *action; action =3D malloc(sizeof(*action)); if (!action) @@ -576,10 +665,36 @@ action->tag_value =3D tag; return action; #endif +#endif (void)tag; return NULL; } =20 +static int +mlx5_glue_dv_destroy_flow(void *flow_id) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_rule(flow_id); +#else + return ibv_destroy_flow(flow_id); +#endif +} + +static int +mlx5_glue_dv_destroy_flow_matcher(void *matcher) +{ +#ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_matcher(matcher); +#else + return mlx5dv_destroy_flow_matcher(matcher); +#endif +#else + (void)matcher; + return 0; +#endif +} + static struct ibv_context * mlx5_glue_dv_open_device(struct ibv_device *device) { @@ -718,6 +833,10 @@ .get_async_event =3D mlx5_glue_get_async_event, .port_state_str =3D mlx5_glue_port_state_str, .cq_ex_to_cq =3D mlx5_glue_cq_ex_to_cq, + .dr_create_flow_tbl =3D mlx5_glue_dr_create_flow_tbl, + .dr_destroy_flow_tbl =3D mlx5_glue_dr_destroy_flow_tbl, + .dr_create_ns =3D mlx5_glue_dr_create_ns, + .dr_destroy_ns =3D mlx5_glue_dr_destroy_ns, .dv_create_cq =3D mlx5_glue_dv_create_cq, .dv_create_wq =3D mlx5_glue_dv_create_wq, .dv_query_device =3D mlx5_glue_dv_query_device, @@ -725,7 +844,6 @@ .dv_init_obj =3D mlx5_glue_dv_init_obj, .dv_create_qp =3D mlx5_glue_dv_create_qp, .dv_create_flow_matcher =3D mlx5_glue_dv_create_flow_matcher, - .dv_destroy_flow_matcher =3D mlx5_glue_dv_destroy_flow_matcher, .dv_create_flow =3D mlx5_glue_dv_create_flow, .dv_create_flow_action_counter =3D mlx5_glue_dv_create_flow_action_counter, @@ -736,6 +854,8 @@ .dv_create_flow_action_packet_reformat =3D mlx5_glue_dv_create_flow_action_packet_reformat, .dv_create_flow_action_tag =3D mlx5_glue_dv_create_flow_action_tag, + .dv_destroy_flow =3D mlx5_glue_dv_destroy_flow, + .dv_destroy_flow_matcher =3D mlx5_glue_dv_destroy_flow_matcher, .dv_open_device =3D mlx5_glue_dv_open_device, .devx_obj_create =3D mlx5_glue_devx_obj_create, .devx_obj_destroy =3D mlx5_glue_devx_obj_destroy, diff --git a/drivers/net/mlx5/mlx5_glue.h b/drivers/net/mlx5/mlx5_glue.h index 167f1f7..7115575 100644 --- a/drivers/net/mlx5/mlx5_glue.h +++ b/drivers/net/mlx5/mlx5_glue.h @@ -63,6 +63,11 @@ struct mlx5dv_devx_obj; #endif =20 +#ifndef HAVE_MLX5DV_DR +struct mlx5dv_dr_ns; +enum mlx5dv_dr_ns_domain { unused, }; +#endif + /* LIB_GLUE_VERSION must be updated every time this structure is modified.= */ struct mlx5_glue { const char *version; @@ -140,6 +145,11 @@ struct mlx5_glue { struct ibv_async_event *event); const char *(*port_state_str)(enum ibv_port_state port_state); struct ibv_cq *(*cq_ex_to_cq)(struct ibv_cq_ex *cq); + void *(*dr_create_flow_tbl)(void *ns, uint32_t level); + int (*dr_destroy_flow_tbl)(void *tbl); + void *(*dr_create_ns)(struct ibv_context *ctx, + enum mlx5dv_dr_ns_domain domain); + int (*dr_destroy_ns)(void *ns); struct ibv_cq_ex *(*dv_create_cq) (struct ibv_context *context, struct ibv_cq_init_attr_ex *cq_attr, @@ -158,23 +168,26 @@ struct mlx5_glue { (struct ibv_context *context, struct ibv_qp_init_attr_ex *qp_init_attr_ex, struct mlx5dv_qp_init_attr *dv_qp_init_attr); - struct mlx5dv_flow_matcher *(*dv_create_flow_matcher) + void *(*dv_create_flow_matcher) (struct ibv_context *context, - struct mlx5dv_flow_matcher_attr *matcher_attr); - int (*dv_destroy_flow_matcher)(struct mlx5dv_flow_matcher *matcher); - struct ibv_flow *(*dv_create_flow)(struct mlx5dv_flow_matcher *matcher, - struct mlx5dv_flow_match_parameters *match_value, + struct mlx5dv_flow_matcher_attr *matcher_attr, + void *tbl); + void *(*dv_create_flow)(void *matcher, void *match_value, size_t num_actions, void *actions[]); void *(*dv_create_flow_action_counter)(void *obj, uint32_t offset); void *(*dv_create_flow_action_dest_ibv_qp)(void *qp); void *(*dv_create_flow_action_modify_header) - (struct ibv_context *ctx, size_t actions_sz, uint64_t actions[], - enum mlx5dv_flow_table_type ft_type); + (struct ibv_context *ctx, enum mlx5dv_flow_table_type ft_type, + void *ns, uint64_t flags, size_t actions_sz, + uint64_t actions[]); void *(*dv_create_flow_action_packet_reformat) - (struct ibv_context *ctx, size_t data_sz, void *data, + (struct ibv_context *ctx, enum mlx5dv_flow_action_packet_reformat_type reformat_type, - enum mlx5dv_flow_table_type ft_type); + enum mlx5dv_flow_table_type ft_type, struct mlx5dv_dr_ns *ns, + uint32_t flags, size_t data_sz, void *data); void *(*dv_create_flow_action_tag)(uint32_t tag); + int (*dv_destroy_flow)(void *flow); + int (*dv_destroy_flow_matcher)(void *matcher); struct ibv_context *(*dv_open_device)(struct ibv_device *device); struct mlx5dv_devx_obj *(*devx_obj_create) (struct ibv_context *ctx, diff --git a/drivers/net/mlx5/mlx5_prm.h b/drivers/net/mlx5/mlx5_prm.h index da1219e..b15266f 100644 --- a/drivers/net/mlx5/mlx5_prm.h +++ b/drivers/net/mlx5/mlx5_prm.h @@ -492,20 +492,40 @@ struct mlx5_ifc_fte_match_set_misc2_bits { u8 reserved_at_1a0[0x60]; }; =20 +struct mlx5_ifc_fte_match_set_misc3_bits { + u8 inner_tcp_seq_num[0x20]; + u8 outer_tcp_seq_num[0x20]; + u8 inner_tcp_ack_num[0x20]; + u8 outer_tcp_ack_num[0x20]; + u8 reserved_at_auto1[0x8]; + u8 outer_vxlan_gpe_vni[0x18]; + u8 outer_vxlan_gpe_next_protocol[0x8]; + u8 outer_vxlan_gpe_flags[0x8]; + u8 reserved_at_a8[0x10]; + u8 icmp_header_data[0x20]; + u8 icmpv6_header_data[0x20]; + u8 icmp_type[0x8]; + u8 icmp_code[0x8]; + u8 icmpv6_type[0x8]; + u8 icmpv6_code[0x8]; + u8 reserved_at_1a0[0xe0]; +}; + /* Flow matcher. */ struct mlx5_ifc_fte_match_param_bits { struct mlx5_ifc_fte_match_set_lyr_2_4_bits outer_headers; struct mlx5_ifc_fte_match_set_misc_bits misc_parameters; struct mlx5_ifc_fte_match_set_lyr_2_4_bits inner_headers; struct mlx5_ifc_fte_match_set_misc2_bits misc_parameters_2; - u8 reserved_at_800[0x800]; + struct mlx5_ifc_fte_match_set_misc3_bits misc_parameters_3; }; =20 enum { MLX5_MATCH_CRITERIA_ENABLE_OUTER_BIT, MLX5_MATCH_CRITERIA_ENABLE_MISC_BIT, MLX5_MATCH_CRITERIA_ENABLE_INNER_BIT, - MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT + MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT, + MLX5_MATCH_CRITERIA_ENABLE_MISC3_BIT }; =20 enum { --=20 1.8.3.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 3F4B5A00E6 for ; Wed, 20 Mar 2019 16:39:29 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id B18031B1F1; Wed, 20 Mar 2019 16:39:16 +0100 (CET) Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80049.outbound.protection.outlook.com [40.107.8.49]) by dpdk.org (Postfix) with ESMTP id DDAF81B146 for ; Wed, 20 Mar 2019 16:39:12 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=7Zf6CG1AIpW9b0Vs7yGfsA1W043V110fw1X3HSwbcE4=; b=Cz21eBXCpqnCwcH/VehNhVSEJRBHw4yT1Xl47AHtSSG7nZry4cwCd81IqkT47413JF8kCT3RAFAmGjesyQs+Yxdqm7pRdJtnrA02aqe6yQ+JXFDsfjYzzNAOyrm98W5YClI0TgfMBL7Af8NlztecIj9qH45dwU9LlfS/zMZQLoo= Received: from AM4PR05MB3425.eurprd05.prod.outlook.com (10.171.190.15) by AM4PR05MB3156.eurprd05.prod.outlook.com (10.171.186.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1709.14; Wed, 20 Mar 2019 15:39:10 +0000 Received: from AM4PR05MB3425.eurprd05.prod.outlook.com ([fe80::4cb3:d1fa:a6a:1d11]) by AM4PR05MB3425.eurprd05.prod.outlook.com ([fe80::4cb3:d1fa:a6a:1d11%3]) with mapi id 15.20.1709.015; Wed, 20 Mar 2019 15:39:10 +0000 From: Ori Kam To: Shahaf Shuler , Yongseok Koh , Matan Azrad CC: "dev@dpdk.org" , Ori Kam , Slava Ovsiienko Thread-Topic: [PATCH 2/3] net/mlx5: add Direct Rules API Thread-Index: AQHU3zMOFMgGK8KgJEGibAIebLrApA== Date: Wed, 20 Mar 2019 15:39:07 +0000 Message-ID: <1553096315-91832-3-git-send-email-orika@mellanox.com> References: <1553096315-91832-1-git-send-email-orika@mellanox.com> In-Reply-To: <1553096315-91832-1-git-send-email-orika@mellanox.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: LNXP123CA0004.GBRP123.PROD.OUTLOOK.COM (2603:10a6:600:d2::16) To AM4PR05MB3425.eurprd05.prod.outlook.com (2603:10a6:205:b::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=orika@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-mailer: git-send-email 1.8.3.1 x-originating-ip: [37.142.13.130] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 3409ef05-ee83-44dc-0417-08d6ad4a30c8 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7153060)(7193020); SRVR:AM4PR05MB3156; x-ms-traffictypediagnostic: AM4PR05MB3156: x-microsoft-antispam-prvs: x-forefront-prvs: 098291215C x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(39860400002)(376002)(136003)(396003)(366004)(189003)(199004)(106356001)(99286004)(36756003)(105586002)(53946003)(6666004)(50226002)(446003)(11346002)(478600001)(4720700003)(305945005)(316002)(6512007)(54906003)(107886003)(110136005)(6636002)(186003)(66066001)(7736002)(26005)(30864003)(71190400001)(14454004)(71200400001)(8936002)(68736007)(76176011)(3846002)(6486002)(52116002)(102836004)(5660300002)(6506007)(386003)(6116002)(4326008)(81166006)(81156014)(476003)(2616005)(486006)(256004)(53936002)(14444005)(8676002)(86362001)(6436002)(2906002)(97736004)(25786009)(579004)(559001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM4PR05MB3156; H:AM4PR05MB3425.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: dlnbkzzYP51lW8KbcrH2xYJnHONkllbjGR+goB6j1HL2khD5aIxRocRgyk+gTFzq4oXNcgPEWnkhyzoIIZlZrtm5c8RjscP34qpgZkHsh12fQG8HBOt7M7hNL5I9lfaVR+mKy7UhCkBLlt8fdIyQEoxaCVGOv21aqyW8msXpuDWKdv5dfGIoSaLPY3/XoJ8+ySXe53d5GYvHbUfMAynkHE8IMI5zRwZVE7xl8Fx5y2mi60tKYPRo4jB2duqknU4LEzmDZS77gTJWTctZyPSP+Qh4krjtq0R/T6UxuxRP3QIf58yio76OkWyKO2U4yxxQaKeb1GdtxugYMz5xM7nZsvojm66rKdbzy0TBzS+BdKGVPRXRR6uUvAEc1zcUbzPlddV9tX/K7lgGArTNQQG4SYf7NeEMvpadiYrK7IyyQSw= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3409ef05-ee83-44dc-0417-08d6ad4a30c8 X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Mar 2019 15:39:08.0736 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM4PR05MB3156 Subject: [dpdk-dev] [PATCH 2/3] net/mlx5: add Direct Rules API X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Message-ID: <20190320153907.8hI_CWu5_zKzhjIhl2uW-6FsT343rBarge23aYlsutw@z> Adds calls to the Direct Rules API inside the glue functions. Due to difference in parameters between the Direct Rules and Direct Verbs some of the glue functions API was updated. Signed-off-by: Ori Kam --- drivers/net/mlx5/Makefile | 5 ++ drivers/net/mlx5/mlx5.c | 21 +++++ drivers/net/mlx5/mlx5.h | 15 ++++ drivers/net/mlx5/mlx5_flow.c | 1 + drivers/net/mlx5/mlx5_flow.h | 6 +- drivers/net/mlx5/mlx5_flow_dv.c | 81 ++++++++++++++++--- drivers/net/mlx5/mlx5_glue.c | 170 ++++++++++++++++++++++++++++++++++--= ---- drivers/net/mlx5/mlx5_glue.h | 31 +++++--- drivers/net/mlx5/mlx5_prm.h | 24 +++++- 9 files changed, 307 insertions(+), 47 deletions(-) diff --git a/drivers/net/mlx5/Makefile b/drivers/net/mlx5/Makefile index 9a7da18..1ed299d 100644 --- a/drivers/net/mlx5/Makefile +++ b/drivers/net/mlx5/Makefile @@ -156,6 +156,11 @@ mlx5_autoconf.h.new: $(RTE_SDK)/buildtools/auto-config= -h.sh func mlx5dv_create_flow_action_packet_reformat \ $(AUTOCONF_OUTPUT) $Q sh -- '$<' '$@' \ + HAVE_MLX5DV_DR \ + infiniband/mlx5dv.h \ + enum MLX5DV_DR_NS_TYPE_TERMINATING \ + $(AUTOCONF_OUTPUT) + $Q sh -- '$<' '$@' \ HAVE_IBV_DEVX_OBJ \ infiniband/mlx5dv.h \ func mlx5dv_devx_obj_create \ diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index ae4b716..ad1975c 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -762,6 +762,9 @@ int own_domain_id =3D 0; uint16_t port_id; unsigned int i; +#ifdef HAVE_MLX5DV_DR + void *ns; +#endif =20 /* Determine if this port representor is supposed to be spawned. */ if (switch_info->representor && dpdk_dev->devargs) { @@ -1219,6 +1222,24 @@ priv->tcf_context =3D NULL; } } +#ifdef HAVE_MLX5DV_DR + ns =3D mlx5dv_dr_create_ns(ctx, + MLX5DV_DR_NS_DOMAIN_INGRESS_BYPASS); + if (ns =3D=3D NULL) { + DRV_LOG(ERR, "mlx5dv_dr_create_ns failed"); + err =3D errno; + goto error; + } + priv->rx_ns =3D ns; + ns =3D mlx5dv_dr_create_ns(ctx, + MLX5DV_DR_NS_DOMAIN_EGRESS_BYPASS); + if (ns =3D=3D NULL) { + DRV_LOG(ERR, "mlx5dv_dr_create_ns failed"); + err =3D errno; + goto error; + } + priv->tx_ns =3D ns; +#endif TAILQ_INIT(&priv->flows); TAILQ_INIT(&priv->ctrl_flows); /* Hint libmlx5 to use PMD allocator for data plane resources */ diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index c0aa891..a0d4961 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -187,6 +187,15 @@ struct mlx5_drop { =20 struct mlx5_flow_tcf_context; =20 +/* Table structure. */ +struct mlx5_flow_tbl_resource { + void *obj; /**< Pointer to DR table object. */ + rte_atomic32_t refcnt; /**< Reference counter. */ +}; + +#define MLX5_MAX_TABLES 1024 +#define MLX5_GROUP_FACTOR 1 + struct mlx5_priv { LIST_ENTRY(mlx5_priv) mem_event_cb; /**< Called by memory event callback. */ @@ -259,6 +268,12 @@ struct mlx5_priv { /* UAR same-page access control required in 32bit implementations. */ #endif struct mlx5_flow_tcf_context *tcf_context; /* TC flower context. */ + void *rx_ns; /* RX Direct Rules name space handle. */ + struct mlx5_flow_tbl_resource rx_tbl[MLX5_MAX_TABLES]; + /* RX Direct Rules tables. */ + void *tx_ns; /* TX Direct Rules name space handle. */ + struct mlx5_flow_tbl_resource tx_tbl[MLX5_MAX_TABLES]; + /* TX Direct Rules tables/ */ }; =20 #define PORT_ID(priv) ((priv)->dev_data->port_id) diff --git a/drivers/net/mlx5/mlx5_flow.c b/drivers/net/mlx5/mlx5_flow.c index dea38e2..010d61a 100644 --- a/drivers/net/mlx5/mlx5_flow.c +++ b/drivers/net/mlx5/mlx5_flow.c @@ -2082,6 +2082,7 @@ uint32_t mlx5_flow_adjust_priority(struct rte_eth_dev= *dev, int32_t priority, flow_size +=3D RTE_ALIGN_CEIL(sizeof(uint16_t), sizeof(void *)); flow =3D rte_calloc(__func__, 1, flow_size, 0); flow->drv_type =3D flow_get_drv_type(dev, attr); + flow->ingress =3D attr->ingress; assert(flow->drv_type > MLX5_FLOW_TYPE_MIN && flow->drv_type < MLX5_FLOW_TYPE_MAX); flow->queue =3D (void *)(flow + 1); diff --git a/drivers/net/mlx5/mlx5_flow.h b/drivers/net/mlx5/mlx5_flow.h index 4f69ae2..8ba37a0 100644 --- a/drivers/net/mlx5/mlx5_flow.h +++ b/drivers/net/mlx5/mlx5_flow.h @@ -204,6 +204,7 @@ struct mlx5_flow_dv_matcher { uint16_t crc; /**< CRC of key. */ uint16_t priority; /**< Priority of matcher. */ uint8_t egress; /**< Egress matcher. */ + uint32_t group; /**< The matcher group. */ struct mlx5_flow_dv_match_params mask; /**< Matcher mask. */ }; =20 @@ -220,6 +221,7 @@ struct mlx5_flow_dv_encap_decap_resource { size_t size; uint8_t reformat_type; uint8_t ft_type; + uint64_t flags; /**< Flags for RDMA API. */ }; =20 /* Tag resource structure. */ @@ -348,7 +350,7 @@ struct mlx5_flow_counter { /* Flow structure. */ struct rte_flow { TAILQ_ENTRY(rte_flow) next; /**< Pointer to the next flow structure. */ - enum mlx5_flow_drv_type drv_type; /**< Drvier type. */ + enum mlx5_flow_drv_type drv_type; /**< Driver type. */ struct mlx5_flow_counter *counter; /**< Holds flow counter. */ struct mlx5_flow_dv_tag_resource *tag_resource; /**< pointer to the tag action. */ @@ -360,6 +362,8 @@ struct rte_flow { uint64_t actions; /**< Bit-fields of detected actions, see MLX5_FLOW_ACTION_*. */ struct mlx5_fdir *fdir; /**< Pointer to associated FDIR if any. */ + uint8_t ingress; /**< 1 if the flow is ingress. */ + uint32_t group; /**< The group index. */ }; =20 typedef int (*mlx5_flow_validate_t)(struct rte_eth_dev *dev, diff --git a/drivers/net/mlx5/mlx5_flow_dv.c b/drivers/net/mlx5/mlx5_flow_d= v.c index 0eb3a28..228ba3f 100644 --- a/drivers/net/mlx5/mlx5_flow_dv.c +++ b/drivers/net/mlx5/mlx5_flow_dv.c @@ -805,11 +805,20 @@ struct field_modify_info modify_tcp[] =3D { { struct mlx5_priv *priv =3D dev->data->dev_private; struct mlx5_flow_dv_encap_decap_resource *cache_resource; + struct rte_flow *flow =3D dev_flow->flow; + struct mlx5dv_dr_ns *ns; + + resource->flags =3D flow->group ? 0 : 1; + if (flow->ingress) + ns =3D priv->rx_ns; + else + ns =3D priv->tx_ns; =20 /* Lookup a matching resource from cache. */ LIST_FOREACH(cache_resource, &priv->encaps_decaps, next) { if (resource->reformat_type =3D=3D cache_resource->reformat_type && resource->ft_type =3D=3D cache_resource->ft_type && + resource->flags =3D=3D cache_resource->flags && resource->size =3D=3D cache_resource->size && !memcmp((const void *)resource->buf, (const void *)cache_resource->buf, @@ -831,10 +840,10 @@ struct field_modify_info modify_tcp[] =3D { *cache_resource =3D *resource; cache_resource->verbs_action =3D mlx5_glue->dv_create_flow_action_packet_reformat - (priv->ctx, cache_resource->size, - (cache_resource->size ? cache_resource->buf : NULL), - cache_resource->reformat_type, - cache_resource->ft_type); + (priv->ctx, cache_resource->reformat_type, + cache_resource->ft_type, ns, cache_resource->flags, + cache_resource->size, + (cache_resource->size ? cache_resource->buf : NULL)); if (!cache_resource->verbs_action) { rte_free(cache_resource); return rte_flow_error_set(error, ENOMEM, @@ -1438,6 +1447,10 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_priv *priv =3D dev->data->dev_private; struct mlx5_flow_dv_modify_hdr_resource *cache_resource; =20 + struct mlx5dv_dr_ns *ns =3D + resource->ft_type =3D=3D MLX5DV_FLOW_TABLE_TYPE_NIC_TX ? + priv->tx_ns : priv->rx_ns; + /* Lookup a matching resource from cache. */ LIST_FOREACH(cache_resource, &priv->modify_cmds, next) { if (resource->ft_type =3D=3D cache_resource->ft_type && @@ -1463,11 +1476,11 @@ struct field_modify_info modify_tcp[] =3D { *cache_resource =3D *resource; cache_resource->verbs_action =3D mlx5_glue->dv_create_flow_action_modify_header - (priv->ctx, + (priv->ctx, cache_resource->ft_type, + ns, 0, cache_resource->actions_num * sizeof(cache_resource->actions[0]), - (uint64_t *)cache_resource->actions, - cache_resource->ft_type); + (uint64_t *)cache_resource->actions); if (!cache_resource->verbs_action) { rte_free(cache_resource); return rte_flow_error_set(error, ENOMEM, @@ -1592,11 +1605,13 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_priv *priv =3D dev->data->dev_private; uint32_t priority_max =3D priv->config.flow_prio - 1; =20 +#ifdef HAVE_MLX5DV_DR if (attributes->group) return rte_flow_error_set(error, ENOTSUP, RTE_FLOW_ERROR_TYPE_ATTR_GROUP, NULL, "groups is not supported"); +#endif if (attributes->priority !=3D MLX5_FLOW_PRIO_RSVD && attributes->priority >=3D priority_max) return rte_flow_error_set(error, ENOTSUP, @@ -2723,7 +2738,11 @@ struct field_modify_info modify_tcp[] =3D { match_criteria_enable |=3D (!HEADER_IS_ZERO(match_criteria, misc_parameters_2)) << MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT; - +#ifdef HAVE_MLX5DV_DR + match_criteria_enable |=3D + (!HEADER_IS_ZERO(match_criteria, misc_parameters_3)) << + MLX5_MATCH_CRITERIA_ENABLE_MISC3_BIT; +#endif return match_criteria_enable; } =20 @@ -2754,12 +2773,14 @@ struct field_modify_info modify_tcp[] =3D { .type =3D IBV_FLOW_ATTR_NORMAL, .match_mask =3D (void *)&matcher->mask, }; + struct mlx5_flow_tbl_resource *tbl; =20 /* Lookup from cache. */ LIST_FOREACH(cache_matcher, &priv->matchers, next) { if (matcher->crc =3D=3D cache_matcher->crc && matcher->priority =3D=3D cache_matcher->priority && matcher->egress =3D=3D cache_matcher->egress && + matcher->group =3D=3D cache_matcher->group && !memcmp((const void *)matcher->mask.buf, (const void *)cache_matcher->mask.buf, cache_matcher->mask.size)) { @@ -2774,6 +2795,27 @@ struct field_modify_info modify_tcp[] =3D { return 0; } } +#ifdef HAVE_MLX5DV_DR + if (matcher->egress) { + tbl =3D &priv->tx_tbl[matcher->group]; + if (!tbl->obj) + tbl->obj =3D mlx5_glue->dr_create_flow_tbl + (priv->tx_ns, + matcher->group * MLX5_GROUP_FACTOR); + } else { + tbl =3D &priv->rx_tbl[matcher->group]; + if (!tbl->obj) + tbl->obj =3D mlx5_glue->dr_create_flow_tbl + (priv->rx_ns, + matcher->group * MLX5_GROUP_FACTOR); + } + if (!tbl->obj) + return rte_flow_error_set(error, ENOMEM, + RTE_FLOW_ERROR_TYPE_UNSPECIFIED, + NULL, "cannot create table"); + + rte_atomic32_inc(&tbl->refcnt); +#endif /* Register new matcher. */ cache_matcher =3D rte_calloc(__func__, 1, sizeof(*cache_matcher), 0); if (!cache_matcher) @@ -2787,9 +2829,16 @@ struct field_modify_info modify_tcp[] =3D { if (matcher->egress) dv_attr.flags |=3D IBV_FLOW_ATTR_FLAGS_EGRESS; cache_matcher->matcher_object =3D - mlx5_glue->dv_create_flow_matcher(priv->ctx, &dv_attr); + mlx5_glue->dv_create_flow_matcher(priv->ctx, &dv_attr, + tbl->obj); if (!cache_matcher->matcher_object) { rte_free(cache_matcher); +#ifdef HAVE_MLX5DV_DR + if (rte_atomic32_dec_and_test(&tbl->refcnt)) { + mlx5_glue->dr_destroy_flow_tbl(tbl->obj); + tbl->obj =3D NULL; + } +#endif return rte_flow_error_set(error, ENOMEM, RTE_FLOW_ERROR_TYPE_UNSPECIFIED, NULL, "cannot create matcher"); @@ -2801,6 +2850,7 @@ struct field_modify_info modify_tcp[] =3D { cache_matcher->priority, cache_matcher->egress ? "tx" : "rx", (void *)cache_matcher, rte_atomic32_read(&cache_matcher->refcnt)); + rte_atomic32_inc(&tbl->refcnt); return 0; } =20 @@ -3276,6 +3326,7 @@ struct field_modify_info modify_tcp[] =3D { matcher.priority =3D mlx5_flow_adjust_priority(dev, priority, matcher.priority); matcher.egress =3D attr->egress; + matcher.group =3D attr->group; if (flow_dv_matcher_register(dev, &matcher, dev_flow, error)) return -rte_errno; return 0; @@ -3391,6 +3442,8 @@ struct field_modify_info modify_tcp[] =3D { struct mlx5_flow *flow) { struct mlx5_flow_dv_matcher *matcher =3D flow->dv.matcher; + struct mlx5_priv *priv =3D dev->data->dev_private; + struct mlx5_flow_tbl_resource *tbl; =20 assert(matcher->matcher_object); DRV_LOG(DEBUG, "port %u matcher %p: refcnt %d--", @@ -3400,6 +3453,14 @@ struct field_modify_info modify_tcp[] =3D { claim_zero(mlx5_glue->dv_destroy_flow_matcher (matcher->matcher_object)); LIST_REMOVE(matcher, next); + if (matcher->egress) + tbl =3D &priv->tx_tbl[matcher->group]; + else + tbl =3D &priv->rx_tbl[matcher->group]; + if (rte_atomic32_dec_and_test(&tbl->refcnt)) { + mlx5_glue->dr_destroy_flow_tbl(tbl->obj); + tbl->obj =3D NULL; + } rte_free(matcher); DRV_LOG(DEBUG, "port %u matcher %p: removed", dev->data->port_id, (void *)matcher); @@ -3489,7 +3550,7 @@ struct field_modify_info modify_tcp[] =3D { LIST_FOREACH(dev_flow, &flow->dev_flows, next) { dv =3D &dev_flow->dv; if (dv->flow) { - claim_zero(mlx5_glue->destroy_flow(dv->flow)); + claim_zero(mlx5_glue->dv_destroy_flow(dv->flow)); dv->flow =3D NULL; } if (dv->hrxq) { diff --git a/drivers/net/mlx5/mlx5_glue.c b/drivers/net/mlx5/mlx5_glue.c index cfd939d..f509f85 100644 --- a/drivers/net/mlx5/mlx5_glue.c +++ b/drivers/net/mlx5/mlx5_glue.c @@ -178,6 +178,9 @@ mlx5_glue_destroy_flow_action(void *action) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_action(action); +#else struct mlx5dv_flow_action_attr *attr =3D action; int res =3D 0; switch (attr->type) { @@ -189,6 +192,7 @@ } free(action); return res; +#endif #else (void)action; return ENOTSUP; @@ -365,6 +369,53 @@ return ibv_cq_ex_to_cq(cq); } =20 +static void * +mlx5_glue_dr_create_flow_tbl(void *ns, uint32_t level) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_ft(ns, level); +#else + (void)ns; + (void)level; + return NULL; +#endif +} + +static int +mlx5_glue_dr_destroy_flow_tbl(void *tbl) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_ft(tbl); +#else + (void)tbl; + return 0; +#endif +} + +static void * +mlx5_glue_dr_create_ns(struct ibv_context *ctx, + enum mlx5dv_dr_ns_domain domain) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_ns(ctx, domain); +#else + (void)ctx; + (void)domain; + return NULL; +#endif +} + +static int +mlx5_glue_dr_destroy_ns(void *ns) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_ns(ns); +#else + (void)ns; + return 0; +#endif +} + static struct ibv_cq_ex * mlx5_glue_dv_create_cq(struct ibv_context *context, struct ibv_cq_init_attr_ex *cq_attr, @@ -423,26 +474,40 @@ #endif } =20 -static struct mlx5dv_flow_matcher * +static void * mlx5_glue_dv_create_flow_matcher(struct ibv_context *context, - struct mlx5dv_flow_matcher_attr *matcher_attr) + struct mlx5dv_flow_matcher_attr *matcher_attr, + void *tbl) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)context; + return mlx5dv_dr_create_matcher(tbl, matcher_attr->priority, + matcher_attr->match_criteria_enable, + matcher_attr->match_mask); +#else + (void)tbl; return mlx5dv_create_flow_matcher(context, matcher_attr); +#endif #else (void)context; (void)matcher_attr; + (void)tbl; return NULL; #endif } =20 -static struct ibv_flow * -mlx5_glue_dv_create_flow(struct mlx5dv_flow_matcher *matcher, - struct mlx5dv_flow_match_parameters *match_value, +static void * +mlx5_glue_dv_create_flow(void *matcher, + void *match_value, size_t num_actions, void *actions[]) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_rule(matcher, match_value, num_actions, + (struct mlx5dv_dr_action **)actions); +#else struct mlx5dv_flow_action_attr actions_attr[8]; =20 if (num_actions > 8) @@ -452,6 +517,7 @@ *((struct mlx5dv_flow_action_attr *)(actions[i])); return mlx5dv_create_flow(matcher, match_value, num_actions, actions_attr); +#endif #else (void)matcher; (void)match_value; @@ -461,21 +527,13 @@ #endif } =20 -static int -mlx5_glue_dv_destroy_flow_matcher(struct mlx5dv_flow_matcher *matcher) -{ -#ifdef HAVE_IBV_FLOW_DV_SUPPORT - return mlx5dv_destroy_flow_matcher(matcher); -#else - (void)matcher; - return 0; -#endif -} - static void * mlx5_glue_dv_create_flow_action_counter(void *counter_obj, uint32_t offset= ) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_devx_counter(counter_obj, offset); +#else struct mlx5dv_flow_action_attr *action; =20 (void)offset; @@ -485,6 +543,7 @@ action->type =3D MLX5DV_FLOW_ACTION_COUNTER_DEVX; action->obj =3D counter_obj; return action; +#endif #else (void)counter_obj; (void)offset; @@ -496,6 +555,9 @@ mlx5_glue_dv_create_flow_action_dest_ibv_qp(void *qp) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_dest_ibv_qp(qp); +#else struct mlx5dv_flow_action_attr *action; =20 action =3D malloc(sizeof(*action)); @@ -504,6 +566,7 @@ action->type =3D MLX5DV_FLOW_ACTION_DEST_IBV_QP; action->obj =3D qp; return action; +#endif #else (void)qp; return NULL; @@ -513,13 +576,22 @@ static void * mlx5_glue_dv_create_flow_action_modify_header (struct ibv_context *ctx, + enum mlx5dv_flow_table_type ft_type, + void *ns, uint64_t flags, size_t actions_sz, - uint64_t actions[], - enum mlx5dv_flow_table_type ft_type) + uint64_t actions[]) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)ctx; + (void)ft_type; + return mlx5dv_dr_create_action_modify_header(ns, flags, actions_sz, + actions); +#else struct mlx5dv_flow_action_attr *action; =20 + (void)ns; + (void)flags; action =3D malloc(sizeof(*action)); if (!action) return NULL; @@ -527,11 +599,14 @@ action->action =3D mlx5dv_create_flow_action_modify_header (ctx, actions_sz, actions, ft_type); return action; +#endif #else (void)ctx; + (void)ft_type; + (void)ns; + (void)flags; (void)actions_sz; (void)actions; - (void)ft_type; return NULL; #endif } @@ -539,12 +614,20 @@ static void * mlx5_glue_dv_create_flow_action_packet_reformat (struct ibv_context *ctx, - size_t data_sz, - void *data, enum mlx5dv_flow_action_packet_reformat_type reformat_type, - enum mlx5dv_flow_table_type ft_type) + enum mlx5dv_flow_table_type ft_type, struct mlx5dv_dr_ns *ns, + uint32_t flags, size_t data_sz, void *data) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + (void)ctx; + (void)ft_type; + return mlx5dv_dr_create_action_packet_reformat(ns, flags, + reformat_type, data_sz, + data); +#else + (void)ns; + (void)flags; struct mlx5dv_flow_action_attr *action; =20 action =3D malloc(sizeof(*action)); @@ -554,12 +637,15 @@ action->action =3D mlx5dv_create_flow_action_packet_reformat (ctx, data_sz, data, reformat_type, ft_type); return action; +#endif #else (void)ctx; - (void)data_sz; - (void)data; (void)reformat_type; (void)ft_type; + (void)ns; + (void)flags; + (void)data_sz; + (void)data; return NULL; #endif } @@ -568,6 +654,9 @@ mlx5_glue_dv_create_flow_action_tag(uint32_t tag) { #ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_create_action_tag(tag); +#else struct mlx5dv_flow_action_attr *action; action =3D malloc(sizeof(*action)); if (!action) @@ -576,10 +665,36 @@ action->tag_value =3D tag; return action; #endif +#endif (void)tag; return NULL; } =20 +static int +mlx5_glue_dv_destroy_flow(void *flow_id) +{ +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_rule(flow_id); +#else + return ibv_destroy_flow(flow_id); +#endif +} + +static int +mlx5_glue_dv_destroy_flow_matcher(void *matcher) +{ +#ifdef HAVE_IBV_FLOW_DV_SUPPORT +#ifdef HAVE_MLX5DV_DR + return mlx5dv_dr_destroy_matcher(matcher); +#else + return mlx5dv_destroy_flow_matcher(matcher); +#endif +#else + (void)matcher; + return 0; +#endif +} + static struct ibv_context * mlx5_glue_dv_open_device(struct ibv_device *device) { @@ -718,6 +833,10 @@ .get_async_event =3D mlx5_glue_get_async_event, .port_state_str =3D mlx5_glue_port_state_str, .cq_ex_to_cq =3D mlx5_glue_cq_ex_to_cq, + .dr_create_flow_tbl =3D mlx5_glue_dr_create_flow_tbl, + .dr_destroy_flow_tbl =3D mlx5_glue_dr_destroy_flow_tbl, + .dr_create_ns =3D mlx5_glue_dr_create_ns, + .dr_destroy_ns =3D mlx5_glue_dr_destroy_ns, .dv_create_cq =3D mlx5_glue_dv_create_cq, .dv_create_wq =3D mlx5_glue_dv_create_wq, .dv_query_device =3D mlx5_glue_dv_query_device, @@ -725,7 +844,6 @@ .dv_init_obj =3D mlx5_glue_dv_init_obj, .dv_create_qp =3D mlx5_glue_dv_create_qp, .dv_create_flow_matcher =3D mlx5_glue_dv_create_flow_matcher, - .dv_destroy_flow_matcher =3D mlx5_glue_dv_destroy_flow_matcher, .dv_create_flow =3D mlx5_glue_dv_create_flow, .dv_create_flow_action_counter =3D mlx5_glue_dv_create_flow_action_counter, @@ -736,6 +854,8 @@ .dv_create_flow_action_packet_reformat =3D mlx5_glue_dv_create_flow_action_packet_reformat, .dv_create_flow_action_tag =3D mlx5_glue_dv_create_flow_action_tag, + .dv_destroy_flow =3D mlx5_glue_dv_destroy_flow, + .dv_destroy_flow_matcher =3D mlx5_glue_dv_destroy_flow_matcher, .dv_open_device =3D mlx5_glue_dv_open_device, .devx_obj_create =3D mlx5_glue_devx_obj_create, .devx_obj_destroy =3D mlx5_glue_devx_obj_destroy, diff --git a/drivers/net/mlx5/mlx5_glue.h b/drivers/net/mlx5/mlx5_glue.h index 167f1f7..7115575 100644 --- a/drivers/net/mlx5/mlx5_glue.h +++ b/drivers/net/mlx5/mlx5_glue.h @@ -63,6 +63,11 @@ struct mlx5dv_devx_obj; #endif =20 +#ifndef HAVE_MLX5DV_DR +struct mlx5dv_dr_ns; +enum mlx5dv_dr_ns_domain { unused, }; +#endif + /* LIB_GLUE_VERSION must be updated every time this structure is modified.= */ struct mlx5_glue { const char *version; @@ -140,6 +145,11 @@ struct mlx5_glue { struct ibv_async_event *event); const char *(*port_state_str)(enum ibv_port_state port_state); struct ibv_cq *(*cq_ex_to_cq)(struct ibv_cq_ex *cq); + void *(*dr_create_flow_tbl)(void *ns, uint32_t level); + int (*dr_destroy_flow_tbl)(void *tbl); + void *(*dr_create_ns)(struct ibv_context *ctx, + enum mlx5dv_dr_ns_domain domain); + int (*dr_destroy_ns)(void *ns); struct ibv_cq_ex *(*dv_create_cq) (struct ibv_context *context, struct ibv_cq_init_attr_ex *cq_attr, @@ -158,23 +168,26 @@ struct mlx5_glue { (struct ibv_context *context, struct ibv_qp_init_attr_ex *qp_init_attr_ex, struct mlx5dv_qp_init_attr *dv_qp_init_attr); - struct mlx5dv_flow_matcher *(*dv_create_flow_matcher) + void *(*dv_create_flow_matcher) (struct ibv_context *context, - struct mlx5dv_flow_matcher_attr *matcher_attr); - int (*dv_destroy_flow_matcher)(struct mlx5dv_flow_matcher *matcher); - struct ibv_flow *(*dv_create_flow)(struct mlx5dv_flow_matcher *matcher, - struct mlx5dv_flow_match_parameters *match_value, + struct mlx5dv_flow_matcher_attr *matcher_attr, + void *tbl); + void *(*dv_create_flow)(void *matcher, void *match_value, size_t num_actions, void *actions[]); void *(*dv_create_flow_action_counter)(void *obj, uint32_t offset); void *(*dv_create_flow_action_dest_ibv_qp)(void *qp); void *(*dv_create_flow_action_modify_header) - (struct ibv_context *ctx, size_t actions_sz, uint64_t actions[], - enum mlx5dv_flow_table_type ft_type); + (struct ibv_context *ctx, enum mlx5dv_flow_table_type ft_type, + void *ns, uint64_t flags, size_t actions_sz, + uint64_t actions[]); void *(*dv_create_flow_action_packet_reformat) - (struct ibv_context *ctx, size_t data_sz, void *data, + (struct ibv_context *ctx, enum mlx5dv_flow_action_packet_reformat_type reformat_type, - enum mlx5dv_flow_table_type ft_type); + enum mlx5dv_flow_table_type ft_type, struct mlx5dv_dr_ns *ns, + uint32_t flags, size_t data_sz, void *data); void *(*dv_create_flow_action_tag)(uint32_t tag); + int (*dv_destroy_flow)(void *flow); + int (*dv_destroy_flow_matcher)(void *matcher); struct ibv_context *(*dv_open_device)(struct ibv_device *device); struct mlx5dv_devx_obj *(*devx_obj_create) (struct ibv_context *ctx, diff --git a/drivers/net/mlx5/mlx5_prm.h b/drivers/net/mlx5/mlx5_prm.h index da1219e..b15266f 100644 --- a/drivers/net/mlx5/mlx5_prm.h +++ b/drivers/net/mlx5/mlx5_prm.h @@ -492,20 +492,40 @@ struct mlx5_ifc_fte_match_set_misc2_bits { u8 reserved_at_1a0[0x60]; }; =20 +struct mlx5_ifc_fte_match_set_misc3_bits { + u8 inner_tcp_seq_num[0x20]; + u8 outer_tcp_seq_num[0x20]; + u8 inner_tcp_ack_num[0x20]; + u8 outer_tcp_ack_num[0x20]; + u8 reserved_at_auto1[0x8]; + u8 outer_vxlan_gpe_vni[0x18]; + u8 outer_vxlan_gpe_next_protocol[0x8]; + u8 outer_vxlan_gpe_flags[0x8]; + u8 reserved_at_a8[0x10]; + u8 icmp_header_data[0x20]; + u8 icmpv6_header_data[0x20]; + u8 icmp_type[0x8]; + u8 icmp_code[0x8]; + u8 icmpv6_type[0x8]; + u8 icmpv6_code[0x8]; + u8 reserved_at_1a0[0xe0]; +}; + /* Flow matcher. */ struct mlx5_ifc_fte_match_param_bits { struct mlx5_ifc_fte_match_set_lyr_2_4_bits outer_headers; struct mlx5_ifc_fte_match_set_misc_bits misc_parameters; struct mlx5_ifc_fte_match_set_lyr_2_4_bits inner_headers; struct mlx5_ifc_fte_match_set_misc2_bits misc_parameters_2; - u8 reserved_at_800[0x800]; + struct mlx5_ifc_fte_match_set_misc3_bits misc_parameters_3; }; =20 enum { MLX5_MATCH_CRITERIA_ENABLE_OUTER_BIT, MLX5_MATCH_CRITERIA_ENABLE_MISC_BIT, MLX5_MATCH_CRITERIA_ENABLE_INNER_BIT, - MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT + MLX5_MATCH_CRITERIA_ENABLE_MISC2_BIT, + MLX5_MATCH_CRITERIA_ENABLE_MISC3_BIT }; =20 enum { --=20 1.8.3.1