From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 829B9A0518 for ; Fri, 24 Jul 2020 14:11:42 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 7B13C1C012; Fri, 24 Jul 2020 14:11:42 +0200 (CEST) Received: from mail-wr1-f66.google.com (mail-wr1-f66.google.com [209.85.221.66]) by dpdk.org (Postfix) with ESMTP id 108661C012 for ; Fri, 24 Jul 2020 14:11:41 +0200 (CEST) Received: by mail-wr1-f66.google.com with SMTP id y3so8095298wrl.4 for ; Fri, 24 Jul 2020 05:11:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=p242nnJhE0dEW0eNlQvrM8lt8ruuEsspFB6D/wo/av4=; b=XCovCtgps8jSdNBBZs7IVDsGRxnU7UKuKTUhTNR8LTL1r3UHapbLvZcmBsZ6/N1Obr qwlw3JKZQBouugmZ2ycKNJxgaEjZ6J+bCKi0q9Z+kkwvtRIV1cii0VnY6YhRj50wmnnA LaJLVWlJI5FB0wt9/3bXmO5TlMKucjWZqIQMW3a5jMuBqKMgwO5gg3rDTFvyT3NX3cTA tNzxir8o4bZAHG2RaU7QTBrl4AQQefOWLYZaEJt/+cW9RSRWjfNI6+YPI3aZmzVb1TaI fMks2wn4pTC9iS6Vn819lwuZpeMaI4DuJjAkbYARjJ/DWNACcA1YL/dei5nvE7/gcAAq neqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=p242nnJhE0dEW0eNlQvrM8lt8ruuEsspFB6D/wo/av4=; b=TE/rMOvHxE83GQNRr236uIzGBEfQfbXYamJudamnWo7+aiChkbnZt8IGQHpCBWMC+t xPNiMiCtgq8h/XYNPlqE52G/nOsRlmw4nNB2HcTgaUsz2joGddS7QvvoeVtsiE09qtHz pKVfyCR55mODjbMKOA9ar66Ke2wMNpiGnT6+xwTV2Z4St+4EEMm5KvyUL724lkD3o/Gq gxy2KRQtV4fgN3HAcal5BHdhL9V7CUJeO2qOlSwbuAEmFO6J0go0Xty9z4ovqkKuBqst bmNdGZpEVNkyVa6yOMb/sqMFOAaubk0ibh++fkMF7rPhbayCLJuRCOKcQJhlqT0PDd56 LaNg== X-Gm-Message-State: AOAM531H6n/Thmc0TiqpRxbD96gyoDCg84lcgIPV0fsapgRZfhztn1DG kkm3u4n3oD87bSXwbdEFSxw= X-Google-Smtp-Source: ABdhPJzkzPS6CFrZJ47K6P9Iz/q9pz9uTcGM7smQ/QdUbGzw49oggMUqyF3F4sMsIOmnPr+kX4/duw== X-Received: by 2002:adf:ed48:: with SMTP id u8mr8867036wro.64.1595592700620; Fri, 24 Jul 2020 05:11:40 -0700 (PDT) Received: from localhost ([88.98.246.218]) by smtp.gmail.com with ESMTPSA id v1sm1090515wro.83.2020.07.24.05.11.39 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 24 Jul 2020 05:11:39 -0700 (PDT) From: luca.boccassi@gmail.com To: Viacheslav Ovsiienko Cc: Matan Azrad , dpdk stable Date: Fri, 24 Jul 2020 13:00:09 +0100 Message-Id: <20200724120030.1863487-171-luca.boccassi@gmail.com> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20200724120030.1863487-1-luca.boccassi@gmail.com> References: <20200724120030.1863487-1-luca.boccassi@gmail.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [dpdk-stable] patch 'net/mlx5: fix UAR lock sharing for multiport devices' has been queued to stable release 19.11.4 X-BeenThere: stable@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches for DPDK stable branches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: stable-bounces@dpdk.org Sender: "stable" Hi, FYI, your patch has been queued to stable release 19.11.4 Note it hasn't been pushed to http://dpdk.org/browse/dpdk-stable yet. It will be pushed if I get no objections before 07/26/20. So please shout if anyone has objections. Also note that after the patch there's a diff of the upstream commit vs the patch applied to the branch. This will indicate if there was any rebasing needed to apply to the stable branch. If there were code changes for rebasing (ie: not only metadata diffs), please double check that the rebase was correctly done. Thanks. Luca Boccassi --- >From cb42557252097729c0631a76c99343c752ebfb93 Mon Sep 17 00:00:00 2001 From: Viacheslav Ovsiienko Date: Thu, 16 Jul 2020 08:23:06 +0000 Subject: [PATCH] net/mlx5: fix UAR lock sharing for multiport devices [ upstream commit 24feb04596af9ca1893fb589d6a0404ebe088771 ] The master and representors might be created over the multiport Infiniband devices and the UAR resource allocated for sibling ports might belong to the same underlying Infiniband device. Hardware requires the write access to the UAR must be performed as atomic 64-bit write, on 32-bit systems this is two sequential writes, protected by lock. Due to possibility to share the same UAR between sibling devices the locks must be moved to shared context. Fixes: f048f3d479a6 ("net/mlx5: switch to the shared IB device context") Signed-off-by: Viacheslav Ovsiienko Acked-by: Matan Azrad --- drivers/net/mlx5/mlx5.c | 12 ++++++------ drivers/net/mlx5/mlx5.h | 10 +++++----- drivers/net/mlx5/mlx5_rxq.c | 2 +- drivers/net/mlx5/mlx5_txq.c | 2 +- 4 files changed, 13 insertions(+), 13 deletions(-) diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c index ce76c96db..c97e54251 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c @@ -687,6 +687,12 @@ mlx5_alloc_shared_ibctx(const struct mlx5_dev_spawn_data *spawn, goto error; } #endif /* HAVE_IBV_FLOW_DV_SUPPORT */ +#ifndef RTE_ARCH_64 + /* Initialize UAR access locks for 32bit implementations. */ + rte_spinlock_init(&sh->uar_lock_cq); + for (i = 0; i < MLX5_UAR_PAGE_NUM_MAX; i++) + rte_spinlock_init(&sh->uar_lock[i]); +#endif /* * Once the device is added to the list of memory event * callback, its global MR cache table cannot be expanded @@ -2399,12 +2405,6 @@ err_secondary: priv->ibv_port = spawn->ibv_port; priv->pci_dev = spawn->pci_dev; priv->mtu = RTE_ETHER_MTU; -#ifndef RTE_ARCH_64 - /* Initialize UAR access locks for 32bit implementations. */ - rte_spinlock_init(&priv->uar_lock_cq); - for (i = 0; i < MLX5_UAR_PAGE_NUM_MAX; i++) - rte_spinlock_init(&priv->uar_lock[i]); -#endif /* Some internal functions rely on Netlink sockets, open them now. */ priv->nl_socket_rdma = mlx5_nl_init(NETLINK_RDMA); priv->nl_socket_route = mlx5_nl_init(NETLINK_ROUTE); diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h index e53934d45..130aed0e5 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h @@ -669,6 +669,11 @@ struct mlx5_ibv_shared { void *fdb_domain; /* FDB Direct Rules name space handle. */ void *rx_domain; /* RX Direct Rules name space handle. */ void *tx_domain; /* TX Direct Rules name space handle. */ +#ifndef RTE_ARCH_64 + rte_spinlock_t uar_lock_cq; /* CQs share a common distinct UAR */ + rte_spinlock_t uar_lock[MLX5_UAR_PAGE_NUM_MAX]; + /* UAR same-page access control required in 32bit implementations. */ +#endif struct mlx5_hlist *flow_tbls; /* Direct Rules tables for FDB, NIC TX+RX */ void *esw_drop_action; /* Pointer to DR E-Switch drop action. */ @@ -777,11 +782,6 @@ struct mlx5_priv { uint8_t mtr_color_reg; /* Meter color match REG_C. */ struct mlx5_mtr_profiles flow_meter_profiles; /* MTR profile list. */ struct mlx5_flow_meters flow_meters; /* MTR list. */ -#ifndef RTE_ARCH_64 - rte_spinlock_t uar_lock_cq; /* CQs share a common distinct UAR */ - rte_spinlock_t uar_lock[MLX5_UAR_PAGE_NUM_MAX]; - /* UAR same-page access control required in 32bit implementations. */ -#endif uint8_t skip_default_rss_reta; /* Skip configuration of default reta. */ uint8_t fdb_def_rule; /* Whether fdb jump to table 1 is configured. */ }; diff --git a/drivers/net/mlx5/mlx5_rxq.c b/drivers/net/mlx5/mlx5_rxq.c index e9e8f1278..970ce5cd0 100644 --- a/drivers/net/mlx5/mlx5_rxq.c +++ b/drivers/net/mlx5/mlx5_rxq.c @@ -1975,7 +1975,7 @@ mlx5_rxq_new(struct rte_eth_dev *dev, uint16_t idx, uint16_t desc, tmpl->rxq.elts = (struct rte_mbuf *(*)[1 << tmpl->rxq.elts_n])(tmpl + 1); #ifndef RTE_ARCH_64 - tmpl->rxq.uar_lock_cq = &priv->uar_lock_cq; + tmpl->rxq.uar_lock_cq = &priv->sh->uar_lock_cq; #endif tmpl->rxq.idx = idx; rte_atomic32_inc(&tmpl->refcnt); diff --git a/drivers/net/mlx5/mlx5_txq.c b/drivers/net/mlx5/mlx5_txq.c index ff1e4fc85..0b092c4a9 100644 --- a/drivers/net/mlx5/mlx5_txq.c +++ b/drivers/net/mlx5/mlx5_txq.c @@ -352,7 +352,7 @@ txq_uar_init(struct mlx5_txq_ctrl *txq_ctrl) /* Assign an UAR lock according to UAR page number */ lock_idx = (txq_ctrl->uar_mmap_offset / page_size) & MLX5_UAR_PAGE_NUM_MASK; - txq_ctrl->txq.uar_lock = &priv->uar_lock[lock_idx]; + txq_ctrl->txq.uar_lock = &priv->sh->uar_lock[lock_idx]; #endif } -- 2.20.1 --- Diff of the applied patch vs upstream commit (please double-check if non-empty: --- --- - 2020-07-24 12:53:55.146347382 +0100 +++ 0171-net-mlx5-fix-UAR-lock-sharing-for-multiport-devices.patch 2020-07-24 12:53:48.575011825 +0100 @@ -1,8 +1,10 @@ -From 24feb04596af9ca1893fb589d6a0404ebe088771 Mon Sep 17 00:00:00 2001 +From cb42557252097729c0631a76c99343c752ebfb93 Mon Sep 17 00:00:00 2001 From: Viacheslav Ovsiienko Date: Thu, 16 Jul 2020 08:23:06 +0000 Subject: [PATCH] net/mlx5: fix UAR lock sharing for multiport devices +[ upstream commit 24feb04596af9ca1893fb589d6a0404ebe088771 ] + The master and representors might be created over the multiport Infiniband devices and the UAR resource allocated for sibling ports might belong to the same underlying Infiniband device. @@ -13,43 +15,24 @@ context. Fixes: f048f3d479a6 ("net/mlx5: switch to the shared IB device context") -Cc: stable@dpdk.org Signed-off-by: Viacheslav Ovsiienko Acked-by: Matan Azrad --- - drivers/net/mlx5/linux/mlx5_os.c | 6 ------ - drivers/net/mlx5/mlx5.c | 6 ++++++ - drivers/net/mlx5/mlx5.h | 10 +++++----- - drivers/net/mlx5/mlx5_rxq.c | 2 +- - drivers/net/mlx5/mlx5_txq.c | 2 +- - 5 files changed, 13 insertions(+), 13 deletions(-) + drivers/net/mlx5/mlx5.c | 12 ++++++------ + drivers/net/mlx5/mlx5.h | 10 +++++----- + drivers/net/mlx5/mlx5_rxq.c | 2 +- + drivers/net/mlx5/mlx5_txq.c | 2 +- + 4 files changed, 13 insertions(+), 13 deletions(-) -diff --git a/drivers/net/mlx5/linux/mlx5_os.c b/drivers/net/mlx5/linux/mlx5_os.c -index 14af468d6..63e9350a0 100644 ---- a/drivers/net/mlx5/linux/mlx5_os.c -+++ b/drivers/net/mlx5/linux/mlx5_os.c -@@ -630,12 +630,6 @@ err_secondary: - priv->mtu = RTE_ETHER_MTU; - priv->mp_id.port_id = port_id; - strlcpy(priv->mp_id.name, MLX5_MP_NAME, RTE_MP_MAX_NAME_LEN); --#ifndef RTE_ARCH_64 -- /* Initialize UAR access locks for 32bit implementations. */ -- rte_spinlock_init(&priv->uar_lock_cq); -- for (i = 0; i < MLX5_UAR_PAGE_NUM_MAX; i++) -- rte_spinlock_init(&priv->uar_lock[i]); --#endif - /* Some internal functions rely on Netlink sockets, open them now. */ - priv->nl_socket_rdma = mlx5_nl_init(NETLINK_RDMA); - priv->nl_socket_route = mlx5_nl_init(NETLINK_ROUTE); diff --git a/drivers/net/mlx5/mlx5.c b/drivers/net/mlx5/mlx5.c -index 72e0870eb..0786945ce 100644 +index ce76c96db..c97e54251 100644 --- a/drivers/net/mlx5/mlx5.c +++ b/drivers/net/mlx5/mlx5.c -@@ -717,6 +717,12 @@ mlx5_alloc_shared_dev_ctx(const struct mlx5_dev_spawn_data *spawn, - err = ENOMEM; +@@ -687,6 +687,12 @@ mlx5_alloc_shared_ibctx(const struct mlx5_dev_spawn_data *spawn, goto error; } + #endif /* HAVE_IBV_FLOW_DV_SUPPORT */ +#ifndef RTE_ARCH_64 + /* Initialize UAR access locks for 32bit implementations. */ + rte_spinlock_init(&sh->uar_lock_cq); @@ -59,11 +42,24 @@ /* * Once the device is added to the list of memory event * callback, its global MR cache table cannot be expanded +@@ -2399,12 +2405,6 @@ err_secondary: + priv->ibv_port = spawn->ibv_port; + priv->pci_dev = spawn->pci_dev; + priv->mtu = RTE_ETHER_MTU; +-#ifndef RTE_ARCH_64 +- /* Initialize UAR access locks for 32bit implementations. */ +- rte_spinlock_init(&priv->uar_lock_cq); +- for (i = 0; i < MLX5_UAR_PAGE_NUM_MAX; i++) +- rte_spinlock_init(&priv->uar_lock[i]); +-#endif + /* Some internal functions rely on Netlink sockets, open them now. */ + priv->nl_socket_rdma = mlx5_nl_init(NETLINK_RDMA); + priv->nl_socket_route = mlx5_nl_init(NETLINK_ROUTE); diff --git a/drivers/net/mlx5/mlx5.h b/drivers/net/mlx5/mlx5.h -index 84cd3e125..d01d7f3c5 100644 +index e53934d45..130aed0e5 100644 --- a/drivers/net/mlx5/mlx5.h +++ b/drivers/net/mlx5/mlx5.h -@@ -559,6 +559,11 @@ struct mlx5_dev_ctx_shared { +@@ -669,6 +669,11 @@ struct mlx5_ibv_shared { void *fdb_domain; /* FDB Direct Rules name space handle. */ void *rx_domain; /* RX Direct Rules name space handle. */ void *tx_domain; /* TX Direct Rules name space handle. */ @@ -75,7 +71,7 @@ struct mlx5_hlist *flow_tbls; /* Direct Rules tables for FDB, NIC TX+RX */ void *esw_drop_action; /* Pointer to DR E-Switch drop action. */ -@@ -673,11 +678,6 @@ struct mlx5_priv { +@@ -777,11 +782,6 @@ struct mlx5_priv { uint8_t mtr_color_reg; /* Meter color match REG_C. */ struct mlx5_mtr_profiles flow_meter_profiles; /* MTR profile list. */ struct mlx5_flow_meters flow_meters; /* MTR list. */ @@ -86,12 +82,12 @@ -#endif uint8_t skip_default_rss_reta; /* Skip configuration of default reta. */ uint8_t fdb_def_rule; /* Whether fdb jump to table 1 is configured. */ - struct mlx5_mp_id mp_id; /* ID of a multi-process process */ + }; diff --git a/drivers/net/mlx5/mlx5_rxq.c b/drivers/net/mlx5/mlx5_rxq.c -index b436f0610..26813225b 100644 +index e9e8f1278..970ce5cd0 100644 --- a/drivers/net/mlx5/mlx5_rxq.c +++ b/drivers/net/mlx5/mlx5_rxq.c -@@ -1997,7 +1997,7 @@ mlx5_rxq_new(struct rte_eth_dev *dev, uint16_t idx, uint16_t desc, +@@ -1975,7 +1975,7 @@ mlx5_rxq_new(struct rte_eth_dev *dev, uint16_t idx, uint16_t desc, tmpl->rxq.elts = (struct rte_mbuf *(*)[1 << tmpl->rxq.elts_n])(tmpl + 1); #ifndef RTE_ARCH_64 @@ -101,10 +97,10 @@ tmpl->rxq.idx = idx; rte_atomic32_inc(&tmpl->refcnt); diff --git a/drivers/net/mlx5/mlx5_txq.c b/drivers/net/mlx5/mlx5_txq.c -index 35b3ade86..e1fa24e40 100644 +index ff1e4fc85..0b092c4a9 100644 --- a/drivers/net/mlx5/mlx5_txq.c +++ b/drivers/net/mlx5/mlx5_txq.c -@@ -355,7 +355,7 @@ txq_uar_init(struct mlx5_txq_ctrl *txq_ctrl) +@@ -352,7 +352,7 @@ txq_uar_init(struct mlx5_txq_ctrl *txq_ctrl) /* Assign an UAR lock according to UAR page number */ lock_idx = (txq_ctrl->uar_mmap_offset / page_size) & MLX5_UAR_PAGE_NUM_MASK;