From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
by inbox.dpdk.org (Postfix) with ESMTP id 66D2EA0C45;
Fri, 15 Oct 2021 18:03:08 +0200 (CEST)
Received: from [217.70.189.124] (localhost [127.0.0.1])
by mails.dpdk.org (Postfix) with ESMTP id 245C3410E0;
Fri, 15 Oct 2021 18:03:08 +0200 (CEST)
Received: from AZHDRRW-EX02.NVIDIA.COM (azhdrrw-ex02.nvidia.com
[20.64.145.131]) by mails.dpdk.org (Postfix) with ESMTP id 0EC6A4067C
for <dev@dpdk.org>; Fri, 15 Oct 2021 18:03:06 +0200 (CEST)
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.101)
by mxs.oss.nvidia.com (10.13.234.37) with Microsoft SMTP Server
(version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
15.2.858.15; Fri, 15 Oct 2021 09:03:04 -0700
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
b=Dd4WqVPGgfPAak0IlQ3/Ol9/HPFkwpsoyP+Y2nIIZLbmk9YJhz2qzf6J2qya4GJrdoGZpYRnh3HLVxJ2CNG6enT+moBinN/QDfsvmtwFBqy7xD91+gHV9Z6NB3nMt5cSajf7lb0nVACVczqduvb1DQaZiaWxOZ6o6974rWnNrZwdsHv7qeKTsBZC5dsQcerZXjaHYPtXy46UcnbUcbQdqO9VslRTaDhfv82UQNEWwWuWOLaZoO4aG89dtI6tWNQrZx0hdLef80c6nMaWkIUlufr4sjqitrpUdhPD5+aC5uw5+yyaW/VK5foNXCHwMz4kvTwlcE1Nk8ONJ6r1RWnZHA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
s=arcselector9901;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
bh=4FNj9olkh1TWnPl4kxuRvxxtnpZ1XZPe5w2kCOxt5Iw=;
b=aHvZD2ncMe2c9qmDkvj3idNXL1T1TVgsDI9hVH0C8YN66f+xWzR3gc/VWgGGIaoDJT+EvnM1JP1LmuEVPEUMI2rsvu2IIg6kz1CKLfW2YkQPeJvdTZ1u1Azy9Vk3S0jBcRRltChsx2jcZgBBKYUdx2O/L3eJHdVaIqVlD0UbH6TlPxgAaBVJ7I7LJtWf+abvn92ylIoDyjztXewiLMm/cXL9RQA79ivnrdP2HLVQRpIytx4WWOkIzxLC62GtFjPw/Q4bbs7B/iutbjIqpC1Xrts2lTala7UqTLxqU3kpuaK6OtU/LJhGedjSzLXsvHdgSgFzckiA4cKpyX57joM8Jw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is
216.228.112.34) smtp.rcpttodomain=dpdk.org smtp.mailfrom=nvidia.com;
dmarc=pass (p=quarantine sp=quarantine pct=100) action=none
header.from=nvidia.com; dkim=none (message not signed); arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com;
s=selector2;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=4FNj9olkh1TWnPl4kxuRvxxtnpZ1XZPe5w2kCOxt5Iw=;
b=m51LW8s90IT2jfxdErrEeIttEsQnMEB2PAtIJaPPmyFsWewT5zVa6J+cJ9n8phn+/p6MQ1hNsLLdu/IZ1MsP893+b01wozgXLCoewpzCZXFxkyqa1w7tDw7y4/qmZXf27M519JmAGwa+lTmuiXs+Yw6pwb1QfyjBDOpvV8AdX9wZ6rjUMquvEqXjdUqt/it/Er44joJZKG8ZDsrkpAJpIo+kYd8YzWDd7uHaNlL9J47jtTduUxkNrP92cqp9N5rxOnknWmOS+KvARrBD+xw0HR+6XpybFU9R2wuzbwQmRr1ZNRsOW6nLQ1LTRYA2USVWRasLUZaBpWjqLIAT5BI6xA==
Received: from DM5PR10CA0012.namprd10.prod.outlook.com (2603:10b6:4:2::22) by
DM6PR12MB3820.namprd12.prod.outlook.com (2603:10b6:5:1c2::14) with
Microsoft
SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
15.20.4608.16; Fri, 15 Oct 2021 16:03:02 +0000
Received: from DM6NAM11FT033.eop-nam11.prod.protection.outlook.com
(2603:10b6:4:2:cafe::95) by DM5PR10CA0012.outlook.office365.com
(2603:10b6:4:2::22) with Microsoft SMTP Server (version=TLS1_2,
cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4608.15 via Frontend
Transport; Fri, 15 Oct 2021 16:03:02 +0000
X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.34)
smtp.mailfrom=nvidia.com; dpdk.org; dkim=none (message not signed)
header.d=none;dpdk.org; dmarc=pass action=none header.from=nvidia.com;
Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates
216.228.112.34 as permitted sender) receiver=protection.outlook.com;
client-ip=216.228.112.34; helo=mail.nvidia.com;
Received: from mail.nvidia.com (216.228.112.34) by
DM6NAM11FT033.mail.protection.outlook.com (10.13.172.221) with Microsoft SMTP
Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id
15.20.4608.15 via Frontend Transport; Fri, 15 Oct 2021 16:03:02 +0000
Received: from nvidia.com (172.20.187.6) by HQMAIL107.nvidia.com
(172.20.187.13) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Fri, 15 Oct
2021 16:02:59 +0000
From: Dmitry Kozlyuk <dkozlyuk@oss.nvidia.com>
To: <dev@dpdk.org>
Date: Fri, 15 Oct 2021 19:02:40 +0300
Message-ID: <20211015160244.3097758-1-dkozlyuk@nvidia.com>
X-Mailer: git-send-email 2.25.1
In-Reply-To: <20211013110131.2909604-1-dkozlyuk@nvidia.com>
References: <20211013110131.2909604-1-dkozlyuk@nvidia.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
Content-Type: text/plain
X-Originating-IP: [172.20.187.6]
X-ClientProxiedBy: HQMAIL105.nvidia.com (172.20.187.12) To
HQMAIL107.nvidia.com (172.20.187.13)
X-EOPAttributedMessage: 0
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-Correlation-Id: 6d31047f-4cb8-4cdd-02ed-08d98ff5442a
X-MS-TrafficTypeDiagnostic: DM6PR12MB3820:
X-Microsoft-Antispam-PRVS: <DM6PR12MB38204E9753E5C5F506EDA9A7B9B99@DM6PR12MB3820.namprd12.prod.outlook.com>
X-MS-Oob-TLC-OOBClassifiers: OLM:9508;
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: iUYtD3w+irk/WCFKlj2iw3tHXU7eEq+qLgNtrPLwPQhew12LLIc4rBrqL42N1hYIXJcTXfLMhPX/O9ZrpKzVAmwgTRpKIB4VpX65FlmyKavq0C0pw3qInlRSnZlCWFmBG8baWP0rr7gtYf8IZ/dlIabM89a4ojuur6hVfZzaw2zKn44/FCFFt/mc5DpY9ApJT+dLKMPnGIUcwNI7eoW6GX8DXw7jKcdwWNsl2ImRZ94mlPsyzjF6N4tvvU0UaXl154akdGgI4G70DYyyzEMlt4h7ySpA+7QvHE1D+msku0eXXsMtJhNSYE32DjBuqt0ynTumCH+x06jw6BO2rPAiqnI0I7Ovcd2k+ISYLkKlAuGzE2EtAgKoGr9Z2nPZ34CE/0KBiJ5m9ptw+esKBeuSwNXrDfzkr19aq7R6gYlg6tJ49gWxMeXuFLESe2JXasI8Sky49j1wTePKxoqvIhMVIEHBV3NH6HqO2s+EJk1h0yB6xCABDF52NCX608kw9VWdXfdU2WHp7OyLRmvLQCl+EvNkFNfyyfJhz5mYcvEktMt9T3IHw3DNmmDUSNoEmfZoPjj+feI4ELDjpIpmBFVARbbMc+WW89reETd2ohPPDYBbM08tRmJAFymqZlGo49XJ/i2T/oeDYn0yIHQZ8rbm45+kk4M2D7ECt3mbpcvVaUz3i5dVwF6ux0+IfXD5DyOsWfzdnJZXhIG21AjL22gGDRJwRFQUYcTqtwz9kLhgyUhQE30JhQanIKQ32zT66l0MN9j7Y+9us3BZbBoUe5FQY9beAklyJU7E/8JcW/B/icU=
X-Forefront-Antispam-Report: CIP:216.228.112.34; CTRY:US; LANG:en; SCL:1; SRV:;
IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid03.nvidia.com; CAT:NONE;
SFS:(4636009)(46966006)(36840700001)(70206006)(8936002)(2906002)(8676002)(5660300002)(86362001)(45080400002)(6916009)(508600001)(36860700001)(1076003)(426003)(82310400003)(70586007)(36756003)(316002)(966005)(6286002)(7636003)(6666004)(55016002)(26005)(186003)(336012)(83380400001)(16526019)(356005)(7696005)(2616005)(47076005);
DIR:OUT; SFP:1101;
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Oct 2021 16:03:02.1040 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 6d31047f-4cb8-4cdd-02ed-08d98ff5442a
X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.34];
Helo=[mail.nvidia.com]
X-MS-Exchange-CrossTenant-AuthSource: DM6NAM11FT033.eop-nam11.prod.protection.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB3820
Subject: [dpdk-dev] [PATCH v5 0/4] net/mlx5: implicit mempool registration
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
<mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
<mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org
Sender: "dev" <dev-bounces@dpdk.org>
MLX5 hardware has its internal IOMMU where PMD registers the memory.
On the data path, PMD translates VA into a key consumed by the device
IOMMU. It is impractical for the PMD to register all allocated memory
because of increased lookup cost both in HW and SW. Most often mbuf
memory comes from mempools, so if PMD tracks them, it can almost always
have mbuf memory registered before an mbuf hits the PMD. This patchset
adds such tracking in the PMD and internal API to support it.
Please see [1] for the discussion of the patch 2/4
and how it can be useful outside of the MLX5 PMD.
[1]: http://inbox.dpdk.org/dev/CH0PR12MB509112FADB778AB28AF3771DB9F99@CH0PR12MB5091.namprd12.prod.outlook.com/
v5:
1. Change non-IO flag inference + various fixes (Andrew).
1. Fix callback unregistration from secondary processes (Olivier).
2. Support non-IO flag in proc-dump (David).
3. Fix the usage of locks (Olivier).
4. Avoid resource leaks in unit test (Olivier).
v4: (Andrew)
1. Improve mempool event callbacks unit tests and documentation.
2. Make MEMPOOL_F_NON_IO internal and automatically inferred.
Add unit tests for the inference logic.
v3: Improve wording and naming; fix typos (Thomas).
v2 (internal review and testing):
1. Change tracked mempool event from being created (CREATE) to being
fully populated (READY), which is the state PMD is interested in.
2. Unit test the new mempool callback API.
3. Remove bogus "error" messages in normal conditions.
4. Fixes in PMD.
Dmitry Kozlyuk (4):
mempool: add event callbacks
mempool: add non-IO flag
common/mlx5: add mempool registration facilities
net/mlx5: support mempool registration
app/proc-info/main.c | 4 +-
app/test/test_mempool.c | 360 +++++++++++++++
doc/guides/nics/mlx5.rst | 13 +
doc/guides/rel_notes/release_21_11.rst | 9 +
drivers/common/mlx5/mlx5_common_mp.c | 50 +++
drivers/common/mlx5/mlx5_common_mp.h | 14 +
drivers/common/mlx5/mlx5_common_mr.c | 580 +++++++++++++++++++++++++
drivers/common/mlx5/mlx5_common_mr.h | 17 +
drivers/common/mlx5/version.map | 5 +
drivers/net/mlx5/linux/mlx5_mp_os.c | 44 ++
drivers/net/mlx5/linux/mlx5_os.c | 4 +-
drivers/net/mlx5/mlx5.c | 152 +++++++
drivers/net/mlx5/mlx5.h | 10 +
drivers/net/mlx5/mlx5_mr.c | 120 ++---
drivers/net/mlx5/mlx5_mr.h | 2 -
drivers/net/mlx5/mlx5_rx.h | 21 +-
drivers/net/mlx5/mlx5_rxq.c | 13 +
drivers/net/mlx5/mlx5_trigger.c | 77 +++-
drivers/net/mlx5/windows/mlx5_os.c | 1 +
lib/mempool/rte_mempool.c | 134 ++++++
lib/mempool/rte_mempool.h | 64 +++
lib/mempool/version.map | 8 +
22 files changed, 1585 insertions(+), 117 deletions(-)
--
2.25.1