From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E89834301F for ; Thu, 10 Aug 2023 02:12:32 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id E24DA40DD8; Thu, 10 Aug 2023 02:12:32 +0200 (CEST) Received: from NAM02-DM3-obe.outbound.protection.outlook.com (mail-dm3nam02on2071.outbound.protection.outlook.com [40.107.95.71]) by mails.dpdk.org (Postfix) with ESMTP id C842A406B6 for ; Thu, 10 Aug 2023 02:12:31 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=c2h5Y9l1FFqa96Z4pqXUTTcdju6q6C6+ONMNbFfZHOMTd+Y9AvEiuBB9PXY8p20lobnkyLsbZ2BfSgvpI7oeD4pOYDqoyhKQtmWfwDXnU0wkwvE8U5d5dexjtmW2XbGhErzTy67JV4ASgDQoIAjrpFR3XJFEFEHQXK19r/csC9ige9493RJXy/rUVGaHGgaqbM5RF3xpVSu6V7v7tkt/ftoerQ2sQzTQ9rYn0RScAfiM+zMIWbLJPJi4usER1fUuVaxU/quX0ayXuJ4DkrnOzyTByTVDmewvTeXcknowKIUyS7YF1qqV+zJ1wMcYIEMFAUiUWpbl5TzTcgsuMnKjLA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=o38DtngRff2FTD5v4vwsdpDVVmN67lPGrS8Unvcei4c=; b=RipuFO3LMeyLDhbSZ9PKTtM98tcwbigKakFq+ZtEWIu3WjWVVTnMfmxP82QUqt2B0RW2Nq2HqP7G8VIlxa0kctzHfkbkgyjuP2fXys0UkvXkw0ffajLV7xEBY38eHPmXAKWy+bZf6IK2AP4MZAaSKWTTLkQRgfEMAtBtDqQ59jdW38eGzn/9LJhWO6bQYxcsCSKJGzWctRkazLhEq7zONkIS6GvXnXSFFLVHVSwJ4ZqyDIBGjEqvafZE+knux8fNRwTXdqh54lzwQApAoPQ9s5gGVg59z1wbyC0a2hrwtiOUiX1P0GW93Gvs8h+7RMRyIQPiD+KD4nGWMdtdXCohMQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.117.160) smtp.rcpttodomain=intel.com smtp.mailfrom=nvidia.com; dmarc=pass (p=reject sp=reject pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=o38DtngRff2FTD5v4vwsdpDVVmN67lPGrS8Unvcei4c=; b=bC/PKHrzlHdurBsLJsbnd5bct466W3cp8aQJhX9dbsF+GK7daVBqazaFe6sllAdW0VEP5ahOnUKpIR0oXwP7dx9rRgj2cBrXdcP0zQLtmvuhYULRcycwUX1fXJg+/BEpeMCcphWp3wFh+uEizbJDp43gmj253+CtA7cmWv3LjehXgXI4Tiu3s+KVSEW+JoFGK2ozJ0apUBa9GzJE3IM4l4adr4tGxPwhJzlIewcgk+G+tNMqnC7G4NBqE9UPPGvWa5AxXcRpExWkzsh/+FUAA0VH3/vneQLGA86b+pL4Zd9Nt9HMHcJY9csOvsikjTbpF3HbONgR2lnK6Japn/cMUg== Received: from SA1P222CA0055.NAMP222.PROD.OUTLOOK.COM (2603:10b6:806:2c1::7) by MN6PR12MB8490.namprd12.prod.outlook.com (2603:10b6:208:470::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6652.27; Thu, 10 Aug 2023 00:12:29 +0000 Received: from SA2PEPF000015CA.namprd03.prod.outlook.com (2603:10b6:806:2c1:cafe::ae) by SA1P222CA0055.outlook.office365.com (2603:10b6:806:2c1::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6652.28 via Frontend Transport; Thu, 10 Aug 2023 00:12:28 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.117.160) smtp.mailfrom=nvidia.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.117.160 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.117.160; helo=mail.nvidia.com; pr=C Received: from mail.nvidia.com (216.228.117.160) by SA2PEPF000015CA.mail.protection.outlook.com (10.167.241.200) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6652.20 via Frontend Transport; Thu, 10 Aug 2023 00:12:28 +0000 Received: from rnnvmail201.nvidia.com (10.129.68.8) by mail.nvidia.com (10.129.200.66) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.5; Wed, 9 Aug 2023 17:12:16 -0700 Received: from nvidia.com (10.126.231.37) by rnnvmail201.nvidia.com (10.129.68.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.986.37; Wed, 9 Aug 2023 17:12:14 -0700 From: Xueming Li To: Junfeng Guo CC: Jingjing Wu , dpdk stable Subject: patch 'doc: update BIOS settings and supported HW for NTB' has been queued to stable release 22.11.3 Date: Thu, 10 Aug 2023 08:10:38 +0800 Message-ID: <20230810001045.2662-18-xuemingl@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20230810001045.2662-1-xuemingl@nvidia.com> References: <20230625063544.11183-1-xuemingl@nvidia.com> <20230810001045.2662-1-xuemingl@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit X-Originating-IP: [10.126.231.37] X-ClientProxiedBy: rnnvmail202.nvidia.com (10.129.68.7) To rnnvmail201.nvidia.com (10.129.68.8) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: SA2PEPF000015CA:EE_|MN6PR12MB8490:EE_ X-MS-Office365-Filtering-Correlation-Id: d93ee795-66d2-4a6a-eebe-08db99367be3 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: VVDsfH6m7Bi5Oh1qxyX5fFLdDPTDauoxRBsxYdmi0xNrk63JFeF+6RutWVVwJmLz2OPNeYi+61F8OakwRkvUaVo7jnW1trUZMNPVDx3rnSNkvTcA3VLqqvl3jDX4Qgy2cbSUwNkdcAkWBNSAiQZjT2Nxf/wgak7xsvD2vD2KZBxw0BBb8IkdJTtFXau8b6T5MbYmzHXzmdGXifLBYwIIQe0TTX3Sus/FurYHzNSH/fkuzVHhhu9DyBU2tuYlxX5dtkNdS3XOSZMM0kxBE1vs5DZsGEMRKF7P8sBRUFORE/+QGqD5YvlhixJ6qpY2mYGBvhauELRJqAZcxS9w8C1U4eKLKkDCv3nZVE3sGC9Xnf7zYj69m3u3FJtGCwM33xi6edbC8xFaNK2e7/+w6o+F/A3HlFp9Yo41zD7p3EAz1K5YVjSs2UxzXqgVQPQsBuJuhr5Dp3kSZWoLRTqg24tR2zA3y6Jd73fnkKZk1nkFrZKW770md9DWjaxMGXbGUrzp+ajoNtzGHnwU88liyY3diH+bg3NEHC1YfYziVX/R+pVNh2Suh0cfJLsp5nnf4lZzQNUN7hcFTYs7j1glHPEu25i3/DoPNzoyrLeFjvj4sEnveAOSD4zZ716eSDFNI/z0+2wUb3eQiVHVpgKnXYyJo6zZJ2y4CovKesdDx5Z33u2r4VXpGrjcM+dtFFY3TC3uj7O71r3FuTgBRXqdfvUiSdlkAlLkeqUFxyJR0RZFv/SfnFS0eobhEfEp0lvMk7R40YEvxKNiZKH6pJYZRYs/SQ== X-Forefront-Antispam-Report: CIP:216.228.117.160; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:dc6edge1.nvidia.com; CAT:NONE; SFS:(13230028)(4636009)(396003)(136003)(39860400002)(376002)(346002)(186006)(82310400008)(1800799006)(451199021)(40470700004)(36840700001)(46966006)(16526019)(1076003)(36756003)(2616005)(7696005)(53546011)(336012)(966005)(6286002)(26005)(6666004)(7636003)(82740400003)(478600001)(356005)(54906003)(70586007)(70206006)(4326008)(41300700001)(426003)(316002)(86362001)(8676002)(8936002)(5660300002)(40460700003)(2906002)(6916009)(36860700001)(15650500001)(47076005)(83380400001)(40480700001)(55016003); DIR:OUT; SFP:1101; X-OriginatorOrg: Nvidia.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Aug 2023 00:12:28.6376 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: d93ee795-66d2-4a6a-eebe-08db99367be3 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.117.160]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: SA2PEPF000015CA.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: MN6PR12MB8490 X-BeenThere: stable@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: patches for DPDK stable branches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: stable-bounces@dpdk.org Hi, FYI, your patch has been queued to stable release 22.11.3 Note it hasn't been pushed to http://dpdk.org/browse/dpdk-stable yet. It will be pushed if I get no objections before 08/11/23. So please shout if anyone has objections. Also note that after the patch there's a diff of the upstream commit vs the patch applied to the branch. This will indicate if there was any rebasing needed to apply to the stable branch. If there were code changes for rebasing (ie: not only metadata diffs), please double check that the rebase was correctly done. Queued patches are on a temporary branch at: https://git.dpdk.org/dpdk-stable/log/?h=22.11-staging This queued commit can be viewed at: https://git.dpdk.org/dpdk-stable/commit/?h=22.11-staging&id=e43b0afe1c83a2f2da1b5bcfce60fec8cb85639c Thanks. Xueming Li --- >From e43b0afe1c83a2f2da1b5bcfce60fec8cb85639c Mon Sep 17 00:00:00 2001 From: Junfeng Guo Date: Mon, 3 Jul 2023 17:24:34 +0800 Subject: [PATCH] doc: update BIOS settings and supported HW for NTB Cc: Xueming Li [ upstream commit 00e57b0e550b7df2047e6d0bde8965c7ae17d203 ] Update BIOS settings and supported platform list for Intel NTB. Fixes: f5057be340e4 ("raw/ntb: support Intel Ice Lake") Signed-off-by: Junfeng Guo Acked-by: Jingjing Wu --- doc/guides/rawdevs/ntb.rst | 38 ++++++++++++++++++++++++-------------- 1 file changed, 24 insertions(+), 14 deletions(-) diff --git a/doc/guides/rawdevs/ntb.rst b/doc/guides/rawdevs/ntb.rst index 2bb115d13f..f8befc6594 100644 --- a/doc/guides/rawdevs/ntb.rst +++ b/doc/guides/rawdevs/ntb.rst @@ -1,6 +1,8 @@ .. SPDX-License-Identifier: BSD-3-Clause Copyright(c) 2018 Intel Corporation. +.. include:: + NTB Rawdev Driver ================= @@ -17,19 +19,23 @@ some information by using scratchpad registers. BIOS setting on Intel Xeon -------------------------- -Intel Non-transparent Bridge needs special BIOS setting. The reference for -Skylake is https://www.intel.com/content/dam/support/us/en/documents/server-products/Intel_Xeon_Processor_Scalable_Family_BIOS_User_Guide.pdf - -- Set the needed PCIe port as NTB to NTB mode on both hosts. -- Enable NTB bars and set bar size of bar 23 and bar 45 as 12-29 (4K-512M) - on both hosts (for Ice Lake, bar size can be set as 12-51, namely 4K-128PB). - Note that bar size on both hosts should be the same. -- Disable split bars for both hosts. -- Set crosslink control override as DSD/USP on one host, USD/DSP on - another host. -- Disable PCIe PII SSC (Spread Spectrum Clocking) for both hosts. This - is a hardware requirement. - +Intel Non-transparent Bridge (NTB) needs special BIOS settings on both systems. +Note that for 4th Generation Intel\ |reg| Xeon\ |reg| Scalable Processors, +option ``Port Subsystem Mode`` should be changed from ``Gen5`` to ``Gen4 Only``, +then reboot. + +- Set ``Non-Transparent Bridge PCIe Port Definition`` for needed PCIe ports + as ``NTB to NTB`` mode, on both hosts. +- Set ``Enable NTB BARs`` as ``Enabled``, on both hosts. +- Set ``Enable SPLIT BARs`` as ``Disabled``, on both hosts. +- Set ``Imbar1 Size``, ``Imbar2 Size``, ``Embar1 Size`` and ``Embar2 Size``, + as 12-29 (i.e., 4K-512M) for 2nd Generation Intel\ |reg| Xeon\ |reg| Scalable Processors; + as 12-51 (i.e., 4K-128PB) for 3rd and 4th Generation Intel\ |reg| Xeon\ |reg| Scalable Processors. + Note that those bar sizes on both hosts should be the same. +- Set ``Crosslink Control override`` as ``DSD/USP`` on one host, + ``USD/DSP`` on another host. +- Set ``PCIe PLL SSC (Spread Spectrum Clocking)`` as ``Disabled``, on both hosts. + This is a hardware requirement when using Re-timer Cards. Device Setup ------------ @@ -145,4 +151,8 @@ like the following: Limitation ---------- -- This PMD only supports Intel Skylake and Ice Lake platforms. +This PMD is only supported on Intel Xeon Platforms: + +- 4th Generation Intel® Xeon® Scalable Processors. +- 3rd Generation Intel® Xeon® Scalable Processors. +- 2nd Generation Intel® Xeon® Scalable Processors. -- 2.25.1 --- Diff of the applied patch vs upstream commit (please double-check if non-empty: --- --- - 2023-08-09 21:51:21.239293800 +0800 +++ 0121-doc-update-BIOS-settings-and-supported-HW-for-NTB.patch 2023-08-09 21:51:18.294352000 +0800 @@ -1 +1 @@ -From 00e57b0e550b7df2047e6d0bde8965c7ae17d203 Mon Sep 17 00:00:00 2001 +From e43b0afe1c83a2f2da1b5bcfce60fec8cb85639c Mon Sep 17 00:00:00 2001 @@ -4,0 +5,3 @@ +Cc: Xueming Li + +[ upstream commit 00e57b0e550b7df2047e6d0bde8965c7ae17d203 ] @@ -9 +11,0 @@ -Cc: stable@dpdk.org