From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id D5897A00C3; Mon, 28 Nov 2022 10:04:40 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B80864067C; Mon, 28 Nov 2022 10:04:40 +0100 (CET) Received: from EUR03-AM7-obe.outbound.protection.outlook.com (mail-am7eur03on2118.outbound.protection.outlook.com [40.107.105.118]) by mails.dpdk.org (Postfix) with ESMTP id C3A4240150 for ; Fri, 25 Nov 2022 15:06:26 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RGnh2BXhCBRr7wrltIO0B5FVVOasFTXyOJ6SSsM5IOywjdfrPHVActT1kKkUT5tQcv0eF6FRnbNoOQQ7ey0vd7fooNmvfqthUp2DiItR8ZaON/jrDDTaKN3plv7+ZIfzYkQjSmwra8tjdWr1tGdkYQTGgyth9acBxq5ScIrZs3ameEZuqcsZfMYIdV5gJSm5v8rZwI/xmIW+2rY55sv5Ct7bjZyw3GHKwPzCw5RhGaP+B12vnh0VT9X5vkoKiLOu7fAxUK2HKkMNJb6IhRz6m/jY+Jm31MBdWhg0LuhTsFZbe27/9bp9PDPjxKaLHTuMqwUK/2+VjPqhmXEFmChG6Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=IG7D2xEPiChmqjxy27rnkn0+csEKiTH7Xx9Ogsr6Zss=; b=TKu3BlYss5LwPMI0X6jloDMzMj3uXQsvBjeNBSeIxIki3Q7NLFLReBk63FO6g7CpdEgvQl1LX4eMSdXnwmnSac37bQ8FUkhU8fe8XwX4IdBj7+M4dwoWC4ioPrQpnAjAkgsRQ95tCNVkL6lG9y1R4ltSq9+vA5g/JGCsUlhP1sGXLzgs3HuPWHQu6tKf/6gPRLOlzrDKQAXaGU42qS9Ki7Z4PBpHUtcE6NqsgqLZTl2LUm8FJMJWLb2UDKy80SlwQpoY4JxdofmStZMQqfR+9YL2rnqPsJbmHn56NpMToCAijdzgsq7DkXKgPCbBzR+CHF4oh0tQKHuPK9/7srDGfg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=bridgetech.tv; dmarc=pass action=none header.from=bridgetech.tv; dkim=pass header.d=bridgetech.tv; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bridgetech.tv; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=IG7D2xEPiChmqjxy27rnkn0+csEKiTH7Xx9Ogsr6Zss=; b=nznWC4SmFOfCKtj/jjkvEbsAXBBRfCvVN++fBUpvIJ47SmJXVs84akUA9zT+H+IeoMRLkynTwHQc7DJmUhbuexf/cla8NIb+RyCzZb8111J/IVU+wDLjiFg+slFP94jcj6I23qI5ISkb4Gwx2wubrgsZDbrwChQ65IKpjTp0v1X4SaWvO5tjx4peyKufRtQAQpF54B8/QYlzoXpDJZR3nk3VG3A6koQL8jeC2XrYUEwVMMd3SbgEUBQLv+aXEy+n5W3SrTfj3doxdBJhbtM/z2ZSy+kPA07m1T14K70NCFlN40GHMKDcBTv/5xdy0lh1xo2UkpZqvFjADVBe8WVRFA== Received: from AS8PR08MB6808.eurprd08.prod.outlook.com (2603:10a6:20b:39c::6) by DU0PR08MB8161.eurprd08.prod.outlook.com (2603:10a6:10:3ec::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5857.17; Fri, 25 Nov 2022 14:06:25 +0000 Received: from AS8PR08MB6808.eurprd08.prod.outlook.com ([fe80::e5bc:4be:947f:6dfa]) by AS8PR08MB6808.eurprd08.prod.outlook.com ([fe80::e5bc:4be:947f:6dfa%5]) with mapi id 15.20.5880.005; Fri, 25 Nov 2022 14:06:24 +0000 From: Kenneth Klette Jonassen To: Dariusz Sosnowski CC: Matan Azrad , Viacheslav Ovsiienko , "dev@dpdk.org" Subject: Re: [PATCH 5/7] net/mlx5: allow hairpin Rx queue in locked memory Thread-Topic: [PATCH 5/7] net/mlx5: allow hairpin Rx queue in locked memory Thread-Index: AQHZANcabIw3MA8oaUiYVRM2rtAiFA== Date: Fri, 25 Nov 2022 14:06:24 +0000 Message-ID: <9F633BC5-D60C-4FFA-A15E-2EDDF4E93A09@bridgetech.tv> References: <20220919163731.1540454-1-dsosnowski@nvidia.com> <20220919163731.1540454-6-dsosnowski@nvidia.com> In-Reply-To: <20220919163731.1540454-6-dsosnowski@nvidia.com> Accept-Language: en-GB, nb-NO, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3731.200.110.1.12) authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=bridgetech.tv; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: AS8PR08MB6808:EE_|DU0PR08MB8161:EE_ x-ms-office365-filtering-correlation-id: a6e09897-ecf7-403a-b501-08daceee3d01 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 6VdQeoEj1CMRC76QvrflFnECTYrWM8r6+kl46BxwcTNX0F9cHhBau1/GrmnSJ6tjjIzBJzd/RHVjk5mJ9565eMRyTTNINBE19eh9zcUeekr+FA1I8+gnm8wxf/Rv+Wh1VEEm/5dd20o0v/FaobeLUXbv325vb9RSNFwlT3uiMD7u4dQREEvb2BJCgQrB7XrbpDzYSIpyJbaJBF5is6egMJzHHOO1NHmm+blLvHancObOCL+E7dMt/ysCf5RFZH6vKts9HE1LCoa/cuYNW4vKyv6nHXrLA2ksl6Zt3BtVWwn4rBP8+4qEsBITRIEAz3PehSBtACseTJpvkXQahW3vcHfy+kv+3ZqBLu9LbGp5UYjN7uZxsDec9aPDgwF35a8cJGqAVI+HS8AgHbvTqGxojFeGvz4zAvqk/7aBQoTjQ90nLPl9MEyyj7W0j8EapRlPdtt97BTpgRjvtdNXowWEHvRGvVphdxW9e7HswR5oVgH21C8xhCnc3aLeDz2wGgyWZDCftuS4p2CPoi6K+bkVzkdOD/aBzCye2dzgvC86A/imbGWcJCn1FRvKRshVWHze3CfFGqQSzTEIm41ieG5wzdyAa0UjnsugvJ/1Pvat1D2YC5AvjIdVXMXvz0z1q7ONVlEV9cr+ZNwi+UWjmYDMgZ/P5ttmXuF5FBXBk9wxSY7F6byqO+T4vW/czkDF1OfXZPd5AVpghByD3hXTkHEeNV2j+hqh6O8CH/ByKU4vxrY= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AS8PR08MB6808.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(346002)(136003)(376002)(39830400003)(396003)(366004)(451199015)(8936002)(66946007)(41300700001)(76116006)(4326008)(316002)(54906003)(64756008)(6916009)(5660300002)(66556008)(91956017)(66476007)(8676002)(66446008)(53546011)(71200400001)(478600001)(2906002)(122000001)(6506007)(6486002)(2616005)(36756003)(6512007)(186003)(86362001)(38100700002)(33656002)(83380400001)(38070700005)(45980500001); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?Ry5/V4xhDAHFrKmcLK0J2/VOG0O7zhoBtwJ/vBGeVguFOwOx9Ix62XdieIXQ?= =?us-ascii?Q?E81cGcIt5HyCk6IPduy+oi0gttsg3xucgJrxcSu9VvK7bGOxiJs2azjLqMuu?= =?us-ascii?Q?8Lr545L1kCrkQmlgNTkSTayQlqxAYehQ1/Pt4IP3wzhTPbjvV/hL5QTgSaKG?= =?us-ascii?Q?+VkUMcYOFy4JVv/FGmlyCe09LSIy5ZBg6g3O/+8O2JZ31L/VuM6rboMHwrPz?= =?us-ascii?Q?4KFBDGPD4erqR2rXQC5384dqfOtAAhpWegpjHTOELqgseh6tGKbssZpY0Z86?= =?us-ascii?Q?/SD7nl3VFpUi/NJQ35CwweVOkuoGlYN37XRYcF91zaVq1hf0D+AXc7iVokc3?= =?us-ascii?Q?6pbhZtG70mVUhkScLBFN3A72rfMgRi4Xk5glDAhzt8piPUXGWOBiU/fJnqBV?= =?us-ascii?Q?2D9kVMZp3/4rWaj16S9hCy0xejOBjSxQmzJBVcjZmWdvRio2DoPghzPY3hV/?= =?us-ascii?Q?MiXb59Fua100WVZJP1xytD2/VfJR4sdI0j8UFcQUxEUSaLvGmGscanEWZ5P9?= =?us-ascii?Q?w0/kYVPFtlInRZCvNV1jBZEh2gEe+sBdmzKTB2Q7jkGyLVao8kWccYr9QLBJ?= =?us-ascii?Q?qBl1e7+GY+SEc3/OCWvjS1LPPg5ohlOuGDbW3sQfwIDTUETArItcJV/s0b64?= =?us-ascii?Q?s5gzYOdywru87b4AYX6gHnCx+jyP1jKX0Ux4op8gIhZ63O6C57d3U2Dg22Wm?= =?us-ascii?Q?kfAYfO81CnD9/uPDBtL44iidv7KQc6zOH6pGEkD8Sjhhctyf1b9T3QxxvROF?= =?us-ascii?Q?a3hO1cuNnSYiJddNl+S7y4Dv7GbCNWJPkCju9K7Qxaf3Fj9+HQq3WfRcI/yV?= =?us-ascii?Q?wscGVqgeW8N4/vBR+Jl7TWVsbEzBfc9hAwGzINJ8PmgG1ba+bjGWYWMlvZ25?= =?us-ascii?Q?rBd6BvQiXrt5jWbbUu9WHzWJfhP2ZY5XftYQ49Lln8QkcYkunQw2sv/q9Je+?= =?us-ascii?Q?fpTQiOXZLD1j8eVNmD0N4vU+l5QHGdivdDgyHFrbcaaYX8tCqW8F57SyrCVU?= =?us-ascii?Q?Xgm+9cypPL5qt0AKXLVFPknvFGHcA01Hk46IrwkYRszq2mE+mpCzOtlVcOAj?= =?us-ascii?Q?GYJWnv7D3WHwVyiLchyYvHZIDboQ+ODqG6tMfWaQXKBYpoa4140h+jddSwK5?= =?us-ascii?Q?kJaWuPltIj3uVI31FF9JhgS1rqbCiEX/F+EIN5H1VqPcyXn6elDn+9LTQKUq?= =?us-ascii?Q?xPT2a0/tLg4IA4Mhsy1XMfhnMUwBA4040SFxLsC7W6R4E4BfHknj1Ijj9EgT?= =?us-ascii?Q?+O6tG/XJvw3vbOjDbI15A0lgyGdKfDKxAmypnuMjkd4Kx6rn8sqdkcLIOJEH?= =?us-ascii?Q?+0qOskk7kaY+BX3J9/Yg7EDF1NxUqA7omQLnXRC3u10PWwUGOW7gGVmNit9n?= =?us-ascii?Q?BGndSMr69X6d8erlTbDSZ+OvmgXJ6XZqXRznhqgpI0v0tvivzvTulByFCu1r?= =?us-ascii?Q?qp6LmzcG9ZkteqgOMyFK32CeI/jO2UcGUHOEqdvvkMiXMFoVGplCqknDdvfu?= =?us-ascii?Q?TkwRGWDBiUpq+bMo7kY6R9aQicPvfAFxuEUJjITz1tOCKqcOrBKgGJ8+U9y2?= =?us-ascii?Q?oeBCpisX5kUxl6ME6ECj0OeafcyRIWZaqWCuuJuG7EFFCKm37XAhrEEa7jgz?= =?us-ascii?Q?k94l/wOPm7+KE8cKLUbGCz4Jmj5eU7kbeYtN3CmCK9kGsMg/IhFIBZek3ibJ?= =?us-ascii?Q?acN/1ntVHDVYsY8lN0iInwsXvVM=3D?= Content-Type: text/plain; charset="us-ascii" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: bridgetech.tv X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: AS8PR08MB6808.eurprd08.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: a6e09897-ecf7-403a-b501-08daceee3d01 X-MS-Exchange-CrossTenant-originalarrivaltime: 25 Nov 2022 14:06:24.6938 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 511b9776-65d2-4726-b5bc-af4fc772381e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 5YemQFqvH9ckpvPrxEJjL43RxTI2or7vgHgr5vULmuWtJWmSLs8zc88mv5rxiQGe0HolOvqUU0rDb100edS/G6SoY0AvGILn2/DzHEIGxJU= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR08MB8161 X-Mailman-Approved-At: Mon, 28 Nov 2022 10:04:40 +0100 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This series adds support for using device-managed MEMIC buffers on hairpin RQ instead of NIM. Was it ever considered as an alternative that the UMEM interface be extended to support MEMIC buffers instead? I'm thinking that could simplify the hairpin-specific firmware bits being added in this series, e.g. no new HAIRPIN_DATA_BUFFER_LOCK TLV, and the MEMIC-backed UMEM can be passed to RQ using existing PRM bits. I'm planning to file a feature request adding MEMIC support to UMEM, so I'd be interested in knowing if that's somehow not possible. My current use case is allocating 64 bytes of MEMIC for a collapsed CQE for something similar to the mlx5 packet send scheduling in DPDK. Best regards, Kenneth Jonassen > On 19 Sep 2022, at 18:37, Dariusz Sosnowski wrote= : >=20 > This patch adds a capability to place hairpin Rx queue in locked device > memory. This capability is equivalent to storing hairpin RQ's data > buffers in locked internal device memory. >=20 > Hairpin Rx queue creation is extended with requesting that RQ is > allocated in locked internal device memory. If allocation fails and > force_memory hairpin configuration is set, then hairpin queue creation > (and, as a result, device start) fails. If force_memory is unset, then > PMD will fallback to allocating memory for hairpin RQ in unlocked > internal device memory. >=20 > To allow such allocation, the user must set HAIRPIN_DATA_BUFFER_LOCK > flag in FW using mlxconfig tool. >=20 > Signed-off-by: Dariusz Sosnowski > --- > doc/guides/platform/mlx5.rst | 5 ++++ > drivers/net/mlx5/mlx5_devx.c | 51 ++++++++++++++++++++++++++++------ > drivers/net/mlx5/mlx5_ethdev.c | 2 ++ > 3 files changed, 49 insertions(+), 9 deletions(-) >=20