From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 64433A0A0C; Fri, 2 Jul 2021 09:28:59 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id EB33140141; Fri, 2 Jul 2021 09:28:58 +0200 (CEST) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150071.outbound.protection.outlook.com [40.107.15.71]) by mails.dpdk.org (Postfix) with ESMTP id EC10B4003E for ; Fri, 2 Jul 2021 09:28:56 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jpttAwFk0BCcnt1/2L/HMrKJnwLb1AQ1tbv8j5yqvTw=; b=9lUX1bTqBE8PYqlSBvuI1SCibHQuatJLw6Qiopdm9u1XoonCnNVejWW8RDt9WL5JCnMbJbBHKgMdisBkuAcjQLK5f9muLrCvb0KbkcybUo1luSs4DbBvO8fbxQ5nx0klVdizNV1lz9j58rxpx28mBblY0n0BtcipXpKWEPoFFL0= Received: from DB6PR1001CA0011.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:4:b7::21) by AS8PR08MB7127.eurprd08.prod.outlook.com (2603:10a6:20b:402::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.23; Fri, 2 Jul 2021 07:28:56 +0000 Received: from DB5EUR03FT013.eop-EUR03.prod.protection.outlook.com (2603:10a6:4:b7:cafe::b4) by DB6PR1001CA0011.outlook.office365.com (2603:10a6:4:b7::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Fri, 2 Jul 2021 07:28:55 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by DB5EUR03FT013.mail.protection.outlook.com (10.152.20.105) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4287.22 via Frontend Transport; Fri, 2 Jul 2021 07:28:55 +0000 Received: ("Tessian outbound 80741586f868:v97"); Fri, 02 Jul 2021 07:28:55 +0000 X-CR-MTA-TID: 64aa7808 Received: from a0c33efd73a5.1 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 65EFA9FB-F477-45B2-A22C-FD33012998F3.1; Fri, 02 Jul 2021 07:28:45 +0000 Received: from EUR05-DB8-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id a0c33efd73a5.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Fri, 02 Jul 2021 07:28:45 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=eXjH4/bgB1MkWEFfr/dt12IrSZeDlSlNfBLAK73RuPTHBdwg5fCK7vDw2caDLdRtNBronKPYwraXRcTvuc/HQZeCb2dC0G14nAebtpvNNkWgijF+74DFKhMu1y/I/vRzXNQiLUKbpHLSzZD48yc3/u+b/KdTP1Z1Oa0Hk2ssZtHmy2YTc7IsZ9IGrA7lIja0I9oSiqRF2hWOQMg96RaoMEdKJzbqdqhi6/I9+0/Ug4yA9f2uBU89kQgUBU6z1KoMMJla1Ad2ZYFOvP6lFvjNZFr3Vw1jfmsYBV+iGVBIcAWgoLHTA4e/J/1GNhwhild7CEHepe9UCid3GopJxwaxog== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jpttAwFk0BCcnt1/2L/HMrKJnwLb1AQ1tbv8j5yqvTw=; b=VNBZ7L4Np84ALA4pPuzBdut6MBG17OauRPC3eJYVQ5TLHVo63o6XT2RPRBVH1fD8w5tysvUpbofKiGfD4wjvB9FqARkhNaxe62NZYHVKgqFLaY7qpOlejEylbnjBl5N89nannTqDiop7lJH05z5r7EhXO1Pk/asNqJeUeVvRsw44Usx2xcqaicC8Uw6BvzDTufzlwbqibOJB4SJKvCFh9MNYcf6dC67hkcW+6wLWRSeEiUK7uFJ5OGKh7q4WTiuQHi/j6YwRMYArZvFJwoqKJUdkHnXEvTh8vnOrzpTwIJ+7P9HOv+IUS/C9zp6RiVtljHhOIzTc8WVTSCYPDgyNZw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=jpttAwFk0BCcnt1/2L/HMrKJnwLb1AQ1tbv8j5yqvTw=; b=9lUX1bTqBE8PYqlSBvuI1SCibHQuatJLw6Qiopdm9u1XoonCnNVejWW8RDt9WL5JCnMbJbBHKgMdisBkuAcjQLK5f9muLrCvb0KbkcybUo1luSs4DbBvO8fbxQ5nx0klVdizNV1lz9j58rxpx28mBblY0n0BtcipXpKWEPoFFL0= Received: from AM5PR0802MB2465.eurprd08.prod.outlook.com (2603:10a6:203:9f::22) by AM6PR08MB4984.eurprd08.prod.outlook.com (2603:10a6:20b:ee::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4264.20; Fri, 2 Jul 2021 07:28:44 +0000 Received: from AM5PR0802MB2465.eurprd08.prod.outlook.com ([fe80::3d12:4220:b215:7c52]) by AM5PR0802MB2465.eurprd08.prod.outlook.com ([fe80::3d12:4220:b215:7c52%8]) with mapi id 15.20.4264.027; Fri, 2 Jul 2021 07:28:44 +0000 From: Ruifeng Wang To: Slava Ovsiienko , Raslan Darawsheh , Matan Azrad , Shahaf Shuler CC: "dev@dpdk.org" , "jerinj@marvell.com" , nd , Honnappa Nagarahalli , nd Thread-Topic: [PATCH 2/2] net/mlx5: reduce unnecessary memory access Thread-Index: AQHXVsCOPwPV2JuviU2vQipTq+pULasvc+eAgAADnHA= Date: Fri, 2 Jul 2021 07:28:43 +0000 Message-ID: References: <20210601083055.97261-1-ruifeng.wang@arm.com> <20210601083055.97261-3-ruifeng.wang@arm.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: 552086CC62109F4D976B5EB535ADE1F3.0 x-checkrecipientchecked: true Authentication-Results-Original: nvidia.com; dkim=none (message not signed) header.d=none;nvidia.com; dmarc=none action=none header.from=arm.com; x-originating-ip: [203.126.0.112] x-ms-publictraffictype: Email X-MS-Office365-Filtering-Correlation-Id: dae0ce08-27c7-493e-a50c-08d93d2b0ce6 x-ms-traffictypediagnostic: AM6PR08MB4984:|AS8PR08MB7127: x-ld-processed: f34e5979-57d9-4aaa-ad4d-b122a662184d,ExtAddr x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:1201;OLM:1201; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: KHX8jrRXjTI4uT02Q+pcGi7nPkLPGBtc6YEz1M/DTFDVEyYe1BxYuJyQLZIQfhKJIOJRJ26EbfvwtR0ajs/qrSvfOBQWwqEAmQNJllH7XiNnTlwB15w6Ta8IQlaxMKO3E1+jkkjx996KMFMcB1+QVgHCywahArJEw5xN1kX2zxeJWfLxTdiognvTqDNs0Kkqu3PLg0e0W8bHt66VK8FuTUI35cVUsDeeDlPEHg7jgEoVjswnb6VoNyBTySkNIQtewgCGcMIum6cGiJ1/nVtMnDZ56JO4tbyZRB9OERsT1qrtm7fnCHPZF5PsRSbEU0Si4OkB1ZZUYLlZuA79jAWQpSXRhhXNeX0AGAYi9KKeuVudJ0hA2XDeIYm2bN0CZrH8If+NocZrCBCVOrXXjhb45A6CRFnXyE43mpTDmBPv0ezA+Ijk5YFDiQ3o4QZAAJeNxd3n6RGud9CxTrz1JQx+yX+iRtBEjtov68b4Wta8GNUuRRpf1XmrBmqpPQGyb2uLNvaEH8qYesyC47eMI4Lb/uJBe4vqykzf8+YXdp+o1Rop9zg8Sin4Fa6M493v3OrXt1PLJcX8zbmFT0pXou13jkDyRiqGxVF6GGIyQshGYvGZgFkeON/JygcBNtI41hx1acOFi5on6Vc69kcKKkq/LQ== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM5PR0802MB2465.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(346002)(366004)(39850400004)(136003)(376002)(86362001)(26005)(9686003)(83380400001)(54906003)(4326008)(122000001)(478600001)(52536014)(8936002)(76116006)(110136005)(55016002)(66946007)(316002)(5660300002)(186003)(38100700002)(71200400001)(66446008)(33656002)(7696005)(66556008)(66476007)(64756008)(6506007)(53546011)(2906002)(8676002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?haYYAbihVagYioIil+1Emp/K0VylcxCBuMJcOuC4Jcz9igKZ+1hcVMCYDjAV?= =?us-ascii?Q?V7X8bFmTMJpIoQOlCELrBJoDcuQmq5q5I6nR4CuMWuxm7meTZbD7oKzjObLU?= =?us-ascii?Q?QMEIPew3hXHWJFeCVhXKXu5g1M6ZZhml7wYMZZrtolu3xneTC//L3ZAs26CE?= =?us-ascii?Q?7Za7oAXdf6kgEn7Li0Xy1Hs7ojusRieO3vZRHhCDJmxbV29ir7HKz+293bxp?= =?us-ascii?Q?TPeeEQdwWCFN/xKdR+kmoBohNHc0l+1D8VZJz73guwiFkzcqisg7bR5Yplk5?= =?us-ascii?Q?NyBBKgVBoJXP5Zm259F/Vhjl5LJlj1eqh7zHPBbGkRkzrOC+zF5/tYzT2VfC?= =?us-ascii?Q?0t0/TbdFZSkQNzO741Jgvj0/uXeCG6ksWCvunSwHZtYUrKnGkFtz7xUSsMMe?= =?us-ascii?Q?oOCoVYYe0+l4EMNn1Oq5O1A8aQ6xD3xcHZzcSwSENJu4T3fKGnqiZCyHfyb9?= =?us-ascii?Q?ElsgUEf8MrtvtOttyWPQEJc5nf6WpcvHATtQShwE1GvkCQWVYSkrLsT2p9jC?= =?us-ascii?Q?wuwAK1+jb+fahH2YFkcPTwP5pU/zfwb4YXlhw6BLHUHjaXhp56oMhnpy3nF5?= =?us-ascii?Q?fz0XR7U+EOTfffsm5nNKfg6Wcgy7+EVfGwazUEDZhb8cgnHdHERvccjB5+sE?= =?us-ascii?Q?n8kKlSEIPPsG8yf6Wuo6Yi3S1FlqTtai+/9R+MROgpqd3J+trolEV901oQW+?= =?us-ascii?Q?9zehJMnh4MRhz9/gCvnrIQYA7GD1vfyJ/i7JgL7kmr+alRuGDkprjEPivNdW?= =?us-ascii?Q?6MVulbYwrgnn3+eI1ENB+XpSocG5lXVCgj4seSdWp8glnS/i6I91GX+JfMxt?= =?us-ascii?Q?R54RQFHLpcUBXe5iXSq87T3qP780SbL9tOFesBhgXqGv7HiKcF2AEwHYQNID?= =?us-ascii?Q?nXkqKnsPKd+cXmBlMsRrCN2t4FqGn4tRdJUm7ikFvZKQwS/MXWTy2CGzoobF?= =?us-ascii?Q?oQgJfjWr/QIie+0IggpPOwc4P2cA69DLcxI4q65EepVKyXR5qYIOnAyqlDmV?= =?us-ascii?Q?qbtXk3ozBTLQmHGRfymurEe8xsbLs3tiOdaAu1vrOrT/6MI2JexEmNl/6mu3?= =?us-ascii?Q?99v6mi5NbKyAyLA7sWxCexQjkVB1SgEOXzypi+k8rq5uBzdVWrPj73cWPpDH?= =?us-ascii?Q?mWo03Hc2pym21xi3gbQfz1GNSu+pAJNS3eBIXWHKu6RrDo+I965TZThxapPt?= =?us-ascii?Q?Rno6uk/uoYh5b1WAeMMPFzAh48h21NkwmB0MaJ28LvBdTZwKLFaVzDF8sVUv?= =?us-ascii?Q?WbTRvuSFm0PIrMW1IqgGh7iSRrrdT4kThyOaTz8h7KCcjGDJ+MJKQSPrZotf?= =?us-ascii?Q?kl70CU8LT0Cvmqpt91iUfsxq?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR08MB4984 Original-Authentication-Results: nvidia.com; dkim=none (message not signed) header.d=none;nvidia.com; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT013.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: da3b257a-4715-4e8e-32c1-08d93d2b05d8 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: OS2B7MwITkjcki6gneIiOy2GJesN2eJjjzZhlxDy2fWdfVOB2tZKwbCX2ivTki3wqIrrkwlALBQjZJGvg8OziE4BwF3PejMHRb6h44OFJ+DVClo2qW+723r+f8C7VYBjoShhI0wU3dFgJ6jCltnwWOBW6HTvX1x75MmNCJAD+jvm+SmC0/Wj3auhVE38Luj+2KtaAREfc9bhv4Nckd+pNriJz927M2Ef0+eFZSeRsgJFsDbddrjpjDWpfksfNdBv9Sy5HPdKOTT4H0S20Ptr8xmRyGgmx2ssVJ5cbhYZWHBlN25bWvtX5KYoUKmgqJeXwz2HLCxM0XADmxWoKkydFgmGK5k7RPcErydvkGMcaxqG09EgkPbXAIxyNPvm9XK49KulCPv175rh87ARrpRm6wXQ3134xXvl8OnICdT9u6zkUPU3AXZLk6+eeUKOfiJwJKs5QnAiptmHvE8o/5CEw8kFoLSvhSMoKeE9RyucRRsT4PKqlhx8c4Ti6CKAoj6H5cxGS2Jo0/VeGGQMKlYU660W44Xme+Afk70CsV9aQNXo2iXqEtVW4hIT2JgECJRL+8nQ8hKurD+4vlyUsoJrk7MJlx0DC6/mAo2NKt+c2ApntnTWCLTvW5J17RjJs/Dca/Jflq9o6IrFlFNX95Wf6Ay7cslKKTnUnZG24PGYtQ6xUfB0+X4bEA6nzK74Ddw5geID2lICNlBjcDpdHOf5CQ== X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(4636009)(376002)(346002)(396003)(39850400004)(136003)(46966006)(36840700001)(54906003)(110136005)(52536014)(5660300002)(86362001)(47076005)(36860700001)(478600001)(82310400003)(33656002)(2906002)(8936002)(316002)(70206006)(8676002)(4326008)(6506007)(53546011)(55016002)(9686003)(82740400003)(356005)(70586007)(83380400001)(81166007)(336012)(186003)(26005)(7696005); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Jul 2021 07:28:55.8896 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: dae0ce08-27c7-493e-a50c-08d93d2b0ce6 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT013.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS8PR08MB7127 Subject: Re: [dpdk-dev] [PATCH 2/2] net/mlx5: reduce unnecessary memory access X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" > -----Original Message----- > From: Slava Ovsiienko > Sent: Friday, July 2, 2021 3:06 PM > To: Ruifeng Wang ; Raslan Darawsheh > ; Matan Azrad ; Shahaf Shuler > > Cc: dev@dpdk.org; jerinj@marvell.com; nd ; Honnappa > Nagarahalli > Subject: RE: [PATCH 2/2] net/mlx5: reduce unnecessary memory access >=20 > Hi, Ruifeng >=20 > Could we go further and implement loop inside the conditional? > Like this: > if (mlx5_mr_btree_len(&rxq->mr_ctrl.cache_bh) > 1) { > for (i =3D 0; i < n; ++i) { > void *buf_addr =3D elts[i]->buf_addr; >=20 > wq[i].addr =3D rte_cpu_to_be_64((uintptr_t)buf_addr + > RTE_PKTMBUF_HEADROOM); > wq[i].lkey =3D mlx5_rx_mb2mr(rxq, elts[i]); > } > } else { > for (i =3D 0; i < n; ++i) { > void *buf_addr =3D elts[i]->buf_addr; >=20 > wq[i].addr =3D rte_cpu_to_be_64((uintptr_t)buf_addr + > RTE_PKTMBUF_HEADROOM); > } > } > What do you think? Agree. Loop inside the conditional should be more efficient. > Also, we should check the performance on other archs is not affected. I will also test on x86 platform that I have. >=20 > With best regards, > Slava >=20 > > -----Original Message----- > > From: Ruifeng Wang > > Sent: Tuesday, June 1, 2021 11:31 > > To: Raslan Darawsheh ; Matan Azrad > > ; Shahaf Shuler ; Slava > > Ovsiienko > > Cc: dev@dpdk.org; jerinj@marvell.com; nd@arm.com; > > honnappa.nagarahalli@arm.com; Ruifeng Wang > > Subject: [PATCH 2/2] net/mlx5: reduce unnecessary memory access > > > > MR btree len is a constant during Rx replenish. > > Moved retrieve of the value out of loop to reduce data loads. > > Slight performance uplift was measured on N1SDP. > > > > Signed-off-by: Ruifeng Wang > > --- > > drivers/net/mlx5/mlx5_rxtx_vec.c | 6 ++++-- > > 1 file changed, 4 insertions(+), 2 deletions(-) > > > > diff --git a/drivers/net/mlx5/mlx5_rxtx_vec.c > > b/drivers/net/mlx5/mlx5_rxtx_vec.c > > index d5af2d91ff..fc7e2a7f41 100644 > > --- a/drivers/net/mlx5/mlx5_rxtx_vec.c > > +++ b/drivers/net/mlx5/mlx5_rxtx_vec.c > > @@ -95,6 +95,7 @@ mlx5_rx_replenish_bulk_mbuf(struct mlx5_rxq_data > > *rxq) > > volatile struct mlx5_wqe_data_seg *wq =3D > > &((volatile struct mlx5_wqe_data_seg *)rxq- > >wqes)[elts_idx]; > > unsigned int i; > > + uint16_t btree_len; > > > > if (n >=3D rxq->rq_repl_thresh) { > > MLX5_ASSERT(n >=3D > > MLX5_VPMD_RXQ_RPLNSH_THRESH(q_n)); > > @@ -106,6 +107,8 @@ mlx5_rx_replenish_bulk_mbuf(struct > mlx5_rxq_data > > *rxq) > > rxq->stats.rx_nombuf +=3D n; > > return; > > } > > + > > + btree_len =3D mlx5_mr_btree_len(&rxq->mr_ctrl.cache_bh); > > for (i =3D 0; i < n; ++i) { > > void *buf_addr; > > > > @@ -119,8 +122,7 @@ mlx5_rx_replenish_bulk_mbuf(struct > mlx5_rxq_data > > *rxq) > > wq[i].addr =3D rte_cpu_to_be_64((uintptr_t)buf_addr > + > > > > RTE_PKTMBUF_HEADROOM); > > /* If there's a single MR, no need to replace LKey. */ > > - if (unlikely(mlx5_mr_btree_len(&rxq- > > >mr_ctrl.cache_bh) > > - > 1)) > > + if (unlikely(btree_len > 1)) > > wq[i].lkey =3D mlx5_rx_mb2mr(rxq, elts[i]); > > } > > rxq->rq_ci +=3D n; > > -- > > 2.25.1