From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0043.outbound.protection.outlook.com [104.47.2.43]) by dpdk.org (Postfix) with ESMTP id 3820B1B01E; Tue, 16 Jan 2018 02:12:37 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=S/NrjAPiZYdqLQHyOibnxXFQnx1arvrvumfCXmFQfm4=; b=aPM6a2ZDgfZkY7rYSFzIdFjBQEi5vAEvV8B6yxn8V5ffFsQsjWI1Bncal+F991WcOTFbLaBrGi2Y4n9CyAhlO593f+Xf+uV65fFXc6usMW/1NZ+VvS61s2g3bQ6Sz5wuSmo1/qurmHIQ/4SRHzuwN0H2Ry5xOdmhlf3QRdmQk08= Received: from mellanox.com (209.116.155.178) by DB6PR0501MB2040.eurprd05.prod.outlook.com (2603:10a6:4:6::22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.407.7; Tue, 16 Jan 2018 01:12:33 +0000 From: Yongseok Koh To: adrien.mazarguil@6wind.com, nelio.laranjeiro@6wind.com, jerin.jacob@caviumnetworks.com, jianbo.liu@arm.com Cc: dev@dpdk.org, Yongseok Koh , stable@dpdk.org Date: Mon, 15 Jan 2018 17:10:50 -0800 Message-Id: <20180116011050.18866-9-yskoh@mellanox.com> X-Mailer: git-send-email 2.11.0 In-Reply-To: <20180116011050.18866-1-yskoh@mellanox.com> References: <20171227042824.33373-1-yskoh@mellanox.com> <20180116011050.18866-1-yskoh@mellanox.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [209.116.155.178] X-ClientProxiedBy: CO2PR05CA0073.namprd05.prod.outlook.com (2603:10b6:102:2::41) To DB6PR0501MB2040.eurprd05.prod.outlook.com (2603:10a6:4:6::22) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 00ec4b57-cfde-4474-7fc3-08d55c7e3a2c X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4604075)(48565401081)(2017052603307)(7153060)(7193020); SRVR:DB6PR0501MB2040; X-Microsoft-Exchange-Diagnostics: 1; DB6PR0501MB2040; 3:VBtE6PdsRj9AG61boXpc5AzXSCzKQl4hWOt4pMA/O6xTX6f1i/DBXjyq0GaCbg8DlqEbRsv7ZYoyZk5SCk+wlH6o57XrFt3ByleUz6MDeJAlmcwEtDtTUST8jxQLA7GaNHN03ZRfrUJD0UKz2bdG1bA7ZAIwdiz6IJJmJsh9PXVBnJinWE1qRUqeogIGmx8H32wl5DYXrlO4p2ASTFT/ciWeLCnFeMh650REOUjc6lFuG/12rbrpXlEyYjME+wmj; 25:EnWvajFsOhal8LpDMU8pcy19hnvHzkhLBMHpLdnCGCdlSJlGi4qYnKZ8ihBXg7u219loZv3saHoDjwpKYZc+VauRuGLNw8zXFcYPexqBs4T8gA3Pz5JeP4pry6Az4R5bSPEAueBzYwJeVfYDRii5dDE/nRqc6dfgx0TR/kPmQRCR03BNk7CO/MVYvrpIqj6C1IafDdP9TieVkc4zZyR2c0/YJUk0WCEga+5d/9l+0UY8CaTMZY21HhzMwY5C7AJQoQ7Vwj0+hhJRhjBp7gQBqx7zPxNqMPHTJPVKawccavuJUjI/Jizun8UGFsSyAnjtM4nCia8Cb9dRwD/or8o17w==; 31:BaShHEQqlcXVlDjERqwJ3V/4fa4XAvDLUiksS/8rFafxjNvjDOJTAKkFjUgUdL1tv6XMzhS0ce+3TyqlNO5E+Xor/EioUZLCVeeINg97r+3/8qUjQDT/A8pxpGGjNlwGNrNt6BJ+k6rvRhKXYQ9KOmKXXFO/MPTq8pw52KQDU0RubpWgZ5VV+kGVVnK86ktV9wiRbIifdu/lTkVXh/7ur/+6ikJMMdzckFRne04caX8= X-MS-TrafficTypeDiagnostic: DB6PR0501MB2040: Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=yskoh@mellanox.com; X-LD-Processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr X-Microsoft-Exchange-Diagnostics: 1; DB6PR0501MB2040; 20:77iYvHpPVo1Cuubp9b59ESXu+k5SzaTbTaeXmzyQT5v40AvxSNmLWiPN+Oy2x7GzJ8d3CD8GlJId6Kq/kBFl0nose6WvCKt5RsrlrlWB/amRhZzE02eSps1oEeZzQrwI+KwXzrn9VlLAA6+23iSIsL2vzVqviBlQ5qV39S8iOpbbVJ0SSJKRYjAZ4xoFzXujww35irVW+p2AmQCYwAJaYXqWv0Kr0Aqcp3x8ADaTODScR9fhl29sDpLzWl/0kkI9xNw5SYnqcZ6lcuhrUakVHyObDjYi0V/KoN5qFyZ6qQJdbYIP6XE/IRCetS80cXeGU8bpkKqFO9Xs2t3jPOgCBOxDy3Iv0nwnEHMkasPu592Aov9k6us8F8Dwj0BQEHo/hX29cNKrmNf+FZO6JcqWjAnRB8pvK0+2HaFTma/upRSJEJIQxkmgSJZSvJ5mtGiTfEVkBpbm04YDlwX3IdEPlXwEX5jcMMzGKAzL8c4tPBh8GYr8Y9uVDCLhRLqXOK4Z; 4:i+MoxNZJuLs+WFj6f7rYZ0A+gM8xI8jQCS5QA/8DcpwdhWPfAlUBc+o21ts7TioBBu/nPNTRXhaAWVfIYpRHjZNUoK+OZB3t8feQey4cKQY5YvM9NLkL4aaR5+G6OAP3LGJltUfKuLs48fvbZw2WbDrMsxJXpAKL3alD+h79PTX90jYUoEWy/b66E7S4BR0vDKH2RuLRn3Powny5jV3sc2fs1FvVE/zYwZsiu6pdsfbX3lipDCqCCjuxfQa58XAWMC626Po6gU9MVAVm5dJ0yA== X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040470)(2401047)(8121501046)(5005006)(3002001)(93006095)(93001095)(10201501046)(3231023)(944501161)(6055026)(6041268)(20161123558120)(20161123562045)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011); SRVR:DB6PR0501MB2040; BCL:0; PCL:0; RULEID:(100000803101)(100110400095); SRVR:DB6PR0501MB2040; X-Forefront-PRVS: 0554B1F54F X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(376002)(39380400002)(366004)(39860400002)(346002)(396003)(189003)(199004)(66066001)(105586002)(106356001)(575784001)(86362001)(97736004)(21086003)(316002)(5660300001)(2950100002)(6666003)(16526018)(47776003)(16586007)(76176011)(7696005)(478600001)(81156014)(25786009)(51416003)(81166006)(52116002)(4326008)(8676002)(36756003)(386003)(8936002)(59450400001)(69596002)(55016002)(1076002)(53936002)(305945005)(50226002)(7736002)(2906002)(3846002)(6116002)(48376002)(50466002)(68736007)(26005); DIR:OUT; SFP:1101; SCL:1; SRVR:DB6PR0501MB2040; H:mellanox.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; DB6PR0501MB2040; 23:tTMZ0TH8f+yekbaUrzMnUyzOpQf85DMLdzif/wB?= =?us-ascii?Q?y8e+bbbsvEthi4Y0LHkP0VYvKVPBrehyaqiopdCohXfrD2DMI3LL1JK+1V8W?= =?us-ascii?Q?9GCNn6W1nbLzmYyjR5zJXa5TUECpFX8YyM2UPEFGoWDtoPvHE78LoM4FNcZk?= =?us-ascii?Q?JJNlZUu8uZ0qrxDaS93ZdGN1BcD9xKmJyKu5LR08LPGgrmBxPTc3iTERpLAq?= =?us-ascii?Q?gpFlm31QlRxPsLqptCOkXYz/E2PzjujW4vBtQwUkLhbQEYUPY9FCTJX7Z917?= =?us-ascii?Q?PDlaHJG3yvbsGvvZupERzHlCC4qu/cxAq2pLEGXWbJGEGe6hWv7hvTf+RpYC?= =?us-ascii?Q?8aaYE7cykGHFWDIay/V3mnjX0Ffvx7xgJsvrm62ivdKBXzVvx+2apMbp+J5x?= =?us-ascii?Q?FCiAW2YiTnE18AdysUpokwXcuBTkBRxt7wkG6Q+CED1EO24WWI9POaM8V9UF?= =?us-ascii?Q?mNseB7EVlwjEEBkZr7GiE0c4Wi6UTmBt7fFeew4IoEENStkhLrToOkJz2pwt?= =?us-ascii?Q?+d7lzYNk+Az8blH8AanslpHY9uRyjH86aNEQfa46jKXFJO0lCjU3fOnN9ByG?= =?us-ascii?Q?b4q0Yn0QhIecZaNqFh42A0lSLv7/d8x0EwVR3uXdIqh0ebnrBiW0lkL0SyvJ?= =?us-ascii?Q?Tlb1piL7FbTYkQ1fx9TEeCxWMCSyptsHdW2v0GPEL615TjNoGk3h3Y2R4Onx?= =?us-ascii?Q?EAt9I493lX9yFZWAb5Za6KiNg30alxfr0+xvZs38dfF31jeTL6fwergy1pj0?= =?us-ascii?Q?5cWcYxxpZNMSxVVnAxrLIiSGxewIMRYCnGxmP5OMehYbPE8ZBZWiiqpMcfP/?= =?us-ascii?Q?duyg6hEnrPLP8EbMDRVuOhHLc/L2XL5M10RaC/282jpH+lB0uvlUFQWYiXhf?= =?us-ascii?Q?KoQKrrFShinOFtoWOT9cbutEuOZyGsTui8Iw40KsxPN0VNN1ZIp3slfQTrD/?= =?us-ascii?Q?kl7Mn94qv4XX2513TDSO+DKEWOq1YhEGiRMIb4X4qB38uNRE75HPd1FB9pd6?= =?us-ascii?Q?ue26Mk/IIWUXFuX/skxHfD8sM2h94uj0lUUESXt2VwPVezdHqZXthanzpuuw?= =?us-ascii?Q?b04fZoJdhW8AxaS9kFjOh/zIMorYDCk/BvqyJB+5zNUG5bE8E7tqoFSVsCQW?= =?us-ascii?Q?MOeZj94yOmDJUCxefq4LKHd7ut/dLSnnGV3BepsGejKbdcAHWxiY5fg=3D?= =?us-ascii?Q?=3D?= X-Microsoft-Exchange-Diagnostics: 1; DB6PR0501MB2040; 6:LQkiHbqbogES2losufY+ONOdjwI5/XLFoPXZftxv6pNreP2UcsMVmpqavvkXAuiU0NrO+iQmdZGbQTKPi4o8xCjStSnPA83qyfG/ua4n6zeQ4oddtuWkB7ffBolTHNJ8i64tg5z+c/JgCgbNsXteLw+eNaOrRMS9haF8k5om4jYVCldb5CfqWqUjBX1cGFBcJyye41SOy0pp4zC9PZnK/1LqsvN+4u6lCHPayymY2fn1ydbzcDHihQO7bKG2j/ZVLhf6v7jSvFmGCCZ//dsITrNMxTo+yiQdgXQqzy8MxDICnVU9TAZoUoOXKAdpsVTGUGm56TWhndnUH4VTDOekWteMjL5SRtnhtdbJY9eE7jo=; 5:QPlrgGP2AXqQisC9yVmbjiK3u/IY7df8a2e6CzUWMyUsErGInpzwEkrd6gXfJgztyPfVibC4+cOqmFxIzG7Nr/e/5gDCwCmxdLrcZm1tRYCsyChV3Y0frNmNG0KRX8ftkrc3IwKSwXfo6lZpF0cQz2zdIVFCGP75hD0+g+IL9sU=; 24:rAJ7HPd8+HseIK16QkVH0HuC+GIxeWWsiOCt8oW2iszH1OfQhVGn4AI80DB1DzL8pq2JfOn/U5aMnAF79eaSbpZ5wH1XDv4WXB7z/u3i1R4=; 7:9ghOW+cirUzPSBWPcB0iF+2dGXfBroG+XAZoraKii3nv3kd8XP0OpUJ+s/jbQORAUcWuUPn9JWBXTWJay1vLSUk1kgXC7B8jxVv9wADVxMnw+QIA4hiwX/KHJZzcCBmYIEZTxddd8hyMMJ6SSdx7WEstDPl1wCBxoSo7JFtZc01V8j4KOh/8KHWiKp1Tq5VJJJyJ4O1giGjBT9gGvmnjgGxC2Av4PLOo/ELHASWMWpOXUzWI/ENLz2prxn40r+yu SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Jan 2018 01:12:33.9890 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 00ec4b57-cfde-4474-7fc3-08d55c7e3a2c X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0501MB2040 Subject: [dpdk-dev] [PATCH v2 8/8] net/mlx5: fix synchonization on polling Rx completions X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Jan 2018 01:12:37 -0000 Polling a new packet is basically sensing the generation bit in a completion entry. For some processors not having strongly-ordered memory model, there has to be an IO memory barrier between reading the generation bit and other fields of the entry in order to guarantee data is not stale. Fixes: 570acdb1da8a ("net/mlx5: add vectorized Rx/Tx burst for ARM") Cc: stable@dpdk.org Signed-off-by: Yongseok Koh Acked-by: Shahaf Shuler Acked-by: Nelio Laranjeiro --- drivers/net/mlx5/mlx5_rxtx.c | 1 + drivers/net/mlx5/mlx5_rxtx_vec_neon.h | 53 ++++++++++++++++++++--------------- drivers/net/mlx5/mlx5_rxtx_vec_sse.h | 2 +- 3 files changed, 32 insertions(+), 24 deletions(-) diff --git a/drivers/net/mlx5/mlx5_rxtx.c b/drivers/net/mlx5/mlx5_rxtx.c index 99a5f8681..8065d9d0b 100644 --- a/drivers/net/mlx5/mlx5_rxtx.c +++ b/drivers/net/mlx5/mlx5_rxtx.c @@ -1669,6 +1669,7 @@ mlx5_rx_poll_len(struct mlx5_rxq_data *rxq, volatile struct mlx5_cqe *cqe, return 0; ++rxq->cq_ci; op_own = cqe->op_own; + rte_dma_rmb(); if (MLX5_CQE_FORMAT(op_own) == MLX5_COMPRESSED) { volatile struct mlx5_mini_cqe8 (*mc)[8] = (volatile struct mlx5_mini_cqe8 (*)[8]) diff --git a/drivers/net/mlx5/mlx5_rxtx_vec_neon.h b/drivers/net/mlx5/mlx5_rxtx_vec_neon.h index e11565f69..29ae933e7 100644 --- a/drivers/net/mlx5/mlx5_rxtx_vec_neon.h +++ b/drivers/net/mlx5/mlx5_rxtx_vec_neon.h @@ -814,6 +814,7 @@ rxq_burst_v(struct mlx5_rxq_data *rxq, struct rte_mbuf **pkts, uint16_t pkts_n, uint16x4_t mask; uint16x4_t byte_cnt; uint32x4_t ptype_info, flow_tag; + register uint64x2_t c0, c1, c2, c3; uint8_t *p0, *p1, *p2, *p3; uint8_t *e0 = (void *)&elts[pos]->pkt_len; uint8_t *e1 = (void *)&elts[pos + 1]->pkt_len; @@ -830,6 +831,16 @@ rxq_burst_v(struct mlx5_rxq_data *rxq, struct rte_mbuf **pkts, uint16_t pkts_n, p1 = p0 + (pkts_n - pos > 1) * sizeof(struct mlx5_cqe); p2 = p1 + (pkts_n - pos > 2) * sizeof(struct mlx5_cqe); p3 = p2 + (pkts_n - pos > 3) * sizeof(struct mlx5_cqe); + /* B.0 (CQE 3) load a block having op_own. */ + c3 = vld1q_u64((uint64_t *)(p3 + 48)); + /* B.0 (CQE 2) load a block having op_own. */ + c2 = vld1q_u64((uint64_t *)(p2 + 48)); + /* B.0 (CQE 1) load a block having op_own. */ + c1 = vld1q_u64((uint64_t *)(p1 + 48)); + /* B.0 (CQE 0) load a block having op_own. */ + c0 = vld1q_u64((uint64_t *)(p0 + 48)); + /* Synchronize for loading the rest of blocks. */ + rte_dma_rmb(); /* Prefetch next 4 CQEs. */ if (pkts_n - pos >= 2 * MLX5_VPMD_DESCS_PER_LOOP) { unsigned int next = pos + MLX5_VPMD_DESCS_PER_LOOP; @@ -839,50 +850,46 @@ rxq_burst_v(struct mlx5_rxq_data *rxq, struct rte_mbuf **pkts, uint16_t pkts_n, rte_prefetch_non_temporal(&cq[next + 3]); } __asm__ volatile ( - /* B.1 (CQE 3) load a block having op_own. */ - "ld1 {v19.16b}, [%[p3]] \n\t" - "sub %[p3], %[p3], #48 \n\t" - /* B.2 (CQE 3) load the rest blocks. */ + /* B.1 (CQE 3) load the rest of blocks. */ "ld1 {v16.16b - v18.16b}, [%[p3]] \n\t" + /* B.2 (CQE 3) move the block having op_own. */ + "mov v19.16b, %[c3].16b \n\t" /* B.3 (CQE 3) extract 16B fields. */ "tbl v23.16b, {v16.16b - v19.16b}, %[cqe_shuf_m].16b \n\t" + /* B.1 (CQE 2) load the rest of blocks. */ + "ld1 {v16.16b - v18.16b}, [%[p2]] \n\t" /* B.4 (CQE 3) adjust CRC length. */ "sub v23.8h, v23.8h, %[crc_adj].8h \n\t" - /* B.1 (CQE 2) load a block having op_own. */ - "ld1 {v19.16b}, [%[p2]] \n\t" - "sub %[p2], %[p2], #48 \n\t" /* C.1 (CQE 3) generate final structure for mbuf. */ "tbl v15.16b, {v23.16b}, %[mb_shuf_m].16b \n\t" - /* B.2 (CQE 2) load the rest blocks. */ - "ld1 {v16.16b - v18.16b}, [%[p2]] \n\t" + /* B.2 (CQE 2) move the block having op_own. */ + "mov v19.16b, %[c2].16b \n\t" /* B.3 (CQE 2) extract 16B fields. */ "tbl v22.16b, {v16.16b - v19.16b}, %[cqe_shuf_m].16b \n\t" + /* B.1 (CQE 1) load the rest of blocks. */ + "ld1 {v16.16b - v18.16b}, [%[p1]] \n\t" /* B.4 (CQE 2) adjust CRC length. */ "sub v22.8h, v22.8h, %[crc_adj].8h \n\t" - /* B.1 (CQE 1) load a block having op_own. */ - "ld1 {v19.16b}, [%[p1]] \n\t" - "sub %[p1], %[p1], #48 \n\t" /* C.1 (CQE 2) generate final structure for mbuf. */ "tbl v14.16b, {v22.16b}, %[mb_shuf_m].16b \n\t" - /* B.2 (CQE 1) load the rest blocks. */ - "ld1 {v16.16b - v18.16b}, [%[p1]] \n\t" + /* B.2 (CQE 1) move the block having op_own. */ + "mov v19.16b, %[c1].16b \n\t" /* B.3 (CQE 1) extract 16B fields. */ "tbl v21.16b, {v16.16b - v19.16b}, %[cqe_shuf_m].16b \n\t" + /* B.1 (CQE 0) load the rest of blocks. */ + "ld1 {v16.16b - v18.16b}, [%[p0]] \n\t" /* B.4 (CQE 1) adjust CRC length. */ "sub v21.8h, v21.8h, %[crc_adj].8h \n\t" - /* B.1 (CQE 0) load a block having op_own. */ - "ld1 {v19.16b}, [%[p0]] \n\t" - "sub %[p0], %[p0], #48 \n\t" /* C.1 (CQE 1) generate final structure for mbuf. */ "tbl v13.16b, {v21.16b}, %[mb_shuf_m].16b \n\t" - /* B.2 (CQE 0) load the rest blocks. */ - "ld1 {v16.16b - v18.16b}, [%[p0]] \n\t" + /* B.2 (CQE 0) move the block having op_own. */ + "mov v19.16b, %[c0].16b \n\t" + /* A.1 load mbuf pointers. */ + "ld1 {v24.2d - v25.2d}, [%[elts_p]] \n\t" /* B.3 (CQE 0) extract 16B fields. */ "tbl v20.16b, {v16.16b - v19.16b}, %[cqe_shuf_m].16b \n\t" /* B.4 (CQE 0) adjust CRC length. */ "sub v20.8h, v20.8h, %[crc_adj].8h \n\t" - /* A.1 load mbuf pointers. */ - "ld1 {v24.2d - v25.2d}, [%[elts_p]] \n\t" /* D.1 extract op_own byte. */ "tbl %[op_own].8b, {v20.16b - v23.16b}, %[owner_shuf_m].8b \n\t" /* C.2 (CQE 3) adjust flow mark. */ @@ -917,9 +924,9 @@ rxq_burst_v(struct mlx5_rxq_data *rxq, struct rte_mbuf **pkts, uint16_t pkts_n, [byte_cnt]"=&w"(byte_cnt), [ptype_info]"=&w"(ptype_info), [flow_tag]"=&w"(flow_tag) - :[p3]"r"(p3 + 48), [p2]"r"(p2 + 48), - [p1]"r"(p1 + 48), [p0]"r"(p0 + 48), + :[p3]"r"(p3), [p2]"r"(p2), [p1]"r"(p1), [p0]"r"(p0), [e3]"r"(e3), [e2]"r"(e2), [e1]"r"(e1), [e0]"r"(e0), + [c3]"w"(c3), [c2]"w"(c2), [c1]"w"(c1), [c0]"w"(c0), [elts_p]"r"(elts_p), [pkts_p]"r"(pkts_p), [cqe_shuf_m]"w"(cqe_shuf_m), diff --git a/drivers/net/mlx5/mlx5_rxtx_vec_sse.h b/drivers/net/mlx5/mlx5_rxtx_vec_sse.h index 559b0237e..6c4d1c3d5 100644 --- a/drivers/net/mlx5/mlx5_rxtx_vec_sse.h +++ b/drivers/net/mlx5/mlx5_rxtx_vec_sse.h @@ -833,7 +833,7 @@ rxq_burst_v(struct mlx5_rxq_data *rxq, struct rte_mbuf **pkts, uint16_t pkts_n, /* B.2 copy mbuf pointers. */ _mm_storeu_si128((__m128i *)&pkts[pos], mbp1); _mm_storeu_si128((__m128i *)&pkts[pos + 2], mbp2); - rte_compiler_barrier(); + rte_dma_rmb(); /* C.1 load remained CQE data and extract necessary fields. */ cqe_tmp2 = _mm_load_si128((__m128i *)&cq[pos + p3]); cqe_tmp1 = _mm_load_si128((__m128i *)&cq[pos + p2]); -- 2.11.0