From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from foss.arm.com (foss.arm.com [217.140.101.70]) by dpdk.org (Postfix) with ESMTP id CDACD4C80 for ; Mon, 8 Oct 2018 11:11:59 +0200 (CEST) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 4477CED1; Mon, 8 Oct 2018 02:11:59 -0700 (PDT) Received: from localhost.localdomain (unknown [10.171.20.31]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPA id 50A5C3F5D3; Mon, 8 Oct 2018 02:11:57 -0700 (PDT) From: Phil Yang To: dev@dpdk.org Cc: jerin.jacob@caviumnetworks.com, Gavin.Hu@arm.com, Honnappa.Nagarahalli@arm.com, Ola.Liljedahl@arm.com, ferruh.yigit@intel.com, phil.yang@arm.com Date: Mon, 8 Oct 2018 17:11:44 +0800 Message-Id: <1538989906-8349-2-git-send-email-phil.yang@arm.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1538989906-8349-1-git-send-email-phil.yang@arm.com> References: <1537364560-4124-1-git-send-email-phil.yang@arm.com> <1538989906-8349-1-git-send-email-phil.yang@arm.com> Subject: [dpdk-dev] [PATCH v3 2/4] kni: fix kni fifo synchronization X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Oct 2018 09:12:01 -0000 With existing code in kni_fifo_put, rx_q values are not being updated before updating fifo_write. While reading rx_q in kni_net_rx_normal, This is causing the sync issue on other core. The same situation happens in kni_fifo_get as well. So syncing the values by adding memory barriers to make sure the values being synced before updating fifo_write and fifo_read. Fixes: 3fc5ca2 ("kni: initial import") Signed-off-by: Phil Yang Reviewed-by: Honnappa Nagarahalli Reviewed-by: Gavin Hu Reviewed-by: Ola Liljedahl Reviewed-by: Jerin Jacob --- lib/librte_kni/rte_kni_fifo.h | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/lib/librte_kni/rte_kni_fifo.h b/lib/librte_kni/rte_kni_fifo.h index ac26a8c..70ac14e 100644 --- a/lib/librte_kni/rte_kni_fifo.h +++ b/lib/librte_kni/rte_kni_fifo.h @@ -28,8 +28,9 @@ kni_fifo_put(struct rte_kni_fifo *fifo, void **data, unsigned num) { unsigned i = 0; unsigned fifo_write = fifo->write; - unsigned fifo_read = fifo->read; unsigned new_write = fifo_write; + rte_smp_rmb(); + unsigned fifo_read = fifo->read; for (i = 0; i < num; i++) { new_write = (new_write + 1) & (fifo->len - 1); @@ -39,6 +40,7 @@ kni_fifo_put(struct rte_kni_fifo *fifo, void **data, unsigned num) fifo->buffer[fifo_write] = data[i]; fifo_write = new_write; } + rte_smp_wmb(); fifo->write = fifo_write; return i; } @@ -51,7 +53,9 @@ kni_fifo_get(struct rte_kni_fifo *fifo, void **data, unsigned num) { unsigned i = 0; unsigned new_read = fifo->read; + rte_smp_rmb(); unsigned fifo_write = fifo->write; + for (i = 0; i < num; i++) { if (new_read == fifo_write) break; @@ -59,6 +63,7 @@ kni_fifo_get(struct rte_kni_fifo *fifo, void **data, unsigned num) data[i] = fifo->buffer[new_read]; new_read = (new_read + 1) & (fifo->len - 1); } + rte_smp_rmb(); fifo->read = new_read; return i; } @@ -69,5 +74,8 @@ kni_fifo_get(struct rte_kni_fifo *fifo, void **data, unsigned num) static inline uint32_t kni_fifo_count(struct rte_kni_fifo *fifo) { - return (fifo->len + fifo->write - fifo->read) & (fifo->len - 1); + unsigned fifo_write = fifo->write; + rte_smp_rmb(); + unsigned fifo_read = fifo->read; + return (fifo->len + fifo_write - fifo_read) & (fifo->len - 1); } -- 2.7.4