From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
by inbox.dpdk.org (Postfix) with ESMTP id 79E96A04A7;
Tue, 25 Jan 2022 10:43:55 +0100 (CET)
Received: from [217.70.189.124] (localhost [127.0.0.1])
by mails.dpdk.org (Postfix) with ESMTP id E2A01428ED;
Tue, 25 Jan 2022 10:43:17 +0100 (CET)
Received: from mga18.intel.com (mga18.intel.com [134.134.136.126])
by mails.dpdk.org (Postfix) with ESMTP id 84901428DA
for <dev@dpdk.org>; Tue, 25 Jan 2022 10:43:15 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;
d=intel.com; i=@intel.com; q=dns/txt; s=Intel;
t=1643103795; x=1674639795;
h=from:to:cc:subject:date:message-id:in-reply-to: references;
bh=Ub3AZnnS8uIx3lW0N+A7Vw9tpP0UyirUaST2e+H5Tpc=;
b=CRxdM35eW1+9iY1lRgIIY2Wi8BvYw1pB0L9w3Iv93Gzjfb5oPl+65ucN
U+0sgVgoxKlW5t/hPx3mRhW9OGVueYgJ6OhSGAG80aDMvplrA/v+rBlmC
rRz+sKwYdGPuj/COwj7molmFnhi8jxOHl8SEU88m/tHDsS5JCJHSqlAa+
Uj0533QbVeT0LYx0+rdizJqoycT9x0Hj6GdUh2f7qq1LNRU4vpJFUP6OK
69s/16iFtWk1/DrcXumocU4rWDr8sQXMZO+p7X/h/XaPpw6Dm1CNb5Tqf
Z/u9lmm2xt99PB6qMII5ENw/QGm410y+feJgM48EJUyqNIwjoLxLWvc3c A==;
X-IronPort-AV: E=McAfee;i="6200,9189,10237"; a="229840488"
X-IronPort-AV: E=Sophos;i="5.88,314,1635231600"; d="scan'208";a="229840488"
Received: from orsmga008.jf.intel.com ([10.7.209.65])
by orsmga106.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;
25 Jan 2022 01:43:15 -0800
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.88,314,1635231600"; d="scan'208";a="534656907"
Received: from dpdk-dipei.sh.intel.com ([10.67.111.91])
by orsmga008.jf.intel.com with ESMTP; 25 Jan 2022 01:43:13 -0800
From: Andy Pei <andy.pei@intel.com>
To: dev@dpdk.org
Cc: chenbo.xia@intel.com, maxime.coquelin@redhat.com, gang.cao@intel.com,
changpeng.liu@intel.com
Subject: [PATCH v2 14/15] vdpa/ifc: make sure hardware last_avail_idx and
last_used_idx is the same when blk device pause
Date: Tue, 25 Jan 2022 17:37:16 +0800
Message-Id: <1643103437-118618-15-git-send-email-andy.pei@intel.com>
X-Mailer: git-send-email 1.8.3.1
In-Reply-To: <1643103437-118618-1-git-send-email-andy.pei@intel.com>
References: <1643093258-47258-2-git-send-email-andy.pei@intel.com>
<1643103437-118618-1-git-send-email-andy.pei@intel.com>
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
<mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
<mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org
When virtio blk device is pause, make sure hardware last_avail_idx and last_used_idx is the same.
Signed-off-by: Andy Pei <andy.pei@intel.com>
---
drivers/vdpa/ifc/base/ifcvf.c | 2 +-
drivers/vdpa/ifc/base/ifcvf.h | 3 +++
drivers/vdpa/ifc/ifcvf_vdpa.c | 32 +++++++++++++++++++++++---------
3 files changed, 27 insertions(+), 10 deletions(-)
diff --git a/drivers/vdpa/ifc/base/ifcvf.c b/drivers/vdpa/ifc/base/ifcvf.c
index a8a4728..7018048 100644
--- a/drivers/vdpa/ifc/base/ifcvf.c
+++ b/drivers/vdpa/ifc/base/ifcvf.c
@@ -116,7 +116,7 @@
IFCVF_WRITE_REG8(status, &hw->common_cfg->device_status);
}
-STATIC void
+void
ifcvf_reset(struct ifcvf_hw *hw)
{
ifcvf_set_status(hw, 0);
diff --git a/drivers/vdpa/ifc/base/ifcvf.h b/drivers/vdpa/ifc/base/ifcvf.h
index 7367094..f22d18b 100644
--- a/drivers/vdpa/ifc/base/ifcvf.h
+++ b/drivers/vdpa/ifc/base/ifcvf.h
@@ -157,6 +157,9 @@ struct ifcvf_hw {
int
ifcvf_init_hw(struct ifcvf_hw *hw, PCI_DEV *dev);
+void
+ifcvf_reset(struct ifcvf_hw *hw);
+
u64
ifcvf_get_features(struct ifcvf_hw *hw);
diff --git a/drivers/vdpa/ifc/ifcvf_vdpa.c b/drivers/vdpa/ifc/ifcvf_vdpa.c
index 4eb8f98..b0b2859 100644
--- a/drivers/vdpa/ifc/ifcvf_vdpa.c
+++ b/drivers/vdpa/ifc/ifcvf_vdpa.c
@@ -356,23 +356,32 @@ struct rte_vdpa_dev_info {
vdpa_ifcvf_blk_pause(struct ifcvf_internal *internal)
{
struct ifcvf_hw *hw = &internal->hw;
- struct rte_vhost_vring vq;
int i, vid;
uint64_t features = 0;
uint64_t log_base = 0, log_size = 0;
uint64_t len;
+ u32 ring_state = 0;
vid = internal->vid;
if (internal->device_type == IFCVF_BLK) {
for (i = 0; i < hw->nr_vring; i++) {
- rte_vhost_get_vhost_vring(internal->vid, i, &vq);
- while (vq.avail->idx != vq.used->idx) {
- ifcvf_notify_queue(hw, i);
- usleep(10);
- }
- hw->vring[i].last_avail_idx = vq.avail->idx;
- hw->vring[i].last_used_idx = vq.used->idx;
+ do {
+ if (hw->lm_cfg != NULL)
+ ring_state = *(u32 *)(hw->lm_cfg +
+ IFCVF_LM_RING_STATE_OFFSET +
+ i * IFCVF_LM_CFG_SIZE);
+ hw->vring[i].last_avail_idx =
+ (u16)(ring_state & IFCVF_16_BIT_MASK);
+ hw->vring[i].last_used_idx =
+ (u16)(ring_state >> 16);
+ if (hw->vring[i].last_avail_idx !=
+ hw->vring[i].last_used_idx) {
+ ifcvf_notify_queue(hw, i);
+ usleep(10);
+ }
+ } while (hw->vring[i].last_avail_idx !=
+ hw->vring[i].last_used_idx);
}
}
@@ -759,7 +768,12 @@ struct rte_vdpa_dev_info {
if (ret)
goto err;
- vdpa_ifcvf_stop(internal);
+ if (internal->device_type == IFCVF_BLK) {
+ vdpa_ifcvf_blk_pause(internal);
+ ifcvf_reset(&internal->hw);
+ } else {
+ vdpa_ifcvf_stop(internal);
+ }
ret = vdpa_disable_vfio_intr(internal);
if (ret)
--
1.8.3.1