From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wr0-f171.google.com (mail-wr0-f171.google.com [209.85.128.171]) by dpdk.org (Postfix) with ESMTP id DFC1F7CCE for ; Mon, 5 Jun 2017 07:57:09 +0200 (CEST) Received: by mail-wr0-f171.google.com with SMTP id v111so25811428wrc.3 for ; Sun, 04 Jun 2017 22:57:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=weka.io; s=google; h=from:to:cc:subject:date:message-id:organization:in-reply-to :references:mime-version:content-transfer-encoding; bh=VAb2qfUUlqUV8K5VrAdNahnNryPbcz9CoMBzRFg2lAw=; b=T/uYxLMzKBSpziJJbO1nrI66s+umlwlkkVGEV6i31W+sXwYIWdJnrzf26XQobXX9+C g/xNQetESpAVCflQ0CALHIJ+MiSGD5tb76QcjhbOm++I6zZ6aWbTHMsNntg0FetRlcyj idhBJF+k6oE+2n9+Ue/rgroXjUXKujQGxxtnY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:organization :in-reply-to:references:mime-version:content-transfer-encoding; bh=VAb2qfUUlqUV8K5VrAdNahnNryPbcz9CoMBzRFg2lAw=; b=q2pXITg90dBtjHfE/oXF2rO4iDeZ3Buq4WwJPLSEmmObWEVYUV6euOeT50avS7EtD7 PLVW0bzxv9VEHPaXGbRgarZy+Yr/k11TVgkThZAAs7hzjTHVlgghR0SvV9TofotsKYvI mW0MdlB7LEMDaLMiF7zJ105XQBqY+iU87ghECG5VWOWVTStPmTkRwKbTmqitWtZj9uys BqSiDCaJZUifv+D2hWSc35RxPbNtw8LsA62qJ8ew+ilMb7nfNFrsB0sDrVKH0RBcinOv NjXba2XBnqf+c2z4wSPfEHDxj4xRnkxEtGoGppmr6RI+We9zoB0yovLOgzUx5rlnvlWC Jnzw== X-Gm-Message-State: AODbwcA5dwkG48MdsuEpnwXZ5ojtt56pnogcjPPqUMm+2ucv1H3Gxpol 7veCntYuKmE619UmRsg= X-Received: by 10.223.164.154 with SMTP id g26mr13700473wrb.75.1496642229565; Sun, 04 Jun 2017 22:57:09 -0700 (PDT) Received: from polaris.localnet (bzq-84-109-69-99.red.bezeqint.net. [84.109.69.99]) by smtp.gmail.com with ESMTPSA id e73sm8830734wmd.1.2017.06.04.22.57.08 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 04 Jun 2017 22:57:08 -0700 (PDT) From: Gregory Etelson To: "Tan, Jianfeng" Cc: Ferruh Yigit , Shijith Thotton , Stephen Hemminger , dev@dpdk.org, Qi Zhang , Wenzhuo Lu , Thomas Monjalon Date: Mon, 05 Jun 2017 08:57:07 +0300 Message-ID: <10692952.YuU2RkIBYZ@polaris> Organization: Weka.IO In-Reply-To: <4e3b8469-b9be-1963-1ca8-7dd000fe7415@intel.com> References: <1748341.rbpcFmWp0q@polaris> <2232995.tDUxtNZcgW@polaris> <4e3b8469-b9be-1963-1ca8-7dd000fe7415@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7Bit X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] [RFC PATCH] igb_uio: issue FLR during open and release of device file X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jun 2017 05:57:10 -0000 Hello Jianfeng, I was experimenting with pci_disable_device() in release Tests running on Intel 82599 VF crashed server after process down, before a new instance was started. Tests running on Intel XL710 VF did not crash server, but could not send / receive Ethernet frames although all DPDK initialization routines completed without errors Regards, Gregory Hi Gregory, On 6/4/2017 3:22 PM, Gregory Etelson wrote: In my environment I could reproduce server crash after applying the patch Different from your patch, my patch calls pci_enable_device()/pci_disable_device() instead of pci_reset_function()/pci_try_reset_function() separately in open() and release(). Could you check if that's the reason? vfio_pci actually calls both pci_try_reset_function() and pci_disable_device() in release(). Thanks, Jianfeng Regards, Gregory On Wednesday, 31 May 2017 15:20:08 IDT Ferruh Yigit wrote: > On 5/31/2017 12:09 PM, Shijith Thotton wrote: > > Set UIO info device file operations open and release. Call pci reset > > function inside open and release to clear device state at start and > > end. Copied this behaviour from vfio_pci kernel module code. With this > > change, it is not mandatory to issue FLR by PMD's during init and close. > > Cc: Jianfeng Tan [1] > > Jianfeng also implemented following patch: > http://dpdk.org/dev/patchwork/patch/17495/[2] > > Which also implements release and open ops, for slightly different > reason (prevent DMA access after app exit), but mainly both are to > gracefully handle application exit status. > > btw, for Jianfeng's case, can adding pci_clear_master() in release and > moving pci_set_master() to open help preventing unwanted DMA? > > > Gregory, > > Can you please check if this patch fixes your issue? > > Thanks, > ferruh > > > > > Signed-off-by: Shijith Thotton [3] > > --- > > lib/librte_eal/linuxapp/igb_uio/igb_uio.c | 30 ++++++++++++++++++++++++++++++ > > 1 file changed, 30 insertions(+) > > > > diff --git a/lib/librte_eal/linuxapp/igb_uio/igb_uio.c b/lib/librte_eal/linuxapp/igb_uio/igb_uio.c > > index b9d427c..5bc58d2 100644 > > --- a/lib/librte_eal/linuxapp/igb_uio/igb_uio.c > > +++ b/lib/librte_eal/linuxapp/igb_uio/igb_uio.c > > @@ -170,6 +170,34 @@ struct rte_uio_pci_dev { > > return IRQ_HANDLED; > > } > > > > +/** > > + * This gets called while opening uio device file. It clears any previous state > > + * associated with the pci device. > > + */ > > +static int > > +igbuio_pci_open(struct uio_info *info, struct inode *inode) > > +{ > > + struct rte_uio_pci_dev *udev = info->priv; > > + struct pci_dev *dev = udev->pdev; > > + > > + /* reset the pci device */ > > + pci_reset_function(dev); > > + > > + return 0; > > +} > > + > > +static int > > +igbuio_pci_release(struct uio_info *info, struct inode *inode) > > +{ > > + struct rte_uio_pci_dev *udev = info->priv; > > + struct pci_dev *dev = udev->pdev; > > + > > + /* try to reset the pci device */ > > + pci_try_reset_function(dev); > > + > > + return 0; > > +} > > + > > #ifdef CONFIG_XEN_DOM0 > > static int > > igbuio_dom0_mmap_phys(struct uio_info *info, struct vm_area_struct *vma) > > @@ -372,6 +400,8 @@ struct rte_uio_pci_dev { > > udev->info.version = "0.1"; > > udev->info.handler = igbuio_pci_irqhandler; > > udev->info.irqcontrol = igbuio_pci_irqcontrol; > > + udev->info.open = igbuio_pci_open; > > + udev->info.release = igbuio_pci_release; > > #ifdef CONFIG_XEN_DOM0 > > /* check if the driver run on Xen Dom0 */ > > if (xen_initial_domain()) > > > > -------- [1] mailto:jianfeng.tan@intel.com [2] http://dpdk.org/dev/patchwork/patch/17495/ [3] mailto:shijith.thotton@caviumnetworks.com