From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 76F45A0032; Thu, 16 Dec 2021 17:20:37 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 4781640696; Thu, 16 Dec 2021 17:20:37 +0100 (CET) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id A570140143 for ; Thu, 16 Dec 2021 17:20:35 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1639671635; x=1671207635; h=date:from:to:cc:subject:message-id:references: mime-version:in-reply-to; bh=NaOz+1Sax24nYmzjnwbLhJfE/Sact+eLbqe8O8TnSsw=; b=ZqXYsQ2pvcau2VMQEBl0RdqjO+jQf509wuUVjz+luILkaIZhKpN520cY 34EXgGCNR8e/fuv74DCejVsoaVmhWZvkilo7hf1msmlTSyRKyfnqEMeb7 SXgVLKpIU6/k6LWMREanaFpPBSM8KE7GyBGVD9zhq9Hd/nFbqec2MOaVr AatfxixbC0ErPpFgY8yDMsKhGDTLFmBNHmD04eyxJ6Im5YTU5jVUgQy95 h+Z3piONqWhQWpjyLs0G6xsl3f0J0V+SmqqJsp5xQk1eXiJludlxUaZX9 W9W1XQlBkR4iY2VPkLwaoxU/6TywP4356NSazr5WOMfdV71ZQHmtdQAeM w==; X-IronPort-AV: E=McAfee;i="6200,9189,10199"; a="220213470" X-IronPort-AV: E=Sophos;i="5.88,211,1635231600"; d="scan'208";a="220213470" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 16 Dec 2021 08:20:34 -0800 X-IronPort-AV: E=Sophos;i="5.88,211,1635231600"; d="scan'208";a="519314749" Received: from bricha3-mobl.ger.corp.intel.com ([10.252.20.185]) by orsmga008-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-SHA; 16 Dec 2021 08:20:33 -0800 Date: Thu, 16 Dec 2021 16:20:29 +0000 From: Bruce Richardson To: Lance Richardson Cc: dev , conor.walsh@intel.com, kevin.laatz@intel.com Subject: Re: Using IOAT PMD Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Thu, Dec 16, 2021 at 11:04:54AM -0500, Lance Richardson wrote: > Hi Bruce, > > I've been looking into using the IOAT PMD, initially with dma_autotest > and the dpdk-dma example application. These seem to work fine on > SKX with the current main branch, but when I try the same procedure > on ICX (binding all 8 devices to vfio-pci in both cases), I get the following > output for each device when probed. Is something different needed when > using IOAT on ICX vs. SKX? > > Thanks, > Lance > > EAL: Probe PCI driver: dmadev_ioat (8086:b00) device: 0000:80:01.0 (socket 2) > IOAT: ioat_dmadev_probe(): Init 0000:80:01.0 on NUMA node 2 > IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel count == 255 > > IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel appears locked > > IOAT: ioat_dmadev_create(): ioat_dmadev_create: cannot reset device. > CHANCMD=0xff, CHANSTS=0xffffffffffffffff, CHANERR=0xffffffff > > EAL: Releasing PCI mapped resource for 0000:80:01.0 > EAL: Calling pci_unmap_resource for 0000:80:01.0 at 0x4102430000 > EAL: Requested device 0000:80:01.0 cannot be used That is strange, the same PMD should work ok on both platforms. This is all on latest branch, right? Let me attempt to reproduce and get back to you. /Bruce PS: Is this a 4-socket system you are running on, since I see "socket 2" being described as the socket number for device 80:01.0?