From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 39AD8A0032; Thu, 16 Dec 2021 17:34:39 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id BA75840696; Thu, 16 Dec 2021 17:34:38 +0100 (CET) Received: from mail-yb1-f170.google.com (mail-yb1-f170.google.com [209.85.219.170]) by mails.dpdk.org (Postfix) with ESMTP id C500140143 for ; Thu, 16 Dec 2021 17:34:36 +0100 (CET) Received: by mail-yb1-f170.google.com with SMTP id d10so66192796ybn.0 for ; Thu, 16 Dec 2021 08:34:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=9I8mUq3McF5nuxZyYCyWBs4D/jbwxBFQskdyF0Yaggk=; b=EDK3SAJ+wnF61lrazyRFbqc8O3sCIknSxJLJk3tKXZe0InJAbcR/Ob0LeoWLeZzUps V2FTKyirRv5g9xHG0y+c2AuS4Db43+dXzrHpzs6/r3mxAhymiaeQGE9w0fxaYim2drbY H/E15Ah/KHpzNE6zxJucIjHbblMaFt8DNGoj0= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=9I8mUq3McF5nuxZyYCyWBs4D/jbwxBFQskdyF0Yaggk=; b=wSUKecb4xM1MOfyCgIf0qMykaEJ/+PHLirnsUrkOVKOhYJSp/WzjFKSBceuZsvAGp5 FzLYZCp7W1rSmDIRKce3aoFgOo+I8fMmVnaQnoTXOZaRCbmwzDX4dNdR2M4srGSZxn06 UIlnD2yOLZJoa1vDzgtrYSvnApTk//UqfLH1Squ93fjntwtJrZ4hzIcIn2WAnINiYGNI Kk9u3qCo6FO/jnn/Gd+RnpVjZ+jUhVFJjDpeSysKL9rzI00JOJ3NHD2dpqxPINj+nM+k cZfMrv7SkVwwxpImelQ0Qk8pP1Zldqbl7ZG9s0+ih/iRx/WWLYn8xKZfanrLL8PlOsij qCbw== X-Gm-Message-State: AOAM530QBtuOM3r2fbcbIpaNZw3r70D5IlXfm9FyHCi5pjJlIn/YR0Fn FWmlMcg0O9fkusLsDW0fM3a0PAXzdeOGK65ppQqchA== X-Google-Smtp-Source: ABdhPJw7WrjS42zJdNopSRa+2jFxiN4OyyKwEvP0ffvp3CuBFv7mCZ04UIEBdOMT6/YbzHST2Qn8iHMneiPA2/ZrO00= X-Received: by 2002:a25:9bc9:: with SMTP id w9mr14436378ybo.398.1639672476050; Thu, 16 Dec 2021 08:34:36 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Lance Richardson Date: Thu, 16 Dec 2021 11:34:25 -0500 Message-ID: Subject: Re: Using IOAT PMD To: Bruce Richardson Cc: dev , conor.walsh@intel.com, kevin.laatz@intel.com Content-Type: text/plain; charset="UTF-8" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Thu, Dec 16, 2021 at 11:20 AM Bruce Richardson wrote: > > On Thu, Dec 16, 2021 at 11:04:54AM -0500, Lance Richardson wrote: > > Hi Bruce, > > > > I've been looking into using the IOAT PMD, initially with dma_autotest > > and the dpdk-dma example application. These seem to work fine on > > SKX with the current main branch, but when I try the same procedure > > on ICX (binding all 8 devices to vfio-pci in both cases), I get the following > > output for each device when probed. Is something different needed when > > using IOAT on ICX vs. SKX? > > > > Thanks, > > Lance > > > > EAL: Probe PCI driver: dmadev_ioat (8086:b00) device: 0000:80:01.0 (socket 2) > > IOAT: ioat_dmadev_probe(): Init 0000:80:01.0 on NUMA node 2 > > IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel count == 255 > > > > IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel appears locked > > > > IOAT: ioat_dmadev_create(): ioat_dmadev_create: cannot reset device. > > CHANCMD=0xff, CHANSTS=0xffffffffffffffff, CHANERR=0xffffffff > > > > EAL: Releasing PCI mapped resource for 0000:80:01.0 > > EAL: Calling pci_unmap_resource for 0000:80:01.0 at 0x4102430000 > > EAL: Requested device 0000:80:01.0 cannot be used > > That is strange, the same PMD should work ok on both platforms. This is all > on latest branch, right? Let me attempt to reproduce and get back to you. Hi Bruce, That's correct, I'm using the current tip of the main branch, which seems to be identical to 21.11.0. > > /Bruce > > PS: Is this a 4-socket system you are running on, since I see "socket 2" > being described as the socket number for device 80:01.0? > It is a two-socket system with sub-NUMA enabled, so it appears as four NUMA nodes. I'm only binding the devices on the second socket. Thanks, Lance