From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 400F3A0032;
	Thu, 16 Dec 2021 17:05:07 +0100 (CET)
Received: from [217.70.189.124] (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 13AD540696;
	Thu, 16 Dec 2021 17:05:07 +0100 (CET)
Received: from mail-yb1-f171.google.com (mail-yb1-f171.google.com
 [209.85.219.171])
 by mails.dpdk.org (Postfix) with ESMTP id 86E9340143
 for <dev@dpdk.org>; Thu, 16 Dec 2021 17:05:05 +0100 (CET)
Received: by mail-yb1-f171.google.com with SMTP id j2so65687682ybg.9
 for <dev@dpdk.org>; Thu, 16 Dec 2021 08:05:05 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google;
 h=mime-version:from:date:message-id:subject:to;
 bh=72EO6ELSIszK1wwBwcmLaX51s1zcfK9Zg9WO7/VO0j0=;
 b=KZqepRqNksGGKbVCLOhVtJcmOiYt3cEHJbf/dv4QnBaswVqJMQnEPu+o5dAJT/RkJo
 Q+Lg63qdM/0wesXe6FrbvAoCNGPg/XS1ncbUE38cgKP8rIVsOUzqIaTe4SpT0BETLFGp
 UUtAhGVvBVvz2b8HHcmyUdOAgNSnwsHIv5rGI=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
 bh=72EO6ELSIszK1wwBwcmLaX51s1zcfK9Zg9WO7/VO0j0=;
 b=mix6ek1VnPcZJf4x/jr4mvbbDVaqtEpaNvL0CMOXLcJiKKzMEEKUE7U9c+ppoMoja3
 ikc/w+aTOFPktiZ0O+wzcufLDtlEGCHjoHsL9iP8L0ka5yoce9KBor8+N3cbKhpT/bN3
 a2ROq6euVGgRWUwCnsiNWtDJBiVzr7C++MsI5kV5u5geIcNX22JVVOkckP+dVjJ3aSmE
 FqZpcHbqut+oj253p9FdxejkCEWygjaOld+68e7F0zDW4fLqJ/pAAEN53RT0lhi+0IOC
 WzjE/SL8aL59DCoKBr48jN2XPvvLBYm7wDLJKpl9cV2ThBsUf/szk4DbqqN7KdL4Fu99
 qiKQ==
X-Gm-Message-State: AOAM532wigk4jNAYNvwy16w3ssBzPIz7i2//lBNA8DFU0ho8XHCt8Zjn
 4ipJ5MNluTMPaRySllZguJux8tXuwtLFglj5P32lex5r/Naq3w==
X-Google-Smtp-Source: ABdhPJxCzjr+9ET2/ZKQHUAfztaWJ/fRnSpKecPCyJZDKu6hQHuiC9C3qijmZLLhqdyikQhM4VXPMfTgsI982xF6PhE=
X-Received: by 2002:a25:8746:: with SMTP id e6mr13561170ybn.138.1639670704731; 
 Thu, 16 Dec 2021 08:05:04 -0800 (PST)
MIME-Version: 1.0
From: Lance Richardson <lance.richardson@broadcom.com>
Date: Thu, 16 Dec 2021 11:04:54 -0500
Message-ID: <CADyeNECkRa3gSW_yoKMLi=0LUBz=uFH33oH-QTFai1m=uqC=Wg@mail.gmail.com>
Subject: Using IOAT PMD
To: dev <dev@dpdk.org>, Bruce Richardson <bruce.richardson@intel.com>
Content-Type: text/plain; charset="UTF-8"
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

Hi Bruce,

I've been looking into using the IOAT PMD, initially with dma_autotest
and the dpdk-dma example application. These seem to work fine on
SKX with the current main branch, but when I try the same procedure
on ICX (binding all 8 devices to vfio-pci in both cases), I get the following
output for each device when probed. Is something different needed when
using IOAT on ICX vs. SKX?

Thanks,
     Lance

EAL: Probe PCI driver: dmadev_ioat (8086:b00) device: 0000:80:01.0 (socket 2)
IOAT: ioat_dmadev_probe(): Init 0000:80:01.0 on NUMA node 2
IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel count == 255

IOAT: ioat_dmadev_create(): ioat_dmadev_create: Channel appears locked

IOAT: ioat_dmadev_create(): ioat_dmadev_create: cannot reset device.
CHANCMD=0xff, CHANSTS=0xffffffffffffffff, CHANERR=0xffffffff

EAL: Releasing PCI mapped resource for 0000:80:01.0
EAL: Calling pci_unmap_resource for 0000:80:01.0 at 0x4102430000
EAL: Requested device 0000:80:01.0 cannot be used