From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 62F63A0544 for ; Wed, 15 Jun 2022 01:15:03 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id E1F7440222; Wed, 15 Jun 2022 01:15:02 +0200 (CEST) Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by mails.dpdk.org (Postfix) with ESMTP id B40A540220 for ; Wed, 15 Jun 2022 01:15:01 +0200 (CEST) Received: from pps.filterd (m0098420.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 25EMiTGN015389 for ; Tue, 14 Jun 2022 23:15:00 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=pp1; bh=Tm0AaH8t/ABuQiU2SlB/jWwOFR+Fy/dSgeMG6q2fpLs=; b=Xdxsrlsi+7cw6rdhPqi6f3Dkdy0g1Ldpdh/AZJnycLjDVeXNXbQYW9m05g63OvNdwHow b1OdR1JArSPA0jklVa/wiUOL3121npraNBz+7xiV6/V7FfcvDskMTmSKABjqxAJlMz7x +juX3+3iUQx8EPdsEn1Y+bYdbzsZmA07ccvpTdNL9749EzZvF3woi5yeKsVeOR/osywn a4uwHAEfp5I8axvrnQwLHUIYx7O++rfMmKcamzeOY9gFuVFEhp8lpzU1LVDC8eDz4thD 0oyRTdg1Xn10fqyC+5kGeyhKpDiWaJOYxyxySFcmilPi38v9UsFjLfqEGY4+bRnGy38S Ig== Received: from nam11-co1-obe.outbound.protection.outlook.com (mail-co1nam11lp2176.outbound.protection.outlook.com [104.47.56.176]) by mx0b-001b2d01.pphosted.com (PPS) with ESMTPS id 3gpqmw63yq-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 14 Jun 2022 23:15:00 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=OsVE2V27S4jn1tVzRUYpbGrX0qx/z0k0XAm3H1ALv+mHofMSWQcZM3UZo1RjwV2v6/Xz2KO1uOn3N7gjurtCtrBgvIMMadSmEq+6QJrJ3HWojAM9ZpU3lPNoI/lz3n/uG2VN5lS+rmzbTbqwd2MVNE6fWc/NgHr9+57E3ZTfPKSQxL0Mt7Vf7buuTN5AlbVL+nRXONdT/3r5HHScgoYfYE1bjjyWt9drAkDNRTDjpqkeSzI1kx/4tsfnXAc9piiS5ciC1xjXYMumvvaSKruGsYU3xg72yr87ksCd2dOKujhjKZ8zV23vTWjgXB+XDV3VYNVkRye/ydEOHMVhG0pvwQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Tm0AaH8t/ABuQiU2SlB/jWwOFR+Fy/dSgeMG6q2fpLs=; b=SRlmfBCrX/jeJaj7kZFRhChCCmka9Zl+SPFKH0yg2L95vU6SKqVlCK/ubE5RQqe9k93MsRLlNjQEWGDxwGih2Pw6XfiTr9PXRposmdl7cQV6ShIe5AMMWcSSLT4SXbgJL4wsPyYj9Q+Np+8hYN0LrRaL1B15kdXnlgJIsrK95XLqaExbjm1vp6INm4bCFuPW0pPEszIqv2DrXz7AELbRnZGQATAZxevLv3v2HX17/vfWkSNlIxD16rjVgaqubrHmXbJF8VRQwPHw6qN0sx/Jk5K8Fg7+IdeZxFt6AqeetMNCrUIWl5gJHHsqCvvwBUhneXutXTmwwbQft6/7tcZwRw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ibm.com; dmarc=pass action=none header.from=ibm.com; dkim=pass header.d=ibm.com; arc=none Received: from SJ0PR15MB4421.namprd15.prod.outlook.com (2603:10b6:a03:372::7) by BYAPR15MB3366.namprd15.prod.outlook.com (2603:10b6:a03:10d::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5332.20; Tue, 14 Jun 2022 23:14:58 +0000 Received: from SJ0PR15MB4421.namprd15.prod.outlook.com ([fe80::2c1e:e044:5877:37ef]) by SJ0PR15MB4421.namprd15.prod.outlook.com ([fe80::2c1e:e044:5877:37ef%4]) with mapi id 15.20.5332.022; Tue, 14 Jun 2022 23:14:58 +0000 From: Daniel Waddington To: "users@dpdk.org" Subject: Re: IOAT channel halting unexpectedly Thread-Topic: IOAT channel halting unexpectedly Thread-Index: AQHYgDvUAW5mNsuRLk+h6J6fRW1nT61PiIbp Date: Tue, 14 Jun 2022 23:14:58 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 0c2fa98c-ffdb-4cf4-8171-08da4e5bb372 x-ms-traffictypediagnostic: BYAPR15MB3366:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: JolHC9FoPmdiae3SMueaEOjMICIGi3cjkWBq0bzapZdC3EYG6spLBGg38YbvSnQrUGtpEFqqobi/bgQH23QuYcIW2fgOR+RzLO4/lWU6yeoFbTb1QlBku+Xz+gBY0CtB3htH9DxdlQo05Z5fc3EQdXCZZ4lxDMnUKcRfOK0ZuFn7APGzLlM2BlnihJZ3GjEsU3uPbKhdYMtrlcHuR/KQQhRb0OaljsG0b2PVsLZcXYzLK2atf5YhCqpgFpFD2GlDk09Dunvs7zJVJ95qPCo7lAiv1+1wxPT8B/3AMzNHTkC/+WDujWfXTttQBehv9kb8DlTI8ehKiKcN0LryFNRbL0xZpL0Z4b1WV4B4DOezWLaCAJr10a243eZmgLgKCEBJ7jNbHO7WNneNHGHa6WsYPE8vumylu4DnZmYHNNy9AgPyEz+sUFybJryPeG5OxahqFDyFAvSzjF6Ilb+PxkOEggvPMtpW6R9CxRQpTaiqdXe8/gG5iw92gqTzNd0vHBKtz++X+ojSO8cpFeU6z0MAj/3ZhcEmpiMFdpjoClY3enpMdyfHoovVIYRyXRX1T1fs4fY5CjLXDOQxoU2enVREl7gUlVGuqzRQu0Ht0Ksx2mF1xnKVl6BxFl0ooiy2yg1MF3mVarMH25K4oF3oCC6JrmPG/iqe7/kksQNV8Rvj3McRiszmtDg5fj4G4eZNNA/qWeoDG1TfQtOH3Ot1QKt2tw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR15MB4421.namprd15.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(366004)(66556008)(66476007)(91956017)(5660300002)(8676002)(86362001)(316002)(64756008)(66946007)(38070700005)(76116006)(66446008)(122000001)(38100700002)(33656002)(52536014)(9686003)(508600001)(8936002)(6506007)(7696005)(6916009)(71200400001)(26005)(53546011)(3480700007)(83380400001)(2940100002)(55016003)(186003)(2906002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?windows-1256?Q?BZVkdv6+f3cS7Fqofuus5f/smBGS3awe9LC5VQ4anWFApCX172x5ejDc?= =?windows-1256?Q?r/nrHFAbAAnjPkOBHgyixmA3Uj8lw8PO3igQjhVe+5wXJbIsYmdmwkRn?= =?windows-1256?Q?AZraJjPDng9La6Wxs2KlxD5JAZe9AMlGEOXHEctAaO57TFBJ67/zXrB0?= =?windows-1256?Q?OpuRdgAEcM5m2aYRETZmgvkvn56hYAA4EYSzEBHHLAogpMK0WjdsQ3R1?= =?windows-1256?Q?VASHJnnn/9ulDhuBvJw2HtduX8ASUM/OVLMTu11dxqc12DRsjaWeGOqH?= =?windows-1256?Q?INsZSqOMneAvJdL/BAYVm2tLZZbcuUGR4seeV329q984uks3uHQhdewC?= =?windows-1256?Q?7Lmt7ufwDRinqH5uA8C/PcFWC7bVPcuO6MsAgenkyO/5MUxE7mv+JCGF?= =?windows-1256?Q?KEBEF1/otjm+WZhsO3GjlnbvjVRTaHjY5NwtfuxIrLTqWodCBo34eAqH?= =?windows-1256?Q?K/om4Fnlq5cZonthN4B0zR7Kex0uugqxOUz7CB0N/8sWZpNzHiHihP6n?= =?windows-1256?Q?Rsqq2nnENZ0n+ophLjrDoZhgwLr9XJAZDdeUp2CaijfDLks5etjPKmup?= =?windows-1256?Q?hWKlYG8CsQ1kfwXXwpMXyat1bd37SUM8A1QgyI/Lrgi2/k1M5xNafqdm?= =?windows-1256?Q?yKqsQNvr+0P9mDyJB1+U0swbBn43aFTfV6+Bfn5k5hx85Vqn8hdFBjZo?= =?windows-1256?Q?chUP5EZWnDS5oUugvtfJ7rRTAiIhdbqhItFj3+KqEVojtXgGiWhf8Ybv?= =?windows-1256?Q?cvDUtmhVGds+N6GUUtDSE5gq9yuIr8pwAYh4w4q01WL9H6kr0kZ6mxr5?= =?windows-1256?Q?ajS1Ix7Uj/Ee29nMDTEb+ci4PMzLEzA7vIaW315KeBrfanLXjZKy+F9t?= =?windows-1256?Q?ZU9VIzdFjH1xbxsFjF2sxg4bGk7NFJMTK5XrOqQz6D6/dG4rIwDBHe0W?= =?windows-1256?Q?G3lBlmHziSSZwtjpJoyAJNWmKGrZYdBy5ST3A/mLhTExo77YrmdCBBiY?= =?windows-1256?Q?jZPOx40U/B1GS1jTjdwY2AW/DPAMnDfSoNmfVYMXqIpwgkTPmwR1R1I8?= =?windows-1256?Q?1LSCbvgR5mhJf5Chqq63WhV9Acz/a3rzhGnCY2OYol+OcFhZktSdr5ew?= =?windows-1256?Q?zLbjdt7UEglnqMV/2dP6NsIku6IhcLDeYaly9NEHdPAtnNT7sqCIFjQZ?= =?windows-1256?Q?sOiM9RrMbUG51UfaNRSavkbKbuRRx70+ZdfJ+pBvG4JGil3Vs32Gm3Ef?= =?windows-1256?Q?Hum/85Ib42PNQcz3svP/8vFbKr7cJbshQ48HabasIh9ggLiSwgPXVGal?= =?windows-1256?Q?nUopoPohUsdJ4WvCCqKVb52svzThfrKuJ6ezpUNPrIdlJDprQEM7tUZA?= =?windows-1256?Q?GjS7YLdBS1rV/JeS7+xcf/fj7ok2X7OJzi/PoFSTkJR68TmyBojgtwC4?= =?windows-1256?Q?PkphEWgizX8Nnz3tHnWwGejI3mGOLoEJctFI8XRauMmNKidnRq2CuOpk?= =?windows-1256?Q?sfXfO0vgFSXjnSoYE6UvJkEAV2E5hrOWwn9rgPTlNa6i/qBIH9Hi1/oB?= =?windows-1256?Q?UNAG0Nr/l4AKS8IVig6FQR4ePqQogZzBidboqH6UWY2X0NjEihAny403?= =?windows-1256?Q?BJLGdpG90wrZwwvnvBnG1Ccd/wTsZQU/dIYkQ73KuoLx5ZNlXOayo5fC?= =?windows-1256?Q?D2hP5+wgeUaQFR/fQBTSlyyQ8Rhpc0T/Y+jYDpV2OS8vpxFXnHYP6Aeu?= =?windows-1256?Q?rIz3NBBpUrUMzt97kSsoVy6tUy11/qp0rLu1xutn6ZabOdU/N6CTnjbU?= =?windows-1256?Q?jYD3F94XHAGTM3hnxCaY8hJ/JJqwCAZd7kBkmJ0JAAMHcIVSUhJkoJms?= =?windows-1256?Q?1IF/yytfov/0ErNcco+kccTUYyIPp4QyaV9isC4vpvvPmQVlvnyKUXHh?= Content-Type: multipart/alternative; boundary="_000_SJ0PR15MB4421BB5851C7430566D96633F5AA9SJ0PR15MB4421namp_" MIME-Version: 1.0 X-OriginatorOrg: ibm.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SJ0PR15MB4421.namprd15.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 0c2fa98c-ffdb-4cf4-8171-08da4e5bb372 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Jun 2022 23:14:58.5337 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: fcf67057-50c9-4ad4-98f3-ffca64add9e9 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: eJChUmjlPo4eWPlaYpr4Zk3sMu0Di8ON1UsVcwgHzFIWp1wHKg4kG82cnGA0xvPqKhemAYLe6VUjJ8dxa7LYamawnp/YIVKmfD1YDDF5DIc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR15MB3366 X-Proofpoint-GUID: VGCQiw_u0jL5LU-MPFA4GxV85-BrZ-us X-Proofpoint-ORIG-GUID: VGCQiw_u0jL5LU-MPFA4GxV85-BrZ-us X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.874,Hydra:6.0.517,FMLib:17.11.64.514 definitions=2022-06-14_10,2022-06-13_01,2022-02-23_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 mlxlogscore=985 spamscore=0 adultscore=0 impostorscore=0 mlxscore=0 lowpriorityscore=0 bulkscore=0 priorityscore=1501 suspectscore=0 phishscore=0 malwarescore=0 clxscore=1015 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2204290000 definitions=main-2206140082 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_SJ0PR15MB4421BB5851C7430566D96633F5AA9SJ0PR15MB4421namp_ Content-Type: text/plain; charset="windows-1256" Content-Transfer-Encoding: quoted-printable I think I just answered my own question =96 too large a transfer size is th= e cause. Daniel From: Daniel Waddington Date: Tuesday, June 14, 2022 at 3:17 PM To: users@dpdk.org Subject: [EXTERNAL] IOAT channel halting unexpectedly Hi DPDK folks, I=92m trying to use IOAT (rte_dma_copy) on Skylake. I can do= a single submit and completion OK. When I try to do more (> 3 as it happen= s), the IOAT reports: =93ioat_completed(): Device HALTED and could not be r= ecovered=94. =9E =9E =9E =9E =9E ZjQcmQRYFpfptBannerStart This Message Is From an External Sender This message came from outside your organization. ZjQcmQRYFpfptBannerEnd Hi DPDK folks, I=92m trying to use IOAT (rte_dma_copy) on Skylake. I can do a single subm= it and completion OK. When I try to do more (> 3 as it happens), the IOAT = reports: =93ioat_completed(): Device HALTED and could not be recovered=94. >From the rte_dma_dump I see the channel status has entered HALTED and the c= ompletions stop. My question is, what can cause the channel to halt? (e.g. bad src or dst ad= dress). Any hints on how I might debug this? Also, I have to reboot to get it out of this state. Re-loading drivers does= n=92t seem to help =96 any other way? Daniel --_000_SJ0PR15MB4421BB5851C7430566D96633F5AA9SJ0PR15MB4421namp_ Content-Type: text/html; charset="windows-1256" Content-Transfer-Encoding: quoted-printable

I think I just answered my own question =96 too larg= e a transfer size is the cause.


Daniel

 

From: Daniel Waddington &= lt;Daniel.Waddington@ibm.com>
Date: Tuesday, June 14, 2022 at 3:17 PM
To: users@dpdk.org <users@dpdk.org>
Subject: [EXTERNAL] IOAT channel halting unexpectedly

Hi DPDK folks, I=92m trying to use IOAT (rte_dm= a_copy) on Skylake. I can do a single submit and completion OK. When I try = to do more (> 3 as it happens), the IOAT reports: =93ioat_completed(): Device HALTED and could not be recovered=94.= =9E =9E =9E =9E =9E

ZjQcmQRYFpfptBannerStart

This Message Is From an External Sende= r

This message came from outside your organi= zation.

ZjQcmQRYFpfptBannerEnd

Hi DPDK folks,

 

I=92m trying to use IOAT (rte_dma_copy) on Skylake.&= nbsp; I can do a single submit and completion OK.  When I try to do mo= re (> 3 as it happens), the IOAT reports:

 

=93ioat_completed(): Device HALTED and could not be = recovered=94.

 

From the rte_dma_dump I see the channel status has e= ntered HALTED and the completions stop.

 

My question is, what can cause the channel to halt? = (e.g. bad src or dst address). Any hints on how I might debug this?

Also, I have to reboot to get it out of this state. = Re-loading drivers doesn=92t seem to help =96 any other way?

 

Daniel

 

 

--_000_SJ0PR15MB4421BB5851C7430566D96633F5AA9SJ0PR15MB4421namp_--