From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2C70BA0544 for ; Wed, 15 Jun 2022 00:17:06 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A788240222; Wed, 15 Jun 2022 00:17:05 +0200 (CEST) Received: from mx0b-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by mails.dpdk.org (Postfix) with ESMTP id 7428A40220 for ; Wed, 15 Jun 2022 00:17:04 +0200 (CEST) Received: from pps.filterd (m0098417.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 25ELQWsg020570 for ; Tue, 14 Jun 2022 22:17:03 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=from : to : subject : date : message-id : content-type : mime-version; s=pp1; bh=8/OUNlP+W+/Rvvtiav+texS7jihtTODFIras7D14tJY=; b=Af5e7mgZojvYZZJFcEpEjjasr0J1BKqogb0fxbefccQ1pYQ7+jBngTW2+dNQ6L0HZoIs IDbD6Nz+oP30L68rp/PIUg7O817s7CvGkOQWs8PMJZNkBKgS0wDuGXkZUofLOY2u7qq9 +OmdfFMu3F+GnOROjShjyS9u5WpYexFRv12utYnkxoLndQ/4lgoEaFzf32BKxC9Knxjq meY3Acu3XT44jQC6MwT/YI1P1Fqg/vseESJiLd6anszMzv7ATT2xjeSqSLeanv4g4qpA 5uWdQkVdfWr5KD92S2rpJaCj+Py/r55Y/f3Wmo8oYr0KC+WlXVX72VvunkU+d/O+UOHa tA== Received: from nam10-dm6-obe.outbound.protection.outlook.com (mail-dm6nam10lp2106.outbound.protection.outlook.com [104.47.58.106]) by mx0a-001b2d01.pphosted.com (PPS) with ESMTPS id 3gppw3e8vd-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Tue, 14 Jun 2022 22:17:03 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=J7KY2XNK80f6iHBcrbnGKoKjqhe2o723UsUv/KFB71MMUG3QYjRNtUq9JlKAeJw7PuV9weYGHbLmPzMEgmWwhPXXfN5FqMH8pwhoKMIyn8QvHgg/9iL/lSU17fcx2mgrcAvnG4z2RTTnxTZ7faRIg0hV9QY9ZUBIw65DEjUhLHf1Ui6+71yQ8TGZzOxpWEQoNdizRufKHNIhgcovFg4Ng/Fsx79jpRviQyNnQYVPikpTwIUmB9IHDsWBR5P3G6CYDdJm5mNwK1xq3oUuctKUcTectIFggt3aJ15Ryss39Wc9rJ49VVv0vUcJMvEvD3FsE25MYRYJun2tKshhabDklA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=8/OUNlP+W+/Rvvtiav+texS7jihtTODFIras7D14tJY=; b=kQKT8/IWo0VgbZK+nYLU53Y5l/qgCCozn7FwTTuP92q3+o3eOjqOypsIn9wgsJ/3cimExKmPSAwww9ZJiW1PtJMQg/qg4O/mOajs6wuYdnYrIr57GQV9aM7tqzv/WnhE6ltsVfixSWt1F6656yssrwPs+A34FULLAgJ+m7JFPnuIVDo5x83Iu1VdPe5mgGuk3OuU9gYT0TvuSVyPDwDqAFB5Zr+wo8Rq74HPk6lTxN3K6IsYYLKf1r1yMvtqfaom7Fu0dhbcPKiiVImhXYiQjs2MUEqiVIfzeznpHuNM1Myn7W3VEbEqDTOv8YGqG8p2dVM45N/JVh0YiOWCIcx/JQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ibm.com; dmarc=pass action=none header.from=ibm.com; dkim=pass header.d=ibm.com; arc=none Received: from SJ0PR15MB4421.namprd15.prod.outlook.com (2603:10b6:a03:372::7) by CO6PR15MB4161.namprd15.prod.outlook.com (2603:10b6:5:348::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5332.22; Tue, 14 Jun 2022 22:17:02 +0000 Received: from SJ0PR15MB4421.namprd15.prod.outlook.com ([fe80::2c1e:e044:5877:37ef]) by SJ0PR15MB4421.namprd15.prod.outlook.com ([fe80::2c1e:e044:5877:37ef%4]) with mapi id 15.20.5332.022; Tue, 14 Jun 2022 22:17:02 +0000 From: Daniel Waddington To: "users@dpdk.org" Subject: IOAT channel halting unexpectedly Thread-Topic: IOAT channel halting unexpectedly Thread-Index: AQHYgDvUAW5mNsuRLk+h6J6fRW1nTw== Date: Tue, 14 Jun 2022 22:17:02 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 66bb89f9-aa89-42ba-66e3-08da4e539b52 x-ms-traffictypediagnostic: CO6PR15MB4161:EE_ x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: tZsSnRavXVVr+WvODvjc9fZUnFYhfr2aDldykoGKVZkxpFWSqJBGIwKUUs/aLy1gpQLnLiPowgmRWTc5WhOugVkbJAuU1MhT3Zwoxw1AjN9dhEQdfaeXDacm8fDjX7kSp0uQRrBIwif98FIhMCJLXZ+ZJKWRSBpJhWXaAKvxP7kyTk90iSPhIUsaT7YMF/JU9CtyFgtydRNhDY9txhlahMUtpk4VDeoNPCrKNvEAwt5qZae01DkWGQgarvXzF3BoJJA2dgdnM4AQwnvjZ6AYpA9JiQ/pBeqXV3Gu7/WPCAE7cBLVG05FjvPSkUCt9IxH8nCcZmSKjNVfhFvWPQSS3JezAQJ9qMjb8xjXov2RTlhd8GdSkAmb2OfwP71Dao4L3lp7znuBIJzqvFFYzlvPqjPo2ApqpTNgSoFVgGPmmscz7DHleiMDjyCM/ai3I4lAf76pgtEIm+4ARlv914jBPxoL+NBXDwPt8QfO/FaYwvtM0HlVRy/OyLsviuIsVttIjKGsqyPy4T4pTDVEhOxyW/+YdpeyTtDJRiHBR8AtN9MRRChq8pLl2ngKQVCK037zsO5Jh1m2ZmiJLFSV7wf6CuB0GJCkFuHq+n2c8ZsA6kTQ6sf0TNGMeecTk0PyW3S2Lwf+1lh2HWMWXeS2XBBRt2PASFpXHhbrs1vjXKMhOYw0iCYMZUpFvNiRkJnQoFXerYPBs3+4kpO72W0hI5OX6g== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SJ0PR15MB4421.namprd15.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230016)(366004)(186003)(2906002)(33656002)(26005)(66476007)(52536014)(66556008)(86362001)(66446008)(508600001)(64756008)(3480700007)(38100700002)(71200400001)(55016003)(316002)(6916009)(38070700005)(8676002)(122000001)(76116006)(5660300002)(9686003)(8936002)(7696005)(6506007)(66946007)(4744005); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?Windows-1252?Q?CjY35kXAnrFTBC+gqCfaMb28ueOmdf18wDi5I06wtrzsf62IRJg9vB5j?= =?Windows-1252?Q?iWUKNFU5Tm8EwcatlOhOcQoYakk+8BmNG+yUmjjQ6EeNDMNm3w09C9Wo?= =?Windows-1252?Q?uoIL0aEG6cCdieYzMZlzzyW2PsMdrDXx5ELzemgO1JVrVKjPaZOIVXcu?= =?Windows-1252?Q?2rRo3fMiVt34RHTpJgm/m7dYWoyoE2KwGC38X/a3WLc54BlJP8BWGgpB?= =?Windows-1252?Q?JC1RCdLSn8lkshqMmCK0s9o+pKhluqmRRMkPEv+4+MwmETWe8iViYypQ?= =?Windows-1252?Q?63Q+g16W1w0eKKB/xk1AKz3v6bIjviFPJHpso1C/N8JpXOttOrY8BMtY?= =?Windows-1252?Q?Mdu7WeoySiAb0Dv5kubfw7GO1/23SOHIKzZO9VU6sqYxdqdRwVUSwD9p?= =?Windows-1252?Q?Ne30KpK2oCKiuVkqdgc65GvH6SFp46cFkrV0F8+Lv6wWCY7D2EssxCrD?= =?Windows-1252?Q?1mBtQRIjjHV9/P7ND9DQmCn+p97yGF2CXcKTnZvR+AcnMu3rO/lPRbP6?= =?Windows-1252?Q?RTmTn8nAiwnKSZcgrx1sn/DA4FXhYPNoqCOCFCK3DsFXA6amVVLneqpx?= =?Windows-1252?Q?r066GI7M9qKix1os/h2EzZV2FuUEfbS8v3T2ZxrqI1cvgpUXffRZfRY2?= =?Windows-1252?Q?3Yx/BZ6C8680B0yBDBGNoOKa5mhmlrpHOODFtZyZhwY8favfsF0t9H0j?= =?Windows-1252?Q?moy5Blus4U9vNsSFOIipzToQoe5PiCMyM1lDg/lvn641XLT7EAz/ssZy?= =?Windows-1252?Q?mN/mfGZfxUwsCKfHADsBXvDDdFJPFiGeASi5Mt4fWFM3B9nomxboggaW?= =?Windows-1252?Q?nYkHWSo2uV8p14bEfQQzqgu7KzLm8gN2T4kKRPv6zuwoF/oCuojsxsui?= =?Windows-1252?Q?wQnFi0bgsdsIQvZN1L5bXZUSYgUbtpzs9N2WpO4S1QAzEMj5r05ZVwdp?= =?Windows-1252?Q?ruOiXg/2Qjsc+1Ie682+KF+7sXxhSCulNzfcOpBln7ukuDaiKvyPIJ5T?= =?Windows-1252?Q?Tr7/W1DA4z1X4qB4u5y/7AQkKz8D5fArHbQdbGQ6A6DTn1Y4ohN6mBkV?= =?Windows-1252?Q?PTcgR8k4yAT8WxzLiiQxaYSmRMo7PH3LMAXQB0bip1q2txwdNKNena2I?= =?Windows-1252?Q?Lllrbb7guvZ/xXovAxU1gjC8wNuE/iT3Wcqg418pt49H41UXXSD3lUj5?= =?Windows-1252?Q?93E91MaweqUsL32tZASywVYssjtNbbbl35ud2JyZmnBSxIuZ+HlTwuYb?= =?Windows-1252?Q?k8H3xJZj1gAhTNAHBVQc2/vnOUJ7qn295PedBUhmQu4xZuEGgDdkz819?= =?Windows-1252?Q?/qy3+w480/DkfTSd5wyJi2EqQrGGudtApmEKUxPFhlY2IWqpaD1ea3oE?= =?Windows-1252?Q?fTCiOWT3084tUNYHr87Uaq+3OW8LVV+/6nKrG6PtZaV9iFErg7mi035M?= =?Windows-1252?Q?upo0FFlY3Hjd6JXyUOjnoGsKrkN2U9ArGnWG3+C5j4Fogid7zC40NVYn?= =?Windows-1252?Q?lpft56EwjLFiRTm0xSJLWdsMflvnlR66ogoct5R0rQ9TzlPmQP+YpJ2L?= =?Windows-1252?Q?uAOgwxLeO5Y/U7CqNswq107YYzId3FuZSUDqYZ1zg0y205IybuA2G2Mk?= =?Windows-1252?Q?BRSC2aiVbZiw2MaaK45QtFKa+gFY12y400yPjdTaJVrUYLOwsObJkDG7?= =?Windows-1252?Q?vqjHDCrOTxK6lFcr+XZRySHCJUoFiqjH1GBupt3wZBDzPV6u9DqnoCMi?= =?Windows-1252?Q?QGQBV4yF3UhUYCPm56VshZlsr/AE/HRMBfEBaKc8gSJuA3ahmFB1TxR9?= =?Windows-1252?Q?pv1cWBfmmY9V6XQf2zRGSKb6xwsWEYGZbtfxpUbu9sVz+iLuCKNIKbKW?= =?Windows-1252?Q?UzitqwjMvEjLej3OL3O3FRe0E4mRV7MMDoNkqJrWixH1i0rrR7rEUMlP?= Content-Type: multipart/alternative; boundary="_000_SJ0PR15MB4421B108339518692B018338F5AA9SJ0PR15MB4421namp_" MIME-Version: 1.0 X-OriginatorOrg: ibm.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SJ0PR15MB4421.namprd15.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 66bb89f9-aa89-42ba-66e3-08da4e539b52 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Jun 2022 22:17:02.0998 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: fcf67057-50c9-4ad4-98f3-ffca64add9e9 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: wNsMx72gNJwJHoE5b7mbPE0f2BH6w6rB7J0tMeWZLCsKzUYOzTMuCyVdJAN8aRfUImwUcBVw7gnZI6vLujUxy+RiqHivEbSwXKvgG4LV9xc= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CO6PR15MB4161 X-Proofpoint-GUID: 2-f3829BpLzHQjB5P-P95I-cApJzmiG9 X-Proofpoint-ORIG-GUID: 2-f3829BpLzHQjB5P-P95I-cApJzmiG9 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.874,Hydra:6.0.517,FMLib:17.11.64.514 definitions=2022-06-14_09,2022-06-13_01,2022-02-23_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 bulkscore=0 adultscore=0 phishscore=0 spamscore=0 clxscore=1011 mlxscore=0 impostorscore=0 mlxlogscore=748 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2204290000 definitions=main-2206140077 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_SJ0PR15MB4421B108339518692B018338F5AA9SJ0PR15MB4421namp_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable Hi DPDK folks, I=92m trying to use IOAT (rte_dma_copy) on Skylake. I can do a single subm= it and completion OK. When I try to do more (> 3 as it happens), the IOAT = reports: =93ioat_completed(): Device HALTED and could not be recovered=94. >From the rte_dma_dump I see the channel status has entered HALTED and the c= ompletions stop. My question is, what can cause the channel to halt? (e.g. bad src or dst ad= dress). Any hints on how I might debug this? Also, I have to reboot to get it out of this state. Re-loading drivers does= n=92t seem to help =96 any other way? Daniel --_000_SJ0PR15MB4421B108339518692B018338F5AA9SJ0PR15MB4421namp_ Content-Type: text/html; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable

Hi DPDK folks,

 

I=92m trying to use IOAT (rte_dma_copy) on Skylake.&= nbsp; I can do a single submit and completion OK.  When I try to do mo= re (> 3 as it happens), the IOAT reports:

 

=93ioat_completed(): Device HALTED and could not be = recovered=94.

 

From the rte_dma_dump I see the channel status has e= ntered HALTED and the completions stop.

 

My question is, what can cause the channel to halt? = (e.g. bad src or dst address). Any hints on how I might debug this?

Also, I have to reboot to get it out of this state. = Re-loading drivers doesn=92t seem to help =96 any other way?

 

Daniel

 

 

--_000_SJ0PR15MB4421B108339518692B018338F5AA9SJ0PR15MB4421namp_--