From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 15FA1A00C5 for ; Thu, 27 Oct 2022 18:44:39 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 9B41341153; Thu, 27 Oct 2022 18:44:38 +0200 (CEST) Received: from NAM04-DM6-obe.outbound.protection.outlook.com (mail-dm6nam04on2063.outbound.protection.outlook.com [40.107.102.63]) by mails.dpdk.org (Postfix) with ESMTP id 185E0400D5 for ; Thu, 27 Oct 2022 04:48:03 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mtwiPbmJ/S6gc5kamm4DyiHukKydikB2gxuN2lHPAZXdadK8yjksHnG8nlhV3EZzUecSNQrr7lNfAl1CcSDxw0qdadD4nvQcb2LkS8mG8KM7bxLwL+1eKpL6FZEOxzDfQQBOldo1osDUZYITVqYpBniKNpw3EzTgw5H/LP4cJPHZAsbcj0TXbE8WRMX7vBWsg/UbyTjhvpE2BrYMyaUppW8JV38RRXVGLUC1bASAK9uE73dE8Uwommj0Pr9ut03+BtOwWDll/MthY6DaxF0EUI9a35c+Dz9kBwgFwNwosdbWHPWuHtjszkirDA3/ZDvreqBSrK4fVzXGtaj8RfyqvA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=vRN02UXsyPiquIa3SS+pM+PSDG84NWHF8Rxnod9AsN0=; b=En7RPD4pUjRfM0euMDWRni1wRaep+LQ6kwzUKh22NjPy4Nvy0IohzRCAXz/zsIdwYpkDB74bHnxYBctsqo4BT8u1uiD/2U9gBe9qzAZQXIjZfB8HrwYKNRXvdYtwFqt+2dquIx6Ee24fbpoKbus+pf0TYoH8XwzSW7wgRDeWkBFKqCdUZLovDCPy9sFWFW6+eS+81VO3ZQK8mykuUQxH4IEtjVjisYjqgJbmfUfcMUZmha4sbG/TKIMTqqft0KQCr+XbWBtxNJwr017A/AD9uspGdQzcLf7qOPTI9GRPvj0VW3vhknwX5qxwD/Sv4fOJ84JUF5cbCf7UqBLOxMZL4g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=exfo.com; dmarc=pass action=none header.from=exfo.com; dkim=pass header.d=exfo.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=EXFO.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=vRN02UXsyPiquIa3SS+pM+PSDG84NWHF8Rxnod9AsN0=; b=GHyGIbxb2AaLHpz6koKIC1I5QupoL0YqrlAd6TRQsI6p5KvX8Z+jXXJ3rinrsRA/CqIcYFCGN8liBV5LcHJmDpf+ekkKVgYrD3MA6jdL65lGoDGFSamklHc3I5JE/pTSxweCRjmYDQ520IibKb4y6Cx5Zq+AcVEL5GpUAyjRuUumuyGxL1ABOU4/9121IfAxJNDa8nnHv5aCnuT2F/pz8rxr8YRAO5jl/kbSO0YvkZMmW0asZPs7YDw2WRqov0DE0dHdWDqxDFTEXefQJ39WzJscdolX269V8vKQAf6unywgPMDJIQPWtQGyi7RQka9820gzpLlIUy4Jd5Qnnw7QAw== Received: from PH0PR11MB5625.namprd11.prod.outlook.com (2603:10b6:510:ea::11) by CH0PR11MB5236.namprd11.prod.outlook.com (2603:10b6:610:e3::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5746.28; Thu, 27 Oct 2022 02:48:01 +0000 Received: from PH0PR11MB5625.namprd11.prod.outlook.com ([fe80::2aea:e82f:ed73:930e]) by PH0PR11MB5625.namprd11.prod.outlook.com ([fe80::2aea:e82f:ed73:930e%5]) with mapi id 15.20.5746.028; Thu, 27 Oct 2022 02:48:01 +0000 From: Kaustubh Mendki To: "users@dpdk.org" Subject: Mellanox Unexpected CQE error syndrome Thread-Topic: Mellanox Unexpected CQE error syndrome Thread-Index: AdjproBBaec0ukMBS2q7VkKfg3p1OQ== Date: Thu, 27 Oct 2022 02:48:01 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=exfo.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH0PR11MB5625:EE_|CH0PR11MB5236:EE_ x-ms-office365-filtering-correlation-id: ea1856c2-dfca-4f1b-8171-08dab7c5a9e3 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ciKmpK9/Gf5IMi82fL/+3sHHu9hWsI13CH2cB2GgQ7DrcghQbkaZFjGYPVrbV+SpjqaTBX8sD8pesM81NKwTpcrwVMsAjIKoiHxJDj0mazXUjd5tBh4Jv8qSBMPykrQH93MSYteYmKOm19DjMtLVxOh7156FNYGX3QoNAHkrcHiPsJzg6ZrWF2mydt9rhi1TQ05FQBMJiA1ffEyv7gg8M6VFIIPFQout718cYeMbCMCQWvOF+sCQtq2O0x91IcV/eTSw0dc1N6uG1yuSEbyWDLUhu/m+0pSJwzM0GVX3jCncaEH2zxdxCANY9ElFMN4hlxO5XZKOKgpj9GxGa1VdI60RWxUGjS8+JmRvpwnd4ST/G6aBCgKYV4XAwJyI2dPrUjNTDb4amBWvaV7XWjV7s5a2GmkipoEJiybWza5eKFtnlt2tQAHJFiu0FWUK5pDYva5aRtbI1f1EzYIYGAoufskYEkkBXvQ7iUCbD32njtuXZjJqCN4JelMwcObQUX/Nlxnkh54178HGhDoAWNBWnf/ZoCDFJ6if5hpd0ONbhz5qhNNyj+ZhH/9gfsHLd+7EXvbaa3RMgn+BQKZIN+q0b14BMZwShRfUcjqlgJVCgKnngzuIfGV25Iz4zm57GpwMl7ed31vGr5dycdEsddbS3Q2eYxM43fVb3UuwfHk+LfSlyjHdn72AfImbnDw4Wljh/nFiSHo+PTsfqG20HLSszOqLRbMdJH78C8a8Vtpmkz/TwKQu5OPgyDzRuKWbAlhE2qKo8C2etGgiVw+sQ2sGGw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH0PR11MB5625.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230022)(4636009)(366004)(39860400002)(376002)(346002)(136003)(396003)(451199015)(478600001)(9326002)(8676002)(2906002)(4744005)(44832011)(5660300002)(41300700001)(52536014)(8936002)(64756008)(6916009)(66446008)(55016003)(76116006)(66556008)(71200400001)(66476007)(86362001)(66946007)(38070700005)(83380400001)(38100700002)(316002)(26005)(6506007)(7696005)(9686003)(186003)(122000001)(33656002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?ZWHSckTygJo3JcO7nkdq7nWeEMwyGztxdvsQwEal1/gI5h+UTW6N65wPfjU/?= =?us-ascii?Q?IJcGY8H8aHXix2mXDsU4eN7LZsjgx8oRxm/F9l4K0upxzBOKo3AaAvbTn4vF?= =?us-ascii?Q?ZBh+23HsvkTsG57M4C+uCOw/hykJMJnihHfTQBr0GLDxSR6dZVNS3/YYMmH5?= =?us-ascii?Q?95AlT04ZnEfwFw81xl92i2kQ4YdUlBBB6iZBpBfsFN+uKf4nsi0uOt9pbwMy?= =?us-ascii?Q?BFn97QeIaBZ6YsAzW+oWAG9vAomj0idQjlQlwClPWLSksnWhUBsIcvK/gq5j?= =?us-ascii?Q?jkiLAKkvoNT3txodZiaZ3cfXVQg+u63hqCRZ4+fs9IWZcvMZBaZJ0xNDAhfZ?= =?us-ascii?Q?0LB29xi9BkACQRz5gABR1AZwDn8Vx3QhEKWcclFKL09fW8F3TtRO6EY7tiYe?= =?us-ascii?Q?asOS28IqypmzZ4tftA3gEJoN5m97jf5exIf4UptXoqNEhX/a55PHF3W6o+pk?= =?us-ascii?Q?VnzOIUbbByJoY5UoX1Ov45HNkIT2AO/SxlTZFT3ubxaAz+6P8VnzNBu8x1rL?= =?us-ascii?Q?NdGfG7ZlpXjFOXTHq/C2X726MergyaBZWIMxshOohKy8Sa5ZidIpa3d8fKyw?= =?us-ascii?Q?l66YCQIBsBtZpcc1vrGJhtAHPGyWWIPFCfrFDNus5rO116aNMc6RvzyElUve?= =?us-ascii?Q?V8WFPaBofs+ui0pSwzP1bR9kIc9yUFRKW7rwGo9916dtTtY6R/s+u8V4e9lo?= =?us-ascii?Q?nbuz426rdzAig+oJteGdz5Y9SCsfq5O4BleYUoqHnjHWkGGC4StDhsQV9vQl?= =?us-ascii?Q?Gw7nunB07H6WfNV/Phz6KPRHaGyeTC6ox7vA4ZpM8/vO3301LV1yP85izfrP?= =?us-ascii?Q?7f8iRRP4GpwapL1ON3DMMMR1a8FqSAVVQJy3v/KwZyoZlBdNk2bgZ9t6J8F3?= =?us-ascii?Q?qbI7uN24YmH//c+tkhbI+ZbuM1aYd5khW/csbSAWpMcLLU0heX5uY4WXyVhe?= =?us-ascii?Q?h+rsNh4Wi8aSEIy3BZOb1V+4eDrIbEWSCZfKzO/7gdgNJ77ijL7BGutYo7OJ?= =?us-ascii?Q?jwcyj9H6ijtfkX9eYBB/P0QrUaYNA1Mo/y43bUPG0Wpato122Ym26MxUN81R?= =?us-ascii?Q?Uo3vQCA9j7Sj8WgFwgISuP9jfwlGhz5LVzD3d8FA6nYZ01iV0Ne6yd6MSVJO?= =?us-ascii?Q?RVhFzYPuoEW8yX7Vs2RmpKt8UNG6dp7eD4oUJgeOB5XvLlH0u/EViedKQo5A?= =?us-ascii?Q?8lfPICjEPfxCPGlRBxA4ppzWTMrpAWGwKnMwgNXj1zDo28CbMUr6hoL+OvZL?= =?us-ascii?Q?lkT/j1HxZLut/q/jFTziuCqeVUO/CAtrU8GchUqGpDyOrCw7gvBqFhlQn3d+?= =?us-ascii?Q?e4ZAhcIYoUhzWr8tDGFVb1ntcYEnZQIXTddQBDrj+OLLffL5CQtMtU0H+huT?= =?us-ascii?Q?IPY1JJz1oihH6JmlaI8GlTkScnQkY6ulCIkV91igmrs6MCbRpo8ovn3SQWrk?= =?us-ascii?Q?y/MVRjdM73iD66GUQ/COd+G9EUszKqDeK1hOFcsSzcFStYRF7UCbTOKSYskD?= =?us-ascii?Q?8xsCSc8anaRhTEswpMuCboKSshd/PNABs9Fv7ckrGoWmpRIoDlk74raLPM/o?= =?us-ascii?Q?RR0zsxHVvont5fGliRhdUqi64hClQigsHfGVh/mP?= Content-Type: multipart/alternative; boundary="_000_PH0PR11MB56251A70503E9FA4E4E6048588339PH0PR11MB5625namp_" MIME-Version: 1.0 X-OriginatorOrg: EXFO.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH0PR11MB5625.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: ea1856c2-dfca-4f1b-8171-08dab7c5a9e3 X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Oct 2022 02:48:01.2889 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 1c75be0f-2569-4bcc-95f7-3ad9d904f42a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: wLA9nZfm1rSEybGWvSfhgtFW+4tg3VjG8l9s9EAankmzk/LukjtcZhul8Y49k0GHSjiW5+YssRkd5VigeloxDfrIMa+qVliKB1Xo9N4tnUg= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH0PR11MB5236 X-Mailman-Approved-At: Thu, 27 Oct 2022 18:44:38 +0200 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_PH0PR11MB56251A70503E9FA4E4E6048588339PH0PR11MB5625namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi, I am observing frequent dpdk Mellanox error files like /var/log/dpdk_mlx5_p= ort_2_rxq_5_2486504542 which seem to result in loss of input traffic. The first line of the error report is as follows- Unexpected CQE error syndrome 0x04 CQN =3D 264 RQN =3D 12583046 wqe_counter= =3D 54011 rq_ci =3D 108465752 cq_ci =3D 59226 MLX5 Error CQ: at [0x2246202000], len=3D262144 Also Unexpected CQE error syndrome 0x04 CQN =3D 263 RQN =3D 12583045 wqe_counter= =3D 57813 rq_ci =3D 2460978576 cq_ci =3D 64517 MLX5 Error CQ: at [0x224624c000], len=3D262144 Below is the device and driver information- Device - HPE InfiniBand EDR/Ethernet 100Gb 2-port 840QSFP28 Adapter (Connec= t X4) Part Number - 825111-B21_Ax_Bx Firmware version - 12.28.1002 Dpdk version - 21.11.1 MLNX OFED - 5.6-2.0.9.0-rhel7.9-x86_64 Can anyone help me in identifying the issue? I noticed that there is new fi= rmware version 12.28.2006 (7 Sep 2022) available. Will firmware upgrade add= ress this issue? Thanks, Kaustubh --_000_PH0PR11MB56251A70503E9FA4E4E6048588339PH0PR11MB5625namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi,

 

I am observing frequent dpdk Mellanox error files li= ke /var/log/dpdk_mlx5_port_2_rxq_5_2486504542 which seem to result in loss = of input traffic.

 

The first line of the error report is as follows-

 

Unexpected CQE error syndrome 0x04 CQN =3D 264 RQN = =3D 12583046 wqe_counter =3D 54011 rq_ci =3D 108465752 cq_ci =3D 59226=

MLX5 Error CQ: at [0x2246202000], len=3D262144<= /o:p>

 

Also

 

Unexpected CQE error syndrome 0x04 CQN =3D 263 RQN = =3D 12583045 wqe_counter =3D 57813 rq_ci =3D 2460978576 cq_ci =3D 64517

MLX5 Error CQ: at [0x224624c000], len=3D262144<= /o:p>

 

Below is the device and driver information-

 

Device - HPE InfiniBand EDR/Ethern= et 100Gb 2-port 840QSFP28 Adapter (Connect X4)

Part Number - 825111-B21_Ax_Bx

Firmware version - 12.28.1002

Dpdk version – 21.11.1

MLNX OFED - 5.6-2.0.9.0-rhel7.9-x86_64

 

Can anyone help me in identifying the issue? I notic= ed that there is new firmware version 12.28.2006 (7 Sep 2022) available. Wi= ll firmware upgrade address this issue?

 

Thanks,

 

Kaustubh

 

--_000_PH0PR11MB56251A70503E9FA4E4E6048588339PH0PR11MB5625namp_--