From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 769BDA09E9 for ; Mon, 14 Dec 2020 14:47:42 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id B2952C876; Mon, 14 Dec 2020 14:47:40 +0100 (CET) Received: from JPN01-TY1-obe.outbound.protection.outlook.com (mail-eopbgr1400073.outbound.protection.outlook.com [40.107.140.73]) by dpdk.org (Postfix) with ESMTP id CE7E172EB for ; Mon, 14 Dec 2020 14:47:37 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=ViSoMBagg21JBMZW1NDtU6htmtmR3WcN+mqHdx3SsHZCCdsrkHUiPVSPvuOdtWo8ub38I15Bl4Siggfqv5oGId3KLr+FVDT81Z8r4msaiXTW29P9gMN3FlG0RgbrolGlH07KJAZLfTbbOH9RtP7JvVZtp4mg88YDk9iJD0ZJekEbt511f6kx9XQcj5GRkRQfWYlgj/Hd0bO/ebQOQNpcht82tA5/hTjJLKN//jXXUc99QuxPUqjdjUoUMnBTys3A/Q95MBpJ3pbxKZWXm3e62Otbrb5bsJrnznSRQDo/Nb477ud0bNSQh7FESkCJFlVXVF3GLEJ1Edsmx/titd+51g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=YprA/UZBrLK2dbFSJUmF+5A9CpCXhr97VDlmBvavDY0=; b=ltFWCDls0mPRWnLd0+z8xQJvoZhqQ1AELkGp/Ylky0rS/hnfn8QQyibcDvOicIzjrfk95lKYJqxB+sYxgv4ySwVqlDsfYXGe4cuWGy6wMQoyC7yD78oQnFbjlPH4tE25FtGp7L9PX7EhnOuLyGKS++u4xzEkYHtCni83CbOOcy6BMrQCBooIjHk5vkZNVlPPG9T0X2Mzd76fY8MmBT/eSseBmsONrqwCjcU5ZcCkT8Xtd9hF/WH0rbgKQEEHp3jpE/HuD3Kh6xt1yzXmsVL9Qqg77t0f8YsHRv82aZ7abPG7xIpzhDYANjNHQQNjxfpNZj/Ze45xohUOUTkQ/5ttMA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=anritsu.com; dmarc=pass action=none header.from=anritsu.com; dkim=pass header.d=anritsu.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=AnritsuGlobal.onmicrosoft.com; s=selector1-AnritsuGlobal-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=YprA/UZBrLK2dbFSJUmF+5A9CpCXhr97VDlmBvavDY0=; b=kX2PN6KazmMRhftZB0hwyWmusqojrtQB6gTkej7F0oM5nKCUyBdOvfWhYFcLCZUjHmxx98LhhDIw0cX5MD1tPRMkfHBekgAAvr4khgCVNDh3pVgtCcVfrUZm8X4ShkYVv3xtRhEoBApCVOhnXLpUMsByXhj1VJTP0B4GZRag8Gk= Received: from OSBPR01MB4152.jpnprd01.prod.outlook.com (2603:1096:604:4d::19) by OSAPR01MB4835.jpnprd01.prod.outlook.com (2603:1096:604:68::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3654.21; Mon, 14 Dec 2020 13:47:32 +0000 Received: from OSBPR01MB4152.jpnprd01.prod.outlook.com ([fe80::781c:693:a054:6a0c]) by OSBPR01MB4152.jpnprd01.prod.outlook.com ([fe80::781c:693:a054:6a0c%5]) with mapi id 15.20.3654.025; Mon, 14 Dec 2020 13:47:32 +0000 From: "Krauz, Pavel" To: Slava Ovsiienko , "users@dpdk.org" Thread-Topic: Mellanox Unexpected CQE error syndrome Thread-Index: AdatzABOSWQt4E2cRouv6M6n8ISRMQDlgl2wAChhN2ABK/MvYAAjB+IwAmbDFOAAlYST8AMcZSCwAAhYwXA= Date: Mon, 14 Dec 2020 13:47:32 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: nvidia.com; dkim=none (message not signed) header.d=none;nvidia.com; dmarc=none action=none header.from=anritsu.com; x-originating-ip: [79.98.75.9] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 62f2673d-0fb3-43f8-cc58-08d8a036cea1 x-ms-traffictypediagnostic: OSAPR01MB4835: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:9508; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: +guI1fbSa1dlu28/EyFpeQZoWKepc4LL2ZrbCtFcAPC/y5VpPiU4sYxSU1Q1zUG0vvnaCmWsBF4qrCit1fuNPdsNEIPUFww0UblxTuXKNDOsEPpoUhPdMTVxv1+t13zkOYcg0L4Qpu2w4jaSkrmxWU0USqjIEChz73FjzhOKiteTjq/G1A6CLGIu3GiKdTcAiwjcW1R08a3SB13dVDxol2sjfcyEiUfp4DecS7a/NzZmkprhKt0XhU72b1Rz4YLdFrV0RQDaGvoOu0HaAw3XHtLObfG2cUl2TCsUCWhjOHsfyHE1UzbPuuBAe8bqky2P38zWwPUq6oOgdV+6wx3Aag== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:OSBPR01MB4152.jpnprd01.prod.outlook.com; PTR:; CAT:NONE; SFS:(136003)(346002)(396003)(39860400002)(366004)(376002)(316002)(2906002)(86362001)(5660300002)(26005)(8676002)(186003)(478600001)(7696005)(66556008)(83380400001)(53546011)(110136005)(66446008)(64756008)(66476007)(66946007)(76116006)(8936002)(6506007)(9686003)(33656002)(55016002)(71200400001)(52536014); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?hM3Sls2sR9nO4MtdY0mw6bR4xI+85a4NVrUKG92FKmPfgST8qAwv8Rs3fY?= =?iso-8859-1?Q?uUjlArezo3bXjJJPkuzUlAkx3vSWy6oJkFzhpnfaQAM0MNtAJrtetrij0d?= =?iso-8859-1?Q?ugNZPyUpVkZZltoEshDVv2Ne1J+mhMCfOTR76sDv5tBwuIFZXcRaRNGVha?= =?iso-8859-1?Q?RYGgTzlbJF+p9pECH+V3qStOqIAc4LBRy7he7iEtHVjONtWqYIFK15u2a8?= =?iso-8859-1?Q?P+Bi//aRxhS8uh8/HTtb6+uxFwB9Ks6lbHnpMlJKln+UZybQ2ecDWs5CpD?= =?iso-8859-1?Q?dgVAhxE5XJxubYVr5kpdVfDTCiJteuFmjXcW9xIh2WNnso0k6k9Y/Cdb1n?= =?iso-8859-1?Q?Z8KETetZXqHvDiQbGpJnaSOlwNOTrmm2SHtNJCk7Wnh3jG7GmV5nXHtPWE?= =?iso-8859-1?Q?ZjlOWwjPgzzoSlj34F/ZmrcmbQDI3/s4fSz42WEVo8U7y+WQfjKJarPo5h?= =?iso-8859-1?Q?ntqKawIRnVMh7SJUXffaTdEYakKKgoR77Pkfx5VMxbDIYFSXl4Thh8/DwF?= =?iso-8859-1?Q?mMSyHE/cdHTZ2yA3Zo7d4B0h0vHTyEF2eOiSKFMvDyfMXSAgEhdy6bpObv?= =?iso-8859-1?Q?TNjonsz9rQP9vtTbiCHexjLrpi2GpNDVzCQCWIkzb18342pap1GiL0QFAN?= =?iso-8859-1?Q?6d/Am7TbrXafBqcNxBiEeCSJkmtd4VjnZMPTEYW2Bn3iRR0lWv7SCOclrA?= =?iso-8859-1?Q?/wRD8sM2ZkOXGVPNqg/T6VkeG9SkSLMcGESSpedqY55xfVZPUStCLlWlvk?= =?iso-8859-1?Q?VUCBkm7O/gbJ5h/Q0tjRFtWReOl8T0HgtxzGZFKIi73Kd9IAEwoLmLZLm3?= =?iso-8859-1?Q?JUTFc1Lxckz1MeAjJ+5KBuWCVnSC4/r9EtX+u10SZudj5RPvPjUE0srZ4P?= =?iso-8859-1?Q?eBfAdY17SkHaEvC95IH0V9xclX3EQaIuw+jhwDAbTpZ6LSNyPZX3xg1r+u?= =?iso-8859-1?Q?9G4r8A2NqdcqqcOssVbkaR+W0rmrQ/UCKLqSS+FXsqAdCN0cANkoOzf2Q7?= =?iso-8859-1?Q?LXf4FoJ6wFkKIA9Wo=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: anritsu.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: OSBPR01MB4152.jpnprd01.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 62f2673d-0fb3-43f8-cc58-08d8a036cea1 X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Dec 2020 13:47:32.7214 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 5655302f-85c9-44b7-bc12-807562d22c08 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Qknc4lXNrmYzyCsLTY+raZIVLBf2B2OZ7KCNjFLe9JFz6tTcbxO/2v+zEDlKUeiugaShWercGAuVNqGzvg4KI+JAuJURVKL+4Pui3fuTrPw= X-MS-Exchange-Transport-CrossTenantHeadersStamped: OSAPR01MB4835 Subject: Re: [dpdk-users] Mellanox Unexpected CQE error syndrome X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi Slava, Your suggestion made me realize that we do not set the flag for jumbo frame= s correctly. After setting the DEV_RX_OFFLOAD_JUMBO_FRAME the problem disap= pears. However when we set the port_conf.rxmode.max_rx_pkt_len =3D RTE_ETHER_MAX_LEN; and do not enable jumbo frames offload, then we see the Mellanox debug file= s again. (mbuf packet pool is configured with data_size =3D RTE_MBUF_DEFAULT_DATAROO= M + RTE_PKTMBUF_HEADROOM) It seems like if there are jumbo frames in the monitored network but not en= abled in the DPDK then the card goes to error state. =20 > It would be nice to create an issue in DPDK Bugzilla and have the dedicat= ed thread to handle. Yes, will do it for the case of jumbo frames not enabled in DPDK and pkt_le= n set low. > What DPDK version do you use? We are using dpdk 19.11.4 b.r. Pavel -----Original Message----- From: Slava Ovsiienko =20 Sent: p=E1tek 11. prosince 2020 11:01 To: users@dpdk.org; Krauz, Pavel Subject: RE: Mellanox Unexpected CQE error syndrome >-----Original Message----- >From: users On Behalf Of Krauz, Pavel >Sent: Thursday, October 29, 2020 10:18 AM >To: users@dpdk.org >Subject: [dpdk-users] Mellanox Unexpected CQE error syndrome > >Hello, >I am having problem with HPE Ethernet 100Gb 2-port 841QSFP28 Adapter=20 >which is a Mellanox adapter for 100G network. > >The DPDK driver reports and generates lot of error files like >dpdk_mlx5_port_0_rxq_0_2459159054 and loses traffic (because>IMHO it=20 >must reset the card): > >the first line of the error report files is as follows: > >Unexpected CQE error syndrome 0x22 CQN =3D 1030 RQN =3D 12582977=20 >wqe_counter =3D 10040 rq_ci =3D 494774062 cq_ci =3D 3586794130 Unexpected = CQE=20 >error syndrome 0x22 CQN =3D 1030 RQN =3D 12582977 wqe_counter =3D 27509=20 >rq_ci=3D 808774458 cq_ci =3D 1527072213 Unexpected CQE error syndrome 0x0e= =20 >CQN =3D 1030 RQN =3D 12582977 wqe_counter =3D 0 rq_ci =3D 32768 cq_ci =3D= =20 >2413356687 > ..snip.. > >I have tried latest card HP firmware and enable/disable CQE compression=20 >in the mlx5 DPDK driver using rxq_cqe_comp_en=3D0/1, but no improvement. > >Does anybody know what can be the problem and how to mitigate it? > >Thanks >Pavel Krauz Hi, Pavel. Sorry, I missed this mail from users@ mailing list. It would be nice to create an issue in DPDK Bugzilla and have the dedicated= thread to handle. What DPDK version do you use? Syndromes in this report are different ones, = at my first glance it looks like as not correct MTU or max packet length is= configured. The NIC receives the packet with the length exceeding for what= queue was configured and packet data overwrite the descriptors, resulting = into syndromes. With best regards, Slava