From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 32D1BA04DB for ; Fri, 11 Dec 2020 11:01:21 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 8D27CAC9C; Fri, 11 Dec 2020 11:01:19 +0100 (CET) Received: from hqnvemgate26.nvidia.com (hqnvemgate26.nvidia.com [216.228.121.65]) by dpdk.org (Postfix) with ESMTP id DAA6FAC9A for ; Fri, 11 Dec 2020 11:01:16 +0100 (CET) Received: from hqmail.nvidia.com (Not Verified[216.228.121.13]) by hqnvemgate26.nvidia.com (using TLS: TLSv1.2, AES256-SHA) id ; Fri, 11 Dec 2020 02:01:15 -0800 Received: from HQMAIL101.nvidia.com (172.20.187.10) by HQMAIL111.nvidia.com (172.20.187.18) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Fri, 11 Dec 2020 10:01:14 +0000 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (104.47.56.173) by HQMAIL101.nvidia.com (172.20.187.10) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Fri, 11 Dec 2020 10:01:14 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=MRo35fxEnLY4H5naw8TvZvojVlo2Xua6QqlHskMXzjrPWWbAvqLfQfO+QZ4mFU8kSKfCddgiR1xfuSn7auaCJleE3s+GyTt+H1M/5fDVb+omFJob6hwvXetoemJ2ME7jiBjSvycJfVWXYRucZIP5hquikoEh+QS/R7G2e9qSDcCyJ4ibtWLs67gi2FGP/9nUx1AkQPn88RHzM2qjcW0k71wqUcZhiIvm0WuwM4UjD4DyecJWRN40gzqad4ruJJKUbVAu71otJbQQxgpgxY7EaKFvKlbsw9gjrJPrZ3jdxeFVtrNF5R2nTQxdKZh52pwSaxXco2KDl93mppAEkrXixg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=dmu4G4YJTjEZTJZ0s6+mx4CFNX6qoPfGxoT32er+0K8=; b=CPZn3T51/TJhqtF7cOWrgKMRVn6TbafClN5YQ7LdVYDipkU/Oszh4FJKL7BjpKEch8a6ZShcmvlzEyPLpMtPXzhborX1Kwc45vyMgdxuwLuG65VSBWx5gTAEHjKpT8tOfr4st+6yDj/el7m6aSfcz188bQC2m2rKEvDqMzp79QjYhal0306UIdox8r0CmPnkKcFUNNQBjQekgYFmTpEx66u0w0/ycoVjJtxljSjpfedQIq8stH8p9tmFwV5x4SGU2mLs8i0txmOQYoacFeRcHxosoj87tF4WRasUeZpB1chBh1qTPthdDjPsfndrDo1d4lrZfSOHs7Aymxn8oEcLRw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none Received: from MWHPR12MB1501.namprd12.prod.outlook.com (10.172.55.146) by MW2PR12MB2411.namprd12.prod.outlook.com (52.132.184.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3632.23; Fri, 11 Dec 2020 10:01:12 +0000 Received: from MWHPR12MB1501.namprd12.prod.outlook.com ([fe80::e932:ffa2:ae39:a379]) by MWHPR12MB1501.namprd12.prod.outlook.com ([fe80::e932:ffa2:ae39:a379%11]) with mapi id 15.20.3654.017; Fri, 11 Dec 2020 10:01:12 +0000 From: Slava Ovsiienko To: "users@dpdk.org" , "Pavel.Krauz@anritsu.com" Thread-Topic: Mellanox Unexpected CQE error syndrome Thread-Index: AdatzABOSWQt4E2cRouv6M6n8ISRMQDlgl2wAChhN2ABK/MvYAAjB+IwAmbDFOAAlYST8AMcZSCw Date: Fri, 11 Dec 2020 10:01:12 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=nvidia.com; x-originating-ip: [95.164.10.10] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 1172d3fd-b4d4-4898-f65d-08d89dbbb0da x-ms-traffictypediagnostic: MW2PR12MB2411: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0y7LgB6GZ9FvcuO387jpkxxs1wZWlGDoL8dGTVOWGAih4n+dIa43ns3caUODnk+DN4lnzR96LS1Tbvlv1ul7UVaGVYceDY8L2qiT1pKCzprWEqOI/l14bzevmEGjkeoU5loiSYyIzpXDVHz8MQAxpsbouLicplGavObDtoNXWK4li4OphWaJMLPZjAxxTTft5WLAfTXbY8uh7EgnK7sgBaN3f1GOZS2nSd4CQK4sjjm6XwNZM+wzQocYgLjJPk6Na6arTOTmCfaJuFDTAxdCl7DrgOOvdF8YFONYoJp7bNiJxKIVh7X/v+PMR6Sd3fHU0zhBvShIJxzz/RtluJY9Lg== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:MWHPR12MB1501.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(376002)(346002)(366004)(136003)(7696005)(33656002)(6506007)(71200400001)(66556008)(5660300002)(66946007)(66476007)(9686003)(83380400001)(86362001)(66446008)(55016002)(8936002)(186003)(8676002)(64756008)(26005)(52536014)(76116006)(2906002)(110136005)(508600001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?Fxkj1lKAjM8ip+PJj8Vt81L+tQEf7Zx5xSsTFXBSHeB3Xo0bf3w1u/mMn5/V?= =?us-ascii?Q?zN3j/NESBeqW7dfLDGIFX9DUNo4EAToBnRYHdOoqOjBHQJBJejyFUHywmsp3?= =?us-ascii?Q?dKIgFr2x0KKftsC/7bSo4aZ9NN4RiWcoxHxjRR8Axks1E66q2oflTSEOOuvp?= =?us-ascii?Q?WtGcL3mG7MQ9gB+Qzwr9CXLnLCm6w7MOudaVDgmoom/bQWozm3uk7E0Ga6Eo?= =?us-ascii?Q?IwuorbHyoJEJGl9IVxuOjpHolPRghx1H7+dqxjwv2tgIiN4ucgF6mFkhqY7t?= =?us-ascii?Q?DBCjN/wGHjGtD2JHw3oWXNQqKJVxhaGvevtt+D9HiORXqTPftr7dmkbd8YrS?= =?us-ascii?Q?M5vkOVxSYpbRWBZkOvT1RyTNkX5o3/NI9eTRuXcB4N0J5mk8BjEhgkk5p5Q7?= =?us-ascii?Q?OxAUgo8HY5UbDZAW5x9NCBCtFG00xbpm4ITFQRTbxhaEIPZ6shiPXH+0V1Mc?= =?us-ascii?Q?l+j1+gLBkmn5ZjCrhJNJwr89tzyfvboiq3T7aR218azq0M+AvAyXglo7Bll4?= =?us-ascii?Q?5JCuS95ANYY2BMJCCrbYDy9aV6G70W715V0x/3ieM90xmWkU12CcqkVjDW+2?= =?us-ascii?Q?/SP1dTWXJ2jMTtLsnGsKHwH07R2IN8pB8LfA00zIKdNQaZb0amWoIW+UfHZ2?= =?us-ascii?Q?BVZYwJIzkRMglvnI5K2a+STk6UJazg9TPmqP624nWOeojHpSt1Z6wmyEFO9S?= =?us-ascii?Q?XvXVk7WMYwOLtkIASbTKL4Ym+Feik/pfBmdBtM3KoQJ5aLRmVIKiMo5hag8L?= =?us-ascii?Q?ayK55z6QDL1lhrlhnC1Fo5HP3JiYQF1zO6O4w3t85UIDyHVjyDttiaL7HIPz?= =?us-ascii?Q?VTXKlLWvEgduuXOTIzbs6ZSz70Hsm5L5qNfMQU2euw57ogxgKVeqjrH6DC5D?= =?us-ascii?Q?FIJ2vEw1XZovM+MiX4IuVjBjJ/3k6BmiW8ip8SunvIlyT3pDQL/V9MPOuCkt?= =?us-ascii?Q?GUn9V+QifW0KqMDkq2M2rEVvD9w2llahCCNnP+jaaIA=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: MWHPR12MB1501.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1172d3fd-b4d4-4898-f65d-08d89dbbb0da X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Dec 2020 10:01:12.3550 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: PFl7rlUg3IHdEdVnIwpHLCvj+YMEc8oAbnkIo9l93ZsYLTqzhlOOo1lCewFhlyEG/l9iYUJS82//+hp+BWoAbA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW2PR12MB2411 X-OriginatorOrg: Nvidia.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1; t=1607680875; bh=dmu4G4YJTjEZTJZ0s6+mx4CFNX6qoPfGxoT32er+0K8=; h=ARC-Seal:ARC-Message-Signature:ARC-Authentication-Results:From:To: Subject:Thread-Topic:Thread-Index:Date:Message-ID:References: In-Reply-To:Accept-Language:Content-Language:X-MS-Has-Attach: X-MS-TNEF-Correlator:authentication-results:x-originating-ip: x-ms-publictraffictype:x-ms-office365-filtering-correlation-id: x-ms-traffictypediagnostic:x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers:x-ms-exchange-senderadcheck: x-microsoft-antispam:x-microsoft-antispam-message-info: x-forefront-antispam-report:x-ms-exchange-antispam-messagedata: x-ms-exchange-transport-forked:Content-Type: Content-Transfer-Encoding:MIME-Version: X-MS-Exchange-CrossTenant-AuthAs: X-MS-Exchange-CrossTenant-AuthSource: X-MS-Exchange-CrossTenant-Network-Message-Id: X-MS-Exchange-CrossTenant-originalarrivaltime: X-MS-Exchange-CrossTenant-fromentityheader: X-MS-Exchange-CrossTenant-id:X-MS-Exchange-CrossTenant-mailboxtype: X-MS-Exchange-CrossTenant-userprincipalname: X-MS-Exchange-Transport-CrossTenantHeadersStamped:X-OriginatorOrg; b=BELfv1VqCWSmGkU9CdpcL/64jVArsrengK0Pmoaq2vgRrQ/XDXLvnunxFgUO3SEY+ HavZ9yZbHPOCS6/4c9hJPJ/i5uqQlwAwpCtbDF2cZSDLaZDqfOhC+Y+Sx9L3vYzl/K 30NKtw7o+0xk4toPHLQwg5gBm1h0XiW02Pb0/GROwE9Ae0WZg2OojOdP/4hCsKLK/n dPBdeet/FOuE+g6rkqNuBLDfyQ850yEJMNA+VaB6WiNzaQt5NdgEZ1hdeNli5LsNex BM0ZQ8d83ncbmT6lOFlEdx5U2oaSm4kMCPTGTMGCXcHx/aZtGc8eoJk2zEiLbxVlYt 9La3Cv5gz6Gig== Subject: Re: [dpdk-users] Mellanox Unexpected CQE error syndrome X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" >-----Original Message----- >From: users On Behalf Of Krauz, Pavel >Sent: Thursday, October 29, 2020 10:18 AM >To: users@dpdk.org >Subject: [dpdk-users] Mellanox Unexpected CQE error syndrome > >Hello, >I am having problem with HPE Ethernet 100Gb 2-port 841QSFP28 >Adapter which is a Mellanox adapter for 100G network. > >The DPDK driver reports and generates lot of error files like >dpdk_mlx5_port_0_rxq_0_2459159054 and loses traffic (because>IMHO >it must reset the card): > >the first line of the error report files is as follows: > >Unexpected CQE error syndrome 0x22 CQN =3D 1030 RQN =3D 12582977 >wqe_counter =3D 10040 rq_ci =3D 494774062 cq_ci =3D 3586794130 >Unexpected CQE error syndrome 0x22 CQN =3D 1030 RQN =3D 12582977 >wqe_counter =3D 27509 rq_ci=3D 808774458 cq_ci =3D 1527072213 >Unexpected CQE error syndrome 0x0e CQN =3D 1030 RQN =3D 12582977 >wqe_counter =3D 0 rq_ci =3D 32768 cq_ci =3D 2413356687 > ..snip.. > >I have tried latest card HP firmware and enable/disable CQE >compression in the mlx5 DPDK driver using rxq_cqe_comp_en=3D0/1, >but no improvement. > >Does anybody know what can be the problem and how to mitigate it? > >Thanks >Pavel Krauz Hi, Pavel. Sorry, I missed this mail from users@ mailing list. It would be nice to create an issue in DPDK Bugzilla and have the dedicated thread to handle. What DPDK version do you use? Syndromes in this report are different ones, at my first glance it looks like as not correct MTU or max packet length is configured. The NIC receives the packet with the length exceeding for what queue was configured and packet data overwrite the descriptors, resulting into syndromes. With best regards, Slava