From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 564E4A00BE for ; Tue, 8 Feb 2022 16:15:10 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id EB8E8410FD; Tue, 8 Feb 2022 16:15:09 +0100 (CET) Received: from mx08-001d1705.pphosted.com (mx08-001d1705.pphosted.com [185.183.30.70]) by mails.dpdk.org (Postfix) with ESMTP id 075CE410FC for ; Tue, 8 Feb 2022 16:15:08 +0100 (CET) Received: from pps.filterd (m0209318.ppops.net [127.0.0.1]) by mx08-001d1705.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 218Cbq6x028824 for ; Tue, 8 Feb 2022 15:15:07 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sony.com; h=from : to : subject : date : message-id : references : in-reply-to : content-type : mime-version; s=S1; bh=x1gUwCq49AZnZ1W5JNvUW7yRN+ZP4c862x+dYSbLCsU=; b=Y60a9rd8TSom7Du/1I02aDXACJHYiul+VMIivrX/OfUX0ztqBNzl4r5YH6GsXDc/rLys OTj2mEG5MDyKFbik7aXEgR2sS35b3qBNRgCjIiLz6ICDM6OFJ4gUBlBAfAFGNvKV38nA HFppxsiY6Nm09Atp08mMXqBD9XOoOLD0AzpOdLZBGuYCa4Bo5eQ625UzLe0e/AGDZzUP qohythgCZSN+WzKf80q/f+hGCGkzoyANm69J3gFLdx4oPArkspUWOYdqWeMtsevaYDBS AP6yMPHmXTtii39XMDKe1vguNJCVkXyHiksqoBi+91kkVdgidIkdYfjfY1Id6Y1ta1d8 2g== Received: from eur05-vi1-obe.outbound.protection.outlook.com (mail-vi1eur05lp2172.outbound.protection.outlook.com [104.47.17.172]) by mx08-001d1705.pphosted.com with ESMTP id 3e1ft4txj0-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK) for ; Tue, 08 Feb 2022 15:15:07 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=H32Fo42n/+X/grb1m+WMPtPV4fu6wQ0/KkxQHbj0TI1MSNBmh0hdo3jN+piI108PTuBnGDhnXqZGzk0ICY6xqqjRLspCyB2alxJunIYoBYOpagMwMwXyLiUGPH5lj9/Zm3bzez5wZtmSsq7B8RbAbmCAfxurpp3FtkGdITDiAbHTmnsZY3szSbHGIh7FoRxF9vCe0FgVhdp86MscsuxxFlMKESOVDux3a0mjUVBhMLVSW52XH6ctPTEvEEfAjuixJq5HPMhExrVtekAMoR8zs34uqOmml92wLNIQdPBQanX/lUZYqoaRXvDerNtC60Xjj0NvQ0x89T9LnKBi5D2/Og== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=x1gUwCq49AZnZ1W5JNvUW7yRN+ZP4c862x+dYSbLCsU=; b=IzZTEH/cAD+W7NiYmOKgJj7uGcn0t6yzrXJSr0BJxlUnc/3LelSd7wGLU2kDRBDWEAeexYOdCT7AtCkvwgr3iYpBTGOfFQBI1yb5dWLv8xCnEHJ6wzngnJER0p1B0e4XTJmLMUlDkB6lQ+sdxbaNJ5dRAso3nAxWkuKd52W8xnXWo6egFHMo5stHAqv5MH3NqfQ5wtKAXc0rAAYeKOiTbNMz4l50XKPgI9KVWDu87dTPNGnx7cYOWLouZ7q1lKbuxtAM15A6Jkk8fzNGijplaa8ROYlamApwERSSQLBmJiTqtL31fQy4HQbRuRBX2KWLeWfGNwrwjX4mO25To64E8A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=none; dmarc=none; dkim=none; arc=none Received: from AS8P193MB1734.EURP193.PROD.OUTLOOK.COM (2603:10a6:20b:3f5::10) by DB9P193MB1931.EURP193.PROD.OUTLOOK.COM (2603:10a6:10:24e::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4951.12; Tue, 8 Feb 2022 15:15:05 +0000 Received: from AS8P193MB1734.EURP193.PROD.OUTLOOK.COM ([fe80::49e6:7699:62cc:5c20]) by AS8P193MB1734.EURP193.PROD.OUTLOOK.COM ([fe80::49e6:7699:62cc:5c20%7]) with mapi id 15.20.4951.019; Tue, 8 Feb 2022 15:15:04 +0000 From: "Alan.Birtles@sony.com" To: "users@dpdk.org" Subject: RE: Connectx-6 LX scheduled sending only sending 25 packets Thread-Topic: Connectx-6 LX scheduled sending only sending 25 packets Thread-Index: AdgcSFDIO7pj/volQGSk3LCX/o0slAAhpnYQAAvcrWA= Date: Tue, 8 Feb 2022 15:15:04 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e33aadc1-6c00-4e9d-805c-08d9eb15c90b x-ms-traffictypediagnostic: DB9P193MB1931:EE_ x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 8KgENJO0ZTZGXIEPKzKd6++7jUYJp3wWQ+KJ5cuoKXTw167SgO/CTAG7vadihhM3nNfbnSATLWmsDNVsE3kl+oBJDTBd3ER2W6xx35b2XkA/dagsFB7CPKM3/o31Z5EE74mq9HHRwvoh1YJUP+rS3t1IgddBxOwRVxh92YK/FNRWfTCLxUrMxar4zEyPk9ESKGxuoJhWxlhnQg7F9eLslXudSvPDpJsM7x0Z0QLo0g9jCSRZDtcAEVbSaSUnAELEBBwHtlsB2wPtkZMZ1C0Tzpfnic2eL/OQNde46nylIgxl87xYj32e71/dmdvMpbLzKG+hDZXrwCA9DfoyKcLq5vSxgH6pr9vrXKKLWON8fZbFARNVYTqnkyq0UgZh3o9eVJeQ/qzZEkYQWD9C27MWQOZWNY+0i0+LZ/ClM30pGFY7U4TA9IDYjJZK5GEHVZYQxgsq79l6bBS3OLouyJRc5HX2inzGc2ljTou2l67IbycVleic+ri+yybj2mVtJd3t1UVFv9ImyfD0sq0aJRCLWFOWkqIhSEevRTUnLdGSHmPjrqeZ9qVGql2xRWt7+QDR4G5/3cRdNENLyP6XGZUKyt3MrbBUSb3FxSm7iIQQpXqpgEXkX4Ul4q3VF5UL2fyJ11qtmDFIZCNU9Zlx8MkhMNJedSylP4j9Ge0sz2hRyjLBP0qkGXn7nvT5Eqhc48CPRmXchX7eMrNjBrqyhOUUsA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AS8P193MB1734.EURP193.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(38070700005)(82960400001)(71200400001)(55016003)(508600001)(66476007)(316002)(86362001)(122000001)(6916009)(7696005)(6506007)(38100700002)(5660300002)(53546011)(9686003)(33656002)(2940100002)(52536014)(2906002)(8676002)(26005)(186003)(76116006)(66446008)(8936002)(64756008)(66946007)(66556008); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?hXfwUBcOHMTMPuv5NXsJHfO2/Fy3y3alpKCBp4gW6pY24AteHqe8TE9erdyN?= =?us-ascii?Q?T3ibz5VT+0VVpnUbQEY5Ql3uZa0TBhy+HcaqhG4lRE/P7wUmn/3XT1wAnyUN?= =?us-ascii?Q?CNeq/PFgawGK10IHal0/JObL2kxE7pHIk4Zx3JJge2vrV8bx9cLCQOy4Re6d?= =?us-ascii?Q?eptG1+OWzS8HrQclA6CkJvkr/8YXfGYlEbhvF9+bQokArCdI3aBG1uVUc9DC?= =?us-ascii?Q?Bcq9B90dxXf4d3fDI6IvaFk2uIE88J/RLJJ9XqPFumPd3I9QA/JclUCDSPot?= =?us-ascii?Q?MkuIStjxhuvALjwasNT/yKBDWE9Q/pwI9Bfup0Igjqxh7CrUd/vY11Wabb9t?= =?us-ascii?Q?0eu3msgzBLYyTVruHy8KXAgVINFa16qd7SeTg9d5rMzCfP5vezgWwXIPQ2c9?= =?us-ascii?Q?HLmqsnHd0k5BsasW00ExtDozbltw6ROBdd15T/CkbNPk7qP8wbziL1b+RfQo?= =?us-ascii?Q?CHW5ng3Uoj0iQGQHMu5ke6j19qjCiBBCadSraS8giK7ap4d1aKoHfivKJ//K?= =?us-ascii?Q?npV1qywrdHvbZgQp8MkSNYvhKtRYDCb+w4vc2X87WNOx+mdcru7heDJoI/lF?= =?us-ascii?Q?0dSBL3UT41JQEOnmMNJ9t+ibbEXIheHlITcAtEl29krkPHzDAhEGtwY0NVek?= =?us-ascii?Q?JTjGRW1krAe1uuEDywGR4l1i+DN+4+nQ7tyd//szfqf4LiYCSrF2p2WdgODE?= =?us-ascii?Q?e7jBgVnlEdWfw7U7V8h7EjzhmbyO7yb4R//813ymtIUf5kpwVHWqttwDj7CW?= =?us-ascii?Q?DIU+GF+PpmNMPF88g64g1/Gck0g9+WJkb9K6DJkpFk+vb5ZreS46xjTTrMe2?= =?us-ascii?Q?Nnh2YjE5OPaZJ8oQjI+cwgKW5H0G60AALrpjBUIWa9ov68lADu6UEeoe/Xxk?= =?us-ascii?Q?GthQGrGrfAwCdTB7vK76QI6K5GzyFoYWTPoDl6Fe/IIR60KariFI/Tx+o5ix?= =?us-ascii?Q?VaZwlq/2R8Gy2cFo8M/zHFlri0OO7I7w+syUqBDbLWgIEsLdqpt58TCqdn7g?= =?us-ascii?Q?kX5yYMPguCObUxn1ZWBllBF27w4pKeyE9WvFQOzH56BXukmzYrkQ2NcFcUqu?= =?us-ascii?Q?Li01JyUOosxLAMufdj6TF+gxRh0j1HxBeohyU8iM0smLoiazDGaboOjIS9m2?= =?us-ascii?Q?15wnp97DtieNZWfMdzE6un7VnTk5pAoW35Bp39aZEkgv9PIdcBTp99A+XjVj?= =?us-ascii?Q?8wCCLuJjqsNhPkIVl1ITHIsC/913Yix6AcQB5qwDz634gn8nte9zYpjQ7+I7?= =?us-ascii?Q?WBHsWZXF7PWLOQYxf4DyXpP24xJuNDNDl21k3e0TumA3pi+AgtrCrEuD6P1T?= =?us-ascii?Q?RGe0VI8+hQheQ0wUFjmeHl+U7ZiBXHT5bthi0xNCjz0nggZElQKeR2U1b3/a?= =?us-ascii?Q?bvx4n6gqe8Mgr3MX1+sX8GAIqDVu3TVrB3W+4jhiszg0ttax1fcb1g086EHb?= =?us-ascii?Q?84XjE/VwQpYwLa3SczWIFlSt7ij88VXP2eVls12m/63sXUsGvOLaIFllNLjW?= =?us-ascii?Q?QjPCZnZT6yj+dQhjTJ1kK1zkwFb6yEf7t5Sro/HFCx3jktvHJ8Iw2K7oCx7u?= =?us-ascii?Q?0z0q8PbBa4Pjf2/f2HkPBXEkDF2cY1esQWpV5gtHtLiK0qSCLQ/OvyteAizy?= =?us-ascii?Q?fw=3D=3D?= Content-Type: multipart/alternative; boundary="_000_AS8P193MB1734B46FC1EFC504B3BA891BE52D9AS8P193MB1734EURP_" MIME-Version: 1.0 X-OriginatorOrg: sony.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: AS8P193MB1734.EURP193.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: e33aadc1-6c00-4e9d-805c-08d9eb15c90b X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Feb 2022 15:15:04.8669 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 66c65d8a-9158-4521-a2d8-664963db48e4 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 1Ei0rgvaUwFVxwqioDBHoo2LuQImmpx41fJy9rA3kRpL96inXtkQErxwRhaWTWIbzT1HaEnRWKLFW7a17Ly7bg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB9P193MB1931 X-Proofpoint-ORIG-GUID: Hw2otocCZ5xyErTaW6nxGRg4FDzKzBgw X-Proofpoint-GUID: Hw2otocCZ5xyErTaW6nxGRg4FDzKzBgw X-Sony-Outbound-GUID: Hw2otocCZ5xyErTaW6nxGRg4FDzKzBgw X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.816,Hydra:6.0.425,FMLib:17.11.62.513 definitions=2022-02-08_05,2022-02-07_02,2021-12-02_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 malwarescore=0 bulkscore=0 spamscore=0 mlxlogscore=749 impostorscore=0 phishscore=0 clxscore=1015 lowpriorityscore=0 suspectscore=0 adultscore=0 priorityscore=1501 mlxscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2201110000 definitions=main-2202080095 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --_000_AS8P193MB1734B46FC1EFC504B3BA891BE52D9AS8P193MB1734EURP_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable It looks like this was caused by not having enough TX descriptors, we were = only specifying 64, increasing to 1024 fixes the problem. From: Birtles, Alan Sent: 08 February 2022 09:34 To: users@dpdk.org Subject: Connectx-6 LX scheduled sending only sending 25 packets We are trying to use send scheduling on a Connectx-6 LX. If we set no times= tamps on the packet buffers and manually send each packet at approximately = the right time everything works. However if we set timestamps in the buffer= s then the first 25 packets are sent and the packets are received at the ex= pected times but all subsequent calls to rte_eth_tx_burst return 0. If its = relevant we are sending a single packet in each burst with timestamps 125 u= s apart. We've tried setting the timestamps to low values and the packets are transm= itted correctly and as expected the tx_pp_timestamp_past_errors value is in= cremented. We also set high values and this worked too with tx_pp_timestamp= _future_errors incrementing. Any ideas where to start debugging this? I couldn't see any API which would= give an error code for rte_eth_tx_burst failing. We're using DPDK 21.08 with the 5.4.3.1 mellanox driver on ubuntu 20.04. --_000_AS8P193MB1734B46FC1EFC504B3BA891BE52D9AS8P193MB1734EURP_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

It looks like this was caused by not having enough T= X descriptors, we were only specifying 64, increasing to 1024 fixes the pro= blem.

 

From: Birtles, Alan
Sent: 08 February 2022 09:34
To: users@dpdk.org
Subject: Connectx-6 LX scheduled sending only sending 25 packets

 

We are trying to use send scheduling on a Connectx-6= LX. If we set no timestamps on the packet buffers and manually send each p= acket at approximately the right time everything works. However if we set t= imestamps in the buffers then the first 25 packets are sent and the packets are received at the expected tim= es but all subsequent calls to rte_eth_tx_burst return 0. If its relevant w= e are sending a single packet in each burst with timestamps 125 us apart.

We’ve tried setting the timestamps to low valu= es and the packets are transmitted correctly and as expected the tx_pp_time= stamp_past_errors value is incremented. We also set high values and this wo= rked too with tx_pp_timestamp_future_errors incrementing.

Any ideas where to start debugging this? I couldn= 217;t see any API which would give an error code for rte_eth_tx_burst faili= ng.

We’re using DPDK 21.08 with the 5.4.3.1 mellan= ox driver on ubuntu 20.04.

--_000_AS8P193MB1734B46FC1EFC504B3BA891BE52D9AS8P193MB1734EURP_--