From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8779941CC1; Fri, 17 Feb 2023 17:39:12 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 4F29940F18; Fri, 17 Feb 2023 17:39:12 +0100 (CET) Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by mails.dpdk.org (Postfix) with ESMTP id AFB6140EE3 for ; Fri, 17 Feb 2023 17:39:10 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1676651951; x=1708187951; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=wxkozx30VzTz9pHPuClNB0REcpYHL9A0IZiTXW7l1eY=; b=fjMGSxfljj5+Dgj+YbbVLfdRf1Q1uQyqzctskRhpXnTYuT7pf1PxVg4B Kg8cKWf+JZgDnASAJTKIL4PhorR0zd1MyYRZ8Upm1CjFzmEmsB/y9CkaP 0KdplIIszpJtxlsYcEK8PwuoWPfnAgxi/TLbAvvz+taexwNw0tHwYLgA5 DHDZ4u2mVaLx44w9Kt5nTsy4Ha/a/a+Tk8xfzIbQmEkZ2XePV9B8Y7+37 yk7gzh6PlqmxxKlYpNk1tWB7/q59PU+M3b35Hb1f7pOGtdKtYNORszl4O mwha2UuzOvVIzk/VsdnK0zw5W5OksDAwceRw9AL9Hhegm5mYwp1AJJwYD g==; X-IronPort-AV: E=McAfee;i="6500,9779,10624"; a="330690255" X-IronPort-AV: E=Sophos;i="5.97,306,1669104000"; d="scan'208";a="330690255" Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 17 Feb 2023 08:39:09 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6500,9779,10624"; a="844634257" X-IronPort-AV: E=Sophos;i="5.97,306,1669104000"; d="scan'208";a="844634257" Received: from fmsmsx603.amr.corp.intel.com ([10.18.126.83]) by orsmga005.jf.intel.com with ESMTP; 17 Feb 2023 08:39:08 -0800 Received: from fmsmsx602.amr.corp.intel.com (10.18.126.82) by fmsmsx603.amr.corp.intel.com (10.18.126.83) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16; Fri, 17 Feb 2023 08:39:08 -0800 Received: from FMSEDG603.ED.cps.intel.com (10.1.192.133) by fmsmsx602.amr.corp.intel.com (10.18.126.82) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.16 via Frontend Transport; Fri, 17 Feb 2023 08:39:08 -0800 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.174) by edgegateway.intel.com (192.55.55.68) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.16; Fri, 17 Feb 2023 08:39:01 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VZYFiUmWXKBqJSuOIb/HYOtZfT6pUQiRHsoyp6CFYI9knS7NoaotCR/CWorKblXGZVfFbwTmt7w6MHMEOZsBG81ONM2jSrrPE0Pyr+0R3tAe6wWQqYLpB5q+TDA/JKcm1xtiajopTR2qSsZnnH5Iiq7nmWaT/EFUufMUNOm05/GKX1VYrec3PFPKa22fq0dgiHNawzOh79ZRHekvnuFoPNgHvDxZHWKxpDDhUIXuL0nFsyq/M7W9buGTXGRXxWNOSsO561zgf/cat8t9G2DyzcN9ZabXGiog+IzcdiM2GQ3eKNgQv6HF3UQm7hdB5MT0Gn7/7bB6XvrjzoVZZLO4ZA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=qIyHjU8AMRuhWxp4aeVAiuQ1v3wN7k0kCOXl1T7+o10=; b=ARzn5zHaG64DwT7h9r/oThy0zRBhtQdvTBDszWdWAOs4aQcu+rZ2RaXrIDDy7xYaXy4Hp60Ov9zlp/ArOIaAS1Y4yknF/01S+AMf1XTqRbXr87ez7MDcVmtkMqWyRr6/010spOFYT9NbKrYzba3nV8aBFjGia4SaZ27g+YS41+zNhoeAlimbAhwwTACJbIr7RHh4zQm8aW/Qb/diapObeet96WSYXA8FRLmXa7SBC/vXrlzdbmPeU9eD7Ji34O48QHzXBd/7Uq7P+z9JAZMDsC3DARu7/9jP7dvZp2eQBQdS/4YJnY4GgZPWL3X+JKCzs9FMj4QJx2LRQLHKB/YZZg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by IA1PR11MB7869.namprd11.prod.outlook.com (2603:10b6:208:3f6::7) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.15; Fri, 17 Feb 2023 16:38:59 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::aaba:abb7:8794:def%9]) with mapi id 15.20.6111.013; Fri, 17 Feb 2023 16:38:59 +0000 Date: Fri, 17 Feb 2023 16:38:53 +0000 From: Bruce Richardson To: Rajasekhar Pulluru CC: , Subject: Re: Multiple Tx-Queues not working as expected Message-ID: References: <20230216115109.07067372@hermes.local> Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: LNXP265CA0052.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:5d::16) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|IA1PR11MB7869:EE_ X-MS-Office365-Filtering-Correlation-Id: 96a938f4-5a71-4544-58b9-08db11057821 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: v4Ett7rub2XcmTLn+MykaYtMLM/0kgT9E0ML1Hnlcqa32HxdRiCZCh4g8pEjIGx8Q0WC5avcGJ1C2LUN/XR2bC1RKuBBhMn2/bgw1sjFf35e1lXqrku9xxwelWUnym/UBRRdIuNuMr4687MofhbdJZHwtjYGOHyCF3Xdj2GKkD5OET21VMeoHd8ZkrN+N+QLWsaRq7ZepmIXUNZFBg+gfM0JFj86kISHw+wtUORj8WBbjLMcV/riBvZ8JM/y3P1iqVrZ47VVUwk0sfLVUlPlVkGzJHBY2wpi2EuViVCP6KwUf4aE+7P0GptNb00Dc3G9N4BDRIFH5+8vi0NcEj2qDIflHom5C8u4mFV6zS3RQf3KDOE0bzal1plYcMtwSUI5hqRvku2c4H5G7LxXuART92K9WpfzV2JmlWlHSeBRwmHJVUvQ9Hdc6els5cuIBYCafqeEmc23qqxPkcYxsvKMLsCaXhP0pRkwnJE47LROGfXCSIkStb5d+z4FDfN1CPela7wbHXE/V2gjufkmjA2uQAXs9CDIjltXZTvDcCD08X2BKOj//9SDbxXo4S/ngDupJISC9bl4fn/+lIEe1a8RAA6DLS5+AN2D2194a/047IT0YhP57DABg+zY5M+DzmdC X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230025)(39860400002)(346002)(396003)(376002)(136003)(366004)(451199018)(2906002)(8936002)(82960400001)(6506007)(38100700002)(6666004)(6512007)(26005)(186003)(316002)(478600001)(41300700001)(5660300002)(83380400001)(4326008)(86362001)(6916009)(66946007)(66476007)(66556008)(44832011)(8676002)(6486002)(966005); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?RecPI2XDGV292f6rKKNv2Dww+NCCUcSCLWEl1O2cPoWt4DyBrA7xk3j8DZ59?= =?us-ascii?Q?PfNLxKBsdnHl4DDqv7NPVG+1+EucXMlUG/ETE3YMbnwjg5E3ZoNxUxVNzWpc?= =?us-ascii?Q?RbKK8rgLI7A4n0NB3dpCL5hX55+tR2gvwcq46JWKo7KceHA2PnjqXOeqy/QA?= =?us-ascii?Q?8jq7Zjd3SqYzGqtwn7YbZVJ0oWSWkQTf00x3dWem0gSims3SNvCQQJM0Nqk7?= =?us-ascii?Q?L11D++SHAC6J8Wfq50RSOl2UKZ5NX5oe0VfXnPclbRzr9i1q/Jty1TYaAXlP?= =?us-ascii?Q?jhLO/nXEPy6Xg4+RlXWlLAvyXgC6AXV+lQ7d5yPFowEvsG4Ztbl7UqRunNF2?= =?us-ascii?Q?1YU4SXL2pnxmiUGk7kOT2Nqin58Drj2m6IE1M9diOAMKndbNZPGOtJb6sQKN?= =?us-ascii?Q?Cqgd8mvDRGb2IDKSxlYnaMCKsXlWX9WWdYdFCcsUJFjwcICWGsgGiFSWab2Y?= =?us-ascii?Q?r8RZbf4eGveGRU/YEijN6un+qZdYqvXvf8ST5pkdCe6NRJA2FfjSdZVZG1fm?= =?us-ascii?Q?jOGKb1AvN3NC3xxfX8IQ32MssXAc3T7iaOU+HXh02zC5TEPSQHwc+EDSRNqh?= =?us-ascii?Q?u8ltzLFdEaKqb2bkbys8ycJDQGGleR63wI80Dplgh6qzxXj03DmuHcZyUTn0?= =?us-ascii?Q?ioC4WocCnAF85r656I78V3OZ6Igo54B7Os6N3wGWjw9fq372AdgGm7qs9zkt?= =?us-ascii?Q?l+UN2Ew5O6LHPxQ90NqRDRAdVu10N57SjoEkYDu1wD9qgTSOgk3XXATa5g3O?= =?us-ascii?Q?HHp73jguK4Ftn1QovH8WcfTtXE2Ch5542//5aMALEixTQhECGnRLU/ltzn5s?= =?us-ascii?Q?ii+blU47Evurr3zlAhd3vKsEsN7uftpUb5nc9ouzmd1nnm4m3ROSxrK30gqp?= =?us-ascii?Q?Tz7wYwpDXsv0KhCv+KzdMwDPgxnBV0g+j/mLaglDHZ+BSEyHzax+mGy7axYW?= =?us-ascii?Q?HO7WSo2/tx2Ta2D/Eirm1I0P6FDn8A4PlahXY88Ou12sEkcT5gyl+VaddMHo?= =?us-ascii?Q?wCRiDonv96lPo0Y3qVB92KyzKfEoc3irKB5vvbZzAe5xxzp/KMstF5B44qAB?= =?us-ascii?Q?xGxX5vf+Dw4f2XGgJisjyHuyrPhUZzO3IvWHi7NukEpgxWk8KkXzu0T3AL10?= =?us-ascii?Q?bLz3Ip+YZvP6UeTXXKXi/+8/aE5qlulJGwLKl6yCfuRsyts7PbEg1c7SW/MN?= =?us-ascii?Q?1nUtI5p4sZWm9TucXN6LKk6iElG88Z1GwWICxdxjW4QJgEKqPgHsiUSfMo99?= =?us-ascii?Q?SAvR8y8m7H3uXQYy+fOP4AdEKwhSfvrhfbbfDdc2ASBqhu/VkBTyChdbjkjq?= =?us-ascii?Q?6934UIseJAdMerEt4nfWSzUF0nQl3yIw09/kYJylCZRqIW0N2giizmhHWV1f?= =?us-ascii?Q?0a+RkVgrorEGnPsqkDAwAuTiosAS01xZdTa6u3eBslDaPdvp1QALx3DWceiO?= =?us-ascii?Q?gfbnFNbGhl7nZxyOH6TsHnEuidl57KDyJgsWbrHCBDXcuMIfDFsvTeQj1hvj?= =?us-ascii?Q?cSHvb+D1cKkKlDTvJNkf5utdJ5v8w7eGg70kNECydsSvK7yZ9ZictGfL/i54?= =?us-ascii?Q?n5Qi/OUi9V1uAgCSzg6Ls++MotxZbG/z9tTHoXNfNGCyAXRIvE/WTZeY56gE?= =?us-ascii?Q?wQ=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: 96a938f4-5a71-4544-58b9-08db11057821 X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Feb 2023 16:38:59.3517 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: d0LZ9Q+mm8YbMiltr/jdrYEJWtgHQCiNwlbjsoB1WwJuSAjR5W+JjwPgSY3hTiZ9N+9uiPBjaMAelE9ojd9TTGZM4g+C4GJwf9GyYllWr5Q= X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB7869 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Fri, Feb 17, 2023 at 11:30:14AM +0530, Rajasekhar Pulluru wrote: > Ok Stephen, thanks for the information, I can try that. > One of the problems I see with single Tx Queue mode is that Ixia > reports packet drops, though I confirmed with the help of counters > (before invoking tx burst) that all packets are being sent-out. Dumping > HW counters don't report any drops in TX. > Is there a mechanism in DPDK to debug this? > Thanks & Regards, > Rajasekhar > Hi, so long as the packets are written successfully to the TX ring, they should be send out ok - unless the actual packets are some way invalid, e.g. undersized. Are the tx_burst calls reporting that all packets are getting written to the ring? All packets successfully written should be reported as received at the other end. In terms of the NIC TX stats, I'm not sure about for the ixgbe driver, but I think in some cases to get per-queue stats, you needed to set up a mapping of what queues you wanted to track stats for, as the NIC could only track a certain number of queues - fewer than that available in HW. See function [1]. For tracking transmits per queue, it's generally easier just to have the app track the successful enqueues to the ring. This is what testpmd does internally for queue stats, I believe (though for port stats it reads hardware). /Bruce [1] https://doc.dpdk.org/api/rte__ethdev_8h.html#a56fae7e398b289f795a1b6256149c4f3