From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 8779941CC1;
	Fri, 17 Feb 2023 17:39:12 +0100 (CET)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 4F29940F18;
	Fri, 17 Feb 2023 17:39:12 +0100 (CET)
Received: from mga04.intel.com (mga04.intel.com [192.55.52.120])
 by mails.dpdk.org (Postfix) with ESMTP id AFB6140EE3
 for <dev@dpdk.org>; Fri, 17 Feb 2023 17:39:10 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;
 d=intel.com; i=@intel.com; q=dns/txt; s=Intel;
 t=1676651951; x=1708187951;
 h=date:from:to:cc:subject:message-id:references:
 in-reply-to:mime-version;
 bh=wxkozx30VzTz9pHPuClNB0REcpYHL9A0IZiTXW7l1eY=;
 b=fjMGSxfljj5+Dgj+YbbVLfdRf1Q1uQyqzctskRhpXnTYuT7pf1PxVg4B
 Kg8cKWf+JZgDnASAJTKIL4PhorR0zd1MyYRZ8Upm1CjFzmEmsB/y9CkaP
 0KdplIIszpJtxlsYcEK8PwuoWPfnAgxi/TLbAvvz+taexwNw0tHwYLgA5
 DHDZ4u2mVaLx44w9Kt5nTsy4Ha/a/a+Tk8xfzIbQmEkZ2XePV9B8Y7+37
 yk7gzh6PlqmxxKlYpNk1tWB7/q59PU+M3b35Hb1f7pOGtdKtYNORszl4O
 mwha2UuzOvVIzk/VsdnK0zw5W5OksDAwceRw9AL9Hhegm5mYwp1AJJwYD g==;
X-IronPort-AV: E=McAfee;i="6500,9779,10624"; a="330690255"
X-IronPort-AV: E=Sophos;i="5.97,306,1669104000"; d="scan'208";a="330690255"
Received: from orsmga005.jf.intel.com ([10.7.209.41])
 by fmsmga104.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;
 17 Feb 2023 08:39:09 -0800
X-ExtLoop1: 1
X-IronPort-AV: E=McAfee;i="6500,9779,10624"; a="844634257"
X-IronPort-AV: E=Sophos;i="5.97,306,1669104000"; d="scan'208";a="844634257"
Received: from fmsmsx603.amr.corp.intel.com ([10.18.126.83])
 by orsmga005.jf.intel.com with ESMTP; 17 Feb 2023 08:39:08 -0800
Received: from fmsmsx602.amr.corp.intel.com (10.18.126.82) by
 fmsmsx603.amr.corp.intel.com (10.18.126.83) with Microsoft SMTP Server
 (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id
 15.1.2507.16; Fri, 17 Feb 2023 08:39:08 -0800
Received: from FMSEDG603.ED.cps.intel.com (10.1.192.133) by
 fmsmsx602.amr.corp.intel.com (10.18.126.82) with Microsoft SMTP Server
 (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id
 15.1.2507.16 via Frontend Transport; Fri, 17 Feb 2023 08:39:08 -0800
Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.174)
 by edgegateway.intel.com (192.55.55.68) with Microsoft SMTP Server
 (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.1.2507.16; Fri, 17 Feb 2023 08:39:01 -0800
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=VZYFiUmWXKBqJSuOIb/HYOtZfT6pUQiRHsoyp6CFYI9knS7NoaotCR/CWorKblXGZVfFbwTmt7w6MHMEOZsBG81ONM2jSrrPE0Pyr+0R3tAe6wWQqYLpB5q+TDA/JKcm1xtiajopTR2qSsZnnH5Iiq7nmWaT/EFUufMUNOm05/GKX1VYrec3PFPKa22fq0dgiHNawzOh79ZRHekvnuFoPNgHvDxZHWKxpDDhUIXuL0nFsyq/M7W9buGTXGRXxWNOSsO561zgf/cat8t9G2DyzcN9ZabXGiog+IzcdiM2GQ3eKNgQv6HF3UQm7hdB5MT0Gn7/7bB6XvrjzoVZZLO4ZA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; 
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1;
 bh=qIyHjU8AMRuhWxp4aeVAiuQ1v3wN7k0kCOXl1T7+o10=;
 b=ARzn5zHaG64DwT7h9r/oThy0zRBhtQdvTBDszWdWAOs4aQcu+rZ2RaXrIDDy7xYaXy4Hp60Ov9zlp/ArOIaAS1Y4yknF/01S+AMf1XTqRbXr87ez7MDcVmtkMqWyRr6/010spOFYT9NbKrYzba3nV8aBFjGia4SaZ27g+YS41+zNhoeAlimbAhwwTACJbIr7RHh4zQm8aW/Qb/diapObeet96WSYXA8FRLmXa7SBC/vXrlzdbmPeU9eD7Ji34O48QHzXBd/7Uq7P+z9JAZMDsC3DARu7/9jP7dvZp2eQBQdS/4YJnY4GgZPWL3X+JKCzs9FMj4QJx2LRQLHKB/YZZg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com;
 dkim=pass header.d=intel.com; arc=none
Authentication-Results: dkim=none (message not signed)
 header.d=none;dmarc=none action=none header.from=intel.com;
Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17)
 by IA1PR11MB7869.namprd11.prod.outlook.com (2603:10b6:208:3f6::7) with
 Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.15; Fri, 17 Feb
 2023 16:38:59 +0000
Received: from DS0PR11MB7309.namprd11.prod.outlook.com
 ([fe80::aaba:abb7:8794:def]) by DS0PR11MB7309.namprd11.prod.outlook.com
 ([fe80::aaba:abb7:8794:def%9]) with mapi id 15.20.6111.013; Fri, 17 Feb 2023
 16:38:59 +0000
Date: Fri, 17 Feb 2023 16:38:53 +0000
From: Bruce Richardson <bruce.richardson@intel.com>
To: Rajasekhar Pulluru <pullururajasekhar@gmail.com>
CC: <stephen@networkplumber.org>, <dev@dpdk.org>
Subject: Re: Multiple Tx-Queues not working as expected
Message-ID: <Y++tnaP05hR09Dld@bricha3-MOBL.ger.corp.intel.com>
References: <CAGA5_H7TO_ioqKkCpsZy=674yET=6O5K-AW9Jw0vijqB5HH24w@mail.gmail.com>
 <20230216115109.07067372@hermes.local>
 <CAGA5_H6kg-6tZozY5hKL8sFBJNrKGd2kTxAdDXitUGcHcFuA6w@mail.gmail.com>
Content-Type: text/plain; charset="us-ascii"
Content-Disposition: inline
In-Reply-To: <CAGA5_H6kg-6tZozY5hKL8sFBJNrKGd2kTxAdDXitUGcHcFuA6w@mail.gmail.com>
X-ClientProxiedBy: LNXP265CA0052.GBRP265.PROD.OUTLOOK.COM
 (2603:10a6:600:5d::16) To DS0PR11MB7309.namprd11.prod.outlook.com
 (2603:10b6:8:13e::17)
MIME-Version: 1.0
X-MS-PublicTrafficType: Email
X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|IA1PR11MB7869:EE_
X-MS-Office365-Filtering-Correlation-Id: 96a938f4-5a71-4544-58b9-08db11057821
X-MS-Exchange-SenderADCheck: 1
X-MS-Exchange-AntiSpam-Relay: 0
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: v4Ett7rub2XcmTLn+MykaYtMLM/0kgT9E0ML1Hnlcqa32HxdRiCZCh4g8pEjIGx8Q0WC5avcGJ1C2LUN/XR2bC1RKuBBhMn2/bgw1sjFf35e1lXqrku9xxwelWUnym/UBRRdIuNuMr4687MofhbdJZHwtjYGOHyCF3Xdj2GKkD5OET21VMeoHd8ZkrN+N+QLWsaRq7ZepmIXUNZFBg+gfM0JFj86kISHw+wtUORj8WBbjLMcV/riBvZ8JM/y3P1iqVrZ47VVUwk0sfLVUlPlVkGzJHBY2wpi2EuViVCP6KwUf4aE+7P0GptNb00Dc3G9N4BDRIFH5+8vi0NcEj2qDIflHom5C8u4mFV6zS3RQf3KDOE0bzal1plYcMtwSUI5hqRvku2c4H5G7LxXuART92K9WpfzV2JmlWlHSeBRwmHJVUvQ9Hdc6els5cuIBYCafqeEmc23qqxPkcYxsvKMLsCaXhP0pRkwnJE47LROGfXCSIkStb5d+z4FDfN1CPela7wbHXE/V2gjufkmjA2uQAXs9CDIjltXZTvDcCD08X2BKOj//9SDbxXo4S/ngDupJISC9bl4fn/+lIEe1a8RAA6DLS5+AN2D2194a/047IT0YhP57DABg+zY5M+DzmdC
X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:;
 IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE;
 SFS:(13230025)(39860400002)(346002)(396003)(376002)(136003)(366004)(451199018)(2906002)(8936002)(82960400001)(6506007)(38100700002)(6666004)(6512007)(26005)(186003)(316002)(478600001)(41300700001)(5660300002)(83380400001)(4326008)(86362001)(6916009)(66946007)(66476007)(66556008)(44832011)(8676002)(6486002)(966005);
 DIR:OUT; SFP:1102; 
X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1
X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?RecPI2XDGV292f6rKKNv2Dww+NCCUcSCLWEl1O2cPoWt4DyBrA7xk3j8DZ59?=
 =?us-ascii?Q?PfNLxKBsdnHl4DDqv7NPVG+1+EucXMlUG/ETE3YMbnwjg5E3ZoNxUxVNzWpc?=
 =?us-ascii?Q?RbKK8rgLI7A4n0NB3dpCL5hX55+tR2gvwcq46JWKo7KceHA2PnjqXOeqy/QA?=
 =?us-ascii?Q?8jq7Zjd3SqYzGqtwn7YbZVJ0oWSWkQTf00x3dWem0gSims3SNvCQQJM0Nqk7?=
 =?us-ascii?Q?L11D++SHAC6J8Wfq50RSOl2UKZ5NX5oe0VfXnPclbRzr9i1q/Jty1TYaAXlP?=
 =?us-ascii?Q?jhLO/nXEPy6Xg4+RlXWlLAvyXgC6AXV+lQ7d5yPFowEvsG4Ztbl7UqRunNF2?=
 =?us-ascii?Q?1YU4SXL2pnxmiUGk7kOT2Nqin58Drj2m6IE1M9diOAMKndbNZPGOtJb6sQKN?=
 =?us-ascii?Q?Cqgd8mvDRGb2IDKSxlYnaMCKsXlWX9WWdYdFCcsUJFjwcICWGsgGiFSWab2Y?=
 =?us-ascii?Q?r8RZbf4eGveGRU/YEijN6un+qZdYqvXvf8ST5pkdCe6NRJA2FfjSdZVZG1fm?=
 =?us-ascii?Q?jOGKb1AvN3NC3xxfX8IQ32MssXAc3T7iaOU+HXh02zC5TEPSQHwc+EDSRNqh?=
 =?us-ascii?Q?u8ltzLFdEaKqb2bkbys8ycJDQGGleR63wI80Dplgh6qzxXj03DmuHcZyUTn0?=
 =?us-ascii?Q?ioC4WocCnAF85r656I78V3OZ6Igo54B7Os6N3wGWjw9fq372AdgGm7qs9zkt?=
 =?us-ascii?Q?l+UN2Ew5O6LHPxQ90NqRDRAdVu10N57SjoEkYDu1wD9qgTSOgk3XXATa5g3O?=
 =?us-ascii?Q?HHp73jguK4Ftn1QovH8WcfTtXE2Ch5542//5aMALEixTQhECGnRLU/ltzn5s?=
 =?us-ascii?Q?ii+blU47Evurr3zlAhd3vKsEsN7uftpUb5nc9ouzmd1nnm4m3ROSxrK30gqp?=
 =?us-ascii?Q?Tz7wYwpDXsv0KhCv+KzdMwDPgxnBV0g+j/mLaglDHZ+BSEyHzax+mGy7axYW?=
 =?us-ascii?Q?HO7WSo2/tx2Ta2D/Eirm1I0P6FDn8A4PlahXY88Ou12sEkcT5gyl+VaddMHo?=
 =?us-ascii?Q?wCRiDonv96lPo0Y3qVB92KyzKfEoc3irKB5vvbZzAe5xxzp/KMstF5B44qAB?=
 =?us-ascii?Q?xGxX5vf+Dw4f2XGgJisjyHuyrPhUZzO3IvWHi7NukEpgxWk8KkXzu0T3AL10?=
 =?us-ascii?Q?bLz3Ip+YZvP6UeTXXKXi/+8/aE5qlulJGwLKl6yCfuRsyts7PbEg1c7SW/MN?=
 =?us-ascii?Q?1nUtI5p4sZWm9TucXN6LKk6iElG88Z1GwWICxdxjW4QJgEKqPgHsiUSfMo99?=
 =?us-ascii?Q?SAvR8y8m7H3uXQYy+fOP4AdEKwhSfvrhfbbfDdc2ASBqhu/VkBTyChdbjkjq?=
 =?us-ascii?Q?6934UIseJAdMerEt4nfWSzUF0nQl3yIw09/kYJylCZRqIW0N2giizmhHWV1f?=
 =?us-ascii?Q?0a+RkVgrorEGnPsqkDAwAuTiosAS01xZdTa6u3eBslDaPdvp1QALx3DWceiO?=
 =?us-ascii?Q?gfbnFNbGhl7nZxyOH6TsHnEuidl57KDyJgsWbrHCBDXcuMIfDFsvTeQj1hvj?=
 =?us-ascii?Q?cSHvb+D1cKkKlDTvJNkf5utdJ5v8w7eGg70kNECydsSvK7yZ9ZictGfL/i54?=
 =?us-ascii?Q?n5Qi/OUi9V1uAgCSzg6Ls++MotxZbG/z9tTHoXNfNGCyAXRIvE/WTZeY56gE?=
 =?us-ascii?Q?wQ=3D=3D?=
X-MS-Exchange-CrossTenant-Network-Message-Id: 96a938f4-5a71-4544-58b9-08db11057821
X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Feb 2023 16:38:59.3517 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: d0LZ9Q+mm8YbMiltr/jdrYEJWtgHQCiNwlbjsoB1WwJuSAjR5W+JjwPgSY3hTiZ9N+9uiPBjaMAelE9ojd9TTGZM4g+C4GJwf9GyYllWr5Q=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB7869
X-OriginatorOrg: intel.com
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

On Fri, Feb 17, 2023 at 11:30:14AM +0530, Rajasekhar Pulluru wrote:
>    Ok Stephen, thanks for the information, I can try that.
>    One of the problems I see with single Tx Queue mode is that Ixia
>    reports packet drops, though I confirmed with the help of counters
>    (before invoking tx burst) that all packets are being sent-out. Dumping
>    HW counters don't report any drops in TX.
>    Is there a mechanism in DPDK to debug this?
>    Thanks & Regards,
>    Rajasekhar
> 
Hi,

so long as the packets are written successfully to the TX ring, they should
be send out ok - unless the actual packets are some way invalid, e.g.
undersized. Are the tx_burst calls reporting that all packets are getting
written to the ring?  All packets successfully written should be reported
as received at the other end.

In terms of the NIC TX stats, I'm not sure about for the ixgbe driver, but
I think in some cases to get per-queue stats, you needed to set up a
mapping of what queues you wanted to track stats for, as the NIC could only
track a certain number of queues - fewer than that available in HW.  See
function [1]. For tracking transmits per queue, it's generally easier just
to have the app track the successful enqueues to the ring. This is what
testpmd does internally for queue stats, I believe (though for port stats
it reads hardware).

/Bruce

[1] https://doc.dpdk.org/api/rte__ethdev_8h.html#a56fae7e398b289f795a1b6256149c4f3