From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 60BECA034F for ; Sat, 27 Feb 2021 08:54:22 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1A3CA1CC585; Sat, 27 Feb 2021 08:54:21 +0100 (CET) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on2139.outbound.protection.outlook.com [40.107.93.139]) by mails.dpdk.org (Postfix) with ESMTP id A94F14069B for ; Wed, 24 Feb 2021 14:24:39 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JNiTAMPRZAdSVg8Zz7KPifEf6+yYGNY11N8oMbvW5QNLuq71AjcmWek7/9vBHL3LZBlpxZto+TWoTuLuLZ09iOBqX9sD//IHBs6CAQ/lQcZpToTcdYUi6cwDJLv2ryLBeuRJGXgcHmYnd4MFBGU+WRank7rNG8Xi8hWe5cxhQTZmojtDNe3wEn9dw7kJWPYvx70qht6SpanHdr1iaidheiS6zJV8CWh+EGcZATwOQQR/d4xATDMNP72PL1+CBhQFjkXCGiA5n753Pz7Q6oZrL6yF+xTA/rqRX13AxVZb1xC5ayIXzeWtAKrakB57vRK/lomEF8VbqIqMORfuz+MC1w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=k85lOg1k20rYmL+w53GWjcM3ofanUdiPhrqK+eOQ5T4=; b=n3ITqNwsFjpE1hcl1mKJdtOR7Oy4UAbQUiUQapTJu5Mbhvh1z5Kwl1AbBLc6gnu3Mtvm87sS5Suw8MgDyjn7ZbjVtaB8kFE0ke/T+e7qNMBf5kVn1W6BptQWSKrBNWuiQRS6A7XnqQIXpj8u+ctX8U9oSf+SVHsJGyFR0P9Xgtf/aOrYHJkq5fGkKelvtGU4Jz8om+Nv8lMBfBSVh18CZTZA71gSHI4gwajVxfAph8rUSjwHfzIy9E6L8zSmLHoc7faFYMxQemx0+gcMUxwT+IAzi4ayHj6uQPhzdPTfVVgg8+A3GxAGPK8mR3QEe0HKoF3JwYEDQLit478B1x+cQw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=vectra.ai; dmarc=pass action=none header.from=vectra.ai; dkim=pass header.d=vectra.ai; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vectra.ai; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=k85lOg1k20rYmL+w53GWjcM3ofanUdiPhrqK+eOQ5T4=; b=nRswgTjzRXYssTtu3GVowHsgmmUGlhd6vi3irXMJAL42yrBRrynQO/un/b0je032OUx2GYwbd5inBBTYb8FjJGnCUj5aJ5ZXDiww0ADNHorO1KR6yv+N+C14+81MRGOoDm+Zwk7Oq3q6pOQLHPcs9TtYgJTLYAMTY9yaOkMmdyY= Received: from DM5PR08MB3434.namprd08.prod.outlook.com (2603:10b6:4:6c::21) by DM6PR08MB4859.namprd08.prod.outlook.com (2603:10b6:5:43::33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3846.34; Wed, 24 Feb 2021 13:24:37 +0000 Received: from DM5PR08MB3434.namprd08.prod.outlook.com ([fe80::5cde:29e6:6718:bab2]) by DM5PR08MB3434.namprd08.prod.outlook.com ([fe80::5cde:29e6:6718:bab2%5]) with mapi id 15.20.3868.032; Wed, 24 Feb 2021 13:24:37 +0000 From: Trevor Highland To: "users@dpdk.org" Thread-Topic: Ixgbe empty queue stats Thread-Index: AQHXCq6/PmM/zgAntEGQJ8zYXF3bTw== Date: Wed, 24 Feb 2021 13:24:37 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=vectra.ai; x-originating-ip: [74.201.86.232] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 6213efa1-ead3-4936-94fa-08d8d8c78862 x-ms-traffictypediagnostic: DM6PR08MB4859: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: Cg2VvctuxGDBHqZq36J+KBn6W1jRg5T+PcY2WC+jkEDwF7BlWDtqdk1THjbCyJH5+B7N8v8MpU7Dzjt9GbtE/rehwckGB5jCAbb0ZatZDcYPJvs5RGQ9/vLcJxbaX3PQnp1L3HfcNOPYLqed1vmjqV65St1Ke4JPtzocVXt5l6JP1gV+JH3gG/dCbjhhBTphsZFiAG9oLzasngbxfTSAe5utZ4pxdybXmpePiWgZraPiALFaWLTMoT8auHEhv9nzsJ+Mhjxfy8JlCIDnyTB0EpkpKz5SZ6sTIurNx0+F83bEb4Dr+bGfrLCqx5VDa9N+Vt79uk2/M66cIHB3vZD/LORpOjTjmLYbmtnLZBClzAVvEP288uSVKOzFEMOkubKeYbUVmDZhlzL5mG9cClJJS2ij2jwhaaUYUtPFg8xSiP0BAvCceGIfV8UwcitYewtsbYRZsI6mK59QGV6l8XnGTYHNVDGf3EOQmt/H4SLIYMEdD7LpakFZg3YBUReVfkl3y8lR02QEHeIWGsI+/Yl9KA== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM5PR08MB3434.namprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(39850400004)(136003)(396003)(346002)(366004)(376002)(7696005)(6506007)(9686003)(55016002)(66476007)(66446008)(83380400001)(478600001)(33656002)(26005)(3480700007)(55236004)(316002)(186003)(71200400001)(52536014)(2906002)(5660300002)(6916009)(8676002)(91956017)(8936002)(66556008)(86362001)(76116006)(66946007)(64756008); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: =?Windows-1252?Q?kvAy5uiq+ea/bWnzaJmsrirf464LjzhD8guM4ed/rddJIu3gKbpG/3SE?= =?Windows-1252?Q?jHrkuBAqO9kEfJOKUffy3Kw5Ui9ImW5HR5/gIUTdrPOr8hn1ybs96vxA?= =?Windows-1252?Q?rcsMDtL0V4EsL1AGdtWiPs5NN6Cx2wFQpT6jAUNVd74+BrH2fEAs7TO3?= =?Windows-1252?Q?3RVK7+kjSd1pdQY6UNplau0M6LlmS33vk2sPLki6i3+Qz/s3yVX2OCsM?= =?Windows-1252?Q?Frd/OcwNkHQid4YMA9ySyed3Vod3ROo97svtAqHXIEa9jjbsyzOAMQst?= =?Windows-1252?Q?7pojpQape7BLJtEfws/2zl+hzOn734oK5Bht51KWk4qYSUF3HljbY6xY?= =?Windows-1252?Q?q8TbVWmTdxLaR49K57rP/ReCs0NOS2LD2AOkdddwQpGuUyox8IIbWSqC?= =?Windows-1252?Q?Hd0Wm5hrpqWL15NbVB2kohZqXbVzeYFsyufhivkndf1HCL1LorkO4Lnq?= =?Windows-1252?Q?pIWVbohFYKVZtQuapozRvAJU0f4b0JeN1otn4uNl60l/2wYXlOqJU3X3?= =?Windows-1252?Q?FkZpNfjVIX9WuCQLk9IsAe13zMuCW/qIur/+8mtzCiOQObYkMBHvf7JC?= =?Windows-1252?Q?fGlo24ADrh854pMWUUr1InesE9wAgQa/r7dP0awkH+q9eEGLV7bq0rZP?= =?Windows-1252?Q?8mw5zc/6Ew8U9GFhnvu7rYwbwkx4P6+lcTp7Ypu5rro07rvzXJ3/Yvfa?= =?Windows-1252?Q?voXXX6IbuN/1t4j0eEZa7g+YSQ8s6xN6rqagEWu1bWt6xZyNRfUgE4TX?= =?Windows-1252?Q?FTBQfQ/fo1ACmeVdrgn0ZmosNljFI5Xdh9iY9fPAJg9RBQ9P3Fx00gzu?= =?Windows-1252?Q?63KaS/Pvqqeunga74lUNYgTPkDK6e29+V7NMnCgy3qqU+IYL2Gm3tgvG?= =?Windows-1252?Q?mCTRkagGca1XxPm7CjGe6SOoH2BN3iEGr0Bq/iWEK+Zz3hdX78g9rdc9?= =?Windows-1252?Q?vI40R/HuQtjfUgWn/mHOEXOWmMCp2c31nkkLP045TBFFQ256HKuzljta?= =?Windows-1252?Q?nTyQgT+BC6cnx+lbk5a4Bpzt64h+FNPc78kzusK8j/AlLKMlkZMoMAbF?= =?Windows-1252?Q?e9dzOOdj+gJMu9iyzMnQjFahhQ3aMCUcDKNaYYb9EQ/acEQEJYBb9G/B?= =?Windows-1252?Q?pwrWvI1LlLJQG9Onn4yYbj10P1noQX32/f1DMmeNjO3UproDDKBQnrPl?= =?Windows-1252?Q?QbPO9MB42HMlPgvySGq/DSx4GhU9wGfe5G+XAXZdUp+5sqhsQOr0duqW?= =?Windows-1252?Q?INRzFHQB1vLzLRkqzPWM5m5z8tAjovfzMjep91iT3sCBbO0O4a3JH2Z1?= =?Windows-1252?Q?hZ5mrwTPvQLawoaT8giDrsPKOFLPBp49dny0MVOgQ2ytk9nWK4+3t6aY?= =?Windows-1252?Q?FWplWRshGze+gf9OCpMiIuX9QRLCgyDl/yBQFpeZ/A6S3LP99IUmq1Ja?= =?Windows-1252?Q?D9cide12LkzNqiJgN4X/xg=3D=3D?= x-ms-exchange-transport-forked: True MIME-Version: 1.0 X-OriginatorOrg: vectra.ai X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM5PR08MB3434.namprd08.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6213efa1-ead3-4936-94fa-08d8d8c78862 X-MS-Exchange-CrossTenant-originalarrivaltime: 24 Feb 2021 13:24:37.0459 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a6cc66bc-f419-45c2-a9c2-8ff4ab685f2d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: mq1NG07Mz/mn1VDcJNYztGbQ0xuFRnzXCz/7wB2mawjTt1hDJ2GOhaEPxm3gFwkt X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR08MB4859 X-Mailman-Approved-At: Sat, 27 Feb 2021 08:54:19 +0100 Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: [dpdk-users] Ixgbe empty queue stats X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi all, We have a DPDK application that=92s running using 82599 NICs with the ixgbe= driver. Our application makes use of RSS and runs with 8 or 16 queues depe= nding on the environment. I was reviewing xstats from a DPDK application th= at we run, and found that =91rx_qN_packets=92 was 0 for all queues except q= ueue 0. I was able to reproduce this using dpdk-testpmd from the 20.11 release. Add= itionally I used the ethregs tool and confirmed that the registers are inde= ed 0. Is this expected behavior, and is there a proper way to get per queue= packet counts from hardware registers? ./dpdk-testpmd -l 0-8 -n 4 -m5120,5120 -- -i --forward-mode=3Drxonly --rxq= =3D2 --txq=3D2 --portmask=3D0xc --rxd=3D65536 --nb-cores=3D8 --rss-ip I then run =91start=92 Truncated uput from =91show port xstats all=92 ###### NIC extended statistics for port 2 rx_good_packets: 480147 tx_good_packets: 0 rx_good_bytes: 558567639 tx_good_bytes: 0 rx_missed_errors: 602293 rx_errors: 0 tx_errors: 0 rx_mbuf_allocation_errors: 0 rx_q0_packets: 480147 rx_q0_bytes: 558567639 rx_q0_errors: 0 rx_q1_packets: 0 ###### NIC extended statistics for port 3 rx_good_packets: 419519 tx_good_packets: 0 rx_good_bytes: 438407091 tx_good_bytes: 0 rx_missed_errors: 441020 rx_errors: 0 tx_errors: 0 rx_mbuf_allocation_errors: 0 rx_q0_packets: 419519 rx_q0_bytes: 438407091 rx_q0_errors: 0 rx_q1_packets: 0 rx_q1_bytes: 0 rx_q1_errors: 0 Output at shutdown which shows both queues servicing packets ------- Forward Stats for RX Port=3D 2/Queue=3D 0 -> TX Port=3D 3/Queue= =3D 0 ------- RX-packets: 116794 TX-packets: 0 TX-dropped: 0 ------- Forward Stats for RX Port=3D 3/Queue=3D 0 -> TX Port=3D 2/Queue= =3D 0 ------- RX-packets: 156055 TX-packets: 0 TX-dropped: 0 ------- Forward Stats for RX Port=3D 2/Queue=3D 1 -> TX Port=3D 3/Queue= =3D 1 ------- RX-packets: 607297 TX-packets: 0 TX-dropped: 0 ------- Forward Stats for RX Port=3D 3/Queue=3D 1 -> TX Port=3D 2/Queue= =3D 1 ------- RX-packets: 451971 TX-packets: 0 TX-dropped: 0 ---------------------- Forward statistics for port 2 -------------------= --- RX-packets: 724010 RX-dropped: 0 RX-total: 724010 TX-packets: 0 TX-dropped: 0 TX-total: 0 -------------------------------------------------------------------------= --- ---------------------- Forward statistics for port 3 -------------------= --- RX-packets: 607924 RX-dropped: 0 RX-total: 607924 TX-packets: 0 TX-dropped: 0 TX-total: 0 -------------------------------------------------------------------------= --- +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++= ++ RX-packets: 1331934 RX-dropped: 0 RX-total: 1331934 TX-packets: 0 TX-dropped: 0 TX-total: 0 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++ Thanks, Trevor