From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR02-VE1-obe.outbound.protection.outlook.com (mail-eopbgr20117.outbound.protection.outlook.com [40.107.2.117]) by dpdk.org (Postfix) with ESMTP id 6095C2E8B for ; Tue, 11 Jul 2017 18:41:42 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Asocs.onmicrosoft.com; s=selector1-asocsnetworks-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=uQI+nVf70+h4PzLZfuTMefQNBR7PfAHrR/x23t1jFpI=; b=aYnwq83hH1xWkR1TJ8qqp4gfcYLNvC3xTLaMqceZXUnrEAbWu0LE6SDA2qMlZ2iCijE6JE17VJljIzfc+r7EGbD6JfZ/lQvbsVxLNlgNOgq/u3D1vpuCbu7I9pVBc/2osPnS3SNDMpz5tfwhv4zudJs4EJP82Wg6GlHQK9nsDOM= Received: from AM3PR06MB084.eurprd06.prod.outlook.com (10.242.245.152) by AM3PR06MB082.eurprd06.prod.outlook.com (10.242.245.144) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1240.13; Tue, 11 Jul 2017 16:41:39 +0000 Received: from AM3PR06MB084.eurprd06.prod.outlook.com ([fe80::8c49:b357:eb16:f3b5]) by AM3PR06MB084.eurprd06.prod.outlook.com ([fe80::8c49:b357:eb16:f3b5%16]) with mapi id 15.01.1240.020; Tue, 11 Jul 2017 16:41:39 +0000 From: Yan Fridland To: "dev@dpdk.org" Thread-Topic: [dpdk-dev]: rx_no_dma_resources starts climbing on Intel 82599 SR-IOV ports Thread-Index: AdL6Y7cLNVQ26TFBRp2L/+VIoAlkBw== Date: Tue, 11 Jul 2017 16:41:39 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none; dpdk.org; dmarc=none action=none header.from=asocsnetworks.com; x-originating-ip: [31.154.47.194] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; AM3PR06MB082; 7:u63/XatoKJst4Thva3fSkVEeCvCap253aswSWXKRXHyWnJTMREMyoz/MCqhaobSJju3620WF0ZQl2xDxm6nwnCbtu97i+7EhkYwpdQCZ8x/wge/QQKJRMd1RyndxqIMhVSmOGOzl7xgjZ/fxxpHZNrxvXU8K0rS193pNg1NgdHjDFr3rxWrOgDStEeWOokTEeHMv/T+DUJu1q824szqbCSOPT8H2cT0Sh3oiEAD8s5dRb9eqtXHVv26nGcyHCr3uene0qCodZpbyIQ5l47Vx8SldiTsqvQitlsfQn+t5hHCwGcM/QGz/xgD7tzgbatcMQmzYaSrx6Rrc+cux89z7gsj77auD2YQsmblR7DeVmlwksCstZa7ruhe/QKMRqiwmhMv7CDZL1u+1Ajy9LimCPxBKnxgWYhWDykSuetoQi7cuKnrJc8BlUHKffUu43mx1ZrmmfhKn/9fod9/e1Q+zaOtDT+AUwTQt8FgMQP9kMGWvYYborA9dGTe6BN1pXZFil+/0wnbg/A6vEnijNGBRFmJ+ZGKkzLSzT3xB7Zi21d9ci2p1qasuMnYbqm1HoXkJcvlBxYZNVJxQgDTjMOlsDw+OsPUWwwGCVf7FgC1duU92mmmqzCI/ZqOhz9m+tjsUNUYSYIVpl4pqfH4dV7F1PIqEMhb3pFgL3QcyWSEZ6wZ+07ul006GJoGGeuMMPhM35I7xBPPqdImA0MWvAG67BBx6N8ykhLRDU292f+qadZwWNA6hv/d5DpdBGEBcmS3Y7m8SSLP7egBHAuxLP9SBQjeR6toOLmZW1HspHYJ45GU= x-ms-office365-filtering-correlation-id: 16e5eeed-20e7-4f01-aa66-08d4c87bb455 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254075)(300000503095)(300135400095)(2017052603031)(201703131423075)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:AM3PR06MB082; x-ms-traffictypediagnostic: AM3PR06MB082: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(151999592597050)(278428928389397)(26388249023172)(236129657087228)(148574349560750)(21748063052155)(247924648384137); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(5005006)(8121501046)(2017060910075)(93006095)(93001095)(100000703101)(100105400095)(3002001)(10201501046)(6041248)(20161123562025)(20161123555025)(20161123558100)(20161123560025)(2016111802025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123564025)(6043046)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:AM3PR06MB082; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:AM3PR06MB082; x-forefront-prvs: 0365C0E14B x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(6009001)(39410400002)(39400400002)(39840400002)(39450400003)(53754006)(86362001)(7736002)(9686003)(2900100001)(5660300001)(6506006)(66066001)(6916009)(5640700003)(6306002)(55016002)(14454004)(1730700003)(38730400002)(8676002)(99286003)(110136004)(7696004)(81166006)(189998001)(478600001)(53936002)(9326002)(8936002)(54896002)(50986999)(3660700001)(3280700002)(54356999)(6116002)(102836003)(3846002)(790700001)(2351001)(25786009)(74316002)(2906002)(6436002)(33656002)(5250100002)(5630700001)(2501003); DIR:OUT; SFP:1102; SCL:1; SRVR:AM3PR06MB082; H:AM3PR06MB084.eurprd06.prod.outlook.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: asocsnetworks.com X-MS-Exchange-CrossTenant-originalarrivaltime: 11 Jul 2017 16:41:39.5327 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 09a71e5b-e130-419f-bde2-1e8422f00aaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM3PR06MB082 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] : rx_no_dma_resources starts climbing on Intel 82599 SR-IOV ports X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Jul 2017 16:41:42 -0000 Hello All, Perhaps you can shade some light on an interesting problem we have. I am working with Intel 82599 NICs in a SR-IOV mode. After several hours of= running traffic we checked port statistics on a host and saw that the coun= ter rx_no_dma_resources began climbing on some ports. At that exact time the VM applications connected to that ports showed packe= t loss and crashed. First question, do you have a clue what is it related to? (I run the same a= pplication on all ports but not all of them experience such thing) After digging a bit I saw that the RX descriptors ring size on the host por= ts was defined to 256 out of 4096 possible (I used ehttool -G). I know that= in DPDK I define each port's RX queue to be 256 descriptors, but this is d= one per VM port which means per VF of the physical NIC. * Do you know what is the relationship, if any, between the number of d= escriptors defined in DPDK per VM port (VF on host) using rte_eth_rx_queue_= setup () and the number of descriptors defined on Host per physical port (u= sing ethtool -g rx ) ? Seems to me that they don't effect one another but perhaps I am wrong. Thanks, Yan