From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id B6548326C for ; Thu, 6 Sep 2018 19:49:14 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga004.fm.intel.com ([10.253.24.48]) by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 06 Sep 2018 10:49:13 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.53,339,1531810800"; d="scan'208";a="86606437" Received: from fmsmsx106.amr.corp.intel.com ([10.18.124.204]) by fmsmga004.fm.intel.com with ESMTP; 06 Sep 2018 10:48:29 -0700 Received: from fmsmsx117.amr.corp.intel.com ([169.254.3.210]) by FMSMSX106.amr.corp.intel.com ([169.254.5.70]) with mapi id 14.03.0319.002; Thu, 6 Sep 2018 10:48:29 -0700 From: "Wiles, Keith" To: Saber Rezvani CC: Stephen Hemminger , "dev@dpdk.org" Thread-Topic: [dpdk-dev] IXGBE throughput loss with 4+ cores Thread-Index: AQHURahgsAGNXlIAaE6PBOCQfwUlW6Tj/amA Date: Thu, 6 Sep 2018 17:48:28 +0000 Message-ID: <13D8BECB-09AF-4260-B501-7A6FC3AC6187@intel.com> References: <165ad80b137.e083efff311035.3287926262954203334@zoho.com> In-Reply-To: <165ad80b137.e083efff311035.3287926262954203334@zoho.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.252.5.98] Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 MIME-Version: 1.0 Subject: Re: [dpdk-dev] IXGBE throughput loss with 4+ cores X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Sep 2018 17:49:15 -0000 DQoNCj4gT24gU2VwIDYsIDIwMTgsIGF0IDc6MTAgQU0sIFNhYmVyIFJlenZhbmkgPGlyc2FiZXJA em9oby5jb20+IHdyb3RlOg0KPiANCj4gDQo+IA0KPiBPbiAwOC8yOS8yMDE4IDExOjIyIFBNLCBX aWxlcywgS2VpdGggd3JvdGU6IA0KPiA+IA0KPiA+PiBPbiBBdWcgMjksIDIwMTgsIGF0IDEyOjE5 IFBNLCBTYWJlciBSZXp2YW5pIDxpcnNhYmVyQHpvaG8uY29tPiB3cm90ZTogDQo+ID4+IA0KPiA+ PiANCj4gPj4gDQo+ID4+IE9uIDA4LzI5LzIwMTggMDE6MzkgQU0sIFdpbGVzLCBLZWl0aCB3cm90 ZTogDQo+ID4+Pj4gT24gQXVnIDI4LCAyMDE4LCBhdCAyOjE2IFBNLCBTYWJlciBSZXp2YW5pIDxp cnNhYmVyQHpvaG8uY29tPiB3cm90ZTogDQo+ID4+Pj4gDQo+ID4+Pj4gDQo+ID4+Pj4gDQo+ID4+ Pj4gT24gMDgvMjgvMjAxOCAxMTozOSBQTSwgV2lsZXMsIEtlaXRoIHdyb3RlOiANCj4gPj4+Pj4g V2hpY2ggdmVyc2lvbiBvZiBQa3RnZW4/IEkganVzdCBwdXNoZWQgYSBwYXRjaCBpbiAzLjUuMyB0 byBmaXggYSBwZXJmb3JtYW5jZSBwcm9ibGVtLiANCj4gPj4+PiBJIHVzZSBQa3RnZW4gdmVyaW9u IDMuMC4wLCBpbmRlZWQgaXQgaXMgTy5rIGFzIGZhciBhcyBJIGhhdmUgb25lIGNvcmUuICgxMCBH Yi9zKSBidXQgd2hlbiBJIGluY3JlYXNlIHRoZSBudW1iZXIgb2YgY29yZSAob25lIGNvcmUgcGVy IHF1ZXVlKSB0aGVuIEkgbG9vc2Ugc29tZSBwZXJmb3JtYW5jZSAocm91Z2hseSA4LjUgR2IvcyBm b3IgOC1jb3JlKS4gSW4gbXkgc2NlbmFyaW8gUGt0Z2VuIHNob3dzIGl0IGlzIGdlbmVyYXRpbmcg YXQgbGluZSByYXRlLCBidXQgcmVjZWl2aW5nIDguNSBHYi9zLiANCj4gPj4+PiBJcyBpdCBiZWNh dXNlIG9mIFBrdGdlbj8/PyANCj4gPj4+IE5vcm1hbGx5IFBrdGdlbiBjYW4gcmVjZWl2ZSBhdCBs aW5lIHJhdGUgdXAgdG8gMTBHIDY0IGJ5dGUgZnJhbWVzLCB3aGljaCBtZWFucyBQa3RnZW4gc2hv dWxkIG5vdCBiZSB0aGUgcHJvYmxlbS4gWW91IGNhbiB2ZXJpZnkgdGhhdCBieSBsb29waW5nIHRo ZSBjYWJsZSBmcm9tIG9uZSBwb3J0IHRvIGFub3RoZXIgb24gdGhlIHBrdGdlbiBtYWNoaW5lIHRv IGNyZWF0ZSBhIGV4dGVybmFsIGxvb3BiYWNrLiBUaGVuIHNlbmQgdHJhZmZpYyB3aGF0IGV2ZXIg eW91IGNhbiBzZW5kIGZyb20gb25lIHBvcnQgeW91IHNob3VsZCBiZSBhYmxlIHRvIHJlY2VpdmUg dGhvc2UgcGFja2V0cyB1bmxlc3Mgc29tZXRoaW5nIGlzIGNvbmZpZ3VyZWQgd3JvbmcuIA0KPiA+ Pj4gDQo+ID4+PiBQbGVhc2Ugc2VuZCBtZSB0aGUgY29tbWFuZCBsaW5lIGZvciBwa3RnZW4uIA0K PiA+Pj4gDQo+ID4+PiANCj4gPj4+IEluIHBrdGdlbiBpZiB5b3UgaGF2ZSB0aGlzIGNvbmZpZyAt bSDigJxbMS00OjUtOF0uMOKAnSB0aGVuIHlvdSBoYXZlIDQgY29yZXMgc2VuZGluZyB0cmFmZmlj IGFuZCA0IGNvcmUgcmVjZWl2aW5nIHBhY2tldHMuIA0KPiA+Pj4gDQo+ID4+PiBJbiB0aGlzIGNh c2UgdGhlIFRYIGNvcmVzIHdpbGwgYmUgc2VuZGluZyB0aGUgcGFja2V0cyBvbiBhbGwgNCBsY29y ZXMgdG8gdGhlIHNhbWUgcG9ydC4gT24gdGhlIHJ4IHNpZGUgeW91IGhhdmUgNCBjb3JlcyBwb2xs aW5nIDQgcnggcXVldWVzLiBUaGUgcnggcXVldWVzIGFyZSBjb250cm9sbGVkIGJ5IFJTUywgd2hp Y2ggbWVhbnMgdGhlIFJYIHRyYWZmaWMgNSB0dXBsZXMgaGFzaCBtdXN0IGRpdmlkZSB0aGUgaW5i b3VuZCBwYWNrZXRzIGFjcm9zcyBhbGwgNCBxdWV1ZXMgdG8gbWFrZSBzdXJlIGVhY2ggY29yZSBp cyBkb2luZyB0aGUgc2FtZSBhbW91bnQgb2Ygd29yay4gSWYgeW91IGFyZSBzZW5kaW5nIG9ubHkg YSBzaW5nbGUgcGFja2V0IG9uIHRoZSBUeCBjb3JlcyB0aGVuIG9ubHkgb25lIHJ4IHF1ZXVlIGJl IHVzZWQuIA0KPiA+Pj4gDQo+ID4+PiBJIGhvcGUgdGhhdCBtYWtlcyBzZW5zZS4gDQo+ID4+IEkg dGhpbmsgdGhlcmUgaXMgYSBtaXN1bmRlcnN0YW5kaW5nIG9mIHRoZSBwcm9ibGVtLiBJbmRlZWQg dGhlIHByb2JsZW0gaXMgbm90IHRoZSBQa3RnZW4uIA0KPiA+PiBIZXJlIGlzIG15IGNvbW1hbmQg LS0+IC4vYXBwL2FwcC94ODZfNjQtbmF0aXZlLWxpbnV4YXBwLWdjYy9wa3RnZW4gLWMgZmZjMDAw MCAtbiA0IC13IDg0OjAwLjAgLXcgODQ6MDAuMSAtLWZpbGUtcHJlZml4IHBrdGdlbl9GMiAtLXNv Y2tldC1tZW0gMTAwMCwyMDAwLDEwMDAsMTAwMCAtLSAtVCAtUCAtbSAiWzE4LTE5OjIwLTIxXS4w LCBbMjI6MjNdLjEiIA0KPiA+PiANCj4gPj4gVGhlIHByb2JsZW0gaXMgd2hlbiBJIHJ1biB0aGUg c3ltbWV0cmljX21wIGV4YW1wbGUgZm9yICRudW1iZXJPZlByb2Nlc3Nlcz04IGNvcmVzLCB0aGVu IEkgaGF2ZSBsZXNzIHRocm91Z2hwdXQgKHJvdWdobHkgOC40IEdiL3MpLiBidXQgd2hlbiBJIHJ1 biBpdCBmb3IgJG51bWJlck9mUHJvY2Vzc2VzPTMgY29yZXMgdGhyb3VnaHB1dCBpcyAxMEcuIA0K PiA+PiBmb3IgaSBpbiBgc2VxICRudW1iZXJPZlByb2Nlc3Nlc2A7IA0KPiA+PiBkbyANCj4gPj4g Li4uLiBzb21lIGNhbGN1bGF0aW9uIGdvZXMgaGVyZS4uLi4uIA0KPiA+PiBzeW1tZXRyaWNfbXAg LWMgJGNvcmVtYXNrIC1uIDIgLS1wcm9jLXR5cGU9YXV0byAtdyAwYjowMC4wIC13IDBiOjAwLjEg LS1maWxlLXByZWZpeCBzbSAtLXNvY2tldC1tZW0gNDAwMCwxMDAwLDEwMDAsMTAwMCAtLSAtcCAz IC0tbnVtLXByb2NzPSRudW1iZXJPZlByb2Nlc3NlcyAtLXByb2MtaWQ9JHByb2NpZCI7IA0KPiA+ PiAuLi4uLiANCj4gPj4gZG9uZSANCj4gPiBNb3N0IE5JQ3MgaGF2ZSBhIGxpbWl0ZWQgYW1vdW50 IG9mIG1lbW9yeSBvbiB0aGUgTklDIGFuZCB3aGVuIHlvdSBzdGFydCB0byBzZWdtZW50IHRoYXQg bWVtb3J5IGJlY2F1c2UgeW91IGFyZSB1c2luZyBtb3JlIHF1ZXVlcyBpdCBjYW4gZWZmZWN0IHBl cmZvcm1hbmNlLiANCj4gPiANCj4gPiBJbiBvbmUgb2YgdGhlIE5JQ3MgaWYgeW91IGdvIG92ZXIg c2F5IDYgb3IgNSBxdWV1ZXMgdGhlIG1lbW9yeSBwZXIgcXVldWUgZm9yIFJ4L1R4IHBhY2tldHMg c3RhcnRzIHRvIGJlY29tZSBhIGJvdHRsZSBuZWNrIGFzIHlvdSBkbyBub3QgaGF2ZSBlbm91Z2gg bWVtb3J5IGluIHRoZSBUeC9SeCBxdWV1ZXMgdG8gaG9sZCBlbm91Z2ggcGFja2V0cy4gVGhpcyBj YW4gY2F1c2UgdGhlIE5JQyB0byBkcm9wIFJ4IHBhY2tldHMgYmVjYXVzZSB0aGUgaG9zdCBjYW4g bm90IHB1bGwgdGhlIGRhdGEgZnJvbSB0aGUgTklDIG9yIFJ4IHJpbmcgb24gdGhlIGhvc3QgZmFz dCBlbm91Z2guIFRoaXMgc2VlbXMgdG8gYmUgdGhlIHByb2JsZW0gYXMgdGhlIGFtb3VudCBvZiB0 aW1lIHRvIHByb2Nlc3MgYSBwYWNrZXQgb24gdGhlIGhvc3QgaGFzIG5vdCBjaGFuZ2VkIG9ubHkg dGhlIGFtb3VudCBvZiBidWZmZXIgc3BhY2UgaW4gdGhlIE5JQyBhcyB5b3UgaW5jcmVhc2UgcXVl dWVzLiANCj4gPiANCj4gPiBJIGFtIG5vdCBzdXJlIHRoaXMgaXMgeW91ciBpc3N1ZSwgYnV0IEkg ZmlndXJlZCBJIHdvdWxkIHN0YXRlIHRoaXMgcG9pbnQuIA0KPiBXaGF0IHlvdSBzYWlkIHNvdW5k ZWQgbG9naWNhbCwgYnV0IGlzIHRoZXJlIGF3YXkgdGhhdCBJIGNhbiBiZSBzdXJlPyBJIA0KPiBt ZWFuIGFyZSB0aGVyZSBzb21lIHJlZ2lzdGVycyBhdCBOSUMgd2hpY2ggc2hvdyB0aGUgbnVtYmVy IG9mIHBhY2tldCANCj4gbG9zcyBvbiBOSUM/IG9yIGRvZXMgRFBESyBoYXZlIGFuIEFQSSB3aGlj aCBzaG93cyB0aGUgbnVtYmVyIG9mIHBhY2tldCANCj4gbG9zcyBhdCBOSUMgbGV2ZWw/IA0KDQpZ ZXMgaWYgeW91IGxvb2sgaW4gdGhlIERvY3MgUmVhZHRoZWRvY3Mub3JnL3Byb2plY3RzL2RwZGsg eW91IGNhbiBmaW5kIHRoZSBBUEkgc29tZXRoaW5nIGxpa2UgcnRlX2V0aF9zdGF0c19nZXQoKQ0K DQo+ID4gDQo+ID4+IEkgYW0gdHJ5aW5nIGZpbmQgb3V0IHdoYXQgbWFrZXMgdGhpcyBsb3NzISAN Cj4gPj4gDQo+ID4+IA0KPiA+Pj4+Pj4gT24gQXVnIDI4LCAyMDE4LCBhdCAxMjowNSBQTSwgU2Fi ZXIgUmV6dmFuaSA8aXJzYWJlckB6b2hvLmNvbT4gd3JvdGU6IA0KPiA+Pj4+Pj4gDQo+ID4+Pj4+ PiANCj4gPj4+Pj4+IA0KPiA+Pj4+Pj4gT24gMDgvMjgvMjAxOCAwODozMSBQTSwgU3RlcGhlbiBI ZW1taW5nZXIgd3JvdGU6IA0KPiA+Pj4+Pj4+IE9uIFR1ZSwgMjggQXVnIDIwMTggMTc6MzQ6Mjcg KzA0MzAgDQo+ID4+Pj4+Pj4gU2FiZXIgUmV6dmFuaSA8aXJzYWJlckB6b2hvLmNvbT4gd3JvdGU6 IA0KPiA+Pj4+Pj4+IA0KPiA+Pj4+Pj4+PiBIaSwgDQo+ID4+Pj4+Pj4+IA0KPiA+Pj4+Pj4+PiAN Cj4gPj4+Pj4+Pj4gSSBoYXZlIHJ1biBtdWx0aV9wcm9jZXNzL3N5bW1ldHJpY19tcCBleGFtcGxl IGluIERQREsgZXhhbXBsZSBkaXJlY3RvcnkuIA0KPiA+Pj4+Pj4+PiBGb3IgYSBvbmUgcHJvY2Vz cyBpdHMgdGhyb3VnaHB1dCBpcyBsaW5lIHJhdGUgYnV0IGFzIEkgaW5jcmVhc2UgdGhlIA0KPiA+ Pj4+Pj4+PiBudW1iZXIgb2YgY29yZXMgSSBzZWUgZGVjcmVhc2UgaW4gdGhyb3VnaHB1dC4gRm9y IGV4YW1wbGUsIElmIHRoZSBudW1iZXIgDQo+ID4+Pj4+Pj4+IG9mIHF1ZXVlcyBzZXQgdG8gNCBh bmQgZWFjaCBxdWV1ZSBhc3NpZ25zIHRvIGEgc2luZ2xlIGNvcmUsIHRoZW4gdGhlIA0KPiA+Pj4+ Pj4+PiB0aHJvdWdocHV0IHdpbGwgYmUgc29tZXRoaW5nIGFib3V0IDkuNC4gaWYgOCBxdWV1ZXMs IHRoZW4gdGhyb3VnaHB1dCANCj4gPj4+Pj4+Pj4gd2lsbCBiZSA4LjUuIA0KPiA+Pj4+Pj4+PiAN Cj4gPj4+Pj4+Pj4gSSBoYXZlIHJlYWQgdGhlIGZvbGxvd2luZywgYnV0IGl0IHdhcyBub3QgY29u dmluY2luZy4gDQo+ID4+Pj4+Pj4+IA0KPiA+Pj4+Pj4+PiBodHRwOi8vbWFpbHMuZHBkay5vcmcv YXJjaGl2ZXMvZGV2LzIwMTUtT2N0b2Jlci8wMjQ5NjAuaHRtbCANCj4gPj4+Pj4+Pj4gDQo+ID4+ Pj4+Pj4+IA0KPiA+Pj4+Pj4+PiBJIGFtIGVhZ2VybHkgbG9va2luZyBmb3J3YXJkIHRvIGhlYXJp bmcgZnJvbSB5b3UsIGFsbC4gDQo+ID4+Pj4+Pj4+IA0KPiA+Pj4+Pj4+PiANCj4gPj4+Pj4+Pj4g QmVzdCB3aXNoZXMsIA0KPiA+Pj4+Pj4+PiANCj4gPj4+Pj4+Pj4gU2FiZXIgDQo+ID4+Pj4+Pj4+ IA0KPiA+Pj4+Pj4+PiANCj4gPj4+Pj4+PiBOb3QgY29tcGxldGVseSBzdXJwcmlzaW5nLiBJZiB5 b3UgaGF2ZSBtb3JlIGNvcmVzIHRoYW4gcGFja2V0IGxpbmUgcmF0ZSANCj4gPj4+Pj4+PiB0aGVu IHRoZSBudW1iZXIgb2YgcGFja2V0cyByZXR1cm5lZCBmb3IgZWFjaCBjYWxsIHRvIHJ4X2J1cnN0 IHdpbGwgYmUgbGVzcy4gDQo+ID4+Pj4+Pj4gV2l0aCBsYXJnZSBudW1iZXIgb2YgY29yZXMsIG1v c3Qgb2YgdGhlIHRpbWUgd2lsbCBiZSBzcGVudCBkb2luZyByZWFkcyBvZiANCj4gPj4+Pj4+PiBQ Q0kgcmVnaXN0ZXJzIGZvciBubyBwYWNrZXRzISANCj4gPj4+Pj4+IEluZGVlZCBwa3RnZW4gc2F5 cyBpdCBpcyBnZW5lcmF0aW5nIHRyYWZmaWMgYXQgbGluZSByYXRlLCBidXQgcmVjZWl2aW5nIGxl c3MgdGhhbiAxMCBHYi9zLiBTbywgaXQgdGhhdCBjYXNlIHRoZXJlIHNob3VsZCBiZSBzb21ldGhp bmcgdGhhdCBjYXVzZXMgdGhlIHJlZHVjdGlvbiBpbiB0aHJvdWdocHV0IDooIA0KPiA+Pj4+Pj4g DQo+ID4+Pj4+PiANCj4gPj4+Pj4gUmVnYXJkcywgDQo+ID4+Pj4+IEtlaXRoIA0KPiA+Pj4+PiAN Cj4gPj4+PiANCj4gPj4+IFJlZ2FyZHMsIA0KPiA+Pj4gS2VpdGggDQo+ID4+PiANCj4gPj4gQmVz dCByZWdhcmRzLCANCj4gPj4gU2FiZXIgDQo+ID4gUmVnYXJkcywgDQo+ID4gS2VpdGggDQo+ID4g DQo+IEJlc3QgcmVnYXJkcywgDQo+IFNhYmVyIA0KPiANCg0KUmVnYXJkcywNCktlaXRoDQoNCg==