From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from emea01-db3-obe.outbound.protection.outlook.com (mail-db3on0081.outbound.protection.outlook.com [157.55.234.81]) by dpdk.org (Postfix) with ESMTP id 674C45949 for ; Sun, 1 Nov 2015 11:05:40 +0100 (CET) Received: from AM2PR05MB0995.eurprd05.prod.outlook.com (10.161.234.145) by AM2PR05MB0994.eurprd05.prod.outlook.com (10.161.234.144) with Microsoft SMTP Server (TLS) id 15.1.312.18; Sun, 1 Nov 2015 10:05:39 +0000 Received: from AM2PR05MB0995.eurprd05.prod.outlook.com ([10.161.234.145]) by AM2PR05MB0995.eurprd05.prod.outlook.com ([10.161.234.145]) with mapi id 15.01.0312.014; Sun, 1 Nov 2015 10:05:33 +0000 From: Olga Shern To: "jesper.wramberg@gmail.com" , "users@dpdk.org" Thread-Topic: [dpdk-users] Low TX performance on Mellanox ConnectX-3 NIC Thread-Index: AQHRFIdG2d5EB242qk2DsKcxnHNZgJ6G62jg Date: Sun, 1 Nov 2015 10:05:32 +0000 Message-ID: References: <36170571.QMO0L8HZgB@xps13> In-Reply-To: <36170571.QMO0L8HZgB@xps13> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=olgas@mellanox.com; x-originating-ip: [193.47.165.251] x-microsoft-exchange-diagnostics: 1; AM2PR05MB0994; 5:K11+HlFdGAhnq+rwLPxY4MT1Bxsa14eJ5wDuoIYRGho31SjFCTsxOx05MTnxq8rOLeziGSF5Pc6eku+Kd6i4Id9gZCjs4dn0AzUEiZ0gYITVF+tsmMSMId4/jeMgdCqz7BaCUH5UrTH+uASL3p1qhw==; 24:i+UN6/xm0501H7XBemp4ZOK+6IUMQedqOuDOhe7jALjy4nKcKpOcCUjtUjEaA5eEt56ALQ3HdJbuo9GJ1f0NUM07feGtwrbnK3y8574jVG8=; 20:dqx50tqMaOY5aPnIc658OMGhzxP7siL76DayKacfkY9M7q2JDB3c+I48BKhIv0AnHKbudy0QPdD1gVLXFJWfAw== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:AM2PR05MB0994; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(34787635062028); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(520078)(8121501046)(5005006)(3002001)(10201501046); SRVR:AM2PR05MB0994; BCL:0; PCL:0; RULEID:; SRVR:AM2PR05MB0994; x-forefront-prvs: 07473990A5 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(53754006)(189002)(243025005)(199003)(2900100001)(189998001)(122556002)(76576001)(50986999)(107886002)(5004730100002)(5007970100001)(2501003)(40100003)(106116001)(86362001)(5003600100002)(66066001)(33656002)(76176999)(102836002)(54356999)(106356001)(10400500002)(105586002)(92566002)(5001770100001)(97736004)(5008740100001)(15975445007)(5002640100001)(5001960100002)(101416001)(77096005)(19580395003)(2950100001)(19580405001)(87936001)(81156007)(74316001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM2PR05MB0994; H:AM2PR05MB0995.eurprd05.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2015 10:05:32.8211 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM2PR05MB0994 Subject: Re: [dpdk-users] Low TX performance on Mellanox ConnectX-3 NIC X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Nov 2015 10:05:40 -0000 SGkgSmVzcGVyLCANCg0KU2V2ZXJhbCBzdWdnZXN0aW9ucywgDQoxLglBbnkgY2hhbmNlIHlvdSBj YW4gaW5zdGFsbCBsYXRlc3QgRlcgZnJvbSBNZWxsYW5veCB3ZWIgc2l0ZSBvciB0aGUgb25lIHRo YXQgaXMgaW5jbHVkZWQgaW4gT0ZFRCAzLjEgdmVyc2lvbiB0aGF0IHlvdSBoYXZlIGRvd25sb2Fk ZWQ/ICBUaGUgbGF0ZXN0IHZlcnNpb24gaXMgIDIuMzUuNTEwMC4NCjIuCVBsZWFzZSBjb25maWd1 cmUgU0dFX05VTT0xIGluIERQREsgY29uZmlnIGZpbGUgIGluIGNhc2UgeW91IGRvbid0IG5lZWQg anVtYm8gZnJhbWVzLiBUaGlzIHdpbGwgaW1wcm92ZSBwZXJmb3JtYW5jZS4NCjMuIAlOb3QgY2xl YXIgZnJvbSB5b3VyIGRlc2NyaXB0aW9uLCBpZiB5b3UgYXJlIHJ1bm5pbmcgRFBESyBvbiBWTSA/ IEFyZSB5b3Ugc3VpbmcgU1JJT1YgPw0KNC4gCUkgc3VnZ2VzdCB5b3UgIHRvIHJ1biAgZmlyc3Qs ICB0ZXN0cG1kIGFwcGxpY2F0aW9uLiBUaGUgdHJhZmZpYyBnZW5lcmF0b3IgY2FuIGJlIHJhd19l dGhlcm5ldF9idyBhcHBsaWNhdGlvbiB0aGF0IGNvbWluZyB3aXRoIE1MTlhfT0ZFRCwgaXQgY2Fu IGdlbmVyYXRlIEwyLCBJUFY0IGFuZCBUQ1AvVURQIHBhY2tldHMNCglGb3IgZXhhbXBsZTogIHRh c2tzZXQgLWMgMTAgcmF3X2V0aGVybmV0X2J3IC0tY2xpZW50IC1kIG1seDRfMCAtaSAxIC1sIDMg LS1kdXJhdGlvbiAxMCAtcyA2NCAtLWRlc3RfbWFjIEY0OjUyOjE0OjdBOjU5OjgwICYNCglUaGlz IHdpbGwgc2VuZCBMMiBwYWNrZXRzIHZpYSBtbHg0XzAgTklDIHBvcnQgMSAsIHBhY2tldCBzaXpl ID0gNjQsIGZvciAxMCBzZWMsIGJhdGNoID0gMyAoLWwpICANCglZb3UgY2FuIHNlZSBhY2NvcmRp bmcgdG8gdGVzdHBtZCBjb3VudGVycyB0aGUgcGVyZm9ybWFuY2UuDQoNClBsZWFzZSBjaGVjayBN ZWxsYW5veCBjb21tdW5pdHkgIHBvc3RzLCBJIHRoaW5rIHRoZXkgY2FuIGhlbHAgeW91LiANCmh0 dHBzOi8vY29tbXVuaXR5Lm1lbGxhbm94LmNvbS9kb2NzL0RPQy0xNTAyDQoNCldlIGFsc28gaGF2 ZSBwZXJmb3JtYW5jZSBzdWdnZXN0aW9ucyBpbiBvdXIgUVNHOiANCmh0dHA6Ly93d3cubWVsbGFu b3guY29tL3JlbGF0ZWQtZG9jcy9wcm9kX3NvZnR3YXJlL01MTlhfRFBES19RdWlja19TdGFydF9H dWlkZV92MiUyMDFfMSUyMDEucGRmDQoNCkJlc3QgUmVnYXJkcywNCk9sZ2EgDQoNCg0KT2JqZXQg OiBbZHBkay11c2Vyc10gTG93IFRYIHBlcmZvcm1hbmNlIG9uIE1lbGxhbm94IENvbm5lY3RYLTMg TklDIERhdGUgOiBzYW1lZGkgMzEgb2N0b2JyZSAyMDE1LCAwOTo1NDowNCBEZSA6IEplc3BlciBX cmFtYmVyZyA8amVzcGVyLndyYW1iZXJnQGdtYWlsLmNvbT4gIMOAIDogdXNlcnNAZHBkay5vcmcN Cg0KSGkgYWxsLA0KDQoNCg0KSSBhbSBleHBlcmllbmNpbmcgc29tZSBwZXJmb3JtYW5jZSBpc3N1 ZXMgaW4gYSBzb21ld2hhdCBjdXN0b20gc2V0dXAgd2l0aCB0d28gTWVsbGFub3ggQ29ubmVjdFgt MyBOSUNzLiBJIHJlYWxpemUgdGhlc2UgaXNzdWVzIG1pZ2h0IGJlIGR1ZSB0byB0aGUgc2V0dXAs IGJ1dCBJIHdhcyBob3Bpbmcgc29tZW9uZSBtaWdodCBiZSBhYmxlIHRvIHBpbnBvaW50IHNvbWUg cG9zc2libGUgcHJvYmxlbXMvYm90dGxlbmVja3MuDQoNCg0KDQoNClRoZSBzZXJ2ZXI6DQoNCkkg aGF2ZSBhIERlbGwgUG93ZXJFZGdlIFI2MzAgd2l0aCB0d28gTWVsbGFub3ggQ29ubmVjdFgtMyBO SUNzIChvbmUgb24gZWFjaCBzb2NrZXQpLiBJIGhhdmUgYSBtaW5pbWFsIENlbnRvcyA3LjEuMTUw MyBpbnN0YWxsZWQgd2l0aCBrZXJuZWwtMy4xMC4wLTIyOS4NCk5vdGUgdGhhdCB0aGlzIGtlcm5l bCBpcyByZS1idWlsZCB3aXRoIG1vc3QgdGhpbmdzIGRpc2FibGVkIHRvIG1pbmltaXplIHNpemUs IGV0Yy4gSXQgaGFzIGluZmluaWJhbmQgZW5hYmxlZCwgaG93ZXZlciwgYW5kIG1seDRfY29yZSBh cyBhIG1vZHVsZSAoc2luY2Ugbm90aGluZyB3b3JrcyBvdGhlcndpc2UpLiBGaW5hbGx5LCBJIGhh dmUgY29ubmVjdGVkIHRoZSB0d28gTklDcyBmcm9tIHBvcnQgMiB0byBwb3J0IDIuDQoNCg0KDQpU aGUgZmlybXdhcmU6DQoNCkkgaGF2ZSBpbnN0YWxsZWQgdGhlIGxhdGVzdCBmaXJtd2FyZSBmb3Ig dGhlIE5JQ3MgZnJvbSBkZWxsIHdoaWNoIGlzIDIuMzQuNTA2MC4NCg0KDQoNClRoZSBkcml2ZXJz LCBtb2R1bGVzLCBldGMuOg0KDQpJIGhhdmUgZG93bmxvYWRlZCB0aGUgTWVsbGFub3ggT0ZFRCBw YWNrYWdlIDMuMSBmb3IgQ2VudG9zIDcuMSBhbmQgdXNlZCBpdHMgcmVidWlsZCBmZWF0dXJlIHRv IGJ1aWxkIGl0IGFnYWluc3QgdGhlIGN1c3RvbSBrZXJuZWwuIEkgaGF2ZSBpbnN0YWxsZWQgaXQg dXNpbmcgdGhlIC0tYmFzaWMgb3B0aW9uIHNpbmNlIEkganVzdCB3YW50IGxpYmlidmVyYnMsIGxp Ym1seDQsIGtlcm5lbCBtb2R1bGVzIGFuZCBvcGVuaWJkIHNlcnZpY2Ugc3R1ZmYuIFRoZSBtbHg0 X2NvcmUuY29uZiBpcyBzZXQgZm9yIGV0aGVybmV0IG9uIGFsbCBwb3J0cy4gTW9yZW92ZXIsIGl0 IGlzIGNvbmZpZ3VyZWQgZm9yIGZsb3cgc3RlZXJpbmcgbW9kZSAtNyBhbmQgYSBmZXcgVkZzLiBJ IGNhbiByZXN0YXJ0IHRoZSBvcGVuaWJkIHNlcnZpY2Ugc3VjY2Vzc2Z1bGx5IGFuZCBldmVyeXRo aW5nIHNlZW1zIHRvIGJlIHdvcmtpbmcuIGliZGV2Mm5ldGRldiByZXBvcnRzIHRoZSBOSUNzIGFu ZCBpdHMgVkZzLCBldGMuIFRoZSBvbmx5IHByb2JsZW1zIEkgaGF2ZSBlbmNvdW50ZXJlZCBhdCB0 aGlzIHN0YWdlIGlzIHRoYXQgdGhlIGxpbmtzIGRvZXNuJ3QgYWx3YXlzIHNlZW0gdG8gY29tZSB1 cCB1bmxlc3MgSSB1bnBsdWcgYW5kIHJlLXBsdWcgdGhlIGNhYmxlcy4NCg0KDQoNCkRQREsgc2V0 dXA6DQoNCkkgaGF2ZSBidWlsdCBEUERLIHdpdGggdGhlIG1seDQgcG1kIHVzaW5nIHRoZSAuaC8u YSBmaWxlcyBmcm9tIHRoZSBPRkVEIHBhY2thZ2UuIEkgYnVpbGQgaXQgdXNpbmcgdGhlIGRlZmF1 bHQgdmFsdWVzIGZvciBldmVyeXRoaW5nLiBSdW5uaW5nIHRoZSBzaW1wbGUgaGVsbG8gd29ybGQg ZXhhbXBsZSBJIGNhbiBzZWUgdGhhdCBldmVyeXRoaW5nIGlzIGluaXRpYWxpemVkIGNvcnJlY3Rs eSwgZXRjLg0KDQoNCg0KVGVzdCBzZXR1cDoNCg0KVG8gdGVzdCB0aGUgcGVyZm9ybWFuY2Ugb2Yg dGhlIE5JQ3MgSSBoYXZlIHRoZSBmb2xsb3dpbmcgc2V0dXAuIFR3byBwcm9jZXNzZXMsIFAxIGFu ZCBQMiwgcnVubmluZyBvbiBOSUMgQS4gVHdvIG90aGVyIHByb2Nlc3NlcywgUDMgYW5kIFA0LCBy dW5uaW5nIG9uIE5JQyBCLiBBbGwgcHJvY2Vzc2VzIHVzZSB2aXJ0dWFsIGZ1bmN0aW9ucyBvbiB0 aGVpciByZXNwZWN0aXZlIE5JQ3MuIERlcGVuZGluZyBvbiB0aGUgdGVzdCwgdGhlIHByb2Nlc3Nl cyBjYW4gZWl0aGVyIHRyYW5zbWl0IG9yIHJlY2VpdmUgZGF0YS4gVG8gdHJhbnNtaXQsIEkgdXNl IGEgc2ltcGxlIERQREsgcHJvZ3JhbSB3aGljaCBnZW5lcmF0ZXMgMzIwMDAgcGFja2V0cyBhbmQg dHJhbnNtaXRzIHRoZW0gb3ZlciBhbmQgb3ZlciB1bnRpbCBpdCBoYXMgc2VudCA2NDAgbWlsbGlv biBwYWNrZXRzLiBTaW1pbGFybHksIEkgdXNlIGEgc2ltcGxlIERQREsgcHJvZ3JhbSB0byByZWNl aXZlIHdoaWNoIGlzIGJhc2ljYWxseSB0aGUgbGF5ZXIgMiBmb3J3YXJkaW5nIGV4YW1wbGUgd2l0 aG91dCByZS10cmFuc21pc3Npb24uDQoNCg0KDQpGaXJzdCB0ZXN0Og0KDQpJbiBteSBmaXJzdCB0 ZXN0LCBQMSB0cmFuc21pdHMgZGF0YSB0byBQMyB3aGlsZSB0aGUgb3RoZXIgcHJvY2Vzc2VzIGFy ZSBpZGxlLg0KDQpQYWNrZXQgc2l6ZTogMTQ4MCBieXRlIHBhY2tldHMNCg0KRmxvdyBjb250cm9s OiBPbi9PZmYsIGRvZXNu4oCZdCBtYXR0ZXIgSSBnZXQgc2FtZSByZXN1bHQuDQoNClJlc3VsdDog UDMgcmVjZWl2ZSBhbGwgcGFja2V0cyBidXQgaXQgdGFrZXMgMTkyLjUyIHNlY29uZHMgfiAzLjMy IE1wcHMgfiA0LjlHYml0L3MNCg0KDQoNClNlY29uZCB0ZXN0Og0KDQpJIG15IHNlY29uZCB0ZXN0 LCBJIGF0dGVtcHQgdG8gaW5jcmVhc2UgdGhlIGFtb3VudCBvZiBkYXRhIHRyYW5zbWl0dGVkIG92 ZXIgTklDIEEuIEFzIHN1Y2gsIFAxIHRyYW5zbWl0cyBkYXRhIHRvIFAzIHdoaWxlIFAyIHRyYW5z bWl0cyBkYXRhIHRvIFA0Lg0KDQpQYWNrZXQgc2l6ZTogMTQ4MCBieXRlIHBhY2tldHMNCg0KRmxv dyBjb250cm9sOiBPbi9PZmYsIGRvZXNu4oCZdCBtYXR0ZXIgSSBnZXQgc2FtZSByZXN1bHQuDQoN ClJlc3VsdHM6IFAzIGFuZCBQNCByZWNlaXZlIGFsbCBwYWNrZXRzIGJ1dCBpdCB0YWtlcyAzNjQu NDAgc2Vjb25kcyB+IDEuNzUgTXBwcyB+IDIuNkdiaXQvcyBmb3IgYSBzaW5nbGUgcHJvY2VzcyB0 byBnZXQgaXRzIGRhdGEgdHJhbnNtaXR0ZWQuDQoNCg0KDQoNCg0KRG9lcyBhbnlvbmUgaGFzIGFu eSBpZGVhIHdoYXQgSSBhbSBkb2luZyB3cm9uZyBoZXJlID8gSW4gdGhlIHNlY29uZCB0ZXN0IEkg d291bGQgZXhwZWN0IFAxIHRvIHRyYW5zbWl0IHdpdGggdGhlIHNhbWUgc3BlZWQgYXMgaW4gdGhl IGZpcnN0IHRlc3QuIEl0IHNlZW1zIHRoYXQgdGhlcmUgaXMgYSBib3R0bGVuZWNrIHNvbWV3aGVy ZSwgaG93ZXZlci4gSSBoYXZlIGxlZnQgbW9zdCB0aGluZ3MgdG8gdGhlaXIgZGVmYXVsdCB2YWx1 ZXMgYnV0IGhhdmUgYWxzbyB0cmllZCB0d2Vha2luZyBxdWV1ZSBzaXplcywgbnVtYmVyIG9mIHF1 ZXVlcywgaW50ZXJydXB0cywgZXRjLiB3aXRoIG5vIGx1Y2sNCg0KDQoNCg0KDQpCZXN0IFJlZ2Fy ZHMsDQoNCkplc3Blcg0K