From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from CAN01-TO1-obe.outbound.protection.outlook.com (mail-eopbgr670137.outbound.protection.outlook.com [40.107.67.137]) by dpdk.org (Postfix) with ESMTP id 9717B1BE0 for ; Tue, 4 Sep 2018 19:54:21 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kaloom.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=oGIzkf7/sQBZHrNlbRuQwk20D2C886DX+iCPuXRzi/0=; b=Kos8Lp59V4SZqPNUXD68ZkzSqt8M6Y99hicUCEfFhVp4e7R6ei53FaNXeEHBRxqVn5GvLyUE2wehF0yFztD2vtJFISp4kueJpZ2QdRjcBPZ1PoIW1mKfAtPu8+NEb0h5XdpdK0K0DTr4E2RUBu9uxWwFI96Z+/6GiPhF8U5JzwE= Received: from YQBPR0101MB1538.CANPRD01.PROD.OUTLOOK.COM (52.132.69.145) by YQBPR0101MB2178.CANPRD01.PROD.OUTLOOK.COM (52.132.72.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1101.14; Tue, 4 Sep 2018 17:54:20 +0000 Received: from YQBPR0101MB1538.CANPRD01.PROD.OUTLOOK.COM ([fe80::407:aa02:623c:5420]) by YQBPR0101MB1538.CANPRD01.PROD.OUTLOOK.COM ([fe80::407:aa02:623c:5420%3]) with mapi id 15.20.1101.016; Tue, 4 Sep 2018 17:54:20 +0000 From: Eric Tremblay To: "users@dpdk.org" Thread-Topic: Virtio-user exceptional path performance Thread-Index: AdREd4eNNKAYJcyxTZytkpj4h2hX1g== Date: Tue, 4 Sep 2018 17:54:20 +0000 Message-ID: Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=ertr@kaloom.com; x-originating-ip: [67.22.228.35] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; YQBPR0101MB2178; 6:E6nFvt3MxfV3ut9Zbfjfw3W7k6jMrKVdwvC/mJpcBcuew5110UCwJr394NEEI2m0jgmaiWJA7UntYYx55dbUvmH2GhfkV982UukMQxfaYL7s265gmZYpsYrcWwoYXNDREmcgmIQmsyVHX9AgAiIZ3w6ecjBM6wFA6UvwM6mjT7n1O1ZYb6Ufyaolx74D858UEnl98uIJd+VE99s8POgZNz00g4AmVwbLXMxx5OzqyivQu6IucGWkDUIE64NN7ksHMzP4YGigHQXfrdpQhzpB93pukG0KwrusCWmaIaIJuKY738S8Z+yUy/q2SQPhWlZitJUhlue2jMfSNHzb9fmJWeJvb1oOGtR5xDqNdfXBgNg/zxukMCgJnKOuLcd0mgT2hAwMl5DQpX8J6tPU3y2neKGZ68Z7IX47IB/5RauUDBopncdAu1xc2TxP/j1ZXwV4CXrg+0aZ6XovvVG/a4Om4g==; 5:0vucDV1dWcY+e/BHdXvSQR0nzYMy8bHrz5WgKOOcpO9O3PqousGtAXcD9a69EbnKN5qTC6FdNK6i0aG053+vZeSjTzmDd2QxY+k35mjurzaHeUyfqutJdZfbB1ufHWeNGYic2JSmV90MGlALsFP2OjVeR0rlg8FxMG2hbBk0z6A=; 7:8zoqb8xvayTbf/pzGlPLgArxOHrxj2DyHKgCeG4I7TZ+VMNVaHDfqD92I5hhiy2s+djG9K6mKuUSwEP0Jb+bweIJpQxPS4X041RkkBUpx4031fopWNk027xi0DxKI3iPIODMYZsu90BunY/I6pVVocacsqBrrAql5SSxyGP9FVmhQhHQBdmUE3sXps6ZbFgfnqXvmML+z4ZPUMXwbXbxBpBVpDQ+jVFcXJjR8wIkYTNo+AWCfc4e953uCx/d0EM7 x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: f2c08bbb-9a22-4867-5a3a-08d6128f70e9 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(7021125)(8989137)(4534165)(7022125)(4603075)(4627221)(201702281549075)(8990107)(7048125)(7024125)(7027125)(7028125)(7023125)(5600074)(711020)(2017052603328)(7153060)(7193020); SRVR:YQBPR0101MB2178; x-ms-traffictypediagnostic: YQBPR0101MB2178: x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(28532068793085)(21748063052155); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3231311)(944501410)(52105095)(3002001)(93006095)(93001095)(10201501046)(149027)(150027)(6041310)(20161123560045)(20161123562045)(2016111802025)(20161123564045)(20161123558120)(6043046)(201708071742011)(7699016); SRVR:YQBPR0101MB2178; BCL:0; PCL:0; RULEID:; SRVR:YQBPR0101MB2178; x-forefront-prvs: 0785459C39 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(39830400003)(376002)(346002)(136003)(396003)(199004)(189003)(6506007)(6116002)(3480700004)(790700001)(9326002)(33656002)(14444005)(8936002)(256004)(99286004)(3846002)(8676002)(81166006)(81156014)(7696005)(5660300001)(1730700003)(966005)(102836004)(478600001)(14454004)(21615005)(97736004)(6436002)(66066001)(5250100002)(25786009)(2501003)(106356001)(2906002)(7736002)(105586002)(486006)(2351001)(186003)(26005)(55016002)(9686003)(54896002)(6306002)(5640700003)(316002)(5630700001)(606006)(86362001)(74316002)(53936002)(6916009)(2900100001)(68736007)(476003)(236005)(42262002); DIR:OUT; SFP:1102; SCL:1; SRVR:YQBPR0101MB2178; H:YQBPR0101MB1538.CANPRD01.PROD.OUTLOOK.COM; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: kaloom.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: HQFSV81DlytxcV4eEWuUgu8rbqofcujizCmRRrwOcmzSV+OinbYFQjKyVCmte0uhDUkAW4lQUkb72eFYAuAjuGEon/lnb76uzzo0Zv5ubvQH4awWU5rxd07loMZ7GvWD1f0lTS/QIIy8tXUSYWo7IxBcoBCal8Gc3ruXFnEP4ye3GBuho0WQITvkd1MU5SsuFruu2hXlQne++6IVQMaVMQStwfIswoTJiRIrfOrkjj1aaXKoOaJIroUUem5H8oh+ApT4AXGJi4LlTIaZAmRLLoeUx1M8TmVBPeR6z6GLGcRl+TjfLnvFAiQ7SxwzPpJYm+xylrWinH3Y7v+JYCxstVJQhnRQTOlMHSQ+i7aiRhw= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: kaloom.com X-MS-Exchange-CrossTenant-Network-Message-Id: f2c08bbb-9a22-4867-5a3a-08d6128f70e9 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Sep 2018 17:54:20.2374 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 47d58e26-f796-48e8-ac40-1c365c204513 X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB2178 X-Mailman-Approved-At: Thu, 06 Sep 2018 15:10:31 +0200 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Virtio-user exceptional path performance X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Sep 2018 17:54:22 -0000 Hello, I am testing the performance capabilities of the virtio-user exceptional pa= th for use in container networking scenarios. I am trying to reproduce the = results obtained in Test Case 1 described in the paper "VIRTIO-USER: A New = Versatile Channel for Kernel-Bypass Networks". That is, I am creating two = virtio-user vdevs in testpmd, putting each one in separate network namespac= es and running iperf3 between the two. However, I am unable to obtain the n= ear 25Gbps throughput shown in the paper. Instead, I obtained a mere 3Gbps.= Has anyone else been able to reproduce these results? My understanding is = that this type of virtual device takes advantage of both checksum offloadin= g and LRO in order to get such high throughput. However, for some reason, I= am unable to use RX checksum offloading nor LRO in my setup. If I specify = the --enable-lro and --enable-rx-cksum options in testpmd (as shown here ht= tps://doc.dpdk.org/guides-17.11/howto/virtio_user_as_exceptional_path.html)= , the tap device is never created in the kernel. If I do not specify these = options, the tap is created correctly but the rx-checksum and LRO are off a= nd cannot be turned on using ethtool (they are marked as [fixed]). Does anyone have any idea what may be preventing me from taking advantage o= f checksum offloading and LRO? Also, I am I right in assuming that this is = the reason why the performance is so poor or could there be another problem= with my setup? I am using DPDK 17.11 on CentOS 7.5. Any help would be appr= eciated. Regards, Eric