From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from na01-bn1-obe.outbound.protection.outlook.com (mail-bn1bon0133.outbound.protection.outlook.com [157.56.111.133]) by dpdk.org (Postfix) with ESMTP id C9F73106B for ; Mon, 15 Jun 2015 09:04:21 +0200 (CEST) Received: from SN1PR05CA0039.namprd05.prod.outlook.com (10.163.68.177) by DM2PR05MB975.namprd05.prod.outlook.com (10.141.176.28) with Microsoft SMTP Server (TLS) id 15.1.190.14; Mon, 15 Jun 2015 07:04:20 +0000 Received: from BY2FFO11FD018.protection.gbl (2a01:111:f400:7c0c::197) by SN1PR05CA0039.outlook.office365.com (2a01:111:e400:5197::49) with Microsoft SMTP Server (TLS) id 15.1.190.14 via Frontend Transport; Mon, 15 Jun 2015 07:04:20 +0000 Authentication-Results: spf=pass (sender IP is 192.65.42.18) smtp.mailfrom=tekcomms.com; intel.com; dkim=none (message not signed) header.d=none; Received-SPF: Pass (protection.outlook.com: domain of tekcomms.com designates 192.65.42.18 as permitted sender) receiver=protection.outlook.com; client-ip=192.65.42.18; helo=mx.danahertm.com; Received: from mx.danahertm.com (192.65.42.18) by BY2FFO11FD018.mail.protection.outlook.com (10.1.14.106) with Microsoft SMTP Server (TLS) id 15.1.190.9 via Frontend Transport; Mon, 15 Jun 2015 07:04:19 +0000 Received: from US-BV-EXH02-P.global.tektronix.net (128.181.11.23) by US-BV-EXE01-P.global.tektronix.net (128.181.15.45) with Microsoft SMTP Server (TLS) id 14.3.224.2; Mon, 15 Jun 2015 00:04:18 -0700 Received: from US-BV-EXM02-P.global.tektronix.net ([169.254.4.113]) by US-BV-EXH02-P.global.tektronix.net ([fe80::91f:91a6:a0ad:f15e%12]) with mapi id 14.03.0224.002; Mon, 15 Jun 2015 00:04:18 -0700 From: "Zhou, Tianlin" To: Jason Wang , "dev@dpdk.org" , "Ouyang, Changchun" Thread-Topic: [dpdk-dev] Poor Virtio PMD TX Performance Thread-Index: AdCfbH3K+T6mdxm0Q3KlByXb8Zi/KQCI5Y4AAABaORAA2F2+AAAPEwqAAIKDBSA= Date: Mon, 15 Jun 2015 07:04:17 +0000 Message-ID: <7D6C3D7847A9FE4E8EB311EAC72727A04EB20A10@US-BV-EXM02-P.global.tektronix.net> References: <7D6C3D7847A9FE4E8EB311EAC72727A04EB1447D@US-BV-EXM02-P.global.tektronix.net> <7D6C3D7847A9FE4E8EB311EAC72727A04EB163A4@US-BV-EXM02-P.global.tektronix.net> <557AAA53.1010301@redhat.com> In-Reply-To: <557AAA53.1010301@redhat.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [134.64.203.88] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-Microsoft-Exchange-Diagnostics: 1; BY2FFO11FD018; 1:YX8TQKaMbeJ8EfnUmuMhPLLjU+BD1b1oIsvuUZlvW8bMTGMs1myim2MxlATdJJPQQBDl6NPpCbe4x/fw7eb+LY9BCFzhKCYwCBN0yUnTueBCMpiKMtgM/ZnWYlXSgSH6MgdjaIUzktWSo+8hyzwZLenRij/nIDU0WnxKmv1jRsM6A2skkoVuKyfuv6MLHWgMybJQu7M90XRdsjELTrRpnblIqBAwmmMzN+JR9s6wcETaGdJIQEMmvAxO3I46jILpTsuQ/kz895T6yNyBv0f5Y1+0kD7YrAHGM28OmRbcL1ZDVRfvyh5vFC50Aa/QbtdgjtxJJiBz4aeL+i3lIbrHhuo7JJTZCXBEvB4OzdJZplQ= X-Forefront-Antispam-Report: CIP:192.65.42.18; CTRY:US; IPV:NLI; EFV:NLI; SFV:NSPM; SFS:(10019020)(6009001)(438002)(199003)(377454003)(189002)(479174004)(24454002)(51704005)(23726002)(50986999)(76176999)(93886004)(5001770100001)(102836002)(22756005)(46102003)(16796002)(66066001)(47776003)(54356999)(46406003)(33656002)(50466002)(106466001)(5003600100002)(87936001)(107886002)(97756001)(2656002)(55846006)(19580395003)(5001970100001)(2950100001)(2920100001)(2900100001)(92566002)(6806004)(189998001)(2501003)(77156002)(19580405001)(62966003)(86362001); DIR:OUT; SFP:1102; SCL:1; SRVR:DM2PR05MB975; H:mx.danahertm.com; FPR:; SPF:Pass; MLV:sfv; A:1; MX:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB975; 2:W1pWOeZIMW5qVEPAFNWCZrURTLs1malKqoKiDgas3+S2BVchix303bXdwGuJUBGO; 2:qDg8DzS9IYHfy/hyZ/jpnUYZ4glF0YBi+i+ErTNM1HE8Lhi4+GFm6qEyczfVN1Z307oqm2aFW3EYwrF/zb82qH5tlvv6Xx0VHfhIgBJwAxrTjAyc2zaeSPWCFJ7R9B330UWYAan9fCpDxD0RKlwtrt5tdt1rvIBw27hIyKhl0cwlkSrgMLcH9lKjGAeG8T6IUbb3wG0iIpexqcfp/9oxUWUbMYq76W8qCi4ZxfIec88=; 6:7OMxx3yQSlUgKL4bdjzUAwWu8kOSL5yFAHNabvJJdQDK1/0TGVM50h5K38jC/hMYmWXmYlyZewSB2t0EnPJhW+ig0oN9YpKgMgQCi3mNOxhn0MGTiw1e0pZMEjitbip0w4ZoT906j2/GlVxuOP5PHX1kYxlfkIOB2xzskvlzuYKyJAucLmjnqw8kZ0g+cGtwh152gzOoKAKDABHBmmzoNxV26na5n5do8/1SJiGLMYhzbGvybBPzZ8N9lsPIQHY9NDgiUCtjfJoo02MW5xAQvmKvBNMXZq77xEGzEX1ZZe4yz+ps/QT0kZsOqv+YXTlQYzkwf8puOSOet+WYpyLme6GYp1tD3NwxEjc6kJNn4G356C6j41s121SB1UJnaWjeiDg6x6odT4mCaFO2KKpoKYLZyM12oO3dUpPuz4WKLBH3scfSgEIKmZWXfyxxqWkg518qilSRIQnkCSxk3CX2+Q6tImuByL6F7xhTJ3wgQLttXEnliprrfsAtvomnFnx+ X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:DM2PR05MB975; X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(520003)(5005006)(3002001); SRVR:DM2PR05MB975; BCL:0; PCL:0; RULEID:; SRVR:DM2PR05MB975; X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB975; 3:UvLXhHbab6mgDzeyGAJ2imNzM8VbtjJJC/13EKkaDgVkBMqbIxXI4zeXoRoVuRX0cH+0j/V9dgNUe/FSa4y+fJtKzaOXjt7kU5PzNvYXSf1tVAzLAq8WT6n509tLQvRX/O3rpoVF1kEtUySJJTouZctOq/qcYjDcCquOIbWwObrBHegStRgUA2PdEs4gaZwRoHnk61mvPfThXn4p2qtqTiI2xbFMfY94LzjFiYMtNaD/vVIQhLaA3vyFXczUi3JQR7A6aVmE8Mz/GJMFficuGVotPYBHbmUBUBsrXMJAbYFIqm368izJuoYamxOSUgOH X-Forefront-PRVS: 0608DEDB67 X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; DM2PR05MB975; 9:uEF++KDvXIS7jj0ykIFWqwTiORbg2/eyWy0ew6xL4qt?= =?us-ascii?Q?oPIBR0SZ7GTXhMdMiziegnvOlAasMRA+NHXGhmqTxBeL7Ec0DP3Y5KUtRrOC?= =?us-ascii?Q?1DS8C1EeFOgjRhxxALU/1lAvGr15Dixomyf1/p4TqrqFKwGGueuHK/8FOAVK?= =?us-ascii?Q?9GFfY9u3AmAFmePKMTxk0pROuivmS2aCi70XVUBp0TLRBkZJYUWXOKRuXhfR?= =?us-ascii?Q?kMtXwEJUgHI7ZbXtTKgojkZqJtDeSQOTsqWUqTkWJAlf7VBPIjMxYzev9TBs?= =?us-ascii?Q?3DEuqHdp6okTzypy7k11j8BW2nywFC4LRD0wCEo9SzlMlW+Gz72TnZyvwTuO?= =?us-ascii?Q?TvODLqoKo1J4S4emeO7x7YCUZZxtFcUPlIfNHPhefuKQU2MZ4+E9ryT56/ik?= =?us-ascii?Q?zIR/DjMqeG6Soq3nql0KlIMDLbQ2SE1vkMF90+2CwUxjW5UdGkQs+QjsPsQ/?= =?us-ascii?Q?Xxh+caWWnaq4sH8aS5cHHBspYTeGWS7+U+cGVD+IZW9gWXBVsLlLSzTxOfu9?= =?us-ascii?Q?6qoQbfSFMOxSXmyZDX+eyJ3IoCMP6exOJdd6GEXqhE1nAOfZ2zqOjZmHk5A5?= =?us-ascii?Q?6Zakv+om7xWlRlpybPm8MofTeaV77hi34fkPwUSaesHT16FLOBRN/dgAF60t?= =?us-ascii?Q?UInv1JTIfETJPaUaTqwWiPbp05R+5FoAjDZxHykGb02Sqfx/zdP3azKCRAyu?= =?us-ascii?Q?utP2kU7vYhO6V9C3ie5x1u9TAHCD3AGofsf36R5n/klkkT+PP29wJZ+7DHN9?= =?us-ascii?Q?1lxiri7U42QbNJdc8XaGGYTHFpHQgxertFPz2FPrtkOq8WpZ56eOmgnSjs3q?= =?us-ascii?Q?BdRckkoAQ0Y0utmG0EuTpOAsd6sJGcOac0KOd1tdMg0Ij6mCQUuKbxVbQzdJ?= =?us-ascii?Q?JnAhgBGLuucXicrWGUxICIrgEm71K1LqTyk01fm6J0H5MJI10xiibu71JdMU?= =?us-ascii?Q?Tf8mK1WfqdzBKGvaQUolFgT+CWrcHxZgh5e/S5JYi1VkbqykOCRARKCQ86ui?= =?us-ascii?Q?GiEEgJBQMkejKKk6pwjeIpaYlvvZdhh1TtS44gYqGrvXFg3WqkZ/dpxY8BSG?= =?us-ascii?Q?kGuGWK20tQb3AdLAQO+Uz7whBR2vGaxcN9AIIEngQoV36a4HSJ5VU5T8r5i7?= =?us-ascii?Q?eRsI1EQY=3D?= X-Microsoft-Exchange-Diagnostics: 1; DM2PR05MB975; 3:IUVKt4fX5uuqKTOL4KdHD5eRiL0f9cqP/iO2NeqWs6d41LoCBLHdeNwEQ5iZ8xFMfaYMa+iOqaQ/xCRxmkLBKSlQCqCjnaUdOcQhdcn0oG1Ap8sQ9/AJ2nTkSGNFJUpLtSh6l6hHk6Ir1snNO15i3Q==; 10:gYn1VqanA/J2ccUVxMXhyDPPsOH2bepKLIrALuDcwMaJX9b7rEOVVt59WpyviqAzDek3Ql0EkTjFoBJI9p1jcXYXk+a3OeSNOuCkiIm//24=; 6:ITcayOlY7zgWuWMdAYAK4GfZtgonsD4pD/0u9STuHBCfikCmO4nncbwEpuUfTWnk X-OriginatorOrg: tekcomms.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Jun 2015 07:04:19.4166 (UTC) X-MS-Exchange-CrossTenant-Id: 937985d5-3f80-4fc9-be29-0bccc11e8b77 X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=937985d5-3f80-4fc9-be29-0bccc11e8b77; Ip=[192.65.42.18]; Helo=[mx.danahertm.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM2PR05MB975 Subject: Re: [dpdk-dev] Poor Virtio PMD TX Performance X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Jun 2015 07:04:22 -0000 Hi Jason, The same results by adding "vhostforce=3Don" -device virtio-net-pci,netdev=3Dpublic1,mac=3D00:0c:29:e1:ff:ff,ioeventfd= =3Don -netdev tap,id=3Dpublic1,ifname=3Dtapvm02,script=3D/home/geo/tzhou/kv= m-image/ovs.sh,downscript=3D/home/geo/tzhou/kvm-image/ovs_down.sh,vhostforc= e=3Don,vnet_hdr=3Don Or -device virtio-net-pci,netdev=3Dpublic1,mac=3D00:0c:29:e1:ff:ff,ioeventfd= =3Don -netdev tap,id=3Dpublic1,ifname=3Dtapvm02,script=3D/home/geo/tzhou/kv= m-image/ovs.sh,downscript=3D/home/geo/tzhou/kvm-image/ovs_down.sh,vhostforc= e=3Don,vhost=3Don,vnet_hdr=3Don -----Original Message----- From: Jason Wang [mailto:jasowang@redhat.com]=20 Sent: Friday, June 12, 2015 5:46 PM To: Zhou, Tianlin; dev@dpdk.org; Ouyang, Changchun Subject: Re: [dpdk-dev] Poor Virtio PMD TX Performance On 06/12/2015 05:35 PM, Zhou, Tianlin wrote: > Hi Changchun, > > Thanks for your response. > Please see my embedded comments. > > What kind of vhost in your test? Linux vhost or dpdk user space vhost? > [tzhou] We use Linux vhost. > > Do you enable the dump/log in your test? It will decrease perf of vritio. > [tzhou] No, I did not enable dump/log in the performance testing.=20 > I just opened log to debug why drop packets and then close it for higher = performance. > > > Which version of dpdk codes are you using? The tip codes in dpdk.org? > [tzhou] I used DPDK 2.0.0 and l2fwd in DPDK 2.0.0. > l2fwd start command: ./l2fwd -c 0x2 -n 1 --p 0x1 > > qemu start command (I used the virtio interface for RX/TX in GUEST):=20 > sudo kvm -m 4096M -smp 4 -hda /home/geo/yanghe/fedora20.qcow2 -boot d=20 > -daemonize -monitor \ telnet::10024,server,nowait,nodelay \ -cpu host=20 > \ -device e1000,netdev=3Dpublic0,mac=3D00:0c:29:e1:f3:ff -netdev=20 > user,id=3Dpublic0,hostfwd=3Dtcp::11022-:22 \ -device=20 > virtio-net-pci,netdev=3Dpublic1,mac=3D00:0c:29:e1:ff:ff,ioeventfd=3Don=20 > -netdev=20 > tap,id=3Dpublic1,ifname=3Dtapvm02,script=3D/home/geo/tzhou/kvm-image/tup.= sh, > downscript=3Dno,vhost=3Don To enable vhost for pmd I believe you need use vhostforce=3Don here. > > The qemu version? > [tzhou] > root@dw-2:/home/geo/tzhou/kvm-image# kvm -version QEMU emulator=20 > version 2.0.0 (Debian 2.0.0+dfsg-2ubuntu1.3), Copyright (c) 2003-2008=20 > Fabrice Bellard > > -Tianlin > > -----Original Message----- > From: Ouyang, Changchun [mailto:changchun.ouyang@intel.com] > Sent: Monday, June 08, 2015 10:13 AM > To: Zhou, Tianlin > Cc: Ouyang, Changchun > Subject: RE: Poor Virtio PMD TX Performance > > Hi tianlin, > > What kind of vhost in your test? Linux vhost or dpdk user space vhost? > > Do you enable the dump/log in your test? It will decrease perf of vritio. > > Which version of dpdk codes are you using? The tip codes in dpdk.org? > > The qemu version? > > Thanks for inputs > Changchun > > >> -----Original Message----- >> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Zhou, Tianlin >> Sent: Friday, June 5, 2015 5:23 PM >> To: dev@dpdk.org >> Subject: [dpdk-dev] Poor Virtio PMD TX Performance >> >> Hi there, >> >> We tested TX performance of Virtio PMD by DPDK l2fwd, but found even=20 >> at 60KPPS (720B packet length) TX rate, there is 1/1000 packet dropping = rate. >> The log shows "No free tx descriptors to transmit" in Virtio PMD. >> Increasing TX queues by modifying DPDK l2fwd can decreases packet=20 >> dropping rate, but can't ensure no packet dropping unless=20 >> retransmitting packets that can't be sent successfully. >> Oppositely, RX rate can be 600KPPS without packet dropping. >> >> Test Env >> - Host CPU: 4 cores, 2127.770MHz >> - Host Memory: 8G >> - Host OS: Linux dw-2 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 >> 19:11:08 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux >> - Guest CPU: 4 cores, 2127.770MHz >> - Guest Memory: 4G >> - Guest OS: fedora20 >> >> Anybody here face the same problem? >> >> -Tianlin