From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from APC01-HK2-obe.outbound.protection.outlook.com (mail-hk2apc01on0060.outbound.protection.outlook.com [104.47.124.60]) by dpdk.org (Postfix) with ESMTP id CBBA629D6 for ; Mon, 4 Jul 2016 14:27:36 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=aricent.onmicrosoft.com; s=selector1-Aricent-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=v9BV/RBhY3+Fszt2oKpk7YSsWk/3cPmBUlDeBJuY6Gw=; b=TffCH1yEb7j6Yl3aIgYuY+qiS8uEOZfvSZPlHihHZYQAQ5YtpALyCCGMHtz9dA8OncBjK7MSjxT6XI4QoiLHPbCG5wjcXJROpOhnYn2Lwzf6mRhmhZ/cg7cIVsMXDhCyrAw9HaisdyZfWW7bDk76zLO2BsqVltXNo2FsbD6wnTQ= Received: from KL1PR0401MB1349.apcprd04.prod.outlook.com (10.165.214.19) by KL1PR0401MB1350.apcprd04.prod.outlook.com (10.165.214.20) with Microsoft SMTP Server (TLS) id 15.1.528.16; Mon, 4 Jul 2016 12:27:34 +0000 Received: from KL1PR0401MB1349.apcprd04.prod.outlook.com ([10.165.214.19]) by KL1PR0401MB1349.apcprd04.prod.outlook.com ([10.165.214.19]) with mapi id 15.01.0528.022; Mon, 4 Jul 2016 12:27:33 +0000 From: Abhishek Mahajan To: "dev@dpdk.org" CC: "Addepalli, Srinivasa R" , "RakeshX Contact" Thread-Topic: Low packet generation rate of 526kpps using pktgen-dpdk from inside VM Thread-Index: AdHV7zO7thADPE3yS5isjmW+0fvMjA== Date: Mon, 4 Jul 2016 12:27:33 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=abhishek.mahajan@aricent.com; x-originating-ip: [165.225.104.71] x-ms-office365-filtering-correlation-id: 954ec087-fe77-4bb4-82ff-08d3a4069367 x-microsoft-exchange-diagnostics: 1; KL1PR0401MB1350; 6:1EHMJsPre3PlSPCGbV+8v3kTGuaf7qGvQbY2jHG92h5XOgURh9zYiiOCIfsyhiCx/zfn+lz1p7yN9P9HnPfEU+d1/TzeAgdkLnkWpod6oa3DPIicGPvd4PS2U7QYpQNv+oWRJY2NxfnWuK/0qVPXhFez6hFniz+fLu3ZruG7v/fHyedtrA1ysaeHhhe1HiZHZCFxVSemK6HgjE0l4oJm8x/leHDRwdgQx9O0iMUSRoLA8aHBzAaUJEdwzWOhRXsT0mEj82peb7r165iJ8vk4SDN/zFv+nrWy7ffJ5ELR6NRP+WKXO5DftwtyF2Q/wybzfsS6yTYd2OAyiqJCYUgamA==; 5:piwR80cq5HHd817q1ULIQtBDXU/W+8MCASQTqhFdRLH54bh0WwuweLghRSZ0NOKtAakx+iZYJzTQ562wfY/SxgIYWDFDLfSrEW6TCZQf1I6nVd903e99p/XzPjR1aWOE0w9FVEColfqhYWu/DCOTVw==; 24:x4bizlLl+RPiQjBBwNAUym+95rRcFdJPsoVvrgivy2W2RiPnGIYVneF+eO2HQbOyC+RacZOF50+R6yrJeAsLEYA21zN1+i4+QVRGIrMVmKM=; 7:YNfl0CXO72ePZjJd//jrtKIAGoddg+V1uzG72Xv/X05d4GCA/gcQOoGC30JrmRUuH2pXsN4nJBf0uWlElBIm6SQs5u3zBQVGbdFUhDSQ2K1noyt++OKOImG22UlNm6ti/C3INk9bW/2g7IahkbleHpRP/d+Q49tYyal1Y6zrBGXzIGfYHapbg+AVD2p5DeZ9dbitDE99ZH0zoevL05FTCoIT+kEefEF56/YO+DeFNKZChT103x2731LHAN106LwQ x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:KL1PR0401MB1350; x-ld-processed: dbb4cbbe-57c5-469d-b342-a9814e1d2382,ExtAddr x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155)(17755550239193); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6055026); SRVR:KL1PR0401MB1350; BCL:0; PCL:0; RULEID:; SRVR:KL1PR0401MB1350; x-forefront-prvs: 0993689CD1 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(189002)(38564003)(199003)(790700001)(6116002)(102836003)(3846002)(68736007)(586003)(66066001)(1730700003)(81156014)(8676002)(81166006)(105586002)(106356001)(76576001)(5640700001)(110136002)(5630700001)(2501003)(2351001)(5002640100001)(229853001)(189998001)(19580395003)(4326007)(86362001)(97736004)(3660700001)(19625215002)(19300405004)(16236675004)(3280700002)(101416001)(2900100001)(87936001)(15975445007)(77096005)(9686002)(7846002)(2906002)(9326002)(122556002)(33656002)(74316002)(7736002)(5003600100003)(7696003)(92566002)(10400500002)(8936002)(50986999)(54356999)(16453002); DIR:OUT; SFP:1101; SCL:1; SRVR:KL1PR0401MB1350; H:KL1PR0401MB1349.apcprd04.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: aricent.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: Aricent.com X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Jul 2016 12:27:33.6483 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: dbb4cbbe-57c5-469d-b342-a9814e1d2382 X-MS-Exchange-Transport-CrossTenantHeadersStamped: KL1PR0401MB1350 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] Low packet generation rate of 526kpps using pktgen-dpdk from inside VM X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2016 12:27:37 -0000 Hi, With pktgen-dpdk inside VM, it is observed that packet TX rate (526Kpps wit= h 64byte size) is very low. How can higher packet rates be achieved ? On enabling logs of virtio pmd in DPDK, getting following logs in syslogs: PMD: virtio_xmit_pkts() tx: No free tx descriptors to transmit Two PC setup having configuration as follow: -> Xeon Processor : Intel(R) Xeon(R) CPU E5-2603 v3 @ 1.60GHz having 6 cor= es. -> RAM : 16GB ->One PC is generating traffic other is receiving the packets using pktgen = tool. The two PC are connected directly with 10G Ethernet interface. Generation side PC - Host -> 2 cores dedicated to OVS-DPDK -> 1 core is free for Linux kernel -> OS: Ubuntu 14.04 -> Linux kernel : 3.13.0-85-generic -> DPDK version : 2.2.0 -> OVS version : 2.5.0 -> VFIO driver for port binding VM - Total 3 cores -> 2 cores for pktgen -> 1 core for Linux kernel -> OS: Ubuntu 15.04 -> Linux kernel : 3.19.8 -> DPDK version : 16.04 -> Pktgen version : 3.0.00 -> UIO driver for port binding DPDK, OVS and pktgen are build using - x86_64-ivshmen-linuxapp-gcc option. VM launched through following Qemu command : * qemu-system-x86_64 --enable-kvm -smp 3 -cpu host -m 2048 -chardev= socket,id=3Dcharnet0,path=3D/var/run/openvswitch/vhost-user1 -netdev type= =3Dvhost-user,id=3Dhostnet0,chardev=3Dcharnet0,vhostforce=3Don -device virt= io-net-pci,netdev=3Dhostnet0,mac=3D16:fa:13:26:31:1b -object memory-backend= -file,id=3Dmem,size=3D2048M,mem-path=3D/dev/hugepages,share=3Don -numa node= ,memdev=3Dmem -mem-prealloc -hda /home/aricent/ubuntu_15_04.img Pktgen is launched using following command: Pktgen -c -0x3 -n 4 -m 512 -b 000:00:04.0 - p 0x3 -t -m "[1= :1].0" OVS command used: * /usr/sbin/ovs-vswitchd --dpdk -c 0xc -n 4 -m 2048 -- unix:/var/ru= n/openvswitch/db.sock -vconsole:emer -vsyslog:err -vfile:info --mlockall --= no-chdir --log-file=3D/var/log/openvswitch/ovs-vswitchd.log --pidfile=3D/va= r/run/openvswitch/ovs-vswitchd.pid --detach -monitor Thanks & Regards Abhishek "DISCLAIMER: This message is proprietary to Aricent and is intended solely = for the use of the individual to whom it is addressed. It may contain privi= leged or confidential information and should not be circulated or used for = any purpose other than for what it is intended. If you have received this m= essage in error, please notify the originator immediately. If you are not t= he intended recipient, you are notified that you are strictly prohibited fr= om using, copying, altering, or disclosing the contents of this message. Ar= icent accepts no responsibility for loss or damage arising from the use of = the information transmitted by this email including damage from virus."