From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from tx2outboundpool.messaging.microsoft.com (tx2ehsobe001.messaging.microsoft.com [65.55.88.11]) by dpdk.org (Postfix) with ESMTP id 5349718F for ; Fri, 7 Mar 2014 04:06:50 +0100 (CET) Received: from mail212-tx2-R.bigfish.com (10.9.14.246) by TX2EHSOBE004.bigfish.com (10.9.40.24) with Microsoft SMTP Server id 14.1.225.22; Fri, 7 Mar 2014 03:08:18 +0000 Received: from mail212-tx2 (localhost [127.0.0.1]) by mail212-tx2-R.bigfish.com (Postfix) with ESMTP id 47A402C055D for ; Fri, 7 Mar 2014 03:08:18 +0000 (UTC) X-Forefront-Antispam-Report: CIP:157.56.240.101; KIP:(null); UIP:(null); IPV:NLI; H:BL2PRD0510HT002.namprd05.prod.outlook.com; RD:none; EFVD:NLI X-SpamScore: 2 X-BigFish: VPS2(zz4015Izz1f42h2148h208ch1ee6h1de0h1fdah2073h2146h1202h1e76h2189h1d1ah1d2ah21bch1fc6h1082kzzz2fh109h2a8h839h946hd25he5bhf0ah1288h12a5h12a9h12bdh137ah13b6h1441h1504h1537h153bh162dh1631h1758h18e1h1946h19b5h19ceh1ad9h1b0ah224fh1d0ch1d2eh1d3fh1dc1h1dfeh1dffh1fe8h1ff5h2052h20b3h2216h22d0h2336h2438h2461h2487h24d7h2516h2545h255eh25cch25f6h2605h1155h) Received-SPF: pass (mail212-tx2: domain of juniper.net designates 157.56.240.101 as permitted sender) client-ip=157.56.240.101; envelope-from=nscsekhar@juniper.net; helo=BL2PRD0510HT002.namprd05.prod.outlook.com ; .outlook.com ; X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(10009001)(6009001)(428001)(164054003)(189002)(199002)(87266001)(87936001)(76796001)(76482001)(54356001)(81816001)(95416001)(81686001)(69226001)(82746002)(81342001)(53806001)(2656002)(51856001)(85306002)(74876001)(46102001)(54316002)(97186001)(97336001)(77982001)(74706001)(74502001)(47446002)(83716003)(59766001)(80976001)(83322001)(92566001)(83072002)(76176001)(36756003)(31966008)(86362001)(81542001)(47736001)(50986001)(49866001)(79102001)(74662001)(56816005)(90146001)(74366001)(4396001)(93516002)(33656001)(85852003)(76786001)(95666003)(94946001)(56776001)(65816001)(80022001)(63696002)(66066001)(94316002)(93136001)(47976001)(92726001)(42262001); DIR:OUT; SFP:1101; SCL:1; SRVR:CO2PR05MB778; H:BN1PR05MB279.namprd05.prod.outlook.com; CLIP:66.129.239.13; FPR:BE99F049.AB026E82.61E89DEF.4E86A4C.20227; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received: from mail212-tx2 (localhost.localdomain [127.0.0.1]) by mail212-tx2 (MessageSwitch) id 1394161696261472_5318; Fri, 7 Mar 2014 03:08:16 +0000 (UTC) Received: from TX2EHSMHS040.bigfish.com (unknown [10.9.14.236]) by mail212-tx2.bigfish.com (Postfix) with ESMTP id 328AB140062 for ; Fri, 7 Mar 2014 03:08:16 +0000 (UTC) Received: from BL2PRD0510HT002.namprd05.prod.outlook.com (157.56.240.101) by TX2EHSMHS040.bigfish.com (10.9.99.140) with Microsoft SMTP Server (TLS) id 14.16.227.3; Fri, 7 Mar 2014 03:08:13 +0000 Received: from CO2PR05MB778.namprd05.prod.outlook.com (10.141.226.151) by BL2PRD0510HT002.namprd05.prod.outlook.com (10.255.100.37) with Microsoft SMTP Server (TLS) id 14.16.423.0; Fri, 7 Mar 2014 03:08:12 +0000 Received: from BN1PR05MB279.namprd05.prod.outlook.com (10.141.64.150) by CO2PR05MB778.namprd05.prod.outlook.com (10.141.226.151) with Microsoft SMTP Server (TLS) id 15.0.888.9; Fri, 7 Mar 2014 03:08:11 +0000 Received: from BN1PR05MB279.namprd05.prod.outlook.com ([10.141.64.150]) by BN1PR05MB279.namprd05.prod.outlook.com ([10.141.64.150]) with mapi id 15.00.0893.001; Fri, 7 Mar 2014 03:08:09 +0000 From: Surya Nimmagadda To: "dev@dpdk.org" Thread-Topic: Very low performance with l2fwd in a VM with PCI Passthrough Thread-Index: AQHPObJ3TFpZLMYrpUe/IVsRDi5a4A== Date: Fri, 7 Mar 2014 03:08:09 +0000 Message-ID: <059A249A-F4A5-48BD-A5F0-7C0DA2CAFD2A@juniper.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [66.129.239.13] x-forefront-prvs: 014304E855 Content-Type: text/plain; charset="Windows-1252" Content-ID: <00F55CCACD74714484FB62BF6AA3C55F@namprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: juniper.net X-FOPE-CONNECTOR: Id%0$Dn%*$RO%0$TLS%0$FQDN%$TlsDn% Subject: [dpdk-dev] Very low performance with l2fwd in a VM with PCI Passthrough X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Mar 2014 03:06:50 -0000 Hi, I am seeing very low throughput when I run l2fwd in a VM.=20 When I send 1g data, I could see only about 10mbps of traffic being receive= d by the VM.=20 I dont see this problem when running l2fwd on the host. I could get 10gbps = traffic in and out of both the ports. My setup details are - Traffic coming in on a 10G interface(eth0) and going out on another 10G i= nterface(eth1) - Both 10G NICs are 82599 - Created virtual functions eth5 and eth8 on eth0 and eth1 respectively - eth5 and eth8 are mapped to eth0 and eth1 in a VM, with device type as e1= 000 in Passthru mode. - Host OS : Centos 6.2, Guest OS : Ubuntu 12.04 <=85> Network devices using IGB_UIO driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:00:07.0 '82540EM Gigabit Ethernet Controller' drv=3Digb_uio unused=3De= 1000 0000:00:08.0 '82540EM Gigabit Ethernet Controller' drv=3Digb_uio unused=3De= 1000 <=85> The counters on the virtual interface (eth5/eth8) show all 10g traffic rece= ived, but I see very 10mbps worth traffic at the l2fwd app counters on the = VM. I also see the following logs in the VM dmesg output. [75399.491215] irq 0xb not handled [75400.142025] irq 0xb not handled [75400.142150] irq 0xb not handled [75400.142913] irq 0xb not handled [75400.142920] irq 0xb not handled Has anyone seen this issue? Am I missing anything? Thanks, Surya=