From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0084.outbound.protection.outlook.com [207.46.100.84]) by dpdk.org (Postfix) with ESMTP id 4D9B08D91 for ; Thu, 19 Nov 2015 19:36:50 +0100 (CET) Received: from BY1PR03MB1338.namprd03.prod.outlook.com (10.162.109.20) by BY1PR03MB1339.namprd03.prod.outlook.com (10.162.109.21) with Microsoft SMTP Server (TLS) id 15.1.325.17; Thu, 19 Nov 2015 18:36:48 +0000 Received: from BY1PR03MB1338.namprd03.prod.outlook.com ([10.162.109.20]) by BY1PR03MB1338.namprd03.prod.outlook.com ([10.162.109.20]) with mapi id 15.01.0331.019; Thu, 19 Nov 2015 18:36:48 +0000 From: Karmarkar Suyash To: "Patel, Rashmin N" , "dev@dpdk.org" Thread-Topic: DPDK 1.6 and Cisco VIC-NIC pmd fails to initialize with VMWare ESX 5.5 Thread-Index: AdEieuvDguC6M3DMR6qHixKwN05lKAAeYc3wAAD9O8A= Date: Thu, 19 Nov 2015 18:36:47 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=skarmarkar@sonusnet.com; x-originating-ip: [106.51.139.66] x-microsoft-exchange-diagnostics: 1; BY1PR03MB1339; 5:ZLJnTIvUa3i+/ViGnyNvHOasfgtBa7U3qz4QL8VIIF5htcNVfMw4mqmrDeYBfYXhuIXQyScajlKiGqGA9uT2dmbv3aOZ9UCYG+w+JlMo4TpV5Ft3SpcNQwzqvKGOb8/+43jt9gEKzmcXdsXxz+L8Hw==; 24:wJkL5c3AIZ1eQ2RjPxAhW5fqMO/PHuz4pC5MseaMc6OGZc5B4sSZwN8uLXI6qKEM9FFGKAbBOuQt6FOzC+7iK34s8JYh45dLDpGH33ZcCn4=; 20:JYzA7J7jdymd9Lg/MtKYbbZdeZElD8YVPti1nMpeE8ZipnJxOyk7SYI98NQyAaogJDmiH4+l/juKQQTu7S+Lgg== x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY1PR03MB1339; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(520078)(5005006)(3002001)(10201501046); SRVR:BY1PR03MB1339; BCL:0; PCL:0; RULEID:; SRVR:BY1PR03MB1339; x-forefront-prvs: 07658B8EA3 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(199003)(377454003)(53754006)(189002)(164054003)(13464003)(66066001)(106356001)(5007970100001)(97736004)(99286002)(6116002)(105586002)(50986999)(2501003)(5002640100001)(101416001)(33656002)(54356999)(76176999)(189998001)(5001770100001)(5004730100002)(5001960100002)(3846002)(74316001)(102836003)(40100003)(81156007)(122556002)(11100500001)(2900100001)(5008740100001)(10400500002)(86362001)(586003)(107886002)(5003600100002)(77096005)(87936001)(92566002)(19580405001)(19580395003)(2950100001)(76576001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY1PR03MB1339; H:BY1PR03MB1338.namprd03.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: sonusnet.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: sonusnet.com X-MS-Exchange-CrossTenant-originalarrivaltime: 19 Nov 2015 18:36:47.9926 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 29a671dc-ed7e-4a54-b1e5-8da1eb495dc3 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR03MB1339 Subject: Re: [dpdk-dev] DPDK 1.6 and Cisco VIC-NIC pmd fails to initialize with VMWare ESX 5.5 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Nov 2015 18:36:50 -0000 Thanks Rashmin for the response. The error code is -1 and the box I am doin= g my experiments is Cisco B200-M3 which would support CISCO VNIC 1240 or 13= 40 NIC. The NIC is in hypervisor but what puzzles me is if there is no dep= endency with ESX the NIC initialization should have passed in both ESX vers= ions 5.5 and 6.0.=20 Error is rte_eth_dev_start error =3D -1=20 Regards Suyash -----Original Message----- From: Patel, Rashmin N [mailto:rashmin.n.patel@intel.com]=20 Sent: Thursday, November 19, 2015 11:50 PM To: Karmarkar Suyash ; dev@dpdk.org Subject: RE: DPDK 1.6 and Cisco VIC-NIC pmd fails to initialize with VMWare= ESX 5.5 What is the error code it failed with? There is no dependency between ESXi and DPDK versions as such. But dependin= g your VM settings, it may pop up some issues related to memory assigned to= VM. When you use NIC in Hypervisor and feed packets to VM via Vmxnet3, the gues= t OS can use Vmxnet3-pmd and that's the sole requirement. Guest OS or DPDK = API in VM are unaware and independent of the physical NIC beneath. When you use NIC in VM via Passthrough (or device direct assignment,) the g= uest OS can use ixgbe-pmd/igb-pmd/xyz-pmd to control them for Rx/Tx operati= ons. ESXi can't look into such device operations like it can't see packets = coming in or going out. When you enable SRIOV on a NIC, you get a PF and multiple VFs and if you us= e a NIC-Virtual Function via passthrough, the guest OS can use respective p= md (ixgbevf/igbvf/xyzvf) in DPDK API to control it for Rx/Tx ops. ESXi cont= rol the Physical Function through a respective driver (ixgbe/igb/xyz provid= ed with ESXi) DPDK API doesn't have support to run in ESXi to control that = PF. Thanks, Rashmin -----Original Message----- From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Karmarkar Suyash Sent: Wednesday, November 18, 2015 8:34 PM To: dev@dpdk.org Subject: [dpdk-dev] DPDK 1.6 and Cisco VIC-NIC pmd fails to initialize with= VMWare ESX 5.5 Hello All, I am trying some experiments with DPDK 1.6 and Cisco NIC - (0000:06:00.0 Ne= twork controller: Cisco Systems Inc. Cisco VIC Ethernet NIC [vmnic0]), on t= he guest I am using VMXNET3 as interface/pmd and one weird behavior that is= see is with VMWare ESX 5.5 DPDK is not able to initialize the NIC and I ge= t the error rte_eth_dev_start failed with error code as, but same NIC and w= ith DPDK 1.6 version works fine with VMWare ESX 6.0 and with VMXNET3 PMD. Two questions: 1. Is there any dependency with VMWare version ESX (5.0/5.1/6.0) with D= PDK Release version (1.6/1.7/2.x)? If yes can you please let me know? 2. If we are not using the NIC in pass-through mode and we are using it= via Hypervisor - vmxnet3 or virtio pmd is there still a dependency for the= list of NIC's supported by DPDK? Regards Suyash