From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EX13-EDG-OU-002.vmware.com (ex13-edg-ou-002.vmware.com [208.91.0.190]) by dpdk.org (Postfix) with ESMTP id 7F5884AC7 for ; Thu, 28 Jul 2016 02:38:01 +0200 (CEST) Received: from sc9-mailhost1.vmware.com (10.113.161.71) by EX13-EDG-OU-002.vmware.com (10.113.208.156) with Microsoft SMTP Server id 15.0.1156.6; Wed, 27 Jul 2016 17:37:22 -0700 Received: from EX13-CAS-001.vmware.com (ex13-cas-001.vmware.com [10.113.191.51]) by sc9-mailhost1.vmware.com (Postfix) with ESMTP id 19643184A1; Wed, 27 Jul 2016 17:37:59 -0700 (PDT) Received: from EX13-CAS-005.vmware.com (10.113.191.55) by EX13-MBX-028.vmware.com (10.113.191.48) with Microsoft SMTP Server (TLS) id 15.0.1156.6; Wed, 27 Jul 2016 17:37:58 -0700 Received: from NAM03-CO1-obe.outbound.protection.outlook.com (10.113.170.11) by EX13-CAS-005.vmware.com (10.113.191.55) with Microsoft SMTP Server (TLS) id 15.0.1156.6 via Frontend Transport; Wed, 27 Jul 2016 17:37:58 -0700 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=onevmw.onmicrosoft.com; s=selector1-vmware-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=sMIPJpCug1TqDt5FdzSAAAP4EG6msIoJ8jUWzu2fPD0=; b=GyK/fizCN80s2iyBeDWQ6x627hnrk3w3uXPkz6SkAaVezayG7bYPGTf/pfAHUIl0DlS9DAOKgZ1/asjktkCDmbmuvKl9YIuNskYa+Orn42JC7KslN9kv4MRcPM9Ot1c9f2DE2q6jTxycPt4Ii6qaaZN76ioToS91tCONdEpBYU0= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=yongwang@vmware.com; Received: from htb-2s-eng-dhcp206.eng.vmware.com (208.91.1.34) by CY1PR05MB2364.namprd05.prod.outlook.com (10.166.193.13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.5; Thu, 28 Jul 2016 00:37:50 +0000 Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) From: Yong Wang In-Reply-To: Date: Wed, 27 Jul 2016 17:29:50 -0700 CC: Mauricio Vasquez , Aaron Conole , , "dev@dpdk.org" Content-Transfer-Encoding: quoted-printable Message-ID: <0F35E25E-977D-4054-AC3B-A36F4DFE875F@vmware.com> References: <578FCAB6.3050403@polito.it> <57909938.8030402@polito.it> <579495C1.5030506@polito.it> <5797909B.6090208@polito.it> To: sothy shan , X-Mailer: Apple Mail (2.3124) X-Originating-IP: [208.91.1.34] X-ClientProxiedBy: BY1PR13CA0029.namprd13.prod.outlook.com (10.162.107.167) To CY1PR05MB2364.namprd05.prod.outlook.com (10.166.193.13) X-MS-Office365-Filtering-Correlation-Id: f92e77f6-f166-4bad-045b-08d3b67f67de X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB2364; 2:DbqoY3GU2FmisV+Dq9ROun+FLTFlqPe3cbldtr1xjHgdYo3jNgjDD9GciF/07W2811sBoohT9fgx4TEJjD/Ld1MvMTaiJO8W8khbLKQdYzC8Uw3tUuqSQY4Hl6hF5AW7cRqpZGdCM6mC5Vsa/OqrfwH9okqTQgZPfq926fHprbZ/UIEG1pAw7yRkvwvldAkD; 3:30EdO2kjbyK+x97azCiMAhfY3pIlrUImvASqaz/LWqvn4yP5cd6+SlBbMbdIuMsRLgtXr+BXOCTutThJGKv1XHvVn6InZ3oHS6bqE/lj8Gi+lC8ROzHfLMDDFFv6Rh2z; 25:6BdExiAy6h734DuocgwkgXrIBHLJZdSZkK9KRfE6GMfXXjIiLqubTmRkAJShbZQRckIgwqlrvzNFGEEhUX65c2E6sCJqnkAoxA8aDhIo2EUU/qudgdxf9JY7LU0lqV998HkgnpSFlAAfl0wly7abtV9z4j7uVzxtAtwr0qXV5ImBsBQjMemZzBhO6Bzv1fmTO91h9rv9xa6O0Y55X6kPhfAe9tq0aL+jcSBg0wVrr/s8+KIuK7JrqcteTcKQTBWEcoYP3BKkkLE9lgaZkEWEtJJV7kRy0yqtJP0BW2IOEX3gB5zC292PkkhsyawFdUtxGkVdcLpYZUy1J+CeWmeyAbM1OZZ/DhNpWYB8Afz4xzIg4UPIY2/w7AOe9f5sfYg0B5jYVuASg622se7cYWb2Lj4pmd9d62iUCj7JZv6bOGA=; 31:gVz+XPcSyB8U4Cx1eQPqCJ7qj8rHLp2hFL83eKZft7nxtyrha+nhxA+1P6ductER6VOls8IZ1fX7Kbqgi1/CFhoAownyR5v0clOD/9t7srgDcJ4FIlxGg0N/vLcM0Mmg2zrp+YunfFTLlWKCnMeSGgIFRYoopIb2OqzMYi34Ccbw2FNL456lPjsxMQM+DPHFIMwC3p6tXNIlntw1kfnW kw== X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CY1PR05MB2364; X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB2364; 20:6798LTacPmStLZATbdzVkdoTJ121aveB4SgrNKC2Dy6BDq4O1WXNC3wD0/liOL4cliQL0HBi2YZ+/LALXXTnutvZgGC/7DXSq7p/ahXZj9JKCaNJgX3npqDPxl3ZZ15bnWAsDCk4jDWnlBxu7aL4mzanxN3hBHI8sO136lKTvy3SeeMgzeqK4lFLjHQDNmrzLmiy3skpybrlLLKKn1b2oZp31UcZy4hqaLAWfOw9gjp60/L0WXVqyyvkQU8kjRTH; 4:Yh7+Ya/hQGu3QKpfCn1lU28zvQRed1Vrw4DObP8JKifzObooeYXEYtlHcTgdj6p4Rpp6W4RXhyomeXct2I/f4S3K2iz9k/K8FxYfttje897o4MIE/s0m84IUEUML3rFeEsaLK2GedK8ryFade3e+dEzAx2fs8r0a230PgWafnKchJCiuwOdE9kC8Og6gObjMq92Tget0JQGmeKurLvIIu7qPgFQ8z7Ox4RO82mwc3bh+YDWKex8PN37LMdwF2boQEEHlEiuiM42W8EX2EqJAFZKR7hbp8KgZC8Lc5zBg+IcdprGyNtxYP71fymfb40PU0JUkzh1Xn6XfbrCm02G9WJrCD3xSvHeaPPy/cEX0BEYvHUazA3UsC1u0U6yCv3TupcjTXNkV2L+IHW5i7r5gh7Dpvl1vUS5O77vua0+iKlq5adbNI85Jfv4pTuPPEoDrXc3AzrsVuvIrToc1wBA2x20f3kAFQUcWTNOY+WriZbs= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(61668805478150)(10436049006162)(216315784871565); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001); SRVR:CY1PR05MB2364; BCL:0; PCL:0; RULEID:; SRVR:CY1PR05MB2364; X-Forefront-PRVS: 00179089FD X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(7916002)(76274002)(45984002)(199003)(24454002)(53754006)(377454003)(189002)(36756003)(97736004)(15975445007)(19580395003)(2950100001)(19580405001)(50466002)(57306001)(7736002)(50986999)(76176999)(47776003)(68736007)(5001770100001)(575784001)(77096005)(66066001)(42186005)(33656002)(86362001)(50226002)(92566002)(106356001)(93886004)(101416001)(23676002)(83716003)(31430400001)(189998001)(7846002)(2906002)(82746002)(8676002)(3846002)(8746002)(4001450100002)(81166006)(586003)(6116002)(105586002)(4326007)(305945005)(81156014)(7099028)(83133001)(44473003)(104396002); DIR:OUT; SFP:1101; SCL:1; SRVR:CY1PR05MB2364; H:htb-2s-eng-dhcp206.eng.vmware.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (EX13-EDG-OU-002.vmware.com: yongwang@vmware.com does not designate permitted sender hosts) Received-SPF: None (protection.outlook.com: vmware.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtDWTFQUjA1TUIyMzY0OzIzOmpnM2N2VHV1YkFvMGF6elZIVnBwMlp6TExm?= =?utf-8?B?cGR1bkNKMXN1cnIwS1o5ZU1YSDlBeGtMdHF5aFJmaVloQVVPbEdaSWVDemJr?= =?utf-8?B?anNlOXA4c2hveC9Xd1F6ZmFkSUx4dHZxMXJ2NjAyZG5xMlovVkdpc25MaFZS?= =?utf-8?B?azQ2Q0dFWDdPSTRZeXJ4U3R4TlJuY2YvQzVIUERJTzRkQUs2eFEwZm9aWW1O?= =?utf-8?B?aUMrMVdEQWZwZUtTWVpGb3FGem5jOVozdUxTdFc1ZnNFbnZydnpmT1NIbkRL?= =?utf-8?B?K3BVN1FMeVc3UThBSG1KRHF4Y21odDlOeVdPSVM4dWIwekRxb1pSZUpvMUlP?= =?utf-8?B?ZVpzS29kdmR0dWErakNFQTJNNGFWVUhrY3NQYnlMUGk1RW41UG84OHZNeXUy?= =?utf-8?B?WEZDSkw5WWwxcjdienF2UzlOTUNRTzVBaE5KQkV0RVR4d0c0aFdTbU4wVGkz?= =?utf-8?B?RXVab3RhVC9naDdMS0FUa2Q1ZjlPTkZNMEF3TnROV0cyOTlMWXRjMGZWbnBB?= =?utf-8?B?KzliZ2N6VkhsQlg1TzR2ang1eEgrTUdWKys2Rm0wcnB1dnNBYmdtOWNhWnRW?= =?utf-8?B?aUl6UXRuV29zdkowUzZBb1FqdkQxam9BNXZPdU1SRGtaOENROVRiUC9QVTNY?= =?utf-8?B?ZGpLbEk2c3V6S3M1NnJZWm5EVFh3QWFoWVNaM3BDVUNKWnFOaGtNUWRrNzBt?= =?utf-8?B?Nm1NczV3ckxLWStoM2lZdDBWM1JRY2hyV3MvLzA4Y1NocWpZUGtBS0J3NVMx?= =?utf-8?B?dkllWmUxUHJhY0pzNnZ3VGFWc1FYR3UvUG13QzM2SUFrMGpCK2hCT1JOcWV5?= =?utf-8?B?T0ZzNlUxS29wbFo4Um95SHdyb3hyL0xoS25wVTlsWlVVYVRDRlkrUUp2TEhv?= =?utf-8?B?TkU4TXc5NVRkOXhwejhob3l5VFRMcXN6RlZCMnNGbnBCN0xoTXc4VTRjODVD?= =?utf-8?B?a0FyYURNekVRck9tRlNPY2JTM21tQWx0aGw2Z2RTaGJKM2E1UjVudkNxT1Fw?= =?utf-8?B?UUN2WW9qMStNQm0wNnd2bXpRTGpqdTBCNzJ0N05VNmVDUElYNVEzdFVmVTh3?= =?utf-8?B?UlRLNEFKMWd4L1hEUENCQkVqcExkZ1c0clIxQjA0V24xLzMzV2d3cDhmcEJl?= =?utf-8?B?M2hYU2x1TTVjQVZWVWJpY3VUU3ZSVXl5U0xjbDlsRVg2aE9JdTJWbzNXWXZw?= =?utf-8?B?elNjeVRRRGVlbWpVZTJFTXp5RFd2Z3YwR25tY3pFbnBreWRaMWlNTUpaczFt?= =?utf-8?B?ei9jeGo5RGJlc2JrYk5acTVDd1R1bjJucU11clVSRCs1ZGJ6Tmd6cjFtTnov?= =?utf-8?B?YU5KRkpVeG53R3dyeTBFYUtmRnJ3cXFnMTFSeTY0RGZqcktCK0dIbWxWejFI?= =?utf-8?B?S1oxVEJMcFYyYUlmVEVzcVFERWRvSnFka1pTMUFJanB6cno3YmJSSm1uelhD?= =?utf-8?B?Wm9mSHNkeXUxRFVtSE1VR3VzMHI3MitZcHl5cXRWeEJGY1JCYmx6WWV2eWsw?= =?utf-8?B?L3A2L1Q3U01JMUZZSDBIUG1SL2xENmpoSWFaVnkrUG9pQ3lQWGpwVW5JN3NJ?= =?utf-8?B?S0tCVFdlWVpqbGsxdnhES1dmeEhzY25YSkc1UUhMdmlHSkdqZWxITVJHc3By?= =?utf-8?B?aXd5cDJYUVFJZjhsNlk1c0FJTUlxQXlWdTlrZldBcTc4MHNDdWhBTHhpK3FL?= =?utf-8?B?NFpXQUp1MVU3WTlLUmUzRUFwQ21ZOHJtUXgvNHZhZFJxNkdhK09aUjZobVkr?= =?utf-8?B?REdiYjBQc2tuRy9PZTY5bkw4OFE3ZEI2anhwOUJjSGpLM0FZZjNncVMrYVFG?= =?utf-8?B?RnZkckFrbTREWHh2TW5mQWJPenVSVmduUmZqQThubGd5ejVEUnNxTnE4blha?= =?utf-8?B?SjJxekJ2eDMySUtXeTdBSnRISzRFR3Z3eVBBcjM5d0pkSGpjRmZMZHY5S2ww?= =?utf-8?B?Y0Q0ZUR3NHJ3PT0=?= X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB2364; 6:wLVLjE0yR+CzRC3pG7obshcjX8Sw7vHoxM3BScfp+oA1uS21z0n6DMR2HmsHQU1J+znGkb4eG1Qt8J1FeJ68GN4XVzl5/MhMo7vPPMJDKjVX0+0c9PFPFprecxRksWbullUpMWJhuXdecxnZV7lzlN7C1qObKDXMptmvSzl6sueJ0sHOFNiJjgZIPp3vVuvJfgQ4/JztultvIeVtynLif2t1pcTGuXXR721yhIZzok+g13w1ZkXFR3Zpo5CqJQtKNyJUNKcRW4CoyZYSqn1BZ14Knjr2v3H0O4j2Aqxf4Xo=; 5:c0eKX5/Xb8DEVf24SXSsaUp0sI1jTLuf35hgVhnnkhumClH+3uu9CmpRkWtK08pwGci/QmZWEFIEK4hEraRKRMl8NcKzXKOPAdYzI2BoVHVZe5+pDWoR5vPlb6WNsqj0+Hkt189Ca6fbMa+gK57zvA==; 24:oUv4/anVZFmxeXrcRECnPGifk0jQ+tAihaqKkEbAW3GoPbmfPYzD/BDa1fPGOkeLvFpSzrGsQPIbE3/S7HCM8T1rqGV5jBmfzJCqHVDClGI=; 7:MEwAx66e/nsPF2mVi8TuaiaC9BoMIF2GtjphlhziyigXXbdbRAQIF78mvy0NwiBh4psjT4sjDA4M4sR3mORySWLEEUzbTOOELkPt5evjNMpVfv95bHLHCm2v9cl0FjgVw1rSg63k/1BkEA6NZ2r3+zXsmPTo0MsjD0qQRnL4KODm1gcPahcugViO0pesbn06DP2JgRkL7MlTi+N6/7IAX9YfO4Q2wKEvjA8NYRXc9lC/brkOLYUKASB0OxqjyZkv SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; CY1PR05MB2364; 20:PJU/2v4C4pzKv54K9bgNGiGIe/ndpO5w1XIBUWuKW3ndELsKkGpoyLZdv0NlfxbgQ13cNun3lT/YxJ3CETmIsiGo8tCk/xHDLJ37xi3IL9IArDmDG+VBvgzb7d2s8hHcbJJvLLOfpOcjTtXEnX/jTQGptr/0qp2dl2Xh1Wmc2Lc= X-MS-Exchange-CrossTenant-OriginalArrivalTime: 28 Jul 2016 00:37:50.2761 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY1PR05MB2364 Subject: Re: [dpdk-dev] [ovs-discuss] OVS DPDK|DPDK|ERR|interface dpdk0 start error:operation not permitted. X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jul 2016 00:38:02 -0000 > On Jul 27, 2016, at 12:25 AM, sothy shan wrote: >=20 > On Tue, Jul 26, 2016 at 6:32 PM, Mauricio Vasquez > wrote: >> Hello Sothy, >>=20 >> Sorry for the delay in answering, some busy days here. >>=20 >>=20 >> On 07/25/2016 12:03 PM, sothy shan wrote: >>>=20 >>> Hello Mauricio, >>>=20 >>> On Sun, Jul 24, 2016 at 12:17 PM, Mauricio Vasquez >>> wrote: >>>>=20 >>>> Hi Sothy, >>>>=20 >>>>=20 >>>> On 07/21/2016 11:55 AM, sothy shan wrote: >>>>>=20 >>>>> On Thu, Jul 21, 2016 at 11:43 AM, Mauricio Vasquez >>>>> wrote: >>>>>>=20 >>>>>>=20 >>>>>> On 07/21/2016 10:51 AM, sothy shan wrote: >>>>>>>=20 >>>>>>> On Thu, Jul 21, 2016 at 10:41 AM, sothy shan = >>>>>>> wrote: >>>>>>>>=20 >>>>>>>> On Wed, Jul 20, 2016 at 9:02 PM, Mauricio Vasquez >>>>>>>> wrote: >>>>>>>>>=20 >>>>>>>>> Hi Sothy, >>>>>>>>>=20 >>>>>>>>> On 07/20/2016 07:40 PM, Aaron Conole wrote: >>>>>>>>>>=20 >>>>>>>>>> sothy shan writes: >>>>>>>>>>=20 >>>>>>>>>>> Hello all, >>>>>>>>>>=20 >>>>>>>>>> Hi Sothy, >>>>>>>>>>=20 >>>>>>>>>>> I followed the installion guide provided in the web site >>>>>>>>>>>=20 >>>>>>>>>>> = https://urldefense.proofpoint.com/v2/url?u=3Dhttps-3A__github.com_openvswi= tch_ovs_blob_master_INSTALL.DPDK.md-23ovstc&d=3DCwIBaQ&c=3DSqcl0Ez6M0X8aeM= 67LKIiDJAXVeAw-YihVMNtXt-uEs&r=3D44mSO5N5yEs4CeCdtQE0xt0F7J0p67_mApYVAzyYm= s0&m=3DvpaHcL64W3vOTY9P8yRZOdCJzbL_oWzZH6J2u4iT614&s=3DojiXK7Tj1ANsHE_Alch= VROP4R7LrgLQqVqTx7BjJQas&e=3D=20 >>>>>>>>>>> to install dpdk OVS. >>>>>>>>>>>=20 >>>>>>>>>>> I am rurnning Ubuntu 14.04 (kernel 3.13). It is a VM running >>>>>>>>>>> VMware. >>>>>>>>>>> One intereface is enabled by VMXNET3. >>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>>> It is not clear for me, are you trying to install OvS within = the VM? >>>>>>>>>=20 >>>>>>>>>>> I used dpdk 16.04 >>>>>>>>>>> Today I made clone of OVS (committ >>>>>>>>>>> :bf32e3e2c029da18b5d6fd9210cb0ea12a1d0383). >>>>>>>>>>>=20 >>>>>>>>>>> The following are different configuration compared to above = link. >>>>>>>>>>>=20 >>>>>>>>>>> sysctl -w vm.nr_hugepages=3D2048 >>>>>>>>>>> Binded interface via igb_uio. >>>>>>>>>>>=20 >>>>>>>>>>> Then followed same configuration to start ovs-vsswitch with = dpdk. >>>>>>>>>>=20 >>>>>>>>>> Can you please post the steps exactly that you followed? = Which >>>>>>>>>> user >>>>>>>>>> you >>>>>>>>>> were running as, etc? Can you also post how you expect = packets to >>>>>>>>>> arrive into the vm? >>>>>>>>>>=20 >>>>>>>>>>> I am able to creatre bridge. When I create a port. It gives = error >>>>>>>>>>> message. >>>>>>>>>>=20 >>>>>>>>>> Please show the steps for this, too. The exact commands you = used. >>>>>>>>>>=20 >>>>>>>>>>> When I check ovs-vswitchd.log file, >>>>>>>>>>>=20 >>>>>>>>>>> There is warning that dpif_netlink|WARN|genric netlink = family, >>>>>>>>>>> ovs_datapath does not exist. The openvswitch kernel module = may be >>>>>>>>>>> not >>>>>>>>>>> loaded. >>>>>>>>>>=20 >>>>>>>>>> This is definitely a problem. How did you start the = ovs-vswitchd >>>>>>>>>> daemon? >>>>>>>>>=20 >>>>>>>>>=20 >>>>>>>>> This is not a problem Aaron, the ovs kernel module is not = needed >>>>>>>>> when >>>>>>>>> ovs is >>>>>>>>> compiled with DPDK. >>>>>>>>>>>=20 >>>>>>>>>>> Then ERR: ERR|interface dpdk0 start error:operation not = permitted. >>>>>>>>>>>=20 >>>>>>>>>>> The corresponding port is loaded by dpdk driver as shown in >>>>>>>>>>> dpdk_nic_bind --status. >>>>>>>>>>>=20 >>>>>>>>>>> After that I did sudo ovs-vsctl show. it show br and port = details >>>>>>>>>>> as >>>>>>>>>>> well. >>>>>>>>>>> I am able to add one flow rule as well. But ovs bridge didnt = get >>>>>>>>>>> packets from the interface. >>>>>>>>>>>=20 >>>>>>>>>>> Do you know why this error is popup? anyway to solve the = problem? >>>>>>>>>>>=20 >>>>>>>>>>> Thank you very much >>>>>>>>>>>=20 >>>>>>>>>>> Best regars >>>>>>>>>>> Sothy >>>>>>>>>>=20 >>>>>>>>>> _______________________________________________ >>>>>>>>>> discuss mailing list >>>>>>>>>> discuss@openvswitch.org >>>>>>>>>> = https://urldefense.proofpoint.com/v2/url?u=3Dhttp-3A__openvswitch.org_mail= man_listinfo_discuss&d=3DCwIBaQ&c=3DSqcl0Ez6M0X8aeM67LKIiDJAXVeAw-YihVMNtX= t-uEs&r=3D44mSO5N5yEs4CeCdtQE0xt0F7J0p67_mApYVAzyYms0&m=3DvpaHcL64W3vOTY9P= 8yRZOdCJzbL_oWzZH6J2u4iT614&s=3DDZpyuDSP-5BYH4bvfNHk68XRFB9-M-M43FxZCCpZKh= o&e=3D=20 >>>>>>>>>=20 >>>>>>>>> As Aaron wrote, having the exact commands is important to help = you. >>>>>>>>=20 >>>>>>>> My configuration and log info: >>>>>>>>=20 >>>>>>>> sudo sysctl vm.nr_hugepages=3D2048 >>>>>>>> sudo mkdir -p /dev/hugepages >>>>>>>> sudo mount -t hugetlbfs hugetlbfs /dev/hugepages >>>>>>>> sudo modprobe uio >>>>>>>> sudo insmod $DPDK_BUILD/kmod/igb_uio.ko >>>>>>>> sudo $DPDK_DIR/tools/dpdk_nic_bind.py --status >>>>>>>> sudo $DPDK_DIR/tools/dpdk_nic_bind.py -b igb_uio 0000:0b:00.0 >>>>>>>> sudo ./dpdk-16.04/tools/dpdk_nic_bind.py --status >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> Network devices using DPDK-compatible driver >>>>>>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>>>>>> 0000:0b:00.0 'VMXNET3 Ethernet Controller' drv=3Digb_uio = unused=3D >>>>>>>> 0000:13:00.0 'VMXNET3 Ethernet Controller' drv=3Digb_uio = unused=3D >>>>>>>>=20 >>>>>>>> Network devices using kernel driver >>>>>>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>>>>>> 0000:03:00.0 'VMXNET3 Ethernet Controller' if=3Deth0 = drv=3Dvmxnet3 >>>>>>>> unused=3Digb_uio *Active* >>>>>>>>=20 >>>>>>>> Other network devices >>>>>>>> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>>>>>>> >>>>>>>>=20 >>>>>>>> .........Then...................... >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> sudo ovs-vsctl add-port br0 dpdk0 -- set Interface dpdk0 = type=3Ddpdk >>>>>>>> sudo ovs-vsctl add-br br0 -- set bridge br0 = datapath_type=3Dnetdev >>>>>>=20 >>>>>> These two commands are inverted. >>>>>> The bridge has to be created first and then ports have to be = added to >>>>>> it. >>>>>>=20 >>>>> It is my mistake when coping. >>>>>>>>=20 >>>>>>>> Log file/ >>>>>>>> 2016-07-21T07:53:35.527Z|00001|vlog|INFO|opened log file >>>>>>>> /var/log/openvswitch/ovs-vswitchd.log >>>>>>>> 2016-07-21T07:53:35.529Z|00002|ovs_numa|INFO|Discovered 2 CPU = cores >>>>>>>> on >>>>>>>> NUMA node 0 >>>>>>>> 2016-07-21T07:53:35.529Z|00003|ovs_numa|INFO|Discovered 1 NUMA = nodes >>>>>>>> and 2 CPU cores >>>>>>>>=20 >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> = 2016-07-21T07:53:35.529Z|00004|reconnect|INFO|unix:/usr/local/var/run/open= vswitch/db.sock: >>>>>>>> connecting... >>>>>>>>=20 >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> = 2016-07-21T07:53:35.529Z|00005|reconnect|INFO|unix:/usr/local/var/run/open= vswitch/db.sock: >>>>>>>> connected >>>>>>>> 2016-07-21T07:53:35.533Z|00006|dpdk|INFO|DPDK Enabled, = initializing >>>>>>>> 2016-07-21T07:53:35.533Z|00007|dpdk|INFO|No vhost-sock-dir = provided - >>>>>>>> defaulting to /usr/local/var/run/openvswitch >>>>>>>> 2016-07-21T07:53:35.533Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >>>>>>>> --socket-mem 1024,0 -c 0x00000001 >>>>>>>> 2016-07-21T07:53:36.606Z|00009|timeval|WARN|Unreasonably long = 1076ms >>>>>>>> poll interval (80ms user, 875ms system) >>>>>>>> 2016-07-21T07:53:36.606Z|00010|timeval|WARN|faults: 3306 minor, = 0 >>>>>>>> major >>>>>>>> 2016-07-21T07:53:36.606Z|00011|timeval|WARN|context switches: 3 >>>>>>>> voluntary, 101 involuntary >>>>>>>> 2016-07-21T07:53:36.606Z|00012|coverage|INFO|Event coverage, = avg rate >>>>>>>> over last: 5 seconds, last minute, last hour, hash=3D398361de: >>>>>>>> 2016-07-21T07:53:36.606Z|00013|coverage|INFO|bridge_reconfigure >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.606Z|00014|coverage|INFO|cmap_expand >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 9 >>>>>>>> 2016-07-21T07:53:36.606Z|00015|coverage|INFO|miniflow_malloc >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 9 >>>>>>>> 2016-07-21T07:53:36.606Z|00016|coverage|INFO|hmap_pathological >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.606Z|00017|coverage|INFO|hmap_expand >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 640 >>>>>>>> 2016-07-21T07:53:36.606Z|00018|coverage|INFO|txn_unchanged >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>>>>> 2016-07-21T07:53:36.606Z|00019|coverage|INFO|txn_incomplete >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.607Z|00020|coverage|INFO|poll_create_node >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 35 >>>>>>>> 2016-07-21T07:53:36.607Z|00021|coverage|INFO|seq_change >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 38 >>>>>>>> 2016-07-21T07:53:36.607Z|00022|coverage|INFO|pstream_open >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.607Z|00023|coverage|INFO|stream_open >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.607Z|00024|coverage|INFO|util_xalloc >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 11049 >>>>>>>> 2016-07-21T07:53:36.607Z|00025|coverage|INFO|netdev_get_hwaddr >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.607Z|00026|coverage|INFO|netlink_received >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>>>>>> 2016-07-21T07:53:36.607Z|00027|coverage|INFO|netlink_sent >>>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>>> 2016-07-21T07:53:36.607Z|00028|coverage|INFO|86 events never = hit >>>>>>>> 2016-07-21T07:53:36.607Z|00029|bridge|INFO|ovs-vswitchd (Open >>>>>>>> vSwitch) >>>>>>>> 2.5.90 >>>>>>>> 2016-07-21T07:54:50.861Z|00030|memory|INFO|18980 kB peak = resident set >>>>>>>> size after 75.3 seconds >>>>>>>> = 2016-07-21T07:54:50.866Z|00031|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath supports recirculation >>>>>>>> = 2016-07-21T07:54:50.866Z|00032|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> MPLS label stack length probed as 3 >>>>>>>> = 2016-07-21T07:54:50.866Z|00033|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath supports truncate action >>>>>>>> = 2016-07-21T07:54:50.866Z|00034|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath supports unique flow ids >>>>>>>> = 2016-07-21T07:54:50.866Z|00035|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath does not support ct_state >>>>>>>> = 2016-07-21T07:54:50.866Z|00036|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath does not support ct_zone >>>>>>>> = 2016-07-21T07:54:50.866Z|00037|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath does not support ct_mark >>>>>>>> = 2016-07-21T07:54:50.866Z|00038|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath does not support ct_label >>>>>>>> = 2016-07-21T07:54:50.866Z|00039|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>>> Datapath does not support ct_state_nat >>>>>>>> 2016-07-21T07:54:50.875Z|00040|bridge|INFO|bridge br0: added >>>>>>>> interface >>>>>>>> br0 on port 65534 >>>>>>>> 2016-07-21T07:54:50.887Z|00041|dpif_netlink|WARN|Generic = Netlink >>>>>>>> family 'ovs_datapath' does not exist. The Open vSwitch kernel = module >>>>>>>> is probably not loaded. >>>>>>>> 2016-07-21T07:54:50.887Z|00042|bridge|INFO|bridge br0: using = datapath >>>>>>>> ID 0000c664fbd86348 >>>>>>>> 2016-07-21T07:54:50.887Z|00043|connmgr|INFO|br0: added service >>>>>>>> controller "punix:/usr/local/var/run/openvswitch/br0.mgmt" >>>>>>>> 2016-07-21T07:58:18.796Z|00044|dpdk|INFO|Port 0: = 00:0c:29:b5:9f:5b >>>>>>>> 2016-07-21T07:58:18.810Z|00045|dpdk|ERR|Interface dpdk0 start = error: >>>>>>>> Operation not permitted >>>>>>>> 2016-07-21T07:58:18.810Z|00046|dpif|WARN|netdev@ovs-netdev: = failed to >>>>>>>> add dpdk0 as port: Operation not permitted >>>>>>>> 2016-07-21T08:10:35.440Z|00047|connmgr|INFO|br0<->unix: 1 = flow_mods >>>>>>>> in >>>>>>>> the last 0 s (1 adds) >>>>>>=20 >>>>>> Could you also provide the full terminal output when you run >>>>>> ovs-vswitchd?, >>>>>> I would like to see the DPDK output >>>>>=20 >>>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vswitchd = unix:$DB_SOCK >>>>> --pidfile --detach = --log-file=3D/var/log/openvswitch/ovs-vswitchd.log >>>>> 2016-07-21T09:33:35Z|00001|vlog|INFO|opened log file >>>>> /var/log/openvswitch/ovs-vswitchd.log >>>>> 2016-07-21T09:33:35Z|00002|ovs_numa|INFO|Discovered 2 CPU cores on = NUMA >>>>> node 0 >>>>> 2016-07-21T09:33:35Z|00003|ovs_numa|INFO|Discovered 1 NUMA nodes = and 2 >>>>> CPU >>>>> cores >>>>>=20 >>>>>=20 >>>>> = 2016-07-21T09:33:35Z|00004|reconnect|INFO|unix:/usr/local/var/run/openvswi= tch/db.sock: >>>>> connecting... >>>>>=20 >>>>>=20 >>>>> = 2016-07-21T09:33:35Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswi= tch/db.sock: >>>>> connected >>>>> 2016-07-21T09:33:35Z|00006|dpdk|INFO|DPDK Enabled, initializing >>>>> 2016-07-21T09:33:35Z|00007|dpdk|INFO|No vhost-sock-dir provided - >>>>> defaulting to /usr/local/var/run/openvswitch >>>>> 2016-07-21T09:33:35Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >>>>> --socket-mem 1024,0 -c 0x00000001 >>>>> EAL: Detected lcore 0 as core 0 on socket 0 >>>>> EAL: Detected lcore 1 as core 0 on socket 0 >>>>> EAL: Support maximum 128 logical core(s) by configuration. >>>>> EAL: Detected 2 lcore(s) >>>>> EAL: Probing VFIO support... >>>>> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file = or >>>>> directory) >>>>> EAL: VFIO modules not loaded, skipping VFIO support... >>>>> EAL: Setting up physically contiguous memory... >>>>> EAL: Ask a virtual area of 0x5e400000 bytes >>>>> EAL: Virtual area found at 0x7fa618400000 (size =3D 0x5e400000) >>>>> EAL: Ask a virtual area of 0x200000 bytes >>>>> EAL: Virtual area found at 0x7fa618000000 (size =3D 0x200000) >>>>> EAL: Ask a virtual area of 0xa1800000 bytes >>>>> EAL: Virtual area found at 0x7fa576600000 (size =3D 0xa1800000) >>>>> EAL: Ask a virtual area of 0x200000 bytes >>>>> EAL: Virtual area found at 0x7fa576200000 (size =3D 0x200000) >>>>> EAL: Requesting 512 pages of size 2MB from socket 0 >>>>> EAL: TSC frequency is ~2799213 KHz >>>>> EAL: Master lcore 0 is ready (tid=3D78ad7b80;cpuset=3D[0]) >>>>> EAL: PCI device 0000:03:00.0 on NUMA socket -1 >>>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>>> EAL: Not managed by a supported kernel driver, skipped >>>>> EAL: PCI device 0000:0b:00.0 on NUMA socket -1 >>>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>>> EAL: PCI memory mapped at 0x7fa658400000 >>>>> EAL: PCI memory mapped at 0x7fa658401000 >>>>> EAL: PCI memory mapped at 0x7fa658402000 >>>>> EAL: PCI device 0000:13:00.0 on NUMA socket -1 >>>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>>> EAL: PCI memory mapped at 0x7fa658404000 >>>>> EAL: PCI memory mapped at 0x7fa658405000 >>>>> EAL: PCI memory mapped at 0x7fa658406000 >>>>> Zone 0: name:, phys:0x82bfdec0, len:0x2080, >>>>> virt:0x7fa6583fdec0, socket_id:0, flags:0 >>>>> Zone 1: name:, phys:0x82973d40, len:0x28a0c0, >>>>> virt:0x7fa658173d40, socket_id:0, flags:0 >>>>> Zone 2: name:, phys:0x82943200, len:0x2f800, >>>>> virt:0x7fa658143200, socket_id:0, flags:0 >>>>> 2016-07-21T09:33:36Z|00009|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath supports recirculation >>>>> 2016-07-21T09:33:36Z|00010|ofproto_dpif|INFO|netdev@ovs-netdev: = MPLS >>>>> label stack length probed as 3 >>>>> 2016-07-21T09:33:36Z|00011|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath supports truncate action >>>>> 2016-07-21T09:33:36Z|00012|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath supports unique flow ids >>>>> 2016-07-21T09:33:36Z|00013|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath does not support ct_state >>>>> 2016-07-21T09:33:36Z|00014|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath does not support ct_zone >>>>> 2016-07-21T09:33:36Z|00015|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath does not support ct_mark >>>>> 2016-07-21T09:33:36Z|00016|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath does not support ct_label >>>>> 2016-07-21T09:33:36Z|00017|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>> Datapath does not support ct_state_nat >>>>> 2016-07-21T09:33:36Z|00018|bridge|INFO|bridge br0: added interface = br0 >>>>> on port 65534 >>>>> 2016-07-21T09:33:36Z|00019|dpif_netlink|WARN|Generic Netlink = family >>>>> 'ovs_datapath' does not exist. The Open vSwitch kernel module is >>>>> probably not loaded. >>>>> 2016-07-21T09:33:36Z|00020|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>>>> 2016-07-21T09:33:36Z|00021|dpdk|ERR|Interface dpdk0 start error: >>>>> Operation not permitted >>>>> 2016-07-21T09:33:36Z|00022|bridge|INFO|bridge br0: using datapath = ID >>>>> 0000c664fbd86348 >>>>> 2016-07-21T09:33:36Z|00023|connmgr|INFO|br0: added service = controller >>>>> "punix:/usr/local/var/run/openvswitch/br0.mgmt" >>>>> 2016-07-21T09:33:36Z|00024|timeval|WARN|Unreasonably long 1244ms = poll >>>>> interval (233ms user, 880ms system) >>>>> 2016-07-21T09:33:36Z|00025|timeval|WARN|faults: 3902 minor, 0 = major >>>>> 2016-07-21T09:33:36Z|00026|timeval|WARN|context switches: 10 >>>>> voluntary, 214 involuntary >>>>> 2016-07-21T09:33:36Z|00027|coverage|INFO|Event coverage, avg rate = over >>>>> last: 5 seconds, last minute, last hour, hash=3D75cfd2fc: >>>>> 2016-07-21T09:33:36Z|00028|coverage|INFO|bridge_reconfigure >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00029|coverage|INFO|ofproto_flush >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00030|coverage|INFO|ofproto_update_port >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00031|coverage|INFO|rev_flow_table >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00032|coverage|INFO|cmap_expand >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 22 >>>>> 2016-07-21T09:33:36Z|00033|coverage|INFO|cmap_shrink >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 7 >>>>> 2016-07-21T09:33:36Z|00034|coverage|INFO|dpif_port_add >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>> 2016-07-21T09:33:36Z|00035|coverage|INFO|dpif_flow_flush >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>> 2016-07-21T09:33:36Z|00036|coverage|INFO|dpif_flow_get >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>>> 2016-07-21T09:33:36Z|00037|coverage|INFO|dpif_flow_put >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 10 >>>>> 2016-07-21T09:33:36Z|00038|coverage|INFO|dpif_flow_del >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>>> 2016-07-21T09:33:36Z|00039|coverage|INFO|dpif_execute >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>>> 2016-07-21T09:33:36Z|00040|coverage|INFO|flow_extract >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 4 >>>>> 2016-07-21T09:33:36Z|00041|coverage|INFO|miniflow_malloc >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 16 >>>>> 2016-07-21T09:33:36Z|00042|coverage|INFO|hmap_pathological >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00043|coverage|INFO|hmap_expand >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 653 >>>>> 2016-07-21T09:33:36Z|00044|coverage|INFO|netdev_get_stats >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00045|coverage|INFO|poll_create_node >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 15 >>>>> 2016-07-21T09:33:36Z|00046|coverage|INFO|poll_zero_timeout >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00047|coverage|INFO|seq_change >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 575 >>>>> 2016-07-21T09:33:36Z|00048|coverage|INFO|pstream_open >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>>> 2016-07-21T09:33:36Z|00049|coverage|INFO|stream_open >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00050|coverage|INFO|util_xalloc >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 11820 >>>>> 2016-07-21T09:33:36Z|00051|coverage|INFO|netdev_set_policing >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00052|coverage|INFO|netdev_get_ifindex >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00053|coverage|INFO|netdev_get_hwaddr >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>> 2016-07-21T09:33:36Z|00054|coverage|INFO|netdev_set_hwaddr >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00055|coverage|INFO|netdev_get_ethtool >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>> 2016-07-21T09:33:36Z|00056|coverage|INFO|netlink_received >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 6 >>>>> 2016-07-21T09:33:36Z|00057|coverage|INFO|netlink_recv_jumbo >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>> 2016-07-21T09:33:36Z|00058|coverage|INFO|netlink_sent >>>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>>> 2016-07-21T09:33:36Z|00059|coverage|INFO|70 events never hit >>>>> 2016-07-21T09:33:36Z|00060|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>>>> 2016-07-21T09:33:36Z|00061|dpdk|ERR|Interface dpdk0 start error: >>>>> Operation not permitted >>>>=20 >>>> The PMD start function is failing, unfortunately that error does = not tell >>>> that much information. >>>>=20 >>>> I would suggest you to enable the debug of the vmxnet3 PMD in DPDK, = set >>>> CONFIG_RTE_LIBRTE_VMXNET3_DEBUG_INIT=3Dy in the config/common_base = file of >>>> DPDK, then recompile DPDK and OvS. >>>>=20 >>>> Please try once again and send the terminal output, I hope we can = get a >>>> more >>>> information of what is going on with that log. >>>=20 >>> Based on your request, I reproduce the log with >>> CONFIG_RTE_LIBRTE_VMXNET3_DEBUG_INIT=3Dy >>> sudo ovs-vswitchd unix:/usr/local/var/run/openvswitch/db.sock >>> --log-file=3D/var/log/openvswitch/ovs-vswitchd.log --pidfile = --detach >>> 2016-07-25T09:24:17Z|00001|vlog|INFO|opened log file >>> /var/log/openvswitch/ovs-vswitchd.log >>> 2016-07-25T09:24:17Z|00002|ovs_numa|INFO|Discovered 2 CPU cores on = NUMA >>> node 0 >>> 2016-07-25T09:24:17Z|00003|ovs_numa|INFO|Discovered 1 NUMA nodes and = 2 CPU >>> cores >>>=20 >>> = 2016-07-25T09:24:17Z|00004|reconnect|INFO|unix:/usr/local/var/run/openvswi= tch/db.sock: >>> connecting... >>>=20 >>> = 2016-07-25T09:24:17Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswi= tch/db.sock: >>> connected >>> 2016-07-25T09:24:17Z|00006|dpdk|INFO|DPDK Enabled, initializing >>> 2016-07-25T09:24:17Z|00007|dpdk|INFO|No vhost-sock-dir provided - >>> defaulting to /usr/local/var/run/openvswitch >>> 2016-07-25T09:24:17Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >>> --socket-mem 1024,0 -c 0x00000001 >>> EAL: Detected lcore 0 as core 0 on socket 0 >>> EAL: Detected lcore 1 as core 0 on socket 0 >>> EAL: Support maximum 128 logical core(s) by configuration. >>> EAL: Detected 2 lcore(s) >>> EAL: Probing VFIO support... >>> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or >>> directory) >>> EAL: VFIO modules not loaded, skipping VFIO support... >>> EAL: Setting up physically contiguous memory... >>> EAL: Ask a virtual area of 0x200000 bytes >>> EAL: Virtual area found at 0x7fdea6000000 (size =3D 0x200000) >>> EAL: Ask a virtual area of 0x5e000000 bytes >>> EAL: Virtual area found at 0x7fde47e00000 (size =3D 0x5e000000) >>> EAL: Ask a virtual area of 0x200000 bytes >>> EAL: Virtual area found at 0x7fde47a00000 (size =3D 0x200000) >>> EAL: Ask a virtual area of 0x200000 bytes >>> EAL: Virtual area found at 0x7fde47600000 (size =3D 0x200000) >>> EAL: Ask a virtual area of 0xa1800000 bytes >>> EAL: Virtual area found at 0x7fdda5c00000 (size =3D 0xa1800000) >>> EAL: Ask a virtual area of 0x200000 bytes >>> EAL: Virtual area found at 0x7fdda5800000 (size =3D 0x200000) >>> EAL: Requesting 512 pages of size 2MB from socket 0 >>> EAL: TSC frequency is ~2799209 KHz >>> EAL: Master lcore 0 is ready (tid=3Da855eb80;cpuset=3D[0]) >>> PMD: rte_vmxnet3_pmd_init(): >> >>> EAL: PCI device 0000:03:00.0 on NUMA socket -1 >>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>> EAL: Not managed by a supported kernel driver, skipped >>> EAL: PCI device 0000:0b:00.0 on NUMA socket -1 >>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>> EAL: PCI memory mapped at 0x7fdea6200000 >>> EAL: PCI memory mapped at 0x7fdea6201000 >>> EAL: PCI memory mapped at 0x7fdea6202000 >>> PMD: eth_vmxnet3_dev_init(): >> >>> PMD: eth_vmxnet3_dev_init(): Hardware version : 1 >>> PMD: eth_vmxnet3_dev_init(): UPT hardware version : 1 >>> PMD: eth_vmxnet3_dev_init(): MAC Address : 00:0c:29:b5:9f:5b >>> EAL: PCI device 0000:13:00.0 on NUMA socket -1 >>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>> EAL: Not managed by a supported kernel driver, skipped >>> Zone 0: name:, phys:0x555fdec0, len:0x2080, >>> virt:0x7fdea61fdec0, socket_id:0, flags:0 >>> Zone 1: name:, phys:0x95375f00, len:0x28a0c0, >>> virt:0x7fde87975f00, socket_id:0, flags:0 >>> Zone 2: name:, phys:0x555cd300, len:0x2f800, >>> virt:0x7fdea61cd300, socket_id:0, flags:0 >>>=20 >>> PMD: vmxnet3_dev_configure(): >> >>> PMD: vmxnet3_dev_tx_queue_setup(): >> >>> PMD: vmxnet3_dev_rx_queue_setup(): >> >>> PMD: vmxnet3_dev_start(): >> >>> PMD: vmxnet3_rss_configure(): >> >>> PMD: vmxnet3_write_mac(): Writing MAC Address : 00:0c:29:b5:9f:5b >>> PMD: vmxnet3_disable_intr(): >> >>> PMD: vmxnet3_dev_rxtx_init(): >> >>> 2016-07-25T09:40:23Z|00020|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>> PMD: vmxnet3_dev_stop(): >> >>> PMD: vmxnet3_disable_intr(): >> >>> PMD: vmxnet3_dev_stop(): Device reset. >>> PMD: vmxnet3_dev_clear_queues(): >> >>> PMD: vmxnet3_dev_configure(): >> >>> PMD: vmxnet3_dev_tx_queue_setup(): >> >>> PMD: vmxnet3_dev_tx_queue_setup(): >> >>> PMD: vmxnet3_dev_tx_queue_setup(): >> >>> PMD: vmxnet3_dev_rx_queue_setup(): >> >>> PMD: vmxnet3_dev_start(): >> >>> PMD: vmxnet3_rss_configure(): >> >>> PMD: vmxnet3_write_mac(): Writing MAC Address : 00:0c:29:b5:9f:5b >>> PMD: vmxnet3_dev_start(): Device activation: UNSUCCESSFUL >>=20 >>=20 >> Unfortunately it is the most I can help you, it is strange for me why >> test-pmd is working and why OvS is not. >> I think it is a DPDK issue, then the next step is to post on the DPDK >> mailing (dev@dpdk.org, add also in CC Yong Wang = that >> is the vmxnet3 maintainer), send a link to this thread in order to be = clear >> what you have tested. >=20 >=20 > Hello Yong Wang, >=20 > I am running fedora VM in ESXi 5.5.0 environment. I tried to install > OVS and DPDK. OVS couldnt start DPDK device. > You can see the error in the mail below. Do you know why? IF you need > more information. I can provide more information. >=20 > Good news, when I tried in Fedora 23 VM in ESXi 5.5.0, it works. It is > possible to bind an dpdk device and get packets on port. >=20 > Thanks Mauricio for your help and reply. >=20 > Best regards > Sothy Sothy, You mentioned that on Fedora 23, it works. Then on some version Fedora = that it failed? =46rom your previous post, you mentioned that it=E2=80=99= s a Ubuntu 14.04 VM? Can you clarify? Other than the changes you = mentioned already, are there any other changes (such as ring buffer = size, number of rx queues, etc) that have been changed? Is there any = updates installed on your ESX 5.5? If yes, what=E2=80=99s the exact = update version? Can you also send me a copy of your vmkernel.log = offline? Also copying Daniele as he is trying to help reproduce the reported = issue. >=20 >>=20 >>> I deleted exisiting bridge and recreated:::::: >>>=20 >>>=20 >>> Then I added bridge. After I try to create bridge. It gives error. = The >>> erros is same as shown in log file. >>>=20 >>> 2016-07-25T09:29:43.248Z|00020|bridge|INFO|bridge br0: added = interface >>> br0 on port 65534 >>> 2016-07-25T09:29:43.253Z|00021|dpif_netlink|WARN|Generic Netlink >>> family 'ovs_datapath' does not exist. The Open vSwitch kernel module >>> is probably not loaded. >>> 2016-07-25T09:29:43.253Z|00022|bridge|INFO|bridge br0: using = datapath >>> ID 0000e6aac740584b >>> 2016-07-25T09:29:43.253Z|00023|connmgr|INFO|br0: added service >>> controller "punix:/usr/local/var/run/openvswitch/br0.mgmt" >>> 2016-07-25T09:30:54.008Z|00024|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>> 2016-07-25T09:30:54.021Z|00025|dpdk|ERR|Interface dpdk0 start error: >>> Operation not permitted >>> 2016-07-25T09:30:54.021Z|00026|dpif|WARN|netdev@ovs-netdev: failed = to >>> add dpdk0 as port: Operation not permitted >>>=20 >>>=20 >>>=20 >>>> Another thing to do would be to bind the NICs to the = uio_pci_generic and >>>> VFIO modules, just to be sure that the issue is also present there. >>>=20 >>> I tried in uio and uio_pci_genric also. Both are giving same error. >>> I suspect I cannt activate VFIO in VM since it is BIOS suport also. = AM I >>> right? >>>=20 >>> Thanks >>>=20 >>>>=20 >>>>> in command line some information for your verification: >>>>>=20 >>>>> sudo ovs-vsctl show >>>>> d53612e0-5d82-4cc1-af7d-ee887a737ef2 >>>>> Bridge "br0" >>>>> Port "dpdk0" >>>>> Interface "dpdk0" >>>>> type: dpdk >>>>> Port "br0" >>>>> Interface "br0" >>>>> type: internal >>>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl del-br br0 >>>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl add-br br0 = -- >>>>> set bridge br0 datapath_type=3Dnetdev >>>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl add-port br0 >>>>> dpdk0 -- set Interface dpdk0 type=3Ddpdk >>>>> ovs-vsctl: Error detected while setting up 'dpdk0'. See = ovs-vswitchd >>>>> log for details. >>>>>=20 >>>>>=20 >>>>>>>>=20 >>>>>>>>=20 >>>>>>>>=20 >>>>>>>> = ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= ++++++++++++++++++++++++++++++++++ >>>>>>>> sudo ovs-vsctl show >>>>>>>> d53612e0-5d82-4cc1-af7d-ee887a737ef2 >>>>>>>> Bridge "br0" >>>>>>>> Port "dpdk0" >>>>>>>> Interface "dpdk0" >>>>>>>> type: dpdk >>>>>>>> Port "br0" >>>>>>>> Interface "br0" >>>>>>>> type: internal >>>>>>>>=20 >>>>>>>> sudo ovs-ofctl dump-flows br0 >>>>>>>> NXST_FLOW reply (xid=3D0x4): >>>>>>>> cookie=3D0x0, duration=3D487.638s, table=3D0, n_packets=3D0, = n_bytes=3D0, >>>>>>>> idle_age=3D487, priority=3D0 actions=3DNORMAL >>>>>>>>=20 >>>>>>>>=20 >>>>>>>>> In addition I would recommend to use the test-pmd [1] = application >>>>>>>>> from >>>>>>>>> DPDK >>>>>>>>> to check if the issue is also present in that case. >>>>>>>=20 >>>>>>> I run testpmd command.The result is >>>>>>>=20 >>>>>>> Configuring Port 0 (socket 0) >>>>>>> Port 0: 00:0C:29:B5:9F:5B >>>>>>> Configuring Port 1 (socket 0) >>>>>>> Port 1: 00:0C:29:B5:9F:65 >>>>>>> Checking link statuses... >>>>>>> Port 0 Link Up - speed 10000 Mbps - full-duplex >>>>>>> Port 1 Link Up - speed 10000 Mbps - full-duplex >>>>>>> Done >>>>>>> No commandline core given, start packet forwarding >>>>>>> io packet forwarding - CRC stripping disabled - = packets/burst=3D32 >>>>>>> nb forwarding cores=3D1 - nb forwarding ports=3D2 >>>>>>> RX queues=3D1 - RX desc=3D128 - RX free threshold=3D0 >>>>>>> RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 >>>>>>> TX queues=3D1 - TX desc=3D512 - TX free threshold=3D0 >>>>>>> TX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 >>>>>>> TX RS bit threshold=3D0 - TXQ flags=3D0x200 >>>>>>> Press enter to exit >>>>>>>=20 >>>>>>> Telling cores to stop... >>>>>>> Waiting for lcores to finish... >>>>>>>=20 >>>>>>> ---------------------- Forward statistics for port 0 >>>>>>> ---------------------- >>>>>>> RX-packets: 88 RX-dropped: 0 = RX-total: 88 >>>>>>> TX-packets: 2 TX-dropped: 0 = TX-total: 2 >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> = --------------------------------------------------------------------------= -- >>>>>>>=20 >>>>>>> ---------------------- Forward statistics for port 1 >>>>>>> ---------------------- >>>>>>> RX-packets: 2 RX-dropped: 0 = RX-total: 2 >>>>>>> TX-packets: 88 TX-dropped: 0 = TX-total: 88 >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> = --------------------------------------------------------------------------= -- >>>>>>>=20 >>>>>>> +++++++++++++++ Accumulated forward statistics for all >>>>>>> ports+++++++++++++++ >>>>>>> RX-packets: 90 RX-dropped: 0 = RX-total: 90 >>>>>>> TX-packets: 90 TX-dropped: 0 = TX-total: 90 >>>>>>>=20 >>>>>>>=20 >>>>>>>=20 >>>>>>> = ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= >>>>>>>=20 >>>>>>> make sense? >>>>>>=20 >>>>>>=20 >>>>>> Yes, it makes sense. Ports are being recognized by DPDK and some >>>>>> packets >>>>>> were exchanged. >>>>>>=20 >>>>>>=20 >>>>>>>>> [1] = https://urldefense.proofpoint.com/v2/url?u=3Dhttp-3A__dpdk.org_doc_guides-= 2D16.04_testpmd-5Fapp-5Fug_index.html&d=3DCwIBaQ&c=3DSqcl0Ez6M0X8aeM67LKIi= DJAXVeAw-YihVMNtXt-uEs&r=3D44mSO5N5yEs4CeCdtQE0xt0F7J0p67_mApYVAzyYms0&m=3D= vpaHcL64W3vOTY9P8yRZOdCJzbL_oWzZH6J2u4iT614&s=3DJnLeHoyKuiecYI95-fcfFiuev5= g2CDweT2MnyUiKWzM&e=3D=20 >>>>>>>>>=20 >>>>>>>>> Mauricio Vasquez, >>>>>>=20 >>>>>>=20 >>>> Mauricio V, >>=20 >>=20