From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by dpdk.org (Postfix) with ESMTP id 29DB82C0C for ; Wed, 27 Jul 2016 09:25:37 +0200 (CEST) Received: by mail-oi0-f49.google.com with SMTP id w18so5974345oiw.3 for ; Wed, 27 Jul 2016 00:25:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=OqZrNvfUV5ykTV34KjU9UPJJxnKcJ1WF/a/aY6ulOn8=; b=ySaViof7R2frAtrHcNAHIdM9JlNZoiDBXJy+KXAd4/RCHV5EFreApOEx4LojvznfFz RHF8szWgtdAxVQyeS4Hpv9pyY/SYZoXT8QOjm+fdFlSAVTHFLRLWYCVpnp5KTQRt4q/e 3ax4RGjk5i905PbN5ExrQ/lTY/zVb3r8dGt6o3rP2UTfkE65klzBF3jiddEAl9HSCdFW RCG9+lpBiHp8lOqm/dCd8LN/XsdOhMQ9LcFQn1mpXzgskwNWLUEA2xXBUGEj8ctYYtDO +So7HrIPe/OLwrkO5yVj2agzfvV2ofXBGg3wm7ArsVXFEeNCGLzTrcwSB05vnHPRYlge egSQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=OqZrNvfUV5ykTV34KjU9UPJJxnKcJ1WF/a/aY6ulOn8=; b=WfrpxbGdjP8D7fyBB2B4p5KHyhSMZiCBRoiffGZDGdwKUbvZnAUF02W8WzTciohGDY SgyrkzcplHqBwic2nRlywvc60TIkJOtMl6PX1hwf/yfRfUB71cARrU4kuTF+eLD3hK4U 7or5K/OeBanLg+L8t3rIQwqONW/vXI4dcpCDGXBXtUoW8400psWFUUgO2yJf4tWbEddP uen081hdpSHzMID+CmkC+zezGNwTInT8VQUYONJ0sAYABREfd18VTaGVqLcbuBSegSpk JSVLZPX76fhkW9dkaxsot0n1MlBSIHrwP4IBXc8v8X16+nbQX7POCKDuRzin6hghshid ZYcg== X-Gm-Message-State: AEkoouvzYuuZcUsXSqYPGhohu4A7NaVqCHdZqqTt16dPDUQi1pT1phPTnn2810cM3XCx0Yoy/eVO9hemd/VKMA== X-Received: by 10.157.37.89 with SMTP id j25mr15872709otd.85.1469604335790; Wed, 27 Jul 2016 00:25:35 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.119.68 with HTTP; Wed, 27 Jul 2016 00:25:35 -0700 (PDT) In-Reply-To: <5797909B.6090208@polito.it> References: <578FCAB6.3050403@polito.it> <57909938.8030402@polito.it> <579495C1.5030506@polito.it> <5797909B.6090208@polito.it> From: sothy shan Date: Wed, 27 Jul 2016 09:25:35 +0200 Message-ID: To: Mauricio Vasquez Cc: Aaron Conole , bugs@openvswitch.org, "dev@dpdk.org" , yongwang@vmware.com Content-Type: text/plain; charset=UTF-8 Subject: Re: [dpdk-dev] [ovs-discuss] OVS DPDK|DPDK|ERR|interface dpdk0 start error:operation not permitted. X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jul 2016 07:25:37 -0000 On Tue, Jul 26, 2016 at 6:32 PM, Mauricio Vasquez wrote: > Hello Sothy, > > Sorry for the delay in answering, some busy days here. > > > On 07/25/2016 12:03 PM, sothy shan wrote: >> >> Hello Mauricio, >> >> On Sun, Jul 24, 2016 at 12:17 PM, Mauricio Vasquez >> wrote: >>> >>> Hi Sothy, >>> >>> >>> On 07/21/2016 11:55 AM, sothy shan wrote: >>>> >>>> On Thu, Jul 21, 2016 at 11:43 AM, Mauricio Vasquez >>>> wrote: >>>>> >>>>> >>>>> On 07/21/2016 10:51 AM, sothy shan wrote: >>>>>> >>>>>> On Thu, Jul 21, 2016 at 10:41 AM, sothy shan >>>>>> wrote: >>>>>>> >>>>>>> On Wed, Jul 20, 2016 at 9:02 PM, Mauricio Vasquez >>>>>>> wrote: >>>>>>>> >>>>>>>> Hi Sothy, >>>>>>>> >>>>>>>> On 07/20/2016 07:40 PM, Aaron Conole wrote: >>>>>>>>> >>>>>>>>> sothy shan writes: >>>>>>>>> >>>>>>>>>> Hello all, >>>>>>>>> >>>>>>>>> Hi Sothy, >>>>>>>>> >>>>>>>>>> I followed the installion guide provided in the web site >>>>>>>>>> >>>>>>>>>> https://github.com/openvswitch/ovs/blob/master/INSTALL.DPDK.md#ovstc >>>>>>>>>> to install dpdk OVS. >>>>>>>>>> >>>>>>>>>> I am rurnning Ubuntu 14.04 (kernel 3.13). It is a VM running >>>>>>>>>> VMware. >>>>>>>>>> One intereface is enabled by VMXNET3. >>>>>>>> >>>>>>>> >>>>>>>> It is not clear for me, are you trying to install OvS within the VM? >>>>>>>> >>>>>>>>>> I used dpdk 16.04 >>>>>>>>>> Today I made clone of OVS (committ >>>>>>>>>> :bf32e3e2c029da18b5d6fd9210cb0ea12a1d0383). >>>>>>>>>> >>>>>>>>>> The following are different configuration compared to above link. >>>>>>>>>> >>>>>>>>>> sysctl -w vm.nr_hugepages=2048 >>>>>>>>>> Binded interface via igb_uio. >>>>>>>>>> >>>>>>>>>> Then followed same configuration to start ovs-vsswitch with dpdk. >>>>>>>>> >>>>>>>>> Can you please post the steps exactly that you followed? Which >>>>>>>>> user >>>>>>>>> you >>>>>>>>> were running as, etc? Can you also post how you expect packets to >>>>>>>>> arrive into the vm? >>>>>>>>> >>>>>>>>>> I am able to creatre bridge. When I create a port. It gives error >>>>>>>>>> message. >>>>>>>>> >>>>>>>>> Please show the steps for this, too. The exact commands you used. >>>>>>>>> >>>>>>>>>> When I check ovs-vswitchd.log file, >>>>>>>>>> >>>>>>>>>> There is warning that dpif_netlink|WARN|genric netlink family, >>>>>>>>>> ovs_datapath does not exist. The openvswitch kernel module may be >>>>>>>>>> not >>>>>>>>>> loaded. >>>>>>>>> >>>>>>>>> This is definitely a problem. How did you start the ovs-vswitchd >>>>>>>>> daemon? >>>>>>>> >>>>>>>> >>>>>>>> This is not a problem Aaron, the ovs kernel module is not needed >>>>>>>> when >>>>>>>> ovs is >>>>>>>> compiled with DPDK. >>>>>>>>>> >>>>>>>>>> Then ERR: ERR|interface dpdk0 start error:operation not permitted. >>>>>>>>>> >>>>>>>>>> The corresponding port is loaded by dpdk driver as shown in >>>>>>>>>> dpdk_nic_bind --status. >>>>>>>>>> >>>>>>>>>> After that I did sudo ovs-vsctl show. it show br and port details >>>>>>>>>> as >>>>>>>>>> well. >>>>>>>>>> I am able to add one flow rule as well. But ovs bridge didnt get >>>>>>>>>> packets from the interface. >>>>>>>>>> >>>>>>>>>> Do you know why this error is popup? anyway to solve the problem? >>>>>>>>>> >>>>>>>>>> Thank you very much >>>>>>>>>> >>>>>>>>>> Best regars >>>>>>>>>> Sothy >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> discuss mailing list >>>>>>>>> discuss@openvswitch.org >>>>>>>>> http://openvswitch.org/mailman/listinfo/discuss >>>>>>>> >>>>>>>> As Aaron wrote, having the exact commands is important to help you. >>>>>>> >>>>>>> My configuration and log info: >>>>>>> >>>>>>> sudo sysctl vm.nr_hugepages=2048 >>>>>>> sudo mkdir -p /dev/hugepages >>>>>>> sudo mount -t hugetlbfs hugetlbfs /dev/hugepages >>>>>>> sudo modprobe uio >>>>>>> sudo insmod $DPDK_BUILD/kmod/igb_uio.ko >>>>>>> sudo $DPDK_DIR/tools/dpdk_nic_bind.py --status >>>>>>> sudo $DPDK_DIR/tools/dpdk_nic_bind.py -b igb_uio 0000:0b:00.0 >>>>>>> sudo ./dpdk-16.04/tools/dpdk_nic_bind.py --status >>>>>>> >>>>>>> >>>>>>> Network devices using DPDK-compatible driver >>>>>>> ============================================ >>>>>>> 0000:0b:00.0 'VMXNET3 Ethernet Controller' drv=igb_uio unused= >>>>>>> 0000:13:00.0 'VMXNET3 Ethernet Controller' drv=igb_uio unused= >>>>>>> >>>>>>> Network devices using kernel driver >>>>>>> =================================== >>>>>>> 0000:03:00.0 'VMXNET3 Ethernet Controller' if=eth0 drv=vmxnet3 >>>>>>> unused=igb_uio *Active* >>>>>>> >>>>>>> Other network devices >>>>>>> ===================== >>>>>>> >>>>>>> >>>>>>> .........Then...................... >>>>>>> >>>>>>> >>>>>>> sudo ovs-vsctl add-port br0 dpdk0 -- set Interface dpdk0 type=dpdk >>>>>>> sudo ovs-vsctl add-br br0 -- set bridge br0 datapath_type=netdev >>>>> >>>>> These two commands are inverted. >>>>> The bridge has to be created first and then ports have to be added to >>>>> it. >>>>> >>>> It is my mistake when coping. >>>>>>> >>>>>>> Log file/ >>>>>>> 2016-07-21T07:53:35.527Z|00001|vlog|INFO|opened log file >>>>>>> /var/log/openvswitch/ovs-vswitchd.log >>>>>>> 2016-07-21T07:53:35.529Z|00002|ovs_numa|INFO|Discovered 2 CPU cores >>>>>>> on >>>>>>> NUMA node 0 >>>>>>> 2016-07-21T07:53:35.529Z|00003|ovs_numa|INFO|Discovered 1 NUMA nodes >>>>>>> and 2 CPU cores >>>>>>> >>>>>>> >>>>>>> >>>>>>> 2016-07-21T07:53:35.529Z|00004|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >>>>>>> connecting... >>>>>>> >>>>>>> >>>>>>> >>>>>>> 2016-07-21T07:53:35.529Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >>>>>>> connected >>>>>>> 2016-07-21T07:53:35.533Z|00006|dpdk|INFO|DPDK Enabled, initializing >>>>>>> 2016-07-21T07:53:35.533Z|00007|dpdk|INFO|No vhost-sock-dir provided - >>>>>>> defaulting to /usr/local/var/run/openvswitch >>>>>>> 2016-07-21T07:53:35.533Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >>>>>>> --socket-mem 1024,0 -c 0x00000001 >>>>>>> 2016-07-21T07:53:36.606Z|00009|timeval|WARN|Unreasonably long 1076ms >>>>>>> poll interval (80ms user, 875ms system) >>>>>>> 2016-07-21T07:53:36.606Z|00010|timeval|WARN|faults: 3306 minor, 0 >>>>>>> major >>>>>>> 2016-07-21T07:53:36.606Z|00011|timeval|WARN|context switches: 3 >>>>>>> voluntary, 101 involuntary >>>>>>> 2016-07-21T07:53:36.606Z|00012|coverage|INFO|Event coverage, avg rate >>>>>>> over last: 5 seconds, last minute, last hour, hash=398361de: >>>>>>> 2016-07-21T07:53:36.606Z|00013|coverage|INFO|bridge_reconfigure >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.606Z|00014|coverage|INFO|cmap_expand >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 9 >>>>>>> 2016-07-21T07:53:36.606Z|00015|coverage|INFO|miniflow_malloc >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 9 >>>>>>> 2016-07-21T07:53:36.606Z|00016|coverage|INFO|hmap_pathological >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.606Z|00017|coverage|INFO|hmap_expand >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 640 >>>>>>> 2016-07-21T07:53:36.606Z|00018|coverage|INFO|txn_unchanged >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>>>>> 2016-07-21T07:53:36.606Z|00019|coverage|INFO|txn_incomplete >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.607Z|00020|coverage|INFO|poll_create_node >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 35 >>>>>>> 2016-07-21T07:53:36.607Z|00021|coverage|INFO|seq_change >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 38 >>>>>>> 2016-07-21T07:53:36.607Z|00022|coverage|INFO|pstream_open >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.607Z|00023|coverage|INFO|stream_open >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.607Z|00024|coverage|INFO|util_xalloc >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 11049 >>>>>>> 2016-07-21T07:53:36.607Z|00025|coverage|INFO|netdev_get_hwaddr >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.607Z|00026|coverage|INFO|netlink_received >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>>>>> 2016-07-21T07:53:36.607Z|00027|coverage|INFO|netlink_sent >>>>>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>>>>> 2016-07-21T07:53:36.607Z|00028|coverage|INFO|86 events never hit >>>>>>> 2016-07-21T07:53:36.607Z|00029|bridge|INFO|ovs-vswitchd (Open >>>>>>> vSwitch) >>>>>>> 2.5.90 >>>>>>> 2016-07-21T07:54:50.861Z|00030|memory|INFO|18980 kB peak resident set >>>>>>> size after 75.3 seconds >>>>>>> 2016-07-21T07:54:50.866Z|00031|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath supports recirculation >>>>>>> 2016-07-21T07:54:50.866Z|00032|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> MPLS label stack length probed as 3 >>>>>>> 2016-07-21T07:54:50.866Z|00033|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath supports truncate action >>>>>>> 2016-07-21T07:54:50.866Z|00034|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath supports unique flow ids >>>>>>> 2016-07-21T07:54:50.866Z|00035|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath does not support ct_state >>>>>>> 2016-07-21T07:54:50.866Z|00036|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath does not support ct_zone >>>>>>> 2016-07-21T07:54:50.866Z|00037|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath does not support ct_mark >>>>>>> 2016-07-21T07:54:50.866Z|00038|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath does not support ct_label >>>>>>> 2016-07-21T07:54:50.866Z|00039|ofproto_dpif|INFO|netdev@ovs-netdev: >>>>>>> Datapath does not support ct_state_nat >>>>>>> 2016-07-21T07:54:50.875Z|00040|bridge|INFO|bridge br0: added >>>>>>> interface >>>>>>> br0 on port 65534 >>>>>>> 2016-07-21T07:54:50.887Z|00041|dpif_netlink|WARN|Generic Netlink >>>>>>> family 'ovs_datapath' does not exist. The Open vSwitch kernel module >>>>>>> is probably not loaded. >>>>>>> 2016-07-21T07:54:50.887Z|00042|bridge|INFO|bridge br0: using datapath >>>>>>> ID 0000c664fbd86348 >>>>>>> 2016-07-21T07:54:50.887Z|00043|connmgr|INFO|br0: added service >>>>>>> controller "punix:/usr/local/var/run/openvswitch/br0.mgmt" >>>>>>> 2016-07-21T07:58:18.796Z|00044|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>>>>>> 2016-07-21T07:58:18.810Z|00045|dpdk|ERR|Interface dpdk0 start error: >>>>>>> Operation not permitted >>>>>>> 2016-07-21T07:58:18.810Z|00046|dpif|WARN|netdev@ovs-netdev: failed to >>>>>>> add dpdk0 as port: Operation not permitted >>>>>>> 2016-07-21T08:10:35.440Z|00047|connmgr|INFO|br0<->unix: 1 flow_mods >>>>>>> in >>>>>>> the last 0 s (1 adds) >>>>> >>>>> Could you also provide the full terminal output when you run >>>>> ovs-vswitchd?, >>>>> I would like to see the DPDK output >>>> >>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vswitchd unix:$DB_SOCK >>>> --pidfile --detach --log-file=/var/log/openvswitch/ovs-vswitchd.log >>>> 2016-07-21T09:33:35Z|00001|vlog|INFO|opened log file >>>> /var/log/openvswitch/ovs-vswitchd.log >>>> 2016-07-21T09:33:35Z|00002|ovs_numa|INFO|Discovered 2 CPU cores on NUMA >>>> node 0 >>>> 2016-07-21T09:33:35Z|00003|ovs_numa|INFO|Discovered 1 NUMA nodes and 2 >>>> CPU >>>> cores >>>> >>>> >>>> 2016-07-21T09:33:35Z|00004|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >>>> connecting... >>>> >>>> >>>> 2016-07-21T09:33:35Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >>>> connected >>>> 2016-07-21T09:33:35Z|00006|dpdk|INFO|DPDK Enabled, initializing >>>> 2016-07-21T09:33:35Z|00007|dpdk|INFO|No vhost-sock-dir provided - >>>> defaulting to /usr/local/var/run/openvswitch >>>> 2016-07-21T09:33:35Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >>>> --socket-mem 1024,0 -c 0x00000001 >>>> EAL: Detected lcore 0 as core 0 on socket 0 >>>> EAL: Detected lcore 1 as core 0 on socket 0 >>>> EAL: Support maximum 128 logical core(s) by configuration. >>>> EAL: Detected 2 lcore(s) >>>> EAL: Probing VFIO support... >>>> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or >>>> directory) >>>> EAL: VFIO modules not loaded, skipping VFIO support... >>>> EAL: Setting up physically contiguous memory... >>>> EAL: Ask a virtual area of 0x5e400000 bytes >>>> EAL: Virtual area found at 0x7fa618400000 (size = 0x5e400000) >>>> EAL: Ask a virtual area of 0x200000 bytes >>>> EAL: Virtual area found at 0x7fa618000000 (size = 0x200000) >>>> EAL: Ask a virtual area of 0xa1800000 bytes >>>> EAL: Virtual area found at 0x7fa576600000 (size = 0xa1800000) >>>> EAL: Ask a virtual area of 0x200000 bytes >>>> EAL: Virtual area found at 0x7fa576200000 (size = 0x200000) >>>> EAL: Requesting 512 pages of size 2MB from socket 0 >>>> EAL: TSC frequency is ~2799213 KHz >>>> EAL: Master lcore 0 is ready (tid=78ad7b80;cpuset=[0]) >>>> EAL: PCI device 0000:03:00.0 on NUMA socket -1 >>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>> EAL: Not managed by a supported kernel driver, skipped >>>> EAL: PCI device 0000:0b:00.0 on NUMA socket -1 >>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>> EAL: PCI memory mapped at 0x7fa658400000 >>>> EAL: PCI memory mapped at 0x7fa658401000 >>>> EAL: PCI memory mapped at 0x7fa658402000 >>>> EAL: PCI device 0000:13:00.0 on NUMA socket -1 >>>> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >>>> EAL: PCI memory mapped at 0x7fa658404000 >>>> EAL: PCI memory mapped at 0x7fa658405000 >>>> EAL: PCI memory mapped at 0x7fa658406000 >>>> Zone 0: name:, phys:0x82bfdec0, len:0x2080, >>>> virt:0x7fa6583fdec0, socket_id:0, flags:0 >>>> Zone 1: name:, phys:0x82973d40, len:0x28a0c0, >>>> virt:0x7fa658173d40, socket_id:0, flags:0 >>>> Zone 2: name:, phys:0x82943200, len:0x2f800, >>>> virt:0x7fa658143200, socket_id:0, flags:0 >>>> 2016-07-21T09:33:36Z|00009|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath supports recirculation >>>> 2016-07-21T09:33:36Z|00010|ofproto_dpif|INFO|netdev@ovs-netdev: MPLS >>>> label stack length probed as 3 >>>> 2016-07-21T09:33:36Z|00011|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath supports truncate action >>>> 2016-07-21T09:33:36Z|00012|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath supports unique flow ids >>>> 2016-07-21T09:33:36Z|00013|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath does not support ct_state >>>> 2016-07-21T09:33:36Z|00014|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath does not support ct_zone >>>> 2016-07-21T09:33:36Z|00015|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath does not support ct_mark >>>> 2016-07-21T09:33:36Z|00016|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath does not support ct_label >>>> 2016-07-21T09:33:36Z|00017|ofproto_dpif|INFO|netdev@ovs-netdev: >>>> Datapath does not support ct_state_nat >>>> 2016-07-21T09:33:36Z|00018|bridge|INFO|bridge br0: added interface br0 >>>> on port 65534 >>>> 2016-07-21T09:33:36Z|00019|dpif_netlink|WARN|Generic Netlink family >>>> 'ovs_datapath' does not exist. The Open vSwitch kernel module is >>>> probably not loaded. >>>> 2016-07-21T09:33:36Z|00020|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>>> 2016-07-21T09:33:36Z|00021|dpdk|ERR|Interface dpdk0 start error: >>>> Operation not permitted >>>> 2016-07-21T09:33:36Z|00022|bridge|INFO|bridge br0: using datapath ID >>>> 0000c664fbd86348 >>>> 2016-07-21T09:33:36Z|00023|connmgr|INFO|br0: added service controller >>>> "punix:/usr/local/var/run/openvswitch/br0.mgmt" >>>> 2016-07-21T09:33:36Z|00024|timeval|WARN|Unreasonably long 1244ms poll >>>> interval (233ms user, 880ms system) >>>> 2016-07-21T09:33:36Z|00025|timeval|WARN|faults: 3902 minor, 0 major >>>> 2016-07-21T09:33:36Z|00026|timeval|WARN|context switches: 10 >>>> voluntary, 214 involuntary >>>> 2016-07-21T09:33:36Z|00027|coverage|INFO|Event coverage, avg rate over >>>> last: 5 seconds, last minute, last hour, hash=75cfd2fc: >>>> 2016-07-21T09:33:36Z|00028|coverage|INFO|bridge_reconfigure >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00029|coverage|INFO|ofproto_flush >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00030|coverage|INFO|ofproto_update_port >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00031|coverage|INFO|rev_flow_table >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00032|coverage|INFO|cmap_expand >>>> 0.0/sec 0.000/sec 0.0000/sec total: 22 >>>> 2016-07-21T09:33:36Z|00033|coverage|INFO|cmap_shrink >>>> 0.0/sec 0.000/sec 0.0000/sec total: 7 >>>> 2016-07-21T09:33:36Z|00034|coverage|INFO|dpif_port_add >>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>> 2016-07-21T09:33:36Z|00035|coverage|INFO|dpif_flow_flush >>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>> 2016-07-21T09:33:36Z|00036|coverage|INFO|dpif_flow_get >>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>> 2016-07-21T09:33:36Z|00037|coverage|INFO|dpif_flow_put >>>> 0.0/sec 0.000/sec 0.0000/sec total: 10 >>>> 2016-07-21T09:33:36Z|00038|coverage|INFO|dpif_flow_del >>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>> 2016-07-21T09:33:36Z|00039|coverage|INFO|dpif_execute >>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>> 2016-07-21T09:33:36Z|00040|coverage|INFO|flow_extract >>>> 0.0/sec 0.000/sec 0.0000/sec total: 4 >>>> 2016-07-21T09:33:36Z|00041|coverage|INFO|miniflow_malloc >>>> 0.0/sec 0.000/sec 0.0000/sec total: 16 >>>> 2016-07-21T09:33:36Z|00042|coverage|INFO|hmap_pathological >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00043|coverage|INFO|hmap_expand >>>> 0.0/sec 0.000/sec 0.0000/sec total: 653 >>>> 2016-07-21T09:33:36Z|00044|coverage|INFO|netdev_get_stats >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00045|coverage|INFO|poll_create_node >>>> 0.0/sec 0.000/sec 0.0000/sec total: 15 >>>> 2016-07-21T09:33:36Z|00046|coverage|INFO|poll_zero_timeout >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00047|coverage|INFO|seq_change >>>> 0.0/sec 0.000/sec 0.0000/sec total: 575 >>>> 2016-07-21T09:33:36Z|00048|coverage|INFO|pstream_open >>>> 0.0/sec 0.000/sec 0.0000/sec total: 3 >>>> 2016-07-21T09:33:36Z|00049|coverage|INFO|stream_open >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00050|coverage|INFO|util_xalloc >>>> 0.0/sec 0.000/sec 0.0000/sec total: 11820 >>>> 2016-07-21T09:33:36Z|00051|coverage|INFO|netdev_set_policing >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00052|coverage|INFO|netdev_get_ifindex >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00053|coverage|INFO|netdev_get_hwaddr >>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>> 2016-07-21T09:33:36Z|00054|coverage|INFO|netdev_set_hwaddr >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00055|coverage|INFO|netdev_get_ethtool >>>> 0.0/sec 0.000/sec 0.0000/sec total: 2 >>>> 2016-07-21T09:33:36Z|00056|coverage|INFO|netlink_received >>>> 0.0/sec 0.000/sec 0.0000/sec total: 6 >>>> 2016-07-21T09:33:36Z|00057|coverage|INFO|netlink_recv_jumbo >>>> 0.0/sec 0.000/sec 0.0000/sec total: 1 >>>> 2016-07-21T09:33:36Z|00058|coverage|INFO|netlink_sent >>>> 0.0/sec 0.000/sec 0.0000/sec total: 5 >>>> 2016-07-21T09:33:36Z|00059|coverage|INFO|70 events never hit >>>> 2016-07-21T09:33:36Z|00060|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >>>> 2016-07-21T09:33:36Z|00061|dpdk|ERR|Interface dpdk0 start error: >>>> Operation not permitted >>> >>> The PMD start function is failing, unfortunately that error does not tell >>> that much information. >>> >>> I would suggest you to enable the debug of the vmxnet3 PMD in DPDK, set >>> CONFIG_RTE_LIBRTE_VMXNET3_DEBUG_INIT=y in the config/common_base file of >>> DPDK, then recompile DPDK and OvS. >>> >>> Please try once again and send the terminal output, I hope we can get a >>> more >>> information of what is going on with that log. >> >> Based on your request, I reproduce the log with >> CONFIG_RTE_LIBRTE_VMXNET3_DEBUG_INIT=y >> sudo ovs-vswitchd unix:/usr/local/var/run/openvswitch/db.sock >> --log-file=/var/log/openvswitch/ovs-vswitchd.log --pidfile --detach >> 2016-07-25T09:24:17Z|00001|vlog|INFO|opened log file >> /var/log/openvswitch/ovs-vswitchd.log >> 2016-07-25T09:24:17Z|00002|ovs_numa|INFO|Discovered 2 CPU cores on NUMA >> node 0 >> 2016-07-25T09:24:17Z|00003|ovs_numa|INFO|Discovered 1 NUMA nodes and 2 CPU >> cores >> >> 2016-07-25T09:24:17Z|00004|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >> connecting... >> >> 2016-07-25T09:24:17Z|00005|reconnect|INFO|unix:/usr/local/var/run/openvswitch/db.sock: >> connected >> 2016-07-25T09:24:17Z|00006|dpdk|INFO|DPDK Enabled, initializing >> 2016-07-25T09:24:17Z|00007|dpdk|INFO|No vhost-sock-dir provided - >> defaulting to /usr/local/var/run/openvswitch >> 2016-07-25T09:24:17Z|00008|dpdk|INFO|EAL ARGS: ovs-vswitchd >> --socket-mem 1024,0 -c 0x00000001 >> EAL: Detected lcore 0 as core 0 on socket 0 >> EAL: Detected lcore 1 as core 0 on socket 0 >> EAL: Support maximum 128 logical core(s) by configuration. >> EAL: Detected 2 lcore(s) >> EAL: Probing VFIO support... >> EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or >> directory) >> EAL: VFIO modules not loaded, skipping VFIO support... >> EAL: Setting up physically contiguous memory... >> EAL: Ask a virtual area of 0x200000 bytes >> EAL: Virtual area found at 0x7fdea6000000 (size = 0x200000) >> EAL: Ask a virtual area of 0x5e000000 bytes >> EAL: Virtual area found at 0x7fde47e00000 (size = 0x5e000000) >> EAL: Ask a virtual area of 0x200000 bytes >> EAL: Virtual area found at 0x7fde47a00000 (size = 0x200000) >> EAL: Ask a virtual area of 0x200000 bytes >> EAL: Virtual area found at 0x7fde47600000 (size = 0x200000) >> EAL: Ask a virtual area of 0xa1800000 bytes >> EAL: Virtual area found at 0x7fdda5c00000 (size = 0xa1800000) >> EAL: Ask a virtual area of 0x200000 bytes >> EAL: Virtual area found at 0x7fdda5800000 (size = 0x200000) >> EAL: Requesting 512 pages of size 2MB from socket 0 >> EAL: TSC frequency is ~2799209 KHz >> EAL: Master lcore 0 is ready (tid=a855eb80;cpuset=[0]) >> PMD: rte_vmxnet3_pmd_init(): >> >> EAL: PCI device 0000:03:00.0 on NUMA socket -1 >> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >> EAL: Not managed by a supported kernel driver, skipped >> EAL: PCI device 0000:0b:00.0 on NUMA socket -1 >> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >> EAL: PCI memory mapped at 0x7fdea6200000 >> EAL: PCI memory mapped at 0x7fdea6201000 >> EAL: PCI memory mapped at 0x7fdea6202000 >> PMD: eth_vmxnet3_dev_init(): >> >> PMD: eth_vmxnet3_dev_init(): Hardware version : 1 >> PMD: eth_vmxnet3_dev_init(): UPT hardware version : 1 >> PMD: eth_vmxnet3_dev_init(): MAC Address : 00:0c:29:b5:9f:5b >> EAL: PCI device 0000:13:00.0 on NUMA socket -1 >> EAL: probe driver: 15ad:7b0 rte_vmxnet3_pmd >> EAL: Not managed by a supported kernel driver, skipped >> Zone 0: name:, phys:0x555fdec0, len:0x2080, >> virt:0x7fdea61fdec0, socket_id:0, flags:0 >> Zone 1: name:, phys:0x95375f00, len:0x28a0c0, >> virt:0x7fde87975f00, socket_id:0, flags:0 >> Zone 2: name:, phys:0x555cd300, len:0x2f800, >> virt:0x7fdea61cd300, socket_id:0, flags:0 >> >> PMD: vmxnet3_dev_configure(): >> >> PMD: vmxnet3_dev_tx_queue_setup(): >> >> PMD: vmxnet3_dev_rx_queue_setup(): >> >> PMD: vmxnet3_dev_start(): >> >> PMD: vmxnet3_rss_configure(): >> >> PMD: vmxnet3_write_mac(): Writing MAC Address : 00:0c:29:b5:9f:5b >> PMD: vmxnet3_disable_intr(): >> >> PMD: vmxnet3_dev_rxtx_init(): >> >> 2016-07-25T09:40:23Z|00020|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >> PMD: vmxnet3_dev_stop(): >> >> PMD: vmxnet3_disable_intr(): >> >> PMD: vmxnet3_dev_stop(): Device reset. >> PMD: vmxnet3_dev_clear_queues(): >> >> PMD: vmxnet3_dev_configure(): >> >> PMD: vmxnet3_dev_tx_queue_setup(): >> >> PMD: vmxnet3_dev_tx_queue_setup(): >> >> PMD: vmxnet3_dev_tx_queue_setup(): >> >> PMD: vmxnet3_dev_rx_queue_setup(): >> >> PMD: vmxnet3_dev_start(): >> >> PMD: vmxnet3_rss_configure(): >> >> PMD: vmxnet3_write_mac(): Writing MAC Address : 00:0c:29:b5:9f:5b >> PMD: vmxnet3_dev_start(): Device activation: UNSUCCESSFUL > > > Unfortunately it is the most I can help you, it is strange for me why > test-pmd is working and why OvS is not. > I think it is a DPDK issue, then the next step is to post on the DPDK > mailing (dev@dpdk.org, add also in CC Yong Wang that > is the vmxnet3 maintainer), send a link to this thread in order to be clear > what you have tested. Hello Yong Wang, I am running fedora VM in ESXi 5.5.0 environment. I tried to install OVS and DPDK. OVS couldnt start DPDK device. You can see the error in the mail below. Do you know why? IF you need more information. I can provide more information. Good news, when I tried in Fedora 23 VM in ESXi 5.5.0, it works. It is possible to bind an dpdk device and get packets on port. Thanks Mauricio for your help and reply. Best regards Sothy > >> I deleted exisiting bridge and recreated:::::: >> >> >> Then I added bridge. After I try to create bridge. It gives error. The >> erros is same as shown in log file. >> >> 2016-07-25T09:29:43.248Z|00020|bridge|INFO|bridge br0: added interface >> br0 on port 65534 >> 2016-07-25T09:29:43.253Z|00021|dpif_netlink|WARN|Generic Netlink >> family 'ovs_datapath' does not exist. The Open vSwitch kernel module >> is probably not loaded. >> 2016-07-25T09:29:43.253Z|00022|bridge|INFO|bridge br0: using datapath >> ID 0000e6aac740584b >> 2016-07-25T09:29:43.253Z|00023|connmgr|INFO|br0: added service >> controller "punix:/usr/local/var/run/openvswitch/br0.mgmt" >> 2016-07-25T09:30:54.008Z|00024|dpdk|INFO|Port 0: 00:0c:29:b5:9f:5b >> 2016-07-25T09:30:54.021Z|00025|dpdk|ERR|Interface dpdk0 start error: >> Operation not permitted >> 2016-07-25T09:30:54.021Z|00026|dpif|WARN|netdev@ovs-netdev: failed to >> add dpdk0 as port: Operation not permitted >> >> >> >>> Another thing to do would be to bind the NICs to the uio_pci_generic and >>> VFIO modules, just to be sure that the issue is also present there. >> >> I tried in uio and uio_pci_genric also. Both are giving same error. >> I suspect I cannt activate VFIO in VM since it is BIOS suport also. AM I >> right? >> >> Thanks >> >>> >>>> in command line some information for your verification: >>>> >>>> sudo ovs-vsctl show >>>> d53612e0-5d82-4cc1-af7d-ee887a737ef2 >>>> Bridge "br0" >>>> Port "dpdk0" >>>> Interface "dpdk0" >>>> type: dpdk >>>> Port "br0" >>>> Interface "br0" >>>> type: internal >>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl del-br br0 >>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl add-br br0 -- >>>> set bridge br0 datapath_type=netdev >>>> vrouter@vrouter-virtual-machine:~/ovs$ sudo ovs-vsctl add-port br0 >>>> dpdk0 -- set Interface dpdk0 type=dpdk >>>> ovs-vsctl: Error detected while setting up 'dpdk0'. See ovs-vswitchd >>>> log for details. >>>> >>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>>> sudo ovs-vsctl show >>>>>>> d53612e0-5d82-4cc1-af7d-ee887a737ef2 >>>>>>> Bridge "br0" >>>>>>> Port "dpdk0" >>>>>>> Interface "dpdk0" >>>>>>> type: dpdk >>>>>>> Port "br0" >>>>>>> Interface "br0" >>>>>>> type: internal >>>>>>> >>>>>>> sudo ovs-ofctl dump-flows br0 >>>>>>> NXST_FLOW reply (xid=0x4): >>>>>>> cookie=0x0, duration=487.638s, table=0, n_packets=0, n_bytes=0, >>>>>>> idle_age=487, priority=0 actions=NORMAL >>>>>>> >>>>>>> >>>>>>>> In addition I would recommend to use the test-pmd [1] application >>>>>>>> from >>>>>>>> DPDK >>>>>>>> to check if the issue is also present in that case. >>>>>> >>>>>> I run testpmd command.The result is >>>>>> >>>>>> Configuring Port 0 (socket 0) >>>>>> Port 0: 00:0C:29:B5:9F:5B >>>>>> Configuring Port 1 (socket 0) >>>>>> Port 1: 00:0C:29:B5:9F:65 >>>>>> Checking link statuses... >>>>>> Port 0 Link Up - speed 10000 Mbps - full-duplex >>>>>> Port 1 Link Up - speed 10000 Mbps - full-duplex >>>>>> Done >>>>>> No commandline core given, start packet forwarding >>>>>> io packet forwarding - CRC stripping disabled - packets/burst=32 >>>>>> nb forwarding cores=1 - nb forwarding ports=2 >>>>>> RX queues=1 - RX desc=128 - RX free threshold=0 >>>>>> RX threshold registers: pthresh=0 hthresh=0 wthresh=0 >>>>>> TX queues=1 - TX desc=512 - TX free threshold=0 >>>>>> TX threshold registers: pthresh=0 hthresh=0 wthresh=0 >>>>>> TX RS bit threshold=0 - TXQ flags=0x200 >>>>>> Press enter to exit >>>>>> >>>>>> Telling cores to stop... >>>>>> Waiting for lcores to finish... >>>>>> >>>>>> ---------------------- Forward statistics for port 0 >>>>>> ---------------------- >>>>>> RX-packets: 88 RX-dropped: 0 RX-total: 88 >>>>>> TX-packets: 2 TX-dropped: 0 TX-total: 2 >>>>>> >>>>>> >>>>>> >>>>>> ---------------------------------------------------------------------------- >>>>>> >>>>>> ---------------------- Forward statistics for port 1 >>>>>> ---------------------- >>>>>> RX-packets: 2 RX-dropped: 0 RX-total: 2 >>>>>> TX-packets: 88 TX-dropped: 0 TX-total: 88 >>>>>> >>>>>> >>>>>> >>>>>> ---------------------------------------------------------------------------- >>>>>> >>>>>> +++++++++++++++ Accumulated forward statistics for all >>>>>> ports+++++++++++++++ >>>>>> RX-packets: 90 RX-dropped: 0 RX-total: 90 >>>>>> TX-packets: 90 TX-dropped: 0 TX-total: 90 >>>>>> >>>>>> >>>>>> >>>>>> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >>>>>> >>>>>> make sense? >>>>> >>>>> >>>>> Yes, it makes sense. Ports are being recognized by DPDK and some >>>>> packets >>>>> were exchanged. >>>>> >>>>> >>>>>>>> [1] http://dpdk.org/doc/guides-16.04/testpmd_app_ug/index.html >>>>>>>> >>>>>>>> Mauricio Vasquez, >>>>> >>>>> >>> Mauricio V, > >