From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-vk0-f50.google.com (mail-vk0-f50.google.com [209.85.213.50]) by dpdk.org (Postfix) with ESMTP id C403B2C0B for ; Thu, 15 Jun 2017 04:55:32 +0200 (CEST) Received: by mail-vk0-f50.google.com with SMTP id 191so485503vko.2 for ; Wed, 14 Jun 2017 19:55:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=os-korea-ac-kr.20150623.gappssmtp.com; s=20150623; h=mime-version:from:date:message-id:subject:to; bh=vBIpLG9WJYAf99IYXPKjkrBPh7Be10dEkZqT4LE3gjA=; b=w2Da9zZr1e5Wm48AS3GQK7Kn6QnbtjYzNRmchAW8ZUyIDf9AmUeS6P+EFrB855V9mO 5CmZf12bfUZAn/GuILUpfCy0Peeg05gOhb5MGFdiwtnnGpUhvEvKKnolVObIF0EHIXPd ewt3CB3awKGj+VlT0WnPT1HfGADs6pOeCUvybSc4h2yfPghylZ89Vm5uuuxytmnW/w6c dkl37XJ4MEIZSZ2h9TjwkWB2Ck4uWdo6U71MZ5ynpoZfUHrH3IMR7CfaGAKSntnn9QQr +tj9XC+HiCygzzFtQTghm1On/ZSNRedPYesmvF4fteN+kZuveHMS3RsCI6uGu4mA7sCM retA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=vBIpLG9WJYAf99IYXPKjkrBPh7Be10dEkZqT4LE3gjA=; b=V3ebpoVs+d2h+/hwNIzz4nge4WOtnxBTsfUcgqtwKeQu8U7QUS0H3iwwmHiE8JbqtH DXAgle45sYXW/5FgKy/4h/6tXGdTEvaqXFd7y9eM9G1KuwyunsZW1OHdb/HReu60SkSr S6WnB7UpYt6HOqfjFZIMeGMpuw8v1Q0JIe4cFkA+8meVvfPJa20izX6suCXzx8kQxKUz NfaOmJmUfMC9vgSWrKVyCvJnnQfljOM8aGBtQ2wUJfRlbuGAUtE5ZUVKfZfGvui7qlxd axNKfB1BFs+sU1J/Ie/WatNrrAz76Mov8DRyGu6V49ryBxDklTqHrxd4XKtZBwl1AhHo NZJg== X-Gm-Message-State: AKS2vOwowyaJtD8l0ZBJ+VWEi5koK/DEA3AgqGnKJFjRM+gzX/70F8C5 i9cLOoZ/BG0k1ebSGxEVMU/+JvrbSbUOXQg= X-Received: by 10.31.160.85 with SMTP id j82mr1906852vke.42.1497495331556; Wed, 14 Jun 2017 19:55:31 -0700 (PDT) MIME-Version: 1.0 Received: by 10.31.106.129 with HTTP; Wed, 14 Jun 2017 19:55:31 -0700 (PDT) From: Heung Sik Choi Date: Thu, 15 Jun 2017 11:55:31 +0900 Message-ID: To: users@dpdk.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] DPDK OVS does not work properly in a multi-flow environment. X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Jun 2017 02:55:33 -0000 Hi, I want to check the performance of DPDK OVS in aspect of forwarding as below URL. https://drive.google.com/a/os.korea.ac.kr/file/d/0BxEx0xE0gw2ETjhkaUpzN3YxS= VU/view?usp=3Dsharing There is a similar experiment at 'Intel=C2=AE Open Network Platform Release= 2.1 Performance Test Report'. Also, there is the result of this. the result shows that when DPDK OVS use multi poll-mode thread and receive multi flows packet, it can achieve amazing throughput. Thus, it can achieves high performance in multi-flows environment. However, I couldn't make this result in my experiment environment. when I made 10 types of packet by DPDK pktgen machine, the throughput dropped by 2Gbps. with single flow and multi threading, the throughput is 8Gbps in my machine. Thus, it is a big problem to me. What makes these the problems in my experiment? Please Help me. My setting is as below: Hardware(both is same) - cpu: Xeon 2630 v2 *2 (NUMA) - mem: 48G (sum of hugepage(1G) :16G) - nic: 82599 ES Software(DPDK OVS) - OS: ubuntu 16.04 - kernel 4.8.0-54 generic(default kernel) - DPDK :2.2 OVS :2.5.2 [I installed this from ubuntu package(ex. apt-get install ovs-vswitch-dpdk)] - the way to set flow table : "i=3D0 j=3D1 while [ $i !=3D 1 ] do while [ $j !=3D 255 ] do ovs-ofctl add-flow br0 ip,nw_dst=3D192.0."$i"."$j",actions=3Dmod_dl_dst:90:e2:ba:5b:88:2c,in_port j=3D$((j+1)) done j=3D1 i=3D$((i+1)) done" - used commands for multi queues & threads: ovs-vsctl set Open_vSwitch . other_config:pmd-cpu-mask=3D0x3f ovs-vsctl set Open_vSwitch . other_config:n-dpdk-rxqs=3D4 ovs-vsctl set Open_vSwitch . other_config:n-dpdk-txqs=3D4 Software(Pktgen) - multi flow command (lua): pktgen.dst_mac("all","start","90:e2:ba:5a:78:30"); pktgen.dst_mac("all","inc","00:00:00:00:00:00"); pktgen.dst_mac("all","min","90:e2:ba:5a:78:30"); pktgen.dst_mac("all","max","90:e2:ba:5a:78:30"); pktgen.src_mac("all","start","90:e2:ba:5b:88:2c"); pktgen.src_mac("all","inc","00:00:00:00:00:00"); pktgen.src_mac("all","min","90:e2:ba:5b:88:2c"); pktgen.src_mac("all","max","90:e2:ba:5b:88:2c"); --pktgen.delay(1000); pktgen.dst_ip("all","start","192.0.0.1"); pktgen.dst_ip("all","inc","0.0.0.1"); pktgen.dst_ip("all","min","192.0.0.1"); pktgen.dst_ip("all","max","192.0.0.10"); --pktgen.delay(1000); pktgen.src_ip("all","start","10.0.0.1"); pktgen.src_ip("all","inc","0.0.0.0"); pktgen.src_ip("all","min","10.0.0.1"); pktgen.src_ip("all","max","10.0.0.1"); --pktgen.delay(1000); pktgen.src_port("all","start",9); pktgen.src_port("all","inc",0); pktgen.src_port("all","min",9); pktgen.src_port("all","max",9); --pktgen.delay(1000); pktgen.dst_port("all","start",10); pktgen.dst_port("all","inc",0); pktgen.dst_port("all","min",10); pktgen.dst_port("all","max",10); --pktgen.delay(1000); pktgen.pkt_size("all","start",64); pktgen.pkt_size("all","inc",0); pktgen.pkt_size("all","min",64); pktgen.pkt_size("all","max",64); pktgen.set_proto("all","tcp"); pktgen.set_type("all","ipv4"); - Use 10 core ./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0x7df -n 4 -- -f multiflow.lua -N -m "[1-5:6-10].0" Please let me know if you have any insights.