From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qc0-f181.google.com (mail-qc0-f181.google.com [209.85.216.181]) by dpdk.org (Postfix) with ESMTP id AE3755A1F for ; Wed, 21 Jan 2015 18:02:34 +0100 (CET) Received: by mail-qc0-f181.google.com with SMTP id l6so28365623qcy.12 for ; Wed, 21 Jan 2015 09:02:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xdel.ru; s=google; h=mime-version:from:date:message-id:subject:to:cc:content-type; bh=ZxJ8FbexkEwmog5RXG5GVFpK699A65yH0GyJg8K8gMA=; b=VW8AxulqblrvpDUVZfcOnGuFU2pNLR+cSwSqJRyVq6Hh4b8jh7YZTbIl7p/b5+RSRr YE4mOjAbhNSgX7XpqYmVe+bsbQa6BHlVwcnjUf0ncF4YnrRqZYB6wML19rVR9CIqCI23 ddMMLJVRO4MNMpaY5zy4tk5Y9ZV9Hj7G/Bqtw= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc :content-type; bh=ZxJ8FbexkEwmog5RXG5GVFpK699A65yH0GyJg8K8gMA=; b=V1WWrHXg8EatG3Rir1/KSQywLuIhUTUmv+1ndsWqgXIUD/Ki7QMk5EEPwx4lBU3pcg iXEK/v7AIXabqkikTYeZK2eJ8l9D1ipCVfRDAFLbqUwvsEJ1BnZLRdJ9RWyIxCrCc7Xb gMGJZKC2SnldcWyCx8KJ4oNbclGAmZ9/Pmx+rW6N+reWxKatFI2Dl2UbGnk0Gi76dwu1 70anqwvQaIdBG7lZG5Gxpa+l/utnvkdwV79NMaoQHqmgcRtLKkrPMUUroyvn9q6mSUlW XOQiasRd30Mqu2cjjslLEVD9ZQJK49VbFMrxudKLlOj/4uq4DZb+IVyhV+6BJYaM6Ep8 dmTA== X-Gm-Message-State: ALoCoQkWR68BjBqpCYZ/KKprN3wv4InePCzu7X4VNTOomsuyrTz6xPTtsCyn+TeE79B5c584HAj0 X-Received: by 10.140.42.14 with SMTP id b14mr7272347qga.47.1421859753179; Wed, 21 Jan 2015 09:02:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.92.197 with HTTP; Wed, 21 Jan 2015 09:02:11 -0800 (PST) From: Andrey Korolyov Date: Wed, 21 Jan 2015 21:02:11 +0400 Message-ID: To: dev@dpdk.org Content-Type: text/plain; charset=UTF-8 Cc: "discuss@openvswitch.org" Subject: [dpdk-dev] Packet drops during non-exhaustive flood with OVS and 1.8.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Jan 2015 17:02:35 -0000 Hello, I observed that the latest OVS with dpdk-1.8.0 and igb_uio starts to drop packets earlier than a regular Linux ixgbe 10G interface, setup follows: receiver/forwarder: - 8 core/2 head system with E5-2603v2, cores 1-3 are given to OVS exclusively - n-dpdk-rxqs=6, rx scattering is not enabled - x520 da - 3.10/3.18 host kernel - during 'legacy mode' testing, queue interrupts are scattered through all cores sender: - 16-core E52630, netmap framework for packet generation - pkt-gen -f tx -i eth2 -s 10.6.9.0-10.6.9.255 -d 10.6.10.0-10.6.10.255 -S 90:e2:ba:84:19:a0 -D 90:e2:ba:85:06:07 -R 11000000, results in 11Mpps 60-byte packet flood, there are constant values during test. OVS contains only single drop rule at the moment: ovs-ofctl add-flow br0 in_port=1,actions=DROP Packet generator was launched for tens of seconds for both Linux stack and OVS+DPDK cases, resulting in zero drop/error count on the interface in first, along with same counter values on pktgen and host interface stat (means that the none of generated packets are unaccounted). I selected rate for about 11M because OVS starts to do packet drop around this value, after same short test interface stat shows following: statistics : {collisions=0, rx_bytes=22003928768, rx_crc_err=0, rx_dropped=0, rx_errors=10694693, rx_frame_err=0, rx_over_err=0, rx_packets=343811387, tx_bytes=0, tx_dropped=0, tx_errors=0, tx_packets=0} pktgen side: Sent 354506080 packets, 60 bytes each, in 32.23 seconds. Speed: 11.00 Mpps Bandwidth: 5.28 Gbps (raw 7.39 Gbps) If rate will be increased up to 13-14Mpps, the relative error/overall ratio will rise up to a one third. So far OVS on dpdk shows perfect results and I do not want to reject this solution due to exhaustive behavior like described one, so I`m open for any suggestions to improve the situation (except using 1.7 branch :) ).