From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-io0-f174.google.com (mail-io0-f174.google.com [209.85.223.174]) by dpdk.org (Postfix) with ESMTP id 893772C27 for ; Wed, 12 Apr 2017 23:00:51 +0200 (CEST) Received: by mail-io0-f174.google.com with SMTP id r16so55524886ioi.2 for ; Wed, 12 Apr 2017 14:00:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=UynCrAYU8OsY6G5KenSNTqnL2J02afCQtN33OIfYzKw=; b=ARqn/2kHKxxLU8JAPbuRfx5gTxVFKEApO64wQn1smkXRGvXyyDbyulyJfscsZC5rG3 Gudo5P2OziAQqQwDVsJQszAzeqjLwFSIR6jnUeuAJz47lpfXlSXjgWK1WJzUSrxd6PiV kZJmeCGDvIkg7antWV11nInwXJ9+7raf5+qLYvbJUh5vszZ1q7CA5Zo7Ty/8v1DFBJmd spTqNMf3+uE4LD/hbbRGlswQNayQYwM8D7j2KKyXzsDK/JXykznsi3wMZpy6IZjjXjZ3 jKGLaxwBBv+qkKVVam3+YyFZt86cynYU835PIoWJSLftOPbAqMVc0EtAKcxt4jfFZ68P Zp9g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=UynCrAYU8OsY6G5KenSNTqnL2J02afCQtN33OIfYzKw=; b=e8yFW+5SlWN+8PixfipHkbbn5AGNwOvAzesiMDqkFJW+vzc/6bdAcXIDMyZlbQDCM5 WXmkPiJW9JogQIXOEK3VEf373neJfQWlrgeg5UO8mFLUWJio5nsatU92rM43SZrwzi4z 5/Bhw+/tm42MjKY13TxxsisgV7n4AHLjaEcgO8rCHH1kbDuSty6O5o9ErcmsUCzRhgPA ZvF/TZf/4jLJPVna/xtNBPheEBJjiMEHjzZtKqOZxxT5S9fAW2zBZXGhoClrnC+SIzSB imwutL1qRZ2uNNLNgCdWd7pN1MVw9dSYRYovF0+NlXvv3mDzfiLhKHG+RbURT6su6ari ++5g== X-Gm-Message-State: AN3rC/7OWyEqSKOvvhRqJIkXrKUA5gc1cdTB8brStzn2OAUuQnVLX9o4 HmbNUrfbVDHNc2IYJsaOE1f4hpItfca4 X-Received: by 10.36.173.19 with SMTP id c19mr242859itf.76.1492030850609; Wed, 12 Apr 2017 14:00:50 -0700 (PDT) MIME-Version: 1.0 Received: by 10.79.145.19 with HTTP; Wed, 12 Apr 2017 14:00:10 -0700 (PDT) From: Shihabur Rahman Chowdhury Date: Wed, 12 Apr 2017 17:00:10 -0400 Message-ID: To: users@dpdk.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Low Rx throughput when using Mellanox ConnectX-3 card with DPDK X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Apr 2017 21:00:52 -0000 Hello, We are running a simple DPDK application and observing quite low throughput. We are currently testing a DPDK application with the following setup - 2 machines with 2xIntel Xeon E5-2620 CPUs - Each machine with a Mellanox single port 10G ConnectX3 card - Mellanox DPDK version 16.11 - Mellanox OFED 4.0-2.0.0.1 and latest firmware for ConnectX3 The application is doing almost nothing. It is reading a batch of 64 packets from a single rxq, swapping the mac of each packet and writing it back to a single txq. The rx and tx is being handled by separate lcores on the same NUMA socket. We are running pktgen on another machine. With 64B sized packets we are seeing ~14.8Mpps Tx rate and ~7.3Mpps Rx rate in pktgen. We checked the NIC on the machine running the DPDK application (with ifconfig) and it looks like there is a large number of packets being dropped by the interface. Our connectx3 card should be theoretically be able to handle 10Gbps Rx + 10Gbps Tx throughput (with channel width 4, the theoretical max on PCIe 3.0 should be ~31.2Gbps). Interestingly, when Tx rate is reduced in pktgent (to ~9Mpps), the Rx rate increases to ~9Mpps. We would highly appriciate if we could get some pointers as to what can be possibly causing this mismatch in Rx and Tx. Ideally, we should be able to see ~14Mpps Rx well. Is it because we are using a single port? Or something else? FYI, we also ran the sample l2fwd application and test-pmd and got comparable results in the same setup. Thanks Shihab