From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f47.google.com (mail-wm0-f47.google.com [74.125.82.47]) by dpdk.org (Postfix) with ESMTP id EA6241BA81 for ; Mon, 29 Jan 2018 18:29:58 +0100 (CET) Received: by mail-wm0-f47.google.com with SMTP id f3so35289683wmc.1 for ; Mon, 29 Jan 2018 09:29:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=OD0WkkrsBWYgKjF8bR4KC9E/NJs4Rd2I5wJ7fdIrVW4=; b=dtkMrjk2Er7ZbZDiUcUt4sM7oplEXNwXsQdjMxVS8jDjEsmup0vDGshE6KFwtL6scy iXxUXite2rESZ88rkO21wafPCn7oqjRl2nKrInNTKQsLakDjWwon0xWYxnfO8jpd0I6E Zg3MiKTxDlhObF+rQzYlutUvpYt478YERfiC9reoIl4co0HToJwbB5ISDdqrRBt/WnAQ Ub4KI25frKgkuJZwnAUEjvRdb0wIEoP1p+IXjnmaLoM9OE660/GLRcTwfdiEVplRxlcv yabESTJc0GHy3jN3I6+uY0EInABkzRP5hhsCpmVWkiW24eXm86LQUskv/C61520gYxIw umYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=OD0WkkrsBWYgKjF8bR4KC9E/NJs4Rd2I5wJ7fdIrVW4=; b=sC/pRZr1mmxnSaqeDzdR6FyUOWX8w0dqWdpxdY0Lbi0shzeANoA0Ssh3fKNS3mZXNy MQFu3FzGuZrgH4zrHDp54VgpD4yjVQW5tUW9dH5/GPLsvNLlpLH4EpeEGA/ANFTPYRMT wUl866yyZTfwg0x9ubTB06e51lC0k1pIAPmWF9zQSgHO1Z5uXrWwJzebtyUePDTnAjPi S9by+QML53rCvAmH6d8LsFtGJrILWEwnzz4dDwJQIxhBONi/6Qptoc78GoxKARtxhzrI EhiKpJkEWeZqKXRdlcj/U2tPjyl87q1+Tq3EfadHXMm7QXM6opppvCJ9zLDEZVoLj/lH pVeg== X-Gm-Message-State: AKwxytfBQ5Y9eBplwLubE29eb+3ZluQbE+yai/yK3+6dybfuhVq2NdST pLaCkhk/B1MBdXzp5YRo/dfWevYAZCg+tCtoT0NLYfrp X-Google-Smtp-Source: AH8x224SevXInmCWKkc63mEkZTx95HBx9bb9rmUpdFrAWqyqmU0WBI+Hfceylg8CfscoMec2/GRa+Q1kM5mdphItw8Y= X-Received: by 10.80.136.85 with SMTP id c21mr22876471edc.259.1517246998445; Mon, 29 Jan 2018 09:29:58 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.134.245 with HTTP; Mon, 29 Jan 2018 09:29:57 -0800 (PST) From: Hugo Menna Barreto Date: Mon, 29 Jan 2018 15:29:57 -0200 Message-ID: To: users@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Significant performance penalty when using flow director in Intel 82599ES X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2018 17:29:59 -0000 Hi, I am using an Intel 82599ES NIC with DPDK. Without activating flow director I am able to process 64B packets at line rate (10Gbps). Unfortunately, as soon as I activate flow director, the maximum throughput is around 5Gbps -- above this rate the NIC starts dropping packets. Trying to isolate the problem I inspected the struct obtained using "rte_eth_stats_get". Interestingly "rte_eth_stats.imissed" is going up while "rte_eth_stats.rx_nombuf" remains at zero. As far as I know "imissed" is linked to the MPC register and, therefore, indicates that the NIC buffer is full. I can imagine that activating flow director may impact performance -- as it reduces the effective rx packet buffer size from 512KB to 448KB. However, I did not expect the impact to be of such proportions. Therefore I am suspicious that I may be doing something wrong. My questions are: When using flow director, is only getting half the throughput the expected behavior? If it is, is there any direction one should follow in order to -- at least partially -- mitigate this problem? (e.g., would RSC help in this case?) If it isn't, any ideas so far on what I may be doing wrong? Thank you for your attention. Best regards, Hugo p.s. Some relevant fields of "rte_eth_conf": ------------------------------------- rte_eth_conf { [...] .rxmode = { .mq_mode = ETH_MQ_RX_NONE [...] } .fdir_conf = { .mode = RTE_FDIR_MODE_SIGNATURE, .pballoc = RTE_FDIR_PBALLOC_64K, .status = RTE_FDIR_REPORT_STATUS_ALWAYS, [...] } } Some extra details: ------------------- * DPDK version: 17.08.1 * NIC: Intel 82599ES (ixgbe) * CPU: E5-2650 (Sandy Bridge) * PCIe: Gen2, Speed 5GT/s, Width x8