From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oa0-x22e.google.com (mail-oa0-x22e.google.com [IPv6:2607:f8b0:4003:c02::22e]) by dpdk.org (Postfix) with ESMTP id B768338E9 for ; Mon, 10 Feb 2014 18:33:25 +0100 (CET) Received: by mail-oa0-f46.google.com with SMTP id n16so7807840oag.5 for ; Mon, 10 Feb 2014 09:34:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Ln1/V2+5XW7qJyIchuIY+Se4CxETMo1s/AQiisflrGc=; b=NCEv8sGKMZ5OiMjmBCuC4Ou1FK9e5B/VA5HoMIf2iII4hIHfCNJMDXyCXxTwEOrqw9 njC5ZI9NhkgXLZZcOCLhNzg6udfmdz6fDVCn5K2sCBKK5cPBoFXLh3IBxpgfvbRyyZIJ rHgaWVKQHTa3KoFxwaehLvw9ehstjPCs8mBjbhfZ2fAZ2YEBmDJ2479O8RVIigyZTxmM 39vrZD7ZbCfbD8nUpsds7hAYCEBWAg8EHAMeDH3KYjpA4BEv4jyHLeS8zM+6hYpVCpmg BAhnl4pX5mVcUKhKaTpd5KYQtfWgGCWwtdP2+DDjU1lDVo/IIFBKzXQsokT0UOvK8lmq 0qZg== MIME-Version: 1.0 X-Received: by 10.60.50.202 with SMTP id e10mr28027228oeo.39.1392053687792; Mon, 10 Feb 2014 09:34:47 -0800 (PST) Received: by 10.76.22.2 with HTTP; Mon, 10 Feb 2014 09:34:47 -0800 (PST) In-Reply-To: <52E76AD3.9040404@gmail.com> References: <52DFDB10.2090906@gmail.com> <52E76AD3.9040404@gmail.com> Date: Mon, 10 Feb 2014 18:34:47 +0100 Message-ID: From: Jun Han To: Dmitry Vyal Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] Rx-errors with testpmd (only 75% line rate) X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Feb 2014 17:33:26 -0000 Hi Michael, We are also trying to purchase an IXIA traffic generator. Could you let us know which chassis + load modules you are using so we can use that as a reference to look for the model we need? There seems to be quite a number of different models. Thank you. On Tue, Jan 28, 2014 at 9:31 AM, Dmitry Vyal wrote: > On 01/28/2014 12:00 AM, Michael Quicquaro wrote: > >> Dmitry, >> I cannot thank you enough for this information. This too was my main >> problem. I put a "small" unmeasured delay before the call to >> rte_eth_rx_burst() and suddenly it starts returning bursts of 512 packets >> vs. 4!! >> Best Regards, >> Mike >> >> > Thanks for confirming my guesses! By the way, make sure the number of > packets you receive in a single burst is less than configured queue size. > Or you will lose packets too. Maybe your "small" delay in not so small :) > For my own purposes I use a delay of about 150usecs. > > P.S. I wonder why this issue is not mentioned in documentation. Is it > evident for everyone doing network programming? > > > > >> On Wed, Jan 22, 2014 at 9:52 AM, Dmitry Vyal > dmitryvyal@gmail.com>> wrote: >> >> Hello MIchael, >> >> I suggest you to check average burst sizes on receive queues. >> Looks like I stumbled upon a similar issue several times. If you >> are calling rte_eth_rx_burst too frequently, NIC begins losing >> packets no matter how many CPU horse power you have (more you >> have, more it loses, actually). In my case this situation occured >> when average burst size is less than 20 packets or so. I'm not >> sure what's the reason for this behavior, but I observed it on >> several applications on Intel 82599 10Gb cards. >> >> Regards, Dmitry >> >> >> >> On 01/09/2014 11:28 PM, Michael Quicquaro wrote: >> >> Hello, >> My hardware is a Dell PowerEdge R820: >> 4x Intel Xeon E5-4620 2.20GHz 8 core >> 16GB RDIMM 1333 MHz Dual Rank, x4 - Quantity 16 >> Intel X520 DP 10Gb DA/SFP+ >> >> So in summary 32 cores @ 2.20GHz and 256GB RAM >> >> ... plenty of horsepower. >> >> I've reserved 16 1GB Hugepages >> >> I am configuring only one interface and using testpmd in >> rx_only mode to >> first see if I can receive at line rate. >> >> I am generating traffic on a different system which is running >> the netmap >> pkt-gen program - generating 64 byte packets at close to line >> rate. >> >> I am only able to receive approx. 75% of line rate and I see >> the Rx-errors >> in the port stats going up proportionally. >> I have verified that all receive queues are being used, but >> strangely >> enough, it doesn't matter how many queues more than 2 that I >> use, the >> throughput is the same. I have verified with 'mpstat -P ALL' >> that all >> specified cores are used. The utilization of each core is >> only roughly 25%. >> >> Here is my command line: >> testpmd -c 0xffffffff -n 4 -- --nb-ports=1 --coremask=0xfffffffe >> --nb-cores=8 --rxd=2048 --txd=2048 --mbcache=512 --burst=512 >> --rxq=8 >> --txq=8 --interactive >> >> What can I do to trace down this problem? It seems very >> similar to a >> thread on this list back in May titled "Best example for showing >> throughput?" where no resolution was ever mentioned in the thread. >> >> Thanks for any help. >> - Michael >> >> >> >> >