From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by dpdk.org (Postfix) with ESMTP id E16E4107A for ; Fri, 29 Sep 2017 04:40:42 +0200 (CEST) Received: by mail-oi0-f49.google.com with SMTP id r20so64854oie.0 for ; Thu, 28 Sep 2017 19:40:42 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=AItThhBr+zo12JsuEgjyH2ji6x1DvHLwwBUywigJbjw=; b=qwEiFiwYUPkTwIqavqzTeVC9uEraKSYvEO3r2aH5O8ZYLYcohYeIme4j8TAXevMjDx 3cJ+McvV9PwBGCrWdXz82zFFTEz9tOuTN+R9axcPWJWO1a918j6ueemo+IRQfOto4/AX K77Jr7EGyx+nPEh1i0Iner0qekc/yAYY6N1HvLfPSUh6HPUeE0dlTMsLNl5W/ttdwwxJ rXnjaVyDUTsfMYco1njI8dromwtpoPtUSRsgQQw7BpFrft2psoFARlYrSHG9CcQPEUmE jK8l5oCBtBjJQcpaFmaaCsAxpN6ZUA3NqlZlxqQYzDOLs6fXo1H0gUKeRqNmgWG9v/qj P21g== X-Gm-Message-State: AMCzsaXJn0g1hlgxX41lH+WtFUgzz/lrTJ9QGrLU5RSo0i24uiCyqISl qpd4DJC4jhktaZvv7XvPuEUBmptjY69TzAmuRN82gA== X-Google-Smtp-Source: AOwi7QDRKhNrov0wJlCuOj01FFP9po5p1RFP7P8Uy96oayp0rtQsqAuBubqS8UBpr5i6kjk6PhqizjBUoaf36lGz510= X-Received: by 10.202.212.209 with SMTP id l200mr1467863oig.360.1506652841859; Thu, 28 Sep 2017 19:40:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.157.61.163 with HTTP; Thu, 28 Sep 2017 19:40:41 -0700 (PDT) In-Reply-To: <6613CB6E-EBE2-40AD-9A5C-AA67C1C833D0@intel.com> References: <6613CB6E-EBE2-40AD-9A5C-AA67C1C833D0@intel.com> From: Andrew Theurer Date: Thu, 28 Sep 2017 21:40:41 -0500 Message-ID: To: "Wiles, Keith" Cc: Mauricio Valdueza , "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Any way to get more that 40Mpps with 64bytes using a XL710 40Gb nic X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Sep 2017 02:40:43 -0000 In our tests, ~36Mpps is the maximum we can get. We usually run a test with TRex, bidirectional, 2 pci cards, 1 port per x8 gen3 PCI adapter, with a device under test using same HW config but running testomd with 2 or more queues per port. Bidirectional aggregate traffic is in the 72Mpps range. So, in that test, each active port is transmitting and receiving ~36Mpps, however, I don't believe the received packets are DMA'd to memory, just counted on the adapter. I have never observed the Fortville doing higher than that. -Andrew On Thu, Sep 28, 2017 at 3:59 PM, Wiles, Keith wrote= : > > > On Sep 28, 2017, at 6:06 AM, Mauricio Valdueza > wrote: > > > > Hi Guys; > > > > I am testing a Fortville 40Gb nic with PKTgen > > > > I see linerate in 40Gb with 156B packet size, but once I decrease size, > linerate is far away > > In Pktgen the packet count is taken from the hardware registers on the NI= C > and the bit rate is calculated using those values. Not all NICs flush the > TX done queue and from one start command to the next the numbers can be o= ff > as the old packets are being recycled with the new size packets. Please t= ry > the different sizes and bring down pktgen between runs just to see if tha= t > is the problem. > > > > > WITH 158B > > Link State : ----TotalRate---- > > Pkts/s Max/Rx : 0/0 0/0 > > Max/Tx : 28090480/28089840 28090480/28089840 > > MBits/s Rx/Tx : 0/40000 0/40000 > > ------------------------------------------------------------ > ----------------------------------- > > > > WITH 128B > > Link State : ----TotalRate---- > > Pkts/s Max/Rx : 0/0 0/0 > > Max/Tx : 33784179/33783908 33784179/33783908 > > MBits/s Rx/Tx : 0/40000 0/40000 > > ------------------------------------------------------------ > ------------------------------------ > > > > With 64B > > Link State : ----TotalRate---- > > Pkts/s Max/Rx : 0/0 0/0 > > Max/Tx : 35944587/35941680 35944587/35941680 > > MBits/s Rx/Tx : 0/24152 0/24152 > > ------------------------------------------------------------ > ---------------------------------- > > > > Should I run any optimization? > > > > My environment is: > > > > =E2=80=A2VMware ESXi version: 6.5.0, 4887370 > > =E2=80=A2Exact NIC version: Intel Corporation XL710 for= 40GbE > QSFP+ > > =E2=80=A2NIC driver version: i40en version 1.3.1 > > =E2=80=A2Server Vendor: Dell > > =E2=80=A2Server Make: Dell Inc. PowerEdge R730 > > =E2=80=A2CPU Model: I ntel(R) Xeon(R) CPU E5-26= 97 v3 @ > 2.60GHz > > =E2=80=A2Huge pages size: 2M > > =E2=80=A2Test VM: What is it? Ubuntu 16.04 > > =E2=80=A2 DPDK is compiled there? dpdk-17.08 > > =E2=80=A2Test traffic kind: IP/UDP? Both tested > > Traffic generator: Intel pktgen version? pktgen-3.4.1 > > > > > > I am executing: > > > > sudo ./app/x86_64-native-linuxapp-gcc/pktgen -c 0xff n 3 --proc-type > auto --socket-mem 9096 -- -m "[1:2-7].0" --crc-strip > > > > > > Thanks in advance > > > > > > mauricio > > > > Regards, > Keith > >