From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp3.iitd.ac.in (smtp3.iitd.ac.in [103.27.11.44]) by dpdk.org (Postfix) with ESMTP id 38C0A44CF for ; Sat, 13 Jan 2018 19:51:23 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by smtp3.iitd.ac.in (Postfix) with ESMTP id D84C140258; Sun, 14 Jan 2018 00:21:22 +0530 (IST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitd.ac.in; h= content-language:content-type:content-type:mime-version :user-agent:date:date:message-id:subject:subject:from:from :received:received; s=iitd; t=1515869478; x=1517683879; bh=5MP3j gHDuVeY41IKLFTllyvMRHDwHsfByM8Qi/b5gSE=; b=Ad/tdI54hHR+ngOhxWlXf X/BwMpKM8uevlGi6XrxYmfNq923Qxs7N48HJSaI7ezPatnPzx4MBql8jwrphvRpM jjAoGpt/ghKPtaszgmD6tI0vBMw5vXClrhSyUjoy89tHL4IXC74b+iNm8X1A691i hzbGGHL2wbvIRRWXa80EQk= X-Virus-Scanned: Debian amavisd-new at smtp2.iitd.ernet.in Received: from smtp3.iitd.ac.in ([127.0.0.1]) by localhost (smtp3.iitd.ac.in [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id nq-upDRKLVPQ; Sun, 14 Jan 2018 00:21:18 +0530 (IST) Received: from [10.237.23.189] (unknown [10.237.23.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: csz168117) by smtp3.iitd.ac.in (Postfix) with ESMTPSA id 66ECF401DC; Sun, 14 Jan 2018 00:21:18 +0530 (IST) To: dev@dpdk.org, "Wiles, Keith" From: Shailja Pandey Message-ID: Date: Sun, 14 Jan 2018 00:21:05 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.0 MIME-Version: 1.0 Content-Language: en-US Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] DPDK-pktgen not giving expected throughput X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 13 Jan 2018 18:51:24 -0000 Hi, Output of command =E2=80=98lspci | grep Ether=E2=80=99 is- 04:00.0 Ethernet controller: Intel Corporation Ethernet Controller 10-Gig= abit X540-AT2 (rev 01) 04:00.1 Ethernet controller: Intel Corporation Ethernet Controller 10-Gig= abit X540-AT2 (rev 01) 05:00.0 Ethernet controller: Intel Corporation Ethernet Controller XL710 = for 40GbE QSFP+ (rev 02) 05:00.1 Ethernet controller: Intel Corporation Ethernet Controller XL710 = for 40GbE QSFP+ (rev 02) I tried running pktgen with this command =2E/app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffff -n 4 -- -T -P -m = =E2=80=9C[2,4,6:8,10,12].0, [14,16,18:20,22,24].1=E2=80=9D but I am unable to see the ports while using comma separated cores like 2= ,4,6. However when I tried with multiple CPUs, the result is still the sa= me. After allocating multiple cores, I also tried the range commands to distr= ibute the packets on different cores(RSS). =20 >/On Jan 11, 2018, at 12:45 AM, Shailja Pandey > wrote: />//>/I have also tried with m= ultiple cpus using the command line- />//>/./app/app/x86_64-native-linuxa= pp-gcc/pktgen -c 0xffff -n 4 -- -T -P -m=20 "[0:4].0,[5:8].1,[9-12].2,[13-16].3=E2=80=9D / What is port 0 and 1, I guess that port 2 and 3 are the 2x40 card. I gues= s I need the =E2=80=98lspci | grep Ether=E2=80=99 output too. Lets assume port 2 and 3 are the 2 ports of 40G and the NIC is on PCI bus= 0 attached to NUMA node 0. May need to blacklist the first two port 0 and 1 to remove them from bein= g used. =2E/app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffff -n 4 -- -T -P -m = =E2=80=9C[2,4,6:8,10,12].0, [14,16,18:20,22,24].1=E2=80=9D Now you have 6 cores per port 3 on TX and 3 on RX on each port. You maybe= be able to get away with 4 per port with the speed of the machine you ha= ve. Next we have to use the range command to make sure the packets are transm= itted with a varying set of 5 tuples. Do a help command an look at the range commands, there is an example in t= he test directory. To see the range information use =E2=80=98page range=E2=80=99 and then yo= u can modify each port. After you are happy with the configuration use the =E2=80=98save =E2=80=99 command to save the configuration. Then you can use =E2=80=98= load =E2=80=99 or add it to the command line with the -f option. >//>/On Thursday 11 January 2018 10:20 AM, Shailja Pandey wrote: />>/The = command line for Pktgen is- />>//>>/./app/app/x86_64-native-linuxapp-gcc/= pktgen -c 0xfff -n 4 -- -T -P -m=20 "[2].0,[4].1,[8].2,[10].3" />>//>>/Configuration of the machine is- />>//= >>/Architecture: x86_64 />>/CPU op-mode(s): 32-bit, 64-bit />>/Byte Order= : Little Endian />>/CPU(s): 32 />>/On-line CPU(s) list: 0-31 />>/Thread(s= ) per core: 2 />>/Core(s) per socket: 8 />>/Socket(s): 2 />>/NUMA node(s)= : 2 />>/Vendor ID: GenuineIntel />>/CPU family: 6 />>/Model: 63 />>/Model= name: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz />>/Stepping: 2 />>/CPU = MHz: 1204.226 />>/CPU max MHz: 3400.0000 />>/CPU min MHz: 1200.0000 />>/B= ogoMIPS: 5195.08 />>/Virtualization: VT-x />>/L1d cache: 32K />>/L1i cach= e: 32K />>/L2 cache: 256K />>/L3 cache: 20480K />>/NUMA node0 CPU(s): 0,2= ,4,6,8,10,12,14,16,18,20,22,24,26,28,30 />>/NUMA node1 CPU(s): 1,3,5,7,9,= 11,13,15,17,19,21,23,25,27,29,31 />>//>>/Linux XeonE5 4.4.0-93-generic />= >//>>/Thanks! />>//>>//>>//>>//>>//>>/ > />>/On Jan 10, 2018, at 7:36 AM,= Shailja Pandey >/ > wrote: />>//>>/ > />>//>>= //>>/ > />>/Hi, />>//>>/ > />>//>>//>>/ > />>/We are performing experimen= ts on Dell Poweredge R430 server, which is=20 based on Haswell architecture based xeon-2640 v3 processor. We have=20 attached XL 710 NIC(2x40 GbE) to the machine and expect 59 Mpps packet=20 generation per port. But pktgen is able to generate only 21 Mpps per=20 port and we are not sure about the problem. />>//>>/ > />>//>>//>>/ > />>= /We are using DPDK version 16.07 and DPDK-pktgen version 3.1.0. Is there = any way to generate packets from pktgen at 118 Mpps ? />>//>>//>>/What is= the command line for Pktgen? />>//>>/Using a single CPU you should be ab= le to generate about 21Mpps, which=20 tells me the configuration is not correct. />>//>>/Pktgen needs N number = of TX and RX cores to generate more traffic, plus=20 the packets need to be spread across the cores using RSS. This means=20 pktgen needs to be setup to generate packets with the 5 tuple difference = to get all of the cores to receive the packets. />>//>>/I need to know th= e command line and the configuration of the machine to=20 help. />>/ > />>//>>//>>/ > />>/-- />>//>>/ > />>//>>//>>/ > />>/Thanks, = />>//>>/ > />>/Shailja />>//>>/ > />>//>>//>>//>>/Regards, />>/Keith />>/= />>/-- />>//>>/Thanks, />>/Shailja />>//>//>/-- />//>/Thanks, />/Shailja = />// Regards, Keith --=20 Thanks, Shailja