From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp2.iitd.ac.in (smtp2.iitd.ac.in [103.27.10.44]) by dpdk.org (Postfix) with ESMTP id 64C6AA493 for ; Thu, 25 Jan 2018 10:11:51 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by smtp2.iitd.ac.in (Postfix) with ESMTP id A68ED40038; Thu, 25 Jan 2018 14:41:50 +0530 (IST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitd.ac.in; h= content-language:content-type:content-type:mime-version :user-agent:date:date:message-id:subject:subject:from:from :received:received; s=iitd; t=1516871504; x=1518685905; bh=JIske AlR8y7pmk6sqC9K71B7zgoY0ZqdtdVYCzcszqI=; b=ZE7tcb7WgRPBkcfenS1el wC4b0an0IlnH2BcBkx6kWLPTXetJAc4ft4WmMws3fTzEh3g5Pji8smVN/cwzVyk4 4dQRO0GinyuhyaIP4AvXvHvVftNzuveWBXxZzeORnYvbNyXi7Au56Th6vX0M+y5e ribOaT7USYbJ6Byu2lb4HY= X-Virus-Scanned: Debian amavisd-new at smtp2.iitd.ernet.in Received: from smtp2.iitd.ac.in ([127.0.0.1]) by localhost (smtp2.iitd.ac.in [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id BtCoTINI9r0f; Thu, 25 Jan 2018 14:41:44 +0530 (IST) Received: from [10.237.23.189] (unknown [10.237.23.189]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: csz168117) by smtp2.iitd.ac.in (Postfix) with ESMTPSA id 458C340D42; Thu, 25 Jan 2018 14:26:24 +0530 (IST) To: "Wiles, Keith" , dev@dpdk.org From: Shailja Pandey Message-ID: <256d873d-c96a-7a79-9fd9-e890123bc67b@iitd.ac.in> Date: Thu, 25 Jan 2018 14:26:03 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.5.0 MIME-Version: 1.0 Content-Language: en-US Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] DPDK-pktgen not giving expected throughput X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jan 2018 09:11:51 -0000 Hi, I tried this command line and blacklisted 04:00.0 and 04:00.1- /./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffff -n 4 //-b 04:00.0 = -b 04:00.1 //-- -T -P -m =E2=80=9C[2,4,6:8,10,12].0, [14,16,18:20,22,24].= 1=E2=80=9D/ But I am still not able to see the ports using comma separated cores. I=20 have also tried the following configuration but not getting 100 Gbps for = packet size of 64 bytes and 1500 bytes: =C2=A0make; ./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffffffff -n= 4=20 -b 04:00.0 -b 04:00.1 -- -T -P -m "[2-6:7-11].0,[12-16:17-21].1" Any help would be highly appreciated. >/On Jan 13, 2018, at 12:51 PM, Shailja Pandey > wrote: />//>/Hi, />//>/Output of comm= and =E2=80=98lspci | grep Ether=E2=80=99 is- />//>/04:00.0 Ethernet contr= oller: Intel Corporation Ethernet Controller=20 10-Gigabit X540-AT2 (rev 01) />/04:00.1 Ethernet controller: Intel Corpor= ation Ethernet Controller=20 10-Gigabit X540-AT2 (rev 01) />/05:00.0 Ethernet controller: Intel Corpor= ation Ethernet Controller XL710=20 for 40GbE QSFP+ (rev 02) />/05:00.1 Ethernet controller: Intel Corporatio= n Ethernet Controller XL710=20 for 40GbE QSFP+ (rev 02) />//>/I tried running pktgen with this command /= >/./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffff -n 4 -- -T -P -m = =E2=80=9C[2,4,6:8,10,12].0, [14,16,18:20,22,24].1=E2=80=9D / Need to blacklist 04:00.0 and 04:00.1 using -b 04:00.0 -b 04:00.1 just be= fore the '--' >//>/but I am unable to see the ports while using comma separated cores l= ike=20 2,4,6. However when I tried with multiple CPUs, the result is still the=20 same. />//>/After allocating multiple cores, I also tried the range comma= nds to=20 distribute the packets on different cores(RSS). />//>//>/ > />/On Jan 11,= 2018, at 12:45 AM, Shailja Pandey / > wrote: = />//>/ > />//>//>/ > />/I have also tried with multiple cpus using the co= mmand line- />//>/ > />//>//>/ > />/./app/app/x86_64-native-linuxapp-gcc/= pktgen -c 0xffff -n 4 -- -T -P -m=20 "[0:4].0,[5:8].1,[9-12].2,[13-16].3=E2=80=9D />//>//>/What is port 0 and = 1, I guess that port 2 and 3 are the 2x40 card. I=20 guess I need the =E2=80=98lspci | grep Ether=E2=80=99 output too. />//>/L= ets assume port 2 and 3 are the 2 ports of 40G and the NIC is on PCI=20 bus0 attached to NUMA node 0. />//>/May need to blacklist the first two p= ort 0 and 1 to remove them from=20 being used. />//>/./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xffff -= n 4 -- -T -P -m=20 =E2=80=9C[2,4,6:8,10,12].0, [14,16,18:20,22,24].1=E2=80=9D />//>/Now you = have 6 cores per port 3 on TX and 3 on RX on each port. You=20 maybe be able to get away with 4 per port with the speed of the machine=20 you have. />//>/Next we have to use the range command to make sure the pa= ckets are=20 transmitted with a varying set of 5 tuples. />//>/Do a help command an lo= ok at the range commands, there is an example in=20 the test directory. />//>/To see the range information use =E2=80=98page = range=E2=80=99 and then you can modify=20 each port. />//>/After you are happy with the configuration use the =E2=80= =98save =E2=80=99=20 command to save the configuration. Then you can use =E2=80=98load =E2=80=99 or=20 add it to the command line with the -f option. />//>//>//>//>/= > />//>//>/ > />/On Thursday 11 January 2018 10:20 AM, Shailja Pandey wr= ote: />//>/ >> />/The command line for Pktgen is- />//>/ >> />//>//>/ >> = />/./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xfff -n 4 -- -T -P -m = "[2].0,[4].1,[8].2,[10].3" />//>/ >> />//>//>/ >> />/Configuration of the= machine is- />//>/ >> />//>//>/ >> />/Architecture: x86_64 />//>/ >> />/= CPU op-mode(s): 32-bit, 64-bit />//>/ >> />/Byte Order: Little Endian />/= />/ >> />/CPU(s): 32 />//>/ >> />/On-line CPU(s) list: 0-31 />//>/ >> />/= Thread(s) per core: 2 />//>/ >> />/Core(s) per socket: 8 />//>/ >> />/Soc= ket(s): 2 />//>/ >> />/NUMA node(s): 2 />//>/ >> />/Vendor ID: GenuineInt= el />//>/ >> />/CPU family: 6 />//>/ >> />/Model: 63 />//>/ >> />/Model n= ame: Intel(R) Xeon(R) CPU E5-2640 v3 @ 2.60GHz />//>/ >> />/Stepping: 2 /= >//>/ >> />/CPU MHz: 1204.226 />//>/ >> />/CPU max MHz: 3400.0000 />//>/ = >> />/CPU min MHz: 1200.0000 />//>/ >> />/BogoMIPS: 5195.08 />//>/ >> />/= Virtualization: VT-x />//>/ >> />/L1d cache: 32K />//>/ >> />/L1i cache: = 32K />//>/ >> />/L2 cache: 256K />//>/ >> />/L3 cache: 20480K />//>/ >> /= >/NUMA node0 CPU(s): 0,2,4,6,8,10,12,14,16,18,20,22,24,26,28,30 />//>/ >>= />/NUMA node1 CPU(s): 1,3,5,7,9,11,13,15,17,19,21,23,25,27,29,31 />//>/ = >> />//>//>/ >> />/Linux XeonE5 4.4.0-93-generic />//>/ >> />//>//>/ >> /= >/Thanks! />//>/ >> />//>//>/ >> />//>//>/ >> />//>//>/ >> />//>//>/ >> /= >//>//>/ >> />/ > />//>/ >> />/On Jan 10, 2018, at 7:36 AM, Shailja Pande= y //>/ >> />/ > wrote: />//>/ >> />//>//>/ >> = />/ > />//>/ >> />//>//>/ >> />//>//>/ >> />/ > />//>/ >> />/Hi, />//>/ >= > />//>//>/ >> />/ > />//>/ >> />//>//>/ >> />//>//>/ >> />/ > />//>/ >> = />/We are performing experiments on Dell Poweredge R430 server, which is = based on Haswell architecture based xeon-2640 v3 processor. We have=20 attached XL 710 NIC(2x40 GbE) to the machine and expect 59 Mpps packet=20 generation per port. But pktgen is able to generate only 21 Mpps per=20 port and we are not sure about the problem. />//>/ >> />//>//>/ >> />/ > = />//>/ >> />//>//>/ >> />//>//>/ >> />/ > />//>/ >> />/We are using DPDK = version 16.07 and DPDK-pktgen version 3.1.0. Is there=20 any way to generate packets from pktgen at 118 Mpps ? />//>/ >> />//>//>/= >> />//>//>/ >> />/What is the command line for Pktgen? />//>/ >> />//>/= />/ >> />/Using a single CPU you should be able to generate about 21Mpps,= which=20 tells me the configuration is not correct. />//>/ >> />//>//>/ >> />/Pktg= en needs N number of TX and RX cores to generate more traffic, plus=20 the packets need to be spread across the cores using RSS. This means=20 pktgen needs to be setup to generate packets with the 5 tuple difference = to get all of the cores to receive the packets. />//>/ >> />//>//>/ >> />= /I need to know the command line and the configuration of the machine to = help. />//>/ >> />/ > />//>/ >> />//>//>/ >> />//>//>/ >> />/ > />//>/ >>= />/-- />//>/ >> />//>//>/ >> />/ > />//>/ >> />//>//>/ >> />//>//>/ >> /= >/ > />//>/ >> />/Thanks, />//>/ >> />//>//>/ >> />/ > />//>/ >> />/Shail= ja />//>/ >> />//>//>/ >> />/ > />//>/ >> />//>//>/ >> />//>//>/ >> />//>= //>/ >> />/Regards, />//>/ >> />/Keith />//>/ >> />//>//>/ >> />/-- />//>= / >> />//>//>/ >> />/Thanks, />//>/ >> />/Shailja />//>/ >> />//>//>/ > /= >//>//>/ > />/-- />//>/ > />//>//>/ > />/Thanks, />//>/ > />/Shailja />//= >/ > />//>//>//>/Regards, />/Keith />//>/-- />//>/Thanks, />/Shailja />//= Regards, Keith --=20 Thanks, Shailja --=20 Thanks, Shailja