From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mailout1.ltindia.com (mailout1.ltindia.com [203.199.60.132]) by dpdk.org (Postfix) with ESMTP id E486D8DAC for ; Wed, 28 Oct 2015 13:24:57 +0100 (CET) Received: from unknown (HELO POCITMSEXHUB03.LntUniverse.com) ([10.2.1.60]) by mailout1.ltindia.com with ESMTP; 28 Oct 2015 17:54:56 +0530 Received: from POCITMSEXMB05.LntUniverse.com ([fe80::518c:4525:d15f:548a]) by POCITMSEXHUB03.LntUniverse.com ([10.2.1.60]) with mapi id 14.03.0181.006; Wed, 28 Oct 2015 17:54:41 +0530 From: Mudit Simlote To: "Wiles, Keith" , Vamsi Kommana , "users@dpdk.org" Thread-Topic: [dpdk-users] DPDK-PKTGEN- Did not find any ports to use Thread-Index: AQHRDaEcp4GfE1Qdh0mKcVyjrGog0559sSSfgAGNZlCAAFGgAIABRsDN Date: Wed, 28 Oct 2015 12:24:40 +0000 Message-ID: <98C0B52A8564054F9CF326E68B6C71A83B5AD4@POCITMSEXMB05.LntUniverse.com> References: <40FFF50E-A8A5-4A80-AB94-27E1F9D8AA1B@intel.com> , <48C971EF-90C3-4C94-BEF0-7FC63F8D58A6@intel.com> In-Reply-To: <48C971EF-90C3-4C94-BEF0-7FC63F8D58A6@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.2.1.124] Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailman-Approved-At: Wed, 28 Oct 2015 13:59:05 +0100 Subject: Re: [dpdk-users] DPDK-PKTGEN- Did not find any ports to use X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Oct 2015 12:25:08 -0000 Hello Keith, Thanks for your reply !! We have moved to Intel Sandy Bridge ( Intel Xeon ) with 24 logical cores ( = with hyperthreading enabled ) I have picked up logical cores from the same CPU socket ( now, pktgen stats= and others run on one of the cores, and 4 cores are used for Rx / Tx proce= ssing ), basically Rx and Tx separated out on a different logical cores per= port. With this configuration, I see for small packets ( 64 bytes ) best packet t= ransmission we have reached thus far is close to 7.2 gbps ( less than 14.88= Mpps ). How do I verify whether pktgen goes through a QPI bus between sockets ( as = per my understanding, since all cores selected are from the same socket , t= his would not matter ? ) Also, would like a couple of clarifications with the Rx and Tx counters ( l= ike, sometimes Tx value lesser than Rx ). 1. As, I understand counters are read from the NIC , could there be a situa= tion where the packet count ( to transmit ) is over, and the last batch of = counter updation ignored etc. 2. Also, in case there are Rx errors, should these be interpreted as Buffer= overruns ? How to debug such a case. 3. I believe, to run a test for a particular duration, we should be setting= the packet counts to Tx ( set count ). Is this correct= ? On setting this, I sometimes see, that Tx stops before the actual number= of packets are sent out. On repeating this a couple of times, correct beha= vior is seen. I will get back to you on the PCI setup ( whether our socket connects direc= tly to the PCIe or not ). Appreciate your help. Thanks, Mudit. ________________________________________ From: Wiles, Keith [keith.wiles@intel.com] Sent: Tuesday, October 27, 2015 8:07 PM To: Vamsi Kommana; Mudit Simlote; users@dpdk.org Subject: Re: [dpdk-users] DPDK-PKTGEN- Did not find any ports to use Hi All, What is the system CPU=92s you are using I did not find that listed, but I = expect it is not the issue here. The performance with one core should be fine as long as they are two differ= ent physical cores on the same socket. Also you need to make sure the PCIe = bus is directly connected to the socket you are running Pktgen. In some sys= tems the PCIe bus for the second socket is on a bridge, which can cause som= e problems in performance. The other issue is pktgen maybe going across the= QPI bus between sockets and that is a huge performance hit. Using the cpu_layout.py tool to verify you are using two different physical= cores, then make sure they are on the socket connected to the PCIe bus. BTW, the =91-p 0x03=92 option is no longer needed for Pktgen, I updated the= docs a while back, but it seems to be used :-( this is not a problem for p= ktgen I just ignore the option. The next thing is to loop back the cable from one port to the other on the = Pktgen machine and make sure you can the performance at wire rate. Then you= can debug the other machine. =97 Regards, ++Keith Wiles Intel Corporation On 10/27/15, 6:46 AM, "Vamsi Kommana" w= rote: >Including Mudit... > >Hi Keith, > >Since I will be OOO if you need any information Mudit will assist you. > >Thanks, >Vamsi > >-----Original Message----- >From: users [mailto:users-bounces@dpdk.org] On Behalf Of Vamsi Kommana >Sent: 27 October 2015 10:35 >To: Wiles, Keith; users@dpdk.org >Subject: Re: [dpdk-users] DPDK-PKTGEN- Did not find any ports to use > >Hi Keith, > >Thanks for the reply... > >I was able to resolve the issue after successfully binding the ports by gi= ving the command "./dpdk_nic_bind.py -b igb_uio p1p2". > >But we are facing issues about the performance numbers we are getting meas= ured through the pktgen application provided by Wind River Systems. >We are having two machines, each equipped with 2 dual-port 10 GbE NICs (wi= th a total of 4 ports). Machine 0 runs DPDK code, and Machine 1 runs Wind R= iver System's DPDK-PKTGEN. >After successful installation we are trying to test the line rate with Pkt= size 64 we are observing very poor line rate( less than 1G) and the statis= tics screen shot is attached to mail > >Our test bed topology is as below >1. 2 NIC cards in two systems with DPDK running on one and DPDK-PKTGEN on = another end connected back to back with cat6 Cables 2. Running on fedora-20= 3. Having 3 logical cores, 1 for Display statistics, and remaining two are= for Rx/Tx and the command we used to run pktgen is as mentioned bellow ./a= pp/build/pktgen -c 0x0e -n 3 --proc-type auto --file-prefix pg -- -p 0x03 -= P -m "2.0,3.1" > >Does using only one logical cores per port for both Rx/Tx will effect the = line rate ? even in this case i am transmitting traffic only from port 0 to= port 1 using command "start 0" from pktgen in this case i am expecting min= imum 5GBPS. > >please let me know if i miss any steps. > >Thanks in advance, >Kommana > >________________________________________ >From: Wiles, Keith [keith.wiles@intel.com] >Sent: Friday, October 23, 2015 8:12 PM >To: Vamsi Kommana; users@dpdk.org >Subject: Re: [dpdk-users] DPDK-PKTGEN- Did not find any ports to use > >It appears you did not add ports to the UIO module. The dpdk_nic_bind.py s= hows no ports attached to the UIO module, you need to use the dpdk_nic_bind= .py to add them . Look at the setup.sh script and adjust it to help get the= system setup, which only needs to be run once per reboot. > >- >Regards, >++Keith Wiles > >Intel Corporation > > > > > > > >On 10/23/15, 2:03 AM, "users on behalf of Vamsi Kommana" wrote: > >>Hi Team, >> >>I was trying to install DPDK-Pktgen(Pktgen version 2.7.7 using >>DPDK-1.7.1) for testing 10G Ethernet ports using NIC card, with 4 >>cores(1: Kernel 1:logs for pktgen 2:for Tx Rx of traffic). >> >>But i was ending up with "*** Did not find any ports to use ***" while >>I was using the below mentioned command >> >>Command: >>-------- >>./app/build/pktgen -c 0x0c -n 3 --proc-type auto -m 512 --file-prefix >>pg >>-- -T -P -m "2.0,3.1" >>collected logs are as below... >> >>-----------------------# >> oot@localhost pktgen]# >> BSD LICENSEpktgen]# >> oot@localhost pktgen]# >> Copyright(c) 2010-2014 Intel Corporation. All rights reserved. >> All rights reserved. >> oot@localhost pktgen]# >> Redistribution and use in source and binary forms, with or without >>modification, are permitted provided that the following conditions are >>met:st pktgen]# oot@localhost pktgen]# >> * Redistributions of source code must retain the above copyright >>notice, this list of conditions and the following disclaimer. >> * Redistributions in binary form must reproduce the above copyright >>notice, this list of conditions and the following disclaimer in the >>documentation and/or other materials provided with the distribution.]# >> * Neither the name of Intel Corporation nor the names of its >>contributors may be used to endorse or promote products derived from >>this software without specific prior written permission. >> oot@localhost pktgen]# >> THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS >>"AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT >>LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR >>A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT >>OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, >>SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT >>LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, >>DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY >>THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT >>(INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE >>OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. >> oot@localhost pktgen]# >>-----------------------# ./app/build/pktgen -c 0x0c -n 3 --proc-type auto= -m 512 --file-prefix pg -- -T -P -m "2.0,3.1" >> Copyright (c) <2010-2014>, Wind River Systems, Inc. All rights reserved. >> >> Redistribution and use in source and binary forms, with or without >> modification, are permitted provided that the following conditions are m= et: >> >> 1) Redistributions of source code must retain the above copyright >> notice, this list of conditions and the following disclaimer. >> >> 2) Redistributions in binary form must reproduce the above copyright >> notice, this list of conditions and the following disclaimer in the >> documentation and/or other materials provided with the distribution. >> >> 3) Neither the name of Wind River Systems nor the names of its >> contributors may be used to endorse or promote products derived from >> this software without specific prior written permission. >> >> 4) The screens displayed by the application must contain the copyright >> notice as defined above and can not be removed without specific prior wr= itten permission. >> >> THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS = IS" >> AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, >> THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR >> PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR >> CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, >> EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO, >> PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR >> PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF >> LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING >> NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTW= ARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE. >> >> Pktgen created by: Keith Wiles -- >>> Powered by Intel(r) DPDK <<< >>----------------------- >>EAL: Detected lcore 0 as core 0 on socket 0 >>EAL: Detected lcore 1 as core 1 on socket 0 >>EAL: Detected lcore 2 as core 0 on socket 0 >>EAL: Detected lcore 3 as core 1 on socket 0 >>EAL: Support maximum 64 logical core(s) by configuration. >>EAL: Detected 4 lcore(s) >>EAL: Auto-detected process type: PRIMARY >>EAL: cannot open VFIO container, error 2 (No such file or directory) >>EAL: VFIO support could not be initialized >>EAL: Setting up memory... >>EAL: Ask a virtual area of 0x800000 bytes >>EAL: Virtual area found at 0x7f071ca00000 (size =3D 0x800000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f071c600000 (size =3D 0x200000) >>EAL: Ask a virtual area of 0x49800000 bytes >>EAL: Virtual area found at 0x7f06d2c00000 (size =3D 0x49800000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f06d2800000 (size =3D 0x200000) >>EAL: Ask a virtual area of 0x35400000 bytes >>EAL: Virtual area found at 0x7f069d200000 (size =3D 0x35400000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f069ce00000 (size =3D 0x200000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f069ca00000 (size =3D 0x200000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f069c600000 (size =3D 0x200000) >>EAL: Ask a virtual area of 0x200000 bytes >>EAL: Virtual area found at 0x7f069c200000 (size =3D 0x200000) >>EAL: Requesting 256 pages of size 2MB from socket 0 >>EAL: TSC frequency is ~3092981 KHz >>EAL: Master core 2 is ready (tid=3D1d745880) >>EAL: Core 3 is ready (tid=3D1bdfe700) >>EAL: PCI device 0000:01:00.0 on NUMA socket -1 >>EAL: probe driver: 8086:1528 rte_ixgbe_pmd >>EAL: 0000:01:00.0 not managed by UIO driver, skipping >>EAL: PCI device 0000:01:00.1 on NUMA socket -1 >>EAL: probe driver: 8086:1528 rte_ixgbe_pmd >>EAL: 0000:01:00.1 not managed by UIO driver, skipping >>2.0 =3D lcores(rx 0000000000000004, tx 0000000000000004) ports(rx >>0000000000000001, tx 0000000000000001) >>3.1 =3D lcores(rx 0000000000000008, tx 0000000000000008) ports(rx >>0000000000000002, tx 0000000000000002) ! >>! >>! >>Lua 5.2.3 Copyright (C) 1994-2013 Lua.org, PUC-Rio >>>>> Packet Burst 32, RX Desc 512, TX Desc 512, mbufs/port 4096, mbuf >>>>> cache 512 >>!PANIC!: *** Did not find any ports to use *** PANIC in >>pktgen_config_ports(): >>*** Did not find any ports to use ***6: [./app/build/pktgen() >>[0x422c25]] >>5: [/lib64/libc.so.6(__libc_start_main+0xf5) [0x3b37821d65]] >>4: [./app/build/pktgen(main+0x463) [0x4226f3]] >>3: [./app/build/pktgen(pktgen_config_ports+0xf71) [0x439111]] >>2: [./app/build/pktgen(__rte_panic+0xc9) [0x42210f]] >>1: [./app/build/pktgen(rte_dump_stack+0x18) [0x4b58b8]] Aborted (core >>dumped) [root@localhost pktgen]# [root@localhost pktgen]# >> >>On googling i found the issues might be due to binding and when i tried >>the below steps i was ending up with binding failed and logs are as >>below >> >>[root@localhost tools]# ./dpdk_nic_bind.py --status >> >>Network devices using DPDK-compatible driver >>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >>Network devices using kernel driver >>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >>0000:00:19.0 '82579LM Gigabit Network Connection' if=3Dem1 drv=3De1000e >>unused=3Digb_uio >>0000:01:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=3Dp1p1 >>drv=3Dixgbe unused=3Digb_uio >>0000:01:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=3Dp1p2 >>drv=3Dixgbe unused=3Digb_uio >>0000:02:00.0 'VT6105/VT6106S [Rhine-III]' if=3Dp33p1 drv=3Dvia-rhine >>unused=3Digb_uio *Active* >> >>Other network devices >>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >>[root@localhost tools]# ./dpdk_nic_bind.py -bind=3Digb_uio p1p2 >>Error: bind failed for 0000:01:00.1 - Cannot open >>/sys/bus/pci/drivers/ind=3Digb_uio/bind >>Error: unbind failed for 0000:01:00.1 - Cannot open >>/sys/bus/pci/drivers//unbind [root@localhost tools]# [root@localhost >>tools]# >> >>Please let me know if i miss any... >> >>Thanks in advance. >>Kommana >> >>L&T Technology Services Ltd >> >>www.LntTechservices.com >> >>This Email may contain confidential or privileged information for the int= ended recipient (s). If you are not the intended recipient, please do not u= se or disseminate the information, notify the sender and delete it from you= r system. > >L&T Technology Services Ltd > >www.LntTechservices.com > >This Email may contain confidential or privileged information for the inte= nded recipient (s). If you are not the intended recipient, please do not us= e or disseminate the information, notify the sender and delete it from your= system. >-------------- next part -------------- >A non-text attachment was scrubbed... >Name: DPDK-PKTGEN_Stats.png >Type: image/png >Size: 98635 bytes >Desc: DPDK-PKTGEN_Stats.png >URL: >L&T Technology Services Ltd > >www.LntTechservices.com > >This Email may contain confidential or privileged information for the inte= nded recipient (s). If you are not the intended recipient, please do not us= e or disseminate the information, notify the sender and delete it from your= system. >L&T Technology Services Ltd > >www.LntTechservices.com > >This Email may contain confidential or privileged information for the inte= nded recipient (s). If you are not the intended recipient, please do not us= e or disseminate the information, notify the sender and delete it from your= system. L&T Technology Services Ltd www.LntTechservices.com This Email may contain confidential or privileged information for the inten= ded recipient (s). If you are not the intended recipient, please do not use= or disseminate the information, notify the sender and delete it from your = system.