From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-f171.google.com (mail-qt0-f171.google.com [209.85.216.171]) by dpdk.org (Postfix) with ESMTP id A46FB2C16 for ; Tue, 25 Jul 2017 11:04:26 +0200 (CEST) Received: by mail-qt0-f171.google.com with SMTP id r14so50169088qte.4 for ; Tue, 25 Jul 2017 02:04:26 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=3vVSA7+dQOhacEWRE1mdsc25QLPqYSo2DI00dg6K5/I=; b=U2UtxY6Iwuf+i1Cpe7YAmImdIDDJRpUaY4LIEKMiMewU4tCb7f+yr96WDXR8KVuMC6 B4xiQziDpR5MUuz9TQoUJcvUuH1GDU3nWrJYO3vQxkF6PiV8T7ewzf4cb1EDpJTqpd4E 8J8tXoHEWSlSzSbMORPEq2jaQhj7L3+oHcacSni+KF+CQCwUPdKySuuMPlyjLUXAYNvW BVMQIPlsMQLS1MMDaa1eUebEXWLpuv46WRLCfkCrJUi23nFLt8Sht5nI8K68eHoO4OkR 84cXsp4GgYewhy418eQCsotelQB7xo/gssA7HkDes0pRiI9QubWLpq+63zEPJGAkyvWw xvWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=3vVSA7+dQOhacEWRE1mdsc25QLPqYSo2DI00dg6K5/I=; b=KB3ekZe9r9L76sbZi2eKwEkzccCDQadqlgev5XRdLtUnfXphxke0NkehDqhNX09ySr 7r4FtTGsCbo/id8shk8oDLWZOsGDZ3SqcQ6luWNtr2DT/2/MWYdv2jQjzPSAv/TZArST vdPZMXaHrMTTISLPENiFofsOFOBYzmSZUNz9rNdOsqfC3VFfVbW+11AiVqgadIykMgPo vmaprMJ2CL5aG05Hps3q4gxP4S8f6X2+oPVFG/4hPRCnXcapN9bYdUvawR3W09nT/eg4 K8BPJpHH91dwrh66iZeIkofqH4CszMiIth9IxFBEVQQC3tr/Y6V29tYdIUInWLw5d545 dDBw== X-Gm-Message-State: AIVw112JNrSoWIIs3fxZ+KwWMl65HMh/zmKE23BPG2h5y74uQ+fJOGGW yqYGzZuqiXTZ0ND6H73sS592iAoFcw== X-Received: by 10.200.14.203 with SMTP id w11mr23166930qti.263.1500973465194; Tue, 25 Jul 2017 02:04:25 -0700 (PDT) MIME-Version: 1.0 Received: by 10.55.170.14 with HTTP; Tue, 25 Jul 2017 02:04:24 -0700 (PDT) In-Reply-To: References: From: Paul Tsvika Date: Tue, 25 Jul 2017 17:04:24 +0800 Message-ID: To: "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] [pktgen] pktgen Tx/Rx rates are not the same in loopback testing case X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Jul 2017 09:04:27 -0000 Hi I've some updates and added inline text in my post. Thanks. > > Memory: 32G ( 16 G on two channels ) > CPU: Xeon-D 1557 > NIC: Intel X552/X557 10GBASE-T > > CPU layout: ( Graph generated from cpu_layout.py ) > > Core and Socket Information (as reported by '/proc/cpuinfo') > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > > > > > > > > > > > > > > > > > *cores =3D [0, 1, 2, 3, 4, 5, 8, 9, 10, 11, 12, 13]sockets =3D [0] > Socket 0 -------- Core 0 [0, 12] Core 1 [1, > 13] Core 2 [2, 14] Core 3 [3, 15] Core 4 [4, > 16] Core 5 [5, 17] Core 8 [6, 18] Core 9 [7, > 19] Core 10 [8, 20] Core 11 [9, 21] Core 12 [10, > 22] Core 13 [11, 23]* > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > My motherboard has 2 10G ports so that I set up the testing experiment in > loopback. > > I have compiled DPDK successfully and below is the steps how I configured > pktgen > > $ sudo modprobe uio > $ sudo insmod ./build/kmod/igb_uio.ko > $ sudo ./usertools/dpdkdevbind.py -b igb_uio xxx:xx.0 xxx:xx.1 > $ sudo ./app/pktgen -c 0x1f -n 2 -- -P -m "[1:3].0, [2:4].1" > start 0 > > I use core 1 and core 3 work for port 0 tx/rx respectively. Core 2 and > core 4 work for port 1 tx/rx respectively. > > I have some questions listed below: > > 1. > > I checked other developers who run pktgen successfully should get the > TX/RX rate almost the same and the value should hit 10000 or 99xx. > I have not figured out yet why the rate went down when I run pktgen. > > > > > > * Flags:Port : P--------------:0 P--------------:1 > 10318718/0Link State : > ----TotalRate----Pkts/s Max/Rx : 0/0 > 10318848/8096382 10318848/8096382 Max/Tx : > 14880683/11528400 0/0 14880683/11528400MBits/s > Rx/Tx : 0/7747 5440/0 5440/7747 > * > *[PT 1:] Any developer has the experience to this ? * > > > > > > > > > > > > > > > > > > > > > > > > > > *Broadcast : 0 > 0Multicast : 0 0 64 > Bytes : 0 4603033247 65-127 > : 0 0 128-255 > : 0 0 256-511 > : 0 0 512-1023 > : 0 0 1024-1518 > : 0 0Runts/Jumbos > : 0/0 0/0Errors Rx/Tx > : 0/0 0/0Total Rx Pkts > : 0 4596736394 Tx Pkts : > 6588970508 0 Rx MBs : > 0 3089006 Tx MBs : > 4427788 0ARP/ICMP Pkts : > 0/0 0/0Tx Count/% Rate : Forever /100% > Forever /100%Pattern Type : abcd... abcd...T= x > Count/% Rate : Forever /100% Forever /100%PktSize/Tx Burst > : 64 / 32 64 / 32 -------------------Src/Dest > Port : 1234 / 5678 1234 / 5678sPkt Type:VLAN ID : > IPv4 / TCP:0001 IPv4 / TCP:0001Dst IP Address : > 192.168.1.1 192.168.0.1Src IP Address : 192.168.0.1/24 > 192.168.1.1/24 > -------------------Dst MAC Address : 0c:c4:7a:c5:43:7b > 0c:c4:7a:c5:43:7a-- Pktgen Ver: 3.3: 8086:15ad/03:00.0 > 8086:15ad/03:00.1 -------------------* > > > 2.1 > > My start_log below: > > Copyright (c) <2010-2017>, Intel Corporation. All rights reserved. > Pktgen created by: Keith Wiles -- >>> Powered by Intel=C2=AE DPDK <<< > > >>> Packet Burst 32, RX Desc 512, TX Desc 1024, mbufs/port 8192, mbuf > cache 1024 > > *[PT]: looks like packet size is 32, should it suppose to be 64? Can I > configure it?* > *Also, why RX Desc and TX Desc is not the same ?* > > =3D=3D=3D port to lcore mapping table (# lcores 5) =3D=3D=3D > lcore: 0 1 2 3 4 Total > port 0: ( D: T) ( 1: 0) ( 0: 0) ( 0: 1) ( 0: 0) =3D ( 1: 1) > port 1: ( D: T) ( 0: 0) ( 1: 0) ( 0: 0) ( 0: 1) =3D ( 1: 1) > Total : ( 0: 0) ( 1: 0) ( 1: 0) ( 0: 1) ( 0: 1) > Display and Timer on lcore 0, rx:tx counts per port/lcore > > Configuring 2 ports, MBUF Size 2176, MBUF Cache Size 1024 > Lcore: > 1, RX-Only > RX_cnt( 1): (pid=3D 0:qid=3D 0) > 2, RX-Only > RX_cnt( 1): (pid=3D 1:qid=3D 0) > 3, TX-Only > TX_cnt( 1): (pid=3D 0:qid=3D 0) > 4, TX-Only > TX_cnt( 1): (pid=3D 1:qid=3D 0) > > Port : > 0, nb_lcores 2, private 0x986ec0, lcores: 1 3 > 1, nb_lcores 2, private 0x989220, lcores: 2 4 > > > > ** Default Info (0000:03:00.0, if_index:0) ** > max_vfs : 0, min_rx_bufsize :1024, max_rx_pktlen : 15872 > max_rx_queues : 128, max_tx_queues : 64 > max_mac_addrs : 128, max_hash_mac_addrs:4096, max_vmdq_pools: 64 > rx_offload_capa: 79, tx_offload_capa : 191, reta_size : 512, > flow_type_rss_offloads:0000000000038d34 > vmdq_queue_base: 0, vmdq_queue_num : 128, vmdq_pool_base: 0 > ** RX Conf ** > pthresh : 8, hthresh : 8, wthresh : 0 > Free Thresh : 32, Drop Enable : 0, Deferred Start : 0 > ** TX Conf ** > pthresh : 32, hthresh : 0, wthresh : 0 > Free Thresh : 32, RS Thresh : 32, Deferred Start : 0, > TXQ Flags:00000f01 > > Create: Default RX 0:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Set RX queue stats mapping pid 0, q 0, lcore 1 > > > Create: Default TX 0:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Range TX 0:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Sequence TX 0:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Special TX 0:0 - Memory used (MBUFs 64 x (size 2176 + Hdr > 128)) + 192 =3D 145 KB headroom 128 2176 > > > Port memory used =3D 73873 KB > Initialize Port 0 -- TxQ 1, RxQ 1, Src MAC 0c:c4:7a:c5:43:7a > > ** Default Info (0000:03:00.1, if_index:0) ** > max_vfs : 0, min_rx_bufsize :1024, max_rx_pktlen : 15872 > max_rx_queues : 128, max_tx_queues : 64 > max_mac_addrs : 128, max_hash_mac_addrs:4096, max_vmdq_pools: 64 > rx_offload_capa: 79, tx_offload_capa : 191, reta_size : 512, > flow_type_rss_offloads:0000000000038d34 > vmdq_queue_base: 0, vmdq_queue_num : 128, vmdq_pool_base: 0 > ** RX Conf ** > pthresh : 8, hthresh : 8, wthresh : 0 > Free Thresh : 32, Drop Enable : 0, Deferred Start : 0 > ** TX Conf ** > pthresh : 32, hthresh : 0, wthresh : 0 > Free Thresh : 32, RS Thresh : 32, Deferred Start : 0, > TXQ Flags:00000f01 > > Create: Default RX 1:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Set RX queue stats mapping pid 1, q 0, lcore 2 > > > Create: Default TX 1:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Range TX 1:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Sequence TX 1:0 - Memory used (MBUFs 8192 x (size 2176 + Hdr > 128)) + 192 =3D 18433 KB headroom 128 2176 > Create: Special TX 1:0 - Memory used (MBUFs 64 x (size 2176 + Hdr > 128)) + 192 =3D 145 KB headroom 128 2176 > > > Port memory used =3D 73873 KB > Initialize Port 1 -- TxQ 1, RxQ 1, Src MAC 0c:c4:7a:c5:43:7b > > Total memory used =3D 147746 KB > Port 0: Link Down > *[PT]: I don't know why the Port ) went down at this point. Is there any > other thing I should check ?* > * [PT 2]: After updating the NIC firmware, the drop issue has been fixed. * > > > Port 1: Link Up - speed 10000 Mbps - full-duplex > > pktgen_packet_capture_init: mz->len 4194304 > > =3D=3D=3D Display processing on lcore 0 > RX processing lcore: 1 rx: 1 tx: 0 > For RX found 1 port(s) for lcore 1 > RX processing lcore: 2 rx: 1 tx: 0 > For RX found 1 port(s) for lcore 2 > TX processing lcore: 3 rx: 0 tx: 1 > For TX found 1 port(s) for lcore 3 > TX processing lcore: 4 rx: 0 tx: 1 > For TX found 1 port(s) for lcore 4 > > > > > > Thanks for any feedback. > > > -- > P.T > --=20 P.T