From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-f174.google.com (mail-qt0-f174.google.com [209.85.216.174]) by dpdk.org (Postfix) with ESMTP id 529E737A6 for ; Thu, 29 Dec 2016 22:11:30 +0100 (CET) Received: by mail-qt0-f174.google.com with SMTP id k15so142575355qtg.3 for ; Thu, 29 Dec 2016 13:11:30 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=4LIEqaU/fLdSc/2PVMYECmdsr6BnaI9DoecyrabQa9g=; b=XiU/IJGKyGOWMLNByV3ihuRqIuARxEFmLLgmuI+9KB76+/2bPIHTtRkXaadqwhkzRe XOStQuYS0d9DwfJNSuy/D/FYo8VX69ZA9UWve3b4kOpXna1alggXyDkOEnQIavqMQYk3 L6K9az44pHlbLoIlcR0A9lMoLOEcdApuP/3zhgKwCXGn07xkeddfP6Y47BOxaIlAdBbn 1gm7qRiX+BHpDqQW/ejyAzaiBeHC6+h+9tuHM5yHj8y7FPbkzVupVNxQtN7OH0KxCMJJ NJEZlkVzz+8grAqLKOBnMnhYf7b5HulnuPmfAuigCazcwGVHXjd/1ifF8/2ddTTWlINq ciYw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=4LIEqaU/fLdSc/2PVMYECmdsr6BnaI9DoecyrabQa9g=; b=jl39RmQ6yOMENeh8JBHKRWIM4U0G6Feh6JuZmVch1yr1cjdVTKHpATDeFyWURF2Fsk rF8Lc+xd8i0JZsq3CtNUb4+psFfj+cUsWyqg4zPA/qUsjzuXunybyOpBqWerDBV1jHqT pxNxK5B584n0WkQlLKfVsShhMR5uK50BDORVb5rjJXSuRsNFFlh41w+nZYDMp87jiCwg iDNLSTyq2SDfVj93bvmYc3AnxLLYBnZX1pyXiJV8O1aLAyVNW9nMD6tRGvpxLZtgc6YQ 76RLcqHEJdIE2he9dLwGnYJotNJxDWV5vEc3mHQmLX4nEzCvanHwb7+sJhEY3d7x0yTk 9zSA== X-Gm-Message-State: AIkVDXIHQgyoxVSR6ZJrh8qgIV2FoOXmel6n/tf4UYebJdWfhbIZGTfdbgkrjpgGLr/ftZfh44UatQZIyoEXAw== X-Received: by 10.237.35.140 with SMTP id j12mr39965553qtc.5.1483045889786; Thu, 29 Dec 2016 13:11:29 -0800 (PST) MIME-Version: 1.0 Received: by 10.12.145.212 with HTTP; Thu, 29 Dec 2016 13:11:29 -0800 (PST) In-Reply-To: References: <7316C74C-5EE4-4986-AA63-B669D68D11D8@intel.com> From: Vincent Li Date: Thu, 29 Dec 2016 13:11:29 -0800 Message-ID: To: "Wiles, Keith" Cc: users@dpdk.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Pktgen with bonding port X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Dec 2016 21:11:30 -0000 forgot to CC users, for sake of user reference On Thu, Dec 29, 2016 at 12:49 PM, Wiles, Keith wrote: > > > On Dec 29, 2016, at 2:39 PM, Vincent Li wrote= : > > > > > > > > > > > > > > Here is a command line I used to for 8 port/ 2 bonds of 4 ports each. > > > > > > ./app/app/x86_64-native-linuxapp-gcc/app/pktgen -l 1-3,18-19 -n 4 > --proc-type auto --log-level 8 --socket-mem 4096,4096 --file-prefix pg > --vdev=3Dnet_bonding0,mode=3D4,xmit_policy=3Dl23,slave=3D0000:04: > 00.0,slave=3D0000:04:00.1,slave=3D0000:04:00.2,slave=3D0000:04:00.3 > --vdev=3Dnet_bonding1,mode=3D4,xmit_policy=3Dl23,slave=3D0000:81: > 00.0,slave=3D0000:81:00.1,slave=3D0000:81:00.2,slave=3D0000:81:00.3 -b 05= :00.0 > -b 05:00.1 -b 82:00.0 -b 83:00.0 -- -T -P --crc-strip -m [2:3].0 -m > [18:19].1 -f themes/black-yellow.theme > > > > > > > just for clarification, the -m[2:3].0 -m [18:19].1, here the .0 means > port id for the vdev net_bonding0 and .1 means for vdev net_bonding1, > correct? so in my case, I run it like > > > > #./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xff > --vdev=3Dnet_bonding0,mode=3D4,xmit_policy=3Dl34,slave=3D0000:04:00.1,sla= ve=3D0000:04:00.0 > -- -P -m [0:1-7].0, > > > > I am confused should it be -m[0:1-7].0 or -m[0:107].2 since Pktgen has > "port 2" I colored in red as output : > > > > > > EAL: Initializing pmd_bond for net_bonding0 > > PMD: Using mode 4, it is necessary to do TX burst and RX burst at least > every 100ms. > > EAL: Create bonded device net_bonding0 on port 2 in mode 4 on socket 0. > > When you add bonding ports to DPDK the bounding ports appear first meanin= g > if you have 2 bond points and 4 real ports, which you assign 2 to each bo= nd. > > If you type =E2=80=98page cpu=E2=80=99 I think I display the know ports a= lso the =E2=80=98page > stats=E2=80=99 displays the bond ports and physical port stats. > > In DPDK the ports are numbered 0 - N starting with the bonding ports: > 0 - net_bond0 > 1 - net_bond1 > 2 - port 0 on the PCI bus using lspci excluding blacklisted ports > 3 - port 1 > 4 - port 2 > 5 - port 3 > > Interesting, but somehow does not agree with my running example: this time I run -m[0:1-7].2 as ./app/app/x86_64-native-linuxapp-gcc/pktgen -c 0xff --vdev=3Dnet_bonding0,mode=3D0,xmit_policy=3Dl34,slave=3D0000:04:00.1,slav= e=3D0000:04:00.0 -- -P -m [0:1-7].2 Pktgen > load bond2 Pktgen > page stats / Copyright (c) <2010-2016>, Intel Corporation Port Name Pkts Rx/Tx Rx Errors/Missed Rate Rx/Tx MAC Address 0-0000:04:00.0: 0/0 0/0 0/0 E8:EA:6A:06:1B:1B 1-0000:04:00.1: 15/0 0/0 0/0 E8:EA:6A:06:1B:1B 2-net_bonding0: 15/0 0/0 0/0 E8:EA:6A:06:1B:1B -- Pktgen Ver: 3.1.0 (DPDK 17.02.0-rc0) Powered by Intel=C2=AE DPDK --------------- Pktgen> start 2 Pktgen>page stats / Copyright (c) <2010-2016>, Intel Corporation Port Name Pkts Rx/Tx Rx Errors/Missed Rate Rx/Tx MAC Address 0-0000:04:00.0: 511/1572001177 0/190420 0/8104641 E8:EA:6A:06:1B:1B 1-0000:04:00.1: 511/1572001819 0/245007 0/8104667 E8:EA:6A:06:1B:1B 2-net_bonding0: 1022/3144007979 0/435427 0/16209311 E8:EA:6A:06:1B:1B -- Pktgen Ver: 3.1.0 (DPDK 17.02.0-rc0) Powered by Intel=C2=AE DPDK --------------- it looks to me DPDK think net_bonding0 as port 2 this time I can see packet pass through both link though the throughput is still under 10Gbit when viewing from BIGIP side: # tmsh show sys performance throughput Sys::Performance Throughput ---------------------------------------------------------------------------= -- Throughput(bits)(bits/sec) Current Average Max(since 12/29/16 10:11:46) ---------------------------------------------------------------------------= -- Service 817.1K 116.9K 866.6K In 7.9G 1.2G 8.7G Out 1.1M 162.7K 1.2M > Pktgen uses the above numbering scheme so port 0 is net_bond0 and port 1 > is net_bond1. The other four ports are bonded to net_bond0-1 and can not = be > used directly any more from Pktgen. > > > > > Regards, > Keith > >