From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-f44.google.com (mail-oi0-f44.google.com [209.85.218.44]) by dpdk.org (Postfix) with ESMTP id 984325323 for ; Fri, 7 Sep 2018 19:25:16 +0200 (CEST) Received: by mail-oi0-f44.google.com with SMTP id 13-v6so28719299ois.1 for ; Fri, 07 Sep 2018 10:25:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=tiP/HBBJC/2y+f3B3op/bpcDCLWUlAodBzrbfU3wAsI=; b=lK63CAC3UNPAutnvDYE25RjYw5kgu3cSXCADrJkkYNsgvjtsiJFBHvrHmOXQ2TDkjV 5BYoC9uoJOdxt+BhQ/EWDyHhRvzX0ztCkLuaB+mFVZIVyTDb03paCAVuacl1wqoo6VOz vESEtGHJgz/vGx6zRcbNcmrJ2OM+BQTFoUVvZgfUPngKYQpVoBqFRG5io4zJe1oUgq9l eaPT7VCjyPylB/h3XNAmfI5iWFv+tnDt9AFAkMm4hZZS0yMPG2tLgIGRPoZLxELbTGIV wV9Z3agz8KBwOkBj+r5uenK9KT8f71HNrtxFn9o+iLPr+LULvMFzfIteBrwmNYHY0n/v steQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=tiP/HBBJC/2y+f3B3op/bpcDCLWUlAodBzrbfU3wAsI=; b=pOlw3qrNR30oJo0F//LT6srVQFs7+BhrZ7vhaV0S5RvPOARnpexw68wrEMHC7mR1tG Zh/O6rwJ0iVRwYjW1eNLAdGs1RXvAkU5Mw6bbKI/RBav125+euruuufPAxNnM4Bq1RNC DAb0DHAPDv/mTyct4+1iyvgths7WIpZVcLaQrY3f7onwcCOt3IhUumsxutqaEerZ1uDn CUDWdaeBm03Cj2l1L1qzHeIsyLeV+j7mfv7zDHFSXbaDqGAMXK72sDkPtV0tj/0DUfIR J+3fJsYmMnuD2YGs5cWm3iusaxBnp6mF16C/9nB7MAoe5zE+aXikS6PXYcLunlq4se/B oyxw== X-Gm-Message-State: APzg51CrKYAvZtNQNIcMeBgruRtSH7K9eSMHk55COlNcEj1xI1nYOd5J umA7k/ELI7/ehSHyFmP45GkcrLeC3iToOxB5m7iahQ== X-Google-Smtp-Source: ANB0VdYPWVYKwb1Z5nKGiusXRY30+WkSGc05NdZMop7trpC2TuKXUCxRb8GT3jt4BxoDb+KVGtexqDHrjSw14C6ZNMA= X-Received: by 2002:aca:cf97:: with SMTP id f145-v6mr9392884oig.131.1536341115635; Fri, 07 Sep 2018 10:25:15 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:ac9:5e08:0:0:0:0:0 with HTTP; Fri, 7 Sep 2018 10:24:35 -0700 (PDT) In-Reply-To: References: From: Emre Eraltan Date: Fri, 7 Sep 2018 10:24:35 -0700 Message-ID: To: Jamie Fargen Cc: users@dpdk.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] TestPMD testing with VMX3NET Devices... X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Sep 2018 17:25:17 -0000 Hi Jamie, I have recently used testpmd on VMware ESX 5.5 with a Ubuntu 16.04 VM - and it was working with vmxnet3 devices. Did you try lowering your RXD and TXD sizes? I am not sure VMXNET3 supports your values "--rxd=3D8192 --txd=3D8192". Try removing these 2 parameters to use the default sizes or lower your values. >>From my history: $ wget http://fast.dpdk.org/rel/dpdk-17.11.4.tar.xz $ tar -xf dpdk-17.11.4.tar.xz $ cd dpdk-stable-17.11.4 $ make config T=3Dx86_64-native-linuxapp-gcc $ make ## had to install libnuma-dev package $ modprobe uio $ insmod ./build/build/lib/librte_eal/linuxapp/igb_uio/igb_uio.ko $ ./usertools/dpdk-devbind.py -b igb_uio 03:00.0 $ ./usertools/dpdk-devbind.py -b igb_uio 0b:00.0 $ echo 1024 > /sys/devices/system/node/node0/hugepages/hugepages- 2048kB/nr_hugepages $ mkdir -p /mnt/huge $ mount -t hugetlbfs nodev /mnt/huge $ testpmd -l 1,2,3 -n 1 -- --disable-hw-vlan --forward-mode=3Dmac --eth-peer=3D0,00:00:00:00:33:33 --eth-peer=3D1,00:00:00:00:44:44 -i --nb-cores=3D2 --rxq=3D8 --txq=3D8 testpmd> show port info all ********************* Infos for port 0 ********************* MAC address: 00:0C:29:06:04:24 Driver name: net_vmxnet3 Connect to socket: 0 memory allocation on the socket: 0 Link status: up Link speed: 10000 Mbps Link duplex: full-duplex MTU: 1500 Promiscuous mode: enabled Allmulticast mode: disabled Maximum number of MAC addresses: 1 Maximum number of MAC addresses of hash filtering: 0 VLAN offload: strip off filter off qinq(extend) off Supported flow types: ipv4 ipv4-tcp ipv6 ipv6-tcp Max possible RX queues: 16 Max possible number of RXDs per queue: 4096 Min possible number of RXDs per queue: 128 RXDs number alignment: 1 Max possible TX queues: 8 Max possible number of TXDs per queue: 4096 Min possible number of TXDs per queue: 512 TXDs number alignment: 1 ********************* Infos for port 1 ********************* MAC address: 00:0C:29:06:04:2E Driver name: net_vmxnet3 Connect to socket: 0 memory allocation on the socket: 0 Link status: up Link speed: 10000 Mbps Link duplex: full-duplex MTU: 1500 Promiscuous mode: enabled Allmulticast mode: disabled Maximum number of MAC addresses: 1 Maximum number of MAC addresses of hash filtering: 0 VLAN offload: strip off filter off qinq(extend) off Supported flow types: ipv4 ipv4-tcp ipv6 ipv6-tcp Max possible RX queues: 16 Max possible number of RXDs per queue: 4096 Min possible number of RXDs per queue: 128 RXDs number alignment: 1 Max possible TX queues: 8 Max possible number of TXDs per queue: 4096 Min possible number of TXDs per queue: 512 TXDs number alignment: 1 Hope it helps. Regards, Emre On Thu, Sep 6, 2018 at 9:39 AM, Jamie Fargen wrote: > Hello- > > Would like to do some performance analysis using testpmd on a RHEL7 VMWar= e > guest using a VMX3NET network devices. Similar tests have been performed > using RHEL7 KVM guests using VirtIO network devices, but the same process > does not work with VMX3NET network interfaces. > > The dpdk-stable-17.11 has been compiled and it looks like the devices are > properly bound to the uio driver, but when testpmd is started it is unabl= e > to locate the devices. > > This is the basic process of how the uio module is loaded, the devices ou= r > bound to the driver, and testpmd is started. > > [root@redacted ~]# cat startTestPmd17.sh > #!/bin/bash -x > modprobe uio > insmod /root/dpdk-stable-17.11.4/build/kmod/igb_uio.ko > /root/dpdk-stable-17.11.4/usertools/dpdk-devbind.py -b igb_uio 0b:00.0 > /root/dpdk-stable-17.11.4/usertools/dpdk-devbind.py -b igb_uio 13:00.0 > mount -t hugetlbfs nodev /mnt/huge > echo 1024 > /sys/devices/system/node/node0/hugepages/hugepages- > 2048kB/nr_hugepages > testpmd -l 1,2,3 -n 1 -- --disable-hw-vlan --forward-mode=3Dmac > --eth-peer=3D0,00:00:00:00:33:33 --eth-peer=3D1,00:00:00:00:44:44 -i > --nb-cores=3D2 --rxq=3D8 --txq=3D8 --rxd=3D8192 --txd=3D8192 > > EAL: Detected 4 lcore(s) > EAL: No free hugepages reported in hugepages-1048576kB > EAL: Probing VFIO support... > EAL: No probed ethernet devices > Set mac packet forwarding mode > Interactive-mode selected > USER1: create a new mbuf pool : n=3D163456, size=3D21= 76, > socket=3D0 > Done > testpmd> > > > There are network devices bound to DPDK-compatible uio driver. > [root@redacted ~]# dpdk-stable-17.11.4/usertools/dpdk-devbind.py -s > > Network devices using DPDK-compatible driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:0b:00.0 'VMXNET3 Ethernet Controller 07b0' drv=3Digb_uio unused=3Dvm= xnet3 > 0000:13:00.0 'VMXNET3 Ethernet Controller 07b0' drv=3Digb_uio unused=3Dvm= xnet3 > > Network devices using kernel driver > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > 0000:1b:00.0 'VMXNET3 Ethernet Controller 07b0' if=3Dens256 drv=3Dvmxnet3 > unused=3Digb_uio *Active* > > > If anyone has any spare cycles to help me solve this issue it would be > greatly appreciated. > > > -- > Jamie Fargen > Senior Consultant > jfargen@redhat.com > 813-817-4430 > --=20 --=20 Emre Eraltan Lead Solutions Architect Direct (US): +1 408 508 6733 Mobile (US): +1 408 329 0271 2975 Scott Blvd, Suite 115 Santa Clara 95054 CA Visit our web site: http://www.6wind.com Join us on Twitter: http://twitter.com/6windsoftware Join us on LinkedIn: https://www.linkedin.com/company/6wind =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D This e-mail message, including any attachments, is for the sole use of the intended recipient(s) and contains information that is confidential and proprietary to 6WIND. All unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. Ce courriel ainsi que toutes les pi=C3=A8ces jointes, est uniquement destin=C3=A9 =C3=A0 son ou ses destinataires. Il contient des informations confidentielles qui sont la propri=C3=A9t=C3=A9 de 6WIND. Toute r=C3=A9v=C3= =A9lation, distribution ou copie des informations qu'il contient est strictement interdite. Si vous avez re=C3=A7u ce message par erreur, veuillez imm=C3=A9diatement le signaler =C3=A0 l'=C3=A9metteur et d=C3=A9truire tout= es les donn=C3=A9es re=C3=A7ues =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D