DPDK patches and discussions
 help / color / mirror / Atom feed
From: "Zhang, Jerry" <jerry.zhang@intel.com>
To: "Zhou, Danny" <danny.zhou@intel.com>,
	Al Patel <alps.oss@gmail.com>,
	"Jayakumar, Muthurajan" <muthurajan.jayakumar@intel.com>
Cc: "dev@dpdk.org" <dev@dpdk.org>
Subject: Re: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or	10g	pair
Date: Tue, 26 Aug 2014 16:45:56 +0000	[thread overview]
Message-ID: <FA09AAB07F084C4DA208D537E2734D2C3749E634@CDSMSX102.ccr.corp.intel.com> (raw)
In-Reply-To: <DFDF335405C17848924A094BC35766CF0A90DF02@SHSMSX104.ccr.corp.intel.com>

Hi,

Make sure to add iommu=pt inte_iommu=on to kernel parameters if VT-d is enabled. 
Otherwise, the PF may not work well with igb_uio because of DMAR.

Please also refer to the comments in the DPDK getting started guide.

In addition, to run the Intel® DPDK with Intel® VT-d, the iommu=pt kernel parameter 
must be used when using igb_uio driver. This results in pass-through of the DMAR 
(DMA Remapping) lookup in the host. Also, if INTEL_IOMMU_DEFAULT_ON is not set 
in the kernel, the intel_iommu=on kernel parameter must be used too. This ensures 
that the Intel IOMMU is being initialized as expected.

-----Original Message-----
From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Zhou, Danny
Sent: Tuesday, August 26, 2014 1:58 AM
To: Al Patel; Jayakumar, Muthurajan
Cc: dev@dpdk.org
Subject: Re: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or 10g pair

The .log below shows your two 10G ports link are up. 

Which CPU are you using now and how many processor sockets do you have? If you used a platform with two processor sockets, make sure to use correct core mask to specify cores rx/tx packets from 10G NIC connecting to local socket. For you case, make sure 10G NIC with BNF 0e:00.0/0e:00.1 connects to CPU socket No.0(as you used -c 0xF to use core 0 to 3 on socket No.0), otherwise you have to change the core mask in the command line to use logical cores on socket No.1.

> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Al Patel
> Sent: Tuesday, August 26, 2014 12:36 AM
> To: Jayakumar, Muthurajan
> Cc: dev@dpdk.org
> Subject: Re: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) 
> or 10g pair
> 
> HI Jayakumar,
> 
> I did. I don' that unbind script in my version (I am using 1.6) 
> root@fe-ucs48:~/dpdk-1.6.0r1# ./tools/pci_unbind.py --status
> 
> Network devices using IGB_UIO driver
> ====================================
> 0000:0e:00.0 '82599EB 10-Gigabit SFI/SFP+ Network Connection' 
> drv=igb_uio unused=ixgbe
> 0000:0e:00.1 '82599EB 10-Gigabit SFI/SFP+ Network Connection' 
> drv=igb_uio unused=ixgbe
> 
> Network devices using kernel driver
> ===================================
> 0000:08:00.0 '82576 Gigabit Network Connection' if=eth2 drv=igb 
> unused=igb_uio
> 0000:08:00.1 '82576 Gigabit Network Connection' if=eth3 drv=igb 
> unused=igb_uio
> 0000:14:00.0 '82576 Gigabit Network Connection' if=eth4 drv=igb 
> unused=igb_uio *Active*
> 0000:14:00.1 '82576 Gigabit Network Connection' if=eth6 drv=igb 
> unused=igb_uio
> 
> Other network devices
> =====================
> 0000:05:00.0 '82576 Gigabit Network Connection' unused=igb,igb_uio
> 0000:05:00.1 '82576 Gigabit Network Connection' unused=igb,igb_uio
> 
> 
> ...
> Checking link statuses...
> Port 0 Link Up - speed 10000 Mbps - full-duplex Port 1 Link Up - speed 
> 10000 Mbps - full-duplex Done
> testpmd> show port stats all
> 
>   ######################## NIC statistics for port 0  
> ########################
>   RX-packets: 0          RX-errors: 0         RX-bytes: 0
>   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> 
> ######################################################################
> ######
> 
>   ######################## NIC statistics for port 1  
> ########################
>   RX-packets: 0          RX-errors: 0         RX-bytes: 0
>   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> 
> ######################################################################
> ######
> testpmd>
> 
> 
> testpmd> start tx_first
>   io packet forwarding - CRC stripping disabled - packets/burst=16
>   nb forwarding cores=2 - nb forwarding ports=2
>   RX queues=1 - RX desc=128 - RX free threshold=0
>   RX threshold registers: pthresh=8 hthresh=8 wthresh=4
>   TX queues=1 - TX desc=512 - TX free threshold=0
>   TX threshold registers: pthresh=36 hthresh=0 wthresh=0
>   TX RS bit threshold=0 - TXQ flags=0x0
> testpmd>
> 
> 
> waited for a few seconds ...
> 
> testpmd> stop
> Telling cores to stop...
> Waiting for lcores to finish...
> 
>   ---------------------- Forward statistics for port 0
>  ----------------------
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ----------------------------------------------------------------------
> ------
> 
>   ---------------------- Forward statistics for port 1
>  ----------------------
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ----------------------------------------------------------------------
> ------
> 
>   +++++++++++++++ Accumulated forward statistics for all
> ports+++++++++++++++
>   RX-packets: 0              RX-dropped: 0             RX-total: 0
>   TX-packets: 0              TX-dropped: 0             TX-total: 0
> 
> ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> 
> Done.
> testpmd>
> 
> 
> Looks like nothing is being sent/received.
> 
> Thanks
> -a
> 
> On Mon, Aug 25, 2014 at 12:30 PM, Jayakumar, Muthurajan < 
> muthurajan.jayakumar@intel.com> wrote:
> 
> > Can you please do the following steps as in Quick start guide 
> > http://dpdk.org/doc/quick-start Thanks,
> >
> > Extract sources.
> > tar xf dpdk.tar.gz
> > cd dpdk
> > Build libraries and kernel module (Linux headers are needed).
> > make config T=x86_64-native-linuxapp-gcc make The next steps must be 
> > done as root.
> > Load kernel modules.
> > modprobe uio
> > insmod build/kmod/igb_uio.ko
> > Bind Intel devices to igb_uio.
> > tools/dpdk_nic_bind.py --bind=igb_uio $(tools/dpdk_nic_bind.py 
> > --status | sed -rn 's,.* if=([^ ]*).*igb_uio *$,\1,p') Reserve huge 
> > pages memory.
> > mkdir -p /mnt/huge
> > mount -t hugetlbfs nodev /mnt/huge
> > echo 64 >
> > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepag
> > es
> > Set the highest frequency.
> > for gov in /sys/devices/system/cpu/*/cpufreq/scaling_governor ; do 
> > echo performance >$gov ; done Run poll-mode driver test (with a 
> > cable between ports).
> > build/app/testpmd -c7 -n3 -- -i --nb-cores=2 --nb-ports=2
> >
> > testpmd> show port stats all
> >
> >   ######################## NIC statistics for port 0 
> > ########################
> >   RX-packets: 0          RX-errors: 0         RX-bytes: 0
> >   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> >
> > ####################################################################
> > ########
> >
> >   ######################## NIC statistics for port 1 
> > ########################
> >   RX-packets: 0          RX-errors: 0         RX-bytes: 0
> >   TX-packets: 0          TX-errors: 0         TX-bytes: 0
> >
> > ####################################################################
> > ########
> >
> > testpmd> start tx_first
> >
> > testpmd> stop
> >
> >   ---------------------- Forward statistics for port 0
> > ----------------------
> >   RX-packets: 7139974        RX-dropped: 0             RX-total: 7139974
> >   TX-packets: 6699967        TX-dropped: 0             TX-total: 6699967
> >
> > --------------------------------------------------------------------
> > --------
> >
> >   ---------------------- Forward statistics for port 1
> > ----------------------
> >   RX-packets: 6699967        RX-dropped: 0             RX-total: 6699967
> >   TX-packets: 7139974        TX-dropped: 0             TX-total: 7139974
> >
> > --------------------------------------------------------------------
> > --------
> >
> > -----Original Message-----
> > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Al Patel
> > Sent: Monday, August 25, 2014 9:20 AM
> > To: dev@dpdk.org
> > Subject: [dpdk-dev] testpmd: not seeing any traffic on 1g (pair) or 
> > 10g pair
> >
> > Hi,
> >
> > I am doing a basic test with testpmd per the getting started page.
> > I connected two 1g in back to back mode and executed:
> >
> >  sudo ./build/app/testpmd -c 0xF -n 4 -- -i --portmask=0x2 
> > --nb-cores=2
> >
> > start (and start tx_first)
> > stop
> >
> > I see 0 counters for rx/tx.
> >
> > I removed the two 1g from uio driver and added two 10g 82599EB and 
> > reran the test - still 0 traffic.
> >
> > Wondering where to debug.
> > thx
> >

      reply	other threads:[~2014-08-26 16:42 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-08-25 16:19 Al Patel
2014-08-25 16:30 ` Jayakumar, Muthurajan
2014-08-25 16:35   ` Al Patel
2014-08-25 17:42     ` Jayakumar, Muthurajan
2014-08-25 17:58     ` Zhou, Danny
2014-08-26 16:45       ` Zhang, Jerry [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=FA09AAB07F084C4DA208D537E2734D2C3749E634@CDSMSX102.ccr.corp.intel.com \
    --to=jerry.zhang@intel.com \
    --cc=alps.oss@gmail.com \
    --cc=danny.zhou@intel.com \
    --cc=dev@dpdk.org \
    --cc=muthurajan.jayakumar@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).