From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 74376A2EFC for ; Tue, 15 Oct 2019 17:20:10 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 016901EA32; Tue, 15 Oct 2019 17:20:10 +0200 (CEST) Received: from us-smtp-delivery-1.mimecast.com (us-smtp-2.mimecast.com [205.139.110.61]) by dpdk.org (Postfix) with ESMTP id 978811EA26 for ; Tue, 15 Oct 2019 17:20:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1571152807; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=HH+auPdIO3YXZcUVfMMNSH4FxXSisiVm7C4v+8HNlgE=; b=TP2ckaiNNSC9gnS1no7ouE3kaVnpRqf2S2QAsLkjJHyM2SLMkbbh3UkSYWx3Sir3tFFlH4 /gYGfRLrgBEhn50p/bNknVC5+78TEC3QmQtclMCwJok/MvHVFbAKSJFBmSZ6U7YtU0O7ts 1ISWz1y+TcIYtHggbzqigfXBpyYZnos= Received: from mail-qt1-f200.google.com (mail-qt1-f200.google.com [209.85.160.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-126-0OVMgb6POzuOjI-W7wTYWw-1; Tue, 15 Oct 2019 11:19:46 -0400 Received: by mail-qt1-f200.google.com with SMTP id t25so21593101qtq.9 for ; Tue, 15 Oct 2019 08:19:45 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=31DpMGXTRYpBilYt4ojQ/csW0aB3kjftpz2Qfo8vr70=; b=cme3kvOrrjeZ2BcXQmpfNHDkAJtpn+DRkWZrJYb90eOcEguArrNPqesbvbBTyTgCVj C7cCoULXZ1666bdITKHytTSp4iOfa7e4Qli3IC3tAH6DuNm1pJnLWE+6TXHDxole4tse 8Nt+9JdExxJKXQj7JFTwPKbXspJMXkcU5Iyw4dJto40Xydg76VbUAMIAJcHBx5QkAB9O 5V5Q+CgF48S4Be5tXUmb4/5NReZNPVYYswC6WmioesIhGLtX/Y+1cIlYGUSYzV4nfoXU byYgonbGQnaB63BLxt9n/I868zGqEXkzWJDs7QPp/iULp2Dwf0sDuhsOPGZ1v+g/7zde xhyQ== X-Gm-Message-State: APjAAAWkWGBRXSBWiCBh7tfnc0rBurg95YHGZkCqrp9ngIPjcCJ0sAJm ve0Pk+SJySBoYQrP5+TbW9mEk3tpPrB0AdRdIf71+2DSo6AIEBFJAar/4QslJQiRN2LqvqMOW/5 FRQZJkqSLopd/XXpdyeh8 X-Received: by 2002:ac8:319a:: with SMTP id h26mr40225536qte.159.1571151840202; Tue, 15 Oct 2019 08:04:00 -0700 (PDT) X-Google-Smtp-Source: APXvYqz54oRe7ZYdbBbUWP8lIUQ9SZRhhTlSfLD7WcyO02YgV3IW+dpmFzjBx57MmKcmQaF8Px4LSeFEIafeWFQ4f3M= X-Received: by 2002:ac8:319a:: with SMTP id h26mr40225521qte.159.1571151839979; Tue, 15 Oct 2019 08:03:59 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Bill Michalowski Date: Tue, 15 Oct 2019 11:03:48 -0400 Message-ID: To: Lance Richardson Cc: dev@dpdk.org, users@dpdk.org X-MC-Unique: 0OVMgb6POzuOjI-W7wTYWw-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] [dpdk-dev] testpmd / SR-IOV RX packets, but TX-errors X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Thank you for the suggestion Lance, but that didn't correct the problem. That being said, I would think that testpmd in "io" mode would just forward the packets in the SR-IOV case just as it successfully does with testpmd across the PFs (non SR-IOV) - but I could be wrong. On Tue, Oct 15, 2019 at 10:26 AM Lance Richardson < lance.richardson@broadcom.com> wrote: > Hi Bill, > > This is just a guess, but perhaps the transmit drops are due to MAC > anti-spoofing checks? > > You could probably prove/disprove by making the packet source MAC > match the transmit VF's MAC. > > Lance > > > On Tue, Oct 15, 2019 at 10:01 AM Bill Michalowski > wrote: > > > > I'm trying run testpmd with SR-IOV, specifically across two VFs. I see > > packets being received successfully by the application but they are not > > being transmitted. They are dropped with the 'TX-errors' counters > > incrementing. > > > > However, if I generate the same traffic and the DUT isn't programmed wi= th > > SR-IOV, but with testpmd just across PFs, the packets are transmitted > just > > fine and I don't have any TX-errors. I'm hoping someone can help me > figure > > out why the TX packets are being dropped in the SR-IOV case. > > > > testpmd is running in the default "io" mode. > > > > The DUT is a two port Intel xxv710 25G card. To simplify things, I'm n= ot > > actually using a guest, just testpmd across VFs. > > > > *# rpm -qa | grep dpdk* > > dpdk-18.11.2-1.el7.x86_64 > > > > *# uname -r* > > 3.10.0-1062.1.2.el7.x86_64 > > > > *# cat /etc/redhat-release * > > Red Hat Enterprise Linux Server release 7.7 (Maipo) > > > > PFs: > > > > #* ethtool -i p7p1* > > driver: i40e > > version: 2.10.19.30 > > firmware-version: 6.80 0x80003d17 18.8.9 > > expansion-rom-version: > > bus-info: 0000:86:00.0 > > > > *# ethtool -i p7p2* > > driver: i40e > > version: 2.10.19.30 > > firmware-version: 6.80 0x80003d17 18.8.9 > > expansion-rom-version: > > bus-info: 0000:86:00.1 > > > > Procedure: > > > > Create VFs: > > > > *#echo 1 > /sys/class/net/p7p1/device/sriov_numvfs* > > > > *#echo 1 > /sys/class/net/p7p2/device/sriov_numvfs* > > > > *# ip l* > > 4: p7p1: mtu 1500 qdisc mq state UP > mode > > DEFAULT group default qlen 1000 > > link/ether 3c:fd:fe:b9:c8:a0 brd ff:ff:ff:ff:ff:ff > > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, tru= st > > off > > 5: p7p2: mtu 1500 qdisc mq state UP > mode > > DEFAULT group default qlen 1000 > > link/ether 3c:fd:fe:b9:c8:a1 brd ff:ff:ff:ff:ff:ff > > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, tru= st > > off > > 13: p7p1_0: mtu 1500 qdisc noop state DOWN mode > > DEFAULT group default qlen 1000 > > link/ether 6a:ff:a3:55:23:4e brd ff:ff:ff:ff:ff:ff > > 14: p7p2_0: mtu 1500 qdisc noop state DOWN mode > > DEFAULT group default qlen 1000 > > link/ether da:a1:1c:c4:6c:e7 brd ff:ff:ff:ff:ff:ff > > > > *# ethtool -i p7p1_0* > > driver: iavf > > version: 3.7.53 > > firmware-version: N/A > > expansion-rom-version: > > bus-info: 0000:86:02.0 > > > > *# ethtool -i p7p2_0* > > driver: iavf > > version: 3.7.53 > > firmware-version: N/A > > expansion-rom-version: > > bus-info: 0000:86:0a.0 > > > > Set MAC addresses: > > > > *#ip link set p7p1 vf 0 mac a0:b0:c0:d0:e0:f0* > > *#ip link set p7p2 vf 0 mac 66:55:44:33:22:11* > > > > Set trust mode: > > > > > > > > *#ip link set p7p1 vf 0 trust on#ip link set p7p2 vf 0 trust on* > > > > Unbind iavf from VFs and bind vfio-pci to them: > > > > *# modprobe vfio-pci* > > *# dpdk-devbind -u 0000:86:02.0 0000:86:0a.0* > > *# dpdk-devbind -b vfio-pci 0000:86:02.0 0000:86:0a.0* > > *# dpdk-devbind -s* > > > > Network devices using DPDK-compatible driver > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > 0000:86:02.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pci > > unused=3Diavf > > 0000:86:0a.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pci > > unused=3Diavf > > > > Start testpmd: > > > > #*/usr/bin/testpmd -l 1,3,35 --socket-mem 1024,1024 -n 4 --proc-type au= to > > --file-prefix testpmd0 -w 0000:86:02.0 -w 0000:86:0a.0 -- --nb-cores=3D= 2 > > --nb-ports=3D2 --portmask=3D3 --auto-start --rxq=3D1 --txq=3D1 --rxd=3D= 2048 > > --txd=3D2048 -i* > > > > Starting traffic at the far end, packets are RX successfully on the DUT > but > > not TX, with many TX-errors: > > > > *testpmd> show port stats all* > > > > ######################## NIC statistics for port 0 > > ######################## > > RX-packets: 144132155 RX-missed: 0 RX-bytes: 9224457088 > > RX-errors: 0 > > RX-nombuf: 0 > > TX-packets: 0 TX-errors: 137664400 TX-bytes: 0 > > > > Throughput (since last show) > > Rx-pps: 19000875 > > Tx-pps: 0 > > > > > #########################################################################= ### > > > > ######################## NIC statistics for port 1 > > ######################## > > RX-packets: 144324307 RX-missed: 0 RX-bytes: 9236754880 > > RX-errors: 0 > > RX-nombuf: 0 > > TX-packets: 0 TX-errors: 137873118 TX-bytes: 0 > > > > Throughput (since last show) > > Rx-pps: 19000772 > > Tx-pps: 0 > > > > > #########################################################################= ### > > > > Thanks for any help. > > > > - Bill >