From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 94D99A2EFC for ; Tue, 15 Oct 2019 16:26:29 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id AEFD71BF71; Tue, 15 Oct 2019 16:26:26 +0200 (CEST) Received: from mail-oi1-f179.google.com (mail-oi1-f179.google.com [209.85.167.179]) by dpdk.org (Postfix) with ESMTP id 2275A1EC95 for ; Tue, 15 Oct 2019 16:26:22 +0200 (CEST) Received: by mail-oi1-f179.google.com with SMTP id i16so16986060oie.4 for ; Tue, 15 Oct 2019 07:26:22 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=sT6zs5qj2WSp9NDl+MXLTu08HiNnuJgtHgfsstDEFlI=; b=dqmRYMSZ2by81zBuArYhi5ON9dAzc13iUNua6ZxSOjxg+AMsMYbPjCrVK967SePXYy x+ZC4il4VFJ7HtMWx6tKHRGgkhYEWyTUIepE1JJtcJykSHH6p2RWT7c0qSRY0DD13r9t 2V5CBoWlhGga+v10BLYUGG1g/LHR1DtxUgW0A= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sT6zs5qj2WSp9NDl+MXLTu08HiNnuJgtHgfsstDEFlI=; b=MtpCaXg+WnW3rS/6u8d0f4iGWkxyqCkSIbMYqTSCTRoAuJ21BOxaIKubORMm/eaBlk nRsRc78W4k+85ZtTWALDvfn+CKMPjEYeM0qjfVsDk2K7rBBNiPDKvou9xk+5hBIgVAiH +iJCCwUfTltITD898P2VjXFUR4FILvR80Fan9gsYx5Qfx5tRupxUB1zLOi6DpKSJm5r3 kdYqPBHff7wdS6gIlyCJlQELj5fCVEFCRUm1UCIpb5dnN2AMePrR0eTZXHytuJlgi7xm nYB9GoEbDMDBXRoBbbRq4kNg6MZccSRztVMREqp5+jghJCPlRVpL+uMp7KyZylOZuXlt YaLA== X-Gm-Message-State: APjAAAV09Sc0gSUkFJ0kQA41m9bddoscIBnLjtEDaP4cUr6vMKhQYkq2 PGjzBo2FZK7dYr3rzTdRzNTEdU17TxAtR6qsERsoXg== X-Google-Smtp-Source: APXvYqydidUl8VlSyZ0geneVamF6VQQW63bekuLQiJLyuU1vG2GnkItgCNovAwn7+8d7cPjzgBzducHsn/JhiqB2wN0= X-Received: by 2002:aca:5c82:: with SMTP id q124mr30270224oib.19.1571149581273; Tue, 15 Oct 2019 07:26:21 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Lance Richardson Date: Tue, 15 Oct 2019 10:26:10 -0400 Message-ID: To: Bill Michalowski Cc: dev@dpdk.org, users@dpdk.org Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-users] [dpdk-dev] testpmd / SR-IOV RX packets, but TX-errors X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi Bill, This is just a guess, but perhaps the transmit drops are due to MAC anti-spoofing checks? You could probably prove/disprove by making the packet source MAC match the transmit VF's MAC. Lance On Tue, Oct 15, 2019 at 10:01 AM Bill Michalowski wrote: > > I'm trying run testpmd with SR-IOV, specifically across two VFs. I see > packets being received successfully by the application but they are not > being transmitted. They are dropped with the 'TX-errors' counters > incrementing. > > However, if I generate the same traffic and the DUT isn't programmed with > SR-IOV, but with testpmd just across PFs, the packets are transmitted just > fine and I don't have any TX-errors. I'm hoping someone can help me figure > out why the TX packets are being dropped in the SR-IOV case. > > testpmd is running in the default "io" mode. > > The DUT is a two port Intel xxv710 25G card. To simplify things, I'm not > actually using a guest, just testpmd across VFs. > > *# rpm -qa | grep dpdk* > dpdk-18.11.2-1.el7.x86_64 > > *# uname -r* > 3.10.0-1062.1.2.el7.x86_64 > > *# cat /etc/redhat-release * > Red Hat Enterprise Linux Server release 7.7 (Maipo) > > PFs: > > #* ethtool -i p7p1* > driver: i40e > version: 2.10.19.30 > firmware-version: 6.80 0x80003d17 18.8.9 > expansion-rom-version: > bus-info: 0000:86:00.0 > > *# ethtool -i p7p2* > driver: i40e > version: 2.10.19.30 > firmware-version: 6.80 0x80003d17 18.8.9 > expansion-rom-version: > bus-info: 0000:86:00.1 > > Procedure: > > Create VFs: > > *#echo 1 > /sys/class/net/p7p1/device/sriov_numvfs* > > *#echo 1 > /sys/class/net/p7p2/device/sriov_numvfs* > > *# ip l* > 4: p7p1: mtu 1500 qdisc mq state UP mode > DEFAULT group default qlen 1000 > link/ether 3c:fd:fe:b9:c8:a0 brd ff:ff:ff:ff:ff:ff > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off > 5: p7p2: mtu 1500 qdisc mq state UP mode > DEFAULT group default qlen 1000 > link/ether 3c:fd:fe:b9:c8:a1 brd ff:ff:ff:ff:ff:ff > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust > off > 13: p7p1_0: mtu 1500 qdisc noop state DOWN mode > DEFAULT group default qlen 1000 > link/ether 6a:ff:a3:55:23:4e brd ff:ff:ff:ff:ff:ff > 14: p7p2_0: mtu 1500 qdisc noop state DOWN mode > DEFAULT group default qlen 1000 > link/ether da:a1:1c:c4:6c:e7 brd ff:ff:ff:ff:ff:ff > > *# ethtool -i p7p1_0* > driver: iavf > version: 3.7.53 > firmware-version: N/A > expansion-rom-version: > bus-info: 0000:86:02.0 > > *# ethtool -i p7p2_0* > driver: iavf > version: 3.7.53 > firmware-version: N/A > expansion-rom-version: > bus-info: 0000:86:0a.0 > > Set MAC addresses: > > *#ip link set p7p1 vf 0 mac a0:b0:c0:d0:e0:f0* > *#ip link set p7p2 vf 0 mac 66:55:44:33:22:11* > > Set trust mode: > > > > *#ip link set p7p1 vf 0 trust on#ip link set p7p2 vf 0 trust on* > > Unbind iavf from VFs and bind vfio-pci to them: > > *# modprobe vfio-pci* > *# dpdk-devbind -u 0000:86:02.0 0000:86:0a.0* > *# dpdk-devbind -b vfio-pci 0000:86:02.0 0000:86:0a.0* > *# dpdk-devbind -s* > > Network devices using DPDK-compatible driver > ============================================ > 0000:86:02.0 'Ethernet Virtual Function 700 Series 154c' drv=vfio-pci > unused=iavf > 0000:86:0a.0 'Ethernet Virtual Function 700 Series 154c' drv=vfio-pci > unused=iavf > > Start testpmd: > > #*/usr/bin/testpmd -l 1,3,35 --socket-mem 1024,1024 -n 4 --proc-type auto > --file-prefix testpmd0 -w 0000:86:02.0 -w 0000:86:0a.0 -- --nb-cores=2 > --nb-ports=2 --portmask=3 --auto-start --rxq=1 --txq=1 --rxd=2048 > --txd=2048 -i* > > Starting traffic at the far end, packets are RX successfully on the DUT but > not TX, with many TX-errors: > > *testpmd> show port stats all* > > ######################## NIC statistics for port 0 > ######################## > RX-packets: 144132155 RX-missed: 0 RX-bytes: 9224457088 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 0 TX-errors: 137664400 TX-bytes: 0 > > Throughput (since last show) > Rx-pps: 19000875 > Tx-pps: 0 > > ############################################################################ > > ######################## NIC statistics for port 1 > ######################## > RX-packets: 144324307 RX-missed: 0 RX-bytes: 9236754880 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 0 TX-errors: 137873118 TX-bytes: 0 > > Throughput (since last show) > Rx-pps: 19000772 > Tx-pps: 0 > > ############################################################################ > > Thanks for any help. > > - Bill