From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 31B7EA317C for ; Thu, 17 Oct 2019 14:33:42 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 0ADB11E95A; Thu, 17 Oct 2019 14:33:37 +0200 (CEST) Received: from us-smtp-1.mimecast.com (us-smtp-delivery-1.mimecast.com [205.139.110.120]) by dpdk.org (Postfix) with ESMTP id 91DF31E943 for ; Thu, 17 Oct 2019 14:33:35 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1571315615; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=B49FDh+KukLA65eX6IKp2gCeLM4Eg3cZVF4+7nRNpwU=; b=K/w6lCiPTmvO0Og0LQf/qufp78/egIwdXnb06IYRONUwGRZ3hXxe/tkkvMhkq4+bUxQWk9 N3uDGJ7/jZmNePD3/H03JHZSpX+133+ZHbiIA7jqGE4vSpQ7PAb+jnzS5099egNgZt3CIP WAGkgS7HbNp0RiqB6IOQmNNsTpPPdj4= Received: from mail-qt1-f198.google.com (mail-qt1-f198.google.com [209.85.160.198]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-6-_Ex51iE-MIySSBR-WxQkVQ-1; Thu, 17 Oct 2019 08:33:31 -0400 Received: by mail-qt1-f198.google.com with SMTP id j5so2129094qtn.10 for ; Thu, 17 Oct 2019 05:33:31 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+2T2gn1O6eQNuvVldWSPiBUdlwUqJ7jpc1QI4UZzam4=; b=jqZxKWrMVe3AcpEsnYMcb6JW1pPOUP2cl2giYta/veBVUr8vMlcsWzlpUyOlk8bq9b EBRoByCgUIZbVPjGeon/s/z7s0adR4Dz8KKRN1oyTreF8ltVkfd62/Lu24LnFNnj0URF UhFIXoEElexcoPzMkz6ESpdSWNgcfozOTz00qVtFxTyV8vfa4r6a7Q0N/bThtJj56PGk QMB2wxJM1RtaHrQ6DgicWF5zRs2cyIrA4wc8qTisAl5TrxuuLq98ap+cDkrijxjwSyXm agN1bppg07xP7kZHpa34P2vx1KvsQsA2HxLw5r8ZvhjhG/IIk6w9YqZvrGvYAwbfVogt 1d6g== X-Gm-Message-State: APjAAAWcrJB3rLTgwtNh0LNff4wO/broBNzMJgP+s3o1Vy0O4Qd46qov M/zZ03hOrGidLfwJ5wH6vJjbVQQ/mtmCqydyhrBwdXSeA1krXi0egf8ujhQbzsDPD8/yWU1DBOf Lz58hQ3RyKpIFEnA9hA== X-Received: by 2002:ac8:d04:: with SMTP id q4mr3493401qti.76.1571315610320; Thu, 17 Oct 2019 05:33:30 -0700 (PDT) X-Google-Smtp-Source: APXvYqxlp1R/Y0GWUJbF6Jeduk17D3AXgogqiVDOcQOIK9pMHvOGs+4DvE5/BxuWZUgWvzCCuLoJT/+xE7w3vHlm92I= X-Received: by 2002:ac8:d04:: with SMTP id q4mr3493371qti.76.1571315610014; Thu, 17 Oct 2019 05:33:30 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Bill Michalowski Date: Thu, 17 Oct 2019 08:33:18 -0400 Message-ID: To: Lance Richardson Cc: dev@dpdk.org, users@dpdk.org X-MC-Unique: _Ex51iE-MIySSBR-WxQkVQ-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] testpmd / SR-IOV RX packets, but TX-errors X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Solved... had to disable spoof checking: ip link set p7p1 vf 0 spoofchk off ip link set p7p2 vf 0 spoofchk off Thank you! On Tue, Oct 15, 2019 at 11:03 AM Bill Michalowski wrote: > Thank you for the suggestion Lance, but that didn't correct the problem. > > That being said, I would think that testpmd in "io" mode would just > forward the packets in the SR-IOV case just as it successfully does with > testpmd across the PFs (non SR-IOV) - but I could be wrong. > > On Tue, Oct 15, 2019 at 10:26 AM Lance Richardson < > lance.richardson@broadcom.com> wrote: > >> Hi Bill, >> >> This is just a guess, but perhaps the transmit drops are due to MAC >> anti-spoofing checks? >> >> You could probably prove/disprove by making the packet source MAC >> match the transmit VF's MAC. >> >> Lance >> >> >> On Tue, Oct 15, 2019 at 10:01 AM Bill Michalowski >> wrote: >> > >> > I'm trying run testpmd with SR-IOV, specifically across two VFs. I se= e >> > packets being received successfully by the application but they are no= t >> > being transmitted. They are dropped with the 'TX-errors' counters >> > incrementing. >> > >> > However, if I generate the same traffic and the DUT isn't programmed >> with >> > SR-IOV, but with testpmd just across PFs, the packets are transmitted >> just >> > fine and I don't have any TX-errors. I'm hoping someone can help me >> figure >> > out why the TX packets are being dropped in the SR-IOV case. >> > >> > testpmd is running in the default "io" mode. >> > >> > The DUT is a two port Intel xxv710 25G card. To simplify things, I'm >> not >> > actually using a guest, just testpmd across VFs. >> > >> > *# rpm -qa | grep dpdk* >> > dpdk-18.11.2-1.el7.x86_64 >> > >> > *# uname -r* >> > 3.10.0-1062.1.2.el7.x86_64 >> > >> > *# cat /etc/redhat-release * >> > Red Hat Enterprise Linux Server release 7.7 (Maipo) >> > >> > PFs: >> > >> > #* ethtool -i p7p1* >> > driver: i40e >> > version: 2.10.19.30 >> > firmware-version: 6.80 0x80003d17 18.8.9 >> > expansion-rom-version: >> > bus-info: 0000:86:00.0 >> > >> > *# ethtool -i p7p2* >> > driver: i40e >> > version: 2.10.19.30 >> > firmware-version: 6.80 0x80003d17 18.8.9 >> > expansion-rom-version: >> > bus-info: 0000:86:00.1 >> > >> > Procedure: >> > >> > Create VFs: >> > >> > *#echo 1 > /sys/class/net/p7p1/device/sriov_numvfs* >> > >> > *#echo 1 > /sys/class/net/p7p2/device/sriov_numvfs* >> > >> > *# ip l* >> > 4: p7p1: mtu 1500 qdisc mq state UP >> mode >> > DEFAULT group default qlen 1000 >> > link/ether 3c:fd:fe:b9:c8:a0 brd ff:ff:ff:ff:ff:ff >> > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, >> trust >> > off >> > 5: p7p2: mtu 1500 qdisc mq state UP >> mode >> > DEFAULT group default qlen 1000 >> > link/ether 3c:fd:fe:b9:c8:a1 brd ff:ff:ff:ff:ff:ff >> > vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, >> trust >> > off >> > 13: p7p1_0: mtu 1500 qdisc noop state DOWN mode >> > DEFAULT group default qlen 1000 >> > link/ether 6a:ff:a3:55:23:4e brd ff:ff:ff:ff:ff:ff >> > 14: p7p2_0: mtu 1500 qdisc noop state DOWN mode >> > DEFAULT group default qlen 1000 >> > link/ether da:a1:1c:c4:6c:e7 brd ff:ff:ff:ff:ff:ff >> > >> > *# ethtool -i p7p1_0* >> > driver: iavf >> > version: 3.7.53 >> > firmware-version: N/A >> > expansion-rom-version: >> > bus-info: 0000:86:02.0 >> > >> > *# ethtool -i p7p2_0* >> > driver: iavf >> > version: 3.7.53 >> > firmware-version: N/A >> > expansion-rom-version: >> > bus-info: 0000:86:0a.0 >> > >> > Set MAC addresses: >> > >> > *#ip link set p7p1 vf 0 mac a0:b0:c0:d0:e0:f0* >> > *#ip link set p7p2 vf 0 mac 66:55:44:33:22:11* >> > >> > Set trust mode: >> > >> > >> > >> > *#ip link set p7p1 vf 0 trust on#ip link set p7p2 vf 0 trust on* >> > >> > Unbind iavf from VFs and bind vfio-pci to them: >> > >> > *# modprobe vfio-pci* >> > *# dpdk-devbind -u 0000:86:02.0 0000:86:0a.0* >> > *# dpdk-devbind -b vfio-pci 0000:86:02.0 0000:86:0a.0* >> > *# dpdk-devbind -s* >> > >> > Network devices using DPDK-compatible driver >> > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> > 0000:86:02.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pc= i >> > unused=3Diavf >> > 0000:86:0a.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pc= i >> > unused=3Diavf >> > >> > Start testpmd: >> > >> > #*/usr/bin/testpmd -l 1,3,35 --socket-mem 1024,1024 -n 4 --proc-type >> auto >> > --file-prefix testpmd0 -w 0000:86:02.0 -w 0000:86:0a.0 -- --nb-cores= =3D2 >> > --nb-ports=3D2 --portmask=3D3 --auto-start --rxq=3D1 --txq=3D1 --rxd= =3D2048 >> > --txd=3D2048 -i* >> > >> > Starting traffic at the far end, packets are RX successfully on the DU= T >> but >> > not TX, with many TX-errors: >> > >> > *testpmd> show port stats all* >> > >> > ######################## NIC statistics for port 0 >> > ######################## >> > RX-packets: 144132155 RX-missed: 0 RX-bytes: 9224457088 >> > RX-errors: 0 >> > RX-nombuf: 0 >> > TX-packets: 0 TX-errors: 137664400 TX-bytes: 0 >> > >> > Throughput (since last show) >> > Rx-pps: 19000875 >> > Tx-pps: 0 >> > >> > >> ########################################################################= #### >> > >> > ######################## NIC statistics for port 1 >> > ######################## >> > RX-packets: 144324307 RX-missed: 0 RX-bytes: 9236754880 >> > RX-errors: 0 >> > RX-nombuf: 0 >> > TX-packets: 0 TX-errors: 137873118 TX-bytes: 0 >> > >> > Throughput (since last show) >> > Rx-pps: 19000772 >> > Tx-pps: 0 >> > >> > >> ########################################################################= #### >> > >> > Thanks for any help. >> > >> > - Bill >> >