From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id EEDF0A2EFC for ; Tue, 15 Oct 2019 16:01:22 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 415941EC96; Tue, 15 Oct 2019 16:01:20 +0200 (CEST) Received: from us-smtp-delivery-1.mimecast.com (us-smtp-1.mimecast.com [205.139.110.61]) by dpdk.org (Postfix) with ESMTP id 6FD6B1EC8A for ; Tue, 15 Oct 2019 16:01:18 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1571148077; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=UqAYV0IefCWP7svqCkOSZUYl7jetdjai7QL2feiwau0=; b=fd9kg7TY7nRrg0MmAPOE50+ViCrmPFAJRUIVIj1mTDHq73qWxq7tx8Nik5cRbnUVleOILq eYR0AozAZq4yKjQKFK4nOyebgshDvsvhpctKD0AGYRbQzXx1FiCWO9qDyoXZOv0sijlaxq vKorPBmZ5HeC/LNpj5+i4011r/XZdE8= Received: from mail-qk1-f199.google.com (mail-qk1-f199.google.com [209.85.222.199]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-144-mId2Nq0_OwS_Hz3_Elnz5w-1; Tue, 15 Oct 2019 10:01:13 -0400 Received: by mail-qk1-f199.google.com with SMTP id y189so20260705qkb.14 for ; Tue, 15 Oct 2019 07:01:13 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=7tOZorlhA0T+CIpneLZwlLzCmzNY/YSJBvM4hTLgYDE=; b=YClEhZmZbaAZD23rrl+ppQ0yhF8cS62gmN+EhCtM486VoAs/P9aaRPcjp81iMN4Bf2 ouk9nY/UJX8AXgZHS/uUyiRrvrI1Zno1D4S2Ja3bfIXGZGd2owP19J/Sen1VzN73YKDK Kfhj8siWBmCT+vk1gSkboVQ0NHrv1vODTMq+2869W4jeQoi7mpebhRG+fCcVDMVnyr2d cYl4knRWNQ3c5dlkVebHmrGXs3MEXEJMoa2VHUqIBvUnHU4VN7YW/FKjDGTmwHNvyy2+ Brj8WMN06brCcec85UOGLHOo9/Hs2VOHbncUlzAkdcNMBjwJe2ZtNt7jiEq0VJ9gogYK UKdg== X-Gm-Message-State: APjAAAXao6hKb6g+td9scsYD0b/Id9ylomNZk5xEKyJk8J4ds1nEAd/7 zCrsAlmWxsKTPCbtM5nLaGjRbQ5MY/8++X/F38DxlslHX8F/3wBOlIFI7UN9ILmQ0gkGUet8+Gr h6hB+wRWueb+lhmSo3Q== X-Received: by 2002:a05:620a:20d4:: with SMTP id f20mr22309313qka.373.1571148071936; Tue, 15 Oct 2019 07:01:11 -0700 (PDT) X-Google-Smtp-Source: APXvYqxNJb8HgQfQaTxUPgp5cV8J/c3HKSVuKeOCHhoXEerpTvtN1MQVfrnpjgkLqHqOUdo9pGzfeHViMU+dDX/9q/E= X-Received: by 2002:a05:620a:20d4:: with SMTP id f20mr22309255qka.373.1571148071481; Tue, 15 Oct 2019 07:01:11 -0700 (PDT) MIME-Version: 1.0 From: Bill Michalowski Date: Tue, 15 Oct 2019 10:01:00 -0400 Message-ID: To: dev@dpdk.org, users@dpdk.org X-MC-Unique: mId2Nq0_OwS_Hz3_Elnz5w-1 X-Mimecast-Spam-Score: 0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] testpmd / SR-IOV RX packets, but TX-errors X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" I'm trying run testpmd with SR-IOV, specifically across two VFs. I see packets being received successfully by the application but they are not being transmitted. They are dropped with the 'TX-errors' counters incrementing. However, if I generate the same traffic and the DUT isn't programmed with SR-IOV, but with testpmd just across PFs, the packets are transmitted just fine and I don't have any TX-errors. I'm hoping someone can help me figure out why the TX packets are being dropped in the SR-IOV case. testpmd is running in the default "io" mode. The DUT is a two port Intel xxv710 25G card. To simplify things, I'm not actually using a guest, just testpmd across VFs. *# rpm -qa | grep dpdk* dpdk-18.11.2-1.el7.x86_64 *# uname -r* 3.10.0-1062.1.2.el7.x86_64 *# cat /etc/redhat-release * Red Hat Enterprise Linux Server release 7.7 (Maipo) PFs: #* ethtool -i p7p1* driver: i40e version: 2.10.19.30 firmware-version: 6.80 0x80003d17 18.8.9 expansion-rom-version: bus-info: 0000:86:00.0 *# ethtool -i p7p2* driver: i40e version: 2.10.19.30 firmware-version: 6.80 0x80003d17 18.8.9 expansion-rom-version: bus-info: 0000:86:00.1 Procedure: Create VFs: *#echo 1 > /sys/class/net/p7p1/device/sriov_numvfs* *#echo 1 > /sys/class/net/p7p2/device/sriov_numvfs* *# ip l* 4: p7p1: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 3c:fd:fe:b9:c8:a0 brd ff:ff:ff:ff:ff:ff vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 5: p7p2: mtu 1500 qdisc mq state UP mode DEFAULT group default qlen 1000 link/ether 3c:fd:fe:b9:c8:a1 brd ff:ff:ff:ff:ff:ff vf 0 MAC 00:00:00:00:00:00, spoof checking on, link-state auto, trust off 13: p7p1_0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 link/ether 6a:ff:a3:55:23:4e brd ff:ff:ff:ff:ff:ff 14: p7p2_0: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 link/ether da:a1:1c:c4:6c:e7 brd ff:ff:ff:ff:ff:ff *# ethtool -i p7p1_0* driver: iavf version: 3.7.53 firmware-version: N/A expansion-rom-version: bus-info: 0000:86:02.0 *# ethtool -i p7p2_0* driver: iavf version: 3.7.53 firmware-version: N/A expansion-rom-version: bus-info: 0000:86:0a.0 Set MAC addresses: *#ip link set p7p1 vf 0 mac a0:b0:c0:d0:e0:f0* *#ip link set p7p2 vf 0 mac 66:55:44:33:22:11* Set trust mode: *#ip link set p7p1 vf 0 trust on#ip link set p7p2 vf 0 trust on* Unbind iavf from VFs and bind vfio-pci to them: *# modprobe vfio-pci* *# dpdk-devbind -u 0000:86:02.0 0000:86:0a.0* *# dpdk-devbind -b vfio-pci 0000:86:02.0 0000:86:0a.0* *# dpdk-devbind -s* Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:86:02.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pci unused=3Diavf 0000:86:0a.0 'Ethernet Virtual Function 700 Series 154c' drv=3Dvfio-pci unused=3Diavf Start testpmd: #*/usr/bin/testpmd -l 1,3,35 --socket-mem 1024,1024 -n 4 --proc-type auto --file-prefix testpmd0 -w 0000:86:02.0 -w 0000:86:0a.0 -- --nb-cores=3D2 --nb-ports=3D2 --portmask=3D3 --auto-start --rxq=3D1 --txq=3D1 --rxd=3D2048 --txd=3D2048 -i* Starting traffic at the far end, packets are RX successfully on the DUT but not TX, with many TX-errors: *testpmd> show port stats all* ######################## NIC statistics for port 0 ######################## RX-packets: 144132155 RX-missed: 0 RX-bytes: 9224457088 RX-errors: 0 RX-nombuf: 0 TX-packets: 0 TX-errors: 137664400 TX-bytes: 0 Throughput (since last show) Rx-pps: 19000875 Tx-pps: 0 ###########################################################################= # ######################## NIC statistics for port 1 ######################## RX-packets: 144324307 RX-missed: 0 RX-bytes: 9236754880 RX-errors: 0 RX-nombuf: 0 TX-packets: 0 TX-errors: 137873118 TX-bytes: 0 Throughput (since last show) Rx-pps: 19000772 Tx-pps: 0 ###########################################################################= # Thanks for any help. - Bill