From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 782FA44161 for ; Wed, 5 Jun 2024 19:59:44 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3F36A40687; Wed, 5 Jun 2024 19:59:44 +0200 (CEST) Received: from mail-lj1-f171.google.com (mail-lj1-f171.google.com [209.85.208.171]) by mails.dpdk.org (Postfix) with ESMTP id 11CC8402E1 for ; Wed, 5 Jun 2024 19:59:42 +0200 (CEST) Received: by mail-lj1-f171.google.com with SMTP id 38308e7fff4ca-2eaac465915so1152701fa.1 for ; Wed, 05 Jun 2024 10:59:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; t=1717610381; x=1718215181; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=D6unhiIKZcEITfKd/OLHHh0dG0mn4eRBeOLpk7dwYEY=; b=aMgo3r4mKhvcR7V81W9zi87qck1kSjbLiVaVlLfj4c1Sc8ZRB+Jq2C+PMmCD8dFi2d Gj9K42XKQT7PsKDgu6kEAkRODlR6f9lN+rzXmh9cWMTkFeVmYQsJ81NdIXExyaVTGFIC ciqs4UjvjON1SRR3k4zwBndJ8qZbcamHMmybU= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1717610381; x=1718215181; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=D6unhiIKZcEITfKd/OLHHh0dG0mn4eRBeOLpk7dwYEY=; b=f43IUDjum6tfv82afCEZQrq2YXDd/uozGpW9LM4rcxRddxGkuFL3Hig3SQ32nyq/Be mUCEZrXnbXk3PR5ZnhDtYjQuCelFHhwfyS6Q4m/oYW+DKhe3K1LUs0/oOhDwFvVGjTYY AGaL2DgK8OG9TrnK9HNodZ8vjgh2lFUPKLwy4ymKG1VJJkjiYRajYgodDb9G36z5oRYd RP+Yjk2dPFebauh26+e6QX8bv0ct0f56f36IK1gVJUdhxYvuBoe8njv8/e4uzWw3mvvw OUWlJLWaDh6wiAPsXGDjJuS7e6/QXc445pqbyuAYO0Gcj/+fLn/BWU1Zv+6bX+Oz0hlL F6cw== X-Gm-Message-State: AOJu0Yy5R0lY7to+ULUyrvccS/BM6La4YAuP6MnCmz6zIcsiRZBurTnp 7xC9B27/F2IxQ2HxW4YPC+sRzasQ5Sf2SLVTTcUhhOK4qHGPIk6cO6r0DF0Ppfs/LS2wueQqtDB SiJXjcoanau5SPw42/u2R0RukXAkQn1XfcJAN323lPoXcXDjxFyhIm3KE1ZKhjuNyJic+sQdJmS vSZAIRzWc= X-Google-Smtp-Source: AGHT+IFawRcORdYnzx+v1M5/DHjCEds96wjN2HeGoZehNQARRMUABQMiL5y6w0dcWlv31EiNyF3Vxtgx8c4S1rpdUuE= X-Received: by 2002:a2e:978b:0:b0:2d6:f69d:c74c with SMTP id 38308e7fff4ca-2eac7a4c6afmr18146421fa.38.1717610381140; Wed, 05 Jun 2024 10:59:41 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Nandini Rangaswamy Date: Wed, 5 Jun 2024 10:59:29 -0700 Message-ID: Subject: Re: DPDK Netvsc - Observing very low throughput while running Testpmd To: "Knight, Joshua" Cc: "users@dpdk.org" Content-Type: multipart/alternative; boundary="000000000000a17f1c061a28548f" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --000000000000a17f1c061a28548f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Joshua, I have modified the tx_only.c in testpmd to reflect the actual IP addresses of the LAN and WAN interfaces. I enabled verbose logs and verified that the packets originated from WAN port are reaching LAN port and vice-versa. A snapshot of running testpmd with verbose logs enabled is shown below: /opt/vc/bin/dpdk-testpmd -l 1-3 -n 1 -a f030:00:02.0 -a 2334:00:02.0 -- --rxq=3D2 --txq=3D2 -i EAL: Detected CPU lcores: 8 EAL: Detected NUMA nodes: 1 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'PA' EAL: VFIO support initialized EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: 2334:00:02.0 (socket -1= ) mlx5_net: No available register for sampler. EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: f030:00:02.0 (socket -1= ) mlx5_net: No available register for sampler. hn_vf_attach(): found matching VF port 0 hn_vf_attach(): found matching VF port 1 TELEMETRY: No legacy callbacks, legacy socket not created Interactive-mode selected testpmd: create a new mbuf pool : n=3D326912, size=3D2560, socke= t=3D0 testpmd: preferred mempool ops selected: ring_mp_mc Configuring Port 2 (socket 0) Port 2: 00:0D:3A:42:F8:3C Configuring Port 3 (socket 0) Port 3: 00:0D:3A:42:FB:CD Checking link statuses... Done testpmd> set verbose 3 Change verbose level from 0 to 3 testpmd> start tx_first io packet forwarding - ports=3D2 - cores=3D1 - streams=3D4 - NUMA support enabled, MP allocation mode: native Logical Core 2 (socket 0) forwards packets on 4 streams: RX P=3D2/Q=3D0 (socket 0) -> TX P=3D3/Q=3D0 (socket 0) peer=3D02:00:00:00= :00:03 RX P=3D3/Q=3D0 (socket 0) -> TX P=3D2/Q=3D0 (socket 0) peer=3D02:00:00:00= :00:02 RX P=3D2/Q=3D1 (socket 0) -> TX P=3D3/Q=3D1 (socket 0) peer=3D02:00:00:00= :00:03 RX P=3D3/Q=3D1 (socket 0) -> TX P=3D2/Q=3D1 (socket 0) peer=3D02:00:00:00= :00:02 io packet forwarding packets/burst=3D32 nb forwarding cores=3D1 - nb forwarding ports=3D2 port 2: RX queue number: 2 Tx queue number: 2 Rx offloads=3D0x80000 Tx offloads=3D0x0 RX queue: 0 RX desc=3D256 - RX free threshold=3D0 RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 RX Offloads=3D0x80000 TX queue: 0 TX desc=3D256 - TX free threshold=3D0 TX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 TX offloads=3D0x0 - TX RS bit threshold=3D0 port 3: RX queue number: 2 Tx queue number: 2 Rx offloads=3D0x80000 Tx offloads=3D0x0 RX queue: 0 RX desc=3D256 - RX free threshold=3D0 RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 RX Offloads=3D0x80000 TX queue: 0 TX desc=3D256 - TX free threshold=3D0 TX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 TX offloads=3D0x0 - TX RS bit threshold=3D0 port 3/queue 1: sent 13 packets src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM ........... port 2/queue 1: received 18 packets src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - sw ptype: L2_ETHER L3_IPV4 L4_UDP - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash=3D0xef1c29ff - RSS que= ue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP - show port stats shows 0 dropped packets. testpmd> show port stats all ######################## NIC statistics for port 2 ######################## RX-packets: 89 RX-missed: 0 RX-bytes: 6126 RX-errors: 0 RX-nombuf: 0 TX-packets: 69 TX-errors: 0 TX-bytes: 4526 Throughput (since last show) Rx-pps: 0 Rx-bps: 0 Tx-pps: 0 Tx-bps: 0 ###########################################################################= # ######################## NIC statistics for port 3 ######################## RX-packets: 5 RX-missed: 0 RX-bytes: 430 RX-errors: 0 RX-nombuf: 0 TX-packets: 153 TX-errors: 0 TX-bytes: 10222 Throughput (since last show) Rx-pps: 0 Rx-bps: 0 Tx-pps: 0 Tx-bps: 0 ###########################################################################= # testpmd> stop Telling cores to stop... Waiting for lcores to finish... ------- Forward Stats for RX Port=3D 2/Queue=3D 0 -> TX Port=3D 3/Queue= =3D 0 ------- RX-packets: 5 TX-packets: 5 TX-dropped: 0 ------- Forward Stats for RX Port=3D 3/Queue=3D 0 -> TX Port=3D 2/Queue= =3D 0 ------- RX-packets: 2 TX-packets: 2 TX-dropped: 0 ------- Forward Stats for RX Port=3D 2/Queue=3D 1 -> TX Port=3D 3/Queue= =3D 1 ------- RX-packets: 11 TX-packets: 11 TX-dropped: 0 ------- Forward Stats for RX Port=3D 3/Queue=3D 1 -> TX Port=3D 2/Queue= =3D 1 ------- RX-packets: 2 TX-packets: 2 TX-dropped: 0 ---------------------- Forward statistics for port 2 ---------------------- RX-packets: 16 RX-dropped: 0 RX-total: 16 TX-packets: 4 TX-dropped: 0 TX-total: 4 ---------------------------------------------------------------------------= - ---------------------- Forward statistics for port 3 ---------------------- RX-packets: 4 RX-dropped: 0 RX-total: 4 TX-packets: 16 TX-dropped: 0 TX-total: 16 ---------------------------------------------------------------------------= - +++++++++++++++ Accumulated forward statistics for all ports+++++++++++++++ RX-packets: 20 RX-dropped: 0 RX-total: 20 TX-packets: 20 TX-dropped: 0 TX-total: 20 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= + Regards, Nandini On Wed, Jun 5, 2024 at 10:39=E2=80=AFAM Knight, Joshua wrote: > Have you also performed the modification of txonly.c that Microsoft > recommends on that page? > > =E2=80=9CWhen you're running the previous commands on a virtual machine, = change > *IP_SRC_ADDR* and *IP_DST_ADDR* in app/test-pmd/txonly.c to match the > actual IP address of the virtual machines before you compile. Otherwise, > the packets are dropped before reaching the forwarder.=E2=80=9D > > > > Keep in mind that in Azure you do not have a true L2 network between two > interfaces even on the same subnet, it=E2=80=99s all routed via the subne= t gateway > (x.x.x.1, mac addr 12:34:56:78:9a:bc). I would not expect an L2 forwardin= g > app to behave in the same way as a regular VM or hardware. > > > > I haven=E2=80=99t personally used testpmd in this way in Azure, but I=E2= =80=99ve used > dpdk-pktgen and it took some effort to get traffic to go to the right pla= ce. > > > > Josh > > > > *From: *Nandini Rangaswamy > *Date: *Tuesday, June 4, 2024 at 5:41=E2=80=AFPM > *To: *users@dpdk.org > *Subject: *DPDK Netvsc - Observing very low throughput while running > Testpmd > > *External Email:* This message originated outside of NETSCOUT. Do not > click links or open attachments unless you recognize the sender and know > the content is safe. > > Hello, > > > > I am trying to set up dpdk with netvsc as master pmd on Azure following > > https://learn.microsoft.com/en-us/azure/virtual-network/setup-dpdk?tabs= =3Dubuntu > > and > > https://doc.dpdk.org/guides-22.11/nics/netvsc.html . > > > > On the Azure VM, I have a LAN and a WAN interface with accelerated networ= king enabled.I have unbound both the VMBUS devices from the kernel and boun= d it to uio_hv_generic.The DPDK version is 22.11 running on openwrt 5.15.15= 0. > > When I try running testpmd in io mode to send and receive traffic between= LAN and WAN port, I notice very low throughput. Please find the testpmd c= ommand and stats below: > > /opt/vc/bin/dpdk-testpmd -l 1-3 -n 1 -a f030:00:02.0 -a 2334:00:02.0 -- = --rxq=3D1 --txq=3D1 -i > EAL: Detected CPU lcores: 8 > EAL: Detected NUMA nodes: 1 > EAL: Detected static linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > EAL: Selected IOVA mode 'PA' > EAL: Debug dataplane logs available - lower performance > EAL: VFIO support initialized > EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: 2334:00:02.0 (socket = -1) > mlx5_net: No available register for sampler. > EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: f030:00:02.0 (socket = -1) > mlx5_net: No available register for sampler. > hn_vf_attach(): found matching VF port 0 > hn_vf_attach(): found matching VF port 1 > TELEMETRY: No legacy callbacks, legacy socket not created > Interactive-mode selected > testpmd: create a new mbuf pool : n=3D326912, size=3D2560, soc= ket=3D0 > testpmd: preferred mempool ops selected: ring_mp_mc > Configuring Port 2 (socket 0) > Port 2: 00:0D:3A:42:F8:3C > Configuring Port 3 (socket 0) > Port 3: 00:0D:3A:42:FB:CD > Checking link statuses... > Done > testpmd> start tx_first > io packet forwarding - ports=3D2 - cores=3D1 - streams=3D2 - NUMA support= enabled, MP allocation mode: native > Logical Core 2 (socket 0) forwards packets on 2 streams: > RX P=3D2/Q=3D0 (socket 0) -> TX P=3D3/Q=3D0 (socket 0) peer=3D02:00:00:= 00:00:03 > RX P=3D3/Q=3D0 (socket 0) -> TX P=3D2/Q=3D0 (socket 0) peer=3D02:00:00:= 00:00:02 > > io packet forwarding packets/burst=3D32 > nb forwarding cores=3D1 - nb forwarding ports=3D2 > port 2: RX queue number: 1 Tx queue number: 1 > Rx offloads=3D0x0 Tx offloads=3D0x0 > RX queue: 0 > RX desc=3D256 - RX free threshold=3D0 > RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 > RX Offloads=3D0x0 > TX queue: 0 > TX desc=3D256 - TX free threshold=3D0 > TX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 > TX offloads=3D0x0 - TX RS bit threshold=3D0 > port 3: RX queue number: 1 Tx queue number: 1 > Rx offloads=3D0x0 Tx offloads=3D0x0 > RX queue: 0 > RX desc=3D256 - RX free threshold=3D0 > RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 > RX Offloads=3D0x0 > TX queue: 0 > TX desc=3D256 - TX free threshold=3D0 > TX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 > TX offloads=3D0x0 - TX RS bit threshold=3D0 > testpmd> show port stats all > > ######################## NIC statistics for port 2 ###################= ##### > RX-packets: 34 RX-missed: 0 RX-bytes: 2194 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 32 TX-errors: 0 TX-bytes: 2048 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > > ######################## NIC statistics for port 3 ###################= ##### > RX-packets: 1 RX-missed: 0 RX-bytes: 86 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 64 TX-errors: 0 TX-bytes: 4096 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > testpmd> show port stats all > > ######################## NIC statistics for port 2 ###################= ##### > RX-packets: 34 RX-missed: 0 RX-bytes: 2194 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 32 TX-errors: 0 TX-bytes: 2048 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > > ######################## NIC statistics for port 3 ###################= ##### > RX-packets: 1 RX-missed: 0 RX-bytes: 86 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 64 TX-errors: 0 TX-bytes: 4096 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > testpmd> show port stats all > > ######################## NIC statistics for port 2 ###################= ##### > RX-packets: 34 RX-missed: 0 RX-bytes: 2194 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 32 TX-errors: 0 TX-bytes: 2048 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > > ######################## NIC statistics for port 3 ###################= ##### > RX-packets: 1 RX-missed: 0 RX-bytes: 86 > RX-errors: 0 > RX-nombuf: 0 > TX-packets: 64 TX-errors: 0 TX-bytes: 4096 > > Throughput (since last show) > Rx-pps: 0 Rx-bps: 0 > Tx-pps: 0 Tx-bps: 0 > #######################################################################= ##### > testpmd> quit > Telling cores to stop... > Waiting for lcores to finish... > > ---------------------- Forward statistics for port 2 -----------------= ----- > RX-packets: 32 RX-dropped: 0 RX-total: 32 > TX-packets: 32 TX-dropped: 0 TX-total: 32 > -----------------------------------------------------------------------= ----- > > ---------------------- Forward statistics for port 3 -----------------= ----- > RX-packets: 0 RX-dropped: 0 RX-total: 0 > TX-packets: 64 TX-dropped: 0 TX-total: 64 > -----------------------------------------------------------------------= ----- > > +++++++++++++++ Accumulated forward statistics for all ports+++++++++++= ++++ > RX-packets: 32 RX-dropped: 0 RX-total: 32 > TX-packets: 96 TX-dropped: 0 TX-total: 96 > +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++= +++++ > > Done. > > Stopping port 2... > Stopping ports... > Done > > Stopping port 3... > Stopping ports... > Done > > Shutting down port 2... > Closing ports... > Port 0 is closed > Port 2 is closed > Done > > Shutting down port 3... > Closing ports... > Port 1 is closed > Port 3 is closed > Done > > Bye... > > If I try with 2 queues , the throughput only slightly improves. I expecte= d to see larger values. > > After enabling debug logs i observe that > > 1. Both the VMbus devices are being probed and matching VF devices found > > 2. VF devices are being configured with Rx and Tx queue setup. > > Any ideas what I might be doing wrong? > > Regards, > > Nandini > > > This electronic communication and the information and any files > transmitted with it, or attached to it, are confidential and are intended > solely for the use of the individual or entity to whom it is addressed an= d > may contain information that is confidential, legally privileged, protect= ed > by privacy laws, or otherwise restricted from disclosure to anyone else. = If > you are not the intended recipient or the person responsible for deliveri= ng > the e-mail to the intended recipient, you are hereby notified that any us= e, > copying, distributing, dissemination, forwarding, printing, or copying of > this e-mail is strictly prohibited. If you received this e-mail in error, > please return the e-mail to the sender, delete it from your computer, and > destroy any printed copy of it. > --=20 This electronic communication and the information and any files transmitted= =20 with it, or attached to it, are confidential and are intended solely for=20 the use of the individual or entity to whom it is addressed and may contain= =20 information that is confidential, legally privileged, protected by privacy= =20 laws, or otherwise restricted from disclosure to anyone else. If you are=20 not the intended recipient or the person responsible for delivering the=20 e-mail to the intended recipient, you are hereby notified that any use,=20 copying, distributing, dissemination, forwarding, printing, or copying of= =20 this e-mail is strictly prohibited. If you received this e-mail in error,= =20 please return the e-mail to the sender, delete it from your computer, and= =20 destroy any printed copy of it. --000000000000a17f1c061a28548f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi=C2=A0Joshua,
I have modified the tx_only.c in testp= md to reflect the actual IP addresses of the LAN and WAN interfaces. I enab= led verbose logs and verified that the packets originated from WAN port are= reaching LAN port and vice-versa.

A snapshot of r= unning testpmd with verbose logs enabled is shown below:

/opt/vc/bin/dpdk-testpmd -l 1-3 -n 1 -a f030:00:02.0=C2=A0 -a 2334:00:02.0 -- --rxq=3D2 --txq=3D2=C2=A0 -i

EAL: Detected CP= U lcores: 8

EAL: Detected NU= MA nodes: 1

EAL: Detected st= atic linkage of DPDK

EAL: Multi-proce= ss socket /var/run/dpdk/rte/mp_socket

EAL: Selected IO= VA mode 'PA'

EAL: VFIO suppor= t initialized

EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: 2334:00:02.0 (socket -1)

mlx5_net: No available register for sampler.

EAL: Probe PCI driver: mlx5_pci (15b3:1016) device: f030:00:02.0 (socket -1)

mlx5_net: No available register for sampler.

hn_vf_attach(): found matching VF port 0

hn_vf_attach(): found matching VF port 1

TELEMETRY: No le= gacy callbacks, legacy socket not created

Interactive-mode selected

testpmd: create = a new mbuf pool <mb_pool_0>: n=3D326912, size=3D2560, socket=3D0

testpmd: preferr= ed mempool ops selected: ring_mp_mc

Configuring Port= 2 (socket 0)

Port 2: 00:0D:3A:42:F8:3C

Configuring Port= 3 (socket 0)

Port 3: 00:0D:3A:42:FB:CD

Checking link statuses...

Done

testpmd> set verbose 3

Change verbose l= evel from 0 to 3

testpmd> star= t tx_first

io packet forwar= ding - ports=3D2 - cores=3D1 - streams=3D4 - NUMA support enabled, MP allocation= mode: native

Logical Core 2 (socket 0) forwards packets on 4 streams:

=C2=A0 RX P=3D2/= Q=3D0 (socket 0) -> TX P=3D3/Q=3D0 (socket 0) peer=3D02:00:00:00:00:03

=C2=A0 RX P=3D3/= Q=3D0 (socket 0) -> TX P=3D2/Q=3D0 (socket 0) peer=3D02:00:00:00:00:02

=C2=A0 RX P=3D2/= Q=3D1 (socket 0) -> TX P=3D3/Q=3D1 (socket 0) peer=3D02:00:00:00:00:03

=C2=A0 RX P=3D3/= Q=3D1 (socket 0) -> TX P=3D2/Q=3D1 (socket 0) peer=3D02:00:00:00:00:02

=C2=A0

=C2=A0 io packet= forwarding packets/burst=3D32

=C2=A0 nb forwar= ding cores=3D1 - nb forwarding ports=3D2

=C2=A0 port 2: R= X queue number: 2 Tx queue number: 2

=C2=A0=C2=A0=C2= =A0 Rx offloads=3D0x80000 Tx offloads=3D0x0

=C2=A0=C2=A0=C2= =A0 RX queue: 0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX desc=3D256 - RX free threshold=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX threshold registers: pthresh=3D0 hthresh=3D0=C2=A0 wthresh=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX Offloads=3D0x80000

=C2=A0=C2=A0=C2= =A0 TX queue: 0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX desc=3D256 - TX free threshold=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX threshold registers: pthresh=3D0 hthresh=3D0=C2=A0 wthresh=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX offloads=3D0x0 - TX RS bit threshold=3D0

=C2=A0 port 3: R= X queue number: 2 Tx queue number: 2

=C2=A0=C2=A0=C2= =A0 Rx offloads=3D0x80000 Tx offloads=3D0x0

=C2=A0=C2=A0=C2= =A0 RX queue: 0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX desc=3D256 - RX free threshold=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX threshold registers: pthresh=3D0 hthresh=3D0=C2=A0 wthresh=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 RX Offloads=3D0x80000

=C2=A0=C2=A0=C2= =A0 TX queue: 0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX desc=3D256 - TX free threshold=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX threshold registers: pthresh=3D0 hthresh=3D0=C2=A0 wthresh=3D0

=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 TX offloads=3D0x0 - TX RS bit threshold=3D0


port 3/queue 1: sent 13 packets

= =C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:= 3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:= 3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Send queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_TX_L4_NO_CKSUM

...........


port 2/queue 1: received 18 packets

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:= F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:= F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 - sw ptype: L2_ET= HER L3_IPV4 L4_UDP=C2=A0 - l2_len=3D14 - l3_len=3D20 - l4_len=3D8 - Receive queue=3D0x1

= =C2=A0 ol_flags: RTE_MBUF_F_RX_RSS_HASH RTE_MBUF_F_RX_L4_CKSUM_UNKNOWN RTE_MBUF_F_RX_IP_CKSUM_GOOD RTE_MBUF_F_RX_OUTER_L4_CKSUM_UNKNOWN

=C2=A0 src=3D00:0D:3A:42:F8:3C - dst=3D00:0D:3A:42:= F8:3C - pool=3Dmb_pool_0 - type=3D0x0800 - length=3D64 - nb_segs=3D1 - RSS hash= =3D0xef1c29ff - RSS queue=3D0x1 - hw ptype: L2_ETHER L3_IPV4 L4_UDP=C2=A0 -=C2=A0


sho= w port stats shows 0 dropped packets.
testpmd> show port stats= all

=C2=A0 ######################## NIC statistics for port 2 =C2= =A0########################
=C2=A0 RX-packets: 89 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 RX-missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A06126<= br>=C2=A0 RX-errors: 0
=C2=A0 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 6= 9 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0TX-bytes: =C2=A04526

=C2=A0 Throughput (since last show)
=C2= =A0 Rx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0Rx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 = Tx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0Tx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 ####= ########################################################################
=C2=A0 ######################## NIC statistics for port 3 =C2=A0######= ##################
=C2=A0 RX-packets: 5 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0RX-missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A0430
= =C2=A0 RX-errors: 0
=C2=A0 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 153 = =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0T= X-bytes: =C2=A010222

=C2=A0 Throughput (since last show)
=C2=A0 R= x-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0Rx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 Tx-p= ps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0Tx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 ########= ####################################################################
tes= tpmd> stop
Telling cores to stop...
Waiting for lcores to finish..= .

=C2=A0 ------- Forward Stats for RX Port=3D 2/Queue=3D 0 -> TX = Port=3D 3/Queue=3D 0 -------
=C2=A0 RX-packets: 5 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-packets: 5 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0TX-dropped: 0

=C2=A0 ------- Forward Stats for RX Port= =3D 3/Queue=3D 0 -> TX Port=3D 2/Queue=3D 0 -------
=C2=A0 RX-packets= : 2 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-packets: 2 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-dropped: 0

=C2=A0 ------= - Forward Stats for RX Port=3D 2/Queue=3D 1 -> TX Port=3D 3/Queue=3D 1 -= ------
=C2=A0 RX-packets: 11 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 T= X-packets: 11 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-dropped: 0
=C2=A0 ------- Forward Stats for RX Port=3D 3/Queue=3D 1 -> TX Port=3D= 2/Queue=3D 1 -------
=C2=A0 RX-packets: 2 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0TX-packets: 2 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0TX-dropped: 0

=C2=A0 ---------------------- Forward statistic= s for port 2 =C2=A0----------------------
=C2=A0 RX-packets: 16 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 RX-total: 16
=C2=A0 TX-packets: 4 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 TX-total: 4
=C2=A0 ------------------------------------------= ----------------------------------

=C2=A0 ---------------------- For= ward statistics for port 3 =C2=A0----------------------
=C2=A0 RX-packet= s: 4 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-dropped: 0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-total: 4
=C2=A0 TX-packets: 16 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 TX-total: 16
=C2=A0 -------------------------------= ---------------------------------------------

=C2=A0 +++++++++++++++= Accumulated forward statistics for all ports+++++++++++++++
=C2=A0 RX-p= ackets: 20 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-dropped: 0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-total: 20
=C2=A0 TX-packets: 20 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-dropped: 0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 TX-total: 20
=C2=A0 +++++++++++++++++++++++++++= +++++++++++++++++++++++++++++++++++++++++++++++++

<= div>Regards,
Nandini

On Wed, Jun 5, 2024 at 10:39=E2=80=AFAM= Knight, Joshua <Joshua.Knight@netscout.com> wrote:

Have you also perform= ed the modification of txonly.c that Microsoft recommends on that page?

=E2=80=9CWhen you're running the previous commands on a virtual = machine, change IP_SRC_ADDR and IP_DST_ADDR in app/test-pmd/txonly.c to match= the actual IP address of the virtual machines before you compile. Otherwis= e, the packets are dropped before reaching the forwarder.=E2=80=9D

=C2=A0<= /span>

Keep in mind that in = Azure you do not have a true L2 network between two interfaces even on the = same subnet, it=E2=80=99s all routed via the subnet gateway (x.x.x.1, mac a= ddr 12:34:56:78:9a:bc). I would not expect an L2 forwarding app to behave in the same way as a regular VM or hardware= .

=C2=A0<= /span>

I haven=E2=80=99t per= sonally used testpmd in this way in Azure, but I=E2=80=99ve used dpdk-pktge= n and it took some effort to get traffic to go to the right place.

=C2=A0<= /span>

Josh

=C2=A0<= /span>

From: Nandini Rangaswamy <nandini.rangaswamy@= broadcom.com>
Date: Tuesday, June 4, 2024 at 5:41=E2=80=AF= PM
To: users@dpdk.o= rg <users@dpdk.o= rg>
Subject: DPDK Netvsc - Observing very low throughput while running T= estpmd

External E= mail: This message originated outside of NETSCOUT. Do not click links or open= attachments unless you recognize the sender and know the content is safe.

 
Hello,
=C2=A0
I am trying to set up dpdk with netvsc as =
master pmd on Azure following
https://learn.mi=
crosoft.com/en-us/azure/virtual-network/setup-dpdk?tabs=3Dubuntu=

and
https://doc.dpdk.org/guides-22.11/nics/netvsc.=
html.
=C2=A0
On the Azure VM, I have a LAN and a WAN in=
terface with accelerated networking enabled.I have unbound both the VMBUS d=
evices from the kernel and bound it to uio_hv_generic.The DPDK version is 2=
2.11 running on openwrt 5.15.150.
When I try running testpmd in io mode to s=
end and receive traffic between LAN and WAN port, I notice very low through=
put.=C2=A0 Please find the testpmd command and stats below:
/opt/vc/bin/dpdk-testpmd -l 1-3 -n 1 -a f0=
30:00:02.0 =C2=A0-a 2334:00:02.0 -- --rxq=3D1 --txq=3D1 =C2=A0-i
EAL: De=
tected CPU lcores: 8
EAL: Detected NUMA nodes: 1
EAL: Detected static=
 linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/rte/mp_socketEAL: Selected IOVA mode 'PA'
EAL: Debug dataplane logs availab=
le - lower performance
EAL: VFIO support initialized
EAL: Probe PCI d=
river: mlx5_pci (15b3:1016) device: 2334:00:02.0 (socket -1)
mlx5_net: N=
o available register for sampler.
EAL: Probe PCI driver: mlx5_pci (15b3:=
1016) device: f030:00:02.0 (socket -1)
mlx5_net: No available register f=
or sampler.
hn_vf_attach(): found matching VF port 0
hn_vf_attach(): =
found matching VF port 1
TELEMETRY: No legacy callbacks, legacy socket n=
ot created
Interactive-mode selected
testpmd: create a new mbuf pool =
<mb_pool_0>: n=3D326912, size=3D2560, socket=3D0
testpmd: preferre=
d mempool ops selected: ring_mp_mc
Configuring Port 2 (socket 0)
Port=
 2: 00:0D:3A:42:F8:3C
Configuring Port 3 (socket 0)
Port 3: 00:0D:3A:=
42:FB:CD
Checking link statuses...
Done
testpmd> start tx_first=

io packet forwarding - ports=3D2 - cores=3D1 - streams=3D2 - NUMA suppo=
rt enabled, MP allocation mode: native
Logical Core 2 (socket 0) forward=
s packets on 2 streams:
=C2=A0 RX P=3D2/Q=3D0 (socket 0) -> TX P=3D3/=
Q=3D0 (socket 0) peer=3D02:00:00:00:00:03
=C2=A0 RX P=3D3/Q=3D0 (socket =
0) -> TX P=3D2/Q=3D0 (socket 0) peer=3D02:00:00:00:00:02

=C2=A0 i=
o packet forwarding packets/burst=3D32
=C2=A0 nb forwarding cores=3D1 - =
nb forwarding ports=3D2
=C2=A0 port 2: RX queue number: 1 Tx queue numbe=
r: 1
=C2=A0 =C2=A0 Rx offloads=3D0x0 Tx offloads=3D0x0
=C2=A0 =C2=A0 =
RX queue: 0
=C2=A0 =C2=A0 =C2=A0 RX desc=3D256 - RX free threshold=3D0=C2=A0 =C2=A0 =C2=A0 RX threshold registers: pthresh=3D0 hthresh=3D0 =C2=
=A0wthresh=3D0
=C2=A0 =C2=A0 =C2=A0 RX Offloads=3D0x0
=C2=A0 =C2=A0 T=
X queue: 0
=C2=A0 =C2=A0 =C2=A0 TX desc=3D256 - TX free threshold=3D0=C2=A0 =C2=A0 =C2=A0 TX threshold registers: pthresh=3D0 hthresh=3D0 =C2=
=A0wthresh=3D0
=C2=A0 =C2=A0 =C2=A0 TX offloads=3D0x0 - TX RS bit thresh=
old=3D0
=C2=A0 port 3: RX queue number: 1 Tx queue number: 1
=C2=A0 =
=C2=A0 Rx offloads=3D0x0 Tx offloads=3D0x0
=C2=A0 =C2=A0 RX queue: 0
=
=C2=A0 =C2=A0 =C2=A0 RX desc=3D256 - RX free threshold=3D0
=C2=A0 =C2=A0=
 =C2=A0 RX threshold registers: pthresh=3D0 hthresh=3D0 =C2=A0wthresh=3D0=C2=A0 =C2=A0 =C2=A0 RX Offloads=3D0x0
=C2=A0 =C2=A0 TX queue: 0
=
=C2=A0 =C2=A0 =C2=A0 TX desc=3D256 - TX free threshold=3D0
=C2=A0 =C2=A0=
 =C2=A0 TX threshold registers: pthresh=3D0 hthresh=3D0 =C2=A0wthresh=3D0=C2=A0 =C2=A0 =C2=A0 TX offloads=3D0x0 - TX RS bit threshold=3D0
testp=
md> show port stats all

=C2=A0 ######################## NIC stati=
stics for port 2 =C2=A0########################
=C2=A0 RX-packets: 34 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=
RX-bytes: =C2=A02194
=C2=A0 RX-errors: 0
=C2=A0 RX-nombuf: =C2=A00=C2=A0 TX-packets: 32 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-errors: 0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0TX-bytes: =C2=A02048

=C2=A0 Throughput (sinc=
e last show)
=C2=A0 Rx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Rx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A00
=C2=A0 Tx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A00
=C2=A0 #####################################################=
#######################

=C2=A0 ######################## NIC statisti=
cs for port 3 =C2=A0########################
=C2=A0 RX-packets: 1 =C2=A0=
 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=
RX-bytes: =C2=A086
=C2=A0 RX-errors: 0
=C2=A0 RX-nombuf: =C2=A00
=
=C2=A0 TX-packets: 64 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-errors: 0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0TX-bytes: =C2=A04096

=C2=A0 Throughput (sinc=
e last show)
=C2=A0 Rx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Rx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A00
=C2=A0 Tx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A00
=C2=A0 #####################################################=
#######################
testpmd> show port stats all

=C2=A0 ##=
###################### NIC statistics for port 2 =C2=A0####################=
####
=C2=A0 RX-packets: 34 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-missed: 0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A02194
=C2=A0 RX-errors: 0<=
br>=C2=A0 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 32 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 TX-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-bytes: =C2=A02048<=
br>
=C2=A0 Throughput (since last show)
=C2=A0 Rx-pps: =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Rx-bps: =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 Tx-pps: =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tx-bps: =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 #############################=
###############################################

=C2=A0 #############=
########### NIC statistics for port 3 =C2=A0########################
=C2=
=A0 RX-packets: 1 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-missed: 0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A086
=C2=A0 RX-errors: 0
=C2=A0=
 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 64 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX=
-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-bytes: =C2=A04096

=
=C2=A0 Throughput (since last show)
=C2=A0 Rx-pps: =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Rx-bps: =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 Tx-pps: =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tx-bps: =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 ####################################=
########################################
testpmd> show port stats all=


=C2=A0 ######################## NIC statistics for port 2 =C2=A0###=
#####################
=C2=A0 RX-packets: 34 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
RX-missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A02194
=C2=
=A0 RX-errors: 0
=C2=A0 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 32 =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 TX-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-=
bytes: =C2=A02048

=C2=A0 Throughput (since last show)
=C2=A0 Rx-p=
ps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0Rx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 Tx-pps: =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0Tx-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 ###########=
#################################################################

=
=C2=A0 ######################## NIC statistics for port 3 =C2=A0###########=
#############
=C2=A0 RX-packets: 1 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-=
missed: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0RX-bytes: =C2=A086
=C2=A0 RX=
-errors: 0
=C2=A0 RX-nombuf: =C2=A00
=C2=A0 TX-packets: 64 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 TX-errors: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0TX-bytes: =
=C2=A04096

=C2=A0 Throughput (since last show)
=C2=A0 Rx-pps: =C2=
=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0R=
x-bps: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 Tx-pps: =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Tx-bp=
s: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A00
=C2=A0 ###################=
#########################################################
testpmd> qu=
it
Telling cores to stop...
Waiting for lcores to finish...

=
=C2=A0 ---------------------- Forward statistics for port 2 =C2=A0---------=
-------------
=C2=A0 RX-packets: 32 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 RX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX-total: 32=

=C2=A0 TX-packets: 32 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-drop=
ped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-total: 32
=C2=A0 ---=
-------------------------------------------------------------------------
=C2=A0 ---------------------- Forward statistics for port 3 =C2=A0---=
-------------------
=C2=A0 RX-packets: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0RX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 RX=
-total: 0
=C2=A0 TX-packets: 64 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 TX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-total: 64=C2=A0 -------------------------------------------------------------------=
---------

=C2=A0 +++++++++++++++ Accumulated forward statistics for =
all ports+++++++++++++++
=C2=A0 RX-packets: 32 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 =C2=A0 =C2=A0 RX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 R=
X-total: 32
=C2=A0 TX-packets: 96 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=
=A0 TX-dropped: 0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 TX-total: 96=C2=A0 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++=
+++++++++

Done.

Stopping port 2...
Stopping ports...
Do=
ne

Stopping port 3...
Stopping ports...
Done

Shutting d=
own port 2...
Closing ports...
Port 0 is closed
Port 2 is closedDone

Shutting down port 3...
Closing ports...
Port 1 is clos=
ed
Port 3 is closed
Done

Bye...
If I try with 2 queues , the throughput on=
ly slightly improves. I expected to see larger values.=

After enabling debug logs i observe that
1. Both the VMbus devices are being probed=
 and matching VF devices found
2. VF devices are being configured with Rx=
 and Tx queue setup.
Any ideas what I might be doing wron=
g?
Regards,
Nandini


This electronic= communication and the information and any files transmitted with it, or at= tached to it, are confidential and are intended solely for the use of the i= ndividual or entity to whom it is addressed and may contain information that is confidential, legally privil= eged, protected by privacy laws, or otherwise restricted from disclosure to= anyone else. If you are not the intended recipient or the person responsib= le for delivering the e-mail to the intended recipient, you are hereby notified that any use, copying, dis= tributing, dissemination, forwarding, printing, or copying of this e-mail i= s strictly prohibited. If you received this e-mail in error, please return = the e-mail to the sender, delete it from your computer, and destroy any printed copy of it. <= u>


This ele= ctronic communication and the information and any files transmitted with it= , or attached to it, are confidential and are intended solely for the use o= f the individual or entity to whom it is addressed and may contain informat= ion that is confidential, legally privileged, protected by privacy laws, or= otherwise restricted from disclosure to anyone else. If you are not the in= tended recipient or the person responsible for delivering the e-mail to the= intended recipient, you are hereby notified that any use, copying, distrib= uting, dissemination, forwarding, printing, or copying of this e-mail is st= rictly prohibited. If you received this e-mail in error, please return the = e-mail to the sender, delete it from your computer, and destroy any printed= copy of it. --000000000000a17f1c061a28548f--