From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id E5586A0679 for ; Fri, 5 Apr 2019 22:08:22 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id BAE531B589; Fri, 5 Apr 2019 22:08:22 +0200 (CEST) Received: from mail.altencalsoftlabs.com (mail.altencalsoftlabs.com [182.73.72.41]) by dpdk.org (Postfix) with ESMTP id 69E7734F3 for ; Thu, 4 Apr 2019 09:25:12 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by mail.altencalsoftlabs.com (Postfix) with ESMTP id A0DF74420EA7 for ; Thu, 4 Apr 2019 12:55:11 +0530 (IST) Received: from mail.altencalsoftlabs.com ([127.0.0.1]) by localhost (mail.altencalsoftlabs.com [127.0.0.1]) (amavisd-new, port 10032) with ESMTP id 4OfeANcNR6n3 for ; Thu, 4 Apr 2019 12:55:11 +0530 (IST) Received: from localhost (localhost [127.0.0.1]) by mail.altencalsoftlabs.com (Postfix) with ESMTP id E9A574420EB9 for ; Thu, 4 Apr 2019 12:55:10 +0530 (IST) DKIM-Filter: OpenDKIM Filter v2.10.3 mail.altencalsoftlabs.com E9A574420EB9 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=altencalsoftlabs.com; s=selector; t=1554362710; bh=ROx4L4qpV6JfwxDijwHElfDVxTd6I2UolnQl3z7VTv4=; h=To:From:Message-ID:Date:MIME-Version; b=Wp54FaYW8IfWWwGufGSAv2gD8AHht3pFvMZswXtWeXwPdP287HDLMRRiPTiBR+Gka IvOBZ7HjKO8KOSpnjMAQno/8ytR1aNDTAVVZFCOGNEYg2abf8yzPTvWEtTTIaqtWob HJmW5sPnIAx5ore5Z/nlxRGNgtOdtfLlR5TXjoeY= X-Virus-Scanned: amavisd-new at altencalsoftlabs.com Received: from mail.altencalsoftlabs.com ([127.0.0.1]) by localhost (mail.altencalsoftlabs.com [127.0.0.1]) (amavisd-new, port 10026) with ESMTP id x6Q1udWM7xRA for ; Thu, 4 Apr 2019 12:55:10 +0530 (IST) Received: from [172.23.103.233] (unknown [10.1.0.4]) by mail.altencalsoftlabs.com (Postfix) with ESMTPSA id C919E4420EA7 for ; Thu, 4 Apr 2019 12:55:10 +0530 (IST) References: <9279c2f3-195c-0034-48e6-4246eee428a9@altencalsoftlabs.com> To: users@dpdk.org From: Sharon X-Forwarded-Message-Id: <9279c2f3-195c-0034-48e6-4246eee428a9@altencalsoftlabs.com> Message-ID: <9beaa13f-239a-5361-81ea-20d5237bf1be@altencalsoftlabs.com> Date: Thu, 4 Apr 2019 12:55:10 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.2.1 MIME-Version: 1.0 In-Reply-To: <9279c2f3-195c-0034-48e6-4246eee428a9@altencalsoftlabs.com> Content-Language: en-US X-Mailman-Approved-At: Fri, 05 Apr 2019 22:08:21 +0200 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Tx burst getting failed with Virtio driver X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi, With a dpdk based application inside GCP VM instance, it is observed that while sending UDP packets of length 1300 at around 6=20 Gbps rate, tx burst starts failing frequently. On enabling virtio pmd logs, following error is found: PMD: virtio_xmit_pkts() tx: No free tx descriptors to transmit *VM configuration:* Cores: Total 12 cores, 5 cores for the application OS: CentOS 7.2.1511 Linux kernel : 3.10.0-327.13.1.el7.x86_64 DPDK version : 17.05* * *Ring configuration in application:* TX descriptor ring size: 4096 RX descriptor ring size: 1024 4 cores for rx and tx in a run to completion model. Single port is used for Rx and Tx. lcore to queue mapping is 1:1, i.e 1rx queue and 1tx queue per lcore *ethtool -g eth0* Ring parameters for eth0: Pre-set maximums: RX:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 4096 RX Mini:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0 RX Jumbo:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0 TX:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 4096 Current hardware settings: RX:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 4096 RX Mini:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =C2=A0 =C2=A0 0 RX Jumbo:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0 TX:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= 4096 *lscpu* Architecture:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0 x86_64 CPU op-mode(s): =C2=A0 =C2=A0=C2=A0 32-bit, 64-bit Byte Order:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Little Endian CPU(s):=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 12 On-line CPU(s) list:=C2=A0=C2=A0=C2=A0 0-11 Thread(s) per core:=C2=A0 2 Core(s) per socket:=C2=A0=C2=A0 6 Socket(s):=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1 NUMA node(s):=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 1 Vendor ID: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 GenuineIntel CPU family:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 6 Model:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 85 Model name:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 I= ntel(R) Xeon(R) CPU @ 2.00GHz Stepping:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 3 CPU MHz:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 2000.168 BogoMIPS:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 4000.33 Hypervisor vendor: KVM Virtualization type:=C2=A0 full L1d cache:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 32K L1i cache:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0 32K L2 cache:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 256K L3 cache:=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 56320K NUMA node0 CPU(s): 0-11 *NIC stats is provided below:* 100330695 packets input, 141154589263 bytes 100310198 packets output, 136450396190 bytes 0 packets missed 0 erroneous packets received 0 multicast packets received 0 failed transmitted packets 0 No Mbufs Stats reg 0 RX-packets: 23454090 RX-errors: 0 RX-bytes: 32948589715 Stats reg 1 RX-packets: 23954850 RX-errors: 0 RX-bytes: 33699067521 Stats reg 2 RX-packets: 26014919 RX-errors: 0 RX-bytes: 36614183404 Stats reg 3 RX-packets: 26906836 RX-errors: 0 RX-bytes: 37892748623 Stats reg 0 TX-packets: 23450529 TX-bytes: 31934107195 Stats reg 1 TX-packets: 23951340 TX-bytes: 32591951998 Stats reg 2 TX-packets: 26008018 TX-bytes: 35366748482 Stats reg 3 TX-packets: 26900311 TX-bytes: 36557588515 Increasing the number of cores for the application is also not helping=20 in this case. Kindly suggest as what needs to be done to improve the performance and=20 avoid this issue. Thanks & Regards, Sharon T N