From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C3C20A046B for ; Sun, 21 Jul 2019 11:41:52 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 1FF3E4C96; Sun, 21 Jul 2019 11:41:52 +0200 (CEST) Received: from mail-qt1-f178.google.com (mail-qt1-f178.google.com [209.85.160.178]) by dpdk.org (Postfix) with ESMTP id 0296B2BC7 for ; Sun, 21 Jul 2019 11:41:49 +0200 (CEST) Received: by mail-qt1-f178.google.com with SMTP id l9so35469231qtu.6 for ; Sun, 21 Jul 2019 02:41:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=NLRF/qWqYgvUljckREXcZHHd649dTHLjS2pj0dFj2aU=; b=iBcANmAlMX8sRX+AGgkKf0+YqR7rySj3TXggVLD4QCO3rhZIJzS1gHNuadajDtFN46 CIth0szXhlYZDwkf0PZKpZCssNAL9Fmt77LXmJDKvNlMKTqTGdncpw8Mpk1/xeXOri2n aed7pfLfFgaSTP1d6g+2OD5STLwUYYPCj28qoIMvth/NSg6dXPpPp/1y12EbftXXnb+I mXDT7j1139yFHaHMwz3tS2wil/ft7VMzo4sqAqO5cgeVdBT9g8Tv/lnSFFvlXUMakztW 1B9z7wy1ZrRUGuym+5edBQMHq6fLbox6+mXReYF761t25bgeI7mvXJBkIoFUv0isENXA iSEA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=NLRF/qWqYgvUljckREXcZHHd649dTHLjS2pj0dFj2aU=; b=TIbu1PgyY3KAXWSeg3n1GWMdPszQ4cZ3bKiSl9xsZ8bpZCEFIwE+aSuf7Trd/5+iOp 8pi+IICR/MIGAYM1Pm1A7jUWeg9PTW87ROlpFwX1kFm2PI1MvdxArFOqhrwj6tODTvqX 1Vvpw+fcv/cASgCcsLk4biSMuIhAcVJJkGvDU8QB81RDZMwc7FWMhWIJUbiWy3X5S2BF S4FwH9h6umAMaPnt3gN4lsmHuJzvpkESe3VqZBwgaLy/4q9BT9XDISk1Mrnvi/qB6HL8 VU3g0kwQ0Wqp0Mv35qnUyD1EKibl4AzaHRLVTWCgmVRIm2uBrhaVedn7+Id2s4FRxydG LFdw== X-Gm-Message-State: APjAAAU4sP3gB3Kc00km+Th+fuLKnYFYARQgoqdMSXEIWVgmn0rjKAo7 dcDxaIE2xqSGPvmfttSLcrwyswgFnJd651nbLvogh+jn/Q8= X-Google-Smtp-Source: APXvYqzXDVGT9Z/5Zk3k49WoZv/2ZUXDQIZJK6EhafEvtTG5Dj3WxxQ4Eloax1NpMYN0nn0xzFstJs8zUdnS+jBKG+E= X-Received: by 2002:a0c:e6cb:: with SMTP id l11mr45279519qvn.136.1563702109240; Sun, 21 Jul 2019 02:41:49 -0700 (PDT) MIME-Version: 1.0 From: Anupama Laxmi Date: Sun, 21 Jul 2019 15:11:34 +0530 Message-ID: To: users Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] dpdk packet loss,delay, retransmission X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" I see delay in TCP packet transfer while transferring huge files using SSH/SCP. The delay is not seen with file sizes up to 35 MB. Beyond 35 MB there is delay due to TCP out of order /retransmission and packet loss. For file size 762835531 earlier it took 8 seconds for scp transfer now it takes ~~ 4 mins after DPDK upgrade. I suspected Small RX and TX queue size on NICs which are connected to DPDK is causing packet drops. 1. Increased TX queue and RX queue size as follows. RTE_TEST_RX_DESC_DEFAULT 128 RTE_TEST_TX_DESC_DEFAULT 512 to RTE_TEST_RX_DESC_DEFAULT 4096 RTE_TEST_TX_DESC_DEFAULT 4096 Saw little improvement. The time taken for scp reduced to 2mins and 30 seconds for file of size 762835531. 1. Tried to rate limit the TX rate using: rte_eth_set_queue_rate_limit API Not seeing much improvement. Please suggest ways to configure the mbuf,queue size to optimize the performance and reduce the delay and drop in packet transfer.