From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by dpdk.org (Postfix) with ESMTP id BFCFFF8C0 for ; Wed, 11 Jan 2017 18:29:46 +0100 (CET) Received: from orsmga005.jf.intel.com ([10.7.209.41]) by orsmga103.jf.intel.com with ESMTP; 11 Jan 2017 09:29:45 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.33,346,1477983600"; d="scan'208";a="51867089" Received: from fyigit-mobl1.ger.corp.intel.com (HELO [10.237.220.38]) ([10.237.220.38]) by orsmga005.jf.intel.com with ESMTP; 11 Jan 2017 09:29:44 -0800 To: Sergey Vyazmitinov References: <1483053795-8489-1-git-send-email-s.vyazmitinov@brain4net.com> Cc: dev@dpdk.org From: Ferruh Yigit Message-ID: <4316d3de-8159-fd34-8515-f82ba33b31e8@intel.com> Date: Wed, 11 Jan 2017 17:29:43 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <1483053795-8489-1-git-send-email-s.vyazmitinov@brain4net.com> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit Subject: Re: [dpdk-dev] [PATCH] kni: fast data availability check in thread_single loop X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jan 2017 17:29:47 -0000 On 12/29/2016 11:23 PM, Sergey Vyazmitinov wrote: > This allow to significant reduces packets processing latency. > > Signed-off-by: Sergey Vyazmitinov > --- > .../linuxapp/eal/include/exec-env/rte_kni_common.h | 6 ++++ > lib/librte_eal/linuxapp/kni/kni_misc.c | 33 ++++++++++++++++------ > 2 files changed, 30 insertions(+), 9 deletions(-) > > diff --git a/lib/librte_eal/linuxapp/eal/include/exec-env/rte_kni_common.h b/lib/librte_eal/linuxapp/eal/include/exec-env/rte_kni_common.h > index 09713b0..8183a8e 100644 > --- a/lib/librte_eal/linuxapp/eal/include/exec-env/rte_kni_common.h > +++ b/lib/librte_eal/linuxapp/eal/include/exec-env/rte_kni_common.h > @@ -109,6 +109,12 @@ struct rte_kni_fifo { > void *volatile buffer[]; /**< The buffer contains mbuf pointers */ > }; > > +static inline int > +kni_fifo_empty(struct rte_kni_fifo *fifo) > +{ > + return fifo->write == fifo->read; > +} > + > /* > * The kernel image of the rte_mbuf struct, with only the relevant fields. > * Padding is necessary to assure the offsets of these fields > diff --git a/lib/librte_eal/linuxapp/kni/kni_misc.c b/lib/librte_eal/linuxapp/kni/kni_misc.c > index 497db9b..4bf9bfa 100644 > --- a/lib/librte_eal/linuxapp/kni/kni_misc.c > +++ b/lib/librte_eal/linuxapp/kni/kni_misc.c > @@ -45,6 +45,7 @@ MODULE_AUTHOR("Intel Corporation"); > MODULE_DESCRIPTION("Kernel Module for managing kni devices"); > > #define KNI_RX_LOOP_NUM 1000 > +#define KNI_RX_DATA_LOOP_NUM 2500 > > #define KNI_MAX_DEVICES 32 > > @@ -129,25 +130,39 @@ static struct pernet_operations kni_net_ops = { > #endif > }; > > -static int > -kni_thread_single(void *data) > +static inline void > +kni_thread_single_rx_data_loop(struct kni_net *knet) > { > - struct kni_net *knet = data; > - int j; > struct kni_dev *dev; > + int i; > > - while (!kthread_should_stop()) { > - down_read(&knet->kni_list_lock); > - for (j = 0; j < KNI_RX_LOOP_NUM; j++) { > - list_for_each_entry(dev, &knet->kni_list_head, list) { > + for (i = 0; i < KNI_RX_DATA_LOOP_NUM; ++i) { When there are multiple KNI interfaces, and lets assume there is traffic too, this will behave like: KNI1x2500 data_packets + KNI2x2500 data_packets .... KNI10x2500 After data packets, KNI1 resp_packet + KNI2 resp_packets ... Won't this scenario also may cause latency? And perhaps jitter according KNI interface traffic loads? This may be good for some use cases, but not sure if this is good for all. > + list_for_each_entry(dev, &knet->kni_list_head, list) { > + /* Burst dequeue from rx_q */ > + if (!kni_fifo_empty((struct rte_kni_fifo *)dev->rx_q)) { Do we need this check, since first thing in kni_net_rx_normal() is checking if there is item in the queue? > #ifdef RTE_KNI_VHOST > kni_chk_vhost_rx(dev); > #else > kni_net_rx(dev); > #endif > - kni_net_poll_resp(dev); > } > } > + } > + list_for_each_entry(dev, &knet->kni_list_head, list) { > + kni_net_poll_resp(dev); > + } > +} > + > +static int > +kni_thread_single(void *data) > +{ > + struct kni_net *knet = data; > + int j; > + > + while (!kthread_should_stop()) { > + down_read(&knet->kni_list_lock); > + for (j = 0; j < KNI_RX_LOOP_NUM; j++) > + kni_thread_single_rx_data_loop(knet); > up_read(&knet->kni_list_lock); > #ifdef RTE_KNI_PREEMPT_DEFAULT > /* reschedule out for a while */ >