From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wi0-f182.google.com (mail-wi0-f182.google.com [209.85.212.182]) by dpdk.org (Postfix) with ESMTP id 21ADE68BF for ; Thu, 18 Dec 2014 11:33:47 +0100 (CET) Received: by mail-wi0-f182.google.com with SMTP id h11so1287966wiw.3 for ; Thu, 18 Dec 2014 02:33:47 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=AmVqVNj29watDKD8yYDUa1ZxeRCX3j8UR1c11n25G2U=; b=G4pmHBn5oynSD3wrj6/0cEOz27xS/QspjyaF9x6Gpv3QWEHh5MFltfg9v7ezg3cMoo ZFpU0ehoWsVGYYBSIQPQ0od6daTi7LXQIy+X9NWobwAmbb87LMV0M+sY4osTJcn+4YiP vlzkMmOPuSAt6xBXan9Zd2FML9o9KFQcpX13zMyIktHRszpeZrNfXDiAk7h8cMs5OtI5 kBzwBVKiluYzJKIH0PY/epG4vr+QJYHmRHZw72ncO//2x0AAdnFTKchSAH31PpXicyWJ rV9c4hjBQWSwWQXAWq3enyWML6JiMceF2gCpJtDD/hWNqKE4qD/NPWsHDKChWd4vTkRc vI9A== X-Gm-Message-State: ALoCoQm4LKc8STVnlskqkuPrD432mM5X66ZHrN6yGhTdaZXwr87HzChSTjQ+h5JTULYL+b4UJQ+q X-Received: by 10.180.221.72 with SMTP id qc8mr23262152wic.19.1418898826928; Thu, 18 Dec 2014 02:33:46 -0800 (PST) Received: from [10.0.0.165] (system.cloudius-systems.com. [84.94.198.183]) by mx.google.com with ESMTPSA id mo12sm8391559wjc.35.2014.12.18.02.33.45 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 18 Dec 2014 02:33:46 -0800 (PST) Message-ID: <5492AD87.8080401@cloudius-systems.com> Date: Thu, 18 Dec 2014 12:33:43 +0200 From: Vlad Zolotarov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.3.0 MIME-Version: 1.0 To: "Ouyang, Changchun" , Thomas Monjalon References: <6168753.p4Vk7dlKkK@xps13> <5490516C.8090202@cloudius-systems.com> <549142F1.2060307@cloudius-systems.com> In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: "dev@dpdk.org" , Avi Kivity , Gleb Natapov Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Dec 2014 10:33:47 -0000 On 12/18/14 03:32, Ouyang, Changchun wrote: > Hi > >> -----Original Message----- >> From: Vlad Zolotarov [mailto:vladz@cloudius-systems.com] >> Sent: Wednesday, December 17, 2014 4:47 PM >> To: Ouyang, Changchun; Thomas Monjalon >> Cc: dev@dpdk.org; Avi Kivity; Gleb Natapov >> Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD >> >> >> On 12/17/14 03:03, Ouyang, Changchun wrote: >>> Hi , >>> >>>> -----Original Message----- >>>> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Vlad Zolotarov >>>> Sent: Tuesday, December 16, 2014 11:36 PM >>>> To: Thomas Monjalon >>>> Cc: dev@dpdk.org; Avi Kivity; Gleb Natapov >>>> Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD >>>> >>>> >>>> On 12/15/14 22:33, Thomas Monjalon wrote: >>>>> 2014-12-15 21:11, Vladislav Zolotarov: >>>>>> Hi, >>>>>> I'm running an ixgbevf PMD on an AWS guests with extended >>>>>> networking (SR-IOV functions of 82599 Intel's NIC) and noticed that >>>>>> even in the current git tree there is no support for a multi-queue in this >> PMD: >>>>>> reta size returned by rte_eth_dev_info_get() call is 0, while >>>>>> max_rx_queues and max_tx_queues are both 4. >>>>>> >>>>>> Linux ixgbevf-2.15.3 driver on the other hand successfully >>>>>> initializes 2 RSS queues: for some reason it always limits the >>>>>> number of >>>> RSS queues by 2. >>>>>> ixgbevf_main.c: line 2539 >>>>>> u16 rss = min_t(u16, num_online_cpus(), 2); >>>>>> >>>>>> The above is strange since if MRQE is set to 1010b there are 4 RSS >>>>>> queues available which seems to be the case in my AWS Guest. >>>>>> >>>>>> However, let's get back to DPDK. As I've mentioned above the SR-IOV >>>>>> function i have is RSS capable (to be 100% sure I've verified both >>>>>> queues are receiving packets in a multi-socket TCP test). And it's >>>>>> a shame I can't utilize it with a DPDK. >>>>> Yes, it is not yet supported. >>>>> But a patch was recently sent: >>>>> http://dpdk.org/ml/archives/dev/2014-December/010028.html >>>> Applying this patchset seems to break the NIC fast path functionality >>>> of a AWS Guest NIC. >>>> I'm still debugging it - will update u as soon as I have more specific info. >> Hi, thanks for tips but I have a question below. >> >>> Pls make sure enabling and using 4 queues on guest >> Why should I enable all 4? Won't any number below or equal 4 work if (!) >> 4 queues are available? >> Note that there is a 82599 mode when only 2 RSS queues are available per >> VF: MRQE=1011b. >> > Yes you are right, it could be 2 queues, the actual queue number per VF depends on the number of VF: > VF number from 1~32: 4 queues per VF; > VF number from 33~64: 2 queues per VF; > The queue number is determined by the vf number at the pf init stage, > If pf setup 4 queues for each vf and distribute packets to 4 queues, but vf only poll 1 or 2 queue, > Then packets in other queues will be lost. > You can try to poll 4 queues firstly to debug your issue. Sure. When I hardcoded the queues number to 4 all works like a charm. The problem is that we can't leave it this way. I've posted some comments to your patches (0 and 5). Since I've joined the list after the patches have been sent I had to paste the patches bodies into my email and they will most like not appear in the thread of the original series. I hope this won't be a big problem... ;) vlad > Thanks > Changchun >