From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga03.intel.com (mga03.intel.com [134.134.136.65]) by dpdk.org (Postfix) with ESMTP id 41CF46848 for ; Fri, 19 Dec 2014 02:18:04 +0100 (CET) Received: from orsmga002.jf.intel.com ([10.7.209.21]) by orsmga103.jf.intel.com with ESMTP; 18 Dec 2014 17:15:40 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.07,604,1413270000"; d="scan'208";a="656787121" Received: from pgsmsx101.gar.corp.intel.com ([10.221.44.78]) by orsmga002.jf.intel.com with ESMTP; 18 Dec 2014 17:18:00 -0800 Received: from shsmsx103.ccr.corp.intel.com (10.239.4.69) by PGSMSX101.gar.corp.intel.com (10.221.44.78) with Microsoft SMTP Server (TLS) id 14.3.195.1; Fri, 19 Dec 2014 09:17:59 +0800 Received: from shsmsx102.ccr.corp.intel.com ([169.254.2.216]) by SHSMSX103.ccr.corp.intel.com ([169.254.4.240]) with mapi id 14.03.0195.001; Fri, 19 Dec 2014 09:17:58 +0800 From: "Ouyang, Changchun" To: Vlad Zolotarov , Thomas Monjalon Thread-Topic: [dpdk-dev] DPDK RSS support for ixgbevf PMD Thread-Index: AQHQGKRZnn+TSM/iH0ScjhVL4Ef+MpyQlUIAgAE/YwCAASIaUP///dCAgAGb5hCAABRWgIABfM5Q Date: Fri, 19 Dec 2014 01:17:56 +0000 Message-ID: References: <6168753.p4Vk7dlKkK@xps13> <5490516C.8090202@cloudius-systems.com> <549142F1.2060307@cloudius-systems.com> <5492AD87.8080401@cloudius-systems.com> In-Reply-To: <5492AD87.8080401@cloudius-systems.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "dev@dpdk.org" , Avi Kivity , Gleb Natapov Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Dec 2014 01:18:04 -0000 Hi , > -----Original Message----- > From: Vlad Zolotarov [mailto:vladz@cloudius-systems.com] > Sent: Thursday, December 18, 2014 6:34 PM > To: Ouyang, Changchun; Thomas Monjalon > Cc: dev@dpdk.org; Avi Kivity; Gleb Natapov > Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD >=20 >=20 > On 12/18/14 03:32, Ouyang, Changchun wrote: > > Hi > > > >> -----Original Message----- > >> From: Vlad Zolotarov [mailto:vladz@cloudius-systems.com] > >> Sent: Wednesday, December 17, 2014 4:47 PM > >> To: Ouyang, Changchun; Thomas Monjalon > >> Cc: dev@dpdk.org; Avi Kivity; Gleb Natapov > >> Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD > >> > >> > >> On 12/17/14 03:03, Ouyang, Changchun wrote: > >>> Hi , > >>> > >>>> -----Original Message----- > >>>> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Vlad > Zolotarov > >>>> Sent: Tuesday, December 16, 2014 11:36 PM > >>>> To: Thomas Monjalon > >>>> Cc: dev@dpdk.org; Avi Kivity; Gleb Natapov > >>>> Subject: Re: [dpdk-dev] DPDK RSS support for ixgbevf PMD > >>>> > >>>> > >>>> On 12/15/14 22:33, Thomas Monjalon wrote: > >>>>> 2014-12-15 21:11, Vladislav Zolotarov: > >>>>>> Hi, > >>>>>> I'm running an ixgbevf PMD on an AWS guests with extended > >>>>>> networking (SR-IOV functions of 82599 Intel's NIC) and noticed > >>>>>> that even in the current git tree there is no support for a > >>>>>> multi-queue in this > >> PMD: > >>>>>> reta size returned by rte_eth_dev_info_get() call is 0, while > >>>>>> max_rx_queues and max_tx_queues are both 4. > >>>>>> > >>>>>> Linux ixgbevf-2.15.3 driver on the other hand successfully > >>>>>> initializes 2 RSS queues: for some reason it always limits the > >>>>>> number of > >>>> RSS queues by 2. > >>>>>> ixgbevf_main.c: line 2539 > >>>>>> u16 rss =3D min_t(u16, num_online_cpus(), 2); > >>>>>> > >>>>>> The above is strange since if MRQE is set to 1010b there are 4 > >>>>>> RSS queues available which seems to be the case in my AWS Guest. > >>>>>> > >>>>>> However, let's get back to DPDK. As I've mentioned above the > >>>>>> SR-IOV function i have is RSS capable (to be 100% sure I've > >>>>>> verified both queues are receiving packets in a multi-socket TCP > >>>>>> test). And it's a shame I can't utilize it with a DPDK. > >>>>> Yes, it is not yet supported. > >>>>> But a patch was recently sent: > >>>>> http://dpdk.org/ml/archives/dev/2014-December/010028.html > >>>> Applying this patchset seems to break the NIC fast path > >>>> functionality of a AWS Guest NIC. > >>>> I'm still debugging it - will update u as soon as I have more specif= ic info. > >> Hi, thanks for tips but I have a question below. > >> > >>> Pls make sure enabling and using 4 queues on guest > >> Why should I enable all 4? Won't any number below or equal 4 work if > >> (!) > >> 4 queues are available? > >> Note that there is a 82599 mode when only 2 RSS queues are available > >> per > >> VF: MRQE=3D1011b. > >> > > Yes you are right, it could be 2 queues, the actual queue number per VF > depends on the number of VF: > > VF number from 1~32: 4 queues per VF; > > VF number from 33~64: 2 queues per VF; > > The queue number is determined by the vf number at the pf init stage, > > If pf setup 4 queues for each vf and distribute packets to 4 queues, > > but vf only poll 1 or 2 queue, Then packets in other queues will be los= t. > > You can try to poll 4 queues firstly to debug your issue. >=20 > Sure. When I hardcoded the queues number to 4 all works like a charm. > The problem is that we can't leave it this way. I've posted some comments= to > your patches (0 and 5). Since I've joined the list after the patches have= been > sent I had to paste the patches bodies into my email and they will most l= ike > not appear in the thread of the original series. > I hope this won't be a big problem... ;) >=20 Yes, I have seen your comments there, and respond it already, let's use tha= t thread to discuss from now on. Thanks Changchun