From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx0b-00169c01.pphosted.com (mx0b-00169c01.pphosted.com [67.231.156.123]) by dpdk.org (Postfix) with ESMTP id 0BA9D68BF for ; Thu, 18 Dec 2014 23:39:26 +0100 (CET) Received: from pps.filterd (m0048188.ppops.net [127.0.0.1]) by mx0b-00169c01.pphosted.com (8.14.5/8.14.5) with SMTP id sBIMXJXN020949; Thu, 18 Dec 2014 14:39:26 -0800 Received: from webmail.paloaltonetworks.com (webmail.paloaltonetworks.com [199.167.52.51]) by mx0b-00169c01.pphosted.com with ESMTP id 1raw9phmyf-1 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NOT); Thu, 18 Dec 2014 14:39:26 -0800 Received: from SJCCMBXPW01P.paloaltonetworks.local ([169.254.3.157]) by sjcchtcpw02p.paloaltonetworks.local ([fe80::7861:72d4:890a:8853%13]) with mapi id 14.03.0158.001; Thu, 18 Dec 2014 14:39:24 -0800 From: Anant Mudambi To: Bruce Richardson , "Ouyang, Changchun" Thread-Topic: [dpdk-dev] Using multi-queue with RSS on X540 VF Thread-Index: AQHQFnZZdLN4Jibenk+QOn8IkHcBV5yRAkcAgAABZ4CABPZdgA== Date: Thu, 18 Dec 2014 22:39:24 +0000 Message-ID: References: <20141215104739.GA11332@bricha3-MOBL3> <20141215105240.GB11332@bricha3-MOBL3> In-Reply-To: <20141215105240.GB11332@bricha3-MOBL3> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.35.11.157] Content-Type: text/plain; charset="iso-8859-1" Content-ID: Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10432:5.13.68, 1.0.33, 0.0.0000 definitions=2014-12-18_07:2014-12-18,2014-12-18,1970-01-01 signatures=0 X-Proofpoint-Spam-Details: rule=outbound_spam_notspam policy=outbound_spam score=0 kscore.is_bulkscore=0 kscore.compositescore=0 circleOfTrustscore=0 compositescore=0.100216192075479 urlsuspect_oldscore=0.924392716097457 suspectscore=0 recipient_domain_to_sender_totalscore=0 phishscore=0 bulkscore=0 kscore.is_spamscore=0 recipient_to_sender_totalscore=0 recipient_domain_to_sender_domain_totalscore=889 rbsscore=0.100216192075479 spamscore=0 recipient_to_sender_domain_totalscore=0 urlsuspectscore=0.9 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=7.0.1-1402240000 definitions=main-1412180216 Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] Using multi-queue with RSS on X540 VF X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Dec 2014 22:39:27 -0000 Thanks Bruce.=20 Hi Changchun, I looked at your patch set and have some questions about it. I might be missing something basic. - How is the RTE_ETH_DEV_SRIOV(rte_eth_dev *).active set for VF ports (in guest using ixgbevf PMD)? The only place I saw this field being set is in ixgbe_pf_host_init() but this is not called from eth_ixgbevf_dev_init(), only from eth_ixgbe_dev_init(). - Your patch includes some changes to ixgbe_dev_mq_rx_configure() to support VF RSS, but this function is not called from the ixgbevf PMD, only from ixgbe PMD? - Do you know if RSS on VF (using DPDK PMD) works with Linux ixgbe PF driver on host? What parameters does the PF driver need to be loaded with? Thanks, Anant On 12/15/14 2:52 AM, "Bruce Richardson" wrote: >On Mon, Dec 15, 2014 at 10:47:40AM +0000, Bruce Richardson wrote: >> On Sat, Dec 13, 2014 at 01:44:36AM +0000, Anant Mudambi wrote: >> > Hi all, >> > I am using DPDK 1.7.0. >> > Qemu-KVM system with the Intel 10G X540 NIC; host has the Linux ixgbe >>PF driver and a guest is using a VF with the DPDK ixgbevf PMD (uio). >> > I am trying to configure multiple (2 for now) receive queues on the >>VF and use RSS. >> > I see packets coming only to queue 0 for some reason. Some questions >>about this: >> >=20 >> > 1] I see that most of the initial configuration to make multi-queue + >>RSS work is done in ixgbe_dev_mq_rx_configure() >> > [e.g. Setting up the redirect table and the MRQC register]. >>However, only the non-VF ixgbe_dev_rx_init() calls the above function; >> > ixgbevf_dev_rx_init() doesn't configure RSS-related hardware. >>Don't we need to do this configuration to use RSS on a VF? >> > 2] Even after configuring the RSS-related hardware in ixgbevf PMD, >>packets only come to queue 0. I printed out the RSS-type and >>RSS-hash-value >> > fields from the write back Rx descriptor and they are both set >>to 0. So for some reason no RSS hash is being done for any packets. >> > 3] Has anyone seen this kind of configuration work (multi-queue + RSS >>+ VF)? I have an X540 NIC but has this worked on any other NIC for >>anyone? >> > 4] Also any ideas on how to debug this problem further? >> >=20 >> > Thanks, >> > Anant >>=20 >> RSS redirection of traffic in a VF is not supported by the hardware, so >>you are >> pretty much stuck with all VF traffic going to queue 0. [Later >>hardware, such as >> 4x10G NICs e.g. "Intel=AE Ethernet Converged Network Adapters XL710" >>using the >> i40e driver should support RSS with VFs] >>=20 >> /Bruce > >Actually, I see Changchun has posted a patch giving support for RSS use >with VF's >so apparently some functionality is possible with 10G NICs such as the >x540. There >may be some limitations with it, however, but I'll defer any further >explanation >to him. :-) > >/Bruce