[dpdk-users] Can't enable RSS in DPDK with MLX5

[dpdk-users] Can't enable RSS in DPDK with MLX5

[MAC Lee]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=UTF-8, Size: 10399 bytes --]

Hi All,
    I encounter a problem when enable RSS in DPDK( I am using 16.04 with OFED 3.3-1.0.4.0) using MLX5 PMD. I tried to enable RSS function in my DPDK application by setting 1.  .rxmode.mq_mode = ETH_MQ_RX_RSS, 2.  .rx_adv_conf.rss_conf.rss_hf = ETH_RSS_PROTO_MASK with RSS key length 40,//I also try ETH_RSS_IPV4 and ETH_RSS_NONFRAG_IPV4_UDP, but still no luck3. update the reta using rte_eth_dev_rss_reta_update
however, when I print out the mbuf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss after rte_eth_rx_burst(). All of these values are 0.
I also test the RSS using Testpmd and modify the testpmd to print those value after  rte_eth_rx_burst(). But still bad luck,  I still got all 0. What I did using Testpmd:1. testpmd -c 0x3f -n 4 -w 06:00.0,txq_inline=200 -- --burst=64 --txd=4096 --rxd=1024 --mbcache=512 --rxq=4 --txq=4 --nb-cores=4 --rss-udp --i2. testpmd>stop3. testpmd>set fwd rxonly4. testpmd> port config all rss udp5. testpmd>start6. Then pump traffic using packet generator and monitor the print out of buf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss in testpmdMay I know how can I enable the RSS function in DPDK application using MLX5 PMD?
Best Regards,Marco
From mac_leehk@yahoo.com.hk  Tue Sep 13 09:44:23 2016
Return-Path: <mac_leehk@yahoo.com.hk>
Received: from nm25-vm9.bullet.mail.sg3.yahoo.com
 (nm25-vm9.bullet.mail.sg3.yahoo.com [106.10.151.104])
 by dpdk.org (Postfix) with ESMTP id 23FB75684
 for <users@dpdk.org>; Tue, 13 Sep 2016 09:44:21 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com.hk; s=s2048;
 t\x1473752660; bh=n543+EULOZPo9tTxdnAbV7hVr0iZ1tQKwa6Svgih7kY=;
 hÚte:From:Reply-To:To:Subject:References:From:Subject;
 b=Fxa1F64xokf/9RiN53nkSppukLBkOxl0/VWQYYCUX5vJEr5QcFUHdKzxXM8yiRiJ50rreou2gUYysYl7oENTSOHXY+gLydAN7MCfLHDDmPoF9hmvXGSxp8+DuhTFQA1i3XgT+Ibe0DH0HfR+MnZ4yh1y7zozfxVOKQlUqWFAtc7qU0+zx7ayCeeY5UX8nT9k+cm6qLNAAZTQPgp/ffeHM11PWJXai24DDcTmzQJG2gEx0RSpo0S497g4gqrLTM58IlE71get+3PdiGceeBTBkQOYiL3uKDLJ0KvxQ/UjFGL1RdxS2QNjIqk2AMGvt4guYTYjzy7IKvs4j54sv9v50g=Received: from [106.10.166.63] by nm25.bullet.mail.sg3.yahoo.com with NNFMP;
 13 Sep 2016 07:44:20 -0000
Received: from [106.10.151.155] by tm20.bullet.mail.sg3.yahoo.com with NNFMP;
 13 Sep 2016 07:44:19 -0000
Received: from [127.0.0.1] by omp1009.mail.sg3.yahoo.com with NNFMP;
 13 Sep 2016 07:44:19 -0000
X-Yahoo-Newman-Property: ymail-3
X-Yahoo-Newman-Id: 917518.91761.bm@omp1009.mail.sg3.yahoo.com
X-YMail-OSG: jsq7QWcVM1lqFoSkIxkKA7QvWNVtNBKlag3jkT1N3XEqpkvHBk9n.ps.Yq.XBot
 jY0MgftSsSFeZ4PucZP6X0EPnm342VRiGi50JI863B3oO1IWFoFM8LBCeRIT3TZH23YbfgBHqk8F
 Cfi5MFxbIQ1p4IPxg9ydKtAuyMACcoQoE_Zi0_Z4YrA7wa_WH5mxQN6R0YiZ5swBWRmxBwESWUG.
 1zdg9sMclFjUGk3wf.mMlkYl0SbdKNnuA7_fafpshwzMz0KBpU9LBLuFp.vyoC_0DJ3oW1CmK5r1
 TtF8L4UEHE70haIbzmU6gU0VFdDp5gSHk_KrS6Vn_9UsJ8eyFH5tWg9PplbKCYGhHJmBE9m8kYuh
 U4YKGRwMUTQeQQykP1OkJJfjQrARgUyxz1dWCh62d.U6FkkMLqqb211MaTUMyUOgW3VZ2Mnf8tBq
 JulyREVCzzpM6d24XsTdOO1Bx769ye2KWwvnbx97xtDQ0b.54w9c879uHSsA0KSlq9sGAJYZI1J2
 BAFHA_.IarLoiUksA4Z2mePvr5tc-
Received: from jws10950.mail.sg3.yahoo.com by
 sendmailws101b.mail.sg3.yahoo.com; Tue, 13 Sep 2016 07:44:19 +0000;
 1473752659.525
Date: Tue, 13 Sep 2016 07:44:19 +0000 (UTC)
From: MAC Lee <mac_leehk@yahoo.com.hk>
To: "users@dpdk.org" <users@dpdk.org>
Message-ID: <1831596038.240091.1473752659296@mail.yahoo.com>
MIME-Version: 1.0
References: <1831596038.240091.1473752659296.ref@mail.yahoo.com>
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: [dpdk-users] Can't enable RSS in DPDK with MLX5
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: MAC Lee <mac_leehk@yahoo.com.hk>
List-Id: usage discussions <users.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Sep 2016 07:44:23 -0000


Hi All,    I encounter a problem when enable RSS in DPDK( I am using 16.04 with OFED 3.3-1.0.4.0) using MLX5 PMD. I tried to enable RSS function in my DPDK application by setting 1.  .rxmode.mq_mode = ETH_MQ_RX_RSS, 2.  .rx_adv_conf.rss_conf.rss_hf = ETH_RSS_PROTO_MASK with RSS key length 40,//I also try ETH_RSS_IPV4 and ETH_RSS_NONFRAG_IPV4_UDP, but still no luck3. update the reta using rte_eth_dev_rss_reta_update
however, when I print out the mbuf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss after rte_eth_rx_burst(). All of these values are 0.
I also test the RSS using Testpmd and modify the testpmd to print those value after  rte_eth_rx_burst(). But still bad luck,  I still got all 0. What I did using Testpmd:1. testpmd -c 0x3f -n 4 -w 06:00.0,txq_inline=200 -- --burst=64 --txd=4096 --rxd=1024 --mbcache=512 --rxq=4 --txq=4 --nb-cores=4 --rss-udp --i2. testpmd>stop3. testpmd>set fwd rxonly4. testpmd> port config all rss udp5. testpmd>start6. Then pump traffic using packet generator and monitor the print out of buf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss in testpmdMay I know how can I enable the RSS function in DPDK application using MLX5 PMD?
Best Regards,Marco
From thomas.monjalon@6wind.com  Tue Sep 13 11:03:40 2016
Return-Path: <thomas.monjalon@6wind.com>
Received: from mail-wm0-f44.google.com (mail-wm0-f44.google.com [74.125.82.44])
 by dpdk.org (Postfix) with ESMTP id 09140591F
 for <users@dpdk.org>; Tue, 13 Sep 2016 11:03:40 +0200 (CEST)
Received: by mail-wm0-f44.google.com with SMTP id c131so100498720wmh.0
 for <users@dpdk.org>; Tue, 13 Sep 2016 02:03:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=6wind-com.20150623.gappssmtp.com; s 150623;
 h=from:to:cc:subject:date:message-id:user-agent:in-reply-to
 :references:mime-version:content-transfer-encoding;
 bh=P6GldYiXxcKpJOE3XeoLAxX7PthKZeehXQ3bXOUGZ+k=;
 b=qbwcngehQY0HIaHnm7DEUVvAcEzg+XCiC+WUAmSm0UYrlcuWLpzWhNwOs4+CUgmkpd
 pYfvX5/wpnjpiykiboP/hPccBsdOsLZuJAQ9rO1RVQ6x2YPPXK4709X2c+mSI2t/ZCaN
 BmgF3jSSDp+puuXfySbAOn16820UU9aPxkWkmfOcg1kVUTJ34YX98PBwFJaY+Ch18vE0
 DyPGTbcF4w3Q9dJnhAlzpUmHYS85RV7TghGazp3cRuWyF3vsQtR9A3+pVOl5XR+24kgX
 5MutfWWDRtoiQZbkvjrvbZRdBKn6VWsTcR+YPQwH95HmkjtyKAUKMxzgHND6kVs3r8e7
 f6nw=X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d\x1e100.net; s 130820;
 h=x-gm-message-state:from:to:cc:subject:date:message-id:user-agent
 :in-reply-to:references:mime-version:content-transfer-encoding;
 bh=P6GldYiXxcKpJOE3XeoLAxX7PthKZeehXQ3bXOUGZ+k=;
 b=KlMLwWpSU02zsjAUwEOlnVK+wxqXi5leLpHZ7hfOaTkLmiddQUIil8mi0P5WW4pnG+
 BUW7pSwJLvjJ064W528upWOIGitfYaqoDtuezg6btjqGcg8bLWfIjiQjX1dwC1v8O9/s
 h5mhFhE8GHoidi2N6M2ZVYhOL6sqVSsY6SP19zSpiAANofzJzNohFARAwqUotrRLoBW5
 mjumgKOhrj1YJVYv7lMfwDtaxMHxnh1+utqCFkiB4ba4Fm6OXeInKW3TZmh8gVAXMPtM
 PeEgPOtNN+dlRzPQBVUEE1CWZH5MLvr2kwj1rNekuWa99vLevLX0PG/ATWe31tgjbXBH
 olSg=X-Gm-Message-State: AE9vXwMB0drwUxxwBVHQtgOkCYBIqrxfRAuwRrlgvjX53Tg3s1t+4zLx1W0W0hDbpo2Jy1hF
X-Received: by 10.194.133.104 with SMTP id pb8mr19242814wjb.139.1473757419663;
 Tue, 13 Sep 2016 02:03:39 -0700 (PDT)
Received: from xps13.localnet (184.203.134.77.rev.sfr.net. [77.134.203.184])
 by smtp.gmail.com with ESMTPSA id i131sm16487990wmg.10.2016.09.13.02.03.38
 (version=TLS1_2 cipherìDHE-RSA-AES128-GCM-SHA256 bits\x128/128);
 Tue, 13 Sep 2016 02:03:38 -0700 (PDT)
From: Thomas Monjalon <thomas.monjalon@6wind.com>
To: Michael Wildt <michael.wildt@broadcom.com>
Cc: users@dpdk.org
Date: Tue, 13 Sep 2016 11:03:38 +0200
Message-ID: <2139728.s9C09RKb8B@xps13>
User-Agent: KMail/4.14.10 (Linux/4.5.4-1-ARCH; KDE/4.14.11; x86_64; ; )
In-Reply-To: <CAN_brw20cXkrvbcpf-nyPo=GddEUP+o=rQ9B9T4V079=nV=vcw@mail.gmail.com>
References: <CAN_brw20cXkrvbcpf-nyPo=GddEUP+o=rQ9B9T4V079=nV=vcw@mail.gmail.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="us-ascii"
Subject: Re: [dpdk-users] Cross compile for ARM64 fails due to librte_vhost
	and pmdinfogen issues
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: usage discussions <users.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 13 Sep 2016 09:03:40 -0000

Hi,

2016-09-12 22:20, Michael Wildt:
> I'm attempting to cross compile DPDK on an x86 for an ARM64 target. This
> fails in the following areas, using latest dpdk as of 9/12. When compiling
> natively there are no issues.

Your analysis below seems good.
Interestingly, I do not see such error (don't know why).
Please could you share the commands you are using?

> - librte_vhost, fails with:
>
> /projects/dpdk_latest/lib/librte_vhost/vhost_user/virtio-net-user.c:250:23:
> error: array subscript is above array bounds [-Werror=array-bounds]
>    rvq = dev->virtqueue[i * VIRTIO_QNUM + VIRTIO_RXQ];
[...]
> - buildtools/pmdinfogen, fails with:
>
> == Build buildtools/pmdinfogen
>   HOSTCC pmdinfogen.o
> /projects/dpdk_test_wget/dpdk-16.07/build/include/rte_byteorder.h:
> Assembler messages:
> /projects/dpdk_test_wget/dpdk-16.07/build/include/rte_byteorder.h:53:
> Error: no such instruction: `rev16 %bx,%bx'
[...]
>   - The issue is due to the rte_byteorder.h file which gets symlink'ed with
> the ARM version at the beginning of the build. The pmdinfogen is always
> compiled for x86 thus the asm is failing. I see two ways to address this.
>
> - Have pmdinfogen always pickup the local OS rte_byteorder.h file, not the
> ARCH symlinked one.

Yes we should not use DPDK headers in pmdinfogen or have a host-include/.

> - Fix pmdinfogen such that it gets cross compiled correctly as the rest of
> the code. Did a quick attempt by setting the HOST_OS to 0, , but then it
> fails at the HOST_LD.

No it must be native because it is part of the build system.

Re: [dpdk-users] Can't enable RSS in DPDK with MLX5

[Olga Shern]

The question was already answered in Mellanox community, adding the link for other users:

https://community.mellanox.com/docs/DOC-2624?et=watches.email.document_comment&comment-2790=

Best Regards,
Olga

-----Original Message-----
From: users [mailto:users-bounces@dpdk.org] On Behalf Of MAC Lee
Sent: Tuesday, September 13, 2016 10:35 AM
To: users@dpdk.org
Subject: [dpdk-users] Can't enable RSS in DPDK with MLX5

Hi All,
    I encounter a problem when enable RSS in DPDK( I am using 16.04 with OFED 3.3-1.0.4.0) using MLX5 PMD. I tried to enable RSS function in my DPDK application by setting 1.  .rxmode.mq_mode = ETH_MQ_RX_RSS, 2.  .rx_adv_conf.rss_conf.rss_hf = ETH_RSS_PROTO_MASK with RSS key length 40,//I also try ETH_RSS_IPV4 and ETH_RSS_NONFRAG_IPV4_UDP, but still no luck3. update the reta using rte_eth_dev_rss_reta_update
however, when I print out the mbuf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss after rte_eth_rx_burst(). All of these values are 0.
I also test the RSS using Testpmd and modify the testpmd to print those value after  rte_eth_rx_burst(). But still bad luck,  I still got all 0. What I did using Testpmd:1. testpmd -c 0x3f -n 4 -w 06:00.0,txq_inline=200 -- --burst=64 --txd=4096 --rxd=1024 --mbcache=512 --rxq=4 --txq=4 --nb-cores=4 --rss-udp --i2. testpmd>stop3. testpmd>set fwd rxonly4. testpmd> port config all rss udp5. testpmd>start6. Then pump traffic using packet generator and monitor the print out of buf->hash.fdir.hash, mbuf->hash.fdir.id, mbuf->hash.rss in testpmdMay I know how can I enable the RSS function in DPDK application using MLX5 PMD?
Best Regards,Marco