[dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[Xiao Kong]

Dear all,
We are currently trying to build a multi-RX-queue dpdk program, using RSS to split the incoming traffic evenly into RX queues on a single port. It works fine when we use an Intel 82599ES 10Gig NIC. However when we switch to the Intel XL710 40Gig NIC (i40e), RSS does not seem to work. As a result, TCP packets belonging to various flows (with different src&dst IPs, ports) are all sent into the same RX queue. Below is our code.
static const struct rte_eth_conf port_conf_default = {
    .rxmode = {
        .max_rx_pkt_len = ETHER_MAX_LEN, //1518
        .mq_mode = ETH_MQ_RX_RSS,
    },
    .rx_adv_conf = {
        .rss_conf = {
            .rss_key = NULL,
            .rss_hf = ETH_RSS_IP | ETH_RSS_UDP | ETH_RSS_TCP | ETH_RSS_SCTP,
        }
    },
};
We noticed that it is mentioned on several pages that XL710 sometimes behaves quite differently from other NICs, but we just can't find a way to configurate RSS hash fields on our card. Another thing is when we tried to enable RSS or setup hash fields in testpmd, it showed error messages as follows.
testpmd> port config all rss all 
Configuration of RSS hash at ethernet port 0 failed with error (22): Invalid argument.
Configuration of RSS hash at ethernet port 1 failed with error (22): Invalid argument.
testpmd> show port 1 rss-hash ipv4
RSS disabled
I am wondering if there is any mistake we made or if there is a unique method for XL710 to configure RSS hash fields.
By the way, we are using DPDK ver. 17.08.
Thanks.  
--------------------------
Best Regards,
Kong

Re: [dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[zhilong zheng]

Hi Kong,

What command that you use to run testpmd? It seems that your RSS is not enabled/configured.

Regards,
Zhilong

> 在 2018年10月20日，09:59，Xiao Kong <kongxiao0532@gmail.com> 写道：
> 
> Dear all,
> We are currently trying to build a multi-RX-queue dpdk program, using RSS to split the incoming traffic evenly into RX queues on a single port. It works fine when we use an Intel 82599ES 10Gig NIC. However when we switch to the Intel XL710 40Gig NIC (i40e), RSS does not seem to work. As a result, TCP packets belonging to various flows (with different src&dst IPs, ports) are all sent into the same RX queue. Below is our code.
> static const struct rte_eth_conf port_conf_default = {
>     .rxmode = {
>         .max_rx_pkt_len = ETHER_MAX_LEN, //1518
>         .mq_mode = ETH_MQ_RX_RSS,
>     },
>     .rx_adv_conf = {
>         .rss_conf = {
>             .rss_key = NULL,
>             .rss_hf = ETH_RSS_IP | ETH_RSS_UDP | ETH_RSS_TCP | ETH_RSS_SCTP,
>         }
>     },
> };
> We noticed that it is mentioned on several pages that XL710 sometimes behaves quite differently from other NICs, but we just can't find a way to configurate RSS hash fields on our card. Another thing is when we tried to enable RSS or setup hash fields in testpmd, it showed error messages as follows.
> testpmd> port config all rss all 
> Configuration of RSS hash at ethernet port 0 failed with error (22): Invalid argument.
> Configuration of RSS hash at ethernet port 1 failed with error (22): Invalid argument.
> testpmd> show port 1 rss-hash ipv4
> RSS disabled
> I am wondering if there is any mistake we made or if there is a unique method for XL710 to configure RSS hash fields.
> By the way, we are using DPDK ver. 17.08.
> Thanks.  
> --------------------------
> Best Regards,
> Kong
> 

Re: [dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[Wu, Xiaoban]

Hi Zhilong,


I encountered the same problem before, and I found a solution at https://stackoverflow.com/questions/42342723/how-to-set-up-rss-hash-fuction-in-xl710-to-receive-ipv4-flow-type#


You basically need to find the corresponding C function of each CLI command, and directly call them with some modifications.


Best wishes,

Xiaoban

________________________________
From: users <users-bounces@dpdk.org> on behalf of zhilong zheng <zhengzl0715@gmail.com>
Sent: Tuesday, October 23, 2018 1:50:30 AM
To: Xiao Kong
Cc: users@dpdk.org
Subject: Re: [dpdk-users] RSS problems with Intel XL710 NIC (i40e)

Hi Kong,

What command that you use to run testpmd? It seems that your RSS is not enabled/configured.

Regards,
Zhilong

> 在 2018年10月20日，09:59，Xiao Kong <kongxiao0532@gmail.com> 写道：
>
> Dear all,
> We are currently trying to build a multi-RX-queue dpdk program, using RSS to split the incoming traffic evenly into RX queues on a single port. It works fine when we use an Intel 82599ES 10Gig NIC. However when we switch to the Intel XL710 40Gig NIC (i40e), RSS does not seem to work. As a result, TCP packets belonging to various flows (with different src&dst IPs, ports) are all sent into the same RX queue. Below is our code.
> static const struct rte_eth_conf port_conf_default = {
>     .rxmode = {
>         .max_rx_pkt_len = ETHER_MAX_LEN, //1518
>         .mq_mode = ETH_MQ_RX_RSS,
>     },
>     .rx_adv_conf = {
>         .rss_conf = {
>             .rss_key = NULL,
>             .rss_hf = ETH_RSS_IP | ETH_RSS_UDP | ETH_RSS_TCP | ETH_RSS_SCTP,
>         }
>     },
> };
> We noticed that it is mentioned on several pages that XL710 sometimes behaves quite differently from other NICs, but we just can't find a way to configurate RSS hash fields on our card. Another thing is when we tried to enable RSS or setup hash fields in testpmd, it showed error messages as follows.
> testpmd> port config all rss all
> Configuration of RSS hash at ethernet port 0 failed with error (22): Invalid argument.
> Configuration of RSS hash at ethernet port 1 failed with error (22): Invalid argument.
> testpmd> show port 1 rss-hash ipv4
> RSS disabled
> I am wondering if there is any mistake we made or if there is a unique method for XL710 to configure RSS hash fields.
> By the way, we are using DPDK ver. 17.08.
> Thanks.
> --------------------------
> Best Regards,
> Kong
>

Re: [dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[zhilong zheng]

Hi Xiaoban,

Thank you for your sharing link, which definitely works. 
 
Actually, this RSS problem does not occur in my ENV setting (DPDK-18.02), which seems appearing in @Kong ’s setting (DPDK-17.08). (:, I have not checked whether it is the problem of DPDK version.

Best Regards,
Zhilong


> 在 2018年10月23日，20:41，Wu, Xiaoban <Xiaoban_Wu@student.uml.edu> 写道：
> 
> Hi Zhilong,
> 
> I encountered the same problem before, and I found a solution at https://stackoverflow.com/questions/42342723/how-to-set-up-rss-hash-fuction-in-xl710-to-receive-ipv4-flow-type# <https://stackoverflow.com/questions/42342723/how-to-set-up-rss-hash-fuction-in-xl710-to-receive-ipv4-flow-type#>
> 
> You basically need to find the corresponding C function of each CLI command, and directly call them with some modifications.
> 
> Best wishes,
> Xiaoban
> 
> From: users <users-bounces@dpdk.org> on behalf of zhilong zheng <zhengzl0715@gmail.com>
> Sent: Tuesday, October 23, 2018 1:50:30 AM
> To: Xiao Kong
> Cc: users@dpdk.org
> Subject: Re: [dpdk-users] RSS problems with Intel XL710 NIC (i40e)
>  
> Hi Kong,
> 
> What command that you use to run testpmd? It seems that your RSS is not enabled/configured.
> 
> Regards,
> Zhilong
> 
> > 在 2018年10月20日，09:59，Xiao Kong <kongxiao0532@gmail.com> 写道：
> > 
> > Dear all,
> > We are currently trying to build a multi-RX-queue dpdk program, using RSS to split the incoming traffic evenly into RX queues on a single port. It works fine when we use an Intel 82599ES 10Gig NIC. However when we switch to the Intel XL710 40Gig NIC (i40e), RSS does not seem to work. As a result, TCP packets belonging to various flows (with different src&dst IPs, ports) are all sent into the same RX queue. Below is our code.
> > static const struct rte_eth_conf port_conf_default = {
> >     .rxmode = {
> >         .max_rx_pkt_len = ETHER_MAX_LEN, //1518
> >         .mq_mode = ETH_MQ_RX_RSS,
> >     },
> >     .rx_adv_conf = {
> >         .rss_conf = {
> >             .rss_key = NULL,
> >             .rss_hf = ETH_RSS_IP | ETH_RSS_UDP | ETH_RSS_TCP | ETH_RSS_SCTP,
> >         }
> >     },
> > };
> > We noticed that it is mentioned on several pages that XL710 sometimes behaves quite differently from other NICs, but we just can't find a way to configurate RSS hash fields on our card. Another thing is when we tried to enable RSS or setup hash fields in testpmd, it showed error messages as follows.
> > testpmd> port config all rss all 
> > Configuration of RSS hash at ethernet port 0 failed with error (22): Invalid argument.
> > Configuration of RSS hash at ethernet port 1 failed with error (22): Invalid argument.
> > testpmd> show port 1 rss-hash ipv4
> > RSS disabled
> > I am wondering if there is any mistake we made or if there is a unique method for XL710 to configure RSS hash fields.
> > By the way, we are using DPDK ver. 17.08.
> > Thanks.  
> > --------------------------
> > Best Regards,
> > Kong
> > 

[dpdk-users] RSS problems with Intel XL710 NIC (i40e)

[Xiao Kong]

Dear all,

We are currently trying to build a multi-RX-queue dpdk program, using 
RSS to split the incoming traffic evenly into RX queues on a single 
port. It works fine when we use an Intel 82599ES 10Gig NIC. However when 
we switch to the Intel XL710 40Gig NIC (i40e), RSS does not seem to 
work. As a result, TCP packets belonging to various flows (with 
different src&dst IPs, ports) are all sent into the same RX queue. Below 
is our code.

static const struct rte_eth_conf port_conf_default = {
     .rxmode = {
         .max_rx_pkt_len = ETHER_MAX_LEN, //1518
         .mq_mode = ETH_MQ_RX_RSS,
     },
     .rx_adv_conf = {
         .rss_conf = {
             .rss_key = NULL,
             .rss_hf = ETH_RSS_IP | ETH_RSS_UDP | ETH_RSS_TCP | 
ETH_RSS_SCTP,
         }
     },
};

We noticed that it is mentioned on several pages that XL710 sometimes 
behaves quite differently from other NICs, but we just can't find a way 
to configurate RSS hash fields on our card. Another thing is when we 
tried to enable RSS or setup hash fields in testpmd, it showed error 
messages as follows.

testpmd> port config all rss all
Configuration of RSS hash at ethernet port 0 failed with error (22): 
Invalid argument.
Configuration of RSS hash at ethernet port 1 failed with error (22): 
Invalid argument.

testpmd> show port 1 rss-hash ipv4
RSS disabled

I am wondering if there is any mistake we made or if there is a unique 
method for XL710 to configure RSS hash fields.

By the way, we are using DPDK ver. 17.08.

Thanks.

--------------------------

Best Regards,

Kong