DPDK patches and discussions
 help / color / Atom feed
* [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
@ 2020-10-15 12:30 Lijun Ou
  2020-10-21 10:07 ` [dpdk-dev] [PATCH] app/testpmd: set default RSS key as null Lijun Ou
  0 siblings, 1 reply; 24+ messages in thread
From: Lijun Ou @ 2020-10-15 12:30 UTC (permalink / raw)
  To: wenzhuo.lu, beilei.xing, adrien.mazarguil, ferruh.yigit; +Cc: dev, linuxarm

When start the testpmd, the pmd driver initializes the RSS
configuration. Generally, the recommended RSS hash key is
used as the default key in the driver. In addition, the
default key is different from the default RSS flow in testpmd
without specifying RSS hash key. So. if you do not specify
the RSS key when creating an RSS rule, the testpmd uses the
default key as the default RSS key of the RSS rule. As a result,
you may mistakenly consider that the RSS key in use is the valid
default key of the NIC, actually, the key and the valid default
key of the NIC are two values.

Consider the follow usage with testpmd:
1. first, startup testpmd:
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
RSS key:
-6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
-20C6A42B73BBEAC01FA
2. create a rss rule
testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions rss \
types ipv4-udp end queues end / end

3. show rss-hash key
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-udp udp
RSS key:
-74657374706D6427732064656661756C74205253532068617368206B65792C206F
-76657272696465

In order to solve the above problems, it use the NIC valid default
RSS key instead of the testpmd dummy RSS key in the flow configuration
when the RSS key is not specified in the flow rule. If the NIC RSS key
is invalid, it will use testpmd dummy RSS key as the default key.

Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
Cc: stable@dpdk.org

Signed-off-by: Lijun Ou <oulijun@huawei.com>
Reviewed-by: Phil Yang <phil.yang@arm.com>
---
V4->V5:
-rewrite the commit log
-add reviewed-by

V3->V4:
-fix checkpatch warning and shorter commit content.

V2->V3:
-fix checkpatch warning.

V1->V2:
-fix the commit.
---
 app/test-pmd/cmdline_flow.c | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/app/test-pmd/cmdline_flow.c b/app/test-pmd/cmdline_flow.c
index 84bba0f..578555e 100644
--- a/app/test-pmd/cmdline_flow.c
+++ b/app/test-pmd/cmdline_flow.c
@@ -4735,6 +4735,7 @@ parse_vc_action_rss(struct context *ctx, const struct token *token,
 		action_rss_data->queue[i] = i;
 	if (!port_id_is_invalid(ctx->port, DISABLED_WARN) &&
 	    ctx->port != (portid_t)RTE_PORT_ALL) {
+		struct rte_eth_rss_conf rss_conf = {0};
 		struct rte_eth_dev_info info;
 		int ret2;
 
@@ -4745,6 +4746,13 @@ parse_vc_action_rss(struct context *ctx, const struct token *token,
 		action_rss_data->conf.key_len =
 			RTE_MIN(sizeof(action_rss_data->key),
 				info.hash_key_size);
+
+		rss_conf.rss_key_len = sizeof(action_rss_data->key);
+		rss_conf.rss_key = action_rss_data->key;
+		ret2 = rte_eth_dev_rss_hash_conf_get(ctx->port, &rss_conf);
+		if (ret2 != 0)
+			return ret2;
+		action_rss_data->conf.key = rss_conf.rss_key;
 	}
 	action->conf = &action_rss_data->conf;
 	return ret;
-- 
2.7.4


^ permalink raw reply	[flat|nested] 24+ messages in thread

* [dpdk-dev] [PATCH] app/testpmd: set default RSS key as null
  2020-10-15 12:30 [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration Lijun Ou
@ 2020-10-21 10:07 ` Lijun Ou
  2020-10-26 10:36   ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: Lijun Ou @ 2020-10-21 10:07 UTC (permalink / raw)
  To: wenzhuo.lu, beilei.xing, adrien.mazarguil, ferruh.yigit; +Cc: dev, linuxarm

From: Ophir Munk <ophirmu@mellanox.com>

When creating an RSS rule without specifying a key (see [1]) it is
expected that the device will use the default key.
A NULL key is used to indicate to a PMD it should use
its default key, however testpmd assigns a non-NULL dummy key
(see [2]) instead.
This does not enable testing any PMD behavior when the RSS key is not
specified. This commit fixes this limitation by setting key to NULL.
Also, it fixes the Scenario [3] that enable default RSS action by
setting key=NULL and key_len!=0.
[1]
RSS rule example without specifying a key:
flow create 0 ingress <pattern> / end actions rss queues 0 1 end / end
[2]
Testpmd default key assignment:
.key= "testpmd's default RSS hash key, "
"override it for better balancing"
[3]
flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end

fixes refer to the link: https://patches.dpdk.org/patch/80898/

Signed-off-by: Ophir Munk <ophirmu@mellanox.com>
Signed-off-by: Ferruh Yigit <ferruh.yigit@intel.com>
Signed-off-by: Lijun Ou <oulijun@huawei.com>
---
 app/test-pmd/cmdline_flow.c  | 19 ++-----------------
 lib/librte_ethdev/rte_flow.c |  2 +-
 2 files changed, 3 insertions(+), 18 deletions(-)

diff --git a/app/test-pmd/cmdline_flow.c b/app/test-pmd/cmdline_flow.c
index cd35d5b..3d1dd05 100644
--- a/app/test-pmd/cmdline_flow.c
+++ b/app/test-pmd/cmdline_flow.c
@@ -4850,30 +4850,15 @@ parse_vc_action_rss(struct context *ctx, const struct token *token,
 			.func = RTE_ETH_HASH_FUNCTION_DEFAULT,
 			.level = 0,
 			.types = rss_hf,
-			.key_len = sizeof(action_rss_data->key),
+			.key_len = 0,
 			.queue_num = RTE_MIN(nb_rxq, ACTION_RSS_QUEUE_NUM),
-			.key = action_rss_data->key,
+			.key = NULL,
 			.queue = action_rss_data->queue,
 		},
-		.key = "testpmd's default RSS hash key, "
-			"override it for better balancing",
 		.queue = { 0 },
 	};
 	for (i = 0; i < action_rss_data->conf.queue_num; ++i)
 		action_rss_data->queue[i] = i;
-	if (!port_id_is_invalid(ctx->port, DISABLED_WARN) &&
-	    ctx->port != (portid_t)RTE_PORT_ALL) {
-		struct rte_eth_dev_info info;
-		int ret2;
-
-		ret2 = rte_eth_dev_info_get(ctx->port, &info);
-		if (ret2 != 0)
-			return ret2;
-
-		action_rss_data->conf.key_len =
-			RTE_MIN(sizeof(action_rss_data->key),
-				info.hash_key_size);
-	}
 	action->conf = &action_rss_data->conf;
 	return ret;
 }
diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
index d3e5cbc..a06f64c 100644
--- a/lib/librte_ethdev/rte_flow.c
+++ b/lib/librte_ethdev/rte_flow.c
@@ -577,7 +577,7 @@ rte_flow_conv_action_conf(void *buf, const size_t size,
 			   }),
 			   size > sizeof(*dst.rss) ? sizeof(*dst.rss) : size);
 		off = sizeof(*dst.rss);
-		if (src.rss->key_len) {
+		if (src.rss->key_len && src.rss->key) {
 			off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
 			tmp = sizeof(*src.rss->key) * src.rss->key_len;
 			if (size >= off + tmp)
-- 
2.7.4


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH] app/testpmd: set default RSS key as null
  2020-10-21 10:07 ` [dpdk-dev] [PATCH] app/testpmd: set default RSS key as null Lijun Ou
@ 2020-10-26 10:36   ` Ferruh Yigit
  0 siblings, 0 replies; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-26 10:36 UTC (permalink / raw)
  To: Lijun Ou, wenzhuo.lu, beilei.xing, adrien.mazarguil; +Cc: dev, linuxarm

On 10/21/2020 11:07 AM, Lijun Ou wrote:
> From: Ophir Munk <ophirmu@mellanox.com>
> 
> When creating an RSS rule without specifying a key (see [1]) it is
> expected that the device will use the default key.
> A NULL key is used to indicate to a PMD it should use
> its default key, however testpmd assigns a non-NULL dummy key
> (see [2]) instead.
> This does not enable testing any PMD behavior when the RSS key is not
> specified. This commit fixes this limitation by setting key to NULL.
> Also, it fixes the Scenario [3] that enable default RSS action by
> setting key=NULL and key_len!=0.
> [1]
> RSS rule example without specifying a key:
> flow create 0 ingress <pattern> / end actions rss queues 0 1 end / end
> [2]
> Testpmd default key assignment:
> .key= "testpmd's default RSS hash key, "
> "override it for better balancing"
> [3]
> flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end
> 
> fixes refer to the link: https://patches.dpdk.org/patch/80898/
> 
> Signed-off-by: Ophir Munk <ophirmu@mellanox.com>
> Signed-off-by: Ferruh Yigit <ferruh.yigit@intel.com>
> Signed-off-by: Lijun Ou <oulijun@huawei.com>

Applied to dpdk-next-net/main, thanks.


Updated the commit log as below:

Author: Lijun Ou <oulijun@huawei.com>
Date:   Wed Oct 21 18:07:10 2020 +0800

     app/testpmd: fix RSS key for flow API RSS rule

     When a flow API RSS rule is issued in testpmd, device RSS key is changed
     unexpectedly, device RSS key is changed to the testpmd default RSS key.

     Consider the following usage with testpmd:
     1. first, startup testpmd:
      testpmd> show port 0 rss-hash key
      RSS functions: all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
      RSS key: 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
               20C6A42B73BBEAC01FA
     2. create a rss rule
      testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end \
               actions rss types ipv4-udp end queues end / end

     3. show rss-hash key
      testpmd> show port 0 rss-hash key
      RSS functions: all ipv4-udp udp
      RSS key: 74657374706D6427732064656661756C74205253532068617368206B65792
               C206F76657272696465

     This is because testpmd always sends a key with the RSS rule,
     if user provides a key as part of the rule that key is used, if user
     doesn't provide a key, testpmd default key is sent to the PMDs, which is
     causing device programmed RSS key to be changed.

     There was a previous attempt to fix the same issue [1], but it has been
     reverted back [2] because of the crash when 'key_len' is provided
     without 'key'.

     This patch follows the same approach with the initial fix [1] but also
     addresses the crash.

     After change, testpmd RSS key is 'NULL' by default, if user provides a
     key as part of rule it is used, if not no key is sent to the PMDs at all

     [1]
     Commit a4391f8bae85 ("app/testpmd: set default RSS key as null")

     [2]
     Commit f3698c3d09a6 ("app/testpmd: revert setting default RSS")

     Fixes: d0ad8648b1c5 ("app/testpmd: fix RSS flow action configuration")
     Cc: stable@dpdk.org

     Signed-off-by: Lijun Ou <oulijun@huawei.com>
     Signed-off-by: Ophir Munk <ophirmu@mellanox.com>
     Signed-off-by: Ferruh Yigit <ferruh.yigit@intel.com>


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-21  9:38                             ` Ferruh Yigit
@ 2020-10-21 10:07                               ` oulijun
  0 siblings, 0 replies; 24+ messages in thread
From: oulijun @ 2020-10-21 10:07 UTC (permalink / raw)
  To: Ferruh Yigit, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/21 17:38, Ferruh Yigit 写道:
> On 10/21/2020 9:19 AM, oulijun wrote:
>>
>>
>> 在 2020/10/20 22:34, Ferruh Yigit 写道:
>>> On 10/20/2020 2:35 PM, oulijun wrote:
>>>>
>>>>
>>>> 在 2020/10/20 18:02, Ferruh Yigit 写道:
>>>>> On 10/20/2020 10:00 AM, oulijun wrote:
>>>>>>
>>>>>>
>>>>>> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>>>>>>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>>>>>>
>>>>>>>>
>>>>>>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>>>>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>>>>>>> configuration. Generally, the recommended RSS hash key is 
>>>>>>>>>>>>>>> used as
>>>>>>>>>>>>>>> the default key in the driver. In addition, the default 
>>>>>>>>>>>>>>> key is
>>>>>>>>>>>>>>> different from the default RSS flow in testpmd without 
>>>>>>>>>>>>>>> specifying
>>>>>>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when 
>>>>>>>>>>>>>>> creating
>>>>>>>>>>>>>>> an RSS rule, the testpmd uses the default key as the 
>>>>>>>>>>>>>>> default RSS
>>>>>>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly 
>>>>>>>>>>>>>>> consider that
>>>>>>>>>>>>>>> the RSS key in use is the valid default key of the NIC, 
>>>>>>>>>>>>>>> actually,
>>>>>>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS 
>>>>>>>>>>>>>>> key:
>>>>>>>>>>>>>>> -
>>>>>>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>>>>>>> 0F
>>>>>>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>>>>>>> 2. create a rss rule
>>>>>>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / 
>>>>>>>>>>>>>>> end
>>>>>>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>>>>>>> RSS key:
>>>>>>>>>>>>>>> -
>>>>>>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>>>>>>> 206F
>>>>>>>>>>>>>>> -76657272696465
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> In order to solve the above problems, it use the NIC 
>>>>>>>>>>>>>>> valid default
>>>>>>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>>>>>>> configuration when the RSS key is not specified in the 
>>>>>>>>>>>>>>> flow rule.
>>>>>>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy 
>>>>>>>>>>>>>>> RSS key as the
>>>>>>>>>>> default key.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration 
>>>>>>>>>>>>>>> in flow
>>>>>>>>>>>>>>> API")
>>>>>>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>>>>>>> ---
>>>>>>>>>>>>>>> V4->V5:
>>>>>>>>>>>>>>> -rewrite the commit log
>>>>>>>>>>>>>>> -add reviewed-by
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Lijun,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> There were multiple other comments, it seems they are not 
>>>>>>>>>>>>>> addressed
>>>>>>>>>>>>>> but only updated the commit log, can you please check 
>>>>>>>>>>>>>> comments to
>>>>>>>>>>> prev versions.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Before going into the details, my question was what 
>>>>>>>>>>>>>> happens if
>>>>>>>>>>>>>> default key not provided at all?
>>>>>>>>>>>>>> It seems this has been already tried by Ophir [1], later 
>>>>>>>>>>>>>> reverted
>>>>>>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> According commit, the reason of revert is to support 
>>>>>>>>>>>>>> following
>>>>>>>>>>> command:
>>>>>>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end 
>>>>>>>>>>>>>> key_len 40 / end"
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported 
>>>>>>>>>>>>>> and solve
>>>>>>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi, Ferruh
>>>>>>>>>>>>>     I have discussed with Phil Yang about the problem in 
>>>>>>>>>>>>> [1]. I think
>>>>>>>>>>>>> there may be other problems with the idea and there is no 
>>>>>>>>>>>>> better
>>>>>>>>>>>>> solution. and we need to remove key_len definition from 
>>>>>>>>>>>>> rte_rss_conf
>>>>>>>>>>>>> structure. They don't have a plan. And [1] was eventually 
>>>>>>>>>>>>> reverted.
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>>>>>>> provided doesn't work?
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> What do you think [1] + following update, will it work?
>>>>>>>>>>>
>>>>>>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>>>>>>>>>> b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, 
>>>>>>>>>>> const size_t
>>>>>>>>>>> size,
>>>>>>>>>>>                               }),
>>>>>>>>>>>                               size > sizeof(*dst.rss) ? 
>>>>>>>>>>> sizeof(*dst.rss) : size);
>>>>>>>>>>>                    off = sizeof(*dst.rss);
>>>>>>>>>>>    -               if (src.rss->key_len) {
>>>>>>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>>>>>>>> sizeof(*dst.rss->key));
>>>>>>>>>>>                            tmp = sizeof(*src.rss->key) * 
>>>>>>>>>>> src.rss->key_len;
>>>>>>>>>>>                            if (size >= off + tmp)
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also 
>>>>>>>>>> verified it on mlx5 PMD.
>>>>>>>>>> Advantage: it's a generic fix for all dpdk applications using 
>>>>>>>>>> rte_flows (not just testpmd).
>>>>>>>>>> It reduces code.
>>>>>>>>>> With this fix the responsibility of handling key==NULL and/or 
>>>>>>>>>> len==0 is moved to the PMDs (which is good).
>>>>>>>>>> With regard to Lijun patch - I liked the approach of 
>>>>>>>>>> overriding the default testpmd key with the default PMD key.
>>>>>>>>>> But it only addresses testpmd. More code was added.
>>>>>>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of 
>>>>>>>>>> parsing RSS, but it would feel more confident if we could 
>>>>>>>>>> confirm it for all the PMDs (by testing) or at least review 
>>>>>>>>>> the PMDs rss_hash_conf_get() implementations.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Lijun's idea can work. There was a problem in implementation 
>>>>>>>>> related to the key size assumption, which can be fixed.
>>>>>>>>>
>>>>>>>>> Even it is fixed, when user gives a rss rule without a key, we 
>>>>>>>>> are getting key from device and feeding same key back to 
>>>>>>>>> device, this is unnecessary I think.
>>>>>>>>> When user didn't provide a key, rss rule shouldn't touch the 
>>>>>>>>> key at all.
>>>>>>>>>
>>>>>>>> Do you mean that the driver should not configure the key to the 
>>>>>>>> hardware when the RSS key is not specified?
>>>>>>>
>>>>>>> We are talking about 'key' in RSS rte flow rule, not generally 
>>>>>>> configuring the device for RSS.
>>>>>>>
>>>>>> Yes, I know. However, I am talking about some implementations. The 
>>>>>> configuration interface may be the same as that for configuring RSS
>>>>>> parameters of the device in general mode.
>>>>>>> If a specific rss rte flow rule, lets say to filter some defined 
>>>>>>> packets to some specific queues, don't have 'key' as a part of 
>>>>>>> rule, I am suggesting not touch 'key' configuration of the device.
>>>>>>>
>>>>>> Yes, I agree. I think your point of view is very reasonable and a 
>>>>>> more
>>>>>> appropriate implementation. However, for the sake of simplicity and
>>>>>> other considerations in the architecture design of some devices, the
>>>>>> hardware may support reasonable hybrid configuration for paramter 
>>>>>> configuration in the RSS config, rather than independent 
>>>>>> configuration
>>>>>> for hw, that is, maybe touch A of rss configuration of the device and
>>>>>> must touch B of rss configuration. As a result, If the preceding 
>>>>>> scenario occurs, it is reasonable to configure an RSS config that 
>>>>>> does not change and specified.What do you think?
>>>>>>>> If so, we cannot identify when the user does not specify the RSS 
>>>>>>>> key to determine whether to configure the key.
>>>>>>>
>>>>>>> I think we can. If the rule has 'key' attribute, driver can use 
>>>>>>> that key to program the device, if 'key' attribute is missing, 
>>>>>>> don't do anything related to the rss key.
>>>>>>>
>>>>>> Yes, if 'key' attribute is missing, don't do anything related to 
>>>>>> the rss key. It's more reasonable.
>>>>>> But, If he can't do that, I think it is reasonable to configure 
>>>>>> the default key that already exists on the device. The only 
>>>>>> disadvantage is wasteful.
>>>>>>>> In hardware design, most vendors do not configure keys for 
>>>>>>>> hardware independently, which may be associated with other RSS 
>>>>>>>> config parameters.
>>>>>>>> I think it would be reasonable for us to reconfigure the RSS key 
>>>>>>>> with the default value configured and valid in the hardware as 
>>>>>>>> the default value if the user does not specify the RSS key.
>>>>>>>
>>>>>>> There are already APIs to update the RSS configuration, like RSS 
>>>>>>> key, hash functions etc.. They are independent from the rte flow 
>>>>>>> RSS rule.
>>>>>>> Application should configure RSS according needs using those APIs.
>>>>>>>
>>>>>> Yes, should do this. Are there any unreasonable users who simply 
>>>>>> do not know these APIs or do not want to use them and want to 
>>>>>> configure some parameters through the rte flow RSS rule without 
>>>>>> changing other parameters?
>>>>>>> The question here is about each RSS rte flow rule that can update 
>>>>>>> the key. Am I missing something?
>>>>>> I don't think you've misunderstood the general situation.
>>>>>> Even if the RSS key is not specified in a rule, the driver uses 
>>>>>> the default key value to re-touch the device.
>>>>>>>
>>>>>>>>> Complication was when user provides key_len without a key, I 
>>>>>>>>> think both ignoring or returning error in this case is OK.
>>>>>>>> I agree. However, I think it is meaningless to expose the RSS 
>>>>>>>> key length to users. Do you consider deleting the RSS key length 
>>>>>>>> directly?
>>>>>>>
>>>>>>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can 
>>>>>>> the driver know the size of the 'key' without 'key_len'?
>>>>>>> And driver should verify these provided values.
>>>>>>>
>>>>>> I know and agree.It is only during the analysis of the [1] scheme, 
>>>>>> from the time it was proposed to the time it was withdrawn, that I 
>>>>>> found some guys in the community questioned the significance of 
>>>>>> key_len.
>>>>>>
>>>>>> Back to the subject, what is your plan for the solution in the patch?
>>>>>
>>>>> I think, Ophir's old reverted patch [1] + 
>>>>> 'rte_flow_conv_action_conf()' update I proposed above can work. Is 
>>>>> this working for you? If so can you please send a patch?
>>>>>
>>>>>
>>>>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>>>>> .
>>>> Hi, Ferruh
>>>>     I've just used [1] + 'rte_flow_conv_action_conf()' for testing 
>>>> based on the Kunpeng920 NIC plation and use hns3 pmd driver. it can 
>>>> be resolve the RSS key question.
>>>>     testpmd> show port 0 rss-hash key
>>>> RSS functions:
>>>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>>> RSS key:
>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>>>
>>>> testpmd> flow create 0 ingress pattern end actions rss func 
>>>> symmetric_toeplitz types all end / end
>>>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
>>>> hardware support, requested:7f83fffc configured:3ef8
>>>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using 
>>>> default
>>>> Flow rule #0 created
>>>> testpmd> show port 0 rss-hash key
>>>> RSS functions:
>>>>   all ipv4-frag ipv4-tcp ipv4-udp ipv4-sctp ipv4-other ipv6-frag 
>>>> ipv6-tcp ipv6-udp ipv6-sctp ipv6-other ip udp tcp sctp
>>>> RSS key:
>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>>>
>>>>
>>>> However, I also tested the case. I am not specified the RSS key and 
>>>> specified the key_len when create a RSS flow rule, it can create 
>>>> success.
>>>> testpmd> flow create 0 ingress pattern end actions rss queues 0 1 
>>>> end key_len 40 / end
>>>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
>>>> hardware support, requested:a38c configured:2288
>>>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using 
>>>> default
>>>> Flow rule #0 created
>>>> testpmd> show port 0 rss-hash key
>>>> RSS functions:
>>>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>>> RSS key:
>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>>>
>>>>
>>>
>>> So are you happy with this solution?
>>> .
>> Yes, thanks.
> 
> cool, will you able to send a new version? Thanks.
> .
Yes
> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-21  8:19                           ` oulijun
@ 2020-10-21  9:38                             ` Ferruh Yigit
  2020-10-21 10:07                               ` oulijun
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-21  9:38 UTC (permalink / raw)
  To: oulijun, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

On 10/21/2020 9:19 AM, oulijun wrote:
> 
> 
> 在 2020/10/20 22:34, Ferruh Yigit 写道:
>> On 10/20/2020 2:35 PM, oulijun wrote:
>>>
>>>
>>> 在 2020/10/20 18:02, Ferruh Yigit 写道:
>>>> On 10/20/2020 10:00 AM, oulijun wrote:
>>>>>
>>>>>
>>>>> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>>>>>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>>>>>
>>>>>>>
>>>>>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>>>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>>>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>>>>>>> -
>>>>>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>>>>>> 0F
>>>>>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>>>>>> 2. create a rss rule
>>>>>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>>>>>> RSS key:
>>>>>>>>>>>>>> -
>>>>>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>>>>>> 206F
>>>>>>>>>>>>>> -76657272696465
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key 
>>>>>>>>>>>>>> as the
>>>>>>>>>> default key.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>>>>>>>> API")
>>>>>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>>>>>> ---
>>>>>>>>>>>>>> V4->V5:
>>>>>>>>>>>>>> -rewrite the commit log
>>>>>>>>>>>>>> -add reviewed-by
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Lijun,
>>>>>>>>>>>>>
>>>>>>>>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>>>>>>>>> but only updated the commit log, can you please check comments to
>>>>>>>>>> prev versions.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>>>>>>> default key not provided at all?
>>>>>>>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>>>>>
>>>>>>>>>>>>> According commit, the reason of revert is to support following
>>>>>>>>>> command:
>>>>>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>>>>>>>>>
>>>>>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>>>>>
>>>>>>>>>>>> Hi, Ferruh
>>>>>>>>>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>>>>>>>>>> there may be other problems with the idea and there is no better
>>>>>>>>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>>>>>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>>>>>> provided doesn't work?
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> What do you think [1] + following update, will it work?
>>>>>>>>>>
>>>>>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>>>>>>>>> b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>>>>>>>>>> size,
>>>>>>>>>>                               }),
>>>>>>>>>>                               size > sizeof(*dst.rss) ? 
>>>>>>>>>> sizeof(*dst.rss) : size);
>>>>>>>>>>                    off = sizeof(*dst.rss);
>>>>>>>>>>    -               if (src.rss->key_len) {
>>>>>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>>>>>>> sizeof(*dst.rss->key));
>>>>>>>>>>                            tmp = sizeof(*src.rss->key) * 
>>>>>>>>>> src.rss->key_len;
>>>>>>>>>>                            if (size >= off + tmp)
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also verified 
>>>>>>>>> it on mlx5 PMD.
>>>>>>>>> Advantage: it's a generic fix for all dpdk applications using rte_flows 
>>>>>>>>> (not just testpmd).
>>>>>>>>> It reduces code.
>>>>>>>>> With this fix the responsibility of handling key==NULL and/or len==0 is 
>>>>>>>>> moved to the PMDs (which is good).
>>>>>>>>> With regard to Lijun patch - I liked the approach of overriding the 
>>>>>>>>> default testpmd key with the default PMD key.
>>>>>>>>> But it only addresses testpmd. More code was added.
>>>>>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing 
>>>>>>>>> RSS, but it would feel more confident if we could confirm it for all 
>>>>>>>>> the PMDs (by testing) or at least review the PMDs rss_hash_conf_get() 
>>>>>>>>> implementations.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Lijun's idea can work. There was a problem in implementation related to 
>>>>>>>> the key size assumption, which can be fixed.
>>>>>>>>
>>>>>>>> Even it is fixed, when user gives a rss rule without a key, we are 
>>>>>>>> getting key from device and feeding same key back to device, this is 
>>>>>>>> unnecessary I think.
>>>>>>>> When user didn't provide a key, rss rule shouldn't touch the key at all.
>>>>>>>>
>>>>>>> Do you mean that the driver should not configure the key to the hardware 
>>>>>>> when the RSS key is not specified?
>>>>>>
>>>>>> We are talking about 'key' in RSS rte flow rule, not generally configuring 
>>>>>> the device for RSS.
>>>>>>
>>>>> Yes, I know. However, I am talking about some implementations. The 
>>>>> configuration interface may be the same as that for configuring RSS
>>>>> parameters of the device in general mode.
>>>>>> If a specific rss rte flow rule, lets say to filter some defined packets 
>>>>>> to some specific queues, don't have 'key' as a part of rule, I am 
>>>>>> suggesting not touch 'key' configuration of the device.
>>>>>>
>>>>> Yes, I agree. I think your point of view is very reasonable and a more
>>>>> appropriate implementation. However, for the sake of simplicity and
>>>>> other considerations in the architecture design of some devices, the
>>>>> hardware may support reasonable hybrid configuration for paramter 
>>>>> configuration in the RSS config, rather than independent configuration
>>>>> for hw, that is, maybe touch A of rss configuration of the device and
>>>>> must touch B of rss configuration. As a result, If the preceding scenario 
>>>>> occurs, it is reasonable to configure an RSS config that does not change 
>>>>> and specified.What do you think?
>>>>>>> If so, we cannot identify when the user does not specify the RSS key to 
>>>>>>> determine whether to configure the key.
>>>>>>
>>>>>> I think we can. If the rule has 'key' attribute, driver can use that key 
>>>>>> to program the device, if 'key' attribute is missing, don't do anything 
>>>>>> related to the rss key.
>>>>>>
>>>>> Yes, if 'key' attribute is missing, don't do anything related to the rss 
>>>>> key. It's more reasonable.
>>>>> But, If he can't do that, I think it is reasonable to configure the default 
>>>>> key that already exists on the device. The only disadvantage is wasteful.
>>>>>>> In hardware design, most vendors do not configure keys for hardware 
>>>>>>> independently, which may be associated with other RSS config parameters.
>>>>>>> I think it would be reasonable for us to reconfigure the RSS key with the 
>>>>>>> default value configured and valid in the hardware as the default value 
>>>>>>> if the user does not specify the RSS key.
>>>>>>
>>>>>> There are already APIs to update the RSS configuration, like RSS key, hash 
>>>>>> functions etc.. They are independent from the rte flow RSS rule.
>>>>>> Application should configure RSS according needs using those APIs.
>>>>>>
>>>>> Yes, should do this. Are there any unreasonable users who simply do not 
>>>>> know these APIs or do not want to use them and want to configure some 
>>>>> parameters through the rte flow RSS rule without changing other parameters?
>>>>>> The question here is about each RSS rte flow rule that can update the key. 
>>>>>> Am I missing something?
>>>>> I don't think you've misunderstood the general situation.
>>>>> Even if the RSS key is not specified in a rule, the driver uses the default 
>>>>> key value to re-touch the device.
>>>>>>
>>>>>>>> Complication was when user provides key_len without a key, I think both 
>>>>>>>> ignoring or returning error in this case is OK.
>>>>>>> I agree. However, I think it is meaningless to expose the RSS key length 
>>>>>>> to users. Do you consider deleting the RSS key length directly?
>>>>>>
>>>>>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the 
>>>>>> driver know the size of the 'key' without 'key_len'?
>>>>>> And driver should verify these provided values.
>>>>>>
>>>>> I know and agree.It is only during the analysis of the [1] scheme, from the 
>>>>> time it was proposed to the time it was withdrawn, that I found some guys 
>>>>> in the community questioned the significance of key_len.
>>>>>
>>>>> Back to the subject, what is your plan for the solution in the patch?
>>>>
>>>> I think, Ophir's old reverted patch [1] + 'rte_flow_conv_action_conf()' 
>>>> update I proposed above can work. Is this working for you? If so can you 
>>>> please send a patch?
>>>>
>>>>
>>>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>>>> .
>>> Hi, Ferruh
>>>     I've just used [1] + 'rte_flow_conv_action_conf()' for testing based on 
>>> the Kunpeng920 NIC plation and use hns3 pmd driver. it can be resolve the RSS 
>>> key question.
>>>     testpmd> show port 0 rss-hash key
>>> RSS functions:
>>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>> RSS key:
>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
>>> testpmd> flow create 0 ingress pattern end actions rss func 
>>> symmetric_toeplitz types all end / end
>>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on hardware 
>>> support, requested:7f83fffc configured:3ef8
>>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
>>> Flow rule #0 created
>>> testpmd> show port 0 rss-hash key
>>> RSS functions:
>>>   all ipv4-frag ipv4-tcp ipv4-udp ipv4-sctp ipv4-other ipv6-frag ipv6-tcp 
>>> ipv6-udp ipv6-sctp ipv6-other ip udp tcp sctp
>>> RSS key:
>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
>>>
>>> However, I also tested the case. I am not specified the RSS key and specified 
>>> the key_len when create a RSS flow rule, it can create success.
>>> testpmd> flow create 0 ingress pattern end actions rss queues 0 1 end key_len 
>>> 40 / end
>>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on hardware 
>>> support, requested:a38c configured:2288
>>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
>>> Flow rule #0 created
>>> testpmd> show port 0 rss-hash key
>>> RSS functions:
>>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>> RSS key:
>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
>>>
>>
>> So are you happy with this solution?
>> .
> Yes, thanks.

cool, will you able to send a new version? Thanks.

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-20 14:34                         ` Ferruh Yigit
@ 2020-10-21  8:19                           ` oulijun
  2020-10-21  9:38                             ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-21  8:19 UTC (permalink / raw)
  To: Ferruh Yigit, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/20 22:34, Ferruh Yigit 写道:
> On 10/20/2020 2:35 PM, oulijun wrote:
>>
>>
>> 在 2020/10/20 18:02, Ferruh Yigit 写道:
>>> On 10/20/2020 10:00 AM, oulijun wrote:
>>>>
>>>>
>>>> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>>>>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>>>>
>>>>>>
>>>>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>>>>> configuration. Generally, the recommended RSS hash key is 
>>>>>>>>>>>>> used as
>>>>>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>>>>>> different from the default RSS flow in testpmd without 
>>>>>>>>>>>>> specifying
>>>>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when 
>>>>>>>>>>>>> creating
>>>>>>>>>>>>> an RSS rule, the testpmd uses the default key as the 
>>>>>>>>>>>>> default RSS
>>>>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly 
>>>>>>>>>>>>> consider that
>>>>>>>>>>>>> the RSS key in use is the valid default key of the NIC, 
>>>>>>>>>>>>> actually,
>>>>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>>>>>> -
>>>>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>>>>> 0F
>>>>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>>>>> 2. create a rss rule
>>>>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>>>>
>>>>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>>>>> RSS key:
>>>>>>>>>>>>> -
>>>>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>>>>> 206F
>>>>>>>>>>>>> -76657272696465
>>>>>>>>>>>>>
>>>>>>>>>>>>> In order to solve the above problems, it use the NIC valid 
>>>>>>>>>>>>> default
>>>>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>>>>> configuration when the RSS key is not specified in the flow 
>>>>>>>>>>>>> rule.
>>>>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy 
>>>>>>>>>>>>> RSS key as the
>>>>>>>>> default key.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in 
>>>>>>>>>>>>> flow
>>>>>>>>>>>>> API")
>>>>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>>>>
>>>>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>>>>> ---
>>>>>>>>>>>>> V4->V5:
>>>>>>>>>>>>> -rewrite the commit log
>>>>>>>>>>>>> -add reviewed-by
>>>>>>>>>>>>
>>>>>>>>>>>> Hi Lijun,
>>>>>>>>>>>>
>>>>>>>>>>>> There were multiple other comments, it seems they are not 
>>>>>>>>>>>> addressed
>>>>>>>>>>>> but only updated the commit log, can you please check 
>>>>>>>>>>>> comments to
>>>>>>>>> prev versions.
>>>>>>>>>>>>
>>>>>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>>>>>> default key not provided at all?
>>>>>>>>>>>> It seems this has been already tried by Ophir [1], later 
>>>>>>>>>>>> reverted
>>>>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>>>>
>>>>>>>>>>>> According commit, the reason of revert is to support following
>>>>>>>>> command:
>>>>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 
>>>>>>>>>>>> 40 / end"
>>>>>>>>>>>>
>>>>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported 
>>>>>>>>>>>> and solve
>>>>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>>>>
>>>>>>>>>>> Hi, Ferruh
>>>>>>>>>>>     I have discussed with Phil Yang about the problem in [1]. 
>>>>>>>>>>> I think
>>>>>>>>>>> there may be other problems with the idea and there is no better
>>>>>>>>>>> solution. and we need to remove key_len definition from 
>>>>>>>>>>> rte_rss_conf
>>>>>>>>>>> structure. They don't have a plan. And [1] was eventually 
>>>>>>>>>>> reverted.
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>>>>> provided doesn't work?
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> What do you think [1] + following update, will it work?
>>>>>>>>>
>>>>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>>>>>>>> b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, 
>>>>>>>>> const size_t
>>>>>>>>> size,
>>>>>>>>>                               }),
>>>>>>>>>                               size > sizeof(*dst.rss) ? 
>>>>>>>>> sizeof(*dst.rss) : size);
>>>>>>>>>                    off = sizeof(*dst.rss);
>>>>>>>>>    -               if (src.rss->key_len) {
>>>>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>>>>>> sizeof(*dst.rss->key));
>>>>>>>>>                            tmp = sizeof(*src.rss->key) * 
>>>>>>>>> src.rss->key_len;
>>>>>>>>>                            if (size >= off + tmp)
>>>>>>>>>
>>>>>>>>
>>>>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also 
>>>>>>>> verified it on mlx5 PMD.
>>>>>>>> Advantage: it's a generic fix for all dpdk applications using 
>>>>>>>> rte_flows (not just testpmd).
>>>>>>>> It reduces code.
>>>>>>>> With this fix the responsibility of handling key==NULL and/or 
>>>>>>>> len==0 is moved to the PMDs (which is good).
>>>>>>>> With regard to Lijun patch - I liked the approach of overriding 
>>>>>>>> the default testpmd key with the default PMD key.
>>>>>>>> But it only addresses testpmd. More code was added.
>>>>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of 
>>>>>>>> parsing RSS, but it would feel more confident if we could 
>>>>>>>> confirm it for all the PMDs (by testing) or at least review the 
>>>>>>>> PMDs rss_hash_conf_get() implementations.
>>>>>>>>
>>>>>>>
>>>>>>> Lijun's idea can work. There was a problem in implementation 
>>>>>>> related to the key size assumption, which can be fixed.
>>>>>>>
>>>>>>> Even it is fixed, when user gives a rss rule without a key, we 
>>>>>>> are getting key from device and feeding same key back to device, 
>>>>>>> this is unnecessary I think.
>>>>>>> When user didn't provide a key, rss rule shouldn't touch the key 
>>>>>>> at all.
>>>>>>>
>>>>>> Do you mean that the driver should not configure the key to the 
>>>>>> hardware when the RSS key is not specified?
>>>>>
>>>>> We are talking about 'key' in RSS rte flow rule, not generally 
>>>>> configuring the device for RSS.
>>>>>
>>>> Yes, I know. However, I am talking about some implementations. The 
>>>> configuration interface may be the same as that for configuring RSS
>>>> parameters of the device in general mode.
>>>>> If a specific rss rte flow rule, lets say to filter some defined 
>>>>> packets to some specific queues, don't have 'key' as a part of 
>>>>> rule, I am suggesting not touch 'key' configuration of the device.
>>>>>
>>>> Yes, I agree. I think your point of view is very reasonable and a more
>>>> appropriate implementation. However, for the sake of simplicity and
>>>> other considerations in the architecture design of some devices, the
>>>> hardware may support reasonable hybrid configuration for paramter 
>>>> configuration in the RSS config, rather than independent configuration
>>>> for hw, that is, maybe touch A of rss configuration of the device and
>>>> must touch B of rss configuration. As a result, If the preceding 
>>>> scenario occurs, it is reasonable to configure an RSS config that 
>>>> does not change and specified.What do you think?
>>>>>> If so, we cannot identify when the user does not specify the RSS 
>>>>>> key to determine whether to configure the key.
>>>>>
>>>>> I think we can. If the rule has 'key' attribute, driver can use 
>>>>> that key to program the device, if 'key' attribute is missing, 
>>>>> don't do anything related to the rss key.
>>>>>
>>>> Yes, if 'key' attribute is missing, don't do anything related to the 
>>>> rss key. It's more reasonable.
>>>> But, If he can't do that, I think it is reasonable to configure the 
>>>> default key that already exists on the device. The only disadvantage 
>>>> is wasteful.
>>>>>> In hardware design, most vendors do not configure keys for 
>>>>>> hardware independently, which may be associated with other RSS 
>>>>>> config parameters.
>>>>>> I think it would be reasonable for us to reconfigure the RSS key 
>>>>>> with the default value configured and valid in the hardware as the 
>>>>>> default value if the user does not specify the RSS key.
>>>>>
>>>>> There are already APIs to update the RSS configuration, like RSS 
>>>>> key, hash functions etc.. They are independent from the rte flow 
>>>>> RSS rule.
>>>>> Application should configure RSS according needs using those APIs.
>>>>>
>>>> Yes, should do this. Are there any unreasonable users who simply do 
>>>> not know these APIs or do not want to use them and want to configure 
>>>> some parameters through the rte flow RSS rule without changing other 
>>>> parameters?
>>>>> The question here is about each RSS rte flow rule that can update 
>>>>> the key. Am I missing something?
>>>> I don't think you've misunderstood the general situation.
>>>> Even if the RSS key is not specified in a rule, the driver uses the 
>>>> default key value to re-touch the device.
>>>>>
>>>>>>> Complication was when user provides key_len without a key, I 
>>>>>>> think both ignoring or returning error in this case is OK.
>>>>>> I agree. However, I think it is meaningless to expose the RSS key 
>>>>>> length to users. Do you consider deleting the RSS key length 
>>>>>> directly?
>>>>>
>>>>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can 
>>>>> the driver know the size of the 'key' without 'key_len'?
>>>>> And driver should verify these provided values.
>>>>>
>>>> I know and agree.It is only during the analysis of the [1] scheme, 
>>>> from the time it was proposed to the time it was withdrawn, that I 
>>>> found some guys in the community questioned the significance of 
>>>> key_len.
>>>>
>>>> Back to the subject, what is your plan for the solution in the patch?
>>>
>>> I think, Ophir's old reverted patch [1] + 
>>> 'rte_flow_conv_action_conf()' update I proposed above can work. Is 
>>> this working for you? If so can you please send a patch?
>>>
>>>
>>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>>> .
>> Hi, Ferruh
>>     I've just used [1] + 'rte_flow_conv_action_conf()' for testing 
>> based on the Kunpeng920 NIC plation and use hns3 pmd driver. it can be 
>> resolve the RSS key question.
>>     testpmd> show port 0 rss-hash key
>> RSS functions:
>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>> RSS key:
>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>
>> testpmd> flow create 0 ingress pattern end actions rss func 
>> symmetric_toeplitz types all end / end
>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
>> hardware support, requested:7f83fffc configured:3ef8
>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
>> Flow rule #0 created
>> testpmd> show port 0 rss-hash key
>> RSS functions:
>>   all ipv4-frag ipv4-tcp ipv4-udp ipv4-sctp ipv4-other ipv6-frag 
>> ipv6-tcp ipv6-udp ipv6-sctp ipv6-other ip udp tcp sctp
>> RSS key:
>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>
>>
>> However, I also tested the case. I am not specified the RSS key and 
>> specified the key_len when create a RSS flow rule, it can create success.
>> testpmd> flow create 0 ingress pattern end actions rss queues 0 1 end 
>> key_len 40 / end
>> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
>> hardware support, requested:a38c configured:2288
>> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
>> Flow rule #0 created
>> testpmd> show port 0 rss-hash key
>> RSS functions:
>>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>> RSS key:
>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA 
>>
>>
> 
> So are you happy with this solution?
> .
Yes, thanks.
> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-20 13:35                       ` oulijun
@ 2020-10-20 14:34                         ` Ferruh Yigit
  2020-10-21  8:19                           ` oulijun
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-20 14:34 UTC (permalink / raw)
  To: oulijun, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

On 10/20/2020 2:35 PM, oulijun wrote:
> 
> 
> 在 2020/10/20 18:02, Ferruh Yigit 写道:
>> On 10/20/2020 10:00 AM, oulijun wrote:
>>>
>>>
>>> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>>>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>>>
>>>>>
>>>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>>>
>>>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>>>>> -
>>>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>>>> 0F
>>>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>>>> 2. create a rss rule
>>>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>>>
>>>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>>> RSS functions:
>>>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>>>> RSS key:
>>>>>>>>>>>> -
>>>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>>>> 206F
>>>>>>>>>>>> -76657272696465
>>>>>>>>>>>>
>>>>>>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
>>>>>>>> default key.
>>>>>>>>>>>>
>>>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>>>>>> API")
>>>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>>>
>>>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>>>> ---
>>>>>>>>>>>> V4->V5:
>>>>>>>>>>>> -rewrite the commit log
>>>>>>>>>>>> -add reviewed-by
>>>>>>>>>>>
>>>>>>>>>>> Hi Lijun,
>>>>>>>>>>>
>>>>>>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>>>>>>> but only updated the commit log, can you please check comments to
>>>>>>>> prev versions.
>>>>>>>>>>>
>>>>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>>>>> default key not provided at all?
>>>>>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>>>
>>>>>>>>>>> According commit, the reason of revert is to support following
>>>>>>>> command:
>>>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>>>>>>>
>>>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>>>
>>>>>>>>>> Hi, Ferruh
>>>>>>>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>>>>>>>> there may be other problems with the idea and there is no better
>>>>>>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>>>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>>>> provided doesn't work?
>>>>>>>>>
>>>>>>>>
>>>>>>>> What do you think [1] + following update, will it work?
>>>>>>>>
>>>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
>>>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>>>>>>>> size,
>>>>>>>>                               }),
>>>>>>>>                               size > sizeof(*dst.rss) ? sizeof(*dst.rss) 
>>>>>>>> : size);
>>>>>>>>                    off = sizeof(*dst.rss);
>>>>>>>>    -               if (src.rss->key_len) {
>>>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>>>>> sizeof(*dst.rss->key));
>>>>>>>>                            tmp = sizeof(*src.rss->key) * src.rss->key_len;
>>>>>>>>                            if (size >= off + tmp)
>>>>>>>>
>>>>>>>
>>>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also verified it 
>>>>>>> on mlx5 PMD.
>>>>>>> Advantage: it's a generic fix for all dpdk applications using rte_flows 
>>>>>>> (not just testpmd).
>>>>>>> It reduces code.
>>>>>>> With this fix the responsibility of handling key==NULL and/or len==0 is 
>>>>>>> moved to the PMDs (which is good).
>>>>>>> With regard to Lijun patch - I liked the approach of overriding the 
>>>>>>> default testpmd key with the default PMD key.
>>>>>>> But it only addresses testpmd. More code was added.
>>>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing 
>>>>>>> RSS, but it would feel more confident if we could confirm it for all the 
>>>>>>> PMDs (by testing) or at least review the PMDs rss_hash_conf_get() 
>>>>>>> implementations.
>>>>>>>
>>>>>>
>>>>>> Lijun's idea can work. There was a problem in implementation related to 
>>>>>> the key size assumption, which can be fixed.
>>>>>>
>>>>>> Even it is fixed, when user gives a rss rule without a key, we are getting 
>>>>>> key from device and feeding same key back to device, this is unnecessary I 
>>>>>> think.
>>>>>> When user didn't provide a key, rss rule shouldn't touch the key at all.
>>>>>>
>>>>> Do you mean that the driver should not configure the key to the hardware 
>>>>> when the RSS key is not specified?
>>>>
>>>> We are talking about 'key' in RSS rte flow rule, not generally configuring 
>>>> the device for RSS.
>>>>
>>> Yes, I know. However, I am talking about some implementations. The 
>>> configuration interface may be the same as that for configuring RSS
>>> parameters of the device in general mode.
>>>> If a specific rss rte flow rule, lets say to filter some defined packets to 
>>>> some specific queues, don't have 'key' as a part of rule, I am suggesting 
>>>> not touch 'key' configuration of the device.
>>>>
>>> Yes, I agree. I think your point of view is very reasonable and a more
>>> appropriate implementation. However, for the sake of simplicity and
>>> other considerations in the architecture design of some devices, the
>>> hardware may support reasonable hybrid configuration for paramter 
>>> configuration in the RSS config, rather than independent configuration
>>> for hw, that is, maybe touch A of rss configuration of the device and
>>> must touch B of rss configuration. As a result, If the preceding scenario 
>>> occurs, it is reasonable to configure an RSS config that does not change and 
>>> specified.What do you think?
>>>>> If so, we cannot identify when the user does not specify the RSS key to 
>>>>> determine whether to configure the key.
>>>>
>>>> I think we can. If the rule has 'key' attribute, driver can use that key to 
>>>> program the device, if 'key' attribute is missing, don't do anything related 
>>>> to the rss key.
>>>>
>>> Yes, if 'key' attribute is missing, don't do anything related to the rss key. 
>>> It's more reasonable.
>>> But, If he can't do that, I think it is reasonable to configure the default 
>>> key that already exists on the device. The only disadvantage is wasteful.
>>>>> In hardware design, most vendors do not configure keys for hardware 
>>>>> independently, which may be associated with other RSS config parameters.
>>>>> I think it would be reasonable for us to reconfigure the RSS key with the 
>>>>> default value configured and valid in the hardware as the default value if 
>>>>> the user does not specify the RSS key.
>>>>
>>>> There are already APIs to update the RSS configuration, like RSS key, hash 
>>>> functions etc.. They are independent from the rte flow RSS rule.
>>>> Application should configure RSS according needs using those APIs.
>>>>
>>> Yes, should do this. Are there any unreasonable users who simply do not know 
>>> these APIs or do not want to use them and want to configure some parameters 
>>> through the rte flow RSS rule without changing other parameters?
>>>> The question here is about each RSS rte flow rule that can update the key. 
>>>> Am I missing something?
>>> I don't think you've misunderstood the general situation.
>>> Even if the RSS key is not specified in a rule, the driver uses the default 
>>> key value to re-touch the device.
>>>>
>>>>>> Complication was when user provides key_len without a key, I think both 
>>>>>> ignoring or returning error in this case is OK.
>>>>> I agree. However, I think it is meaningless to expose the RSS key length to 
>>>>> users. Do you consider deleting the RSS key length directly?
>>>>
>>>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the driver 
>>>> know the size of the 'key' without 'key_len'?
>>>> And driver should verify these provided values.
>>>>
>>> I know and agree.It is only during the analysis of the [1] scheme, from the 
>>> time it was proposed to the time it was withdrawn, that I found some guys in 
>>> the community questioned the significance of key_len.
>>>
>>> Back to the subject, what is your plan for the solution in the patch?
>>
>> I think, Ophir's old reverted patch [1] + 'rte_flow_conv_action_conf()' update 
>> I proposed above can work. Is this working for you? If so can you please send 
>> a patch?
>>
>>
>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>> .
> Hi, Ferruh
>     I've just used [1] + 'rte_flow_conv_action_conf()' for testing based on the 
> Kunpeng920 NIC plation and use hns3 pmd driver. it can be resolve the RSS key 
> question.
>     testpmd> show port 0 rss-hash key
> RSS functions:
>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
> RSS key:
> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
> testpmd> flow create 0 ingress pattern end actions rss func symmetric_toeplitz 
> types all end / end
> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on hardware 
> support, requested:7f83fffc configured:3ef8
> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
> Flow rule #0 created
> testpmd> show port 0 rss-hash key
> RSS functions:
>   all ipv4-frag ipv4-tcp ipv4-udp ipv4-sctp ipv4-other ipv6-frag ipv6-tcp 
> ipv6-udp ipv6-sctp ipv6-other ip udp tcp sctp
> RSS key:
> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
> 
> However, I also tested the case. I am not specified the RSS key and specified 
> the key_len when create a RSS flow rule, it can create success.
> testpmd> flow create 0 ingress pattern end actions rss queues 0 1 end key_len 40 
> / end
> 0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on hardware 
> support, requested:a38c configured:2288
> 0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
> Flow rule #0 created
> testpmd> show port 0 rss-hash key
> RSS functions:
>   all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
> RSS key:
> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
> 

So are you happy with this solution?

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-20 10:02                     ` Ferruh Yigit
@ 2020-10-20 13:35                       ` oulijun
  2020-10-20 14:34                         ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-20 13:35 UTC (permalink / raw)
  To: Ferruh Yigit, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/20 18:02, Ferruh Yigit 写道:
> On 10/20/2020 10:00 AM, oulijun wrote:
>>
>>
>> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>>
>>>>
>>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>>> configuration. Generally, the recommended RSS hash key is 
>>>>>>>>>>> used as
>>>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>>>> different from the default RSS flow in testpmd without 
>>>>>>>>>>> specifying
>>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when 
>>>>>>>>>>> creating
>>>>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider 
>>>>>>>>>>> that
>>>>>>>>>>> the RSS key in use is the valid default key of the NIC, 
>>>>>>>>>>> actually,
>>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>>
>>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>> RSS functions:
>>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>>>> -
>>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>>> 0F
>>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>>> 2. create a rss rule
>>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>>
>>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>>> RSS functions:
>>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>>> RSS key:
>>>>>>>>>>> -
>>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>>> 206F
>>>>>>>>>>> -76657272696465
>>>>>>>>>>>
>>>>>>>>>>> In order to solve the above problems, it use the NIC valid 
>>>>>>>>>>> default
>>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>>> configuration when the RSS key is not specified in the flow 
>>>>>>>>>>> rule.
>>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS 
>>>>>>>>>>> key as the
>>>>>>> default key.
>>>>>>>>>>>
>>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>>>>> API")
>>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>>
>>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>>> ---
>>>>>>>>>>> V4->V5:
>>>>>>>>>>> -rewrite the commit log
>>>>>>>>>>> -add reviewed-by
>>>>>>>>>>
>>>>>>>>>> Hi Lijun,
>>>>>>>>>>
>>>>>>>>>> There were multiple other comments, it seems they are not 
>>>>>>>>>> addressed
>>>>>>>>>> but only updated the commit log, can you please check comments to
>>>>>>> prev versions.
>>>>>>>>>>
>>>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>>>> default key not provided at all?
>>>>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>>
>>>>>>>>>> According commit, the reason of revert is to support following
>>>>>>> command:
>>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 
>>>>>>>>>> / end"
>>>>>>>>>>
>>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and 
>>>>>>>>>> solve
>>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>>
>>>>>>>>> Hi, Ferruh
>>>>>>>>>     I have discussed with Phil Yang about the problem in [1]. I 
>>>>>>>>> think
>>>>>>>>> there may be other problems with the idea and there is no better
>>>>>>>>> solution. and we need to remove key_len definition from 
>>>>>>>>> rte_rss_conf
>>>>>>>>> structure. They don't have a plan. And [1] was eventually 
>>>>>>>>> reverted.
>>>>>>>>>
>>>>>>>>
>>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>>> provided doesn't work?
>>>>>>>>
>>>>>>>
>>>>>>> What do you think [1] + following update, will it work?
>>>>>>>
>>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>>>>>> b/lib/librte_ethdev/rte_flow.c
>>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const 
>>>>>>> size_t
>>>>>>> size,
>>>>>>>                               }),
>>>>>>>                               size > sizeof(*dst.rss) ? 
>>>>>>> sizeof(*dst.rss) : size);
>>>>>>>                    off = sizeof(*dst.rss);
>>>>>>>    -               if (src.rss->key_len) {
>>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>>>> sizeof(*dst.rss->key));
>>>>>>>                            tmp = sizeof(*src.rss->key) * 
>>>>>>> src.rss->key_len;
>>>>>>>                            if (size >= off + tmp)
>>>>>>>
>>>>>>
>>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also 
>>>>>> verified it on mlx5 PMD.
>>>>>> Advantage: it's a generic fix for all dpdk applications using 
>>>>>> rte_flows (not just testpmd).
>>>>>> It reduces code.
>>>>>> With this fix the responsibility of handling key==NULL and/or 
>>>>>> len==0 is moved to the PMDs (which is good).
>>>>>> With regard to Lijun patch - I liked the approach of overriding 
>>>>>> the default testpmd key with the default PMD key.
>>>>>> But it only addresses testpmd. More code was added.
>>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of 
>>>>>> parsing RSS, but it would feel more confident if we could confirm 
>>>>>> it for all the PMDs (by testing) or at least review the PMDs 
>>>>>> rss_hash_conf_get() implementations.
>>>>>>
>>>>>
>>>>> Lijun's idea can work. There was a problem in implementation 
>>>>> related to the key size assumption, which can be fixed.
>>>>>
>>>>> Even it is fixed, when user gives a rss rule without a key, we are 
>>>>> getting key from device and feeding same key back to device, this 
>>>>> is unnecessary I think.
>>>>> When user didn't provide a key, rss rule shouldn't touch the key at 
>>>>> all.
>>>>>
>>>> Do you mean that the driver should not configure the key to the 
>>>> hardware when the RSS key is not specified?
>>>
>>> We are talking about 'key' in RSS rte flow rule, not generally 
>>> configuring the device for RSS.
>>>
>> Yes, I know. However, I am talking about some implementations. The 
>> configuration interface may be the same as that for configuring RSS
>> parameters of the device in general mode.
>>> If a specific rss rte flow rule, lets say to filter some defined 
>>> packets to some specific queues, don't have 'key' as a part of rule, 
>>> I am suggesting not touch 'key' configuration of the device.
>>>
>> Yes, I agree. I think your point of view is very reasonable and a more
>> appropriate implementation. However, for the sake of simplicity and
>> other considerations in the architecture design of some devices, the
>> hardware may support reasonable hybrid configuration for paramter 
>> configuration in the RSS config, rather than independent configuration
>> for hw, that is, maybe touch A of rss configuration of the device and
>> must touch B of rss configuration. As a result, If the preceding 
>> scenario occurs, it is reasonable to configure an RSS config that does 
>> not change and specified.What do you think?
>>>> If so, we cannot identify when the user does not specify the RSS key 
>>>> to determine whether to configure the key.
>>>
>>> I think we can. If the rule has 'key' attribute, driver can use that 
>>> key to program the device, if 'key' attribute is missing, don't do 
>>> anything related to the rss key.
>>>
>> Yes, if 'key' attribute is missing, don't do anything related to the 
>> rss key. It's more reasonable.
>> But, If he can't do that, I think it is reasonable to configure the 
>> default key that already exists on the device. The only disadvantage 
>> is wasteful.
>>>> In hardware design, most vendors do not configure keys for hardware 
>>>> independently, which may be associated with other RSS config 
>>>> parameters.
>>>> I think it would be reasonable for us to reconfigure the RSS key 
>>>> with the default value configured and valid in the hardware as the 
>>>> default value if the user does not specify the RSS key.
>>>
>>> There are already APIs to update the RSS configuration, like RSS key, 
>>> hash functions etc.. They are independent from the rte flow RSS rule.
>>> Application should configure RSS according needs using those APIs.
>>>
>> Yes, should do this. Are there any unreasonable users who simply do 
>> not know these APIs or do not want to use them and want to configure 
>> some parameters through the rte flow RSS rule without changing other 
>> parameters?
>>> The question here is about each RSS rte flow rule that can update the 
>>> key. Am I missing something?
>> I don't think you've misunderstood the general situation.
>> Even if the RSS key is not specified in a rule, the driver uses the 
>> default key value to re-touch the device.
>>>
>>>>> Complication was when user provides key_len without a key, I think 
>>>>> both ignoring or returning error in this case is OK.
>>>> I agree. However, I think it is meaningless to expose the RSS key 
>>>> length to users. Do you consider deleting the RSS key length directly?
>>>
>>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the 
>>> driver know the size of the 'key' without 'key_len'?
>>> And driver should verify these provided values.
>>>
>> I know and agree.It is only during the analysis of the [1] scheme, 
>> from the time it was proposed to the time it was withdrawn, that I 
>> found some guys in the community questioned the significance of key_len.
>>
>> Back to the subject, what is your plan for the solution in the patch?
> 
> I think, Ophir's old reverted patch [1] + 'rte_flow_conv_action_conf()' 
> update I proposed above can work. Is this working for you? If so can you 
> please send a patch?
> 
> 
> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
> .
Hi, Ferruh
    I've just used [1] + 'rte_flow_conv_action_conf()' for testing based 
on the Kunpeng920 NIC plation and use hns3 pmd driver. it can be resolve 
the RSS key question.
    testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
RSS key:
6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA
testpmd> flow create 0 ingress pattern end actions rss func 
symmetric_toeplitz types all end / end
0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
hardware support, requested:7f83fffc configured:3ef8
0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
Flow rule #0 created
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-frag ipv4-tcp ipv4-udp ipv4-sctp ipv4-other ipv6-frag 
ipv6-tcp ipv6-udp ipv6-sctp ipv6-other ip udp tcp sctp
RSS key:
6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA

However, I also tested the case. I am not specified the RSS key and 
specified the key_len when create a RSS flow rule, it can create success.
testpmd> flow create 0 ingress pattern end actions rss queues 0 1 end 
key_len 40 / end
0000:7d:00.0 hns3_config_rss_filter(): modified RSS types based on 
hardware support, requested:a38c configured:2288
0000:7d:00.0 hns3_parse_rss_key(): no valid RSS key config, using default
Flow rule #0 created
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
RSS key:
6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F20C6A42B73BBEAC01FA

> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-20  9:00                   ` oulijun
@ 2020-10-20 10:02                     ` Ferruh Yigit
  2020-10-20 13:35                       ` oulijun
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-20 10:02 UTC (permalink / raw)
  To: oulijun, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

On 10/20/2020 10:00 AM, oulijun wrote:
> 
> 
> 在 2020/10/16 18:57, Ferruh Yigit 写道:
>> On 10/16/2020 11:04 AM, oulijun wrote:
>>>
>>>
>>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>>
>>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>> RSS functions:
>>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>>> -
>>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>>> 0F
>>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>>> 2. create a rss rule
>>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>>> testpmd> actions rss \
>>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>>
>>>>>>>>>> 3. show rss-hash key
>>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>>> RSS functions:
>>>>>>>>>>     all ipv4-udp udp
>>>>>>>>>> RSS key:
>>>>>>>>>> -
>>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>>> 206F
>>>>>>>>>> -76657272696465
>>>>>>>>>>
>>>>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
>>>>>> default key.
>>>>>>>>>>
>>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>>>> API")
>>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>>
>>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>>> ---
>>>>>>>>>> V4->V5:
>>>>>>>>>> -rewrite the commit log
>>>>>>>>>> -add reviewed-by
>>>>>>>>>
>>>>>>>>> Hi Lijun,
>>>>>>>>>
>>>>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>>>>> but only updated the commit log, can you please check comments to
>>>>>> prev versions.
>>>>>>>>>
>>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>>> default key not provided at all?
>>>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>>
>>>>>>>>> According commit, the reason of revert is to support following
>>>>>> command:
>>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>>>>>
>>>>>>>>> @Ophir, @Lijun,
>>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>>
>>>>>>>> Hi, Ferruh
>>>>>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>>>>>> there may be other problems with the idea and there is no better
>>>>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>>>>
>>>>>>>
>>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>>> provided doesn't work?
>>>>>>>
>>>>>>
>>>>>> What do you think [1] + following update, will it work?
>>>>>>
>>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
>>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>>>>>> size,
>>>>>>                               }),
>>>>>>                               size > sizeof(*dst.rss) ? sizeof(*dst.rss) : 
>>>>>> size);
>>>>>>                    off = sizeof(*dst.rss);
>>>>>>    -               if (src.rss->key_len) {
>>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>>                            off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
>>>>>>                            tmp = sizeof(*src.rss->key) * src.rss->key_len;
>>>>>>                            if (size >= off + tmp)
>>>>>>
>>>>>
>>>>> Ferruh, your suggestion ([1] + update) looks correct. I also verified it on 
>>>>> mlx5 PMD.
>>>>> Advantage: it's a generic fix for all dpdk applications using rte_flows 
>>>>> (not just testpmd).
>>>>> It reduces code.
>>>>> With this fix the responsibility of handling key==NULL and/or len==0 is 
>>>>> moved to the PMDs (which is good).
>>>>> With regard to Lijun patch - I liked the approach of overriding the default 
>>>>> testpmd key with the default PMD key.
>>>>> But it only addresses testpmd. More code was added.
>>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing RSS, 
>>>>> but it would feel more confident if we could confirm it for all the PMDs 
>>>>> (by testing) or at least review the PMDs rss_hash_conf_get() implementations.
>>>>>
>>>>
>>>> Lijun's idea can work. There was a problem in implementation related to the 
>>>> key size assumption, which can be fixed.
>>>>
>>>> Even it is fixed, when user gives a rss rule without a key, we are getting 
>>>> key from device and feeding same key back to device, this is unnecessary I 
>>>> think.
>>>> When user didn't provide a key, rss rule shouldn't touch the key at all.
>>>>
>>> Do you mean that the driver should not configure the key to the hardware when 
>>> the RSS key is not specified?
>>
>> We are talking about 'key' in RSS rte flow rule, not generally configuring the 
>> device for RSS.
>>
> Yes, I know. However, I am talking about some implementations. The configuration 
> interface may be the same as that for configuring RSS
> parameters of the device in general mode.
>> If a specific rss rte flow rule, lets say to filter some defined packets to 
>> some specific queues, don't have 'key' as a part of rule, I am suggesting not 
>> touch 'key' configuration of the device.
>>
> Yes, I agree. I think your point of view is very reasonable and a more
> appropriate implementation. However, for the sake of simplicity and
> other considerations in the architecture design of some devices, the
> hardware may support reasonable hybrid configuration for paramter configuration 
> in the RSS config, rather than independent configuration
> for hw, that is, maybe touch A of rss configuration of the device and
> must touch B of rss configuration. As a result, If the preceding scenario 
> occurs, it is reasonable to configure an RSS config that does not change and 
> specified.What do you think?
>>> If so, we cannot identify when the user does not specify the RSS key to 
>>> determine whether to configure the key.
>>
>> I think we can. If the rule has 'key' attribute, driver can use that key to 
>> program the device, if 'key' attribute is missing, don't do anything related 
>> to the rss key.
>>
> Yes, if 'key' attribute is missing, don't do anything related to the rss key. 
> It's more reasonable.
> But, If he can't do that, I think it is reasonable to configure the default key 
> that already exists on the device. The only disadvantage is wasteful.
>>> In hardware design, most vendors do not configure keys for hardware 
>>> independently, which may be associated with other RSS config parameters.
>>> I think it would be reasonable for us to reconfigure the RSS key with the 
>>> default value configured and valid in the hardware as the default value if 
>>> the user does not specify the RSS key.
>>
>> There are already APIs to update the RSS configuration, like RSS key, hash 
>> functions etc.. They are independent from the rte flow RSS rule.
>> Application should configure RSS according needs using those APIs.
>>
> Yes, should do this. Are there any unreasonable users who simply do not know 
> these APIs or do not want to use them and want to configure some parameters 
> through the rte flow RSS rule without changing other parameters?
>> The question here is about each RSS rte flow rule that can update the key. Am 
>> I missing something?
> I don't think you've misunderstood the general situation.
> Even if the RSS key is not specified in a rule, the driver uses the default key 
> value to re-touch the device.
>>
>>>> Complication was when user provides key_len without a key, I think both 
>>>> ignoring or returning error in this case is OK.
>>> I agree. However, I think it is meaningless to expose the RSS key length to 
>>> users. Do you consider deleting the RSS key length directly?
>>
>> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the driver 
>> know the size of the 'key' without 'key_len'?
>> And driver should verify these provided values.
>>
> I know and agree.It is only during the analysis of the [1] scheme, from the time 
> it was proposed to the time it was withdrawn, that I found some guys in the 
> community questioned the significance of key_len.
> 
> Back to the subject, what is your plan for the solution in the patch?

I think, Ophir's old reverted patch [1] + 'rte_flow_conv_action_conf()' update I 
proposed above can work. Is this working for you? If so can you please send a patch?


[1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-16 10:57                 ` Ferruh Yigit
  2020-10-16 14:59                   ` Ophir Munk
@ 2020-10-20  9:00                   ` oulijun
  2020-10-20 10:02                     ` Ferruh Yigit
  1 sibling, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-20  9:00 UTC (permalink / raw)
  To: Ferruh Yigit, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/16 18:57, Ferruh Yigit 写道:
> On 10/16/2020 11:04 AM, oulijun wrote:
>>
>>
>> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>>
>>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>>> 1. first, startup testpmd:
>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>> RSS functions:
>>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>>> -
>>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>>> 0F
>>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>>> 2. create a rss rule
>>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>>> testpmd> actions rss \
>>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>>
>>>>>>>>> 3. show rss-hash key
>>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>>> RSS functions:
>>>>>>>>>     all ipv4-udp udp
>>>>>>>>> RSS key:
>>>>>>>>> -
>>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>>> 206F
>>>>>>>>> -76657272696465
>>>>>>>>>
>>>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS 
>>>>>>>>> key as the
>>>>> default key.
>>>>>>>>>
>>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>>> API")
>>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>>
>>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>>> ---
>>>>>>>>> V4->V5:
>>>>>>>>> -rewrite the commit log
>>>>>>>>> -add reviewed-by
>>>>>>>>
>>>>>>>> Hi Lijun,
>>>>>>>>
>>>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>>>> but only updated the commit log, can you please check comments to
>>>>> prev versions.
>>>>>>>>
>>>>>>>> Before going into the details, my question was what happens if
>>>>>>>> default key not provided at all?
>>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>>> back [2] bringing the initial issue back.
>>>>>>>>
>>>>>>>> According commit, the reason of revert is to support following
>>>>> command:
>>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / 
>>>>>>>> end"
>>>>>>>>
>>>>>>>> @Ophir, @Lijun,
>>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>>>> current issue as initially intended ([1])?
>>>>>>>>
>>>>>>> Hi, Ferruh
>>>>>>>     I have discussed with Phil Yang about the problem in [1]. I 
>>>>>>> think
>>>>>>> there may be other problems with the idea and there is no better
>>>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>>>
>>>>>>
>>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>>> provided doesn't work?
>>>>>>
>>>>>
>>>>> What do you think [1] + following update, will it work?
>>>>>
>>>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>>>> b/lib/librte_ethdev/rte_flow.c
>>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const 
>>>>> size_t
>>>>> size,
>>>>>                               }),
>>>>>                               size > sizeof(*dst.rss) ? 
>>>>> sizeof(*dst.rss) : size);
>>>>>                    off = sizeof(*dst.rss);
>>>>>    -               if (src.rss->key_len) {
>>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>>                            off = RTE_ALIGN_CEIL(off, 
>>>>> sizeof(*dst.rss->key));
>>>>>                            tmp = sizeof(*src.rss->key) * 
>>>>> src.rss->key_len;
>>>>>                            if (size >= off + tmp)
>>>>>
>>>>
>>>> Ferruh, your suggestion ([1] + update) looks correct. I also 
>>>> verified it on mlx5 PMD.
>>>> Advantage: it's a generic fix for all dpdk applications using 
>>>> rte_flows (not just testpmd).
>>>> It reduces code.
>>>> With this fix the responsibility of handling key==NULL and/or len==0 
>>>> is moved to the PMDs (which is good).
>>>> With regard to Lijun patch - I liked the approach of overriding the 
>>>> default testpmd key with the default PMD key.
>>>> But it only addresses testpmd. More code was added.
>>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of 
>>>> parsing RSS, but it would feel more confident if we could confirm it 
>>>> for all the PMDs (by testing) or at least review the PMDs 
>>>> rss_hash_conf_get() implementations.
>>>>
>>>
>>> Lijun's idea can work. There was a problem in implementation related 
>>> to the key size assumption, which can be fixed.
>>>
>>> Even it is fixed, when user gives a rss rule without a key, we are 
>>> getting key from device and feeding same key back to device, this is 
>>> unnecessary I think.
>>> When user didn't provide a key, rss rule shouldn't touch the key at all.
>>>
>> Do you mean that the driver should not configure the key to the 
>> hardware when the RSS key is not specified?
> 
> We are talking about 'key' in RSS rte flow rule, not generally 
> configuring the device for RSS.
> 
Yes, I know. However, I am talking about some implementations. The 
configuration interface may be the same as that for configuring RSS
parameters of the device in general mode.
> If a specific rss rte flow rule, lets say to filter some defined packets 
> to some specific queues, don't have 'key' as a part of rule, I am 
> suggesting not touch 'key' configuration of the device.
> 
Yes, I agree. I think your point of view is very reasonable and a more
appropriate implementation. However, for the sake of simplicity and
other considerations in the architecture design of some devices, the
hardware may support reasonable hybrid configuration for paramter 
configuration in the RSS config, rather than independent configuration
for hw, that is, maybe touch A of rss configuration of the device and
must touch B of rss configuration. As a result, If the preceding 
scenario occurs, it is reasonable to configure an RSS config that does 
not change and specified.What do you think?
>> If so, we cannot identify when the user does not specify the RSS key 
>> to determine whether to configure the key.
> 
> I think we can. If the rule has 'key' attribute, driver can use that key 
> to program the device, if 'key' attribute is missing, don't do anything 
> related to the rss key.
> 
Yes, if 'key' attribute is missing, don't do anything related to the rss 
key. It's more reasonable.
But, If he can't do that, I think it is reasonable to configure the 
default key that already exists on the device. The only disadvantage is 
wasteful.
>> In hardware design, most vendors do not configure keys for hardware 
>> independently, which may be associated with other RSS config parameters.
>> I think it would be reasonable for us to reconfigure the RSS key with 
>> the default value configured and valid in the hardware as the default 
>> value if the user does not specify the RSS key.
> 
> There are already APIs to update the RSS configuration, like RSS key, 
> hash functions etc.. They are independent from the rte flow RSS rule.
> Application should configure RSS according needs using those APIs.
> 
Yes, should do this. Are there any unreasonable users who simply do not 
know these APIs or do not want to use them and want to configure some 
parameters through the rte flow RSS rule without changing other parameters?
> The question here is about each RSS rte flow rule that can update the 
> key. Am I missing something?
I don't think you've misunderstood the general situation.
Even if the RSS key is not specified in a rule, the driver uses the 
default key value to re-touch the device.
> 
>>> Complication was when user provides key_len without a key, I think 
>>> both ignoring or returning error in this case is OK.
>> I agree. However, I think it is meaningless to expose the RSS key 
>> length to users. Do you consider deleting the RSS key length directly?
> 
> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the 
> driver know the size of the 'key' without 'key_len'?
> And driver should verify these provided values.
> 
I know and agree.It is only during the analysis of the [1] scheme, from 
the time it was proposed to the time it was withdrawn, that I found some 
guys in the community questioned the significance of key_len.

Back to the subject, what is your plan for the solution in the patch?
> .
> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-16 10:05                 ` oulijun
@ 2020-10-16 15:13                   ` Ophir Munk
  0 siblings, 0 replies; 24+ messages in thread
From: Ophir Munk @ 2020-10-16 15:13 UTC (permalink / raw)
  To: oulijun, Ferruh Yigit, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam


> -----Original Message-----
> From: oulijun <oulijun@huawei.com>
> Sent: Friday, October 16, 2020 1:06 PM
ndle all cases.
> >
> Do you agree with [1] + Ferruh update solution?

Yes.
In that case your PMD may get a NULL RSS key. Then you can override it with your default key (if HW is not already configured with the default).

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-16 10:57                 ` Ferruh Yigit
@ 2020-10-16 14:59                   ` Ophir Munk
  2020-10-20  9:00                   ` oulijun
  1 sibling, 0 replies; 24+ messages in thread
From: Ophir Munk @ 2020-10-16 14:59 UTC (permalink / raw)
  To: Ferruh Yigit, oulijun, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



Ferruh Yigit <ferruh.yigit@intel.com> wrote:
> Sent: Friday, October 16, 2020 1:57 PM
> >> Lijun's idea can work. There was a problem in implementation related
> >> to the key size assumption, which can be fixed.
> >>
> >> Even it is fixed, when user gives a rss rule without a key, we are
> >> getting key from device and feeding same key back to device, this is
> unnecessary I think.
> >> When user didn't provide a key, rss rule shouldn't touch the key at all.
> >>
> > Do you mean that the driver should not configure the key to the
> > hardware when the RSS key is not specified?
> 

I would consider 2 user types:
1. A user who knows the HW capabilities and wish to get a distribution by specifying an explicit key.
2. A clueless user that is not familiar with the NIC HW. For example, a switching application which runs on any NIC. In that case the switching application will not configure a key. The HW driver can decide to configure the default key if not configured.
On the rte flow level we should communicate to the PMD that no key was specified.
Inside the PMD any decision can be taken (e.g. configuring the default key).
All of this is supported by PMD call backs to rte calls such as flow_validate(), flow_translate().

> We are talking about 'key' in RSS rte flow rule, not generally configuring the
> device for RSS.
> 
> If a specific rss rte flow rule, lets say to filter some defined packets to some
> specific queues, don't have 'key' as a part of rule, I am suggesting not touch
> 'key' configuration of the device.
> 
> > If so, we cannot identify when the user does not specify the RSS key
> > to determine whether to configure the key.
> 
> I think we can. If the rule has 'key' attribute, driver can use that key to
> program the device, if 'key' attribute is missing, don't do anything related to
> the rss key.

The driver is free to take any decision when a key is missing.
 
> > In hardware design, most vendors do not configure keys for hardware
> > independently, which may be associated with other RSS config parameters.
> > I think it would be reasonable for us to reconfigure the RSS key with
> > the default value configured and valid in the hardware as the default
> > value if the user does not specify the RSS key.
> 
> There are already APIs to update the RSS configuration, like RSS key, hash
> functions etc.. They are independent from the rte flow RSS rule.
> Application should configure RSS according needs using those APIs.
> 
> The question here is about each RSS rte flow rule that can update the key.
> Am I missing something?
> 
> >> Complication was when user provides key_len without a key, I think
> >> both ignoring or returning error in this case is OK.
> > I agree. However, I think it is meaningless to expose the RSS key
> > length to users. Do you consider deleting the RSS key length directly?
> 
> Isn't both 'key' and 'key_len' needed to program the RSS key? Can the driver
> know the size of the 'key' without 'key_len'?
> And driver should verify these provided values.

The key_len must be explicit. Key itself is just a pointer to an array of bytes. 


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-16 10:04               ` oulijun
@ 2020-10-16 10:57                 ` Ferruh Yigit
  2020-10-16 14:59                   ` Ophir Munk
  2020-10-20  9:00                   ` oulijun
  0 siblings, 2 replies; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-16 10:57 UTC (permalink / raw)
  To: oulijun, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

On 10/16/2020 11:04 AM, oulijun wrote:
> 
> 
> 在 2020/10/16 7:53, Ferruh Yigit 写道:
>> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>>
>>>>>>>> Consider the follow usage with testpmd:
>>>>>>>> 1. first, startup testpmd:
>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>> RSS functions:
>>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>>> -
>>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>>> 0F
>>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>>> 2. create a rss rule
>>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>>> testpmd> actions rss \
>>>>>>>> types ipv4-udp end queues end / end
>>>>>>>>
>>>>>>>> 3. show rss-hash key
>>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>>> RSS functions:
>>>>>>>>     all ipv4-udp udp
>>>>>>>> RSS key:
>>>>>>>> -
>>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>>> 206F
>>>>>>>> -76657272696465
>>>>>>>>
>>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
>>>> default key.
>>>>>>>>
>>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>>> API")
>>>>>>>> Cc: stable@dpdk.org
>>>>>>>>
>>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>>> ---
>>>>>>>> V4->V5:
>>>>>>>> -rewrite the commit log
>>>>>>>> -add reviewed-by
>>>>>>>
>>>>>>> Hi Lijun,
>>>>>>>
>>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>>> but only updated the commit log, can you please check comments to
>>>> prev versions.
>>>>>>>
>>>>>>> Before going into the details, my question was what happens if
>>>>>>> default key not provided at all?
>>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>>> back [2] bringing the initial issue back.
>>>>>>>
>>>>>>> According commit, the reason of revert is to support following
>>>> command:
>>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>>>
>>>>>>> @Ophir, @Lijun,
>>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>>> current issue as initially intended ([1])?
>>>>>>>
>>>>>> Hi, Ferruh
>>>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>>>> there may be other problems with the idea and there is no better
>>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>>
>>>>>
>>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>>> provided doesn't work?
>>>>>
>>>>
>>>> What do you think [1] + following update, will it work?
>>>>
>>>>    diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
>>>>    index ee4f3464fe..e7789c87b3 100644
>>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>>>> size,
>>>>                               }),
>>>>                               size > sizeof(*dst.rss) ? sizeof(*dst.rss) : 
>>>> size);
>>>>                    off = sizeof(*dst.rss);
>>>>    -               if (src.rss->key_len) {
>>>>    +               if (src.rss->key_len && src.rss->key) {
>>>>                            off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
>>>>                            tmp = sizeof(*src.rss->key) * src.rss->key_len;
>>>>                            if (size >= off + tmp)
>>>>
>>>
>>> Ferruh, your suggestion ([1] + update) looks correct. I also verified it on 
>>> mlx5 PMD.
>>> Advantage: it's a generic fix for all dpdk applications using rte_flows (not 
>>> just testpmd).
>>> It reduces code.
>>> With this fix the responsibility of handling key==NULL and/or len==0 is moved 
>>> to the PMDs (which is good).
>>> With regard to Lijun patch - I liked the approach of overriding the default 
>>> testpmd key with the default PMD key.
>>> But it only addresses testpmd. More code was added.
>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing RSS, 
>>> but it would feel more confident if we could confirm it for all the PMDs (by 
>>> testing) or at least review the PMDs rss_hash_conf_get() implementations.
>>>
>>
>> Lijun's idea can work. There was a problem in implementation related to the 
>> key size assumption, which can be fixed.
>>
>> Even it is fixed, when user gives a rss rule without a key, we are getting key 
>> from device and feeding same key back to device, this is unnecessary I think.
>> When user didn't provide a key, rss rule shouldn't touch the key at all.
>>
> Do you mean that the driver should not configure the key to the hardware when 
> the RSS key is not specified?

We are talking about 'key' in RSS rte flow rule, not generally configuring the 
device for RSS.

If a specific rss rte flow rule, lets say to filter some defined packets to some 
specific queues, don't have 'key' as a part of rule, I am suggesting not touch 
'key' configuration of the device.

> If so, we cannot identify when the user does not specify the RSS key to 
> determine whether to configure the key.

I think we can. If the rule has 'key' attribute, driver can use that key to 
program the device, if 'key' attribute is missing, don't do anything related to 
the rss key.

> In hardware design, most vendors do not configure keys for hardware 
> independently, which may be associated with other RSS config parameters.
> I think it would be reasonable for us to reconfigure the RSS key with the 
> default value configured and valid in the hardware as the default value if the 
> user does not specify the RSS key.

There are already APIs to update the RSS configuration, like RSS key, hash 
functions etc.. They are independent from the rte flow RSS rule.
Application should configure RSS according needs using those APIs.

The question here is about each RSS rte flow rule that can update the key. Am I 
missing something?

>> Complication was when user provides key_len without a key, I think both 
>> ignoring or returning error in this case is OK.
> I agree. However, I think it is meaningless to expose the RSS key length to 
> users. Do you consider deleting the RSS key length directly?

Isn't both 'key' and 'key_len' needed to program the RSS key? Can the driver 
know the size of the 'key' without 'key_len'?
And driver should verify these provided values.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-16  6:46               ` Ophir Munk
@ 2020-10-16 10:05                 ` oulijun
  2020-10-16 15:13                   ` Ophir Munk
  0 siblings, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-16 10:05 UTC (permalink / raw)
  To: Ophir Munk, Ferruh Yigit, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/16 14:46, Ophir Munk 写道:
> 
> 
>> -----Original Message-----
>> From: Ferruh Yigit <ferruh.yigit@intel.com>
> <..>
>>>>
>>>
>>> Ferruh, your suggestion ([1] + update) looks correct. I also verified it on
>> mlx5 PMD.
>>> Advantage: it's a generic fix for all dpdk applications using rte_flows (not
>> just testpmd).
>>> It reduces code.
>>> With this fix the responsibility of handling key==NULL and/or len==0 is
>> moved to the PMDs (which is good).
>>>
>>> With regard to Lijun patch - I liked the approach of overriding the default
>> testpmd key with the default PMD key.
>>> But it only addresses testpmd. More code was added.
>>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing
>> RSS, but it would feel more confident if we could confirm it for all the PMDs
>> (by testing) or at least review the PMDs rss_hash_conf_get()
>> implementations.
>>>
>>
>> Lijun's idea can work. There was a problem in implementation related to the
>> key size assumption, which can be fixed.
>>
>> Even it is fixed, when user gives a rss rule without a key, we are getting key
>> from device and feeding same key back to device, this is unnecessary I think.
> 
> I agree.
> 
>> When user didn't provide a key, rss rule shouldn't touch the key at all.
> 
> Agreed as well.
> 
>> Complication was when user provides key_len without a key, I think both
>> ignoring or returning error in this case is OK.
> 
> I think that in general flow rules should arrive "as is" to the PMD which has its
> validation and translation APIs to handle all cases.
> 
Do you agree with [1] + Ferruh update solution?

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 23:53             ` Ferruh Yigit
  2020-10-16  0:14               ` Ajit Khaparde
  2020-10-16  6:46               ` Ophir Munk
@ 2020-10-16 10:04               ` oulijun
  2020-10-16 10:57                 ` Ferruh Yigit
  2 siblings, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-16 10:04 UTC (permalink / raw)
  To: Ferruh Yigit, Ophir Munk, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



在 2020/10/16 7:53, Ferruh Yigit 写道:
> On 10/16/2020 12:21 AM, Ophir Munk wrote:
>>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>>> the default key in the driver. In addition, the default key is
>>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>>
>>>>>>> Consider the follow usage with testpmd:
>>>>>>> 1. first, startup testpmd:
>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>> RSS functions:
>>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>>> -
>>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>>> 0F
>>>>>>> -20C6A42B73BBEAC01FA
>>>>>>> 2. create a rss rule
>>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>>> testpmd> actions rss \
>>>>>>> types ipv4-udp end queues end / end
>>>>>>>
>>>>>>> 3. show rss-hash key
>>>>>>> testpmd> show port 0 rss-hash key
>>>>>>> RSS functions:
>>>>>>>     all ipv4-udp udp
>>>>>>> RSS key:
>>>>>>> -
>>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>>> 206F
>>>>>>> -76657272696465
>>>>>>>
>>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key 
>>>>>>> as the
>>> default key.
>>>>>>>
>>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>>> API")
>>>>>>> Cc: stable@dpdk.org
>>>>>>>
>>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>>> ---
>>>>>>> V4->V5:
>>>>>>> -rewrite the commit log
>>>>>>> -add reviewed-by
>>>>>>
>>>>>> Hi Lijun,
>>>>>>
>>>>>> There were multiple other comments, it seems they are not addressed
>>>>>> but only updated the commit log, can you please check comments to
>>> prev versions.
>>>>>>
>>>>>> Before going into the details, my question was what happens if
>>>>>> default key not provided at all?
>>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>>> back [2] bringing the initial issue back.
>>>>>>
>>>>>> According commit, the reason of revert is to support following
>>> command:
>>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>>
>>>>>> @Ophir, @Lijun,
>>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>>> current issue as initially intended ([1])?
>>>>>>
>>>>> Hi, Ferruh
>>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>>> there may be other problems with the idea and there is no better
>>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>>
>>>>
>>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>>> provided doesn't work?
>>>>
>>>
>>> What do you think [1] + following update, will it work?
>>>
>>>    diff --git a/lib/librte_ethdev/rte_flow.c 
>>> b/lib/librte_ethdev/rte_flow.c
>>>    index ee4f3464fe..e7789c87b3 100644
>>>    --- a/lib/librte_ethdev/rte_flow.c
>>>    +++ b/lib/librte_ethdev/rte_flow.c
>>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>>> size,
>>>                               }),
>>>                               size > sizeof(*dst.rss) ? 
>>> sizeof(*dst.rss) : size);
>>>                    off = sizeof(*dst.rss);
>>>    -               if (src.rss->key_len) {
>>>    +               if (src.rss->key_len && src.rss->key) {
>>>                            off = RTE_ALIGN_CEIL(off, 
>>> sizeof(*dst.rss->key));
>>>                            tmp = sizeof(*src.rss->key) * 
>>> src.rss->key_len;
>>>                            if (size >= off + tmp)
>>>
>>
>> Ferruh, your suggestion ([1] + update) looks correct. I also verified 
>> it on mlx5 PMD.
>> Advantage: it's a generic fix for all dpdk applications using 
>> rte_flows (not just testpmd).
>> It reduces code.
>> With this fix the responsibility of handling key==NULL and/or len==0 
>> is moved to the PMDs (which is good).
>> With regard to Lijun patch - I liked the approach of overriding the 
>> default testpmd key with the default PMD key.
>> But it only addresses testpmd. More code was added.
>> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing 
>> RSS, but it would feel more confident if we could confirm it for all 
>> the PMDs (by testing) or at least review the PMDs rss_hash_conf_get() 
>> implementations.
>>
> 
> Lijun's idea can work. There was a problem in implementation related to 
> the key size assumption, which can be fixed.
> 
> Even it is fixed, when user gives a rss rule without a key, we are 
> getting key from device and feeding same key back to device, this is 
> unnecessary I think.
> When user didn't provide a key, rss rule shouldn't touch the key at all.
> 
Do you mean that the driver should not configure the key to the hardware 
when the RSS key is not specified?
If so, we cannot identify when the user does not specify the RSS key to 
determine whether to configure the key.
In hardware design, most vendors do not configure keys for hardware 
independently, which may be associated with other RSS config parameters.
I think it would be reasonable for us to reconfigure the RSS key with 
the default value configured and valid in the hardware as the default 
value if the user does not specify the RSS key.
> Complication was when user provides key_len without a key, I think both 
> ignoring or returning error in this case is OK.
I agree. However, I think it is meaningless to expose the RSS key length 
to users. Do you consider deleting the RSS key length directly?
> .
> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 23:53             ` Ferruh Yigit
  2020-10-16  0:14               ` Ajit Khaparde
@ 2020-10-16  6:46               ` Ophir Munk
  2020-10-16 10:05                 ` oulijun
  2020-10-16 10:04               ` oulijun
  2 siblings, 1 reply; 24+ messages in thread
From: Ophir Munk @ 2020-10-16  6:46 UTC (permalink / raw)
  To: Ferruh Yigit, oulijun, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam



> -----Original Message-----
> From: Ferruh Yigit <ferruh.yigit@intel.com>
<..>
> >>
> >
> > Ferruh, your suggestion ([1] + update) looks correct. I also verified it on
> mlx5 PMD.
> > Advantage: it's a generic fix for all dpdk applications using rte_flows (not
> just testpmd).
> > It reduces code.
> > With this fix the responsibility of handling key==NULL and/or len==0 is
> moved to the PMDs (which is good).
> >
> > With regard to Lijun patch - I liked the approach of overriding the default
> testpmd key with the default PMD key.
> > But it only addresses testpmd. More code was added.
> > It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing
> RSS, but it would feel more confident if we could confirm it for all the PMDs
> (by testing) or at least review the PMDs rss_hash_conf_get()
> implementations.
> >
> 
> Lijun's idea can work. There was a problem in implementation related to the
> key size assumption, which can be fixed.
> 
> Even it is fixed, when user gives a rss rule without a key, we are getting key
> from device and feeding same key back to device, this is unnecessary I think.

I agree.

> When user didn't provide a key, rss rule shouldn't touch the key at all.

Agreed as well.

> Complication was when user provides key_len without a key, I think both
> ignoring or returning error in this case is OK.

I think that in general flow rules should arrive "as is" to the PMD which has its
validation and translation APIs to handle all cases.


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 23:53             ` Ferruh Yigit
@ 2020-10-16  0:14               ` Ajit Khaparde
  2020-10-16  6:46               ` Ophir Munk
  2020-10-16 10:04               ` oulijun
  2 siblings, 0 replies; 24+ messages in thread
From: Ajit Khaparde @ 2020-10-16  0:14 UTC (permalink / raw)
  To: Ferruh Yigit
  Cc: Ophir Munk, oulijun, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil, dev, linuxarm, Ori Kam

On Thu, Oct 15, 2020 at 4:54 PM Ferruh Yigit <ferruh.yigit@intel.com> wrote:
>
> On 10/16/2020 12:21 AM, Ophir Munk wrote:
> >> From: Ferruh Yigit <ferruh.yigit@intel.com>
> >>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
> >>>>>> When start the testpmd, the pmd driver initializes the RSS
> >>>>>> configuration. Generally, the recommended RSS hash key is used as
> >>>>>> the default key in the driver. In addition, the default key is
> >>>>>> different from the default RSS flow in testpmd without specifying
> >>>>>> RSS hash key. So. if you do not specify the RSS key when creating
> >>>>>> an RSS rule, the testpmd uses the default key as the default RSS
> >>>>>> key of the RSS rule. As a result, you may mistakenly consider that
> >>>>>> the RSS key in use is the valid default key of the NIC, actually,
> >>>>>> the key and the valid default key of the NIC are two values.
> >>>>>>
> >>>>>> Consider the follow usage with testpmd:
> >>>>>> 1. first, startup testpmd:
> >>>>>> testpmd> show port 0 rss-hash key
> >>>>>> RSS functions:
> >>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
> >>>>>> -
> >> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
> >> 0F
> >>>>>> -20C6A42B73BBEAC01FA
> >>>>>> 2. create a rss rule
> >>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
> >>>>>> testpmd> actions rss \
> >>>>>> types ipv4-udp end queues end / end
> >>>>>>
> >>>>>> 3. show rss-hash key
> >>>>>> testpmd> show port 0 rss-hash key
> >>>>>> RSS functions:
> >>>>>>     all ipv4-udp udp
> >>>>>> RSS key:
> >>>>>> -
> >> 74657374706D6427732064656661756C74205253532068617368206B65792C
> >> 206F
> >>>>>> -76657272696465
> >>>>>>
> >>>>>> In order to solve the above problems, it use the NIC valid default
> >>>>>> RSS key instead of the testpmd dummy RSS key in the flow
> >>>>>> configuration when the RSS key is not specified in the flow rule.
> >>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
> >> default key.
> >>>>>>
> >>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
> >>>>>> API")
> >>>>>> Cc: stable@dpdk.org
> >>>>>>
> >>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
> >>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
> >>>>>> ---
> >>>>>> V4->V5:
> >>>>>> -rewrite the commit log
> >>>>>> -add reviewed-by
> >>>>>
> >>>>> Hi Lijun,
> >>>>>
> >>>>> There were multiple other comments, it seems they are not addressed
> >>>>> but only updated the commit log, can you please check comments to
> >> prev versions.
> >>>>>
> >>>>> Before going into the details, my question was what happens if
> >>>>> default key not provided at all?
> >>>>> It seems this has been already tried by Ophir [1], later reverted
> >>>>> back [2] bringing the initial issue back.
> >>>>>
> >>>>> According commit, the reason of revert is to support following
> >> command:
> >>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
> >>>>>
> >>>>> @Ophir, @Lijun,
> >>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
> >>>>> current issue as initially intended ([1])?
> >>>>>
> >>>> Hi, Ferruh
> >>>>     I have discussed with Phil Yang about the problem in [1]. I think
> >>>> there may be other problems with the idea and there is no better
> >>>> solution. and we need to remove key_len definition from rte_rss_conf
> >>>> structure. They don't have a plan. And [1] was eventually reverted.
> >>>>
> >>>
> >>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
> >>> provided doesn't work?
> >>>
> >>
> >> What do you think [1] + following update, will it work?
> >>
> >>    diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
> >>    index ee4f3464fe..e7789c87b3 100644
> >>    --- a/lib/librte_ethdev/rte_flow.c
> >>    +++ b/lib/librte_ethdev/rte_flow.c
> >>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
> >> size,
> >>                               }),
> >>                               size > sizeof(*dst.rss) ? sizeof(*dst.rss) : size);
> >>                    off = sizeof(*dst.rss);
> >>    -               if (src.rss->key_len) {
> >>    +               if (src.rss->key_len && src.rss->key) {
> >>                            off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
> >>                            tmp = sizeof(*src.rss->key) * src.rss->key_len;
> >>                            if (size >= off + tmp)
> >>
> >
> > Ferruh, your suggestion ([1] + update) looks correct. I also verified it on mlx5 PMD.
> > Advantage: it's a generic fix for all dpdk applications using rte_flows (not just testpmd).
> > It reduces code.
> > With this fix the responsibility of handling key==NULL and/or len==0 is moved to the PMDs (which is good).
> >
> > With regard to Lijun patch - I liked the approach of overriding the default testpmd key with the default PMD key.
> > But it only addresses testpmd. More code was added.
> > It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing RSS, but it would feel more confident if we could confirm it for all the PMDs (by testing) or at least review the PMDs rss_hash_conf_get() implementations.
> >
>
> Lijun's idea can work. There was a problem in implementation related to the key
> size assumption, which can be fixed.
>
> Even it is fixed, when user gives a rss rule without a key, we are getting key
> from device and feeding same key back to device, this is unnecessary I think.
> When user didn't provide a key, rss rule shouldn't touch the key at all.
+1
But can we add this as expected behavior in the rte_flow document.

>
> Complication was when user provides key_len without a key, I think both ignoring
> or returning error in this case is OK.
Let's return an error if key_len is provided without a key.

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 23:21           ` Ophir Munk
@ 2020-10-15 23:53             ` Ferruh Yigit
  2020-10-16  0:14               ` Ajit Khaparde
                                 ` (2 more replies)
  0 siblings, 3 replies; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-15 23:53 UTC (permalink / raw)
  To: Ophir Munk, oulijun, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

On 10/16/2020 12:21 AM, Ophir Munk wrote:
>> From: Ferruh Yigit <ferruh.yigit@intel.com>
>>>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>>>> When start the testpmd, the pmd driver initializes the RSS
>>>>>> configuration. Generally, the recommended RSS hash key is used as
>>>>>> the default key in the driver. In addition, the default key is
>>>>>> different from the default RSS flow in testpmd without specifying
>>>>>> RSS hash key. So. if you do not specify the RSS key when creating
>>>>>> an RSS rule, the testpmd uses the default key as the default RSS
>>>>>> key of the RSS rule. As a result, you may mistakenly consider that
>>>>>> the RSS key in use is the valid default key of the NIC, actually,
>>>>>> the key and the valid default key of the NIC are two values.
>>>>>>
>>>>>> Consider the follow usage with testpmd:
>>>>>> 1. first, startup testpmd:
>>>>>> testpmd> show port 0 rss-hash key
>>>>>> RSS functions:
>>>>>>     all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
>>>>>> -
>> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
>> 0F
>>>>>> -20C6A42B73BBEAC01FA
>>>>>> 2. create a rss rule
>>>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
>>>>>> testpmd> actions rss \
>>>>>> types ipv4-udp end queues end / end
>>>>>>
>>>>>> 3. show rss-hash key
>>>>>> testpmd> show port 0 rss-hash key
>>>>>> RSS functions:
>>>>>>     all ipv4-udp udp
>>>>>> RSS key:
>>>>>> -
>> 74657374706D6427732064656661756C74205253532068617368206B65792C
>> 206F
>>>>>> -76657272696465
>>>>>>
>>>>>> In order to solve the above problems, it use the NIC valid default
>>>>>> RSS key instead of the testpmd dummy RSS key in the flow
>>>>>> configuration when the RSS key is not specified in the flow rule.
>>>>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
>> default key.
>>>>>>
>>>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
>>>>>> API")
>>>>>> Cc: stable@dpdk.org
>>>>>>
>>>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>>>> ---
>>>>>> V4->V5:
>>>>>> -rewrite the commit log
>>>>>> -add reviewed-by
>>>>>
>>>>> Hi Lijun,
>>>>>
>>>>> There were multiple other comments, it seems they are not addressed
>>>>> but only updated the commit log, can you please check comments to
>> prev versions.
>>>>>
>>>>> Before going into the details, my question was what happens if
>>>>> default key not provided at all?
>>>>> It seems this has been already tried by Ophir [1], later reverted
>>>>> back [2] bringing the initial issue back.
>>>>>
>>>>> According commit, the reason of revert is to support following
>> command:
>>>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>>>
>>>>> @Ophir, @Lijun,
>>>>> Can we ignore the 'key_len' if the 'key' is not supported and solve
>>>>> current issue as initially intended ([1])?
>>>>>
>>>> Hi, Ferruh
>>>>     I have discussed with Phil Yang about the problem in [1]. I think
>>>> there may be other problems with the idea and there is no better
>>>> solution. and we need to remove key_len definition from rte_rss_conf
>>>> structure. They don't have a plan. And [1] was eventually reverted.
>>>>
>>>
>>> Why ignoring 'key_len' (set it to zero) when there is no 'key'
>>> provided doesn't work?
>>>
>>
>> What do you think [1] + following update, will it work?
>>
>>    diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
>>    index ee4f3464fe..e7789c87b3 100644
>>    --- a/lib/librte_ethdev/rte_flow.c
>>    +++ b/lib/librte_ethdev/rte_flow.c
>>    @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
>> size,
>>                               }),
>>                               size > sizeof(*dst.rss) ? sizeof(*dst.rss) : size);
>>                    off = sizeof(*dst.rss);
>>    -               if (src.rss->key_len) {
>>    +               if (src.rss->key_len && src.rss->key) {
>>                            off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
>>                            tmp = sizeof(*src.rss->key) * src.rss->key_len;
>>                            if (size >= off + tmp)
>>
> 
> Ferruh, your suggestion ([1] + update) looks correct. I also verified it on mlx5 PMD.
> Advantage: it's a generic fix for all dpdk applications using rte_flows (not just testpmd).
> It reduces code.
> With this fix the responsibility of handling key==NULL and/or len==0 is moved to the PMDs (which is good).
>   
> With regard to Lijun patch - I liked the approach of overriding the default testpmd key with the default PMD key.
> But it only addresses testpmd. More code was added.
> It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing RSS, but it would feel more confident if we could confirm it for all the PMDs (by testing) or at least review the PMDs rss_hash_conf_get() implementations.
> 

Lijun's idea can work. There was a problem in implementation related to the key 
size assumption, which can be fixed.

Even it is fixed, when user gives a rss rule without a key, we are getting key 
from device and feeding same key back to device, this is unnecessary I think.
When user didn't provide a key, rss rule shouldn't touch the key at all.

Complication was when user provides key_len without a key, I think both ignoring 
or returning error in this case is OK.

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 16:05         ` Ferruh Yigit
@ 2020-10-15 23:21           ` Ophir Munk
  2020-10-15 23:53             ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: Ophir Munk @ 2020-10-15 23:21 UTC (permalink / raw)
  To: Ferruh Yigit, oulijun, wenzhuo.lu, beilei.xing,
	NBU-Contact-Adrien Mazarguil
  Cc: dev, linuxarm, Ori Kam

> From: Ferruh Yigit <ferruh.yigit@intel.com>
> >>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
> >>>> When start the testpmd, the pmd driver initializes the RSS
> >>>> configuration. Generally, the recommended RSS hash key is used as
> >>>> the default key in the driver. In addition, the default key is
> >>>> different from the default RSS flow in testpmd without specifying
> >>>> RSS hash key. So. if you do not specify the RSS key when creating
> >>>> an RSS rule, the testpmd uses the default key as the default RSS
> >>>> key of the RSS rule. As a result, you may mistakenly consider that
> >>>> the RSS key in use is the valid default key of the NIC, actually,
> >>>> the key and the valid default key of the NIC are two values.
> >>>>
> >>>> Consider the follow usage with testpmd:
> >>>> 1. first, startup testpmd:
> >>>> testpmd> show port 0 rss-hash key
> >>>> RSS functions:
> >>>>    all ipv4-frag ipv4-other ipv6-frag ipv6-other ip RSS key:
> >>>> -
> 6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA3803
> 0F
> >>>> -20C6A42B73BBEAC01FA
> >>>> 2. create a rss rule
> >>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end
> >>>> testpmd> actions rss \
> >>>> types ipv4-udp end queues end / end
> >>>>
> >>>> 3. show rss-hash key
> >>>> testpmd> show port 0 rss-hash key
> >>>> RSS functions:
> >>>>    all ipv4-udp udp
> >>>> RSS key:
> >>>> -
> 74657374706D6427732064656661756C74205253532068617368206B65792C
> 206F
> >>>> -76657272696465
> >>>>
> >>>> In order to solve the above problems, it use the NIC valid default
> >>>> RSS key instead of the testpmd dummy RSS key in the flow
> >>>> configuration when the RSS key is not specified in the flow rule.
> >>>> If the NIC RSS key is invalid, it will use testpmd dummy RSS key as the
> default key.
> >>>>
> >>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow
> >>>> API")
> >>>> Cc: stable@dpdk.org
> >>>>
> >>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
> >>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
> >>>> ---
> >>>> V4->V5:
> >>>> -rewrite the commit log
> >>>> -add reviewed-by
> >>>
> >>> Hi Lijun,
> >>>
> >>> There were multiple other comments, it seems they are not addressed
> >>> but only updated the commit log, can you please check comments to
> prev versions.
> >>>
> >>> Before going into the details, my question was what happens if
> >>> default key not provided at all?
> >>> It seems this has been already tried by Ophir [1], later reverted
> >>> back [2] bringing the initial issue back.
> >>>
> >>> According commit, the reason of revert is to support following
> command:
> >>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
> >>>
> >>> @Ophir, @Lijun,
> >>> Can we ignore the 'key_len' if the 'key' is not supported and solve
> >>> current issue as initially intended ([1])?
> >>>
> >> Hi, Ferruh
> >>    I have discussed with Phil Yang about the problem in [1]. I think
> >> there may be other problems with the idea and there is no better
> >> solution. and we need to remove key_len definition from rte_rss_conf
> >> structure. They don't have a plan. And [1] was eventually reverted.
> >>
> >
> > Why ignoring 'key_len' (set it to zero) when there is no 'key'
> > provided doesn't work?
> >
> 
> What do you think [1] + following update, will it work?
> 
>   diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
>   index ee4f3464fe..e7789c87b3 100644
>   --- a/lib/librte_ethdev/rte_flow.c
>   +++ b/lib/librte_ethdev/rte_flow.c
>   @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t
> size,
>                              }),
>                              size > sizeof(*dst.rss) ? sizeof(*dst.rss) : size);
>                   off = sizeof(*dst.rss);
>   -               if (src.rss->key_len) {
>   +               if (src.rss->key_len && src.rss->key) {
>                           off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
>                           tmp = sizeof(*src.rss->key) * src.rss->key_len;
>                           if (size >= off + tmp)
> 

Ferruh, your suggestion ([1] + update) looks correct. I also verified it on mlx5 PMD.
Advantage: it's a generic fix for all dpdk applications using rte_flows (not just testpmd). 
It reduces code.
With this fix the responsibility of handling key==NULL and/or len==0 is moved to the PMDs (which is good).
 
With regard to Lijun patch - I liked the approach of overriding the default testpmd key with the default PMD key.
But it only addresses testpmd. More code was added. 
It seems OK to call rte_eth_dev_rss_hash_conf_get() as part of parsing RSS, but it would feel more confident if we could confirm it for all the PMDs (by testing) or at least review the PMDs rss_hash_conf_get() implementations.

> >> Thanks
> >> Lijun Ou
> >>>

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 14:43       ` Ferruh Yigit
@ 2020-10-15 16:05         ` Ferruh Yigit
  2020-10-15 23:21           ` Ophir Munk
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-15 16:05 UTC (permalink / raw)
  To: oulijun, wenzhuo.lu, beilei.xing, adrien.mazarguil
  Cc: dev, linuxarm, Ophir Munk, Ori Kam

On 10/15/2020 3:43 PM, Ferruh Yigit wrote:
> On 10/15/2020 3:04 PM, oulijun wrote:
>>
>>
>> 在 2020/10/15 21:52, Ferruh Yigit 写道:
>>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>>> When start the testpmd, the pmd driver initializes the RSS
>>>> configuration. Generally, the recommended RSS hash key is
>>>> used as the default key in the driver. In addition, the
>>>> default key is different from the default RSS flow in testpmd
>>>> without specifying RSS hash key. So. if you do not specify
>>>> the RSS key when creating an RSS rule, the testpmd uses the
>>>> default key as the default RSS key of the RSS rule. As a result,
>>>> you may mistakenly consider that the RSS key in use is the valid
>>>> default key of the NIC, actually, the key and the valid default
>>>> key of the NIC are two values.
>>>>
>>>> Consider the follow usage with testpmd:
>>>> 1. first, startup testpmd:
>>>> testpmd> show port 0 rss-hash key
>>>> RSS functions:
>>>>    all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>>> RSS key:
>>>> -6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
>>>> -20C6A42B73BBEAC01FA
>>>> 2. create a rss rule
>>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions rss \
>>>> types ipv4-udp end queues end / end
>>>>
>>>> 3. show rss-hash key
>>>> testpmd> show port 0 rss-hash key
>>>> RSS functions:
>>>>    all ipv4-udp udp
>>>> RSS key:
>>>> -74657374706D6427732064656661756C74205253532068617368206B65792C206F
>>>> -76657272696465
>>>>
>>>> In order to solve the above problems, it use the NIC valid default
>>>> RSS key instead of the testpmd dummy RSS key in the flow configuration
>>>> when the RSS key is not specified in the flow rule. If the NIC RSS key
>>>> is invalid, it will use testpmd dummy RSS key as the default key.
>>>>
>>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
>>>> Cc: stable@dpdk.org
>>>>
>>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>>> ---
>>>> V4->V5:
>>>> -rewrite the commit log
>>>> -add reviewed-by
>>>
>>> Hi Lijun,
>>>
>>> There were multiple other comments, it seems they are not addressed but only 
>>> updated the commit log, can you please check comments to prev versions.
>>>
>>> Before going into the details, my question was what happens if default key 
>>> not provided at all?
>>> It seems this has been already tried by Ophir [1], later reverted back [2] 
>>> bringing the initial issue back.
>>>
>>> According commit, the reason of revert is to support following command:
>>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>>
>>> @Ophir, @Lijun,
>>> Can we ignore the 'key_len' if the 'key' is not supported and solve current 
>>> issue as initially intended ([1])?
>>>
>> Hi, Ferruh
>>    I have discussed with Phil Yang about the problem in [1]. I think there may 
>> be other problems with the idea and there is no better solution. and we need 
>> to remove key_len definition from rte_rss_conf structure. They don't have a 
>> plan. And [1] was eventually reverted.
>>
> 
> Why ignoring 'key_len' (set it to zero) when there is no 'key' provided doesn't 
> work?
> 

What do you think [1] + following update, will it work?

  diff --git a/lib/librte_ethdev/rte_flow.c b/lib/librte_ethdev/rte_flow.c
  index ee4f3464fe..e7789c87b3 100644
  --- a/lib/librte_ethdev/rte_flow.c
  +++ b/lib/librte_ethdev/rte_flow.c
  @@ -535,7 +535,7 @@ rte_flow_conv_action_conf(void *buf, const size_t size,
                             }),
                             size > sizeof(*dst.rss) ? sizeof(*dst.rss) : size);
                  off = sizeof(*dst.rss);
  -               if (src.rss->key_len) {
  +               if (src.rss->key_len && src.rss->key) {
                          off = RTE_ALIGN_CEIL(off, sizeof(*dst.rss->key));
                          tmp = sizeof(*src.rss->key) * src.rss->key_len;
                          if (size >= off + tmp)

>> Thanks
>> Lijun Ou
>>>
>>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>>>
>>> [2] https://git.dpdk.org/dpdk/commit/?id=f3698c3d09a
>>> .
>>>
> 


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 14:04     ` oulijun
@ 2020-10-15 14:43       ` Ferruh Yigit
  2020-10-15 16:05         ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-15 14:43 UTC (permalink / raw)
  To: oulijun, wenzhuo.lu, beilei.xing, adrien.mazarguil
  Cc: dev, linuxarm, Ophir Munk, Ori Kam

On 10/15/2020 3:04 PM, oulijun wrote:
> 
> 
> 在 2020/10/15 21:52, Ferruh Yigit 写道:
>> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>>> When start the testpmd, the pmd driver initializes the RSS
>>> configuration. Generally, the recommended RSS hash key is
>>> used as the default key in the driver. In addition, the
>>> default key is different from the default RSS flow in testpmd
>>> without specifying RSS hash key. So. if you do not specify
>>> the RSS key when creating an RSS rule, the testpmd uses the
>>> default key as the default RSS key of the RSS rule. As a result,
>>> you may mistakenly consider that the RSS key in use is the valid
>>> default key of the NIC, actually, the key and the valid default
>>> key of the NIC are two values.
>>>
>>> Consider the follow usage with testpmd:
>>> 1. first, startup testpmd:
>>> testpmd> show port 0 rss-hash key
>>> RSS functions:
>>>    all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>>> RSS key:
>>> -6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
>>> -20C6A42B73BBEAC01FA
>>> 2. create a rss rule
>>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions rss \
>>> types ipv4-udp end queues end / end
>>>
>>> 3. show rss-hash key
>>> testpmd> show port 0 rss-hash key
>>> RSS functions:
>>>    all ipv4-udp udp
>>> RSS key:
>>> -74657374706D6427732064656661756C74205253532068617368206B65792C206F
>>> -76657272696465
>>>
>>> In order to solve the above problems, it use the NIC valid default
>>> RSS key instead of the testpmd dummy RSS key in the flow configuration
>>> when the RSS key is not specified in the flow rule. If the NIC RSS key
>>> is invalid, it will use testpmd dummy RSS key as the default key.
>>>
>>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
>>> Cc: stable@dpdk.org
>>>
>>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>>> ---
>>> V4->V5:
>>> -rewrite the commit log
>>> -add reviewed-by
>>
>> Hi Lijun,
>>
>> There were multiple other comments, it seems they are not addressed but only 
>> updated the commit log, can you please check comments to prev versions.
>>
>> Before going into the details, my question was what happens if default key not 
>> provided at all?
>> It seems this has been already tried by Ophir [1], later reverted back [2] 
>> bringing the initial issue back.
>>
>> According commit, the reason of revert is to support following command:
>> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
>>
>> @Ophir, @Lijun,
>> Can we ignore the 'key_len' if the 'key' is not supported and solve current 
>> issue as initially intended ([1])?
>>
> Hi, Ferruh
>    I have discussed with Phil Yang about the problem in [1]. I think there may 
> be other problems with the idea and there is no better solution. and we need to 
> remove key_len definition from rte_rss_conf structure. They don't have a plan. 
> And [1] was eventually reverted.
> 

Why ignoring 'key_len' (set it to zero) when there is no 'key' provided doesn't 
work?

> Thanks
> Lijun Ou
>>
>> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
>>
>> [2] https://git.dpdk.org/dpdk/commit/?id=f3698c3d09a
>> .
>>


^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 13:52   ` Ferruh Yigit
@ 2020-10-15 14:04     ` oulijun
  2020-10-15 14:43       ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: oulijun @ 2020-10-15 14:04 UTC (permalink / raw)
  To: Ferruh Yigit, wenzhuo.lu, beilei.xing, adrien.mazarguil
  Cc: dev, linuxarm, Ophir Munk, Ori Kam



在 2020/10/15 21:52, Ferruh Yigit 写道:
> On 10/15/2020 1:41 PM, Lijun Ou wrote:
>> When start the testpmd, the pmd driver initializes the RSS
>> configuration. Generally, the recommended RSS hash key is
>> used as the default key in the driver. In addition, the
>> default key is different from the default RSS flow in testpmd
>> without specifying RSS hash key. So. if you do not specify
>> the RSS key when creating an RSS rule, the testpmd uses the
>> default key as the default RSS key of the RSS rule. As a result,
>> you may mistakenly consider that the RSS key in use is the valid
>> default key of the NIC, actually, the key and the valid default
>> key of the NIC are two values.
>>
>> Consider the follow usage with testpmd:
>> 1. first, startup testpmd:
>> testpmd> show port 0 rss-hash key
>> RSS functions:
>>    all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
>> RSS key:
>> -6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
>> -20C6A42B73BBEAC01FA
>> 2. create a rss rule
>> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions 
>> rss \
>> types ipv4-udp end queues end / end
>>
>> 3. show rss-hash key
>> testpmd> show port 0 rss-hash key
>> RSS functions:
>>    all ipv4-udp udp
>> RSS key:
>> -74657374706D6427732064656661756C74205253532068617368206B65792C206F
>> -76657272696465
>>
>> In order to solve the above problems, it use the NIC valid default
>> RSS key instead of the testpmd dummy RSS key in the flow configuration
>> when the RSS key is not specified in the flow rule. If the NIC RSS key
>> is invalid, it will use testpmd dummy RSS key as the default key.
>>
>> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
>> Cc: stable@dpdk.org
>>
>> Signed-off-by: Lijun Ou <oulijun@huawei.com>
>> Reviewed-by: Phil Yang <phil.yang@arm.com>
>> ---
>> V4->V5:
>> -rewrite the commit log
>> -add reviewed-by
> 
> Hi Lijun,
> 
> There were multiple other comments, it seems they are not addressed but 
> only updated the commit log, can you please check comments to prev 
> versions.
> 
> Before going into the details, my question was what happens if default 
> key not provided at all?
> It seems this has been already tried by Ophir [1], later reverted back 
> [2] bringing the initial issue back.
> 
> According commit, the reason of revert is to support following command:
> "flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"
> 
> @Ophir, @Lijun,
> Can we ignore the 'key_len' if the 'key' is not supported and solve 
> current issue as initially intended ([1])?
> 
Hi, Ferruh
   I have discussed with Phil Yang about the problem in [1]. I think 
there may be other problems with the idea and there is no better 
solution. and we need to remove key_len definition from rte_rss_conf 
structure. They don't have a plan. And [1] was eventually reverted.

Thanks
Lijun Ou
> 
> [1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8
> 
> [2] https://git.dpdk.org/dpdk/commit/?id=f3698c3d09a
> .
> 

^ permalink raw reply	[flat|nested] 24+ messages in thread

* Re: [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-10-15 12:41 ` [dpdk-dev] [PATCH v5] " Lijun Ou
@ 2020-10-15 13:52   ` Ferruh Yigit
  2020-10-15 14:04     ` oulijun
  0 siblings, 1 reply; 24+ messages in thread
From: Ferruh Yigit @ 2020-10-15 13:52 UTC (permalink / raw)
  To: Lijun Ou, wenzhuo.lu, beilei.xing, adrien.mazarguil
  Cc: dev, linuxarm, Ophir Munk, Ori Kam

On 10/15/2020 1:41 PM, Lijun Ou wrote:
> When start the testpmd, the pmd driver initializes the RSS
> configuration. Generally, the recommended RSS hash key is
> used as the default key in the driver. In addition, the
> default key is different from the default RSS flow in testpmd
> without specifying RSS hash key. So. if you do not specify
> the RSS key when creating an RSS rule, the testpmd uses the
> default key as the default RSS key of the RSS rule. As a result,
> you may mistakenly consider that the RSS key in use is the valid
> default key of the NIC, actually, the key and the valid default
> key of the NIC are two values.
> 
> Consider the follow usage with testpmd:
> 1. first, startup testpmd:
> testpmd> show port 0 rss-hash key
> RSS functions:
>    all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
> RSS key:
> -6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
> -20C6A42B73BBEAC01FA
> 2. create a rss rule
> testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions rss \
> types ipv4-udp end queues end / end
> 
> 3. show rss-hash key
> testpmd> show port 0 rss-hash key
> RSS functions:
>    all ipv4-udp udp
> RSS key:
> -74657374706D6427732064656661756C74205253532068617368206B65792C206F
> -76657272696465
> 
> In order to solve the above problems, it use the NIC valid default
> RSS key instead of the testpmd dummy RSS key in the flow configuration
> when the RSS key is not specified in the flow rule. If the NIC RSS key
> is invalid, it will use testpmd dummy RSS key as the default key.
> 
> Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
> Cc: stable@dpdk.org
> 
> Signed-off-by: Lijun Ou <oulijun@huawei.com>
> Reviewed-by: Phil Yang <phil.yang@arm.com>
> ---
> V4->V5:
> -rewrite the commit log
> -add reviewed-by

Hi Lijun,

There were multiple other comments, it seems they are not addressed but only 
updated the commit log, can you please check comments to prev versions.

Before going into the details, my question was what happens if default key not 
provided at all?
It seems this has been already tried by Ophir [1], later reverted back [2] 
bringing the initial issue back.

According commit, the reason of revert is to support following command:
"flow create 0 <pattern> actions rss queues 0 1 end key_len 40 / end"

@Ophir, @Lijun,
Can we ignore the 'key_len' if the 'key' is not supported and solve current 
issue as initially intended ([1])?


[1] https://git.dpdk.org/dpdk/commit/?id=a4391f8bae8

[2] https://git.dpdk.org/dpdk/commit/?id=f3698c3d09a

^ permalink raw reply	[flat|nested] 24+ messages in thread

* [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration
  2020-09-24 13:45 [dpdk-dev] [PATCH v4] app/testpmd: fix the default RSS key configuration Lijun Ou
@ 2020-10-15 12:41 ` " Lijun Ou
  2020-10-15 13:52   ` Ferruh Yigit
  0 siblings, 1 reply; 24+ messages in thread
From: Lijun Ou @ 2020-10-15 12:41 UTC (permalink / raw)
  To: wenzhuo.lu, beilei.xing, adrien.mazarguil, ferruh.yigit; +Cc: dev, linuxarm

When start the testpmd, the pmd driver initializes the RSS
configuration. Generally, the recommended RSS hash key is
used as the default key in the driver. In addition, the
default key is different from the default RSS flow in testpmd
without specifying RSS hash key. So. if you do not specify
the RSS key when creating an RSS rule, the testpmd uses the
default key as the default RSS key of the RSS rule. As a result,
you may mistakenly consider that the RSS key in use is the valid
default key of the NIC, actually, the key and the valid default
key of the NIC are two values.

Consider the follow usage with testpmd:
1. first, startup testpmd:
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-frag ipv4-other ipv6-frag ipv6-other ip
RSS key:
-6D5A56DA255B0EC24167253D43A38FB0D0CA2BCBAE7B30B477CB2DA38030F
-20C6A42B73BBEAC01FA
2. create a rss rule
testpmd> flow create 0 ingress pattern eth / ipv4 / udp / end actions rss \
types ipv4-udp end queues end / end

3. show rss-hash key
testpmd> show port 0 rss-hash key
RSS functions:
  all ipv4-udp udp
RSS key:
-74657374706D6427732064656661756C74205253532068617368206B65792C206F
-76657272696465

In order to solve the above problems, it use the NIC valid default
RSS key instead of the testpmd dummy RSS key in the flow configuration
when the RSS key is not specified in the flow rule. If the NIC RSS key
is invalid, it will use testpmd dummy RSS key as the default key.

Fixes: ac8d22de2394 ("ethdev: flatten RSS configuration in flow API")
Cc: stable@dpdk.org

Signed-off-by: Lijun Ou <oulijun@huawei.com>
Reviewed-by: Phil Yang <phil.yang@arm.com>
---
V4->V5:
-rewrite the commit log
-add reviewed-by

V3->V4:
-fix checkpatch warning and shorter commit content.

V2->V3:
-fix checkpatch warning.

V1->V2:
-fix the commit.
---
 app/test-pmd/cmdline_flow.c | 8 ++++++++
 1 file changed, 8 insertions(+)

diff --git a/app/test-pmd/cmdline_flow.c b/app/test-pmd/cmdline_flow.c
index 84bba0f..578555e 100644
--- a/app/test-pmd/cmdline_flow.c
+++ b/app/test-pmd/cmdline_flow.c
@@ -4735,6 +4735,7 @@ parse_vc_action_rss(struct context *ctx, const struct token *token,
 		action_rss_data->queue[i] = i;
 	if (!port_id_is_invalid(ctx->port, DISABLED_WARN) &&
 	    ctx->port != (portid_t)RTE_PORT_ALL) {
+		struct rte_eth_rss_conf rss_conf = {0};
 		struct rte_eth_dev_info info;
 		int ret2;
 
@@ -4745,6 +4746,13 @@ parse_vc_action_rss(struct context *ctx, const struct token *token,
 		action_rss_data->conf.key_len =
 			RTE_MIN(sizeof(action_rss_data->key),
 				info.hash_key_size);
+
+		rss_conf.rss_key_len = sizeof(action_rss_data->key);
+		rss_conf.rss_key = action_rss_data->key;
+		ret2 = rte_eth_dev_rss_hash_conf_get(ctx->port, &rss_conf);
+		if (ret2 != 0)
+			return ret2;
+		action_rss_data->conf.key = rss_conf.rss_key;
 	}
 	action->conf = &action_rss_data->conf;
 	return ret;
-- 
2.7.4


^ permalink raw reply	[flat|nested] 24+ messages in thread

end of thread, back to index

Thread overview: 24+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-10-15 12:30 [dpdk-dev] [PATCH v5] app/testpmd: fix the default RSS key configuration Lijun Ou
2020-10-21 10:07 ` [dpdk-dev] [PATCH] app/testpmd: set default RSS key as null Lijun Ou
2020-10-26 10:36   ` Ferruh Yigit
  -- strict thread matches above, loose matches on Subject: below --
2020-09-24 13:45 [dpdk-dev] [PATCH v4] app/testpmd: fix the default RSS key configuration Lijun Ou
2020-10-15 12:41 ` [dpdk-dev] [PATCH v5] " Lijun Ou
2020-10-15 13:52   ` Ferruh Yigit
2020-10-15 14:04     ` oulijun
2020-10-15 14:43       ` Ferruh Yigit
2020-10-15 16:05         ` Ferruh Yigit
2020-10-15 23:21           ` Ophir Munk
2020-10-15 23:53             ` Ferruh Yigit
2020-10-16  0:14               ` Ajit Khaparde
2020-10-16  6:46               ` Ophir Munk
2020-10-16 10:05                 ` oulijun
2020-10-16 15:13                   ` Ophir Munk
2020-10-16 10:04               ` oulijun
2020-10-16 10:57                 ` Ferruh Yigit
2020-10-16 14:59                   ` Ophir Munk
2020-10-20  9:00                   ` oulijun
2020-10-20 10:02                     ` Ferruh Yigit
2020-10-20 13:35                       ` oulijun
2020-10-20 14:34                         ` Ferruh Yigit
2020-10-21  8:19                           ` oulijun
2020-10-21  9:38                             ` Ferruh Yigit
2020-10-21 10:07                               ` oulijun

DPDK patches and discussions

Archives are clonable:
	git clone --mirror http://inbox.dpdk.org/dev/0 dev/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 dev dev/ http://inbox.dpdk.org/dev \
		dev@dpdk.org
	public-inbox-index dev


Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.dev


AGPL code for this site: git clone https://public-inbox.org/ public-inbox