[dpdk-users] Issue with X550 link status

[dpdk-users] Issue with X550 link status

[Dey, Souvik]

Hi All,
              After upgrading to DPDK 18.11.6 LTS release from 18.11.2 the link_update call for link status update is not working for  X550 NICs SR-IOV enabled. On debugging it looks like the change introduced as a part of this patch is causing the issue.

https://patches.dpdk.org/patch/62140/

@@ -4135,6 +4138,10 @@  ixgbe_dev_link_update_share(struct rte_eth_dev *dev,
              return rte_eth_linkstatus_set(dev, &link);
       }
+       esdp_reg = IXGBE_READ_REG(hw, IXGBE_ESDP);
+       if ((esdp_reg & IXGBE_ESDP_SDP3))
+              link_up = 0;
+
       if (link_up == 0) {
              if (ixgbe_get_media_type(hw) == ixgbe_media_type_fiber) {
                      intr->flags |= IXGBE_FLAG_NEED_LINK_CONFIG;


I can see that the esdp_req is coming as 3735928495(0xDEADBEAF) and due to which the link_up is set to 0 even when ixgbevf_check_link returned link_up as 1. Along with this patch I also see a path_fullchk patch introduced , does that play any role in this ?
Can someone please let me know if the patch has got some issues or it is behaving correctly and the link_status is failing for valid reason. As mentioned earlier the same HW with same NIC acting in SR-IOV works fine with 18.11.2 DPDK . I am blocked at a customer bug dew to this and any urgent help will be much appreciated.

--
Regards,
Souvik


-----------------------------------------------------------------------------------------------------------------------
Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. that
is confidential and/or proprietary for the sole use of the intended recipient.  Any review, disclosure, reliance or
distribution by others or forwarding without express permission is strictly prohibited.  If you are not the intended
recipient, please notify the sender immediately and then delete all copies, including any attachments.
-----------------------------------------------------------------------------------------------------------------------

Re: [dpdk-users] Issue with X550 link status

[Dey, Souvik]

The X550 NIC is of the below device id.
[root@stdell10 ~]# lspci -nnn | grep -i ether
19:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:10.0 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.1 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.2 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.3 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]

So the mac_type is ixgbe_mac_X550_vf  in the below case.

--
Regards,
Souvik

From: Dey, Souvik
Sent: Wednesday, March 4, 2020 1:17 PM
To: dev@dpdk.org
Cc: xiaolong.ye@intel.com; xiao.zhang@intel.com; users@dpdk.org
Subject: Issue with X550 link status

Hi All,
              After upgrading to DPDK 18.11.6 LTS release from 18.11.2 the link_update call for link status update is not working for  X550 NICs SR-IOV enabled. On debugging it looks like the change introduced as a part of this patch is causing the issue.

https://patches.dpdk.org/patch/62140/

@@ -4135,6 +4138,10 @@  ixgbe_dev_link_update_share(struct rte_eth_dev *dev,
              return rte_eth_linkstatus_set(dev, &link);
       }

+       esdp_reg = IXGBE_READ_REG(hw, IXGBE_ESDP);
+       if ((esdp_reg & IXGBE_ESDP_SDP3))
+              link_up = 0;
+
       if (link_up == 0) {
              if (ixgbe_get_media_type(hw) == ixgbe_media_type_fiber) {
                      intr->flags |= IXGBE_FLAG_NEED_LINK_CONFIG;


I can see that the esdp_req is coming as 3735928495(0xDEADBEAF) and due to which the link_up is set to 0 even when ixgbevf_check_link returned link_up as 1. Along with this patch I also see a path_fullchk patch introduced , does that play any role in this ?
Can someone please let me know if the patch has got some issues or it is behaving correctly and the link_status is failing for valid reason. As mentioned earlier the same HW with same NIC acting in SR-IOV works fine with 18.11.2 DPDK . I am blocked at a customer bug dew to this and any urgent help will be much appreciated.

--
Regards,
Souvik


-----------------------------------------------------------------------------------------------------------------------
Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. that
is confidential and/or proprietary for the sole use of the intended recipient.  Any review, disclosure, reliance or
distribution by others or forwarding without express permission is strictly prohibited.  If you are not the intended
recipient, please notify the sender immediately and then delete all copies, including any attachments.
-----------------------------------------------------------------------------------------------------------------------

Re: [dpdk-users] Issue with X550 link status

[Dey, Souvik]

Little more information. It looks like the below X550 nic is broken as the change related to http://patches.dpdk.org/patch/63951/ is not been backported.
The below patch broken the link status for ixgbevf and the fix was done in the above patch but we have only backported the below patch to 18.11.6 which breaks the ixgbevf link status. When is plan for 18.11.7 or updated 18.11.6 as we should not have a broken release.

--
Regads,
Souvik

From: Dey, Souvik
Sent: Wednesday, March 4, 2020 4:08 PM
To: dev@dpdk.org
Cc: xiaolong.ye@intel.com; xiao.zhang@intel.com; users@dpdk.org; Stephen Hemminger <stephen@networkplumber.org>; Ferruh Yigit <ferruh.yigit@intel.com>
Subject: RE: Issue with X550 link status

The X550 NIC is of the below device id.
[root@stdell10 ~]# lspci -nnn | grep -i ether
19:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:10.0 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.1 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.2 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.3 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]

So the mac_type is ixgbe_mac_X550_vf  in the below case.

--
Regards,
Souvik

From: Dey, Souvik
Sent: Wednesday, March 4, 2020 1:17 PM
To: dev@dpdk.org<mailto:dev@dpdk.org>
Cc: xiaolong.ye@intel.com<mailto:xiaolong.ye@intel.com>; xiao.zhang@intel.com<mailto:xiao.zhang@intel.com>; users@dpdk.org<mailto:users@dpdk.org>
Subject: Issue with X550 link status

Hi All,
              After upgrading to DPDK 18.11.6 LTS release from 18.11.2 the link_update call for link status update is not working for  X550 NICs SR-IOV enabled. On debugging it looks like the change introduced as a part of this patch is causing the issue.

https://patches.dpdk.org/patch/62140/

@@ -4135,6 +4138,10 @@  ixgbe_dev_link_update_share(struct rte_eth_dev *dev,
              return rte_eth_linkstatus_set(dev, &link);
       }

+       esdp_reg = IXGBE_READ_REG(hw, IXGBE_ESDP);
+       if ((esdp_reg & IXGBE_ESDP_SDP3))
+              link_up = 0;
+
       if (link_up == 0) {
              if (ixgbe_get_media_type(hw) == ixgbe_media_type_fiber) {
                      intr->flags |= IXGBE_FLAG_NEED_LINK_CONFIG;


I can see that the esdp_req is coming as 3735928495(0xDEADBEAF) and due to which the link_up is set to 0 even when ixgbevf_check_link returned link_up as 1. Along with this patch I also see a path_fullchk patch introduced , does that play any role in this ?
Can someone please let me know if the patch has got some issues or it is behaving correctly and the link_status is failing for valid reason. As mentioned earlier the same HW with same NIC acting in SR-IOV works fine with 18.11.2 DPDK . I am blocked at a customer bug dew to this and any urgent help will be much appreciated.

--
Regards,
Souvik


-----------------------------------------------------------------------------------------------------------------------
Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. that
is confidential and/or proprietary for the sole use of the intended recipient.  Any review, disclosure, reliance or
distribution by others or forwarding without express permission is strictly prohibited.  If you are not the intended
recipient, please notify the sender immediately and then delete all copies, including any attachments.
-----------------------------------------------------------------------------------------------------------------------

Re: [dpdk-users] Issue with X550 link status

[Zhang, Xiao]

Hi Souvik,

The patch http://patches.dpdk.org/patch/63951/ has been queued to LTS release 18.11.7 by Kevin.
And the release date should be April 2020 according to the release plan on http://core.dpdk.org/roadmap/.

BR,
Xiao

From: Dey, Souvik [mailto:sodey@rbbn.com]
Sent: Thursday, March 5, 2020 5:23 AM
To: dev@dpdk.org
Cc: Ye, Xiaolong <xiaolong.ye@intel.com>; Zhang, Xiao <xiao.zhang@intel.com>; users@dpdk.org; Stephen Hemminger <stephen@networkplumber.org>; Yigit, Ferruh <ferruh.yigit@intel.com>; stable@dpdk.org
Subject: RE: Issue with X550 link status
Importance: High

Little more information. It looks like the below X550 nic is broken as the change related to http://patches.dpdk.org/patch/63951/ is not been backported.
The below patch broken the link status for ixgbevf and the fix was done in the above patch but we have only backported the below patch to 18.11.6 which breaks the ixgbevf link status. When is plan for 18.11.7 or updated 18.11.6 as we should not have a broken release.

--
Regads,
Souvik

From: Dey, Souvik
Sent: Wednesday, March 4, 2020 4:08 PM
To: dev@dpdk.org<mailto:dev@dpdk.org>
Cc: xiaolong.ye@intel.com<mailto:xiaolong.ye@intel.com>; xiao.zhang@intel.com<mailto:xiao.zhang@intel.com>; users@dpdk.org<mailto:users@dpdk.org>; Stephen Hemminger <stephen@networkplumber.org<mailto:stephen@networkplumber.org>>; Ferruh Yigit <ferruh.yigit@intel.com<mailto:ferruh.yigit@intel.com>>
Subject: RE: Issue with X550 link status

The X550 NIC is of the below device id.
[root@stdell10 ~]# lspci -nnn | grep -i ether
19:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
19:10.0 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.1 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.2 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
19:10.3 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]

So the mac_type is ixgbe_mac_X550_vf  in the below case.

--
Regards,
Souvik

From: Dey, Souvik
Sent: Wednesday, March 4, 2020 1:17 PM
To: dev@dpdk.org<mailto:dev@dpdk.org>
Cc: xiaolong.ye@intel.com<mailto:xiaolong.ye@intel.com>; xiao.zhang@intel.com<mailto:xiao.zhang@intel.com>; users@dpdk.org<mailto:users@dpdk.org>
Subject: Issue with X550 link status

Hi All,
              After upgrading to DPDK 18.11.6 LTS release from 18.11.2 the link_update call for link status update is not working for  X550 NICs SR-IOV enabled. On debugging it looks like the change introduced as a part of this patch is causing the issue.

https://patches.dpdk.org/patch/62140/

@@ -4135,6 +4138,10 @@  ixgbe_dev_link_update_share(struct rte_eth_dev *dev,
              return rte_eth_linkstatus_set(dev, &link);
       }

+       esdp_reg = IXGBE_READ_REG(hw, IXGBE_ESDP);
+       if ((esdp_reg & IXGBE_ESDP_SDP3))
+              link_up = 0;
+
       if (link_up == 0) {
              if (ixgbe_get_media_type(hw) == ixgbe_media_type_fiber) {
                      intr->flags |= IXGBE_FLAG_NEED_LINK_CONFIG;


I can see that the esdp_req is coming as 3735928495(0xDEADBEAF) and due to which the link_up is set to 0 even when ixgbevf_check_link returned link_up as 1. Along with this patch I also see a path_fullchk patch introduced , does that play any role in this ?
Can someone please let me know if the patch has got some issues or it is behaving correctly and the link_status is failing for valid reason. As mentioned earlier the same HW with same NIC acting in SR-IOV works fine with 18.11.2 DPDK . I am blocked at a customer bug dew to this and any urgent help will be much appreciated.

--
Regards,
Souvik

________________________________
Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. that is confidential and/or proprietary for the sole use of the intended recipient. Any review, disclosure, reliance or distribution by others or forwarding without express permission is strictly prohibited. If you are not the intended recipient, please notify the sender immediately and then delete all copies, including any attachments.
________________________________

Re: [dpdk-users] [dpdk-dev] Issue with X550 link status

[Kevin Traynor]

On 04/03/2020 21:22, Dey, Souvik wrote:

Hi Souvik,

> Little more information. It looks like the below X550 nic is broken as the change related to http://patches.dpdk.org/patch/63951/ is not been backported.
> The below patch broken the link status for ixgbevf and the fix was done in the above patch but we have only backported the below patch to 18.11.6 which breaks the ixgbevf link status. When is plan for 18.11.7 or updated 18.11.6 as we should not have a broken release.
> 

Thanks for reporting this. The fix was in a later DPDK release and will
be part of 18.11.7. It is already backported to the 18.11 branch [1].

I am expecting some more backports this week from authors and to create
a RC for 18.11.7 next week. After that, it is dependent on different
companies to validate and what is found during that validation. At the
moment assuming no major issues, I would estimate April 10th.

There is a list of validation-contacts, that I can add you to if you are
using LTS's so you would get the emails about RC's etc and could test
prior to release. Let me know if you are interested.

+ixgbe maintainers and Intel validation team, is there a test that can
be added to prevent future link status issues?

thanks,
Kevin.

[1]
commit 03b69d3c415f084b14833ed911ac9aa2e470b409
Author: Lunyuan Cui <lunyuanx.cui@intel.com>
Date:   Tue Dec 17 06:12:03 2019 +0000

    net/ixgbe: fix link status

    [ upstream commit ff8162cb9571528c006f265a32730a463fd0b886 ]


> --
> Regads,
> Souvik
> 
> From: Dey, Souvik
> Sent: Wednesday, March 4, 2020 4:08 PM
> To: dev@dpdk.org
> Cc: xiaolong.ye@intel.com; xiao.zhang@intel.com; users@dpdk.org; Stephen Hemminger <stephen@networkplumber.org>; Ferruh Yigit <ferruh.yigit@intel.com>
> Subject: RE: Issue with X550 link status
> 
> The X550 NIC is of the below device id.
> [root@stdell10 ~]# lspci -nnn | grep -i ether
> 19:00.0 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
> 19:00.1 Ethernet controller [0200]: Intel Corporation Ethernet Controller 10G X550T [8086:1563] (rev 01)
> 19:10.0 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
> 19:10.1 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
> 19:10.2 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
> 19:10.3 Ethernet controller [0200]: Intel Corporation X550 Virtual Function [8086:1565]
> 
> So the mac_type is ixgbe_mac_X550_vf  in the below case.
> 
> --
> Regards,
> Souvik
> 
> From: Dey, Souvik
> Sent: Wednesday, March 4, 2020 1:17 PM
> To: dev@dpdk.org<mailto:dev@dpdk.org>
> Cc: xiaolong.ye@intel.com<mailto:xiaolong.ye@intel.com>; xiao.zhang@intel.com<mailto:xiao.zhang@intel.com>; users@dpdk.org<mailto:users@dpdk.org>
> Subject: Issue with X550 link status
> 
> Hi All,
>               After upgrading to DPDK 18.11.6 LTS release from 18.11.2 the link_update call for link status update is not working for  X550 NICs SR-IOV enabled. On debugging it looks like the change introduced as a part of this patch is causing the issue.
> 
> https://patches.dpdk.org/patch/62140/
> 
> @@ -4135,6 +4138,10 @@  ixgbe_dev_link_update_share(struct rte_eth_dev *dev,
>               return rte_eth_linkstatus_set(dev, &link);
>        }
> 
> +       esdp_reg = IXGBE_READ_REG(hw, IXGBE_ESDP);
> +       if ((esdp_reg & IXGBE_ESDP_SDP3))
> +              link_up = 0;
> +
>        if (link_up == 0) {
>               if (ixgbe_get_media_type(hw) == ixgbe_media_type_fiber) {
>                       intr->flags |= IXGBE_FLAG_NEED_LINK_CONFIG;
> 
> 
> I can see that the esdp_req is coming as 3735928495(0xDEADBEAF) and due to which the link_up is set to 0 even when ixgbevf_check_link returned link_up as 1. Along with this patch I also see a path_fullchk patch introduced , does that play any role in this ?
> Can someone please let me know if the patch has got some issues or it is behaving correctly and the link_status is failing for valid reason. As mentioned earlier the same HW with same NIC acting in SR-IOV works fine with 18.11.2 DPDK . I am blocked at a customer bug dew to this and any urgent help will be much appreciated.
> 
> --
> Regards,
> Souvik
> 
> 
> -----------------------------------------------------------------------------------------------------------------------
> Notice: This e-mail together with any attachments may contain information of Ribbon Communications Inc. that
> is confidential and/or proprietary for the sole use of the intended recipient.  Any review, disclosure, reliance or
> distribution by others or forwarding without express permission is strictly prohibited.  If you are not the intended
> recipient, please notify the sender immediately and then delete all copies, including any attachments.
> -----------------------------------------------------------------------------------------------------------------------
>