Hi Zhichao,

Do you have any update ?

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Other discussion from Intel IPS Case No. 00867743  ~

[Intel internal sync  - between  DPDK forum and DPDK IPS case discussion]

Something “the firmware issue “  need you sync with  Intel IPS ticket (#00867743) owner – Mao and Howard

It really need your help . thanks a lot!

 

Mao

Intel Technical Specialist
[mhsieh 03/14/2024 07:37:47]
Dear Customer,

Does Advantech see the similar issue with the kernel driver?
Since I don't get such FW issue, please check with the person who provided the DPDK patch for the following up if v3.36 NVM still see the issue.

 

He (Mao) said he does NOT hear such FW issue .   could you sync this sync that you think  with Mao or Howard  ?

Hope let it CLOSED this issue more speedily and quickly .

 

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Meantime, we will arrange to do the same experiment on LEK v3.36 which Howard and Mao 's suggestion recently.

 

Thanks a lot!

 

Best Regards,

JackyCT.Chen

x86 Software | Cloud-IoT Group | Advantech Co., Ltd.

02-2792-7818 Ext. 1194

 

 

From: Jason.Hsu <Jason.Hsu@advantech.com.tw>
Sent: Monday, March 11, 2024 4:26 PM
To: Chang, Howard C <howard.c.chang@intel.com>; Zeng, ZhichaoX <zhichaox.zeng@intel.com>; JackyCT.Chen <JackyCT.Chen@advantech.com.tw>
Cc: Amy.Shih <Amy.Shih@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

 

 

 

 

 

 

Hi Howard,

 

The IPS Case No : 00867743, kindly help to check it and sharing related schedule info for ref., TKS.

 

 

 

Best regards,

Jason Hsu 許文偉

Product Manager | ICVG-ENPD | Advantech Co., Ltd.
Tel: +886 2 2792-7818 ext.1602 | Mobile:
+886 920-125-625 | Fax: +886 2 2794-7336

www.advantech.com I jason.hsu@advantech.com.tw

Advantech ENPD

 

From: Jason.Hsu
Sent: Thursday, March 7, 2024 5:29 PM
To: Chang, Howard C <howard.c.chang@intel.com>; Zeng, ZhichaoX <zhichaox.zeng@intel.com>; JackyCT.Chen <JackyCT.Chen@advantech.com.tw>
Cc: Amy.Shih <Amy.Shih@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi Howard,

 

As discussed, the issue need to have a IPS ticket for keep following up in next, so we will try to issue it and update the no. soon, TKS.

 

 

 

 

 

 

Best regards,

Jason Hsu 許文偉

Product Manager | ICVG-ENPD | Advantech Co., Ltd.
Tel: +886 2 2792-7818 ext.1602 | Mobile:
+886 920-125-625 | Fax: +886 2 2794-7336

www.advantech.com I jason.hsu@advantech.com.tw

Advantech ENPD

 

From: Jason.Hsu
Sent: Tuesday, March 5, 2024 10:07 AM
To: Chang, Howard C <howard.c.chang@intel.com>; Zeng, ZhichaoX <zhichaox.zeng@intel.com>; JackyCT.Chen <JackyCT.Chen@advantech.com.tw>
Cc: Amy.Shih <Amy.Shih@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi Howard,

 

Could you help to check this DPDK testing issue and comments the estimated schedule for next FW ver. release to fix it?

 

 

 

 

Best regards,

Jason Hsu 許文偉

Product Manager | ICVG-ENPD | Advantech Co., Ltd.
Tel: +886 2 2792-7818 ext.1602 | Mobile:
+886 920-125-625 | Fax: +886 2 2794-7336

www.advantech.com I jason.hsu@advantech.com.tw

Advantech ENPD

 

From: JackyCT.Chen <JackyCT.Chen@advantech.com.tw>
Sent: Friday, March 1, 2024 6:25 PM
To: Zeng, ZhichaoX <zhichaox.zeng@intel.com>
Cc: Amy.Shih <Amy.Shih@advantech.com.tw>; Jason.Hsu <Jason.Hsu@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi Zhichao,

Do you have any update ?

 

Q: As you said “We are tracking this issue, it is a firmware issue that has been reported to the hardware team and the fix will take some time.

Could you descript more detail ?

2-1 The “firmware issue” that mean the LEK firmware-version: 3.26 0x8001b733 1.3429.0 of the Intel NIC - E823  has some question or not ?

2-2 When it will release new E823 LEK that fix link status/speed issue ?

2-3 Where we could get the new E823 LEK that fix link status/speed issue ?.. Content ID # of Intel RDC .

We look forward to receiving your reply . 😊

 

Thanks your help !

 

Best Regards,

JackyCT.Chen

x86 Software | Cloud-IoT Group | Advantech Co., Ltd.

02-2792-7818 Ext. 1194

 

From: JackyCT.Chen
Sent: Friday, February 16, 2024 4:26 PM
To: Zeng, ZhichaoX <
zhichaox.zeng@intel.com>
Cc: Amy.Shih <
Amy.Shih@advantech.com.tw>; Jason.Hsu <Jason.Hsu@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi Zhichao,

  1. This workaround in ICE_PMD which change the “no wait” to “wait_to_complete”  è it seemed workable  .

When we run testpmd on E823 port0/1 , it got “link status : up and link speed : 10 Gbps” as below  (Detail see attached file)

testpmd> show port summary all

Number of available ports: 2

Port MAC Address       Name         Driver         Status   Link

0    00:00:00:00:01:00 89:00.0      net_ice        up       10 Gbps

1    00:00:00:00:01:01 89:00.1      net_ice        up       10 Gbps

 

  1. As you said “We are tracking this issue, it is a firmware issue that has been reported to the hardware team and the fix will take some time.

Could you descript more detail ?

2-1 The “firmware issue” that mean the LEK firmware-version: 3.26 0x8001b733 1.3429.0 of the Intel NIC - E823  has some question or not ?

2-2 When it will release new E823 LEK that fix link status/speed issue ?

2-3 Where we could get the new E823 LEK that fix link status/speed issue ?.. Content ID # of Intel RDC .

We look forward to receiving your reply . 😊

 

 

Thanks your help !

 

 

Best Regards,

JackyCT.Chen

x86 Software | Cloud-IoT Group | Advantech Co., Ltd.

02-2792-7818 Ext. 1194

 

From: Zeng, ZhichaoX <zhichaox.zeng@intel.com>
Sent: Tuesday, February 6, 2024 11:24 AM
To: JackyCT.Chen <
JackyCT.Chen@advantech.com.tw>
Cc: Amy.Shih <
Amy.Shih@advantech.com.tw>; Jason.Hsu <Jason.Hsu@advantech.com.tw>; Leo66.Wang <Leo66.Wang@advantech.com.tw>; dev@dpdk.org; Cui, KaixinX <kaixinx.cui@intel.com>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi JackyCT.Chen:

 

We are tracking this issue, it is a firmware issue that has been reported to the hardware team and the fix will take some time.

 

There is a workaround in ICE PMD, change the “no wait” to “wait_to_complete” mode when ice_interrupt_handler() updates the link status in drivers/net/ice/ice_ethdev.c:

 

#ifdef ICE_LSE_SPT

                if (int_fw_ctl & PFINT_FW_CTL_INTEVENT_M) {

                                PMD_DRV_LOG(INFO, "FW_CTL: link state change event");

                                ice_handle_aq_msg(dev);

                }

#else

                if (oicr & PFINT_OICR_LINK_STAT_CHANGE_M) {

                                PMD_DRV_LOG(INFO, "OICR: link state change event");

-                            ret = ice_link_update(dev, 0);

+                           ret = ice_link_update(dev, 1);

                                if (!ret)

                                                rte_eth_dev_callback_process

                                                                (dev, RTE_ETH_EVENT_INTR_LSC, NULL);

                }

#endif

 

 

 

Best Regards

Zhichao

 

From: JackyCT.Chen <JackyCT.Chen@advantech.com.tw>
Sent: Wednesday, January 31, 2024 6:53 PM
To: Yang, Qiming <
qiming.yang@intel.com>; dev@dpdk.org
Cc: Shih, Amy <
amy.shih@advantech.com.tw>; Hsu, Jason <jason.hsu@advantech.com.tw>; Wang, Leo <leo66.wang@advantech.com.tw>
Subject: RE: DPDK testpmd with E823 link status is down

 

Hi Qiming & dpdk dev team:

 

This is JackyCT.Chen from Advantech, we have a question about E823 DPDK loopback testpmd  ,

Could you please give us some advice?

 

We bind the E823 and X710 devices with vfio-pci driver and execute the DPDK testpmd . (detail see attached files please)

 

However,  both E823  “link status : down and link speed : None” , we expected that “link status : up and link speed : 10 Gbps” .

Do you have any suggestions?

 

Testing procedure & result:

Platform : Moro City Reference Planform ICX-D  ~ CRB  

l   On-Board : E823

l   Ext-PCIE CARD : PCIE-2230NP-00A1E ( Intel X710 )

OS/Kernel :  Debian 12  / kernel 6.1.0-16-amd64 x86_64

DPDK : DPDK 24.03.0-rc0 (from trunk build)

NIC_BDF_INFO :

CRB EXT-PCIE CARD : X710

Port : 10G * 4

firmware-version: 7.10 0x80007b33 255.65535.255

 

CRB On-BOARD : E823 

Port Option : 4x10-4x2.5

firmware-version: 3.26 0x8001b733 1.3429.0

 

BDF = 91:00.0

---

BDF = 89:00.0

BDF = 91:00.1

---

BDF = 89:00.1

Prepare and config :

root@5-efi:~# modprobe uio

root@5-efi:~# modprobe vfio-pci

root@5-efi:~# echo 2048 > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages

root@5-efi:~# mkdir -p /mnt/huge

root@5-efi:~# mount -t hugetlbfs nodev /mnt/huge

root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.0

root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.1

root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.0

root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.1

 

LOG :

root@5-efi:~# dpdk-testpmd -c 0xff -n 4 -a 89:00.0 -a 89:00.1 --socket-mem=256 -- -i --mbcache=512 --socket-num=0 --coremask=0xc --nb-cores=2 --rxq=1 --txq=1 --portmask=0xf --rxd=4096 --rxfreet=128 --rxpt=128 --rxht=8 --rxwt=0 --txd=4096 --txfreet=128 --txpt=128 --txht=0 --txwt=0 --burst=64 --txrst=64 --rss-ip -a

EAL: Detected CPU lcores: 24

EAL: Detected NUMA nodes: 1

EAL: Detected static linkage of DPDK

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket

EAL: Selected IOVA mode 'VA'

EAL: VFIO support initialized

EAL: Using IOMMU type 1 (Type 1)

EAL: Ignore mapping IO port bar(1)

EAL: Ignore mapping IO port bar(4)

EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.0 (socket 0)

ice_dev_init(): Failed to read device serial number

 

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (double VLAN mode)

EAL: Ignore mapping IO port bar(1)

EAL: Ignore mapping IO port bar(4)

EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.1 (socket 0)

ice_dev_init(): Failed to read device serial number

 

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (double VLAN mode)

TMTY: TELEMETRY: No legacy callbacks, legacy socket not created

Interactive-mode selected

previous number of forwarding cores 1 - changed to number of configured cores 2

Auto-start selected

testpmd: create a new mbuf pool <mb_pool_0>: n=262144, size=2176, socket=0

testpmd: preferred mempool ops selected: ring_mp_mc

Configuring Port 0 (socket 0)

ice_set_rx_function(): Using AVX2 Vector Rx (port 0).

Port 0: 00:00:00:00:01:00

Configuring Port 1 (socket 0)

ice_set_rx_function(): Using AVX2 Vector Rx (port 1).

Port 1: 00:00:00:00:01:01

Checking link statuses...

Done

Start automatic packet forwarding

io packet forwarding - ports=2 - cores=2 - streams=2 - NUMA support enabled, MP allocation mode: native

Logical Core 2 (socket 0) forwards packets on 1 streams:

  RX P=0/Q=0 (socket 0) -> TX P=1/Q=0 (socket 0) peer=02:00:00:00:00:01

Logical Core 3 (socket 0) forwards packets on 1 streams:

  RX P=1/Q=0 (socket 0) -> TX P=0/Q=0 (socket 0) peer=02:00:00:00:00:00

 

  io packet forwarding packets/burst=64

  nb forwarding cores=2 - nb forwarding ports=2

  port 0: RX queue number: 1 Tx queue number: 1

    Rx offloads=0x0 Tx offloads=0x10000

    RX queue: 0

      RX desc=4096 - RX free threshold=128

      RX threshold registers: pthresh=0 hthresh=0  wthresh=0

      RX Offloads=0x0

    TX queue: 0

      TX desc=4096 - TX free threshold=128

      TX threshold registers: pthresh=128 hthresh=0  wthresh=0

      TX offloads=0x10000 - TX RS bit threshold=64

  port 1: RX queue number: 1 Tx queue number: 1

    Rx offloads=0x0 Tx offloads=0x10000

    RX queue: 0

      RX desc=4096 - RX free threshold=128

      RX threshold registers: pthresh=0 hthresh=0  wthresh=0

      RX Offloads=0x0

    TX queue: 0

      TX desc=4096 - TX free threshold=128

      TX threshold registers: pthresh=128 hthresh=0  wthresh=0

      TX offloads=0x10000 - TX RS bit threshold=64

testpmd>

testpmd> show port stats all

 

  ######################## NIC statistics for port 0  ########################

  RX-packets: 442827099  RX-missed: 0          RX-bytes:  26569625172

  RX-errors: 0

  RX-nombuf:  0        

  TX-packets: 443292288  TX-errors: 0          TX-bytes:  26597536896

 

  Throughput (since last show)

  Rx-pps:     14390795          Rx-bps:   6907582048

  Tx-pps:     14405470          Tx-bps:   6914626456

  ############################################################################

 

  ######################## NIC statistics for port 1  ########################

  RX-packets: 443293641  RX-missed: 0          RX-bytes:  26597617500

  RX-errors: 0

 RX-nombuf:  0        

  TX-packets: 442827661  TX-errors: 0          TX-bytes:  26569658892

 

  Throughput (since last show)

  Rx-pps:     14405477          Rx-bps:   6914629232

  Tx-pps:     14390795          Tx-bps:   6907581696

  ############################################################################

testpmd> show port summary all

Number of available ports: 2

Port MAC Address       Name         Driver         Status   Link

0    00:00:00:00:01:00 89:00.0      net_ice        down     None

1    00:00:00:00:01:01 89:00.1      net_ice        down     None

testpmd> show port stats all

 

  ######################## NIC statistics for port 0  ########################

  RX-packets: 2267795378 RX-missed: 0          RX-bytes:  136067721784

  RX-errors: 0

  RX-nombuf:  0        

  TX-packets: 2270213831 TX-errors: 0          TX-bytes:  136212829092

 

  Throughput (since last show)

  Rx-pps:     14385293          Rx-bps:   6904940896

  Tx-pps:     14400690          Tx-bps:   6912331240

  ############################################################################

 

  ######################## NIC statistics for port 1  ########################

  RX-packets: 2270215290 RX-missed: 0          RX-bytes:  136212916568

  RX-errors: 0

  RX-nombuf:  0        

  TX-packets: 2267796060 TX-errors: 0          TX-bytes:  136067762768

 

  Throughput (since last show)

  Rx-pps:     14400690          Rx-bps:   6912331344

  Tx-pps:     14385293          Tx-bps:   6904941024

  ############################################################################

 

 

 

Thanks!

 

 

Best Regards,

JackyCT.Chen

x86 Software | Cloud-IoT Group | Advantech Co., Ltd.

02-2792-7818 Ext. 1194