From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A26A143A9A; Tue, 6 Feb 2024 04:24:33 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 726064026B; Tue, 6 Feb 2024 04:24:32 +0100 (CET) Received: from mgamail.intel.com (mgamail.intel.com [198.175.65.13]) by mails.dpdk.org (Postfix) with ESMTP id 649D84003C for ; Tue, 6 Feb 2024 04:24:29 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1707189871; x=1738725871; h=from:to:cc:subject:date:message-id:references: in-reply-to:mime-version; bh=qvLTjK/fmIGgMXKGiyaWeFs/t78bkVqtd6Me0IzzEQM=; b=UoKefwArzVc0do8EO2huhjCtbbUoC/XWq/nRa9N9yyzOnoqUZkZ/pXqv AlA4xVrsGWSyLH7zKl2iqu3KhfhutZJqvH/hxPD8iVoQbR6ONkCv9qAkg I9gdihwCGlMrgjpIPwFnPGYqIVqkTBiD1VHTR4qcPcH9OoPA8d7qZPbWG zr3MxmNurUWFGWqyvIVxkGzaq00kR4drwhNSE6cPXBCnaJiIa5m2HlWXm JcM9GQ4PvdneGFNcI0LurvAnKQQVyU5sxjQj5hg8cKx+rdz9D0jAXzfGm MULpKHaKe8EJimGtC7Ha4lJS/9fp7CF6bP7/5jPLus+/TuUPEGBkJWNdq Q==; X-IronPort-AV: E=McAfee;i="6600,9927,10975"; a="11741101" X-IronPort-AV: E=Sophos;i="6.05,246,1701158400"; d="scan'208,217";a="11741101" Received: from fmviesa001.fm.intel.com ([10.60.135.141]) by orvoesa105.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 05 Feb 2024 19:24:29 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.05,246,1701158400"; d="scan'208,217";a="31962549" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by fmviesa001.fm.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 05 Feb 2024 19:24:24 -0800 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Mon, 5 Feb 2024 19:24:23 -0800 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Mon, 5 Feb 2024 19:24:23 -0800 Received: from orsedg603.ED.cps.intel.com (10.7.248.4) by orsmsx610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Mon, 5 Feb 2024 19:24:23 -0800 Received: from NAM12-BN8-obe.outbound.protection.outlook.com (104.47.55.169) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Mon, 5 Feb 2024 19:24:22 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Cs8hL7u24GeYtsTWHfgRUCEg5rk3OJStO9gxea1SkEVR2ZYb3fgA42AMKA4YcGxm++Uy214Ot0GzjA1O3d91Y48D3dhPI1tsKHKCNvq4xJ7lYAm0m3yC6ayOpo+Q+gi2rsK3F4cXmyi50/2wvAIN5SJirf6cr4kb+nfZaeOQF0vAAJ+Or6AlggQkT/DVFmso+VBOpwiVR24hmHIFSYQ1Dixvv0CBjW8Gz/W9p7uI6LGNRzyixPzXbDM3BeOgFKFKq7W3RzzKrsaehozpy6rFK3nOk10M0LAsOMMR3p+RfUvL9IasBYjBoFKHNLaSEm5rK6GywFN1UjyMFee3tw5Ubw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=KKrL45ZroTPKStE85K6B/dVLym5BJDaeiRquyADxMyY=; b=dEmvvPU03IyLJCsv0sLiyt4udYNG4KWCG3F1yg5GRnleyErhwFDA5fTfo2bnc8cpJvZAf+YBVx9PPpEaguJhHc8bU7dsEPB0c33C7iD9WfhecJh/K8LsIpPQWSzXZDCQKtpeytjtvSQtF59y3ECm1NJTdgu26650fiAtXqIwakitZFFGvIKUJ0W1FfehPYwtDaogeDWdIMpx4J3EntElp7Sk4vlFl+5/Z3CowXr/xU3AmEGVb+TQ1df54xqHJFt12PQaK6CWOHLKaxiF9MnLJ7TFrZ2avC6BFzfhTz8oNS6GkMJiAqhc9sRMOBe4AwMveTuSycmrATnJr9+jhdio8g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from CO6PR11MB5602.namprd11.prod.outlook.com (2603:10b6:303:13a::5) by IA1PR11MB6323.namprd11.prod.outlook.com (2603:10b6:208:389::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.34; Tue, 6 Feb 2024 03:24:20 +0000 Received: from CO6PR11MB5602.namprd11.prod.outlook.com ([fe80::5d84:2b01:5029:9315]) by CO6PR11MB5602.namprd11.prod.outlook.com ([fe80::5d84:2b01:5029:9315%7]) with mapi id 15.20.7249.035; Tue, 6 Feb 2024 03:24:20 +0000 From: "Zeng, ZhichaoX" To: "Chen, Jacky" CC: "Shih, Amy" , "Hsu, Jason" , "Wang, Leo" , "dev@dpdk.org" , "Cui, KaixinX" Subject: RE: DPDK testpmd with E823 link status is down Thread-Topic: DPDK testpmd with E823 link status is down Thread-Index: AdpUMuPae1a7+k7OSJ+OEzYAKZfHIwEdP2Eg Date: Tue, 6 Feb 2024 03:24:19 +0000 Message-ID: References: In-Reply-To: Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: CO6PR11MB5602:EE_|IA1PR11MB6323:EE_ x-ms-office365-filtering-correlation-id: e3b77f98-5f0a-4cbb-0616-08dc26c31b61 x-ld-processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: bVtSGdBEBtyjqyqpC56ESvYkMJizwuMkAOY2WSgaZTolo4gPkejjGuKAQWaKgkiuo91rf8MKMjEaaDWDm9+l7gLWPIDdh15nbO6pwjw3HUbndLa+oFXT204h4DqE2jlq09EF3I+HkZSZQ6nlblUjs95W43e3rmsOzxn4Zs7Yba7DP6lOfIkE3+xaRtEn8a9EQM5XYwP0GnMu3uB974C22GAh2/+qJbIYL1mUgQQQk+Iggv9OUa9K63/+jW5jTLxKecuvrOYj04Fgy3e+CIinxj28n/irOnh3SNfVCDO5ky2liLOU/Xvitc30bBGtD8pmLRiTbgdhnjVWPQSuUFPq4NJsdXsZvF5iPpK8Nz66BG4BM2ZgtbDMEPP4ewfzrJqwwf27A6eB/O/xFpXV21dMjudGKqQ/TWooww/qh40e0UR+ivD2gmGhRfU32SdVMR/3cMi7KEP59G/K7qPx3oPxvWEQDkeQJ7/Ot0Vmw3V85oXkTnLD5b9m22YvpJwTipAqrsg5oAdCM63FFJVoqk55p8sAfgGT5xvVAv1P9x33oUQK3dX8UivxO4yVm+S/OPJVw3agW2cavMQVsCrz4nJ849SYHDXRceEDkh/+hPawQwyxpDP9kSDiw0a3mhalhG+r x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CO6PR11MB5602.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(396003)(366004)(376002)(136003)(346002)(39860400002)(230922051799003)(64100799003)(1800799012)(451199024)(186009)(54906003)(66476007)(52536014)(66446008)(64756008)(8936002)(76116006)(4326008)(6916009)(33656002)(8676002)(5660300002)(316002)(66946007)(2906002)(86362001)(66556008)(38070700009)(53546011)(478600001)(82960400001)(6506007)(38100700002)(9686003)(71200400001)(7696005)(122000001)(83380400001)(26005)(107886003)(4743002)(41300700001)(55016003)(579004); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?MYIZ/JDLQWyuqhyyRM0Tg0nqv68X7ylniJYtjFwsGX2WwCeK0ezJcMpYtXT5?= =?us-ascii?Q?S6DQxGYu6XAJDQmTzjlnI2xyjgW9S8yyAM3bo4rn0IlGgJNpg9FT+xY4bG9m?= =?us-ascii?Q?9scWb6eZ5U3cDIAbIlSgv+jIKTZK7piqiGxom6UEaWpogC5/YwBa7m1br3Ry?= =?us-ascii?Q?PhTYcXiwzUO4xE+t42vK6FDODGavJoWtmY7rWVuYJxosML5ROpH81bQT85NL?= =?us-ascii?Q?+0VnDul2/3H/lojrUp1v6SHZzWsU/mzhROAG55Cz0SIxTvkxvr4Wd+55ibbG?= =?us-ascii?Q?pKJEIZW7DG8SpXCXYWwik8BgMdw/nECYJWnJpiAxPhsO9bAGCtADNF3552fV?= =?us-ascii?Q?dgs5JTH0W/9fWPH/ZYKNBndwLvPenp2SBVH36oTpMCOqe7H5ZyFAR9uqITKp?= =?us-ascii?Q?8Ga6fJdqdqXtjOtqGYDGN1x6QsfPETDMvrMfJJZKgG55p3WwYCbkgCy3HXvv?= =?us-ascii?Q?Ntj4p6yGH1vZs7wU6E9uIu6tBTsJ36Wf7958YtJ1FM2V/0GR7GtdqtB9z/p5?= =?us-ascii?Q?nfhVcbZyTiFT1+3RTgNOqzawvDErYHt54OiYBHpVS1/jqiLtPL7IGosjO4/R?= =?us-ascii?Q?s5p7jbu7MaR7YFbWbXjHWiDwRYR8tvnxKqWJccbygPRp/+5qSMwSM8wq6dwc?= =?us-ascii?Q?tLT7CEaeOoLmYwm2Q/tYNtJcX7bBHEE2UiuiqF4B13W2zv8K72GuYsEiNhZ2?= =?us-ascii?Q?B62dFs2OFuvu6UGOdchW3kls7Nu58AwooMD7XOIqgQEqUUgLEPIY2v/Y2tMe?= =?us-ascii?Q?yGUHO9Mw91CKa2co4nqUbK/cpZC5pZIH+2W1MuKFu3g2RcLIETRvLjF/XCse?= =?us-ascii?Q?N5TYFHNkKfEHt5vxkqo2ZLvy4dmL1wuZfhRBYZN8OWb7IGi7EziFNdgUxPnQ?= =?us-ascii?Q?JXGikF3OkSBfsMe8IUAYfcjKzDgal4ldI7ewLGsl3kAcs9HhxUFEzzytco30?= =?us-ascii?Q?6gtQCWdNm+KYv7VGDEFtxjF1tHjQ1+h4IlDps88M1XixPfI/eTnaSnph+Dyr?= =?us-ascii?Q?4EO/83wit+SSv8jl+bN14aqjD0sK8XOXa2mtLA2ELDwewYMQy1pUq25sH+y4?= =?us-ascii?Q?xv/WorR/lphVIsxJ5ayF/EZyg3LBNEbweq+UW2lgcGpgJlVn3gzOATERwiI/?= =?us-ascii?Q?klbPRuJ85WPeurwJ8kV2uI63hpTn/9bUd9pUhxz6GQiOyz4DDomlmJztmmq1?= =?us-ascii?Q?hJm6Gz1nQMH1HjdpLHLUEIAsD7eYqDoYaXdnHg6mMUEuIu+SAvVgeZhM+xBB?= =?us-ascii?Q?AhrULgQMHhKWnCFRo3gQyq+5E2NVz6MV/DAQ5KYufyULuWl0XXPzrXomZXar?= =?us-ascii?Q?sUokKA9y67E0PqSFwYP/5I7n4tdNbizigWMX/VPLFo6MlNrUiavaIog88OLZ?= =?us-ascii?Q?nDzFqvZdq3U8Vb7GXaUGFCe4sS0LIYlnWTbduMvH8V3UCERjfOcZYrUIZRL7?= =?us-ascii?Q?l8LObeGxD5n1zvu0BRz99MXREV7g2lGPhLlSUcRGqmjA8L1SjpcZa3+xHHK8?= =?us-ascii?Q?MdlXZ6zMxIXa+L5meYFByhxsJtagtkdQb98gFrETowsWrOmTIKNtcNjK75ED?= =?us-ascii?Q?+RhKTfACwi8Z6djODBBZrRIWrG0uskFGdz/uj10Q?= Content-Type: multipart/alternative; boundary="_000_CO6PR11MB5602033FE3A079F16E7C7328F1462CO6PR11MB5602namp_" MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CO6PR11MB5602.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: e3b77f98-5f0a-4cbb-0616-08dc26c31b61 X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Feb 2024 03:24:19.9483 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: TXmQWw0Vwe6+ZB0EqEDsW/jOvZ4inP2Q4VYVf2Csa9XzFuXHsrTN5ezqLSaJ+HZz4uvtEUp4XPDdjKblYbnu8g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA1PR11MB6323 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --_000_CO6PR11MB5602033FE3A079F16E7C7328F1462CO6PR11MB5602namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi JackyCT.Chen: We are tracking this issue, it is a firmware issue that has been reported t= o the hardware team and the fix will take some time. There is a workaround in ICE PMD, change the "no wait" to "wait_to_complete= " mode when ice_interrupt_handler() updates the link status in drivers/net/= ice/ice_ethdev.c: #ifdef ICE_LSE_SPT if (int_fw_ctl & PFINT_FW_CTL_INTEVENT_M) { PMD_DRV_LOG(INFO, "FW_CTL: link state chang= e event"); ice_handle_aq_msg(dev); } #else if (oicr & PFINT_OICR_LINK_STAT_CHANGE_M) { PMD_DRV_LOG(INFO, "OICR: link state change = event"); - ret =3D ice_link_update(dev, 0); + ret =3D ice_link_update(dev, 1); if (!ret) rte_eth_dev_callback_proces= s (dev, RTE_E= TH_EVENT_INTR_LSC, NULL); } #endif Best Regards Zhichao From: JackyCT.Chen Sent: Wednesday, January 31, 2024 6:53 PM To: Yang, Qiming ; dev@dpdk.org Cc: Shih, Amy ; Hsu, Jason ; Wang, Leo Subject: RE: DPDK testpmd with E823 link status is down Hi Qiming & dpdk dev team: This is JackyCT.Chen from Advantech, we have a question about E823 DPDK loo= pback testpmd , Could you please give us some advice? We bind the E823 and X710 devices with vfio-pci driver and execute the DPDK= testpmd . (detail see attached files please) However, both E823 "link status : down and link speed : None" , we expect= ed that "link status : up and link speed : 10 Gbps" . Do you have any suggestions? Testing procedure & result: Platform : Moro City Reference Planform ICX-D ~ CRB l On-Board : E823 l Ext-PCIE CARD : PCIE-2230NP-00A1E ( Intel X710 ) OS/Kernel : Debian 12 / kernel 6.1.0-16-amd64 x86_64 DPDK : DPDK 24.03.0-rc0 (from trunk build) NIC_BDF_INFO : CRB EXT-PCIE CARD : X710 Port : 10G * 4 firmware-version: 7.10 0x80007b33 255.65535.255 CRB On-BOARD : E823 Port Option : 4x10-4x2.5 firmware-version: 3.26 0x8001b733 1.3429.0 BDF =3D 91:00.0 --- BDF =3D 89:00.0 BDF =3D 91:00.1 --- BDF =3D 89:00.1 Prepare and config : root@5-efi:~# modprobe uio root@5-efi:~# modprobe vfio-pci root@5-efi:~# echo 2048 > /sys/devices/system/node/node0/hugepages/hugepage= s-2048kB/nr_hugepages root@5-efi:~# mkdir -p /mnt/huge root@5-efi:~# mount -t hugetlbfs nodev /mnt/huge root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.0 root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.1 root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.0 root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.1 LOG : root@5-efi:~# dpdk-testpmd -c 0xff -n 4 -a 89:00.0 -a 89:00.1 --socket-mem= =3D256 -- -i --mbcache=3D512 --socket-num=3D0 --coremask=3D0xc --nb-cores= =3D2 --rxq=3D1 --txq=3D1 --portmask=3D0xf --rxd=3D4096 --rxfreet=3D128 --rx= pt=3D128 --rxht=3D8 --rxwt=3D0 --txd=3D4096 --txfreet=3D128 --txpt=3D128 --= txht=3D0 --txwt=3D0 --burst=3D64 --txrst=3D64 --rss-ip -a EAL: Detected CPU lcores: 24 EAL: Detected NUMA nodes: 1 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'VA' EAL: VFIO support initialized EAL: Using IOMMU type 1 (Type 1) EAL: Ignore mapping IO port bar(1) EAL: Ignore mapping IO port bar(4) EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.0 (socket 0) ice_dev_init(): Failed to read device serial number ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (d= ouble VLAN mode) EAL: Ignore mapping IO port bar(1) EAL: Ignore mapping IO port bar(4) EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:00.1 (socket 0) ice_dev_init(): Failed to read device serial number ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS Default Package (d= ouble VLAN mode) TMTY: TELEMETRY: No legacy callbacks, legacy socket not created Interactive-mode selected previous number of forwarding cores 1 - changed to number of configured cor= es 2 Auto-start selected testpmd: create a new mbuf pool : n=3D262144, size=3D2176, socke= t=3D0 testpmd: preferred mempool ops selected: ring_mp_mc Configuring Port 0 (socket 0) ice_set_rx_function(): Using AVX2 Vector Rx (port 0). Port 0: 00:00:00:00:01:00 Configuring Port 1 (socket 0) ice_set_rx_function(): Using AVX2 Vector Rx (port 1). Port 1: 00:00:00:00:01:01 Checking link statuses... Done Start automatic packet forwarding io packet forwarding - ports=3D2 - cores=3D2 - streams=3D2 - NUMA support e= nabled, MP allocation mode: native Logical Core 2 (socket 0) forwards packets on 1 streams: RX P=3D0/Q=3D0 (socket 0) -> TX P=3D1/Q=3D0 (socket 0) peer=3D02:00:00:00= :00:01 Logical Core 3 (socket 0) forwards packets on 1 streams: RX P=3D1/Q=3D0 (socket 0) -> TX P=3D0/Q=3D0 (socket 0) peer=3D02:00:00:00= :00:00 io packet forwarding packets/burst=3D64 nb forwarding cores=3D2 - nb forwarding ports=3D2 port 0: RX queue number: 1 Tx queue number: 1 Rx offloads=3D0x0 Tx offloads=3D0x10000 RX queue: 0 RX desc=3D4096 - RX free threshold=3D128 RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 RX Offloads=3D0x0 TX queue: 0 TX desc=3D4096 - TX free threshold=3D128 TX threshold registers: pthresh=3D128 hthresh=3D0 wthresh=3D0 TX offloads=3D0x10000 - TX RS bit threshold=3D64 port 1: RX queue number: 1 Tx queue number: 1 Rx offloads=3D0x0 Tx offloads=3D0x10000 RX queue: 0 RX desc=3D4096 - RX free threshold=3D128 RX threshold registers: pthresh=3D0 hthresh=3D0 wthresh=3D0 RX Offloads=3D0x0 TX queue: 0 TX desc=3D4096 - TX free threshold=3D128 TX threshold registers: pthresh=3D128 hthresh=3D0 wthresh=3D0 TX offloads=3D0x10000 - TX RS bit threshold=3D64 testpmd> testpmd> show port stats all ######################## NIC statistics for port 0 #####################= ### RX-packets: 442827099 RX-missed: 0 RX-bytes: 26569625172 RX-errors: 0 RX-nombuf: 0 TX-packets: 443292288 TX-errors: 0 TX-bytes: 26597536896 Throughput (since last show) Rx-pps: 14390795 Rx-bps: 6907582048 Tx-pps: 14405470 Tx-bps: 6914626456 #########################################################################= ### ######################## NIC statistics for port 1 #####################= ### RX-packets: 443293641 RX-missed: 0 RX-bytes: 26597617500 RX-errors: 0 RX-nombuf: 0 TX-packets: 442827661 TX-errors: 0 TX-bytes: 26569658892 Throughput (since last show) Rx-pps: 14405477 Rx-bps: 6914629232 Tx-pps: 14390795 Tx-bps: 6907581696 #########################################################################= ### testpmd> show port summary all Number of available ports: 2 Port MAC Address Name Driver Status Link 0 00:00:00:00:01:00 89:00.0 net_ice down None 1 00:00:00:00:01:01 89:00.1 net_ice down None testpmd> show port stats all ######################## NIC statistics for port 0 #####################= ### RX-packets: 2267795378 RX-missed: 0 RX-bytes: 136067721784 RX-errors: 0 RX-nombuf: 0 TX-packets: 2270213831 TX-errors: 0 TX-bytes: 136212829092 Throughput (since last show) Rx-pps: 14385293 Rx-bps: 6904940896 Tx-pps: 14400690 Tx-bps: 6912331240 #########################################################################= ### ######################## NIC statistics for port 1 #####################= ### RX-packets: 2270215290 RX-missed: 0 RX-bytes: 136212916568 RX-errors: 0 RX-nombuf: 0 TX-packets: 2267796060 TX-errors: 0 TX-bytes: 136067762768 Throughput (since last show) Rx-pps: 14400690 Rx-bps: 6912331344 Tx-pps: 14385293 Tx-bps: 6904941024 #########################################################################= ### Thanks! Best Regards, JackyCT.Chen x86 Software | Cloud-IoT Group | Advantech Co., Ltd. 02-2792-7818 Ext. 1194 --_000_CO6PR11MB5602033FE3A079F16E7C7328F1462CO6PR11MB5602namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hi JackyCT.Chen:

 

We are tracking thi= s issue, it is a firmware issue that has been reported to the hardware team= and the fix will take some time.

 

There is a workarou= nd in ICE PMD, change the “no wait” to “wait_to_complete&= #8221; mode when ice_interrupt_handler() updates the link status in drivers= /net/ice/ice_ethdev.c:

 

#ifdef ICE_LSE_SPT<= o:p>

   &= nbsp;            if = (int_fw_ctl & PFINT_FW_CTL_INTEVENT_M) {

   &= nbsp;           &nbs= p;            &= nbsp;   PMD_DRV_LOG(INFO, "FW_CTL: link state change event&q= uot;);

   &= nbsp;           &nbs= p;            &= nbsp;   ice_handle_aq_msg(dev);

   &= nbsp;            }

#else

   &= nbsp;            if = (oicr & PFINT_OICR_LINK_STAT_CHANGE_M) {

   &= nbsp;           &nbs= p;            &= nbsp;   PMD_DRV_LOG(INFO, "OICR: link state change event&quo= t;);

-    = ;            &n= bsp;           ret = =3D ice_link_update(dev, 0);

+   =             &nb= sp;           ret =3D ice= _link_update(dev, 1);

   &= nbsp;           &nbs= p;            &= nbsp;   if (!ret)

   &= nbsp;           &nbs= p;            &= nbsp;           &nbs= p;       rte_eth_dev_callback_process

   &= nbsp;           &nbs= p;            &= nbsp;           &nbs= p;            &= nbsp;          (dev, RTE_ETH_E= VENT_INTR_LSC, NULL);

   &= nbsp;            }

#endif

 

 

Best Regards

Zhichao<= /span>

 

From:= JackyCT.Chen <JackyCT.Chen@advantech.c= om.tw>
Sent: Wednesday, January 31, 2024 6:53 PM
To: Yang, Qiming <qiming.yang@intel.com>; dev@dpdk.org
Cc: Shih, Amy <amy.shih@advantech.com.tw>; Hsu, Jason <jaso= n.hsu@advantech.com.tw>; Wang, Leo <leo66.wang@advantech.com.tw> Subject: RE: DPDK testpmd with E823 link status is down <= /span>

 

Hi Qiming= & dpdk dev team:

&nbs= p;

This is J= ackyCT.Chen from Advantech, we have a question about E823 DPDK loopback tes= tpmd  ,

Could you= please give us some advice?

&nbs= p;

We bind t= he E823 and X710 devices with vfio-pci driver and execute the DPDK testpmd = . (detail see attached files please)

&nbs= p;

However, =  both E823  “link status : down and link speed : None” , we expected that “link status : up and link speed : 10 Gbps” .=

Do you ha= ve any suggestions?

 

Testin= g procedure & result:

Platform : Moro City Reference Planform ICX-D &nbs= p;~ CRB  

l   On-Board : E823

l   Ext-PCIE CARD : PCIE-2230NP-00A1E ( Intel = X710 )

OS/Kernel :  Debian 12  / kernel 6.1.0-1= 6-amd64 x86_64

DPDK : DPDK 24.03.0-rc0 (from trunk build)

NIC_BDF_INFO :

CRB EXT-PCIE CARD : X710

Port : 10G * 4

firmware-version: 7.10 0x80007b33 255.65535.255<= o:p>

 = ;

CRB On-BOARD : E823 

Port Option : 4x10-4x2.5

firmware-version: 3.26 0x8001b733 1.3429.0

 

BDF =3D 91:00.= 0

---=

BDF =3D 89:00.= 0

BDF =3D 91:00.= 1

---=

BDF =3D 89:00.= 1

Prepare and config :

root@5-efi:~# modprobe uio

root@5-efi:~# modprobe vfio-pci

root@5-efi:~# echo 2048 > /sys/devices/system/node/node0= /hugepages/hugepages-2048kB/nr_hugepages

root@5-efi:~# mkdir -p /mnt/huge

root@5-efi:~# mount -t hugetlbfs nodev /mnt/huge=

root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.0

root@5-efi:~# dpdk-devbind.py -b vfio-pci 91:00.1

root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.0

root@5-efi:~# dpdk-devbind.py -b vfio-pci 89:00.1

 

LOG :

root@5-efi:~# dpdk-testpmd -c 0xff -n 4 -a 89:00.0 -a 89:00= .1 --socket-mem=3D256 -- -i --mbcache=3D512 --socket-num=3D0 --coremask=3D0= xc --nb-cores=3D2 --rxq=3D1 --txq=3D1 --portmask=3D0xf --rxd=3D4096 --rxfreet=3D128 --rxpt=3D128 --rxht=3D8 --rxwt=3D0 --txd=3D4096 --txfreet= =3D128 --txpt=3D128 --txht=3D0 --txwt=3D0 --burst=3D64 --txrst=3D64 --rss-i= p -a

EAL: Detected CPU lcores: 24

EAL: Detected NUMA nodes: 1

EAL: Detected static linkage of DPDK

EAL: Multi-process socket /var/run/dpdk/rte/mp_socket<= /o:p>

EAL: Selected IOVA mode 'VA'

EAL: VFIO support initialized

EAL: Using IOMMU type 1 (Type 1)

EAL: Ignore mapping IO port bar(1)

EAL: Ignore mapping IO port bar(4)

EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:= 00.0 (socket 0)

ice_dev_init(): Failed to read device serial number

 

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS De= fault Package (double VLAN mode)

EAL: Ignore mapping IO port bar(1)

EAL: Ignore mapping IO port bar(4)

EAL: Probe PCI driver: net_ice (8086:188a) device: 0000:89:= 00.1 (socket 0)

ice_dev_init(): Failed to read device serial number

 

ice_load_pkg_type(): Active package is: 1.3.35.0, ICE OS De= fault Package (double VLAN mode)

TMTY: TELEMETRY: No legacy callbacks, legacy socket not cre= ated

Interactive-mode selected

previous number of forwarding cores 1 - changed to number o= f configured cores 2

Auto-start selected

testpmd: create a new mbuf pool <mb_pool_0>: n=3D2621= 44, size=3D2176, socket=3D0

testpmd: preferred mempool ops selected: ring_mp_mc

Configuring Port 0 (socket 0)

ice_set_rx_function(): Using AVX2 Vector Rx (port 0).<= /o:p>

Port 0: 00:00:00:00:01:00

Configuring Port 1 (socket 0)

ice_set_rx_function(): Using AVX2 Vector Rx (port 1).<= /o:p>

Port 1: 00:00:00:00:01:01

Checking link statuses...

Done

Start automatic packet forwarding

io packet forwarding - ports=3D2 - cores=3D2 - streams=3D2 = - NUMA support enabled, MP allocation mode: native

Logical Core 2 (socket 0) forwards packets on 1 streams:

  RX P=3D0/Q=3D0 (socket 0) -> TX P=3D1/Q=3D0 (sock= et 0) peer=3D02:00:00:00:00:01

Logical Core 3 (socket 0) forwards packets on 1 streams:

  RX P=3D1/Q=3D0 (socket 0) -> TX P=3D0/Q=3D0 (sock= et 0) peer=3D02:00:00:00:00:00

 

  io packet forwarding packets/burst=3D64

  nb forwarding cores=3D2 - nb forwarding ports=3D2

  port 0: RX queue number: 1 Tx queue number: 1

    Rx offloads=3D0x0 Tx offloads=3D0x10000<= o:p>

    RX queue: 0

      RX desc=3D4096 - RX free thr= eshold=3D128

      RX threshold registers: pthr= esh=3D0 hthresh=3D0  wthresh=3D0

      RX Offloads=3D0x0=

    TX queue: 0

      TX desc=3D4096 - TX free thr= eshold=3D128

      TX threshold registers: pthr= esh=3D128 hthresh=3D0  wthresh=3D0

      TX offloads=3D0x10000 - TX R= S bit threshold=3D64

  port 1: RX queue number: 1 Tx queue number: 1

    Rx offloads=3D0x0 Tx offloads=3D0x10000<= o:p>

    RX queue: 0

      RX desc=3D4096 - RX free thr= eshold=3D128

      RX threshold registers: pthr= esh=3D0 hthresh=3D0  wthresh=3D0

      RX Offloads=3D0x0=

    TX queue: 0

      TX desc=3D4096 - TX free thr= eshold=3D128

      TX threshold registers: pthr= esh=3D128 hthresh=3D0  wthresh=3D0

      TX offloads=3D0x10000 - TX R= S bit threshold=3D64

testpmd>

testpmd> show port stats all

 

  ######################## NIC statistics for port 0&n= bsp; ########################

  RX-packets: 442827099  RX-missed: 0  =         RX-bytes:  26569625172=

  RX-errors: 0

  RX-nombuf:  0     &nbs= p;  

  TX-packets: 443292288  TX-errors: 0 &= nbsp;        TX-bytes:  26597536896=

 

  Throughput (since last show)

  Rx-pps:     14390795  =         Rx-bps:   6907582048

  Tx-pps:     14405470  =         Tx-bps:   6914626456

  ####################################################= ########################

 

  ######################## NIC statistics for port 1&n= bsp; ########################

  RX-packets: 443293641  RX-missed: 0  =         RX-bytes:  26597617500=

  RX-errors: 0

 RX-nombuf:  0      = ;  

  TX-packets: 442827661  TX-errors: 0 &= nbsp;        TX-bytes:  26569658892=

 

  Throughput (since last show)

  Rx-pps:     14405477  =         Rx-bps:   6914629232

  Tx-pps:     14390795  =         Tx-bps:   6907581696

  ####################################################= ########################

testpmd> show port summary all

Number of available ports: 2

Port MAC Address&nbs= p;      Name      &n= bsp;  Driver         Status&nb= sp;  Link

0    = 00:00:00:00:01:00 89:00.0      net_ice  =       down     None=

1    = 00:00:00:00:01:01 89:00.1      net_ice  =       down     None=

testpmd> show port stats all

 

  ######################## NIC statistics for port 0&n= bsp; ########################

  RX-packets: 2267795378 RX-missed: 0   = ;       RX-bytes:  136067721784

  RX-errors: 0

  RX-nombuf:  0     &nbs= p;  

  TX-packets: 2270213831 TX-errors: 0  =         TX-bytes:  136212829092

 

  Throughput (since last show)

  Rx-pps:     14385293  =         Rx-bps:   6904940896

  Tx-pps:     14400690  =         Tx-bps:   6912331240

  ####################################################= ########################

 

  ######################## NIC statistics for port 1&n= bsp; ########################

  RX-packets: 2270215290 RX-missed: 0   = ;       RX-bytes:  136212916568

  RX-errors: 0

  RX-nombuf:  0     &nbs= p;  

  TX-packets: 2267796060 TX-errors: 0  =         TX-bytes:  136067762768

 

  Throughput (since last show)

  Rx-pps:     14400690  =         Rx-bps:   6912331344

  Tx-pps:     14385293  =         Tx-bps:   6904941024

  ####################################################= ########################

&nbs= p;

&nbs= p;

&nbs= p;

Thanks!

&nbs= p;

&nbs= p;

Best Regards,

JackyCT.Chen

x86 Software | Cloud-IoT Group | Advantech Co., Ltd.

02-2792-7818 Ext. 1194

&nbs= p;

--_000_CO6PR11MB5602033FE3A079F16E7C7328F1462CO6PR11MB5602namp_--