From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 200AFA0C4C for ; Mon, 4 Oct 2021 11:36:37 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5138341303; Mon, 4 Oct 2021 11:36:33 +0200 (CEST) Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2054.outbound.protection.outlook.com [40.107.20.54]) by mails.dpdk.org (Postfix) with ESMTP id 009244068E for ; Sun, 3 Oct 2021 10:10:14 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=F7Nx2a3Uq7lRROES/SStL7/ZXXEKXvnDbDYpsz4jDMxs52gkcafhn4xvD/DX68L6dQJi0WdAlfJhJXM3hEBq5IKj+CRF1VGRIF3e3CYeFUdcGGyjJzy8zUR4VzZloAdEbX9gfDy95GZ6BH2+CHnMqIC2Aa8v7V8aUAsmRgO0TE/jbABxiX9inj4Jx7/BLrzPAyt19IMcsDzOJaAPuK6sD3qBeZKBuDRgbHnOrEzAT9jrnVPTxf4nhRzvQjYArfwxiA25h0tsQoX3PCvKG3gBhT+o21DrSKPbzWq31LGpzrdkC2sMXPyk2Y9B9Z3mgzY46f0QBaM7/wxSHaaXIR/5qQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Y+40wHm/vXPqGEdvZuhCvy34a0iMIcnGTnTQKlT+DkM=; b=CFvGSxtfzNtreBW3MASRSD5eaZf6Ea/QviCf0TtGlHNmSPc5vrOr03taYPqPi4fBbSUvNPaUZAsUHCNvc4D+Ojj2PAh011JixfbEPD7Uvol01cRw6AtZPkfgU+OYa1hoDQcJvNPozf1cU4RmFEu3NPmsk2Gv/1miJgK/skHbLyiEKYDkvHl8XTNQSRrOAmcLZ415WLPMInbMrbYFf4IxdtoHNe0F82fgc821hyJKDBPinVPfHV7gIlMat+VQXiLKcsNj7gazqCfJ0mwcwo3uB0MA4X0P0QMpCJxR1HR4+Ja0/ATrownvBGuKX/YqqCMTYmL1qxHQL6VLxtmHdV/Nug== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Y+40wHm/vXPqGEdvZuhCvy34a0iMIcnGTnTQKlT+DkM=; b=KDEfT9TVu/HuOYPwQ2FjontdgjkazvXomLHKutK5CCKs8QSrtaAJv0Ri0zeIQdDhXRauq40VsUqaCz+wWa4W3SrT4dB2IrQRTABglmQkVc010WQemfo2KvLkSwq2D64IiA1afQq/UytJE5Sz34l/BNSMbOQyOKT3lV7WVh3jMrw= Received: from HE1PR07MB4220.eurprd07.prod.outlook.com (2603:10a6:7:a2::20) by HE1PR07MB4201.eurprd07.prod.outlook.com (2603:10a6:7:98::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4566.12; Sun, 3 Oct 2021 08:10:13 +0000 Received: from HE1PR07MB4220.eurprd07.prod.outlook.com ([fe80::e461:3c1a:c7c7:7d2f]) by HE1PR07MB4220.eurprd07.prod.outlook.com ([fe80::e461:3c1a:c7c7:7d2f%5]) with mapi id 15.20.4566.019; Sun, 3 Oct 2021 08:10:13 +0000 From: Jaeeun Ham To: Thomas Monjalon CC: "users@dpdk.org" , "alialnu@nvidia.com" , "rasland@nvidia.com" , "asafp@nvidia.com" Subject: RE: I need DPDK MLX5 Probe error support Thread-Topic: I need DPDK MLX5 Probe error support Thread-Index: Adex8Y/6HkRA7eCuSI6Sm+gHAPyyMABQ31VAAHuY/wAAlilrcAAr1xyAAABP6LA= Date: Sun, 3 Oct 2021 08:10:13 +0000 Message-ID: References: <1682223.0z2BAqYvtR@thomas> <10888350.v8Z1xNktaK@thomas> In-Reply-To: <10888350.v8Z1xNktaK@thomas> Accept-Language: ko-KR, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: monjalon.net; dkim=none (message not signed) header.d=none;monjalon.net; dmarc=none action=none header.from=ericsson.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 22d557e7-8e9d-45ca-9fb9-08d986453a05 x-ms-traffictypediagnostic: HE1PR07MB4201: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:2150; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: m3fe6v14mpDWe2uk4KEdyBI6NhG9wSS6X9Z0hT0diC8YSME8xLtOxi9lM1JXhtgYLRN/EQXLmZQzZPlLQGSavjvqeBgYASx9dtGXBL2ZPdMI3Mf+cwraw1Td/hx7bOiftufFFgELALQL70TR06A4DuOu67/liBvMPlhPrWOt2ROHW60UMRTFsysm5CDeWDvIx8ljH7WDSe3qhlQrLt5fUZuPKVBVfwzdH8ujRUkb71Pi9gRen8lvEQVXw6ICiQutyGXdIDAgHBvOe6JWQAOFQ949kBdEVqGIqulUsMO1ff3PK9srJ5zLLncr0x6h0FfJuCVV5Uyy4KoNeHdX32TnmdYTy6aJDuLm0hh/Em7yJd8WMSZrLqDLo1bwVefXDg8Cc3a2SbBhDv5LRsi91DDs3BUVwV+eir+4HxYO1pUMmfRrEYIz5gJPNPDHLV7ufYDNGvsf50I0dDKNwPizUoHIzr3+xDdQmhYkuGpze1vAh6dNs1sAq+5YqJFPrI48Y57L8KBV6v5nzt4DNgvpm8ZH0fo2s2e5PBGZGs5zFnaIGGrpGoJNwopC8tij/3CAgR4kPjmcIO64GvgfXjtwJ3nzwHfhHLC+wVl7XKS8Zp3eBXeXRZW/BP5nMdORxsqyAZmu/a58lUCT5kubDzuJHyFEvASrMnVoEvYv9q78k+39h/l4GLise4Oq2ZTLgeZcSpZHMsPXw/2ST07zfh+GrueQHHMA1RBBtf7u3TD4ACMJYoUOfqokUhnF8pvL6HVZU251042gC00k+nLWkR9bmFsAoViGrfwmJP4G+tu2U09LUz8= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR07MB4220.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(9686003)(7696005)(55016002)(33656002)(66446008)(71200400001)(316002)(8936002)(66476007)(4326008)(66556008)(76116006)(64756008)(6506007)(8676002)(66946007)(53546011)(122000001)(5660300002)(26005)(966005)(508600001)(44832011)(2906002)(38070700005)(186003)(83380400001)(52536014)(54906003)(86362001)(6916009)(30864003)(38100700002); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?abNje52v8IK0XrLa02TFoARZVC/qoiBzc9DmUA2K0/tyjhKaRzadATrLCqnr?= =?us-ascii?Q?nrr+zAnlcvQ/awU+nmzIHjhqdN4Zk16Scp9Ho2x77d1IRQwZnnAv7jM7Q9+t?= =?us-ascii?Q?W9wleisiy0QXAem+kJZn+tQPZSYfZ/nY4lOGd1tjHt8XG9S30f9UfW+Fycyd?= =?us-ascii?Q?Sgf3wxqndXNdYy2wNGy/f1/LDxix7Et2PMg2E/jxxFID6luYa/cJd124bLpu?= =?us-ascii?Q?ZTksdiFpwqrh5e6AU4xeUCfAPPIuv+0xy8738heR1ResgQaqxQKmpNTjiK/H?= =?us-ascii?Q?zbyBT8XfeZ+CxCPCHYg8/wmx5JkrA2a4LSeGspn7Yx0Bmu9s3mxBxnaG779H?= =?us-ascii?Q?QIorl2/Iidp7vUMOn+ogyxB3/g+6jatAd4NVBTA0tfpBuwTkAWkKhrKIj80b?= =?us-ascii?Q?/uygh7Mdbj+AduaM4Um8Gzu+MnJSyfmqL1l7is2sLfbzINjSb8DBQ1YO8Mvq?= =?us-ascii?Q?EXHVFyTPNSgsl+mLUbf/myvBls5hxrW55Ey4ajnRICoKAy4kFML+i19T1WD3?= =?us-ascii?Q?NZguQ96hhIK5C7h8M8MMiZfLBvc6/DrL0OABzfoNRpEUpkk1jhLAJYYUPVSQ?= =?us-ascii?Q?86YPiyZ1YcmqY6hnE4EluodiAGq6eYDxBR+Xv4CWKhrafVKB+MsBPTZ4wTzs?= =?us-ascii?Q?JqrZl4xHv1C05np6KCinR18irbjIJOR/kaDlNK1deVsZr8o80WLqkVyh+J9t?= =?us-ascii?Q?Bs7socROnYfz2qImzc1OsHpcQ7AQLEI0elSEvrXxgobkjtdp3PGE4i5/HbU9?= =?us-ascii?Q?wKPGG2Ttp6pwNDgNDh/jmEOQPIC4Jg8rt9YYmMDOS0AHSctjh4Fa5fLTW8m7?= =?us-ascii?Q?y/Xv5yCj4rfDkqGPgyNpMd8EzeWu6rwjYHAlaiHeN+iHY1nX4cpwO+C40D9T?= =?us-ascii?Q?QzKxH1sMjWLxYgOw0kk3YEnMF7cg6e6giLCKXmWg1qEZ7VjXcBUbpi2tpDQ8?= =?us-ascii?Q?0BAZVlqczLaZisjbTLkt1BLVYGfmKs75Rfm9vXNiXCTqB2+WK9gaBpGEGAsL?= =?us-ascii?Q?NulY7vfhKuGEAZcMbh+avfWAT6tqGdeSaOIqBhCOJ8HdumWd3lt6l1IKwnC9?= =?us-ascii?Q?BLtf1C6OCb03GshKx9eRO2KzL/MBcOcFQGyGhXMLaTB3xPor7W6YOKZmH+sd?= =?us-ascii?Q?GMf6tmiBjKlwCCybpLaZn8bGq53fGna2g5cC9EVx/NKFczX7oTQhWDZ0T580?= =?us-ascii?Q?SlTSYqd4dsiigS/KT9qX2OyHuaqlGQ0ibsOPue5tfjqz2GRfTSrAAM5yC2sO?= =?us-ascii?Q?1kpK+oDm1TM0ZwAWFrK9Jmm1iTPT5EW9AYX7PJtZ8c5yZj4P9epiuGnDhwDO?= =?us-ascii?Q?PeM=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: ericsson.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: HE1PR07MB4220.eurprd07.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 22d557e7-8e9d-45ca-9fb9-08d986453a05 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Oct 2021 08:10:13.2059 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: +s8CQCwmXc0trzwUDbdjCTMJ6ZfQD4tn0ObynVs6a3kjHTGUOMTibCKvsTE12VbtpME5Ehp/ke+fjuigxfT7pw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR07MB4201 X-Mailman-Approved-At: Mon, 04 Oct 2021 11:36:31 +0200 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Thomas, Thank you so much for your sincere support. I will follow your suggestion and do my best to solve this issue. By the way, is it okay to use mlx5_core driver by different applications wh= ich have different DPDK versions? 0000:12:01.0 (DPDK 20.11 - mlx5_pci: unable to recognize master/representor= s on the multiple IB) 0000:12:01.1 (DPDK 20.11 - mlx5_pci: unable to recognize master/representor= s on the multiple IB) 0000:12:01.2 (DPDK 18.11 - currently used) root@seroics05111:~# ethtool -i enp18s1 driver: mlx5_core version: 5.3-1.0.0 firmware-version: 14.27.4000 (HP_2420110034) expansion-rom-version:=20 bus-info: 0000:12:01.0 supports-statistics: yes supports-test: yes supports-eeprom-access: no supports-register-dump: no supports-priv-flags: yes root@seroics05111:~# ethtool -i enp18s1f1 driver: mlx5_core version: 5.3-1.0.0 firmware-version: 14.27.4000 (HP_2420110034) expansion-rom-version:=20 bus-info: 0000:12:01.1 supports-statistics: yes supports-test: yes supports-eeprom-access: no supports-register-dump: no supports-priv-flags: yes root@seroics05111:~# ethtool -i enp18s1f2 driver: mlx5_core version: 5.3-1.0.0 firmware-version: 14.27.4000 (HP_2420110034) expansion-rom-version:=20 bus-info: 0000:12:01.2 supports-statistics: yes supports-test: yes supports-eeprom-access: no supports-register-dump: no supports-priv-flags: yes BR/Jaeeun -----Original Message----- From: Thomas Monjalon =20 Sent: Sunday, October 3, 2021 4:51 PM To: Jaeeun Ham Cc: users@dpdk.org; alialnu@nvidia.com; rasland@nvidia.com; asafp@nvidia.co= m Subject: Re: I need DPDK MLX5 Probe error support Hi, I think you need to read the documentation. For DPDK install on Linux: https://protect2.fireeye.com/v1/url?k=3D7925aba3-26be92c2-7925eb38-86d8a30c= a42b-d871f122b4a0a61a&q=3D1&e=3D88eca0f4-aa71-4ba8-a332-179f08406da3&u=3Dht= tps%3A%2F%2Fdoc.dpdk.org%2Fguides%2Flinux_gsg%2Fbuild_dpdk.html%23compiling= -and-installing-dpdk-system-wide For mlx5 specific dependencies, install rdma-core package: https://protect2.fireeye.com/v1/url?k=3D9bce4984-c45570e5-9bce091f-86d8a30c= a42b-25bd3d467b5f290d&q=3D1&e=3D88eca0f4-aa71-4ba8-a332-179f08406da3&u=3Dht= tps%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fnics%2Fmlx5.html%23linux-prerequisites 02/10/2021 12:57, Jaeeun Ham: > Hi, >=20 > Could you teach me how to install dpdk-testpmd? > I have to run the application on the host server, not a development serve= r. > So, I don't know how to get dpdk-testpmd. >=20 > By the way, testpmd run result is as below. > root@seroics05590:~/ejaeham# testpmd > EAL: Detected 64 lcore(s) > EAL: libmlx4.so.1: cannot open shared object file: No such file or=20 > directory > EAL: FATAL: Cannot init plugins >=20 > EAL: Cannot init plugins >=20 > PANIC in main(): > Cannot init EAL > 5: [testpmd(_start+0x2a) [0x55d301d98e1a]] > 4: [/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7)=20 > [0x7f5e044a4bf7]] > 3: [testpmd(main+0x907) [0x55d301d98d07]] > 2: [/usr/lib/x86_64-linux-gnu/librte_eal.so.17.11(__rte_panic+0xbd)=20 > [0x7f5e04ca3cfd]] > 1: [/usr/lib/x86_64-linux-gnu/librte_eal.so.17.11(rte_dump_stack+0x2e)=20 > [0x7f5e04cac19e]] Aborted >=20 >=20 > I added option below when the process is starting in the docker. > dv_flow_en=3D0 \ > --log-level=3Dpmd,8 \ > < MLX5 log > > 415a695ba348:/tmp/logs # cat epp.log > MIDHAUL_PCI_ADDR:0000:12:01.0, BACKHAUL_PCI_ADDR:0000:12:01.1=20 > MIDHAUL_IP_ADDR:10.255.21.177, BACKHAUL_IP_ADDR:10.255.21.178 > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > devices > common_mlx5: Failed to load driver =3D mlx5_pci. >=20 > EAL: Requested device 0000:12:01.0 cannot be used > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > devices > common_mlx5: Failed to load driver =3D mlx5_pci. >=20 > EAL: Requested device 0000:12:01.1 cannot be used > EAL: Bus (pci) probe failed. > EAL: Trying to obtain current memory policy. > EAL: Setting policy MPOL_PREFERRED for socket 1 Caught signal 15 > EAL: Restoring previous memory policy: 0 > EAL: Calling mem event callback 'MLX5_MEM_EVENT_CB:(nil)' > EAL: request: mp_malloc_sync > EAL: Heap on socket 1 was expanded by 5120MB > FATAL: epp_init.c::copy_mac_addr:130: Call to=20 > rte_eth_dev_get_port_by_name(src_dpdk_dev_name, &port_id) failed: -19=20 > (Unknown error -19), rte_errno=3D0 (not set) >=20 > Caught signal 6 > Obtained 7 stack frames, tid=3D713. > tid=3D713, /usr/local/bin/ericsson-packet-processor() [0x40a4a4]=20 > tid=3D713, /lib64/libpthread.so.0(+0x13f80) [0x7f7e1eae8f80] tid=3D713,=20 > /lib64/libc.so.6(gsignal+0x10b) [0x7f7e1c5f818b] tid=3D713,=20 > /lib64/libc.so.6(abort+0x175) [0x7f7e1c5f9585] tid=3D713,=20 > /usr/local/bin/ericsson-packet-processor(main+0x458) [0x406818]=20 > tid=3D713, /lib64/libc.so.6(__libc_start_main+0xed) [0x7f7e1c5e334d]=20 > tid=3D713, /usr/local/bin/ericsson-packet-processor(_start+0x2a)=20 > [0x4091ca] >=20 > < i40e log > > cat epp.log > MIDHAUL_PCI_ADDR:0000:3b:0d.5, BACKHAUL_PCI_ADDR:0000:3b:0d.4=20 > MIDHAUL_IP_ADDR:10.51.21.112, BACKHAUL_IP_ADDR:10.51.21.113 > EAL: Trying to obtain current memory policy. > EAL: Setting policy MPOL_PREFERRED for socket 1 > EAL: Restoring previous memory policy: 0 > EAL: Calling mem event callback 'vfio_mem_event_clb:(nil)' > EAL: request: mp_malloc_sync > EAL: Heap on socket 1 was expanded by 5120MB > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 28 > i40e_dev_rx_queue_setup(): Rx Burst Bulk Alloc Preconditions are satisfie= d. Rx Burst Bulk Alloc function will be used on port=3D0, queue=3D0. > i40e_set_tx_function_flag(): Neither simple nor vector Tx enabled on=20 > Tx queue 0 >=20 > i40evf_dev_start(): >> > i40evf_config_rss(): No hash flag is set > i40e_set_rx_function(): Vector Rx path will be used on port=3D0. > i40e_set_tx_function(): Xmit tx finally be used. > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 6 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 7 > i40evf_add_del_all_mac_addr(): add/rm mac:62:64:21:84:83:b0 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 10 > i40evf_dev_rx_queue_start(): >> > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > i40evf_dev_tx_queue_start(): >> > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 28 > i40e_dev_rx_queue_setup(): Rx Burst Bulk Alloc Preconditions are satisfie= d. Rx Burst Bulk Alloc function will be used on port=3D1, queue=3D0. > i40e_set_tx_function_flag(): Neither simple nor vector Tx enabled on=20 > Tx queue 0 >=20 > i40evf_dev_start(): >> > i40evf_config_rss(): No hash flag is set > i40e_set_rx_function(): Vector Rx path will be used on port=3D1. > i40e_set_tx_function(): Xmit tx finally be used. > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 6 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 7 > i40evf_add_del_all_mac_addr(): add/rm mac:c2:88:5c:a9:a2:ef > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 10 > i40evf_dev_rx_queue_start(): >> > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > i40evf_dev_tx_queue_start(): >> > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at socket=20 > -1 > i40evf_dev_mtu_set(): port 1 must be stopped before configuration > i40evf_dev_mtu_set(): port 0 must be stopped before configuration=20 > Caught signal 10 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15=20 > Caught signal 10 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 >=20 >=20 > process start option which is triggered by shell script is as below. >=20 > < start-epp.sh > > exec /usr/local/bin/ericsson-packet-processor \ > $(get_dpdk_core_list_parameter) \ > $(get_dpdk_mem_parameter) \ > $(get_dpdk_hugepage_parameters) \ > -d /usr/local/lib/librte_mempool_ring.so \ -d=20 > /usr/local/lib/librte_mempool_stack.so \ -d=20 > /usr/local/lib/librte_net_pcap.so \ -d=20 > /usr/local/lib/librte_net_i40e.so \ -d=20 > /usr/local/lib/librte_net_mlx5.so \ -d=20 > /usr/local/lib/librte_event_dsw.so \ $DPDK_PCI_OPTIONS \ > --vdev=3Devent_dsw0 \ > --vdev=3Deth_pcap0,iface=3Dmidhaul_edk \ > --vdev=3Deth_pcap1,iface=3Dbackhaul_edk \ --file-prefix=3Dcontainer \ = =20 > --log-level lib.eal:debug \ > dv_flow_en=3D0 \ > --log-level=3Dpmd,8 \ > -- \ > $(get_epp_mempool_parameter) \ > =20 > "--neighbor-discovery-interface=3Dmidhaul_ker,${MIDHAUL_IP_ADDR},mac_addr= _dev=3D${MIDHAUL_MAC_ADDR_DEV},vr_id=3D0" \ "--neighbor-discovery-interfac= e=3Dbackhaul_ker,${BACKHAUL_IP_ADDR},mac_addr_dev=3D${BACKHAUL_MAC_ADDR_DEV= },vr_id=3D1" >=20 > BR/Jaeeun >=20 > -----Original Message----- > From: Thomas Monjalon > Sent: Wednesday, September 29, 2021 8:16 PM > To: Jaeeun Ham > Cc: users@dpdk.org; alialnu@nvidia.com; rasland@nvidia.com;=20 > asafp@nvidia.com > Subject: Re: I need DPDK MLX5 Probe error support >=20 > 27/09/2021 02:18, Jaeeun Ham: > > Hi, > >=20 > > I hope you are well. > > My name is Jaeeun Ham and I have been working for the Ericsson. > >=20 > > I am suffering from enabling MLX5 NIC, so could you take a look at how = to run it? > > There are two pci address for the SRIOV(vfio) mlx5 nic support but=20 > > it doesn't run correctly. (12:01.0, 12:01.1) > >=20 > > I started one process which is running inside the docker process that i= s on the MLX5 NIC support host server. > > The process started to run with following option. > > -d /usr/local/lib/librte_net_mlx5.so And the docker process has > > mlx5 libraries as below. >=20 > Did you try on the host outside of any container? >=20 > Please could you try following commands (variables to be replaced)? >=20 > dpdk-hugepages.py --reserve 1G > ip link set $netdev netns $container > docker run --cap-add SYS_NICE --cap-add IPC_LOCK --cap-add NET_ADMIN = \ > --device /dev/infiniband/ $image > echo show port summary all | dpdk-testpmd --in-memory -- -i >=20 >=20 >=20 > > 706a37a35d29:/usr/local/lib # ls -1 | grep mlx librte_common_mlx5.so > > librte_common_mlx5.so.21 > > librte_common_mlx5.so.21.0 > > librte_net_mlx5.so > > librte_net_mlx5.so.21 > > librte_net_mlx5.so.21.0 > >=20 > > But I failed to run the process with following error.=20 > > (MIDHAUL_PCI_ADDR:0000:12:01.0, BACKHAUL_PCI_ADDR:0000:12:01.1) > >=20 > > --- > >=20 > > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > > devices > > common_mlx5: Failed to load driver =3D mlx5_pci. > > EAL: Requested device 0000:12:01.0 cannot be used > > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > > devices > > common_mlx5: Failed to load driver =3D mlx5_pci. > > EAL: Requested device 0000:12:01.1 cannot be used > > EAL: Bus (pci) probe failed. > >=20 > > --- > >=20 > > For the success case of pci address 12:01.2, it showed following messag= es. > >=20 > > --- > >=20 > > EAL: Detected 64 lcore(s) > > EAL: Detected 2 NUMA nodes > > EAL: Multi-process socket /var/run/dpdk/nah2/mp_socket > > EAL: Probing VFIO support... > > EAL: VFIO support initialized > > EAL: PCI device 0000:12:01.2 on NUMA socket 0 > > EAL: probe driver: 15b3:1016 net_mlx5 > > net_mlx5: MPLS over GRE/UDP tunnel offloading disabled due to old=20 > > OFED/rdma-core version or firmware configuration > > net_mlx5: port 0 the requested maximum Rx packet size (2056) is=20 > > larger than a single mbuf (2048) and scattered mode has not been=20 > > requested > > USER1: rte_ip_frag_table_create: allocated of 6291584 bytes at=20 > > socket > > 0 > >=20 > > --- > >=20 > > BR/Jaeeun >=20