From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9C3D6A034F for ; Mon, 11 Oct 2021 08:36:10 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6A11541109; Mon, 11 Oct 2021 08:35:49 +0200 (CEST) Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60068.outbound.protection.outlook.com [40.107.6.68]) by mails.dpdk.org (Postfix) with ESMTP id 8FA0C40042 for ; Sat, 9 Oct 2021 03:15:12 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=heXHdN3IYXZpHvsN3n5pXCkUBxGI96yvvODWvb5ycNQYFKJQeCJ/KibhODs7Z1jdFoXF7jvzsZyI6PrwoD7A83pLwmctHjfVIPAnCbfKRGBS2+6VuZxHNmBFdpcgoAViqmHhY8wxznIsJctP30zcInSoHt+hFQXoJzhN4rcYlxP+HjEfoiRgXOvUIQ7ZV/SUPXPNo71nejuaEXB3V0KAkvvLPHh+oTofGTYWBv4cRwgQsJdDdvphqRcboOVULJIQQqCqoDgyhmmhRLqscWf2w+vDPoZjmMT/4275+RxWjw8Gea4X6OlWuHz3CkPxuF2S9+a5LzBsQvu8nMheHt03/Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=X6k1+Of6IQOSgm3dmxwrTm5IK3AaI8sLssv1yAtLrFA=; b=SwVU0LQ7Y12AThLOLt45gPgjX9jWjZETzXNyJgr9QGWz/++TErvDny9sF7+CGmXwyDMYbh0SputawddKhOOwFL3m72PXkHs0W29WgD6v3rz6R4ngk+FFfQPrH1OUh3ANxlAqixCT1SmwtZgZxkhFbA3j9d9XjY2KHHgFrfzeYL7+DiLodqF2x9EGC8ggUdkr6mcpWWV3x2+lOUq/kBeHR65fLVWL/I+PYLd/LAcxgUm0V/VMYLYJRqZOYCE5IQm1y6IaaKss7vmYr3gYl94yo5BzcUgb4jnGl3XRvDCGvMRdguRcFN7ERjbGl7bP/zfBrLSJIIug3rd82tSgBNvcRA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=ericsson.com; dmarc=pass action=none header.from=ericsson.com; dkim=pass header.d=ericsson.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ericsson.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=X6k1+Of6IQOSgm3dmxwrTm5IK3AaI8sLssv1yAtLrFA=; b=UXSJSNH9HcJheDBTrYqW+PZkxqSTvrUh28y5DxvsYlJtRiuxID25fS9Hp5wc4FwvEAuR4kYTwyR2ni18gkAdLkAH3B3mx2IaTg6/k2wYmQeWAjQOyWYUKNOyaH85JQ7vSDY+F/uZi9BSZrG54tBycYXACpuOMXhdfyQiA9T3BLw= Received: from HE1PR07MB4220.eurprd07.prod.outlook.com (2603:10a6:7:a2::20) by HE1PR0701MB2812.eurprd07.prod.outlook.com (2603:10a6:3:49::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.13; Sat, 9 Oct 2021 01:15:05 +0000 Received: from HE1PR07MB4220.eurprd07.prod.outlook.com ([fe80::20a5:78cb:654a:8e50]) by HE1PR07MB4220.eurprd07.prod.outlook.com ([fe80::20a5:78cb:654a:8e50%6]) with mapi id 15.20.4587.024; Sat, 9 Oct 2021 01:15:05 +0000 From: Jaeeun Ham To: Thomas Monjalon CC: "users@dpdk.org" , "alialnu@nvidia.com" , "rasland@nvidia.com" , "asafp@nvidia.com" , Keunho Shin , Joonmo Koo Subject: RE: I need DPDK MLX5 Probe error support Thread-Topic: I need DPDK MLX5 Probe error support Thread-Index: Adex8Y/6HkRA7eCuSI6Sm+gHAPyyMABQ31VAAHuY/wAAlilrcAAr1xyAAJst8mAAAj3MAAACp1twAAJCdIAAfK6I0AAA3rHg Date: Sat, 9 Oct 2021 01:15:05 +0000 Message-ID: References: <6007812.z5yfQvPEFT@thomas> <2929698.unaRaE0BUr@thomas> In-Reply-To: Accept-Language: ko-KR, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: monjalon.net; dkim=none (message not signed) header.d=none;monjalon.net; dmarc=none action=none header.from=ericsson.com; x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 3deab399-118d-4157-d1a6-08d98ac23a4a x-ms-traffictypediagnostic: HE1PR0701MB2812: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:785; x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: TYzZITfUylK3y7t77Z2r8F9bFMtbaAGb9sY/ViSH7emFWEzxgjUyJJFOuq2af7HmKAXmMww51ImMvinSd7eINyOzzDn9PxsiOEf5PjfpL+gtE6RgSiZmtjoeOHDyN1yv77/BrTFbxsINCO0yJ0v+CHO4XkkIJk22/q92ppFwjdjeRI2gTT0ah1qp2/oXepVrE6Fd0W+EKhvy8Oxq0ofDsVtlEMqvNHZRsCodpQcf6uRH3tNzO4oRtfMiU2RWQX1ow7rCTET887TSo3vhkBlku9O+N6HWbcoglp1hxOUE2f/jGai7wC3XqSJPBpRbP7EgGWLlP5mCzlTVkjVuoRpMUx8nS6+j+BJ+fTvw34f6H4bcZX1xfQu9CL04PssgI7AlPTkaCaGVJlqmAi2Z7zko+DTZN+h2GBorXO8MtbVt6VAa6hmH2t71B+dhaaoeJfR+pMZo9ROzO6t77PWfxByeFRlwVCBYarR/GwbJP6uv4dBGIloXMt96QHSW5Qs7zvr+LCCNOo6RWW7YHlGsd5unOnJ/3Sy7mimDgXqaXv9a0raIaprRi1J63WDoSenjmX/fNeAg88YKOJx2quTK/XJCuEF2lj4bwv4n7gP0coQpC0Aa9zz6kktwqnLdR6L993tWcBkr8dBqH1w+oDY5PA3FjbfxYeKGoCWscREnlcO4PP/zCWgIjy0WGovXw3BMavIMJiT1fAUJbNuSYlT3Ns0XFEZ0D7BtyZAfoWCucW52/UgUYa0oqZKqvvnjL64+H3TveGulgPmhMEYMtPxoZ2+gBenmDtt2WWaok62R0594ytB10su9/4Th2aWO4+cTj5UsyX9cOnR/yeeF+xs248INKQ== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:HE1PR07MB4220.eurprd07.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(76116006)(316002)(66946007)(7696005)(52536014)(55016002)(122000001)(38100700002)(66556008)(86362001)(54906003)(66446008)(4326008)(26005)(83380400001)(66476007)(6506007)(71200400001)(508600001)(6916009)(2906002)(107886003)(38070700005)(64756008)(44832011)(5660300002)(33656002)(30864003)(2940100002)(966005)(8676002)(186003)(8936002)(53546011)(9686003)(579004); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?43raeIxBw3UsHpRepZvAQ/vLRljw2ULlNAFW+olIxaLU2tU6P5eWI/SU4dFv?= =?us-ascii?Q?b2yeiejXNkQO9wzBHB7/XWO66vpV7Ro3J4ae3JrvdscEtjCJIEQ4Bq9kQjPZ?= =?us-ascii?Q?Rb2kvhB0cHv6PsrbOCJQbyOIFksMJQ1Oy/O3mxEc5LtIUo2A3GVLuxLvVKig?= =?us-ascii?Q?qrIE/ICPL8qyXYDzng+jA2nmHO5NFDso+Q7cIaWKbnq29/W1ErSvmLULBqB8?= =?us-ascii?Q?0T7hyMUFVnvLJZMySbGAjlHg1mo7YI+LEPNvwRFvJtdtl2h0Ux8fQ4uG2E0F?= =?us-ascii?Q?VqUP9Dw/e9MPhYnRufNw+uC0sJict7bbw8xy0RBC84wJczLZ+rZHO0GNMRfN?= =?us-ascii?Q?yuxUAZH/J2neRENtUYqCeYXdWd7cjlwprQKrLhD2GQLTdxruLqDWfyvAuDX2?= =?us-ascii?Q?5AJx93489rSseDyu2/qkdFIEYBG810HDe/dau1fkufDcbHrQPZMskXuZf5fX?= =?us-ascii?Q?Zq48AQ/WfBsnXj4UfrbHj6EEDZnxQOkQwNWkeQbd66WL7rCqB99p1qCZQsdL?= =?us-ascii?Q?2L+zfC88i+lC2jVnW8u7xlDu5UCfo7YKsWD2PjQB6W6DMS5blzM99/6NJXHS?= =?us-ascii?Q?5FU0un0XpPmvMmrKNr8FvZ0abGvPT0pZFChJ7PJ39fFu19GDZcfcKWHdE6qi?= =?us-ascii?Q?C2BaPOKIywXUNbQTz+Ecq959TVeVbTCUkLAcceITQ0hYBf+0w0Uv/VaW0+GD?= =?us-ascii?Q?YwFef+c88EBlBJ+qDso6XdICi1UIM6S+iJosEYW2fyfniGnXoChekPXLuZm0?= =?us-ascii?Q?mo5SPRh6SzVB+EuqTP1RaQ7nRY1NG5vgyn+pAZ0L8xGeBSWwyhhnz9pgrtgp?= =?us-ascii?Q?CrG0xsBT/GbQO8fGAubfEJSomLDwbtjdwXODUp/fNPN6f9XmWzrXHfhheEqn?= =?us-ascii?Q?PWFgA07Cbin1FiPjKcXG4E7U3Sq3vMCfbbu/2rQX9KqbMvAKMr3nxwkD9e6K?= =?us-ascii?Q?KMp0+nGUqjrPIPMFbvWsFK2jdIRCT4PXMWvK65NTanUAeugGq1vn+dlLHzgT?= =?us-ascii?Q?2XFO/t0cX3pv610kWL0v8BEXmMT3RZ5n7nzA2GMyBfLWBPIW+7cyIJm9sSVD?= =?us-ascii?Q?4SaHC5j1B+S7CRKoBeUoOZHzaWElqfyP8IfJkb7YeXi3FplH5k43yT7kJRLp?= =?us-ascii?Q?QankP0qLEqZ8vTPYQqaaVrsznowRLwxveXU3p2T90VzORtQvwvc9pcv3JnlT?= =?us-ascii?Q?FACG9ovsCK3AkP/SNgmLQP/d8gZKE8JtKlhrdZoEAqZxbH0Dv8wJLPGlui5P?= =?us-ascii?Q?6ut0+7MrYy5gH53Oet0e7k4N/Qd79+zryZ5idP46+7Ldwk7NQP7HHbDcZO9a?= =?us-ascii?Q?c58=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: ericsson.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: HE1PR07MB4220.eurprd07.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 3deab399-118d-4157-d1a6-08d98ac23a4a X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Oct 2021 01:15:05.3867 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 92e84ceb-fbfd-47ab-be52-080c6b87953f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: kT7+EalrxiH+fmGjBm177TPLkC2aTASH1rkyadmjxgN0kuZQzry1DfqzcM6X6+EqOmoLpO0iSbWpJyPRN5YIsQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0701MB2812 X-Mailman-Approved-At: Mon, 11 Oct 2021 08:35:44 +0200 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org +Keunho Shin ; Joonmo Koo -----Original Message----- From: Jaeeun Ham=20 Sent: Saturday, October 9, 2021 10:12 AM To: Thomas Monjalon Cc: users@dpdk.org; alialnu@nvidia.com; rasland@nvidia.com; asafp@nvidia.co= m Subject: RE: I need DPDK MLX5 Probe error support Hi Thomas, I am sorry for the inconvenience. Docker is compiled as a layered, so three attached Dockerfiles are used. Dockerfile.prod.base: application base Dockerfile.prod: application Dockerfile.build: tool chains < docker container version > 4a9d999f0c15:/ # uname -a Linux 4a9d999f0c15 4.15.0-46-generic #49-Ubuntu SMP Wed Feb 6 09:33:07 UTC = 2019 x86_64 x86_64 x86_64 GNU/Linux BR/Jaeeun -----Original Message----- From: Thomas Monjalon Sent: Wednesday, October 6, 2021 10:19 PM To: Jaeeun Ham Cc: users@dpdk.org; alialnu@nvidia.com; rasland@nvidia.com; asafp@nvidia.co= m Subject: Re: I need DPDK MLX5 Probe error support I don't even know which Linux distribution you are using. Please send the Dockerfile. If it compiles in Docker, it should run. 06/10/2021 14:27, Jaeeun Ham: > Hi Thomas, >=20 > The cause is that I fail to load mlx5 driver using pci address on the doc= ker container. > So, I tried to add rdma-core library to solve dependency issue you mentio= ned as below. > Docker image is built with these Dockerfiles. > This docker image is built with DPDK20.11. > How should I add rdma-core library? >=20 > I don't find any rdma related so files in the docker container. > b273016e5be8:/usr/local/lib # ls *mlx* librte_common_mlx5.so > librte_common_mlx5.so.21 librte_common_mlx5.so.21.0=20 > librte_net_mlx5.so librte_net_mlx5.so.21 librte_net_mlx5.so.21.0=20 > b273016e5be8:/usr/local/lib # ls *rdma* > ls: cannot access '*rdma*': No such file or directory >=20 > dpdk-20.11/doc/guides/rel_notes/release_20_11.rst > 911: * rdma-core: > 913: * rdma-core-31.0-1 and above >=20 >=20 >=20 > < error log > > f1d23550a947:/ # cat /tmp/logs/epp.log MIDHAUL_PCI_ADDR:0000:12:01.0, > BACKHAUL_PCI_ADDR:0000:12:01.1 MIDHAUL_IP_ADDR:10.255.20.125, > BACKHAUL_IP_ADDR:10.255.20.124 > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > devices > common_mlx5: Failed to load driver =3D mlx5_pci. >=20 > EAL: Requested device 0000:12:01.0 cannot be used > mlx5_pci: unable to recognize master/representors on the multiple IB=20 > devices > common_mlx5: Failed to load driver =3D mlx5_pci. >=20 > EAL: Requested device 0000:12:01.1 cannot be used > EAL: Bus (pci) probe failed. > FATAL: epp_init.c::copy_mac_addr:130: Call to=20 > rte_eth_dev_get_port_by_name(src_dpdk_dev_name, &port_id) failed: -19=20 > (Unknown error -19), rte_errno=3D0 (not set) >=20 > Caught signal 6 > Obtained 7 stack frames, tid=3D1377. > tid=3D1377, /usr/local/bin/ericsson-packet-processor() [0x40a3c4]=20 > tid=3D1377, /lib64/libpthread.so.0(+0x13f80) [0x7f56c4786f80] tid=3D1377, > /lib64/libc.so.6(gsignal+0x10b) [0x7f56c229018b] tid=3D1377, > /lib64/libc.so.6(abort+0x175) [0x7f56c2291585] tid=3D1377, > /usr/local/bin/ericsson-packet-processor(main+0x458) [0x406818]=20 > tid=3D1377, /lib64/libc.so.6(__libc_start_main+0xed) [0x7f56c227b34d]=20 > tid=3D1377, /usr/local/bin/ericsson-packet-processor(_start+0x2a) > [0x4090ea] >=20 >=20 >=20 > BR/Jaeeun >=20 > -----Original Message----- > From: Thomas Monjalon > Sent: Wednesday, October 6, 2021 7:59 PM > To: Jaeeun Ham > Cc: users@dpdk.org; alialnu@nvidia.com; rasland@nvidia.com;=20 > asafp@nvidia.com > Subject: Re: I need DPDK MLX5 Probe error support >=20 > Installing dependencies is not an issue. > I don't understand which support you need. >=20 >=20 > 06/10/2021 11:57, Jaeeun Ham: > > Hi Thomas, > > > > Could you take a look at the attached file? > > My engineer managed to compile DPDK 20.11 to support MLX5. Please find = the output from dpdk-testpmd command in attached file. As you can see testp= md was able to probe mlx5_pci drivers and get MAC addresses. > > The key issue in his case for enabling MLX5 support was to export rdma-= core lib path to shared libs for meson/ninja commands as new build system a= utomatically enables MLX5 support if needed dependencies are available. > > > > BR/Jaeeun > > > > -----Original Message----- > > From: Thomas Monjalon > > > > > Sent: Sunday, October 3, 2021 4:51 PM > > To: Jaeeun Ham > > > > > Cc: users@dpdk.org; > > alialnu@nvidia.com; > > rasland@nvidia.com; > > asafp@nvidia.com > > Subject: Re: I need DPDK MLX5 Probe error support > > > > Hi, > > > > I think you need to read the documentation. > > For DPDK install on Linux: > > https://protect2.fireeye.com/v1/url?k=3D7925aba3-26be92c2-7925eb38-86d > > 8a > > 30ca42b-d871f122b4a0a61a&q=3D1&e=3D88eca0f4-aa71-4ba8-a332-179f08406da3= & > > u=3D > > https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Flinux_gsg%2Fbuild_dpdk.html%23 > > co mpiling-and-installing-dpdk-system-wide > > For mlx5 specific dependencies, install rdma-core package: > > https://protect2.fireeye.com/v1/url?k=3D9bce4984-c45570e5-9bce091f-86d > > 8a > > 30ca42b-25bd3d467b5f290d&q=3D1&e=3D88eca0f4-aa71-4ba8-a332-179f08406da3= & > > u=3D > > https%3A%2F%2Fdoc.dpdk.org%2Fguides%2Fnics%2Fmlx5.html%23linux-prere > > qu > > isites > > > > > > 02/10/2021 12:57, Jaeeun Ham: > > > Hi, > > > > > > Could you teach me how to install dpdk-testpmd? > > > I have to run the application on the host server, not a development s= erver. > > > So, I don't know how to get dpdk-testpmd. > > > > > > By the way, testpmd run result is as below. > > > root@seroics05590:~/ejaeham# testpmd > > > EAL: Detected 64 lcore(s) > > > EAL: libmlx4.so.1: cannot open shared object file: No such file or=20 > > > directory > > > EAL: FATAL: Cannot init plugins > > > > > > EAL: Cannot init plugins > > > > > > PANIC in main(): > > > Cannot init EAL > > > 5: [testpmd(_start+0x2a) [0x55d301d98e1a]] > > > 4: [/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) > > > [0x7f5e044a4bf7]] > > > 3: [testpmd(main+0x907) [0x55d301d98d07]] > > > 2:=20 > > > [/usr/lib/x86_64-linux-gnu/librte_eal.so.17.11(__rte_panic+0xbd) > > > [0x7f5e04ca3cfd]] > > > 1: > > > [/usr/lib/x86_64-linux-gnu/librte_eal.so.17.11(rte_dump_stack+0x2e > > > ) > > > [0x7f5e04cac19e]] Aborted > > > > > > > > > I added option below when the process is starting in the docker. > > > dv_flow_en=3D0 \ > > > --log-level=3Dpmd,8 \ > > > < MLX5 log > > > > 415a695ba348:/tmp/logs # cat epp.log=20 > > > MIDHAUL_PCI_ADDR:0000:12:01.0, > > > BACKHAUL_PCI_ADDR:0000:12:01.1 MIDHAUL_IP_ADDR:10.255.21.177, > > > BACKHAUL_IP_ADDR:10.255.21.178 > > > mlx5_pci: unable to recognize master/representors on the multiple=20 > > > IB devices > > > common_mlx5: Failed to load driver =3D mlx5_pci. > > > > > > EAL: Requested device 0000:12:01.0 cannot be used > > > mlx5_pci: unable to recognize master/representors on the multiple=20 > > > IB devices > > > common_mlx5: Failed to load driver =3D mlx5_pci. > > > > > > EAL: Requested device 0000:12:01.1 cannot be used > > > EAL: Bus (pci) probe failed. > > > EAL: Trying to obtain current memory policy. > > > EAL: Setting policy MPOL_PREFERRED for socket 1 Caught signal 15 > > > EAL: Restoring previous memory policy: 0 > > > EAL: Calling mem event callback 'MLX5_MEM_EVENT_CB:(nil)' > > > EAL: request: mp_malloc_sync > > > EAL: Heap on socket 1 was expanded by 5120MB > > > FATAL: epp_init.c::copy_mac_addr:130: Call to=20 > > > rte_eth_dev_get_port_by_name(src_dpdk_dev_name, &port_id) failed: > > > -19 (Unknown error -19), rte_errno=3D0 (not set) > > > > > > Caught signal 6 > > > Obtained 7 stack frames, tid=3D713. > > > tid=3D713, /usr/local/bin/ericsson-packet-processor() [0x40a4a4]=20 > > > tid=3D713, /lib64/libpthread.so.0(+0x13f80) [0x7f7e1eae8f80]=20 > > > tid=3D713, > > > /lib64/libc.so.6(gsignal+0x10b) [0x7f7e1c5f818b] tid=3D713, > > > /lib64/libc.so.6(abort+0x175) [0x7f7e1c5f9585] tid=3D713, > > > /usr/local/bin/ericsson-packet-processor(main+0x458) [0x406818]=20 > > > tid=3D713, /lib64/libc.so.6(__libc_start_main+0xed) [0x7f7e1c5e334d]= =20 > > > tid=3D713, /usr/local/bin/ericsson-packet-processor(_start+0x2a) > > > [0x4091ca] > > > > > > < i40e log > > > > cat epp.log > > > MIDHAUL_PCI_ADDR:0000:3b:0d.5, BACKHAUL_PCI_ADDR:0000:3b:0d.4=20 > > > MIDHAUL_IP_ADDR:10.51.21.112, BACKHAUL_IP_ADDR:10.51.21.113 > > > EAL: Trying to obtain current memory policy. > > > EAL: Setting policy MPOL_PREFERRED for socket 1 > > > EAL: Restoring previous memory policy: 0 > > > EAL: Calling mem event callback 'vfio_mem_event_clb:(nil)' > > > EAL: request: mp_malloc_sync > > > EAL: Heap on socket 1 was expanded by 5120MB > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 28 > > > i40e_dev_rx_queue_setup(): Rx Burst Bulk Alloc Preconditions are sati= sfied. Rx Burst Bulk Alloc function will be used on port=3D0, queue=3D0. > > > i40e_set_tx_function_flag(): Neither simple nor vector Tx enabled=20 > > > on Tx queue 0 > > > > > > i40evf_dev_start(): >> > > > i40evf_config_rss(): No hash flag is set > > > i40e_set_rx_function(): Vector Rx path will be used on port=3D0. > > > i40e_set_tx_function(): Xmit tx finally be used. > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 6 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 7 > > > i40evf_add_del_all_mac_addr(): add/rm mac:62:64:21:84:83:b0 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 10 > > > i40evf_dev_rx_queue_start(): >> > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > > > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > > > i40evf_dev_tx_queue_start(): >> > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > > > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 28 > > > i40e_dev_rx_queue_setup(): Rx Burst Bulk Alloc Preconditions are sati= sfied. Rx Burst Bulk Alloc function will be used on port=3D1, queue=3D0. > > > i40e_set_tx_function_flag(): Neither simple nor vector Tx enabled=20 > > > on Tx queue 0 > > > > > > i40evf_dev_start(): >> > > > i40evf_config_rss(): No hash flag is set > > > i40e_set_rx_function(): Vector Rx path will be used on port=3D1. > > > i40e_set_tx_function(): Xmit tx finally be used. > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 6 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 7 > > > i40evf_add_del_all_mac_addr(): add/rm mac:c2:88:5c:a9:a2:ef > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 10 > > > i40evf_dev_rx_queue_start(): >> > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > > > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > > > i40evf_dev_tx_queue_start(): >> > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 8 > > > i40evf_handle_pf_event(): VIRTCHNL_EVENT_LINK_CHANGE event > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 14 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > USER1: rte_ip_frag_table_create: allocated of 12583040 bytes at=20 > > > socket > > > -1 > > > i40evf_dev_mtu_set(): port 1 must be stopped before configuration > > > i40evf_dev_mtu_set(): port 0 must be stopped before configuration=20 > > > Caught signal 10 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15=20 > > > Caught signal 10 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > i40evf_dev_alarm_handler(): ICR01_ADMINQ is reported > > > i40evf_handle_aq_msg(): adminq response is received, opcode =3D 15 > > > > > > > > > process start option which is triggered by shell script is as below. > > > > > > < start-epp.sh > > > > exec /usr/local/bin/ericsson-packet-processor \ > > > $(get_dpdk_core_list_parameter) \ > > > $(get_dpdk_mem_parameter) \ > > > $(get_dpdk_hugepage_parameters) \ -d=20 > > > /usr/local/lib/librte_mempool_ring.so \ -d=20 > > > /usr/local/lib/librte_mempool_stack.so \ -d=20 > > > /usr/local/lib/librte_net_pcap.so \ -d=20 > > > /usr/local/lib/librte_net_i40e.so \ -d=20 > > > /usr/local/lib/librte_net_mlx5.so \ -d=20 > > > /usr/local/lib/librte_event_dsw.so \ $DPDK_PCI_OPTIONS \ > > > --vdev=3Devent_dsw0 \ > > > --vdev=3Deth_pcap0,iface=3Dmidhaul_edk \=20 > > > --vdev=3Deth_pcap1,iface=3Dbackhaul_edk \ --file-prefix=3Dcontainer = \=20 > > > --log-level lib.eal:debug \ > > > dv_flow_en=3D0 \ > > > --log-level=3Dpmd,8 \ > > > -- \ > > > $(get_epp_mempool_parameter) \ > > > > > > "--neighbor-discovery-interface=3Dmidhaul_ker,${MIDHAUL_IP_ADDR},mac_= addr_dev=3D${MIDHAUL_MAC_ADDR_DEV},vr_id=3D0" \ "--neighbor-discovery-inte= rface=3Dbackhaul_ker,${BACKHAUL_IP_ADDR},mac_addr_dev=3D${BACKHAUL_MAC_ADDR= _DEV},vr_id=3D1" > > > > > > BR/Jaeeun > > > > > > -----Original Message----- > > > From: Thomas Monjalon=20 > > > > > > > Sent: Wednesday, September 29, 2021 8:16 PM > > > To: Jaeeun Ham=20 > > > > > > > Cc: users@dpdk.org;=20 > > > alialnu@nvidia.com;=20 > > > rasland@nvidia.com; > > > asafp@nvidia.com > > > Subject: Re: I need DPDK MLX5 Probe error support > > > > > > 27/09/2021 02:18, Jaeeun Ham: > > > > Hi, > > > > > > > > I hope you are well. > > > > My name is Jaeeun Ham and I have been working for the Ericsson. > > > > > > > > I am suffering from enabling MLX5 NIC, so could you take a look at = how to run it? > > > > There are two pci address for the SRIOV(vfio) mlx5 nic support=20 > > > > but it doesn't run correctly. (12:01.0, 12:01.1) > > > > > > > > I started one process which is running inside the docker process th= at is on the MLX5 NIC support host server. > > > > The process started to run with following option. > > > > -d /usr/local/lib/librte_net_mlx5.so And the docker process=20 > > > > has > > > > mlx5 libraries as below. > > > > > > Did you try on the host outside of any container? > > > > > > Please could you try following commands (variables to be replaced)? > > > > > > dpdk-hugepages.py --reserve 1G > > > ip link set $netdev netns $container > > > docker run --cap-add SYS_NICE --cap-add IPC_LOCK --cap-add NET_AD= MIN \ > > > --device /dev/infiniband/ $image > > > echo show port summary all | dpdk-testpmd --in-memory -- -i > > > > > > > > > > > > > 706a37a35d29:/usr/local/lib # ls -1 | grep mlx=20 > > > > librte_common_mlx5.so > > > > librte_common_mlx5.so.21 > > > > librte_common_mlx5.so.21.0 > > > > librte_net_mlx5.so > > > > librte_net_mlx5.so.21 > > > > librte_net_mlx5.so.21.0 > > > > > > > > But I failed to run the process with following error. > > > > (MIDHAUL_PCI_ADDR:0000:12:01.0, BACKHAUL_PCI_ADDR:0000:12:01.1) > > > > > > > > --- > > > > > > > > mlx5_pci: unable to recognize master/representors on the=20 > > > > multiple IB devices > > > > common_mlx5: Failed to load driver =3D mlx5_pci. > > > > EAL: Requested device 0000:12:01.0 cannot be used > > > > mlx5_pci: unable to recognize master/representors on the=20 > > > > multiple IB devices > > > > common_mlx5: Failed to load driver =3D mlx5_pci. > > > > EAL: Requested device 0000:12:01.1 cannot be used > > > > EAL: Bus (pci) probe failed. > > > > > > > > --- > > > > > > > > For the success case of pci address 12:01.2, it showed following me= ssages. > > > > > > > > --- > > > > > > > > EAL: Detected 64 lcore(s) > > > > EAL: Detected 2 NUMA nodes > > > > EAL: Multi-process socket /var/run/dpdk/nah2/mp_socket > > > > EAL: Probing VFIO support... > > > > EAL: VFIO support initialized > > > > EAL: PCI device 0000:12:01.2 on NUMA socket 0 > > > > EAL: probe driver: 15b3:1016 net_mlx5 > > > > net_mlx5: MPLS over GRE/UDP tunnel offloading disabled due to=20 > > > > old OFED/rdma-core version or firmware configuration > > > > net_mlx5: port 0 the requested maximum Rx packet size (2056) is=20 > > > > larger than a single mbuf (2048) and scattered mode has not been=20 > > > > requested > > > > USER1: rte_ip_frag_table_create: allocated of 6291584 bytes at=20 > > > > socket > > > > 0 > > > > > > > > --- > > > > > > > > BR/Jaeeun