From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8F11DA0547 for ; Wed, 29 Sep 2021 13:16:30 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D098C410DB; Wed, 29 Sep 2021 13:16:29 +0200 (CEST) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) by mails.dpdk.org (Postfix) with ESMTP id DEF1F410D7 for ; Wed, 29 Sep 2021 13:16:28 +0200 (CEST) Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 4B6205C01F4; Wed, 29 Sep 2021 07:16:28 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Wed, 29 Sep 2021 07:16:28 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=monjalon.net; h= from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding:content-type; s=fm2; bh= xnvaAJVzcOvYBBZYJ6J9puJKH+RX6zU2QQtFvHvN5U0=; b=GSVcFqXq0iFarQSP Iz50fcTX89iUZANtzzEEy/qwhrcUORH5H9ykj3KlX+wY6mUHe9r63Yz1WtRNwKI9 T22zY4rRWy4x+oT5iVoAXsVjyQNsHJYaTowS30rNgxhrR/HHVKJ21uOfYSmsX96v 15ktZ+FvcJOKCfVzWd9yDmnv8Wx4jnl2gTFv+UjEWqF5hud12Xsr5ZQewF70nCcB DPquHMiLzxDx8UTFE9RC59rNUQc1/Ms4JA9fJHhVKZIew590PLIDG+hw0FEhAIYc ZACJ+4LeGj+RYD+D+4BgtpxZEmw2mgnyuPt8Nw0p3AjVhiauSyIeKaRORvSoq3XR HFLlrA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm3; bh=xnvaAJVzcOvYBBZYJ6J9puJKH+RX6zU2QQtFvHvN5 U0=; b=ndlW7qBKdLRECODUvy0f/rldB0r5E4GaFbQrmcSe7kXEuDWOzxlR3Gx1U IfdbeRPZ6iGt1g+gh7KfYvzQ30sNv+ftIrzaROT5wUEoFjHnsE2BffWwHz6IdwJi YpIQ6aH5fj2Z6/yBGnI6MlIqcRIHuIeiL0antAPUV1ibmShFflTseiBjq3K3s1DU zrSLpINjuS7oFNG78fc5k2zuGHzc55xmzCp9I/UozKczei39QCvXfvrlxH5BqumW 7nndlo/3ZmxNv4QQT+wVuBrRxfuANSR48wANbhVsWb5xkuHVVLUBTIFS6G9LFc0a 2UsQxUpiwpqmUQwazaocG3GLrj3Mw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvtddrudekvddgfeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvufffkfgjfhgggfgtsehtufertddttddvnecuhfhrohhmpefvhhhomhgr shcuofhonhhjrghlohhnuceothhhohhmrghssehmohhnjhgrlhhonhdrnhgvtheqnecugg ftrfgrthhtvghrnhepudeggfdvfeduffdtfeeglefghfeukefgfffhueejtdetuedtjeeu ieeivdffgeehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrh homhepthhhohhmrghssehmohhnjhgrlhhonhdrnhgvth X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA; Wed, 29 Sep 2021 07:16:27 -0400 (EDT) From: Thomas Monjalon To: Jaeeun Ham Cc: users@dpdk.org, alialnu@nvidia.com, rasland@nvidia.com, asafp@nvidia.com Subject: Re: I need DPDK MLX5 Probe error support Date: Wed, 29 Sep 2021 13:16:26 +0200 Message-ID: <1682223.0z2BAqYvtR@thomas> In-Reply-To: References: MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org 27/09/2021 02:18, Jaeeun Ham: > Hi, > > I hope you are well. > My name is Jaeeun Ham and I have been working for the Ericsson. > > I am suffering from enabling MLX5 NIC, so could you take a look at how to run it? > There are two pci address for the SRIOV(vfio) mlx5 nic support but it doesn't run correctly. (12:01.0, 12:01.1) > > I started one process which is running inside the docker process that is on the MLX5 NIC support host server. > The process started to run with following option. > -d /usr/local/lib/librte_net_mlx5.so > And the docker process has mlx5 libraries as below. Did you try on the host outside of any container? Please could you try following commands (variables to be replaced)? dpdk-hugepages.py --reserve 1G ip link set $netdev netns $container docker run --cap-add SYS_NICE --cap-add IPC_LOCK --cap-add NET_ADMIN \ --device /dev/infiniband/ $image echo show port summary all | dpdk-testpmd --in-memory -- -i > 706a37a35d29:/usr/local/lib # ls -1 | grep mlx > librte_common_mlx5.so > librte_common_mlx5.so.21 > librte_common_mlx5.so.21.0 > librte_net_mlx5.so > librte_net_mlx5.so.21 > librte_net_mlx5.so.21.0 > > But I failed to run the process with following error. (MIDHAUL_PCI_ADDR:0000:12:01.0, BACKHAUL_PCI_ADDR:0000:12:01.1) > > --- > > mlx5_pci: unable to recognize master/representors on the multiple IB devices > common_mlx5: Failed to load driver = mlx5_pci. > EAL: Requested device 0000:12:01.0 cannot be used > mlx5_pci: unable to recognize master/representors on the multiple IB devices > common_mlx5: Failed to load driver = mlx5_pci. > EAL: Requested device 0000:12:01.1 cannot be used > EAL: Bus (pci) probe failed. > > --- > > For the success case of pci address 12:01.2, it showed following messages. > > --- > > EAL: Detected 64 lcore(s) > EAL: Detected 2 NUMA nodes > EAL: Multi-process socket /var/run/dpdk/nah2/mp_socket > EAL: Probing VFIO support... > EAL: VFIO support initialized > EAL: PCI device 0000:12:01.2 on NUMA socket 0 > EAL: probe driver: 15b3:1016 net_mlx5 > net_mlx5: MPLS over GRE/UDP tunnel offloading disabled due to old OFED/rdma-core version or firmware configuration > net_mlx5: port 0 the requested maximum Rx packet size (2056) is larger than a single mbuf (2048) and scattered mode has not been requested > USER1: rte_ip_frag_table_create: allocated of 6291584 bytes at socket 0 > > --- > > BR/Jaeeun