From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 65D05A0547 for ; Sat, 10 Apr 2021 09:01:16 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DDF68141168; Sat, 10 Apr 2021 09:01:15 +0200 (CEST) Received: from linux.microsoft.com (linux.microsoft.com [13.77.154.182]) by mails.dpdk.org (Postfix) with ESMTP id 9DB68141163 for ; Sat, 10 Apr 2021 09:01:14 +0200 (CEST) Received: by linux.microsoft.com (Postfix, from userid 1059) id DCB7020B568A; Sat, 10 Apr 2021 00:01:13 -0700 (PDT) DKIM-Filter: OpenDKIM Filter v2.11.0 linux.microsoft.com DCB7020B568A DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.microsoft.com; s=default; t=1618038073; bh=2W5XCktfLHV5bVWXnTCB1Y2G+oLgwiNmB3wda53c5Sk=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=VarKc08XAYvOwUnqcq2HMmmOe9vLqljXJqNyvaOXD6Brla+/M7HVKoPaOW/69+uoA 7myxn/grj/B+tFeG6JSbl37p3qTBfXkLkfdQKeAvoiN6BUOiG00ubYaNu0N6ypdi3q rBNy+l/Vmg+bv+i4fACqYTCKEvVZkNxdy2gGy6rY= Date: Sat, 10 Apr 2021 00:01:13 -0700 From: Narcisa Ana Maria Vasile To: "Wiles, Keith" Cc: Narcisa Ana Maria Vasile , "users@dpdk.org" , "Kevin Daniel (WIPRO LIMITED)" , Omar Cardona Message-ID: <20210410070113.GA22367@linuxonhyperv3.guj3yctzbm1etfxqx2vob5hsef.xx.internal.cloudapp.net> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Subject: Re: [dpdk-users] Running Pktgen with Mellanox CX5 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" On Fri, Apr 09, 2021 at 02:15:04PM +0000, Wiles, Keith wrote: > > > > On Apr 8, 2021, at 7:08 PM, Narcisa Ana Maria Vasile wrote: > > > > Thanks for the quick reply! Just to clarify, the libmlx4 doesn't get installed when installing the latest Mellanox drivers. > > Instead, the libmlx5 is installed, which I believe is the right one to use with Cx5s. > > > > It looks like pktgen needs libmlx4 to run, so does this mean that it is only working with older Mellanox tools and NICs? > > I could try install the libmlx4, but my understanding was that libmlx4 is for Cx3s and libmlx5 is for Cx4s and Cx5s. > > Pktgen has no requirement to work with any mlx library or hardware for that matter. I do not know what this problem is, but I believe it is not a Pktgen problem. Did you try with testpmd or any of the DPDK examples. If they work with mlx then I can look at why Pktgen does not work in this case. If anything the libmlx5 is referencing the mlx4 library for some reason and when you added the mlx5 PMD it also needed the mlx4. > Sure, I understand it's not required to work with any of these HW or libs. I thought I'd ask in case someone in the community tested with a similar setup and can confirm whether it works or not. If someone has it working, then it's probably a misconfiguration on my side, alternatively if it's known that this is an unsupported setup I can stop investigating. > BTW, notice the error message states "EAL: libmlx4.so.1: cannot open shared object file: No such file or directory” EAL Is DPDK initialization not Pktgen. That's right, it looks like it's required by EAL. However, I am able to run testpmd successfully. I've also tried l2fwd successfully. Still, this doesn't necessarily mean the issue is Pktgen-related, that's why I wanted to verify here. > > > > -----Original Message----- > > From: Wiles, Keith > > Sent: Thursday, April 8, 2021 2:12 PM > > To: Narcisa Ana Maria Vasile > > Cc: users@dpdk.org; Kevin Daniel (WIPRO LIMITED) ; Omar Cardona > > Subject: [EXTERNAL] Re: Running Pktgen with Mellanox CX5 > > > > > > > >> On Apr 8, 2021, at 1:47 PM, Narcisa Ana Maria Vasile wrote: > >> > >> Hi, > >> > >> I’m trying to run pktgen (latest ‘master’ branch) with a Mellanox CX5 NIC on Ubuntu 20.04. > >> I’ve installed the latest Mellanox drivers (MLNX_OFED_LINUX-5.3-1.0.0.1-ubuntu20.04-x86_64.iso). > >> I’ve compiled and installed DPDK successfully (latest ‘main’ branch). > >> > >> As you can see below, I’m getting an error message saying “libmlx4.so.1: cannot open shared object file: No such file or directory”. > >> I am able to run other DPDK applications such as ‘testpmd’. > >> > >> Is pktgen supported with the latest Mellanox drivers on CX5? Thank you! > >> > >> -------------- > >> pktgen -l 1,3,5 -a 04:00.0 -d librte_net_mlx5.so -- -P -m "[3:5].0" -T > >> > >> Copyright(c) <2010-2021>, Intel Corporation. All rights reserved. Powered by DPDK > >> EAL: Detected 20 lcore(s) > >> EAL: Detected 2 NUMA nodes > >> EAL: Detected shared linkage of DPDK > >> EAL: libmlx4.so.1: cannot open shared object file: No such file or directory > >> EAL: FATAL: Cannot init plugins > >> EAL: Cannot init plugins > > > > I have not built anything with mlx in a long time. My guess is the libmix4.so.1 is not located in a place the system can pick up. Maybe you need to set LD_LIBRARY_PATH to the path where this library is located. I see you included the DPDK PMD, but you still need to tell applications where to locate the library. Another option is to add it to the /etc/ld.so.conf.d/ file or use pkg-config to locate the libs may help too. In some cases external packages do not store the libs in a standard place for ldconfig to locate or the package does not provide ldconfig configuration files. > >> > >> Thank you, > >> Narcisa V. > > >