ibverbs_1.8 not found

ibverbs_1.8 not found

[Kevin Williams]

Hi,

I have just installed a fresh Rocky 8.8 on a server with two Mellanox interfaces, which seem to have the correct firmware according to Nvidia:

  Device Type:      ConnectX3
  Part Number:      MCX353A-FCB_A2-A5
  Description:      ConnectX-3 VPI adapter card; single-port QSFP; FDR IB (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
  PCI Device Name:  /dev/mst/mt4099_pci_cr1
  Versions:         Current        Available
     FW             2.42.5000      N/A
     PXE            3.4.0752       N/A

  Status:           No matching image found

I have followed all instructions on the Ettus web page (https://kb.ettus.com/Getting_Started_with_DPDK_and_UHD) which proceeded without any issues.

When running an Ettus benchmark utility I get the following error.

[root@rflab-r720 python]# ./benchmark_rate.py --rx_rate 184.32e6 --rx_subdev "A:0 B:0" --rx_channels "0" --tx_rate 184.32e6 --tx_subdev "A:0 B:0" --tx_channels 0 --args "addr=10.28.128.3,second_addr=10.29.128.3,master_clock_rate=184.32e6,use_dpdk=1"
[INFO] [UHD] linux; GNU C++ version 8.5.0 20210514 (Red Hat 8.5.0-20); Boost_106600; DPDK_21.11; UHD_
EAL: Detected CPU lcores: 24
EAL: Detected NUMA nodes: 2
EAL: Detected shared linkage of DPDK
EAL: /usr/lib64/libibverbs.so.1: version `IBVERBS_1.8' not found (required by /usr/lib64/dpdk-pmds/librte_common_mlx5.so.22.0)
EAL: FATAL: Cannot init plugins
EAL: Cannot init plugins
[ERROR] [DPDK] Error with EAL initialization
[ERROR] [UHD] Device discovery error: RuntimeError: Error with EAL initialization
EAL: Detected CPU lcores: 24
EAL: Detected NUMA nodes: 2
EAL: Option -l is ignored, because (-l) is set!

I see there are two locations for libibverbs.so.1, but setting LD_LIBRARY_PATH to either results in the same error.

/usr/lib64/mlnx_ofed/valgrind/libibverbs.so.1
/usr/lib64/libibverbs.so.1

I can't install a new libibverbs RPM because of obsolescence issues.

Can anyone offer any advice?

Many thanks, Kevin

RE: ibverbs_1.8 not found

[Bing Zhao]

Hi Kevin,

Usually, the issue is irrelevant to the FW but the building/linking and runtime ENV.
If possible, could you rebuild your DPDK libs and APP from the source code and the scratch on this running setup to have another try?

1. Please use "ls -al" of the ibverbs.so to check the actual version in the suffix.
2. Try to use "ldd" / "objdump/nm" to check the so version that the DPDK application linked and wants to load.

BR. Bing

> -----Original Message-----
> From: Kevin Williams <kevin.williams@vastech.co.za>
> Sent: Wednesday, April 24, 2024 9:56 PM
> To: users@dpdk.org
> Subject: ibverbs_1.8 not found
> 
> External email: Use caution opening links or attachments
> 
> 
> Hi,
> 
> I have just installed a fresh Rocky 8.8 on a server with two Mellanox interfaces,
> which seem to have the correct firmware according to Nvidia:
> 
>   Device Type:      ConnectX3
>   Part Number:      MCX353A-FCB_A2-A5
>   Description:      ConnectX-3 VPI adapter card; single-port QSFP; FDR IB
> (56Gb/s) and 40GigE; PCIe3.0 x8 8GT/s; RoHS R6
>   PCI Device Name:  /dev/mst/mt4099_pci_cr1
>   Versions:         Current        Available
>      FW             2.42.5000      N/A
>      PXE            3.4.0752       N/A
> 
>   Status:           No matching image found
> 
> I have followed all instructions on the Ettus web page
> (https://kb.ettus.com/Getting_Started_with_DPDK_and_UHD) which
> proceeded without any issues.
> 
> When running an Ettus benchmark utility I get the following error.
> 
> [root@rflab-r720 python]# ./benchmark_rate.py --rx_rate 184.32e6 --
> rx_subdev "A:0 B:0" --rx_channels "0" --tx_rate 184.32e6 --tx_subdev "A:0
> B:0" --tx_channels 0 --args
> "addr=10.28.128.3,second_addr=10.29.128.3,master_clock_rate=184.32e6,
> use_dpdk=1"
> [INFO] [UHD] linux; GNU C++ version 8.5.0 20210514 (Red Hat 8.5.0-20);
> Boost_106600; DPDK_21.11; UHD_
> EAL: Detected CPU lcores: 24
> EAL: Detected NUMA nodes: 2
> EAL: Detected shared linkage of DPDK
> EAL: /usr/lib64/libibverbs.so.1: version `IBVERBS_1.8' not found (required by
> /usr/lib64/dpdk-pmds/librte_common_mlx5.so.22.0)
> EAL: FATAL: Cannot init plugins
> EAL: Cannot init plugins
> [ERROR] [DPDK] Error with EAL initialization [ERROR] [UHD] Device discovery
> error: RuntimeError: Error with EAL initialization
> EAL: Detected CPU lcores: 24
> EAL: Detected NUMA nodes: 2
> EAL: Option -l is ignored, because (-l) is set!
> 
> I see there are two locations for libibverbs.so.1, but setting LD_LIBRARY_PATH
> to either results in the same error.
> 
> /usr/lib64/mlnx_ofed/valgrind/libibverbs.so.1
> /usr/lib64/libibverbs.so.1
> 
> I can't install a new libibverbs RPM because of obsolescence issues.
> 
> Can anyone offer any advice?
> 
> Many thanks, Kevin
>