From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 91452A0546 for ; Wed, 26 May 2021 21:41:35 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2DB1640150; Wed, 26 May 2021 21:41:35 +0200 (CEST) Received: from mail-ej1-f42.google.com (mail-ej1-f42.google.com [209.85.218.42]) by mails.dpdk.org (Postfix) with ESMTP id C34C640143 for ; Wed, 26 May 2021 21:41:33 +0200 (CEST) Received: by mail-ej1-f42.google.com with SMTP id z12so4344902ejw.0 for ; Wed, 26 May 2021 12:41:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=ykxI8VS4qCdB6VktbiP+SwLzPyiICsK9R/MyhSinEj0=; b=AO9Y++OFMRciK+rVPzC3tiBgJYel9YyLfrOUw9tpvZ25vqn52pTdkZEKPMI6uBkyjo JjgkvY3nbyPZb7TTjEpAYrgIA0WSQ9TnGIcfUW9r8fzKKOWQdfXVGzYH37XBYN+vVKO5 KqgI1iZPmBA3EBDKxQuq0UHKKIeCDYiOtSSSdRnYktNe2/7Lv4DtKxsztvVC4lH4M4Mc 2wZlR8AJ67C+MO/xcd1F3uQQ4X6noHB9c2CYG5XEIFCiVrZXu1db7CRAIeMUmBb31D5K l6sPCB6u4KxaC8X0ayT9YfwKAa3EXxGH/1DZm+ZGEJyClA4ci62Rs5zbgaO6dpoPCK0R e6Aw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ykxI8VS4qCdB6VktbiP+SwLzPyiICsK9R/MyhSinEj0=; b=nwe5ubrUGhoSCcrXjfIcZpoqSSJXMZCpYfMVKv3aAbg2iWvOKKfM+r1E7Gapae7m6F GPlNv1r86E8tAAaVP0lUSyZxA1B8bavC89OMhOMSJXm/oflWGcxO2nTGheMY9Nf09WTU glKswggyhomlM0X9xll2LmfAlBPlm1tJFLiLCLqhTp7xlk7Mca3iQbbQdS4eU1cmpqaS RD58+5rugyhwjkN7If2ztnpPp7CALyvYSNUCm/2g3zLEgAF8gIjQFHcIha3EUAtTOnyr vk2CApCk/P0XyjPdo7fTW+XxcfXdFW6HbhKQwhGSse4iHCQdCVZJXaxd/qxBjp9OjHde KjRg== X-Gm-Message-State: AOAM5336Wh0HBFaKDNZTeqOIVRFNlYhta5kZH/36EXq29dPK1YOmtCd9 CemTnJqCFa7nr3qHATXTjGvVdFkj6yhI+IdfWHUj0gDwETI= X-Google-Smtp-Source: ABdhPJx8v9yIdLj45c3aafgFQzjSaSDvx/QBEtA4p+WjtyPN9dQJDoMMbkKpIp24MCV0izpnM6D3gQLzn0qhyGh4urI= X-Received: by 2002:a17:907:c06:: with SMTP id ga6mr10635050ejc.229.1622058093365; Wed, 26 May 2021 12:41:33 -0700 (PDT) MIME-Version: 1.0 References: <20210526105326.2b580fc7@hermes.local> In-Reply-To: From: Sudharshan Krishnakumar Date: Wed, 26 May 2021 12:41:21 -0700 Message-ID: To: Stephen Hemminger Cc: users@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [dpdk-users] Issue moving to DPDK 20.11 release X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi Stephen, Normal for dynamically linked shared libraries, linker should load the dependant libraries based on library path under-> /etc/ld.so.conf.d$ cat x86_64-linux-gnu.conf # Multiarch support /usr/local/lib/x86_64-linux-gnu /lib/x86_64-linux-gnu /usr/lib/x86_64-linux-gnu I do have the /usr/local/lib/x86* path, which is where DPDK 20.11 shared(*.so) libraries have been installed. But during launch of application, application does not seem to load those libraries. Normally this method works. Is this a DPDK issue. In any case, I followed your suggestion, did ldd -v packet_ordering-shared, to get the dependencies, and manually passed the paths to the application, but there is another error now-> MBUF: error setting mempool handler ~/dpdk-20.11/examples/packet_ordering/build$ sudo ./packet_ordering -l 4-6 -n 2 --proc-type auto --log-level 7 -m 1024 --file-prefix packet_ordering -d /usr/local/lib/x86_64-linux-gnu/librte_eal.so -d /usr/local/lib/x86_64-linux-gnu/librte_net_i40e.so -d /usr/local/lib/x86_64-linux-gnu/librte_reorder.so -d /usr/local/lib/x86_64-linux-gnu/librte_ethdev.so -d /usr/local/lib/x86_64-linux-gnu/librte_mbuf.so -d /usr/local/lib/x86_64-linux-gnu/librte_mempool.so -d /usr/local/lib/x86_64-linux-gnu/librte_ring.so -d /usr/lib/x86_64-linux-gnu/libnuma.so.1 -d /usr/local/lib/x86_64-linux-gnu/librte_kvargs.so.21 -d /usr/local/lib/x86_64-linux-gnu/librte_net.so.21 -d /usr/local/lib/x86_64-linux-gnu/librte_meter.so.21 -b 0000:31:00.0 -b 0000:31:00.1 -b 0000:05:00.0 -b 0000:06:00.0 -b 0000:07:00.0 -b 0000:08:00.0 -- -p 0xf --disable-reorderEAL: Detected 72 lcore(s) EAL: Detected 2 NUMA nodes EAL: Auto-detected process type: PRIMARY EAL: Multi-process socket /var/run/dpdk/packet_ordering/mp_socket EAL: Selected IOVA mode 'VA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: VFIO support initialized EAL: using IOMMU type 1 (Type 1) EAL: Ignore mapping IO port bar(1) EAL: Ignore mapping IO port bar(4) EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:31:00.2 (socket 0) EAL: Ignore mapping IO port bar(1) EAL: Ignore mapping IO port bar(4) EAL: Probe PCI driver: net_i40e (8086:1572) device: 0000:31:00.3 (socket 0) EAL: No legacy callbacks, legacy socket not created reorder disabled MBUF: error setting mempool handler EAL: Error - exiting with code: 1 Cause: Invalid argument Please let me know. Thanks, Sudha On Wed, May 26, 2021 at 11:10 AM Sudharshan Krishnakumar < sudhar.ckrishna@gmail.com> wrote: > Hi Stephen, Thanks for your reply, I was not aware of that. > > I am using 4-Port Intel 10Gigbit network card-> X710 for 10GbE, and this > is currently bound to DPDK using VFIO-PCI driver, but the corresponding > kernel network driver appears to be-> i40e. > > Currently I dont see shared libraries built under DPDK's-> > build/driver/net/i40e directory. > > Should I build those driver libraries, and then provide path to it, > something like this in EAL param -> -d build/drivers/net/i40e/libi40e.so > > Please let me know. > > Thanks, > > Sudha > Regards, > > Sudha > > On Wed, May 26, 2021 at 10:53 AM Stephen Hemminger < > stephen@networkplumber.org> wrote: > >> On Wed, 26 May 2021 10:27:56 -0700 >> Sudharshan Krishnakumar wrote: >> >> > Hi All, >> > >> > Previously, I had DPDK-19.11 working fine on my server system, which >> runs >> > on Ubuntu 18.04. >> > Have a 4-Port 10 Gigabit Network card, with ports bound to use VFIO-PCI >> > driver. >> > But had to move to DPDK-20.11, and running into issues. >> > >> > I installed on DPDK-20.11 on the server to /usr/local. >> > >> > And did binding of ports using the dpdk-devbind script to use VFIO-PCI >> > driver. >> > >> > But when running DPDK sample application such as-> >> > dpdk-20.11/examples/packet_ordering, >> > noticed DPDK is NOT able to detect any available ports. >> > Getting error-> Cause: Error: no ethernet ports detected >> > >> > Also when I pass parameter to block certain >> interfaces(Bus:Device.Function) >> > on a NIC, EAL throws an >> > Error-> EAL: failed to parse device "0000:31.00.0" >> > >> > On the same system, using the same 10 Gigbit Network card, DPDK sample >> > applications were >> > working fine with older version of DPDK->19.11 >> > >> > Below, I have the output of commands: >> > >> > ~/dpdk-20.11$ sudo ./usertools/dpdk-devbind.py --status >> > >> > Network devices using DPDK-compatible driver >> > ============================================ >> > 0000:31:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci >> > unused=i40e >> > 0000:31:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci >> > unused=i40e >> > 0000:31:00.2 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci >> > unused=i40e >> > 0000:31:00.3 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=vfio-pci >> > unused=i40e >> > >> > Network devices using kernel driver >> > =================================== >> > 0000:01:00.0 'I210 Gigabit Network Connection 1533' if=enp1s0 drv=igb >> > unused=vfio-pci *Active* >> > 0000:17:00.0 'Ethernet Controller 10G X550T 1563' if=ens6f0 drv=ixgbe >> > unused=vfio-pci *Active* >> > 0000:17:00.1 'Ethernet Controller 10G X550T 1563' if=ens6f1 drv=ixgbe >> > unused=vfio-pci *Active* >> > >> > >> > cat /proc/meminfo | grep -i huge >> > AnonHugePages: 8192 kB >> > ShmemHugePages: 0 kB >> > HugePages_Total: 2048 >> > HugePages_Free: 2048 >> > HugePages_Rsvd: 0 >> > HugePages_Surp: 0 >> > Hugepagesize: 2048 kB >> > >> > :~/dpdk-20.11/examples/packet_ordering$ sudo >> ./build/packet_ordering-shared >> > -l 4-6 -n 2 --log-level 7 -m 1024 >> > --file-prefix packet_order -- -p 0xf --disable-reorder >> > EAL: Detected 72 lcore(s) >> > EAL: Detected 2 NUMA nodes >> > EAL: Multi-process socket /var/run/dpdk/packet_order/mp_socket >> > EAL: Selected IOVA mode 'VA' >> > EAL: No available hugepages reported in hugepages-1048576kB >> > EAL: Probing VFIO support... >> > EAL: VFIO support initialized >> > EAL: No legacy callbacks, legacy socket not created >> > reorder disabled >> > EAL: Error - exiting with code: 1 >> > Cause: Error: no ethernet ports detected >> > >> > ~/dpdk-20.11/examples/packet_ordering/build$ sudo ./packet_ordering -l >> 4-6 >> > -n 2 --proc-type auto --log-level 7 -m 1024 >> > --file-prefix packet_ordering -b 0000:31:00.0 -b 0000:31:00.1 >> > -b 0000:05:00.0 -b 0000:06:00.0 -b 0000:07:00.0 -b 0000:08:00.0 -- -p >> 0xf >> > --disable-reorder >> > EAL: Detected 72 lcore(s) >> > EAL: Detected 2 NUMA nodes >> > EAL: Auto-detected process type: PRIMARY >> > EAL: failed to parse device "0000:31:00.0" >> > EAL: Unable to parse device '0000:31:00.0' >> > EAL: Error - exiting with code: 1 >> > Cause: Invalid EAL arguments >> > >> > >> > Please let me know, if you have any suggestions. >> > >> > >> > Thanks, >> > >> > Sudha >> >> By default, DPDK is now dynamically linked and all the drivers are in >> shared libraries. >> You need to pass the -d flag to indicate which library to load. >> >