Couple of build problems ( Fedora 36, DPDK 21.11.1 )

Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Mark de Roussier]

[-- Attachment #1.1: Type: text/plain, Size: 3897 bytes --]

Hi folk,

I'm just starting to experiment with DPDK, but I'm noticing some build issues. I'm using Fedora 36, and DPDK 21.11.1, and following the build instructions at https://core.dpdk.org/doc/quick-start/, building all examples ( meson -Dexamples=all build ).

The first problem is that the build is not finding certain libraries which are installed and known about by pkg-config.

>[mderouss@mark-dt ~]$ pkg-config --modversion jansson
>2.13.1
>[mderouss@mark-dt ~]$ pkg-config --modversion numa
>2.0.14
>[mderouss@mark-dt ~]$ pkg-config --modversion libarchive
>3.5.3

However, using LIBRARY_PATH to specify their location appears to resolve the problem. There is a potentially relevant error in the meson log :

    [Errno 21] Is a directory: '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
    Unusable script '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
    Program pkg-config found: YES (/usr/bin/pkg-config)

Is this expected behaviour, i.e. LIBRARY_PATH is expected to be set ?

The more taxing problem is that I am using ( for this experiment ) a Mellanox NIC :

>[mderouss@mark-dt ~]$ lspci | grep Mellanox
>06:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
>06:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]

The meson log reports missing dependencies. It isn't clear to me how I am supposed to satisfy the unresolved dependencies with respect to Mellanox related libraries, in particular the 'missing internal dependency' ? The meson log reports the following, but I think I'm only interested in the mlx ones :

    drivers:
          common/mvep:  missing dependency, "libmusdk"
          common/mlx5:  missing dependency, "mlx5"
          net/mlx4:     missing dependency, "mlx4"
          net/mlx5:     missing internal dependency, "common_mlx5"
          net/mvneta:   missing dependency, "libmusdk"
          net/mvpp2:    missing dependency, "libmusdk"
          net/nfb:      missing dependency, "libnfb"
          raw/ioat:     replaced by dmadev drivers
          crypto/armv8: missing dependency, "libAArch64crypto"
          crypto/mlx5:  missing internal dependency, "common_mlx5"
          crypto/mvsam: missing dependency, "libmusdk"
          compress/isal:      missing dependency, "libisal"
          compress/mlx5:      missing internal dependency, "common_mlx5"
          regex/mlx5:   missing internal dependency, "common_mlx5"
          vdpa/mlx5:    missing internal dependency, "common_mlx5"
          gpu/cuda:     missing dependency, "cuda.h"

I read DPDK documentation which seems to suggest that support for Mellanox NICs is somehow 'built in' to DPDK, but this does not appear to be the case ?

The documentation refers to a library 'librte_common_mlx5', but does not explain where this can be found. I've looked at downloads from NVIDIA, but even so I am not clear what I need. I've installed the 'RDMA Core Userspace Library' in my system as they are available from the distro, but I'm not sure if these are even relevant :

>[mderouss@mark-dt ~]$ pkg-config --list-all | grep mlx
>libmlx4                        libmlx4 - RDMA Core Userspace Library
>libmlx5                        libmlx5 - RDMA Core Userspace Library

Could someone possibly clarify what I actually need, and where I should get it from ?

Regards,
Mark de Roussier






















[cid:bfe06702-5f46-4fb0-b5d9-2c1e4252d3d1][cid:08c8e8c8-6523-42be-95fa-b86e84e922f8]

[-- Attachment #1.2: Type: text/html, Size: 8922 bytes --]

[-- Attachment #2: Outlook-m5klsbya.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #3: Outlook-gak3b304.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Дмитрий Степанов]

[-- Attachment #1.1: Type: text/plain, Size: 3948 bytes --]

Hey!
According to missing mlx5 dependency - i have the same problem on my Ubuntu
system.
You should check full meson build error logs.
In my case the error was in missing libmlx5 library

> Run-time dependency libmlx5 found: NO (tried pkgconfig)

Installing the libibverbs-dev package resolved the issue!

ср, 20 июл. 2022 г. в 11:38, Mark de Roussier <mark@hitomi-broadcast.tv>:

> Hi folk,
>
> I'm just starting to experiment with DPDK, but I'm noticing some build
> issues. I'm using Fedora 36, and DPDK 21.11.1, and following the build
> instructions at https://core.dpdk.org/doc/quick-start/, building all
> examples ( meson -Dexamples=all build ).
>
> The first problem is that the build is not finding certain libraries which
> are installed and known about by pkg-config.
>
> >[mderouss@mark-dt ~]$ pkg-config --modversion jansson
> >2.13.1
> >[mderouss@mark-dt ~]$ pkg-config --modversion numa
> >2.0.14
> >[mderouss@mark-dt ~]$ pkg-config --modversion libarchive
> >3.5.3
>
> However, using LIBRARY_PATH to specify their location appears to resolve
> the problem. There is a potentially relevant error in the meson log :
>
>     [Errno 21] Is a directory:
> '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
>     Unusable script
> '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
>     Program pkg-config found: YES (/usr/bin/pkg-config)
>
> Is this expected behaviour, i.e. LIBRARY_PATH is expected to be set ?
>
> The more taxing problem is that I am using ( for this experiment ) a
> Mellanox NIC :
>
> >[mderouss@mark-dt ~]$ lspci | grep Mellanox
> >06:00.0 Ethernet controller: Mellanox Technologies MT27710 Family
> [ConnectX-4 Lx]
> >06:00.1 Ethernet controller: Mellanox Technologies MT27710 Family
> [ConnectX-4 Lx]
>
> The meson log reports missing dependencies. It isn't clear to me how I am
> supposed to satisfy the unresolved dependencies with respect to Mellanox
> related libraries, in particular the 'missing internal dependency' ? The
> meson log reports the following, but I think I'm only interested in the mlx
> ones :
>
>     drivers:
>    common/mvep: missing dependency, "libmusdk"
>    *common/mlx5: missing dependency, "mlx5"*
>    *net/mlx4: missing dependency, "mlx4"*
>    *net/mlx5: missing internal dependency, "common_mlx5"*
>    net/mvneta: missing dependency, "libmusdk"
>    net/mvpp2: missing dependency, "libmusdk"
>    net/nfb: missing dependency, "libnfb"
>    raw/ioat: replaced by dmadev drivers
>    crypto/armv8: missing dependency, "libAArch64crypto"
>    *crypto/mlx5: missing internal dependency, "common_mlx5"*
>    crypto/mvsam: missing dependency, "libmusdk"
>    compress/isal: missing dependency, "libisal"
>    *compress/mlx5: missing internal dependency, "common_mlx5"*
>   * regex/mlx5: missing internal dependency, "common_mlx5"*
>    *vdpa/mlx5: missing internal dependency, "common_mlx5"*
>    gpu/cuda: missing dependency, "cuda.h"
>
> I read DPDK documentation which seems to suggest that support for Mellanox
> NICs is somehow 'built in' to DPDK, but this does not appear to be the case
> ?
>
> The documentation refers to a library 'librte_common_mlx5', but does not
> explain where this can be found. I've looked at downloads from NVIDIA, but
> even so I am not clear what I need. I've installed the 'RDMA Core Userspace
> Library' in my system as they are available from the distro, but I'm not
> sure if these are even relevant :
>
> >[mderouss@mark-dt ~]$ pkg-config --list-all | grep mlx
> >libmlx4                        libmlx4 - RDMA Core Userspace Library
> >libmlx5                        libmlx5 - RDMA Core Userspace Library
>
> Could someone possibly clarify what I actually need, and where I should
> get it from ?
>
> Regards,
> Mark de Roussier
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>

[-- Attachment #1.2: Type: text/html, Size: 8564 bytes --]

[-- Attachment #2: Outlook-m5klsbya.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #3: Outlook-gak3b304.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Mark de Roussier]

[-- Attachment #1.1: Type: text/plain, Size: 5046 bytes --]

Hi Stephanov,

thanks for the quick reply ! Yeah, I noticed the libmlx5 complaint in the log, but it wasn't useful because I didn't know where to look for libmlx5. Thanks for the pointer ! Looks like Fedora hasn't included the libibverbs-dev package in it's standard repo, so I'll have to go hunt for it, but now I know what I'm looking for 🙂.

Cheers,
Mark de Roussier



[cid:5d8d9e42-bc90-49da-8eec-df9d55ebfba1][cid:01aa7a99-cf9d-48c1-838a-8d8d1ea458a6]
________________________________
From: Дмитрий Степанов <stepanov.dmit@gmail.com>
Sent: 20 July 2022 10:55
To: Mark de Roussier <mark@hitomi-broadcast.tv>
Cc: users@dpdk.org <users@dpdk.org>
Subject: Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

Hey!
According to missing mlx5 dependency - i have the same problem on my Ubuntu system.
You should check full meson build error logs.
In my case the error was in missing libmlx5 library

> Run-time dependency libmlx5 found: NO (tried pkgconfig)

Installing the libibverbs-dev package resolved the issue!

ср, 20 июл. 2022 г. в 11:38, Mark de Roussier <mark@hitomi-broadcast.tv<mailto:mark@hitomi-broadcast.tv>>:
Hi folk,

I'm just starting to experiment with DPDK, but I'm noticing some build issues. I'm using Fedora 36, and DPDK 21.11.1, and following the build instructions at https://core.dpdk.org/doc/quick-start/, building all examples ( meson -Dexamples=all build ).

The first problem is that the build is not finding certain libraries which are installed and known about by pkg-config.

>[mderouss@mark-dt ~]$ pkg-config --modversion jansson
>2.13.1
>[mderouss@mark-dt ~]$ pkg-config --modversion numa
>2.0.14
>[mderouss@mark-dt ~]$ pkg-config --modversion libarchive
>3.5.3

However, using LIBRARY_PATH to specify their location appears to resolve the problem. There is a potentially relevant error in the meson log :

    [Errno 21] Is a directory: '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
    Unusable script '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
    Program pkg-config found: YES (/usr/bin/pkg-config)

Is this expected behaviour, i.e. LIBRARY_PATH is expected to be set ?

The more taxing problem is that I am using ( for this experiment ) a Mellanox NIC :

>[mderouss@mark-dt ~]$ lspci | grep Mellanox
>06:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
>06:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]

The meson log reports missing dependencies. It isn't clear to me how I am supposed to satisfy the unresolved dependencies with respect to Mellanox related libraries, in particular the 'missing internal dependency' ? The meson log reports the following, but I think I'm only interested in the mlx ones :

    drivers:
          common/mvep:  missing dependency, "libmusdk"
          common/mlx5:  missing dependency, "mlx5"
          net/mlx4:     missing dependency, "mlx4"
          net/mlx5:     missing internal dependency, "common_mlx5"
          net/mvneta:   missing dependency, "libmusdk"
          net/mvpp2:    missing dependency, "libmusdk"
          net/nfb:      missing dependency, "libnfb"
          raw/ioat:     replaced by dmadev drivers
          crypto/armv8: missing dependency, "libAArch64crypto"
          crypto/mlx5:  missing internal dependency, "common_mlx5"
          crypto/mvsam: missing dependency, "libmusdk"
          compress/isal:      missing dependency, "libisal"
          compress/mlx5:      missing internal dependency, "common_mlx5"
          regex/mlx5:   missing internal dependency, "common_mlx5"
          vdpa/mlx5:    missing internal dependency, "common_mlx5"
          gpu/cuda:     missing dependency, "cuda.h"

I read DPDK documentation which seems to suggest that support for Mellanox NICs is somehow 'built in' to DPDK, but this does not appear to be the case ?

The documentation refers to a library 'librte_common_mlx5', but does not explain where this can be found. I've looked at downloads from NVIDIA, but even so I am not clear what I need. I've installed the 'RDMA Core Userspace Library' in my system as they are available from the distro, but I'm not sure if these are even relevant :

>[mderouss@mark-dt ~]$ pkg-config --list-all | grep mlx
>libmlx4                        libmlx4 - RDMA Core Userspace Library
>libmlx5                        libmlx5 - RDMA Core Userspace Library

Could someone possibly clarify what I actually need, and where I should get it from ?

Regards,
Mark de Roussier






















[cid:1821b0405152c70d1d31][cid:1821b040515771430ca2]

[-- Attachment #1.2: Type: text/html, Size: 11699 bytes --]

[-- Attachment #2: Outlook-m5klsbya.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #3: Outlook-gak3b304.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

[-- Attachment #4: Outlook-pqka112w.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #5: Outlook-aqz4fkuf.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[David Marchand]

[-- Attachment #1: Type: text/plain, Size: 530 bytes --]

On Wed, Jul 20, 2022 at 2:19 PM Mark de Roussier <mark@hitomi-broadcast.tv>
wrote:

> Hi Stephanov,
>
> thanks for the quick reply ! Yeah, I noticed the libmlx5 complaint in the
> log, but it wasn't useful because I didn't know where to look for libmlx5.
> Thanks for the pointer ! Looks like Fedora hasn't included the
> libibverbs-dev package in it's standard repo, so I'll have to go hunt for
> it, but now I know what I'm looking for 🙂.
>

I think you are looking for rdma-core-devel.


-- 
David Marchand

[-- Attachment #2: Type: text/html, Size: 1542 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Mark de Roussier]

[-- Attachment #1.1: Type: text/plain, Size: 1221 bytes --]

Hello David,

thanks for the idea, but I'm afraid that's not the case. I do have that already, that is what is providing libmlx4 and libmlx5. But it does not contain librte_common_mlx5, which is what I think is probably the source of my problem.

Cheers,
Mark

[cid:8487dc36-3485-4f1a-b9bf-3476dcf122e0][cid:835153b4-87cd-4e3c-95ed-f810959f7f39]
________________________________
From: David Marchand <david.marchand@redhat.com>
Sent: 20 July 2022 15:14
To: Mark de Roussier <mark@hitomi-broadcast.tv>
Cc: Дмитрий Степанов <stepanov.dmit@gmail.com>; users@dpdk.org <users@dpdk.org>
Subject: Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )


On Wed, Jul 20, 2022 at 2:19 PM Mark de Roussier <mark@hitomi-broadcast.tv<mailto:mark@hitomi-broadcast.tv>> wrote:
Hi Stephanov,

thanks for the quick reply ! Yeah, I noticed the libmlx5 complaint in the log, but it wasn't useful because I didn't know where to look for libmlx5. Thanks for the pointer ! Looks like Fedora hasn't included the libibverbs-dev package in it's standard repo, so I'll have to go hunt for it, but now I know what I'm looking for 🙂.

I think you are looking for rdma-core-devel.


--
David Marchand


[-- Attachment #1.2: Type: text/html, Size: 4014 bytes --]

[-- Attachment #2: Outlook-e1vd31lu.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #3: Outlook-fpbvskjc.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[David Marchand]

On Wed, Jul 20, 2022 at 4:59 PM Mark de Roussier
<mark@hitomi-broadcast.tv> wrote:
>
> Hello David,
>
> thanks for the idea, but I'm afraid that's not the case. I do have that already, that is what is providing libmlx4 and libmlx5. But it does not contain librte_common_mlx5, which is what I think is probably the source of my problem.

Well, that's what I have on my Fedora to build mlx drivers.

Btw, librte_common_mlx5 is an internal DPDK driver.
If you still see that this component is disabled after installing
those headers via the devel packages, then maybe you did not
reconfigure your build env.
$ meson --reconfigure <build_dir>


If this is not working, you'll have to look into
<build_dir>/meson-logs/, there may be some useful info in those logs.


-- 
David Marchand

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Dmitry Kozlyuk]

2022-07-20 14:58 (UTC+0000), Mark de Roussier:
> thanks for the idea, but I'm afraid that's not the case. I do have that already, that is what is providing libmlx4 and libmlx5. But it does not contain librte_common_mlx5, which is what I think is probably the source of my problem.

librte_common_mlx5 is built as part of DPDK.
The dependency chain is as follows ("|" denotes DPDK boundary):

librte_{net,...}_mlx5 -> librte_common_mlx5 -> | -> libmlx5, libibverbs

I think the root cause is with pkg-config, as described in your first message.
pkg-config is used to find libraries, including libibverbs and libmlx5.
librte_common_mlx5 build is skipped if they are not found.

This message is harmless:

[Errno 21] Is a directory: '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'
Unusable script '/home/mderouss/Projects/dpdk/dpdk-stable-21.11.1/buildtools/pkg-config'

LIBRARY_PATH should not be needed.
What is the full build log?

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[Mark de Roussier]

[-- Attachment #1.1: Type: text/plain, Size: 1813 bytes --]

>then maybe you did not reconfigure your build env.
>$ meson --reconfigure <build_dir>

🙂. I tried many meson commands to wipe/reconfigure my build environment, but I've just blown away the whole build directory and started again, and now it appears to be working ( though I thought I'd tried that before too ). Maybe I missed a trick with reconfiguring meson, I don't know. The PC has also been restarted a few times. The ninja build succeeds ( with warnings ).

Anyway, I'm encouraged that there are people listening out there, and willing to try helping  🙂.

Thanks folk,
Mark


[cid:a8ca81a5-8baf-4da6-a3b6-bd53d0013478][cid:4721cdc2-3222-4b8f-8ce2-87d22690b4f8]
________________________________
From: David Marchand <david.marchand@redhat.com>
Sent: 20 July 2022 16:18
To: Mark de Roussier <mark@hitomi-broadcast.tv>
Cc: Дмитрий Степанов <stepanov.dmit@gmail.com>; users@dpdk.org <users@dpdk.org>
Subject: Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

On Wed, Jul 20, 2022 at 4:59 PM Mark de Roussier
<mark@hitomi-broadcast.tv> wrote:
>
> Hello David,
>
> thanks for the idea, but I'm afraid that's not the case. I do have that already, that is what is providing libmlx4 and libmlx5. But it does not contain librte_common_mlx5, which is what I think is probably the source of my problem.

Well, that's what I have on my Fedora to build mlx drivers.

Btw, librte_common_mlx5 is an internal DPDK driver.
If you still see that this component is disabled after installing
those headers via the devel packages, then maybe you did not
reconfigure your build env.
$ meson --reconfigure <build_dir>


If this is not working, you'll have to look into
<build_dir>/meson-logs/, there may be some useful info in those logs.


--
David Marchand


[-- Attachment #1.2: Type: text/html, Size: 4364 bytes --]

[-- Attachment #2: Outlook-aduifygt.jpg --]
[-- Type: image/jpeg, Size: 40880 bytes --]

[-- Attachment #3: Outlook-ewewvaav.jpg --]
[-- Type: image/jpeg, Size: 22705 bytes --]

Re: Couple of build problems ( Fedora 36, DPDK 21.11.1 )

[David Marchand]

On Wed, Jul 20, 2022 at 6:12 PM Mark de Roussier
<mark@hitomi-broadcast.tv> wrote:
>
> >then maybe you did not reconfigure your build env.
> >$ meson --reconfigure <build_dir>
>
> 🙂. I tried many meson commands to wipe/reconfigure my build environment, but I've just blown away the whole build directory and started again, and now it appears to be working ( though I thought I'd tried that before too ). Maybe I missed a trick with reconfiguring meson, I don't know. The PC has also been restarted a few times. The ninja build succeeds ( with warnings ).

Those warnings may be what I have fixed in 22.07 wrt GCC 12.
Backports for 21.11 are in progress, you may try with the last
stable/21.11 branch.
https://git.dpdk.org/dpdk-stable/log/?h=21.11


-- 
David Marchand