DPDK usage discussions
 help / color / mirror / Atom feed
* Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform
@ 2019-09-24 16:31 Jim Vaigl
  2019-09-24 17:18 ` Stephen Hemminger
  0 siblings, 1 reply; 12+ messages in thread
From: Jim Vaigl @ 2019-09-24 16:31 UTC (permalink / raw)
  To: users

Since no one has chimed in with any build/install/configure suggestion for
the
BlueField, I've spent some time debugging and thought I'd share the results.
Building the l3fwd example application and running it as the docs suggest,
when
I try to send it UDP packets from another machine, it dumps core.

Debugging a bit with gdb and printf, I can see that from inside
process_packet()
and processx4_step1() the calls to rte_pktmbuf_mtod() return Nil or
suspicious
pointer values (i.e. 0x80).  The sample apps don't guard against NULL
pointers
being returned from this rte call, so that's why it's dumping core.

I still think the problem is related to the driver config, but thought this
might ring a bell for anyone who's had problems like this.

The thing that still bothers me is that rather than seeing what I was
expecting
at init based on what the documentation shows:
    [...]
    EAL: probe driver: 15b3:1013 librte_pmd_mlx5

... when rte_eal_init() runs, I'm seeing:
    [...]
    EAL:  Selected IOVA mode 'PA'
    EAL:  Probing VFIO support...

This still seems wrong, and I've verified that specifying the BlueField
target ID
string in the make is causing "CONFIG_RTE_LIBRTE_MLX5_PMD=y" to appear in
the .config.

Regards,
--Jim Vaigl
614 886 5999



^ permalink raw reply	[flat|nested] 12+ messages in thread
* [dpdk-users] DPDK on Mellanox BlueField Ref Platform
@ 2019-09-20 19:34 Jim Vaigl
  0 siblings, 0 replies; 12+ messages in thread
From: Jim Vaigl @ 2019-09-20 19:34 UTC (permalink / raw)
  To: users

I'm trying to get DPDK to run on a Mellanox BlueField Reference Platform.
For what it's worth, I'm using CentOS 7.4.1708, Kernel 4.14.139 built from
source, MLNX_OFED 4.6-3.5.8, and DPDK 19.08.  I can get stuff to build and
run, but I'm failing to receive packets.  Either I get none, or I get core
dumps.  I've become convinced it's at least partly because the wrong driver
is in use in the configuration I've created.

 

In https://doc.dpdk.org/guides/nics/mlx5.html, it says this:

 

                User space I/O kernel modules (uio and igb_uio) are not used
and do not have to be loaded.

 

And the example output on that page shows:

 

EAL: PCI device 0000:05:00.0 on NUMA socket 0

EAL:   probe driver: 15b3:1013 librte_pmd_mlx5

PMD: librte_pmd_mlx5: PCI information matches, using device "mlx5_0" (VF:
false)

PMD: librte_pmd_mlx5: 1 port(s) detected

PMD: librte_pmd_mlx5: port 1 MAC address is e4:1d:2d:e7:0c:fe

 

...so, it's working and not using VFIO or igb_uio.  But in DPDK's
usertools/dpdk-setup.sh, I see this:

 

#

# Calls dpdk-devbind.py --status to show the devices and what they

# are all bound to, in terms of drivers.

#

show_devices()

{

       if [ -d /sys/module/vfio_pci -o -d /sys/module/igb_uio ]; then

              ${RTE_SDK}/usertools/dpdk-devbind.py --status

       else

              echo "# Please load the 'igb_uio' or 'vfio-pci' kernel module
before "

              echo "# querying or adjusting device bindings"

       fi

}

 

So the setup script bails unless VFIO or igb_uio is loaded, but this doesn't
match the output from the testpmd output example above, which shows
something else active.   I've got a request in to Mellanox, but it's been
weeks and the only feedback so far is that 'the DPDK developer brought up
DPDK on Bluefield and confirmed operation'.

 

If anyone is aware of a combination of version of CentOS, kernel, OFED, and
DPDK that works, and a self-consistent and compatible combination of
build/install options, I'd be grateful.  I've gone as far as digging through
the kernel .config and turning off VFIO and any built-in looking support for
mlx5 or dpdk so that I can be sure the support is coming from the dpdk
modules, but this feels like guessing.

 

Thanks for any suggestions,

--Jim


^ permalink raw reply	[flat|nested] 12+ messages in thread
end of thread, other threads:[~2019-10-07 21:11 UTC | newest]

Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-09-24 16:31 [dpdk-users] DPDK on Mellanox BlueField Ref Platform Jim Vaigl
2019-09-24 17:18 ` Stephen Hemminger
2019-09-24 19:10   ` Jim Vaigl
2019-09-26 10:59     ` Asaf Penso
2019-09-26 19:46       ` Jim Vaigl
2019-10-04 17:35       ` Jim Vaigl
2019-10-04 18:28         ` Kiran Vedere
2019-10-07 16:52           ` Jim Vaigl
2019-10-07 17:00             ` Kiran Vedere
2019-10-07 17:02               ` Kiran Vedere
2019-10-07 18:10               ` Jim Vaigl
  -- strict thread matches above, loose matches on Subject: below --
2019-09-20 19:34 Jim Vaigl

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).