DPDK usage discussions
 help / color / mirror / Atom feed
* [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
@ 2020-12-09 16:03 Alessandro Pagani
  2020-12-11 15:48 ` Thomas Monjalon
  2020-12-13 10:29 ` Asaf Penso
  0 siblings, 2 replies; 7+ messages in thread
From: Alessandro Pagani @ 2020-12-09 16:03 UTC (permalink / raw)
  To: users

Hi all,

I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5 driver).

I am specifying the tx_pp parameter to provide the packet send scheduling
on mbuf timestamps, but the testpmd fails with the following error:

# ./dpdk-testpmd -l 8-15 -n 4 -a 3b:00.0,tx_pp=500 -- --flow-isolate-all -i
EAL: Detected 36 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: VFIO support initialized
EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0 (socket 0)
mlx5_pci: No available register for Sampler.
mlx5_pci: WQE index ignore feature is required for packet pacing
mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after encountering an
error: No such device
common_mlx5: Failed to load driver = mlx5_pci.

EAL: Requested device 0000:3b:00.0 cannot be used
EAL: Bus (pci) probe failed.
EAL: No legacy callbacks, legacy socket not created
testpmd: No probed ethernet devices



The error messages suggest that "WQE index ignore feature is required for
packet pacing".

Anyone knows the reason of this error and how to solve it?
I know that WQE is related to RDMA (InfiniBand/RoCE) but I do not
understand how it is related to DPDK.

Thank you.

Best regards
Alessandro

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-09 16:03 [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing' Alessandro Pagani
@ 2020-12-11 15:48 ` Thomas Monjalon
  2020-12-11 16:19   ` Slava Ovsiienko
  2020-12-13 10:29 ` Asaf Penso
  1 sibling, 1 reply; 7+ messages in thread
From: Thomas Monjalon @ 2020-12-11 15:48 UTC (permalink / raw)
  To: Alessandro Pagani; +Cc: users, viacheslavo, asafp

09/12/2020 17:03, Alessandro Pagani:
> Hi all,
> 
> I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5 driver).
> 
> I am specifying the tx_pp parameter to provide the packet send scheduling
> on mbuf timestamps, but the testpmd fails with the following error:
[...]
> EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0 (socket 0)
> mlx5_pci: No available register for Sampler.
> mlx5_pci: WQE index ignore feature is required for packet pacing
> mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after encountering an
> error: No such device
> common_mlx5: Failed to load driver = mlx5_pci.
> 
> EAL: Requested device 0000:3b:00.0 cannot be used
[...]
> The error messages suggest that "WQE index ignore feature is required for
> packet pacing".
> 
> Anyone knows the reason of this error and how to solve it?

I think it means your device does not support this feature.
But I realize it is not documented here:
http://doc.dpdk.org/guides/nics/mlx5.html#supported-hardware-offloads




^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-11 15:48 ` Thomas Monjalon
@ 2020-12-11 16:19   ` Slava Ovsiienko
  2020-12-11 16:31     ` Thomas Monjalon
  0 siblings, 1 reply; 7+ messages in thread
From: Slava Ovsiienko @ 2020-12-11 16:19 UTC (permalink / raw)
  To: NBU-Contact-Thomas Monjalon, Alessandro Pagani; +Cc: users, Asaf Penso

> -----Original Message-----
> From: Thomas Monjalon <thomas@monjalon.net>
> Sent: Friday, December 11, 2020 17:48
> To: Alessandro Pagani <alessandropagani.90@gmail.com>
> Cc: users@dpdk.org; Slava Ovsiienko <viacheslavo@nvidia.com>; Asaf Penso
> <asafp@nvidia.com>
> Subject: Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore
> feature is required for packet pacing'
> 
> 09/12/2020 17:03, Alessandro Pagani:
> > Hi all,
> >
> > I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5 driver).
> >
> > I am specifying the tx_pp parameter to provide the packet send
> > scheduling on mbuf timestamps, but the testpmd fails with the following
> error:
> [...]
> > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0

This is ConnectX-4LX (DevID is 1015), it does not support scheduling.
Tx scheduling is supported since ConnectX-6DX. 

> > (socket 0)
> > mlx5_pci: No available register for Sampler.
> > mlx5_pci: WQE index ignore feature is required for packet pacing
> > mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after encountering
> > an
> > error: No such device
> > common_mlx5: Failed to load driver = mlx5_pci.
> >
> > EAL: Requested device 0000:3b:00.0 cannot be used
> [...]
> > The error messages suggest that "WQE index ignore feature is required
> > for packet pacing".
> >
> > Anyone knows the reason of this error and how to solve it?
> 
> I think it means your device does not support this feature.
> But I realize it is not documented here:

Yes, indeed. I'll provide the patch, thank you for noticing that.

With best regards, Slava


> https://nam11.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdoc.dp
> dk.org%2Fguides%2Fnics%2Fmlx5.html%23supported-hardware-
> offloads&amp;data=04%7C01%7Cviacheslavo%40nvidia.com%7C68077a428d9
> 140ecac4408d89dec2c93%7C43083d15727340c1b7db39efd9ccc17a%7C0%7C0
> %7C637432984987268866%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjA
> wMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C1000&amp;sda
> ta=2n5MI7WLln9xRPcpQzSy2Q2g3xPlYnYrK6YIeRKxS9Q%3D&amp;reserved=0
> 


> 


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-11 16:19   ` Slava Ovsiienko
@ 2020-12-11 16:31     ` Thomas Monjalon
  2020-12-11 16:44       ` Slava Ovsiienko
  0 siblings, 1 reply; 7+ messages in thread
From: Thomas Monjalon @ 2020-12-11 16:31 UTC (permalink / raw)
  To: Slava Ovsiienko; +Cc: Alessandro Pagani, users, Asaf Penso

11/12/2020 17:19, Slava Ovsiienko:
> From: Thomas Monjalon <thomas@monjalon.net>
> > 09/12/2020 17:03, Alessandro Pagani:
> > > Hi all,
> > >
> > > I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5 driver).
> > >
> > > I am specifying the tx_pp parameter to provide the packet send
> > > scheduling on mbuf timestamps, but the testpmd fails with the following
> > error:
> > [...]
> > > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0
> 
> This is ConnectX-4LX (DevID is 1015), it does not support scheduling.
> Tx scheduling is supported since ConnectX-6DX. 
> 
> > > (socket 0)
> > > mlx5_pci: No available register for Sampler.
> > > mlx5_pci: WQE index ignore feature is required for packet pacing
> > > mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after encountering
> > > an
> > > error: No such device
> > > common_mlx5: Failed to load driver = mlx5_pci.
> > >
> > > EAL: Requested device 0000:3b:00.0 cannot be used
> > [...]
> > > The error messages suggest that "WQE index ignore feature is required
> > > for packet pacing".
> > >
> > > Anyone knows the reason of this error and how to solve it?
> > 
> > I think it means your device does not support this feature.
> > But I realize it is not documented here:
> 
> Yes, indeed. I'll provide the patch, thank you for noticing that.

I think we should also improve the error message to
something like "not supported on this device".



^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-11 16:31     ` Thomas Monjalon
@ 2020-12-11 16:44       ` Slava Ovsiienko
  2020-12-16  6:40         ` Alessandro Pagani
  0 siblings, 1 reply; 7+ messages in thread
From: Slava Ovsiienko @ 2020-12-11 16:44 UTC (permalink / raw)
  To: NBU-Contact-Thomas Monjalon; +Cc: Alessandro Pagani, users, Asaf Penso

> -----Original Message-----
> From: Thomas Monjalon <thomas@monjalon.net>
> Sent: Friday, December 11, 2020 18:31
> To: Slava Ovsiienko <viacheslavo@nvidia.com>
> Cc: Alessandro Pagani <alessandropagani.90@gmail.com>; users@dpdk.org;
> Asaf Penso <asafp@nvidia.com>
> Subject: Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore
> feature is required for packet pacing'
> 
> 11/12/2020 17:19, Slava Ovsiienko:
> > From: Thomas Monjalon <thomas@monjalon.net>
> > > 09/12/2020 17:03, Alessandro Pagani:
> > > > Hi all,
> > > >
> > > > I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5
> driver).
> > > >
> > > > I am specifying the tx_pp parameter to provide the packet send
> > > > scheduling on mbuf timestamps, but the testpmd fails with the
> > > > following
> > > error:
> > > [...]
> > > > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0
> >
> > This is ConnectX-4LX (DevID is 1015), it does not support scheduling.
> > Tx scheduling is supported since ConnectX-6DX.
> >
> > > > (socket 0)
> > > > mlx5_pci: No available register for Sampler.
> > > > mlx5_pci: WQE index ignore feature is required for packet pacing
> > > > mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after
> > > > encountering an
> > > > error: No such device
> > > > common_mlx5: Failed to load driver = mlx5_pci.
> > > >
> > > > EAL: Requested device 0000:3b:00.0 cannot be used
> > > [...]
> > > > The error messages suggest that "WQE index ignore feature is
> > > > required for packet pacing".
> > > >
> > > > Anyone knows the reason of this error and how to solve it?
> > >
> > > I think it means your device does not support this feature.
> > > But I realize it is not documented here:
> >
> > Yes, indeed. I'll provide the patch, thank you for noticing that.
> 
> I think we should also improve the error message to something like "not
> supported on this device".
> 
In my opinion, we should not depend on model index, but rather on
what capabilities firmware reports, this approach provides much more flexibility
and accuracy. We do not provide model index blind check for any other feature(s).

With best regards,
Slava




^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-09 16:03 [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing' Alessandro Pagani
  2020-12-11 15:48 ` Thomas Monjalon
@ 2020-12-13 10:29 ` Asaf Penso
  1 sibling, 0 replies; 7+ messages in thread
From: Asaf Penso @ 2020-12-13 10:29 UTC (permalink / raw)
  To: Alessandro Pagani, users

Hello Alessandro,

As you can see from the documentation - http://doc.dpdk.org/guides/nics/mlx5.html#supported-hardware-offloads
The feature is supported starting ConnectX-6 Dx, and it's not supported for ConnectX-4Lx as you tried.

Regards,
Asaf Penso

>-----Original Message-----
>From: users <users-bounces@dpdk.org> On Behalf Of Alessandro Pagani
>Sent: Wednesday, December 9, 2020 6:03 PM
>To: users@dpdk.org
>Subject: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore
>feature is required for packet pacing'
>
>Hi all,
>
>I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5 driver).
>
>I am specifying the tx_pp parameter to provide the packet send scheduling on
>mbuf timestamps, but the testpmd fails with the following error:
>
># ./dpdk-testpmd -l 8-15 -n 4 -a 3b:00.0,tx_pp=500 -- --flow-isolate-all -i
>EAL: Detected 36 lcore(s)
>EAL: Detected 2 NUMA nodes
>EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
>EAL: Selected IOVA mode 'PA'
>EAL: No available hugepages reported in hugepages-1048576kB
>EAL: Probing VFIO support...
>EAL: VFIO support initialized
>EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0 (socket 0)
>mlx5_pci: No available register for Sampler.
>mlx5_pci: WQE index ignore feature is required for packet pacing
>mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after encountering an
>error: No such device
>common_mlx5: Failed to load driver = mlx5_pci.
>
>EAL: Requested device 0000:3b:00.0 cannot be used
>EAL: Bus (pci) probe failed.
>EAL: No legacy callbacks, legacy socket not created
>testpmd: No probed ethernet devices
>
>
>
>The error messages suggest that "WQE index ignore feature is required for
>packet pacing".
>
>Anyone knows the reason of this error and how to solve it?
>I know that WQE is related to RDMA (InfiniBand/RoCE) but I do not
>understand how it is related to DPDK.
>
>Thank you.
>
>Best regards
>Alessandro

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing'
  2020-12-11 16:44       ` Slava Ovsiienko
@ 2020-12-16  6:40         ` Alessandro Pagani
  0 siblings, 0 replies; 7+ messages in thread
From: Alessandro Pagani @ 2020-12-16  6:40 UTC (permalink / raw)
  To: Slava Ovsiienko; +Cc: NBU-Contact-Thomas Monjalon, users, Asaf Penso

Thanks for your reply.
I did not realize from the DPDK documentation that the tx scheduling
feature is not supported by ConnectX4 Lx.

Moreover, an improved error message would be really helpful.

Thanks for the info.

Best regards
Alessandro


On Fri, Dec 11, 2020, 5:44 PM Slava Ovsiienko <viacheslavo@nvidia.com>
wrote:

> > -----Original Message-----
> > From: Thomas Monjalon <thomas@monjalon.net>
> > Sent: Friday, December 11, 2020 18:31
> > To: Slava Ovsiienko <viacheslavo@nvidia.com>
> > Cc: Alessandro Pagani <alessandropagani.90@gmail.com>; users@dpdk.org;
> > Asaf Penso <asafp@nvidia.com>
> > Subject: Re: [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore
> > feature is required for packet pacing'
> >
> > 11/12/2020 17:19, Slava Ovsiienko:
> > > From: Thomas Monjalon <thomas@monjalon.net>
> > > > 09/12/2020 17:03, Alessandro Pagani:
> > > > > Hi all,
> > > > >
> > > > > I am trying to run dpdk testpmd with Mellanox ConnectX4 Lx (mlx5
> > driver).
> > > > >
> > > > > I am specifying the tx_pp parameter to provide the packet send
> > > > > scheduling on mbuf timestamps, but the testpmd fails with the
> > > > > following
> > > > error:
> > > > [...]
> > > > > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:3b:00.0
> > >
> > > This is ConnectX-4LX (DevID is 1015), it does not support scheduling.
> > > Tx scheduling is supported since ConnectX-6DX.
> > >
> > > > > (socket 0)
> > > > > mlx5_pci: No available register for Sampler.
> > > > > mlx5_pci: WQE index ignore feature is required for packet pacing
> > > > > mlx5_pci: probe of PCI device 0000:3b:00.0 aborted after
> > > > > encountering an
> > > > > error: No such device
> > > > > common_mlx5: Failed to load driver = mlx5_pci.
> > > > >
> > > > > EAL: Requested device 0000:3b:00.0 cannot be used
> > > > [...]
> > > > > The error messages suggest that "WQE index ignore feature is
> > > > > required for packet pacing".
> > > > >
> > > > > Anyone knows the reason of this error and how to solve it?
> > > >
> > > > I think it means your device does not support this feature.
> > > > But I realize it is not documented here:
> > >
> > > Yes, indeed. I'll provide the patch, thank you for noticing that.
> >
> > I think we should also improve the error message to something like "not
> > supported on this device".
> >
> In my opinion, we should not depend on model index, but rather on
> what capabilities firmware reports, this approach provides much more
> flexibility
> and accuracy. We do not provide model index blind check for any other
> feature(s).
>
> With best regards,
> Slava
>
>
>
>

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2020-12-16 21:48 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-12-09 16:03 [dpdk-users] DPDK 20.11 MLX5 testpmd tx_pp 'WQE index ignore feature is required for packet pacing' Alessandro Pagani
2020-12-11 15:48 ` Thomas Monjalon
2020-12-11 16:19   ` Slava Ovsiienko
2020-12-11 16:31     ` Thomas Monjalon
2020-12-11 16:44       ` Slava Ovsiienko
2020-12-16  6:40         ` Alessandro Pagani
2020-12-13 10:29 ` Asaf Penso

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).