[dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[Sebastian Bernauer]

Hello DPDK team,

I have 2 Mellanox ConnectX-4 MCX415A-CCAT cards connected with DAC (firmware 12.26.4012). Im using debian stretch and DPDK 19.11.
If i try to start DPDK-applications i get the following error:

sbernauer@he37:~$ lspci | grep Mellanox
04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family [ConnectX-4]
42:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]

sbernauer@he37:~$ sudo dpdk-19.11/examples/l2fwd/build/app/l2fwd -w 04:00.0 -- -p 0x1
EAL: Detected 40 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: PCI device 0000:04:00.0 on NUMA socket 0
EAL:   probe driver: 15b3:1013 net_mlx5
MAC updating enabled
Notice: odd number of ports in portmask.
Lcore 0: RX port 0
Initializing port 0... EAL: Error - exiting with code: 1
  Cause: rte_eth_dev_start:err=-12, port=0

I can't find a description of the error code -12, can you please give my a hint whats my problem?

Thanks a lot!
Sebastian

[dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[Sebastian Bernauer]

Sorry for the duplicate post.

I found the line that returns the error.

In drivers/net/mlx5/mlx5_flow_dv.c, starting at line 6358:
-------------------------------
cache_matcher->matcher_object =
         mlx5_glue->dv_create_flow_matcher(sh->ctx, &dv_attr, tbl->obj);
     if (!cache_matcher->matcher_object) {
         rte_free(cache_matcher);
#ifdef HAVE_MLX5DV_DR
         flow_dv_tbl_resource_release(dev, tbl);
#endif
         return rte_flow_error_set(error, ENOMEM,
                       RTE_FLOW_ERROR_TYPE_UNSPECIFIED,
                       NULL, "cannot create matcher");
     }
-------------------------------
mlx5_glue->dv_create_flow_matcher(...) returns (void *) 0x0.
Because of this, the if-statement is fulfilled and returns the error.

Do you have an idea why the matcher can't be created?

Thanks!
Sebastian

On 03.01.20 11:40, Sebastian Bernauer wrote:
> Hello DPDK team,
>
> I have 2 Mellanox ConnectX-4 MCX415A-CCAT cards connected with DAC (firmware 12.26.4012). Im using debian stretch and DPDK 19.11.
> If i try to start DPDK-applications i get the following error:
>
> sbernauer@he37:~$ lspci | grep Mellanox
> 04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family [ConnectX-4]
> 42:00.0 Network controller: Mellanox Technologies MT27500 Family [ConnectX-3]
>
> sbernauer@he37:~$ sudo dpdk-19.11/examples/l2fwd/build/app/l2fwd -w 04:00.0 -- -p 0x1
> EAL: Detected 40 lcore(s)
> EAL: Detected 2 NUMA nodes
> EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
> EAL: Selected IOVA mode 'PA'
> EAL: No available hugepages reported in hugepages-1048576kB
> EAL: Probing VFIO support...
> EAL: PCI device 0000:04:00.0 on NUMA socket 0
> EAL:   probe driver: 15b3:1013 net_mlx5
> MAC updating enabled
> Notice: odd number of ports in portmask.
> Lcore 0: RX port 0
> Initializing port 0... EAL: Error - exiting with code: 1
>    Cause: rte_eth_dev_start:err=-12, port=0
>
> I can't find a description of the error code -12, can you please give my a hint whats my problem?
>
> Thanks a lot!
> Sebastian

Re: [dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[Ori Kam]

Hi Sebastian,

My Name is Ori and I'm part of Mellanox DPDK team.

I'm sorry to hear you encountered some issues. 

I will try to help you.
2 questions:
1. Can you tell me if the HAVE_MLX5DV_DR is defined? 
2. can you please try adding device parameter ,dv_flow_en=0 and let me know if it works?

Thanks,
Ori Kam


> -----Original Message-----
> From: users <users-bounces@dpdk.org> On Behalf Of Sebastian Bernauer
> Sent: Friday, January 3, 2020 5:08 PM
> To: users@dpdk.org
> Subject: [dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4
> card
> 
> Sorry for the duplicate post.
> 
> I found the line that returns the error.
> 
> In drivers/net/mlx5/mlx5_flow_dv.c, starting at line 6358:
> -------------------------------
> cache_matcher->matcher_object =
>          mlx5_glue->dv_create_flow_matcher(sh->ctx, &dv_attr, tbl->obj);
>      if (!cache_matcher->matcher_object) {
>          rte_free(cache_matcher);
> #ifdef HAVE_MLX5DV_DR
>          flow_dv_tbl_resource_release(dev, tbl);
> #endif
>          return rte_flow_error_set(error, ENOMEM,
>                        RTE_FLOW_ERROR_TYPE_UNSPECIFIED,
>                        NULL, "cannot create matcher");
>      }
> -------------------------------
> mlx5_glue->dv_create_flow_matcher(...) returns (void *) 0x0.
> Because of this, the if-statement is fulfilled and returns the error.
> 
> Do you have an idea why the matcher can't be created?
> 
> Thanks!
> Sebastian
> 
> On 03.01.20 11:40, Sebastian Bernauer wrote:
> > Hello DPDK team,
> >
> > I have 2 Mellanox ConnectX-4 MCX415A-CCAT cards connected with DAC
> (firmware 12.26.4012). Im using debian stretch and DPDK 19.11.
> > If i try to start DPDK-applications i get the following error:
> >
> > sbernauer@he37:~$ lspci | grep Mellanox
> > 04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family
> [ConnectX-4]
> > 42:00.0 Network controller: Mellanox Technologies MT27500 Family
> [ConnectX-3]
> >
> > sbernauer@he37:~$ sudo dpdk-19.11/examples/l2fwd/build/app/l2fwd -w
> 04:00.0 -- -p 0x1
> > EAL: Detected 40 lcore(s)
> > EAL: Detected 2 NUMA nodes
> > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
> > EAL: Selected IOVA mode 'PA'
> > EAL: No available hugepages reported in hugepages-1048576kB
> > EAL: Probing VFIO support...
> > EAL: PCI device 0000:04:00.0 on NUMA socket 0
> > EAL:   probe driver: 15b3:1013 net_mlx5
> > MAC updating enabled
> > Notice: odd number of ports in portmask.
> > Lcore 0: RX port 0
> > Initializing port 0... EAL: Error - exiting with code: 1
> >    Cause: rte_eth_dev_start:err=-12, port=0
> >
> > I can't find a description of the error code -12, can you please give my a hint
> whats my problem?
> >
> > Thanks a lot!
> > Sebastian

[dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[Sebastian Bernauer]

Hi Ori,


thanks for your helpful response!

The command "sudo ./l2fwd -w 04:00.0,dv_flow_en=0 -- -p 0x1" worked perfectly for me. Thanks!

Strangely on another server, exact the same server model and card, the card works with the flow option enabled (,dv_flow_en=1).

ibv_devinfo shows exact the same fw_version vendor_id, board_id etc.


Thanks,

Sebastian

On 05.01.20 08:09, Ori Kam wrote:

Hi Sebastian,

My Name is Ori and I'm part of Mellanox DPDK team.

I'm sorry to hear you encountered some issues.

I will try to help you.
2 questions:
1. Can you tell me if the HAVE_MLX5DV_DR is defined?
2. can you please try adding device parameter ,dv_flow_en=0 and let me know if it works?

Thanks,
Ori Kam




-----Original Message-----
From: users <users-bounces@dpdk.org><mailto:users-bounces@dpdk.org> On Behalf Of Sebastian Bernauer
Sent: Friday, January 3, 2020 5:08 PM
To: users@dpdk.org<mailto:users@dpdk.org>
Subject: [dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4
card

Sorry for the duplicate post.

I found the line that returns the error.

In drivers/net/mlx5/mlx5_flow_dv.c, starting at line 6358:
-------------------------------
cache_matcher->matcher_object =
         mlx5_glue->dv_create_flow_matcher(sh->ctx, &dv_attr, tbl->obj);
     if (!cache_matcher->matcher_object) {
         rte_free(cache_matcher);
#ifdef HAVE_MLX5DV_DR
         flow_dv_tbl_resource_release(dev, tbl);
#endif
         return rte_flow_error_set(error, ENOMEM,
                       RTE_FLOW_ERROR_TYPE_UNSPECIFIED,
                       NULL, "cannot create matcher");
     }
-------------------------------
mlx5_glue->dv_create_flow_matcher(...) returns (void *) 0x0.
Because of this, the if-statement is fulfilled and returns the error.

Do you have an idea why the matcher can't be created?

Thanks!
Sebastian

On 03.01.20 11:40, Sebastian Bernauer wrote:


Hello DPDK team,

I have 2 Mellanox ConnectX-4 MCX415A-CCAT cards connected with DAC


(firmware 12.26.4012). Im using debian stretch and DPDK 19.11.


If i try to start DPDK-applications i get the following error:

sbernauer@he37:~$ lspci | grep Mellanox
04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family


[ConnectX-4]


42:00.0 Network controller: Mellanox Technologies MT27500 Family


[ConnectX-3]


sbernauer@he37:~$ sudo dpdk-19.11/examples/l2fwd/build/app/l2fwd -w


04:00.0 -- -p 0x1


EAL: Detected 40 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: PCI device 0000:04:00.0 on NUMA socket 0
EAL:   probe driver: 15b3:1013 net_mlx5
MAC updating enabled
Notice: odd number of ports in portmask.
Lcore 0: RX port 0
Initializing port 0... EAL: Error - exiting with code: 1
   Cause: rte_eth_dev_start:err=-12, port=0

I can't find a description of the error code -12, can you please give my a hint


whats my problem?


Thanks a lot!
Sebastian

[dpdk-users] Can't start DPDK applications on Mellanox ConnectX-4 card

[Sebastian Bernauer]

Hello DPDK team,

I have 2 Mellanox ConnectX-4 MCX415A-CCAT cards connected with DAC 
(firmware 12.26.4012). Im using debian stretch and DPDK 19.11.
If i try to start DPDK-applications i get the following error:

sbernauer@he37:~$ lspci | grep Mellanox
04:00.0 Ethernet controller: Mellanox Technologies MT27700 Family 
[ConnectX-4]
42:00.0 Network controller: Mellanox Technologies MT27500 Family 
[ConnectX-3]
sbernauer@he37:~$ sudo dpdk-19.11/examples/l2fwd/build/app/l2fwd -w 
04:00.0 -- -p 0x1
EAL: Detected 40 lcore(s)
EAL: Detected 2 NUMA nodes
EAL: Multi-process socket /var/run/dpdk/rte/mp_socket
EAL: Selected IOVA mode 'PA'
EAL: No available hugepages reported in hugepages-1048576kB
EAL: Probing VFIO support...
EAL: PCI device 0000:04:00.0 on NUMA socket 0
EAL:   probe driver: 15b3:1013 net_mlx5
MAC updating enabled
Notice: odd number of ports in portmask.
Lcore 0: RX port 0
Initializing port 0... EAL: Error - exiting with code: 1
   Cause: rte_eth_dev_start:err=-12, port=0

I can't find a description of the error code -12, can you please give my 
a hint whats my problem?

Thanks a lot!
Sebastian