From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 2E1A3A0096 for ; Fri, 12 Apr 2019 10:34:09 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id F2D9F548B; Fri, 12 Apr 2019 10:34:08 +0200 (CEST) Received: from mail-qt1-f177.google.com (mail-qt1-f177.google.com [209.85.160.177]) by dpdk.org (Postfix) with ESMTP id D878D5424 for ; Fri, 12 Apr 2019 10:34:06 +0200 (CEST) Received: by mail-qt1-f177.google.com with SMTP id h39so10321386qte.2 for ; Fri, 12 Apr 2019 01:34:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to:cc; bh=RD56ffrNkWXv2KL/GxbWn4dWKNfxTNBg0nacm6SQFjY=; b=mQCA5NL1bC32oSYU3fi622XwQ1AWAtx7jgf/qA3ks7OicEhkh9X7ua0dz29y9J+nOo +Nepy3Z+c0nljoGyZP+2u89FpQC7APGiwTCcdz6keEI0IL6ZwjQ/I1HdWCX3WgA8CXti mtEWCh1bFpqQMQBYJI/i7ADVbMUiVknM7ghpC8BfQygXttQSwwgww2RVz4ZSBGtFGueJ TVjVQTi+TpJ7XUPTQwk9FUOv+gZS37tNOxlhq8jWmSfekpkrG9mYnJrhJuTHr95Yx/sV fSsfNMoKtqpgHVCdR94ozJf5YRR96BPuCPfS1XBLGur3TeD3/dqn8TmjJTajCPZqdIAk otBw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc; bh=RD56ffrNkWXv2KL/GxbWn4dWKNfxTNBg0nacm6SQFjY=; b=o6eg0AB+QYNOx5qKjEVFnXbsom1kv+Rf3JAkKXZSrpOTffybvdyhuVDlMXCIQ24gYC vzifxWOPOxZYSqis5LRy6cOrZ5jzWkiWed2mBV8ShqWM8ZFTGsKDiygQaf0QQG5Yq9da dnb4xcYWcNXK80AOJ58kf4ZSjovRw0NgYRvxwDQPud6jq1TVAQonsexNpyL7F127k3fI 7xnW5fvyeILBFHi6F9vbb9ZeZrZUXhWYg7GIMMQYeOaYeDx6ImOHPOvhg17o5heuwf2p D16KUx0QyG2szvx8ha9WHH7QKDhJ3k2qm0i808jkJX2ecUdPVVpurm/BSh9qepGYPNmR yU7A== X-Gm-Message-State: APjAAAVkN137vSLKhl/OWqq/QxFK3RG55NAJeaPEp2PPOg1nmKB24pZw BXhs1wbHh98rVJmmh7Oe7td20crXWcyVHgi/YCyb3ZAA X-Google-Smtp-Source: APXvYqz55LvV6KvldBu1wGakSrcblhi41kc5gWZiZkujOdGLJPA/aCJuxW+sBxRJuFZjau8nGGDAYQtEnaSKStNyR2o= X-Received: by 2002:ac8:404b:: with SMTP id j11mr45362758qtl.155.1555058045968; Fri, 12 Apr 2019 01:34:05 -0700 (PDT) MIME-Version: 1.0 From: Chandramouli VENKATARAMAN Date: Fri, 12 Apr 2019 14:03:54 +0530 Message-ID: To: users@dpdk.org Cc: mr.v.chandramouli@gmail.com Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] DPDK MLX5: Bonding Intf doesn't come up with MLX5 NIC multiple restarts X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi, I am trying to bring up DPDK (18.05) Bonding interface with MLX5 NICs and see the following problem. In order to narrow down the problem, I am using testpmd with some logs to dump some debugging information with tag BOND_ISSUE_LOG. a) After a reboot of the server, when I run testpmd with bonding configuration, I see the bonding interface come up fine. b) When I restart testpmd again with the same bonding configuration, I see the MLX5 PMD throwing 'Address already in use' for the MAC address that is programmed on the slave port part of the bonding interface. Due to this, the bonding interface doesn't come up. Captured the DPDK testpmd logs below. Can some one help me to check If i am missing some thing here or if this is a known issue (and fix if it exists)? I see this issue with DPDK-18.08 too. Env Info ======= mouli@server1:~$ uname -r 4.4.0-142-generic mouli@server1:~$ lspci | grep Mell 1a:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx] 1a:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx] 1a:00.2 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:00.3 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:00.4 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:00.5 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:02.2 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:02.3 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:02.4 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] 1a:02.5 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx Virtual Function] mouli@server1:~$ mouli@server1:~$ ofed_info | grep MLNX_OFED MLNX_OFED_LINUX-4.3-1.0.1.0 (OFED-4.3-1.0.1): mouli@server1:~$ mouli@server1:~$ ethtool -i enp26s0f0 driver: mlx5_core version: 4.3-1.0.1 firmware-version: 14.23.1020 (SM_2111000001034) expansion-rom-version: bus-info: 0000:1a:00.0 supports-statistics: yes supports-test: yes supports-eeprom-access: no supports-register-dump: no supports-priv-flags: yes mouli@server1:~$ mouli@server1:~$ lsmod | grep ib ib_ucm 20480 0 ib_ipoib 159744 0 ib_cm 53248 3 rdma_cm,ib_ucm,ib_ipoib ib_uverbs 102400 2 ib_ucm,rdma_ucm ib_umad 24576 0 mlx5_ib 245760 0 mlx4_ib 208896 0 ib_core 262144 10 rdma_cm,ib_cm,iw_cm,mlx4_ib,mlx5_ib,ib_ucm,ib_umad,ib_uverbs,rdma_ucm,ib_ipoib mlx4_core 344064 2 mlx4_en,mlx4_ib libcrc32c 16384 1 raid456 mlx5_core 749568 2 mlx5_ib,mlx5_fpga_tools mlx_compat 24576 15 rdma_cm,ib_cm,iw_cm,mlx4_en,mlx4_ib,mlx5_ib,mlx5_fpga_tools,ib_ucm,ib_core,ib_umad,ib_uverbs,mlx4_core,mlx5_core,rdma_ucm,ib_ipoib libahci 32768 1 ahci mouli@server1:~$ Logs Information ============= mouli@server1:~/mouli/dpdk-stable-18.05.1/myinstall/bin$ sudo ~/dpdk-testpmd-bond EAL: Detected 40 lcore(s) EAL: Detected 2 NUMA nodes EAL: Multi-process socket /var/run/dpdk/vpp/mp_socket EAL: No free hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: VFIO support initialized EAL: PCI device 0000:1a:00.2 on NUMA socket 0 EAL: probe driver: 15b3:1016 net_mlx5 net_mlx5: mlx5.c:871: mlx5_pci_probe(): MPLS over GRE/UDP tunnel offloading disabled due to old OFED/rdma-core version or firmware configuratio n BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 0, name 0000:1a:00.2, mac 01:00:5E:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 0, name 0000:1a:00.2, mac 33:33:00:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 0, name 0000:1a:00.2, mac 33:33:FF:6A:37:49 EAL: PCI device 0000:1a:00.3 on NUMA socket 0 EAL: probe driver: 15b3:1016 net_mlx5 net_mlx5: mlx5.c:871: mlx5_pci_probe(): MPLS over GRE/UDP tunnel offloading disabled due to old OFED/rdma-core version or firmware configuratio n BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 1, name 0000:1a:00.3, mac 01:00:5E:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 1, name 0000:1a:00.3, mac 33:33:00:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 1, name 0000:1a:00.3, mac 33:33:FF:58:15:1B EAL: PCI device 0000:1a:02.2 on NUMA socket 0 EAL: probe driver: 15b3:1016 net_mlx5 net_mlx5: mlx5.c:871: mlx5_pci_probe(): MPLS over GRE/UDP tunnel offloading disabled due to old OFED/rdma-core version or firmware configuratio n BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 2, name 0000:1a:02.2, mac 01:00:5E:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 2, name 0000:1a:02.2, mac 33:33:00:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 2, name 0000:1a:02.2, mac 33:33:FF:0A:51:3B EAL: PCI device 0000:1a:02.3 on NUMA socket 0 EAL: probe driver: 15b3:1016 net_mlx5 net_mlx5: mlx5.c:871: mlx5_pci_probe(): MPLS over GRE/UDP tunnel offloading disabled due to old OFED/rdma-core version or firmware configuratio n BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 3, name 0000:1a:02.3, mac 01:00:5E:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 3, name 0000:1a:02.3, mac 33:33:00:00:00:01 BOND_ISSUE_LOG-> mlx5_nl_mac_addr_sync: port 3, name 0000:1a:02.3, mac 33:33:FF:F6:3F:69 Interactive-mode selected testpmd: create a new mbuf pool : n=155456, size=2176, socket=0 testpmd: preferred mempool ops selected: ring_mp_mc testpmd: create a new mbuf pool : n=155456, size=2176, socket=1 testpmd: preferred mempool ops selected: ring_mp_mc Configuring Port 0 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 Port 0: 62:2E:6E:F6:7A:A2 Configuring Port 1 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B Port 1: 16:93:1B:1F:BB:2B Configuring Port 2 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 2, name 0000:1a:02.2, mac DA:E0:44:54:FF:55 Port 2: DA:E0:44:54:FF:55 Configuring Port 3 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 3, name 0000:1a:02.3, mac A6:D5:49:CE:86:95 Port 3: A6:D5:49:CE:86:95 Configuring Port 4 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mac-addr-set: port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 2 MAC address, error Address already in use BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mac-addr-set: port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 2 MAC address, error Address already in use BOND_ISSUE_LOG-> mac-addr-set: port 2, name 0000:1a:02.2, mac DA:E0:44:54:FF:55 BOND_ISSUE_LOG-> mac-addr-set: port 0, name 0000:1a:00.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mac-addr-set: port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 2, name 0000:1a:02.2, mac 62:2E:6E:F6:7A:A2 mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 2 MAC address, error Address already in use Fail to start port 4 Configuring Port 5 (socket 0) BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mac-addr-set: port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 3 MAC address, error Address already in use BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mac-addr-set: port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 3 MAC address, error Address already in use BOND_ISSUE_LOG-> mac-addr-set: port 3, name 0000:1a:02.3, mac A6:D5:49:CE:86:95 BOND_ISSUE_LOG-> mac-addr-set: port 1, name 0000:1a:00.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mac-addr-set: port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B BOND_ISSUE_LOG-> mlx5_internal_mac_addr_add: EADDRINUSE error -- port 3, name 0000:1a:02.3, mac 16:93:1B:1F:BB:2B mac_address_slaves_update(1611) - BOND_ISSUE_LOG-> mac_address_slaves_update: Failed to update port Id 3 MAC address, error Address already in use Fail to start port 5 Please stop the ports first Done testpmd> testpmd> show port info 4 ********************* Infos for port 4 ********************* MAC address: 62:2E:6E:F6:7A:A2 Device name: eth_bond0 <<<<<<<<<<<< Driver name: net_bonding Connect to socket: 0 memory allocation on the socket: 0 Link status: down <<<<<<<<<<<< Link speed: 0 Mbps Link duplex: full-duplex MTU: 1500 Promiscuous mode: enabled Allmulticast mode: disabled Maximum number of MAC addresses: 1 Maximum number of MAC addresses of hash filtering: 0 VLAN offload: strip off filter off qinq(extend) off Redirection table size: 1 Supported flow types: ipv4 ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv6 ipv6-frag ipv6-tcp ipv6-udp ipv6-other user defined 15 user defined 16 user defined 17 Minimum size of RX buffer: 0 Maximum configurable length of RX packet: 65536 Current number of RX queues: 1 Max possible RX queues: 65535 Max possible number of RXDs per queue: 65535 Min possible number of RXDs per queue: 0 RXDs number alignment: 1 Current number of TX queues: 1 Max possible TX queues: 65535 Max possible number of TXDs per queue: 65535 Min possible number of TXDs per queue: 0 TXDs number alignment: 1 testpmd> testpmd> show port info 0 ********************* Infos for port 0 ********************* MAC address: 62:2E:6E:F6:7A:A2 Device name: 0000:1a:00.2 Driver name: net_mlx5 Connect to socket: 0 memory allocation on the socket: 0 Link status: up Link speed: 25000 Mbps Link duplex: full-duplex MTU: 1500 Promiscuous mode: enabled Allmulticast mode: disabled Maximum number of MAC addresses: 128 Maximum number of MAC addresses of hash filtering: 0 VLAN offload: strip off filter off qinq(extend) off Hash key size in bytes: 40 Redirection table size: 1 Supported flow types: ipv4 ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv6 ipv6-frag ipv6-tcp ipv6-udp ipv6-other user defined 15 user defined 16 user defined 17 Minimum size of RX buffer: 32 Maximum configurable length of RX packet: 65536 Current number of RX queues: 1 Max possible RX queues: 65535 Max possible number of RXDs per queue: 65535 Min possible number of RXDs per queue: 0 RXDs number alignment: 1 Current number of TX queues: 1 Max possible TX queues: 65535 Max possible number of TXDs per queue: 65535 Min possible number of TXDs per queue: 0 TXDs number alignment: 1 testpmd> testpmd> show port info 2 ********************* Infos for port 2 ********************* MAC address: DA:E0:44:54:FF:55 Device name: 0000:1a:02.2 Driver name: net_mlx5 Connect to socket: 0 memory allocation on the socket: 0 Link status: up Link speed: 25000 Mbps Link duplex: full-duplex MTU: 1500 Promiscuous mode: enabled Allmulticast mode: disabled Maximum number of MAC addresses: 128 Maximum number of MAC addresses of hash filtering: 0 VLAN offload: strip off filter off qinq(extend) off Hash key size in bytes: 40 Redirection table size: 1 Supported flow types: ipv4 ipv4-frag ipv4-tcp ipv4-udp ipv4-other ipv6 ipv6-frag ipv6-tcp ipv6-udp ipv6-other user defined 15 user defined 16 user defined 17 Minimum size of RX buffer: 32 Maximum configurable length of RX packet: 65536 Current number of RX queues: 1 Max possible RX queues: 65535 Max possible number of RXDs per queue: 65535 Min possible number of RXDs per queue: 0 RXDs number alignment: 1 Current number of TX queues: 1 Max possible TX queues: 65535 Max possible number of TXDs per queue: 65535 Min possible number of TXDs per queue: 0 TXDs number alignment: 1 testpmd> Thanks in advance. Regards, Mouli