From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <raghu_gangi@adaranetworks.com>
Received: from SJ-EXCH-1.adaranet.com (unknown [50.205.150.194])
 by dpdk.org (Postfix) with ESMTP id 8321EFEB
 for <users@dpdk.org>; Wed, 31 Oct 2018 00:39:55 +0100 (CET)
Received: from SJ-EXCH-1.adaranet.com ([::1]) by SJ-EXCH-1.adaranet.com
 ([::1]) with mapi; Tue, 30 Oct 2018 16:39:54 -0700
From: Raghu Gangi <raghu_gangi@adaranetworks.com>
To: "users@dpdk.org" <users@dpdk.org>
Date: Tue, 30 Oct 2018 16:39:52 -0700
Thread-Topic: Failed to allocate tx pool
Thread-Index: AdRwqdtyLISpDRnBR1yKyeIjpKGU+g==
Message-ID: <D7FE39D8.A4162%raghu|gangi@adaranetworks.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
user-agent: Microsoft-MacOutlook/14.7.7.170905
acceptlanguage: en-US
MIME-Version: 1.0
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: [dpdk-users] Failed to allocate tx pool
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 30 Oct 2018 23:39:56 -0000

Hi,

I am currently facing issue in brining up DPDK application. It is failing w=
ith the following message. rte_errno is set to 12 in this scenario. (Out of=
 memory).

It would be great if you can kindly point me to what am I doing incorrectly=
.

I am using DPDK 2.2.0 version on ubuntu 16.04.

EAL: PCI device 0000:02:00.0 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL:   Not managed by a supported kernel driver, skipped
EAL: PCI device 0000:02:00.3 on NUMA socket 0
EAL:   probe driver: 8086:1521 rte_igb_pmd
EAL:   Not managed by a supported kernel driver, skipped
EAL: PCI device 0000:82:00.0 on NUMA socket 1
EAL:   probe driver: 8086:10fb rte_ixgbe_pmd
EAL:   PCI memory mapped at 0x7fd1a7600000
EAL:   PCI memory mapped at 0x7fd1a7640000
PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 3
PMD: eth_ixgbe_dev_init(): port 0 vendorID=3D0x8086 deviceID=3D0x10fb
EAL: PCI device 0000:82:00.1 on NUMA socket 1
EAL:   probe driver: 8086:10fb rte_ixgbe_pmd
EAL:   PCI memory mapped at 0x7fd1a7644000
EAL:   PCI memory mapped at 0x7fd1a7684000
PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 4
PMD: eth_ixgbe_dev_init(): port 1 vendorID=3D0x8086 deviceID=3D0x10fb
RING: Cannot reserve memory
dpdk_if_init:256: failed to allocate tx pool

The DPDK bound NIC cards are on NUMA socket 1.

root@rg2-14053:/home/adara/raghu_2/dpdk-2.2.0# ./tools/dpdk_nic_bind.py --s=
tatus

Network devices using DPDK-compatible driver
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
0000:82:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=3Digb_uio=
 unused=3Dixgbe
0000:82:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=3Digb_uio=
 unused=3Dixgbe

Network devices using kernel driver
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
0000:02:00.0 'I350 Gigabit Network Connection' if=3Deno1 drv=3Digb unused=
=3Digb_uio *Active*
0000:02:00.3 'I350 Gigabit Network Connection' if=3Deno2 drv=3Digb unused=
=3Digb_uio

Other network devices
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
<none>


root@rg2-14053:/home/adara/raghu_2/run# cat /sys/bus/pci/devices/0000\:82\:=
00.0/numa_node
1
root@rg2-14053:/home/adara/raghu_2/run# cat /sys/bus/pci/devices/0000\:82\:=
00.1/numa_node
1


DPDK huge pages are allocated on the same NUMA node 1 as shown below:

root@rg2-14053:/home/adara/raghu_2/run# cat /sys/devices/system/node/node0/=
hugepages/hugepages-2048kB/nr_hugepages
0
root@rg2-14053:/home/adara/raghu_2/run# cat /sys/devices/system/node/node1/=
hugepages/hugepages-2048kB/nr_hugepages
128
root@rg2-14053:/home/adara/raghu_2/run#

Output of CPU Layout tool:

root@rg2-14053:/home/adara/raghu_2/run# ../dpdk-2.2.0/tools/cpu_layout.py
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Core and Socket Information (as reported by '/proc/cpuinfo')
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
cores =3D  [0, 1, 2, 3, 4, 8, 9, 10, 11, 12]
sockets =3D  [0, 1]

        Socket 0        Socket 1
        --------        --------
Core 0  [0, 20]         [10, 30]

Core 1  [1, 21]         [11, 31]

Core 2  [2, 22]         [12, 32]

Core 3  [3, 23]         [13, 33]

Core 4  [4, 24]         [14, 34]

Core 8  [5, 25]         [15, 35]

Core 9  [6, 26]         [16, 36]

Core 10 [7, 27]         [17, 37]

Core 11 [8, 28]         [18, 38]

Core 12 [9, 29]         [19, 39]

Thanks,
Raghu