From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from SJ-EXCH-1.adaranet.com (unknown [50.205.150.194]) by dpdk.org (Postfix) with ESMTP id 8321EFEB for ; Wed, 31 Oct 2018 00:39:55 +0100 (CET) Received: from SJ-EXCH-1.adaranet.com ([::1]) by SJ-EXCH-1.adaranet.com ([::1]) with mapi; Tue, 30 Oct 2018 16:39:54 -0700 From: Raghu Gangi To: "users@dpdk.org" Date: Tue, 30 Oct 2018 16:39:52 -0700 Thread-Topic: Failed to allocate tx pool Thread-Index: AdRwqdtyLISpDRnBR1yKyeIjpKGU+g== Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Microsoft-MacOutlook/14.7.7.170905 acceptlanguage: en-US MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Failed to allocate tx pool X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2018 23:39:56 -0000 Hi, I am currently facing issue in brining up DPDK application. It is failing w= ith the following message. rte_errno is set to 12 in this scenario. (Out of= memory). It would be great if you can kindly point me to what am I doing incorrectly= . I am using DPDK 2.2.0 version on ubuntu 16.04. EAL: PCI device 0000:02:00.0 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: Not managed by a supported kernel driver, skipped EAL: PCI device 0000:02:00.3 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: Not managed by a supported kernel driver, skipped EAL: PCI device 0000:82:00.0 on NUMA socket 1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7fd1a7600000 EAL: PCI memory mapped at 0x7fd1a7640000 PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 3 PMD: eth_ixgbe_dev_init(): port 0 vendorID=3D0x8086 deviceID=3D0x10fb EAL: PCI device 0000:82:00.1 on NUMA socket 1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7fd1a7644000 EAL: PCI memory mapped at 0x7fd1a7684000 PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 4 PMD: eth_ixgbe_dev_init(): port 1 vendorID=3D0x8086 deviceID=3D0x10fb RING: Cannot reserve memory dpdk_if_init:256: failed to allocate tx pool The DPDK bound NIC cards are on NUMA socket 1. root@rg2-14053:/home/adara/raghu_2/dpdk-2.2.0# ./tools/dpdk_nic_bind.py --s= tatus Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:82:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=3Digb_uio= unused=3Dixgbe 0000:82:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=3Digb_uio= unused=3Dixgbe Network devices using kernel driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:02:00.0 'I350 Gigabit Network Connection' if=3Deno1 drv=3Digb unused= =3Digb_uio *Active* 0000:02:00.3 'I350 Gigabit Network Connection' if=3Deno2 drv=3Digb unused= =3Digb_uio Other network devices =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D root@rg2-14053:/home/adara/raghu_2/run# cat /sys/bus/pci/devices/0000\:82\:= 00.0/numa_node 1 root@rg2-14053:/home/adara/raghu_2/run# cat /sys/bus/pci/devices/0000\:82\:= 00.1/numa_node 1 DPDK huge pages are allocated on the same NUMA node 1 as shown below: root@rg2-14053:/home/adara/raghu_2/run# cat /sys/devices/system/node/node0/= hugepages/hugepages-2048kB/nr_hugepages 0 root@rg2-14053:/home/adara/raghu_2/run# cat /sys/devices/system/node/node1/= hugepages/hugepages-2048kB/nr_hugepages 128 root@rg2-14053:/home/adara/raghu_2/run# Output of CPU Layout tool: root@rg2-14053:/home/adara/raghu_2/run# ../dpdk-2.2.0/tools/cpu_layout.py =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Core and Socket Information (as reported by '/proc/cpuinfo') =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D cores =3D [0, 1, 2, 3, 4, 8, 9, 10, 11, 12] sockets =3D [0, 1] Socket 0 Socket 1 -------- -------- Core 0 [0, 20] [10, 30] Core 1 [1, 21] [11, 31] Core 2 [2, 22] [12, 32] Core 3 [3, 23] [13, 33] Core 4 [4, 24] [14, 34] Core 8 [5, 25] [15, 35] Core 9 [6, 26] [16, 36] Core 10 [7, 27] [17, 37] Core 11 [8, 28] [18, 38] Core 12 [9, 29] [19, 39] Thanks, Raghu