From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-yb1-f179.google.com (mail-yb1-f179.google.com [209.85.219.179]) by dpdk.org (Postfix) with ESMTP id 9198491 for ; Wed, 31 Oct 2018 02:56:57 +0100 (CET) Received: by mail-yb1-f179.google.com with SMTP id i78-v6so5961586ybg.0 for ; Tue, 30 Oct 2018 18:56:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=NIGNdwn8yDj/TvR6EZW7s/AANTQfm6M100e64ziNcMQ=; b=gnUDlz60Y+9FrNdXylybe/iHbleZjc75nTfImY6k+8o+2nJT4pDg/Qd32V+ynqL4MB YfadttnKOItwHt7O+q2uNZt2Azq8yonoweKrXf07eyQAUQWbywqWLDbvfLNRHgVpSr7/ eyxRLLdYDVAsVb1M6UBpz4nhNQCw73i2QVeIYQEjZpfR60KBdZGHZq8X7PCgvolHEpSL 2tn94lKNo50Bp2wAHbJWNP/5ENbHCUwJg/z6Jfv+81y8aIf88HM9cVUrDoXR8H35dvNi lgKVDRKXehIOWIhEjS9Ou2OavubyHC4FG0XfAIuoNn2KV+seWQ810EUiAsE1KEq5bDV+ goHw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=NIGNdwn8yDj/TvR6EZW7s/AANTQfm6M100e64ziNcMQ=; b=I2Ma+RHLDbJ6XN6qAK1+k4lYU5sC+cK5CBDgX+OcRI4pt7PGf7XawfqGWyTXRPny9u OT5WX0SOfajhExpD2RghanXJfWtzUDZ1buf1kpxkYG1lD+pc4S9lZjTsgs7YI/1lBwc9 TMFkzLocaso0pYIDqxCBq3FPk8fDQLJda/zFY+EIzj90XjQNAVnjmiPsNuhgpCOpnAOQ 2Tf4zPRhzkqtBRT4PEq78Zr6CjJb+IMO6hiQMvNgdNe+KLsHc5845n8802KwzKunb63u A71qmoPlglbqE1AMGrloWxIykdgOB3//s4OguNyMGMX8ElfpUNOd+Hu9zffk/KvPD7HA CjUQ== X-Gm-Message-State: AGRZ1gInlxEWW/bMkLU4KONEx+1GjAB7X/LZYKVKQ9ikAUNTPcoAbOZB 2qc7MCS+3YHHJFlFkGMhhdOMP0OHU7PqGffpXXA= X-Google-Smtp-Source: AJdET5fZ1f2AUo1YncI5mXXmqeo1tFXyFC3cp5uI3Yu8Ous81liPRoWhwFebnV/lqf1caO1CWklwti6PmDOVhzN6ow0= X-Received: by 2002:a25:b006:: with SMTP id q6-v6mr1117777ybf.199.1540951016719; Tue, 30 Oct 2018 18:56:56 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Cliff Burdick Date: Tue, 30 Oct 2018 18:56:45 -0700 Message-ID: To: Raghu Gangi Cc: users Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Failed to allocate tx pool X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Oct 2018 01:56:57 -0000 Have you tried allocating memory on both numa nodes to rule that out? On Tue, Oct 30, 2018, 16:40 Raghu Gangi wrote: > Hi, > > I am currently facing issue in brining up DPDK application. It is failing > with the following message. rte_errno is set to 12 in this scenario. (Out > of memory). > > It would be great if you can kindly point me to what am I doing > incorrectly. > > I am using DPDK 2.2.0 version on ubuntu 16.04. > > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: Not managed by a supported kernel driver, skipped > EAL: PCI device 0000:02:00.3 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: Not managed by a supported kernel driver, skipped > EAL: PCI device 0000:82:00.0 on NUMA socket 1 > EAL: probe driver: 8086:10fb rte_ixgbe_pmd > EAL: PCI memory mapped at 0x7fd1a7600000 > EAL: PCI memory mapped at 0x7fd1a7640000 > PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 3 > PMD: eth_ixgbe_dev_init(): port 0 vendorID=0x8086 deviceID=0x10fb > EAL: PCI device 0000:82:00.1 on NUMA socket 1 > EAL: probe driver: 8086:10fb rte_ixgbe_pmd > EAL: PCI memory mapped at 0x7fd1a7644000 > EAL: PCI memory mapped at 0x7fd1a7684000 > PMD: eth_ixgbe_dev_init(): MAC: 2, PHY: 12, SFP+: 4 > PMD: eth_ixgbe_dev_init(): port 1 vendorID=0x8086 deviceID=0x10fb > RING: Cannot reserve memory > dpdk_if_init:256: failed to allocate tx pool > > The DPDK bound NIC cards are on NUMA socket 1. > > root@rg2-14053:/home/adara/raghu_2/dpdk-2.2.0# ./tools/dpdk_nic_bind.py > --status > > Network devices using DPDK-compatible driver > ============================================ > 0000:82:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > unused=ixgbe > 0000:82:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > unused=ixgbe > > Network devices using kernel driver > =================================== > 0000:02:00.0 'I350 Gigabit Network Connection' if=eno1 drv=igb > unused=igb_uio *Active* > 0000:02:00.3 'I350 Gigabit Network Connection' if=eno2 drv=igb > unused=igb_uio > > Other network devices > ===================== > > > > root@rg2-14053:/home/adara/raghu_2/run# cat > /sys/bus/pci/devices/0000\:82\:00.0/numa_node > 1 > root@rg2-14053:/home/adara/raghu_2/run# cat > /sys/bus/pci/devices/0000\:82\:00.1/numa_node > 1 > > > DPDK huge pages are allocated on the same NUMA node 1 as shown below: > > root@rg2-14053:/home/adara/raghu_2/run# cat > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages > 0 > root@rg2-14053:/home/adara/raghu_2/run# cat > /sys/devices/system/node/node1/hugepages/hugepages-2048kB/nr_hugepages > 128 > root@rg2-14053:/home/adara/raghu_2/run# > > Output of CPU Layout tool: > > root@rg2-14053:/home/adara/raghu_2/run# ../dpdk-2.2.0/tools/cpu_layout.py > ============================================================ > Core and Socket Information (as reported by '/proc/cpuinfo') > ============================================================ > cores = [0, 1, 2, 3, 4, 8, 9, 10, 11, 12] > sockets = [0, 1] > > Socket 0 Socket 1 > -------- -------- > Core 0 [0, 20] [10, 30] > > Core 1 [1, 21] [11, 31] > > Core 2 [2, 22] [12, 32] > > Core 3 [3, 23] [13, 33] > > Core 4 [4, 24] [14, 34] > > Core 8 [5, 25] [15, 35] > > Core 9 [6, 26] [16, 36] > > Core 10 [7, 27] [17, 37] > > Core 11 [8, 28] [18, 38] > > Core 12 [9, 29] [19, 39] > > Thanks, > Raghu >