From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-yw1-f50.google.com (mail-yw1-f50.google.com [209.85.161.50]) by dpdk.org (Postfix) with ESMTP id 6133C4CA5 for ; Mon, 22 Oct 2018 11:28:34 +0200 (CEST) Received: by mail-yw1-f50.google.com with SMTP id z206-v6so4475271ywb.3 for ; Mon, 22 Oct 2018 02:28:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Fw+vThmqEtAhC9toVQas7wpeQ9u1WvE5PmGEv9N5HEA=; b=VkKIa4bIYY54n3s0PyweN8317baX2hWJl8ZSI7qacFr0dTK4TQZ8Cse/XKEZYBHIFy Fhi0l4NayPoHss5x12xTdOULSYaLWSUZov2ol6OT1r5HZ14oNPDcQhAPn5uC7eDOJlaH ZiL0DxkEpMlI9vMQQinKMn0k3xGyRrdR7/DdUBpcTdVOK5kauf+Io+6oNbyRPW8NGyou 4VxnJFBB4FTuIbLFsHYxOH6GUzCfqUEtjxJkHz7vV9cehLKdHSsWnMtzX/ePQvQQoYLS bdBzq/slQTCVSl7IhZw0knUV991+r+xbk4WGd6E0jr5qwo3Q3LSADIyAsjsIJ7jYCOZI sbng== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Fw+vThmqEtAhC9toVQas7wpeQ9u1WvE5PmGEv9N5HEA=; b=p+bTGSIW03m16CaP4mrEgAMca4M63aOhfOG7veeEGeUaLKE+mN2U+fzkBq9hW+K+T3 gRQqT09TJmq9Tx9q0kPnOMZdcRG18x+xNvih7DEbh4BpxsY4JtlyuXecTWOQVplr4oJy nRlZhVdI9E6TL245ntHvQKVumqEf7i4jN/4cN0qxkxPvoLFpRF5V4I3tl0Lv3uLil66b U4EdlIBKXGDbabQD0/+je3UVBol+6c8hVa13/8Pe8vb65WgGjsjtNVLn2nAA5wKhpGgr KqweK+y4NJg48tJ9Oi6j+9/D/psrzThiIXtpFOaTqD2x1g7dcSPcnf7IE1w2/SekZ9xM DA8Q== X-Gm-Message-State: ABuFfoglZAT5jhc2FSWTYARrtfZh4ugZieq4DdUaNnhg2GE1qlzmcn67 andsaENn42ggBSJDljtgPkgaHvWx2a13SbxrOhc= X-Google-Smtp-Source: ACcGV60we9Rn4Ycg+N0h727Bp0pr9HU0+95LmALP/jdvp+hIpOv0aOqOwGbnGbTdANgfCu4hMPA9D3r3KVnWefRFpe8= X-Received: by 2002:a81:4502:: with SMTP id s2-v6mr9714396ywa.363.1540200513626; Mon, 22 Oct 2018 02:28:33 -0700 (PDT) MIME-Version: 1.0 References: <0db47ae8-8811-0a21-b56e-ac8d58f403cc@intel.com> In-Reply-To: <0db47ae8-8811-0a21-b56e-ac8d58f403cc@intel.com> From: Kenvish Butani Date: Mon, 22 Oct 2018 14:58:21 +0530 Message-ID: To: anatoly.burakov@intel.com Cc: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] testpmd crashes with Invalid NUMA socket, default to 0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Oct 2018 09:28:34 -0000 Thanks a lot for your prompt reply ! JFYI, The invalid NUma socket was resolved by manually changing the entry to 0 echo 0 > /sys/bus/pci/devices/0000\:01\:00.0/uio/uio0/device/numa_node echo 0 > /sys/bus/pci/devices/0000\:01\:00.1/uio/uio1/device/numa_node # ./testpmd-cc-on-local -c 0xF -n 1 --log-level=eal,8 EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 0 on socket 1 EAL: Detected lcore 2 as core 1 on socket 0 EAL: Detected lcore 3 as core 1 on socket 1 EAL: Detected lcore 4 as core 2 on socket 0 EAL: Detected lcore 5 as core 2 on socket 1 EAigb_uio 0000:01:00.0: uio device registered with irq 44 L: Detected lcore 6 as core 8 on socket 0 EAL: Detected lcore 7 as core 8 on socket 1 EAL: Detected lcore 8 as core 9 on socket 0 EAL: Detected lcore 9 as core 9 on socket 1 EAL: Detected lcore 10 as core 10 on socket 0 EAL: Detected lcore 11 as core 10 on socket 1 EAL: Detected lcore 12 as core 0 on socket 0 EAL: Detected lcore 13 as core 0 on socket 1 EAL: Detected lcore 14 as core 1 on socket 0 EAL: Detected lcore 15 as core 1 on socket 1 EAL: Detected lcore 16 as core 2 on socket 0 EAL: Detected lcore 17 as core 2 on socket 1 EAL: Detected lcore 18 as core 8 on socket 0 EAL: Detected lcore 19 as core 8 on socket 1 EAL: Detected lcore 20 as core 9 on socket 0 EAL: Detected lcore 21 as core 9 on socket 1 EAL: Detected lcore 22 as core 10 on socket 0 EAL: Detected lcore 23 as core 10 on socket 1 EAL: Support maximum 128 logical core(s) by configuration. EAL: Detected 24 lcore(s) EAL: Detected 2 NUMA nodes EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: DPAA Bus not present. Skipping. EAL: Module /sys/module/vfio_pci not found! error 2 (No such file or directory) EAL: VFIO PCI modules not loaded EAL: Probing VFIO support... EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) EAL: VFIO modules not loaded, skipping VFIO support... EAL: Ask a virtual area of 0x2e000 bytes EAL: Virtual area found at 0x7fdf72c49000 (size = 0x2e000) EAL: Setting up physically contiguous memory... EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf72be8000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fdb70c00000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf72b87000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fd770a00000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf72b26000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fd370800000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf72ac5000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fcf70600000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf70d30000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 1 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fcb70400000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf70ccf000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 1 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fc770200000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf70c6e000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 1 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fc370000000 (size = 0x400000000) EAL: Ask a virtual area of 0x61000 bytes EAL: Virtual area found at 0x7fdf70c0d000 (size = 0x61000) EAL: Memseg list allocated: 0x800kB at socket 1 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x7fbf6fe00000 (size = 0x400000000) EAL: TSC frequency is ~2394274 KHz EAL: Master lcore 0 is ready (tid=72c7ec00;cpuset=[0]) EAL: lcore 1 is ready (tid=6f5fe700;cpuset=[1]) EAL: lcore 2 is ready (tid=6edfd700;cpuset=[2]) EAL: lcore 3 is ready (tid=6e5fc700;cpuset=[3]) EAL: Trying to obtain current memory policy. EAL: Setting policy MPOL_PREFERRED for socket 0 EAL: Restoring previous memory policy: 0 EAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 2MB EAL: PCI device 0000:01:00.0 on NUMA socket 0 EAL: probe driver: 8086:10a7 net_e1000_igb EAL: PCI memory mapped at 0x7fdf72aa5000 EAL: PCI memory mapped at 0x7fdf72aa1igb_uio 0000:01:00.1: uio device registered with irq 45 000 EAL: PCI device 0000:01:00.1 on NUMA socket 0 EAL: probe driver: 8086:10a7 net_e1000_igb EAL: PCI memory mapped at 0x7fdb70be0000 EAL: PCI memory mapped at 0x7fdf72a9d000 EAL: Module /sys/module/vfio not found! error 2 (No such file or directory) EAL: Trying to obtain current memory policy. EAL: Setting policy MPOL_PREFERRED for socket 0 EAL: alloc_seg(): allocation happened on wrong socket (wanted 0, got 1) EAL: attempted to allocate 45 segments, but only 31 were allocated EAL: Restoring previous memory policy: 0 EAL: Trying to obtain current memory policy. EAL: Setting policy MPOL_PREFERRED for socket 1 EAL: alloc_seg(): allocation happened on wrong socket (wanted 1, got 0) EAL: attempted to allocate 45 segments, but only 32 were allocated EAL: Restoring previous memory policy: 0 EAL: Error - exiting with code: 1 Cause: rte_zmalloc(32 struct rte_port) failed Is vfio driver mandatory ? i see few error messages related to it. Also, I see few error messages related to memory allocation, but I am not sure how to fix this. Can you please help me out here. Thanks, --Kenvish On Mon, Oct 22, 2018 at 2:45 PM Burakov, Anatoly wrote: > On 22-Oct-18 7:34 AM, Kenvish Butani wrote: > > Hi All, > > > > I am new to dpdk, and trying it to integrate DPDK with one of my server > > having intel nic's and 24 core cpu. > > > > I am trying to run testpmd app and it gets crashed with below logs > > > > ++++++++++++++++++++++++++++++++++++++ > > # ./testpmd-cc-on-local -c 0xF -n 1 -w 01:00.0 -- -i > > EAL: Detected 24 lcore(s) > > EAL: Detected 2 NUMA nodes > > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > > EAL: Probing VFIO support... > > EAL: PCI device igb_uio 0000:01:00.0: uio device registered with irq 44 > > 0000:01:00.0 on NUMA socket -1 > > EAL: Invalid NUMA socket, default to 0 > > EAL: probe driver: 8086:10a7 net_e1000_igb > > EAL: Error - exiting with code: 1 > > Cause: rte_zmalloc(32 struct rte_port) failed > > ++++++++++++++++++++++++++++++++++++++ > > Hi Kenvish, > > The error looks like you don't have any memory available. Adding > --log-level=eal,8 will reveal more info on what is happening during > attempt at allocation time. > > -- > Thanks, > Anatoly >