From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 46CDBA0C4A; Fri, 16 Jul 2021 06:04:54 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 08C0540151; Fri, 16 Jul 2021 06:04:54 +0200 (CEST) Received: from mail-oi1-f172.google.com (mail-oi1-f172.google.com [209.85.167.172]) by mails.dpdk.org (Postfix) with ESMTP id 7BB534014D for ; Fri, 16 Jul 2021 06:04:53 +0200 (CEST) Received: by mail-oi1-f172.google.com with SMTP id w127so9371014oig.12 for ; Thu, 15 Jul 2021 21:04:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=bZEzPtvc220904x70UJFO5De1wjx4nqwmwv++MRPggc=; b=frPxaFm/R7DXHPtlTyuYfvCS+rsoUTSd2sp7kGPqsPe6JlRONFo0GKHLcVK56S4SHW Xi2lFzlWXwPpId93r0ZQGr+NTJ1D72niQW//0RqJrVohtHYeVu0XWpfaJBu6D5zMQrS0 NgxxZtWLl3C+fclHw0Lr5vKV4J7KIouB8C72Pt6UO+l9vF3pbMtGShzVDgTfYrL/cbNr ygItAVY0gDUPGK8LFIOnpM/mXtp07ppVl3EjuQ5ybvxX5pB1sAowxelhfcSfm/ZmsDpK LCdL92GPBRBqR1z4mkUZh9h6o4ed6cvqdsv9E0Ayk0Nz6fYiXocm8facmkeye4nE/dAB LSDQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=bZEzPtvc220904x70UJFO5De1wjx4nqwmwv++MRPggc=; b=Wus9GcW7RyCsYVjTif22ag2jd/Nb/PUYh/K0+Il/spuS9fMFGOwSZ1FAtzRuY/Ya5T 0vRbcz485Cx92/u+b/PkLfS7CELvdLwBXXJZqYEJQbsYVF2jpcJiRljKI1dx0IWnrA02 ajTMi9N+QonlJEUAWg95Lp2i1U4by19KihCb7RZZmaN+aLHsdB3IGQwW4MXnPiHb3JDN rWy3etF9CDVVt2LwsRo2rRA/u0MiNf/XN1gaK5BlcpWOiU+uZeveczWNcO2wavPCRhb1 BpEu2ontxNct0ZpK88IXami2wMCOYfS8UAlqe0Y30DUgjA2+KMYkQdLFbg0PhVzGZCt6 mcJQ== X-Gm-Message-State: AOAM530+j08wcgHQf+vhQOUpU8q2TLWs7kp3LrLMGS3iJ987mAGXpACp OtdJFBw9ZHVrLrPqy5gpTvz18MlzukpcZHuIxfmdfgQWiVVRSA== X-Google-Smtp-Source: ABdhPJwKk0QdxYBw+f6cRL+j/L++tB9crFD5c3rGinnjHptm6q9R8xFmmEDbNT0EM+8OtkYULqMEj8LxzfUL+yzrCwg= X-Received: by 2002:aca:1e04:: with SMTP id m4mr6442297oic.1.1626408292608; Thu, 15 Jul 2021 21:04:52 -0700 (PDT) MIME-Version: 1.0 From: Truring Team Date: Fri, 16 Jul 2021 09:34:14 +0530 Message-ID: To: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: [dpdk-dev] dpdk-testpmd app with SRIOV VF on Kubernetes POD not working X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Everyone, We have Kubernetes setup where Master Node and one worker node are there and tried running dpdk-testpmd on POD So Master Node and Worker Node are AWS VM which has ixgbevf VF interfaces and binded one interface with dpdk igb_uio then expose the interface inside POD with multus cni and SR-IOV Network Device Plugin used and exposed interface showing inside POD Also created the Hugepages on worker node before joining cluster and then POD yaml file used hugepages-2Mi:100Mi with help of Kubernetes documentation https://kubernetes.io/docs/tasks/manage-hugepages/scheduling-hugepages/ Hugepages are showing in node and inside POD as well NIC Detail: *00:04.0 Ethernet controller [0200]: Intel Corporation 82599 Ethernet Controller Virtual Function [8086:10ed] (rev 01)* *dpdk-testpmd giving segmentation fault on PODs* After build dpdk-20.11 inside POD run the dpdk-testpmd then following segment fault occurs [root@centos7-testpmd dpdk-20.11]#* gdb ./build/app/dpdk-testpmd* GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-120.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /home/sandeep/dpdk-20.11/build/app/dpdk-testpmd...(no debugging symbols found)...done. (gdb) r -l 0-3 -n 4 -- -i Starting program: /home/sandeep/dpdk-20.11/./build/app/dpdk-testpmd -l 0-3 -n 4 -- -i [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". EAL: Detected 4 lcore(s) EAL: Detected 1 NUMA nodes [New Thread 0x7ffff6a71700 (LWP 29508)] EAL: Multi-process socket /var/run/dpdk/rte/mp_socket [New Thread 0x7ffff6270700 (LWP 29509)] EAL: Selected IOVA mode 'PA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... [New Thread 0x7ffff5a6f700 (LWP 29510)] [New Thread 0x7ffff526e700 (LWP 29511)] [New Thread 0x7ffff4a6d700 (LWP 29512)] EAL: Invalid NUMA socket, default to 0 EAL: Invalid NUMA socket, default to 0 EAL: Probe PCI driver: net_ixgbe_vf (8086:10ed) device: 0000:00:04.0 (socket 0) [New Thread 0x7ffff426c700 (LWP 29513)] EAL: No legacy callbacks, legacy socket not created Interactive-mode selected testpmd: create a new mbuf pool : n=171456, size=2176, socket=0 testpmd: preferred mempool ops selected: ring_mp_mc Program received signal SIGBUS, Bus error. 0x00000000009ffa36 in alloc_seg () Missing separate debuginfos, use: debuginfo-install glibc-2.17-324.el7_9.x86_64 libgcc-4.8.5-44.el7.x86_64 libpcap-1.5.3-12.el7.x86_64 numactl-libs-2.0.12-5.el7.x86_64 zlib-1.2.7-19.el7_9.x86_64 (gdb) *bt* *#0 0x00000000009ffa36 in alloc_seg ()* #1 0x0000000000a0043b in alloc_seg_walk () #2 0x00000000009e35ab in rte_memseg_list_walk_thread_unsafe () #3 0x0000000000a00d32 in eal_memalloc_alloc_seg_bulk () #4 0x00000000009f0374 in alloc_pages_on_heap () #5 0x00000000009f065b in try_expand_heap () #6 0x00000000009f0a91 in alloc_more_mem_on_socket () #7 0x00000000009f115e in malloc_heap_alloc () #8 0x00000000009e3ed1 in rte_memzone_reserve_thread_safe () #9 0x00000000009d671e in rte_mempool_populate_default () #10 0x00000000009c93af in rte_pktmbuf_pool_create_by_ops () #11 0x00000000009c9478 in rte_pktmbuf_pool_create () #12 0x000000000072b233 in mbuf_pool_create () #13 0x00000000004266d4 in main () (gdb) Can anyone help in resolving this issue ? Best Regard Puneet