From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id F0FACA04DA for ; Wed, 12 Aug 2020 17:36:26 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id B21391C032; Wed, 12 Aug 2020 17:36:25 +0200 (CEST) Received: from mail-pf1-f194.google.com (mail-pf1-f194.google.com [209.85.210.194]) by dpdk.org (Postfix) with ESMTP id DA9FB1C031 for ; Wed, 12 Aug 2020 17:36:24 +0200 (CEST) Received: by mail-pf1-f194.google.com with SMTP id a79so1203468pfa.8 for ; Wed, 12 Aug 2020 08:36:24 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=ecMyLfsozuq6WOdb4cLmZ97ikVLQ0+wNIAid+Ou0ppU=; b=UFabRf6PjVD8TcIvzLa7oU2p9CHIKLkWnnY0KIf4Z2hXuZ3x17cFx1OY7RdqwjfGwp iFONjlqVfykYiNmhvs9h3ySFlk3vLXUu9PKdexCcVodIjLxefIzNVa1LPdS2f90JrX3A HjNWxQ0upFmqtgXWieQZqNHkpUDmh9EUNhnFqyOwhRlpwl2TrD2XDRyFLK6ack/NggGq 8OTcVEdOvlOeIU5j61fDEuLbMpZl5cBkSZRRuzfBgYu+8eBazRjhkm5j2WRmuE+/C9tG Z3ogMJAn53d5EIqI11tSXf0N+vNGKsy0vfQUtyqCb+xX0j+k7zAQ87TT0SDI9VNOFw9O +pAg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=ecMyLfsozuq6WOdb4cLmZ97ikVLQ0+wNIAid+Ou0ppU=; b=C4ayTB5PjLOQ/VjMJnORQS04MPuFYsNdxKO3NBeXDU6IrNnziSingZq2s8KTjfe5Od vsSoolMZE2udLgXhKsJ8CfkUJeJW2kSBQqk+Sjln7So+tvR6oL197zt+Q0GXgSBKiV2z gs9/r306EQGULtDzoQclWqzLceEgmMG626W1FbyeQJIf32XUg338u4AwyBZdNKNy32AG D2MWGszhrDo53Ye/ZVALrEFTEyj4cBX5jhxEZN5JeApI61y2Wd4bHdXpeDHA1veuDfQx KqRd3CpZNlsmLelSO51jZAq16gbyYQBMn5u32oLwKB/DZFMC0+WdvMLQx0JRD71CQFLt z70Q== X-Gm-Message-State: AOAM533ZTWtzyHdS5sz7SL0rRHwEKhxDU8ftrpfI2SJyPODEqPJyl76r b8x2DVPKFwoJw14DD6WckumB6Q== X-Google-Smtp-Source: ABdhPJyWL6k540yJZGVorJJCS+dxJ3HX5nXYxSK/FJdptdC/ScWWMKO8HGjeizyogPZyELxu5t8Dag== X-Received: by 2002:a62:86ca:: with SMTP id x193mr140579pfd.152.1597246583780; Wed, 12 Aug 2020 08:36:23 -0700 (PDT) Received: from hermes.lan (204-195-22-127.wavecable.com. [204.195.22.127]) by smtp.gmail.com with ESMTPSA id z29sm2869370pfj.182.2020.08.12.08.36.22 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 12 Aug 2020 08:36:23 -0700 (PDT) Date: Wed, 12 Aug 2020 08:36:15 -0700 From: Stephen Hemminger To: Jatin Sahu Cc: users@dpdk.org, jatin.sahu@mobileum.com, chandrika.gautam@mobileum.com Message-ID: <20200812083615.4e6ddfea@hermes.lan> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: [dpdk-users] DPDK application is hunged in eal_hugepage_info_init X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" On Wed, 12 Aug 2020 16:59:33 +0530 Jatin Sahu wrote: > Hi, > > We are using DPDK libraries with huge pages enabled. > We observed that the application rte_eal_init() function is stuck in > flock() call. > > Please advise how to resolve this. > > DPDK Version: dpdk-stable-18.11.6/ > > [root@loadtestsrv helloworld]# ./build/helloworld -l 0-3 -n 4 > EAL: Detected 72 lcore(s) > EAL: Detected 2 NUMA nodes > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket > > Stack Trace: > Thread 3 (Thread 0x7f783c34e700 (LWP 1034)): > #0 0x00007f783c664113 in epoll_wait () from /lib64/libc.so.6 > #1 0x0000000000558724 in eal_intr_thread_main () > #2 0x00007f783c939dd5 in start_thread () from /lib64/libpthread.so.0 > #3 0x00007f783c663b3d in clone () from /lib64/libc.so.6 > Thread 2 (Thread 0x7f783bb4d700 (LWP 1035)): > #0 0x00007f783c940bfd in recvmsg () from /lib64/libpthread.so.0 > #1 0x0000000000565bae in mp_handle () > #2 0x00007f783c939dd5 in start_thread () from /lib64/libpthread.so.0 > #3 0x00007f783c663b3d in clone () from /lib64/libc.so.6 > Thread 1 (Thread 0x7f783d66dc00 (LWP 1033)): > #0 0x00007f783c655167 in flock () from /lib64/libc.so.6 > #1 0x000000000054e068 in eal_hugepage_info_init () > #2 0x000000000054ccfe in rte_eal_init () > #3 0x00000000004712a6 in main () > [root@loadtestsrv user]# > > HugePage details: > > [root@loadtestsrv roamware]# cat /proc/meminfo | grep -i huge > AnonHugePages: 112640 kB > HugePages_Total: 32 > HugePages_Free: 32 > HugePages_Rsvd: 0 > HugePages_Surp: 0 > Hugepagesize: 1048576 kB > > [roamware@loadtestsrv ~]$ cat > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages > 512 > [roamware@loadtestsrv ~]$ cat > /sys/devices/system/node/node1/hugepages/hugepages-2048kB/nr_hugepages > 512 > > [root@loadtestsrv roamware]# cat /proc/mounts | grep -i huge > cgroup /sys/fs/cgroup/hugetlb cgroup > rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 > nodev /mnt/huge hugetlbfs rw,seclabel,relatime 0 0 > nodev /mnt/huge hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 > nodev /mnt/huge hugetlbfs rw,seclabel,relatime 0 0 > > Regards, > Jatin Maybe in this case Flock blocks if other process has the file locked? Is there another process which has flocked the file? Or you have a buggy kernel?