From: Linzhe Lee <slayercat.subscription@gmail.com>
To: dev@dpdk.org
Subject: memory_hotplug_lock deadlock during initialization in Multi-process Mode on DPDK Version 22.11.3 LTS
Date: Wed, 27 Dec 2023 11:13:56 +0800 [thread overview]
Message-ID: <CAK_yBkNd2Jz4FY2xXFf9xMLrWY_ZkMuB076dhEfcKLWCusPeyA@mail.gmail.com> (raw)
Dear Team,
I hope this message finds you well.
We have encountered a recurring deadlock issue within the function
rte_rwlock_write_lock in the DPDK version 22.11.3 LTS.
It appears to be related to a known matter addressed in
https://bugs.dpdk.org/show_bug.cgi?id=1277 and subsequently resolved
in version 23.11.
I kindly propose the backporting of this fix to the 22.11 branch,
considering its status as a long-term support (LTS) version.
This deadlock scenario significantly impacts the initialization of the
secondary program, rendering it unable to function correctly.
Here is a snippet of the secondary program's initiation call stack:
```
#0 0x00000000013dd604 in rte_mcfg_mem_read_lock ()
#1 0x00000000013def02 in rte_memseg_list_walk ()
#2 0x00000000013fbc85 in eal_memalloc_init ()
#3 0x00000000013df73b in rte_eal_memory_init ()
#4 0x0000000000889cf5 in rte_eal_init.cold ()
#5 0x000000000088d094 in main () at ../app/status_server/main.cc:96
#6 0x00007ffff678e555 in __libc_start_main () from /lib64/libc.so.6
#7 0x00000000009ca80d in _start () at
/opt/rh/devtoolset-9/root/usr/include/c++/9/bits/shared_ptr_base.h:1169
```
The main program's situation during this deadlock is as follows:
```
(gdb) thread 1
[Switching to thread 1 (Thread 0x7ffff7fdec00 (LWP 20071))]
#0 0x00007ffff6b1d85d in nanosleep () from /lib64/libc.so.6
(gdb) bt
#0 0x00007ffff6b1d85d in nanosleep () from /lib64/libc.so.6
#1 0x00007ffff6b1d6f4 in sleep () from /lib64/libc.so.6
#2 0x00000000006e1f24 in lcore_main (pInfo=<synthetic pointer>) at
../app/main/main.c:682
#3 main () at ../app/main/main.c:1174
#4 0x00007ffff6a7a555 in __libc_start_main () from /lib64/libc.so.6
#5 0x000000000081f57d in _start ()
(gdb) thread 2
[Switching to thread 2 (Thread 0x7ffff3c50700 (LWP 20166))]
#0 0x00007ffff6e349dd in accept () from /lib64/libpthread.so.0
(gdb) bt
#0 0x00007ffff6e349dd in accept () from /lib64/libpthread.so.0
#1 0x0000000001172b23 in socket_listener ()
#2 0x00007ffff6e2dea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007ffff6b568dd in clone () from /lib64/libc.so.6
(gdb) thread 3
[Switching to thread 3 (Thread 0x7ffff4451700 (LWP 20157))]
#0 0x00007ffff6e34bad in recvmsg () from /lib64/libpthread.so.0
(gdb) bt
#0 0x00007ffff6e34bad in recvmsg () from /lib64/libpthread.so.0
#1 0x000000000115fce7 in mp_handle ()
#2 0x00007ffff6e2dea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007ffff6b568dd in clone () from /lib64/libc.so.6
(gdb) thread 4
[Switching to thread 4 (Thread 0x7ffff4c52700 (LWP 20156))]
#0 0x00007ffff6b56eb3 in epoll_wait () from /lib64/libc.so.6
(gdb) bt
#0 0x00007ffff6b56eb3 in epoll_wait () from /lib64/libc.so.6
#1 0x0000000001169be4 in eal_intr_thread_main ()
#2 0x00007ffff6e2dea5 in start_thread () from /lib64/libpthread.so.0
#3 0x00007ffff6b568dd in clone () from /lib64/libc.so.6
```
Your assistance in resolving this matter or providing guidance on a
workaround would be greatly appreciated.
Thank you for your attention to this issue.
next reply other threads:[~2023-12-27 3:14 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-12-27 3:13 Linzhe Lee [this message]
2023-12-27 10:14 ` David Marchand
2023-12-28 5:40 ` Linzhe Lee
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAK_yBkNd2Jz4FY2xXFf9xMLrWY_ZkMuB076dhEfcKLWCusPeyA@mail.gmail.com \
--to=slayercat.subscription@gmail.com \
--cc=dev@dpdk.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).