DPDK usage discussions
 help / color / mirror / Atom feed
From: David Marchand <david.marchand@redhat.com>
To: "Pei, Andy" <andy.pei@intel.com>
Cc: "users@dpdk.org" <users@dpdk.org>,
	"Burakov, Anatoly" <anatoly.burakov@intel.com>,
	 David Christensen <drc@linux.vnet.ibm.com>,
	Volodymyr Fialko <vfialko@marvell.com>,
	 Maxime Coquelin <maxime.coquelin@redhat.com>,
	"Xia, Chenbo" <chenbo.xia@intel.com>
Subject: Re: enable ASAN issue when run on a Virtio PCI device
Date: Thu, 9 Mar 2023 14:44:17 +0100	[thread overview]
Message-ID: <CAJFAV8x+K9NXz+9hr2P+Wo-2OKBzu_V_Xm2onrtbTRS9nAuCGg@mail.gmail.com> (raw)
In-Reply-To: <DM5PR11MB1739D75B57B03CF00608913B8FB59@DM5PR11MB1739.namprd11.prod.outlook.com>

Hello,

Copying vhost/virtio people.


On Thu, Mar 9, 2023 at 2:05 PM Pei, Andy <andy.pei@intel.com> wrote:
> I am running testpmd on a virtio PCI device, and encounter this issue when enable ASAN.
>
> I got this ERROR,
>
> check_vq_phys_addr_ok(): vring address shouldn't be above 16TB!
> virtio_init_queue(): setup_queue failed
> eth_virtio_pci_init(): Failed to init virtio device
> EAL: Releasing PCI mapped resource for 0000:18:00.0
> EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc9c0000000
> EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc197a75000
> EAL: Requested device 0000:18:00.0 cannot be used
> EAL: Bus (pci) probe failed.
> TELEMETRY: No legacy callbacks, legacy socket not created
> testpmd: No probed ethernet devices
>
>
> How to fix this issue when ASAN is enabled, huge pages are all mapped to very high address,  adding “--base-virtaddr” args does not works.

I am not able to reproduce your issue.
You'll have to share more details about your setup.

Could you try --in-memory mode?

Maybe Anatoly has a better idea.


>
> 00400000-1079b000 r-xp 00000000 08:03 1671254677                         /home/andy/dpdk/asan/app/dpdk-testpmd
> 1099b000-109df000 r--p 1039b000 08:03 1671254677                         /home/andy/dpdk/asan/app/dpdk-testpmd
> 109df000-110ba000 rw-p 103df000 08:03 1671254677                         /home/andy/dpdk/asan/app/dpdk-testpmd
> 110ba000-116c6000 rw-p 00000000 00:00 0
> 7fff7000-8fff7000 rw-p 00000000 00:00 0
> 8fff7000-2008fff7000 ---p 00000000 00:00 0
> 2008fff7000-10007fff8000 rw-p 00000000 00:00 0
> 600000000000-600400000000 ---p 00000000 00:00 0
> 600400000000-600400010000 rw-p 00000000 00:00 0
> 7fb140000000-7fb180000000 rw-s 00000000 00:24 769328                     /dev/hugepages/rtemap_16384
> 7fb180000000-7fb1c0000000 rw-s 00000000 00:24 769329                     /dev/hugepages/rtemap_16385
> 7fb1c0000000-7fb200000000 rw-s 00000000 00:24 769330                     /dev/hugepages/rtemap_16386
> 7fb200000000-7fb240000000 rw-s 00000000 00:24 769331                     /dev/hugepages/rtemap_16387
> 7fc1c0000000-7fc200000000 rw-s 00000000 00:24 769319                     /dev/hugepages/rtemap_0
> 7fc200000000-7fc240000000 rw-s 00000000 00:24 769324                     /dev/hugepages/rtemap_1
> 7fc240000000-7fc280000000 rw-s 00000000 00:24 769326                     /dev/hugepages/rtemap_2
> 7fc280000000-7fc2c0000000 rw-s 00000000 00:24 769327                     /dev/hugepages/rtemap_3
> 7fc9d967c000-7fc9d967d000 rw-s 00000000 00:13 622047                     /run/dpdk/rte/fbarray_memseg-1048576k-1-1
> 7fc9d967d000-7fc9d967e000 rw-s 00000000 00:13 622046                     /run/dpdk/rte/fbarray_memseg-1048576k-1-0
> 7fc9d967e000-7fc9d967f000 rw-s 00000000 00:13 622045                     /run/dpdk/rte/fbarray_memseg-1048576k-0-1
> 7fc9d967f000-7fc9d96ad000 rw-s 00000000 00:13 622043                     /run/dpdk/rte/fbarray_memzone
> 7fc9d96ad000-7fc9d96ae000 ---p 00000000 00:00 0
> 7fc9d96ae000-7fc9da1b4000 rw-p 00000000 00:00 0
> 7fc9da1b4000-7fc9da1b5000 ---p 00000000 00:00 0
> 7fc9da1b5000-7fc9dacbb000 rw-p 00000000 00:00 0
> 7fc9dacbb000-7fc9dacc2000 rw-s 00000000 00:13 622030                     /run/dpdk/rte/config
> 7fc9dacc2000-7fc9dacf2000 rw-p 00000000 00:00 0
> 7fc9dacf2000-7fc9dad10000 r-xp 00000000 08:03 536960915                  /usr/lib64/libnl-3.so.200.23.0
> 7fc9dad10000-7fc9daf10000 ---p 0001e000 08:03 536960915                  /usr/lib64/libnl-3.so.200.23.0
> 7fc9daf10000-7fc9daf12000 r--p 0001e000 08:03 536960915                  /usr/lib64/libnl-3.so.200.23.0
> 7fc9daf12000-7fc9daf13000 rw-p 00020000 08:03 536960915                  /usr/lib64/libnl-3.so.200.23.0
> 7fc9daf13000-7fc9daf77000 r-xp 00000000 08:03 536960923                  /usr/lib64/libnl-route-3.so.200.23.0
> 7fc9daf77000-7fc9db176000 ---p 00064000 08:03 536960923                  /usr/lib64/libnl-route-3.so.200.23.0
> 7fc9db176000-7fc9db179000 r--p 00063000 08:03 536960923                  /usr/lib64/libnl-route-3.so.200.23.0
> 7fc9db179000-7fc9db17e000 rw-p 00066000 08:03 536960923                  /usr/lib64/libnl-route-3.so.200.23.0
> 7fc9db17e000-7fc9db180000 rw-p 00000000 00:00 0
> 7fc9db180000-7fc9db195000 r-xp 00000000 08:03 593696022                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7fc9db195000-7fc9db394000 ---p 00015000 08:03 593696022                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7fc9db394000-7fc9db395000 r--p 00014000 08:03 593696022                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7fc9db395000-7fc9db396000 rw-p 00015000 08:03 593696022                  /usr/lib64/libgcc_s-4.8.5-20150702.so.1
> 7fc9db396000-7fc9db47f000 r-xp 00000000 08:03 538833557                  /usr/lib64/libstdc++.so.6.0.19
> 7fc9db47f000-7fc9db67f000 ---p 000e9000 08:03 538833557                  /usr/lib64/libstdc++.so.6.0.19
> 7fc9db67f000-7fc9db687000 r--p 000e9000 08:03 538833557                  /usr/lib64/libstdc++.so.6.0.19
> 7fc9db687000-7fc9db689000 rw-p 000f1000 08:03 538833557                  /usr/lib64/libstdc++.so.6.0.19
> 7fc9db689000-7fc9db69e000 rw-p 00000000 00:00 0
> 7fc9db69e000-7fc9db862000 r-xp 00000000 08:03 536960220                  /usr/lib64/libc-2.17.so
> 7fc9db862000-7fc9dba61000 ---p 001c4000 08:03 536960220                  /usr/lib64/libc-2.17.so
> 7fc9dba61000-7fc9dba65000 r--p 001c3000 08:03 536960220                  /usr/lib64/libc-2.17.so
> 7fc9dba65000-7fc9dba67000 rw-p 001c7000 08:03 536960220                  /usr/lib64/libc-2.17.so
> 7fc9dba67000-7fc9dba6c000 rw-p 00000000 00:00 0
> 7fc9dba6c000-7fc9dba83000 r-xp 00000000 08:03 536960246                  /usr/lib64/libpthread-2.17.so
> 7fc9dba83000-7fc9dbc82000 ---p 00017000 08:03 536960246                  /usr/lib64/libpthread-2.17.so
> 7fc9dbc82000-7fc9dbc83000 r--p 00016000 08:03 536960246                  /usr/lib64/libpthread-2.17.so
> 7fc9dbc83000-7fc9dbc84000 rw-p 00017000 08:03 536960246                  /usr/lib64/libpthread-2.17.so
> 7fc9dbc84000-7fc9dbc88000 rw-p 00000000 00:00 0
> 7fc9dbc88000-7fc9dbc93000 r-xp 00000000 08:03 537880973                  /usr/lib64/libmlx4.so.1.0.22.4
> 7fc9dbc93000-7fc9dbe92000 ---p 0000b000 08:03 537880973                  /usr/lib64/libmlx4.so.1.0.22.4
> 7fc9dbe92000-7fc9dbe93000 r--p 0000a000 08:03 537880973                  /usr/lib64/libmlx4.so.1.0.22.4
> 7fc9dbe93000-7fc9dbe94000 rw-p 0000b000 08:03 537880973                  /usr/lib64/libmlx4.so.1.0.22.4
> 7fc9dbe94000-7fc9dbea9000 r-xp 00000000 08:03 536960265                  /usr/lib64/libz.so.1.2.7
> 7fc9dbea9000-7fc9dc0a8000 ---p 00015000 08:03 536960265                  /usr/lib64/libz.so.1.2.7
> 7fc9dc0a8000-7fc9dc0a9000 r--p 00014000 08:03 536960265                  /usr/lib64/libz.so.1.2.7
> 7fc9dc0a9000-7fc9dc0aa000 rw-p 00015000 08:03 536960265                  /usr/lib64/libz.so.1.2.7
> 7fc9dc0aa000-7fc9dc2e1000 r-xp 00000000 08:03 680121447                  /usr/lib64/libcrypto.so.1.0.2k
> 7fc9dc2e1000-7fc9dc4e0000 ---p 00237000 08:03 680121447                  /usr/lib64/libcrypto.so.1.0.2k
> 7fc9dc4e0000-7fc9dc4fc000 r--p 00236000 08:03 680121447                  /usr/lib64/libcrypto.so.1.0.2k
> 7fc9dc4fc000-7fc9dc509000 rw-p 00252000 08:03 680121447                  /usr/lib64/libcrypto.so.1.0.2k
> 7fc9dc509000-7fc9dc50d000 rw-p 00000000 00:00 0
> 7fc9dc50d000-7fc9dc525000 r-xp 00000000 08:03 537880966                  /usr/lib64/libibverbs.so.1.5.22.4
> 7fc9dc525000-7fc9dc724000 ---p 00018000 08:03 537880966                  /usr/lib64/libibverbs.so.1.5.22.4
> 7fc9dc724000-7fc9dc725000 r--p 00017000 08:03 537880966                  /usr/lib64/libibverbs.so.1.5.22.4
> 7fc9dc725000-7fc9dc726000 rw-p 00018000 08:03 537880966                  /usr/lib64/libibverbs.so.1.5.22.4
> 7fc9dc726000-7fc9dc74d000 r-xp 00000000 08:03 537880975                  /usr/lib64/libmlx5.so.1.8.22.4
> 7fc9dc74d000-7fc9dc94c000 ---p 00027000 08:03 537880975                  /usr/lib64/libmlx5.so.1.8.22.4
> 7fc9dc94c000-7fc9dc94d000 r--p 00026000 08:03 537880975                  /usr/lib64/libmlx5.so.1.8.22.4
> 7fc9dc94d000-7fc9dc94e000 rw-p 00027000 08:03 537880975                  /usr/lib64/libmlx5.so.1.8.22.4
> 7fc9dc94e000-7fc9dc98c000 r-xp 00000000 08:03 538119976                  /usr/lib64/libpcap.so.1.5.3
> 7fc9dc98c000-7fc9dcb8b000 ---p 0003e000 08:03 538119976                  /usr/lib64/libpcap.so.1.5.3
> 7fc9dcb8b000-7fc9dcb8d000 r--p 0003d000 08:03 538119976                  /usr/lib64/libpcap.so.1.5.3
> 7fc9dcb8d000-7fc9dcb8e000 rw-p 0003f000 08:03 538119976                  /usr/lib64/libpcap.so.1.5.3
> 7fc9dcb8e000-7fc9dcb8f000 rw-p 00000000 00:00 0
> 7fc9dcb8f000-7fc9dcb99000 r-xp 00000000 08:03 538833618                  /usr/lib64/libnuma.so.1.0.0
> 7fc9dcb99000-7fc9dcd99000 ---p 0000a000 08:03 538833618                  /usr/lib64/libnuma.so.1.0.0
> 7fc9dcd99000-7fc9dcd9a000 r--p 0000a000 08:03 538833618                  /usr/lib64/libnuma.so.1.0.0
> 7fc9dcd9a000-7fc9dcd9b000 rw-p 0000b000 08:03 538833618                  /usr/lib64/libnuma.so.1.0.0
> 7fc9dcd9b000-7fc9dcd9d000 r-xp 00000000 08:03 536960226                  /usr/lib64/libdl-2.17.so
> 7fc9dcd9d000-7fc9dcf9d000 ---p 00002000 08:03 536960226                  /usr/lib64/libdl-2.17.so
> 7fc9dcf9d000-7fc9dcf9e000 r--p 00002000 08:03 536960226                  /usr/lib64/libdl-2.17.so
> 7fc9dcf9e000-7fc9dcf9f000 rw-p 00003000 08:03 536960226                  /usr/lib64/libdl-2.17.so
> 7fc9dcf9f000-7fc9dd0a0000 r-xp 00000000 08:03 536960228                  /usr/lib64/libm-2.17.so
> 7fc9dd0a0000-7fc9dd29f000 ---p 00101000 08:03 536960228                  /usr/lib64/libm-2.17.so
> 7fc9dd29f000-7fc9dd2a0000 r--p 00100000 08:03 536960228                  /usr/lib64/libm-2.17.so
> 7fc9dd2a0000-7fc9dd2a1000 rw-p 00101000 08:03 536960228                  /usr/lib64/libm-2.17.so
> 7fc9dd2a1000-7fc9dd2cb000 r-xp 00000000 08:03 671752690                  /usr/lib64/libasan.so.0.0.0
> 7fc9dd2cb000-7fc9dd4ca000 ---p 0002a000 08:03 671752690                  /usr/lib64/libasan.so.0.0.0
> 7fc9dd4ca000-7fc9dd4cb000 r--p 00029000 08:03 671752690                  /usr/lib64/libasan.so.0.0.0
> 7fc9dd4cb000-7fc9dd4cc000 rw-p 0002a000 08:03 671752690                  /usr/lib64/libasan.so.0.0.0
> 7fc9dd4cc000-7fc9e0231000 rw-p 00000000 00:00 0
> 7fc9e0231000-7fc9e0253000 r-xp 00000000 08:03 536960213                  /usr/lib64/ld-2.17.so
> 7fc9e0253000-7fc9e0254000 rw-s 00000000 00:13 622044                     /run/dpdk/rte/fbarray_memseg-1048576k-0-0
> 7fc9e0254000-7fc9e043a000 rw-p 00000000 00:00 0
> 7fc9e043a000-7fc9e0452000 rw-p 00000000 00:00 0
> 7fc9e0452000-7fc9e0453000 r--p 00021000 08:03 536960213                  /usr/lib64/ld-2.17.so
> 7fc9e0453000-7fc9e0454000 rw-p 00022000 08:03 536960213                  /usr/lib64/ld-2.17.so
> 7fc9e0454000-7fc9e0455000 rw-p 00000000 00:00 0
> 7fff29f46000-7fff29f67000 rw-p 00000000 00:00 0                          [stack]
> 7fff29fe9000-7fff29feb000 r-xp 00000000 00:00 0                          [vdso]
> ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0                  [vsyscall]


-- 
David Marchand


  reply	other threads:[~2023-03-09 13:44 UTC|newest]

Thread overview: 4+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-03-09 13:04 Pei, Andy
2023-03-09 13:44 ` David Marchand [this message]
2023-03-09 14:43   ` David Marchand
2023-03-10  6:05     ` Pei, Andy

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=CAJFAV8x+K9NXz+9hr2P+Wo-2OKBzu_V_Xm2onrtbTRS9nAuCGg@mail.gmail.com \
    --to=david.marchand@redhat.com \
    --cc=anatoly.burakov@intel.com \
    --cc=andy.pei@intel.com \
    --cc=chenbo.xia@intel.com \
    --cc=drc@linux.vnet.ibm.com \
    --cc=maxime.coquelin@redhat.com \
    --cc=users@dpdk.org \
    --cc=vfialko@marvell.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).