From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 49CF441E14 for ; Thu, 9 Mar 2023 14:44:34 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id BECE940ED7; Thu, 9 Mar 2023 14:44:33 +0100 (CET) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id 5D6A0400D7 for ; Thu, 9 Mar 2023 14:44:32 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1678369471; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HLw6lERz36F9+LtcMDZEWqP/dS28hHKZk7tfBM2KahU=; b=jJQQHpzWeFwwHAQZsS/ImDcwTpasod3jDrxkQDJydZ7ks/36rVMPNdp0P0jtDcu3X+FIXi 6jR1fzLSIf0GVswIfapIg/2IzrhtpUdVTaIiTicvMav61tCpbfbSGS7un4LLAnMYxu8wjo VVVrpGz/uvcwPPDq3wjXYiM/nNsho5U= Received: from mail-pj1-f72.google.com (mail-pj1-f72.google.com [209.85.216.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-202-Bmj_3R4fOdGiPYY2z7ATww-1; Thu, 09 Mar 2023 08:44:30 -0500 X-MC-Unique: Bmj_3R4fOdGiPYY2z7ATww-1 Received: by mail-pj1-f72.google.com with SMTP id h19-20020a17090aa89300b0023a9e52c40dso1184758pjq.0 for ; Thu, 09 Mar 2023 05:44:30 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1678369469; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=HLw6lERz36F9+LtcMDZEWqP/dS28hHKZk7tfBM2KahU=; b=5DvbUdkhWW2vrArDtF9+e+dwPpx1MMr5AbZb/7Ey/FPrkqwb8/Ri5Os6ez0FN/ihYr QZ8wuxfUzhQoMMVZXOvuZtVG0sF8pt18Z1EkonNUMVqbqIA5WobDBfzNnUhBiUpfYcsx Pj74erQ4NVNwg/zBre0Klt5UyEKEMKtaY/VLPPCIzmaalxraScVhjWnK7EePI3F5gBnS vcCwUowCggNbdftxJZBembXftD0/NsP/wScXbSI3j7qM2Uo867gYceMWCMzxhQkQ9Yan i9cX5934gEeGV9PwhZVk0yQZRqmLoAzW3TyyfSkNNPJcSiTxH/HfD2N2KZLyAzC/4BT0 Y1Iw== X-Gm-Message-State: AO0yUKU9J54rlrhrZ9pZFL/0A4vwmUJvk/oucOWyRMBlNvKqWdKjQEd/ tx6YINAHIPDhz7Y+dY5TMQcdVFhVHv0ye+JmtdlW72BYVAag7bEaIM9unKVdvW1xv55akoD949O pRBH/UIVx4rr/5+Hw89gtbw== X-Received: by 2002:a62:87cc:0:b0:592:453c:320a with SMTP id i195-20020a6287cc000000b00592453c320amr9229702pfe.5.1678369469515; Thu, 09 Mar 2023 05:44:29 -0800 (PST) X-Google-Smtp-Source: AK7set8fEeT/WI9kdDdV9/zBIeoqeZ3elJgdKpdET2Tn/7I87Tm19EJdtNZ4OPX+UqDtGqYsxWLtIBUO5lEAvKzBS+s= X-Received: by 2002:a62:87cc:0:b0:592:453c:320a with SMTP id i195-20020a6287cc000000b00592453c320amr9229680pfe.5.1678369469162; Thu, 09 Mar 2023 05:44:29 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: David Marchand Date: Thu, 9 Mar 2023 14:44:17 +0100 Message-ID: Subject: Re: enable ASAN issue when run on a Virtio PCI device To: "Pei, Andy" Cc: "users@dpdk.org" , "Burakov, Anatoly" , David Christensen , Volodymyr Fialko , Maxime Coquelin , "Xia, Chenbo" X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hello, Copying vhost/virtio people. On Thu, Mar 9, 2023 at 2:05=E2=80=AFPM Pei, Andy wrote= : > I am running testpmd on a virtio PCI device, and encounter this issue whe= n enable ASAN. > > I got this ERROR, > > check_vq_phys_addr_ok(): vring address shouldn't be above 16TB! > virtio_init_queue(): setup_queue failed > eth_virtio_pci_init(): Failed to init virtio device > EAL: Releasing PCI mapped resource for 0000:18:00.0 > EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc9c0000000 > EAL: Calling pci_unmap_resource for 0000:18:00.0 at 0x7fc197a75000 > EAL: Requested device 0000:18:00.0 cannot be used > EAL: Bus (pci) probe failed. > TELEMETRY: No legacy callbacks, legacy socket not created > testpmd: No probed ethernet devices > > > How to fix this issue when ASAN is enabled, huge pages are all mapped to = very high address, adding =E2=80=9C--base-virtaddr=E2=80=9D args does not = works. I am not able to reproduce your issue. You'll have to share more details about your setup. Could you try --in-memory mode? Maybe Anatoly has a better idea. > > 00400000-1079b000 r-xp 00000000 08:03 1671254677 = /home/andy/dpdk/asan/app/dpdk-testpmd > 1099b000-109df000 r--p 1039b000 08:03 1671254677 = /home/andy/dpdk/asan/app/dpdk-testpmd > 109df000-110ba000 rw-p 103df000 08:03 1671254677 = /home/andy/dpdk/asan/app/dpdk-testpmd > 110ba000-116c6000 rw-p 00000000 00:00 0 > 7fff7000-8fff7000 rw-p 00000000 00:00 0 > 8fff7000-2008fff7000 ---p 00000000 00:00 0 > 2008fff7000-10007fff8000 rw-p 00000000 00:00 0 > 600000000000-600400000000 ---p 00000000 00:00 0 > 600400000000-600400010000 rw-p 00000000 00:00 0 > 7fb140000000-7fb180000000 rw-s 00000000 00:24 769328 = /dev/hugepages/rtemap_16384 > 7fb180000000-7fb1c0000000 rw-s 00000000 00:24 769329 = /dev/hugepages/rtemap_16385 > 7fb1c0000000-7fb200000000 rw-s 00000000 00:24 769330 = /dev/hugepages/rtemap_16386 > 7fb200000000-7fb240000000 rw-s 00000000 00:24 769331 = /dev/hugepages/rtemap_16387 > 7fc1c0000000-7fc200000000 rw-s 00000000 00:24 769319 = /dev/hugepages/rtemap_0 > 7fc200000000-7fc240000000 rw-s 00000000 00:24 769324 = /dev/hugepages/rtemap_1 > 7fc240000000-7fc280000000 rw-s 00000000 00:24 769326 = /dev/hugepages/rtemap_2 > 7fc280000000-7fc2c0000000 rw-s 00000000 00:24 769327 = /dev/hugepages/rtemap_3 > 7fc9d967c000-7fc9d967d000 rw-s 00000000 00:13 622047 = /run/dpdk/rte/fbarray_memseg-1048576k-1-1 > 7fc9d967d000-7fc9d967e000 rw-s 00000000 00:13 622046 = /run/dpdk/rte/fbarray_memseg-1048576k-1-0 > 7fc9d967e000-7fc9d967f000 rw-s 00000000 00:13 622045 = /run/dpdk/rte/fbarray_memseg-1048576k-0-1 > 7fc9d967f000-7fc9d96ad000 rw-s 00000000 00:13 622043 = /run/dpdk/rte/fbarray_memzone > 7fc9d96ad000-7fc9d96ae000 ---p 00000000 00:00 0 > 7fc9d96ae000-7fc9da1b4000 rw-p 00000000 00:00 0 > 7fc9da1b4000-7fc9da1b5000 ---p 00000000 00:00 0 > 7fc9da1b5000-7fc9dacbb000 rw-p 00000000 00:00 0 > 7fc9dacbb000-7fc9dacc2000 rw-s 00000000 00:13 622030 = /run/dpdk/rte/config > 7fc9dacc2000-7fc9dacf2000 rw-p 00000000 00:00 0 > 7fc9dacf2000-7fc9dad10000 r-xp 00000000 08:03 536960915 = /usr/lib64/libnl-3.so.200.23.0 > 7fc9dad10000-7fc9daf10000 ---p 0001e000 08:03 536960915 = /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf10000-7fc9daf12000 r--p 0001e000 08:03 536960915 = /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf12000-7fc9daf13000 rw-p 00020000 08:03 536960915 = /usr/lib64/libnl-3.so.200.23.0 > 7fc9daf13000-7fc9daf77000 r-xp 00000000 08:03 536960923 = /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9daf77000-7fc9db176000 ---p 00064000 08:03 536960923 = /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db176000-7fc9db179000 r--p 00063000 08:03 536960923 = /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db179000-7fc9db17e000 rw-p 00066000 08:03 536960923 = /usr/lib64/libnl-route-3.so.200.23.0 > 7fc9db17e000-7fc9db180000 rw-p 00000000 00:00 0 > 7fc9db180000-7fc9db195000 r-xp 00000000 08:03 593696022 = /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db195000-7fc9db394000 ---p 00015000 08:03 593696022 = /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db394000-7fc9db395000 r--p 00014000 08:03 593696022 = /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db395000-7fc9db396000 rw-p 00015000 08:03 593696022 = /usr/lib64/libgcc_s-4.8.5-20150702.so.1 > 7fc9db396000-7fc9db47f000 r-xp 00000000 08:03 538833557 = /usr/lib64/libstdc++.so.6.0.19 > 7fc9db47f000-7fc9db67f000 ---p 000e9000 08:03 538833557 = /usr/lib64/libstdc++.so.6.0.19 > 7fc9db67f000-7fc9db687000 r--p 000e9000 08:03 538833557 = /usr/lib64/libstdc++.so.6.0.19 > 7fc9db687000-7fc9db689000 rw-p 000f1000 08:03 538833557 = /usr/lib64/libstdc++.so.6.0.19 > 7fc9db689000-7fc9db69e000 rw-p 00000000 00:00 0 > 7fc9db69e000-7fc9db862000 r-xp 00000000 08:03 536960220 = /usr/lib64/libc-2.17.so > 7fc9db862000-7fc9dba61000 ---p 001c4000 08:03 536960220 = /usr/lib64/libc-2.17.so > 7fc9dba61000-7fc9dba65000 r--p 001c3000 08:03 536960220 = /usr/lib64/libc-2.17.so > 7fc9dba65000-7fc9dba67000 rw-p 001c7000 08:03 536960220 = /usr/lib64/libc-2.17.so > 7fc9dba67000-7fc9dba6c000 rw-p 00000000 00:00 0 > 7fc9dba6c000-7fc9dba83000 r-xp 00000000 08:03 536960246 = /usr/lib64/libpthread-2.17.so > 7fc9dba83000-7fc9dbc82000 ---p 00017000 08:03 536960246 = /usr/lib64/libpthread-2.17.so > 7fc9dbc82000-7fc9dbc83000 r--p 00016000 08:03 536960246 = /usr/lib64/libpthread-2.17.so > 7fc9dbc83000-7fc9dbc84000 rw-p 00017000 08:03 536960246 = /usr/lib64/libpthread-2.17.so > 7fc9dbc84000-7fc9dbc88000 rw-p 00000000 00:00 0 > 7fc9dbc88000-7fc9dbc93000 r-xp 00000000 08:03 537880973 = /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbc93000-7fc9dbe92000 ---p 0000b000 08:03 537880973 = /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe92000-7fc9dbe93000 r--p 0000a000 08:03 537880973 = /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe93000-7fc9dbe94000 rw-p 0000b000 08:03 537880973 = /usr/lib64/libmlx4.so.1.0.22.4 > 7fc9dbe94000-7fc9dbea9000 r-xp 00000000 08:03 536960265 = /usr/lib64/libz.so.1.2.7 > 7fc9dbea9000-7fc9dc0a8000 ---p 00015000 08:03 536960265 = /usr/lib64/libz.so.1.2.7 > 7fc9dc0a8000-7fc9dc0a9000 r--p 00014000 08:03 536960265 = /usr/lib64/libz.so.1.2.7 > 7fc9dc0a9000-7fc9dc0aa000 rw-p 00015000 08:03 536960265 = /usr/lib64/libz.so.1.2.7 > 7fc9dc0aa000-7fc9dc2e1000 r-xp 00000000 08:03 680121447 = /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc2e1000-7fc9dc4e0000 ---p 00237000 08:03 680121447 = /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc4e0000-7fc9dc4fc000 r--p 00236000 08:03 680121447 = /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc4fc000-7fc9dc509000 rw-p 00252000 08:03 680121447 = /usr/lib64/libcrypto.so.1.0.2k > 7fc9dc509000-7fc9dc50d000 rw-p 00000000 00:00 0 > 7fc9dc50d000-7fc9dc525000 r-xp 00000000 08:03 537880966 = /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc525000-7fc9dc724000 ---p 00018000 08:03 537880966 = /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc724000-7fc9dc725000 r--p 00017000 08:03 537880966 = /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc725000-7fc9dc726000 rw-p 00018000 08:03 537880966 = /usr/lib64/libibverbs.so.1.5.22.4 > 7fc9dc726000-7fc9dc74d000 r-xp 00000000 08:03 537880975 = /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc74d000-7fc9dc94c000 ---p 00027000 08:03 537880975 = /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94c000-7fc9dc94d000 r--p 00026000 08:03 537880975 = /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94d000-7fc9dc94e000 rw-p 00027000 08:03 537880975 = /usr/lib64/libmlx5.so.1.8.22.4 > 7fc9dc94e000-7fc9dc98c000 r-xp 00000000 08:03 538119976 = /usr/lib64/libpcap.so.1.5.3 > 7fc9dc98c000-7fc9dcb8b000 ---p 0003e000 08:03 538119976 = /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8b000-7fc9dcb8d000 r--p 0003d000 08:03 538119976 = /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8d000-7fc9dcb8e000 rw-p 0003f000 08:03 538119976 = /usr/lib64/libpcap.so.1.5.3 > 7fc9dcb8e000-7fc9dcb8f000 rw-p 00000000 00:00 0 > 7fc9dcb8f000-7fc9dcb99000 r-xp 00000000 08:03 538833618 = /usr/lib64/libnuma.so.1.0.0 > 7fc9dcb99000-7fc9dcd99000 ---p 0000a000 08:03 538833618 = /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd99000-7fc9dcd9a000 r--p 0000a000 08:03 538833618 = /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd9a000-7fc9dcd9b000 rw-p 0000b000 08:03 538833618 = /usr/lib64/libnuma.so.1.0.0 > 7fc9dcd9b000-7fc9dcd9d000 r-xp 00000000 08:03 536960226 = /usr/lib64/libdl-2.17.so > 7fc9dcd9d000-7fc9dcf9d000 ---p 00002000 08:03 536960226 = /usr/lib64/libdl-2.17.so > 7fc9dcf9d000-7fc9dcf9e000 r--p 00002000 08:03 536960226 = /usr/lib64/libdl-2.17.so > 7fc9dcf9e000-7fc9dcf9f000 rw-p 00003000 08:03 536960226 = /usr/lib64/libdl-2.17.so > 7fc9dcf9f000-7fc9dd0a0000 r-xp 00000000 08:03 536960228 = /usr/lib64/libm-2.17.so > 7fc9dd0a0000-7fc9dd29f000 ---p 00101000 08:03 536960228 = /usr/lib64/libm-2.17.so > 7fc9dd29f000-7fc9dd2a0000 r--p 00100000 08:03 536960228 = /usr/lib64/libm-2.17.so > 7fc9dd2a0000-7fc9dd2a1000 rw-p 00101000 08:03 536960228 = /usr/lib64/libm-2.17.so > 7fc9dd2a1000-7fc9dd2cb000 r-xp 00000000 08:03 671752690 = /usr/lib64/libasan.so.0.0.0 > 7fc9dd2cb000-7fc9dd4ca000 ---p 0002a000 08:03 671752690 = /usr/lib64/libasan.so.0.0.0 > 7fc9dd4ca000-7fc9dd4cb000 r--p 00029000 08:03 671752690 = /usr/lib64/libasan.so.0.0.0 > 7fc9dd4cb000-7fc9dd4cc000 rw-p 0002a000 08:03 671752690 = /usr/lib64/libasan.so.0.0.0 > 7fc9dd4cc000-7fc9e0231000 rw-p 00000000 00:00 0 > 7fc9e0231000-7fc9e0253000 r-xp 00000000 08:03 536960213 = /usr/lib64/ld-2.17.so > 7fc9e0253000-7fc9e0254000 rw-s 00000000 00:13 622044 = /run/dpdk/rte/fbarray_memseg-1048576k-0-0 > 7fc9e0254000-7fc9e043a000 rw-p 00000000 00:00 0 > 7fc9e043a000-7fc9e0452000 rw-p 00000000 00:00 0 > 7fc9e0452000-7fc9e0453000 r--p 00021000 08:03 536960213 = /usr/lib64/ld-2.17.so > 7fc9e0453000-7fc9e0454000 rw-p 00022000 08:03 536960213 = /usr/lib64/ld-2.17.so > 7fc9e0454000-7fc9e0455000 rw-p 00000000 00:00 0 > 7fff29f46000-7fff29f67000 rw-p 00000000 00:00 0 = [stack] > 7fff29fe9000-7fff29feb000 r-xp 00000000 00:00 0 = [vdso] > ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 = [vsyscall] --=20 David Marchand