From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 795E1A10DA for ; Thu, 1 Aug 2019 07:25:30 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id D7DEE1C136; Thu, 1 Aug 2019 07:25:29 +0200 (CEST) Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by dpdk.org (Postfix) with ESMTP id 0A3C81C011 for ; Thu, 1 Aug 2019 07:25:28 +0200 (CEST) Received: from pps.filterd (m0098419.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x715MIZZ135360 for ; Thu, 1 Aug 2019 01:25:28 -0400 Received: from smtp.notes.na.collabserv.com (smtp.notes.na.collabserv.com [158.85.210.109]) by mx0b-001b2d01.pphosted.com with ESMTP id 2u3qu2vbku-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 01 Aug 2019 01:25:28 -0400 Received: from localhost by smtp.notes.na.collabserv.com with smtp.notes.na.collabserv.com ESMTP for from ; Thu, 1 Aug 2019 05:25:27 -0000 Received: from us1b3-smtp01.a3dr.sjc01.isc4sb.com (10.122.7.174) by smtp.notes.na.collabserv.com (10.122.47.48) with smtp.notes.na.collabserv.com ESMTP; Thu, 1 Aug 2019 05:25:22 -0000 Received: from us1b3-mail157.a3dr.sjc03.isc4sb.com ([10.160.174.125]) by us1b3-smtp01.a3dr.sjc01.isc4sb.com with ESMTP id 2019080105252172-79677 ; Thu, 1 Aug 2019 05:25:21 +0000 In-Reply-To: From: "Takeshi T Yoshimura" To: David Marchand Cc: dev , David Christensen Date: Thu, 1 Aug 2019 05:25:22 +0000 MIME-Version: 1.0 Sensitivity: Importance: Normal X-Priority: 3 (Normal) References: , <20190731033523.2482-1-tyos@jp.ibm.com> X-Mailer: IBM iNotes ($HaikuForm 1054) | IBM Domino Build SCN1812108_20180501T0841_FP55 May 22, 2019 at 11:09 X-KeepSent: FCB5A2C6:AF7A3BFF-00258449:001DA2FD; type=4; name=$KeepSent X-LLNOutbound: False X-Disclaimed: 21467 X-TNEFEvaluated: 1 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 x-cbid: 19080105-3721-0000-0000-0000071ADEB9 X-IBM-SpamModules-Scores: BY=0.283064; FL=0; FP=0; FZ=0; HX=0; KW=0; PH=0; SC=0.415104; ST=0; TS=0; UL=0; ISC=; MB=0.000430 X-IBM-SpamModules-Versions: BY=3.00011532; HX=3.00000242; KW=3.00000007; PH=3.00000004; SC=3.00000287; SDB=6.01240390; UDB=6.00654088; IPR=6.01021814; BA=6.00006362; NDR=6.00000001; ZLA=6.00000005; ZF=6.00000009; ZB=6.00000000; ZP=6.00000000; ZH=6.00000000; ZU=6.00000002; MB=3.00027990; XFM=3.00000015; UTC=2019-08-01 05:25:25 X-IBM-AV-DETECTION: SAVI=unsuspicious REMOTE=unsuspicious XFE=unused X-IBM-AV-VERSION: SAVI=2019-08-01 05:19:40 - 6.00010234 x-cbparentid: 19080105-3722-0000-0000-0000FEDF1485 Message-Id: X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-08-01_03:, , signatures=0 X-Proofpoint-Spam-Reason: safe Subject: Re: [dpdk-dev] [PATCH] eal: forcing IOVA as PA in ppc X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" -----David Marchand wrote: ----- >To: Takeshi T Yoshimura >From: David Marchand >Date: 08/01/2019 02:01PM >Cc: dev , David Christensen >Subject: [EXTERNAL] Re: [dpdk-dev] [PATCH] eal: forcing IOVA as PA in >ppc > >Hello, > >On Thu, Aug 1, 2019 at 6:10 AM Takeshi T Yoshimura >wrote: >> Here's the full debug log I got. I ran upstream SPDK on NVMe on IBM >Power9 AC922. >> The operating system is Ubuntu 18.04 and Linux 4.17. >> >> Starting SPDK v19.07-pre / DPDK 19.08.0-rc3 initialization... >> [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 >--log-level=3Dlib.eal:6 --log-level=3Dlib.cryptodev:5 --log-level=3Duser1:6 >--log-level=3Dlib.eal:8 --base-virtaddr=3D0x200000000000 >--match-allocations --file-prefix=3Dspdk=5Fpid139059 ] > >We are missing the initial logs here (eal log level is set twice, but >this should not be a problem). >Is it truncated by spdk ? Is there a way to get them ? > >Thanks. > >--=20 >David Marchand > > Okay. I should have set the --log-level=3Dlib.*:debug. Here is the log. Starting SPDK v19.10-pre / DPDK 19.08.0-rc3 initialization... [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --log-level=3D= lib.eal:6 --log-level=3Dlib.cryptodev:5 --log-level=3Duser1:6 --log-level= =3Dlib.*:debug --base-virtaddr=3D0x200000000000 --match-allocations --file-= prefix=3Dspdk=5Fpid159692 ] EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 0 on socket 0 EAL: Detected lcore 2 as core 0 on socket 0 EAL: Detected lcore 3 as core 0 on socket 0 EAL: Detected lcore 4 as core 4 on socket 0 EAL: Detected lcore 5 as core 4 on socket 0 EAL: Detected lcore 6 as core 4 on socket 0 EAL: Detected lcore 7 as core 4 on socket 0 EAL: Detected lcore 8 as core 8 on socket 0 EAL: Detected lcore 9 as core 8 on socket 0 EAL: Detected lcore 10 as core 8 on socket 0 EAL: Detected lcore 11 as core 8 on socket 0 EAL: Detected lcore 12 as core 12 on socket 0 EAL: Detected lcore 13 as core 12 on socket 0 EAL: Detected lcore 14 as core 12 on socket 0 EAL: Detected lcore 15 as core 12 on socket 0 EAL: Detected lcore 16 as core 24 on socket 0 EAL: Detected lcore 17 as core 24 on socket 0 EAL: Detected lcore 18 as core 24 on socket 0 EAL: Detected lcore 19 as core 24 on socket 0 EAL: Detected lcore 20 as core 28 on socket 0 EAL: Detected lcore 21 as core 28 on socket 0 EAL: Detected lcore 22 as core 28 on socket 0 EAL: Detected lcore 23 as core 28 on socket 0 EAL: Detected lcore 24 as core 32 on socket 0 EAL: Detected lcore 25 as core 32 on socket 0 EAL: Detected lcore 26 as core 32 on socket 0 EAL: Detected lcore 27 as core 32 on socket 0 EAL: Detected lcore 28 as core 36 on socket 0 EAL: Detected lcore 29 as core 36 on socket 0 EAL: Detected lcore 30 as core 36 on socket 0 EAL: Detected lcore 31 as core 36 on socket 0 EAL: Detected lcore 32 as core 48 on socket 0 EAL: Detected lcore 33 as core 48 on socket 0 EAL: Detected lcore 34 as core 48 on socket 0 EAL: Detected lcore 35 as core 48 on socket 0 EAL: Detected lcore 36 as core 52 on socket 0 EAL: Detected lcore 37 as core 52 on socket 0 EAL: Detected lcore 38 as core 52 on socket 0 EAL: Detected lcore 39 as core 52 on socket 0 EAL: Detected lcore 40 as core 56 on socket 0 EAL: Detected lcore 41 as core 56 on socket 0 EAL: Detected lcore 42 as core 56 on socket 0 EAL: Detected lcore 43 as core 56 on socket 0 EAL: Detected lcore 44 as core 60 on socket 0 EAL: Detected lcore 45 as core 60 on socket 0 EAL: Detected lcore 46 as core 60 on socket 0 EAL: Detected lcore 47 as core 60 on socket 0 EAL: Detected lcore 48 as core 64 on socket 0 EAL: Detected lcore 49 as core 64 on socket 0 EAL: Detected lcore 50 as core 64 on socket 0 EAL: Detected lcore 51 as core 64 on socket 0 EAL: Detected lcore 52 as core 68 on socket 0 EAL: Detected lcore 53 as core 68 on socket 0 EAL: Detected lcore 54 as core 68 on socket 0 EAL: Detected lcore 55 as core 68 on socket 0 EAL: Detected lcore 56 as core 72 on socket 0 EAL: Detected lcore 57 as core 72 on socket 0 EAL: Detected lcore 58 as core 72 on socket 0 EAL: Detected lcore 59 as core 72 on socket 0 EAL: Detected lcore 60 as core 76 on socket 0 EAL: Detected lcore 61 as core 76 on socket 0 EAL: Detected lcore 62 as core 76 on socket 0 EAL: Detected lcore 63 as core 76 on socket 0 EAL: Detected lcore 64 as core 80 on socket 0 EAL: Detected lcore 65 as core 80 on socket 0 EAL: Detected lcore 66 as core 80 on socket 0 EAL: Detected lcore 67 as core 80 on socket 0 EAL: Detected lcore 68 as core 84 on socket 0 EAL: Detected lcore 69 as core 84 on socket 0 EAL: Detected lcore 70 as core 84 on socket 0 EAL: Detected lcore 71 as core 84 on socket 0 EAL: Detected lcore 72 as core 88 on socket 0 EAL: Detected lcore 73 as core 88 on socket 0 EAL: Detected lcore 74 as core 88 on socket 0 EAL: Detected lcore 75 as core 88 on socket 0 EAL: Detected lcore 76 as core 92 on socket 0 EAL: Detected lcore 77 as core 92 on socket 0 EAL: Detected lcore 78 as core 92 on socket 0 EAL: Detected lcore 79 as core 92 on socket 0 EAL: Detected lcore 80 as core 2048 on socket 8 EAL: Detected lcore 81 as core 2048 on socket 8 EAL: Detected lcore 82 as core 2048 on socket 8 EAL: Detected lcore 83 as core 2048 on socket 8 EAL: Detected lcore 84 as core 2052 on socket 8 EAL: Detected lcore 85 as core 2052 on socket 8 EAL: Detected lcore 86 as core 2052 on socket 8 EAL: Detected lcore 87 as core 2052 on socket 8 EAL: Detected lcore 88 as core 2056 on socket 8 EAL: Detected lcore 89 as core 2056 on socket 8 EAL: Detected lcore 90 as core 2056 on socket 8 EAL: Detected lcore 91 as core 2056 on socket 8 EAL: Detected lcore 92 as core 2060 on socket 8 EAL: Detected lcore 93 as core 2060 on socket 8 EAL: Detected lcore 94 as core 2060 on socket 8 EAL: Detected lcore 95 as core 2060 on socket 8 EAL: Detected lcore 96 as core 2064 on socket 8 EAL: Detected lcore 97 as core 2064 on socket 8 EAL: Detected lcore 98 as core 2064 on socket 8 EAL: Detected lcore 99 as core 2064 on socket 8 EAL: Detected lcore 100 as core 2068 on socket 8 EAL: Detected lcore 101 as core 2068 on socket 8 EAL: Detected lcore 102 as core 2068 on socket 8 EAL: Detected lcore 103 as core 2068 on socket 8 EAL: Detected lcore 104 as core 2072 on socket 8 EAL: Detected lcore 105 as core 2072 on socket 8 EAL: Detected lcore 106 as core 2072 on socket 8 EAL: Detected lcore 107 as core 2072 on socket 8 EAL: Detected lcore 108 as core 2076 on socket 8 EAL: Detected lcore 109 as core 2076 on socket 8 EAL: Detected lcore 110 as core 2076 on socket 8 EAL: Detected lcore 111 as core 2076 on socket 8 EAL: Detected lcore 112 as core 2080 on socket 8 EAL: Detected lcore 113 as core 2080 on socket 8 EAL: Detected lcore 114 as core 2080 on socket 8 EAL: Detected lcore 115 as core 2080 on socket 8 EAL: Detected lcore 116 as core 2084 on socket 8 EAL: Detected lcore 117 as core 2084 on socket 8 EAL: Detected lcore 118 as core 2084 on socket 8 EAL: Detected lcore 119 as core 2084 on socket 8 EAL: Detected lcore 120 as core 2088 on socket 8 EAL: Detected lcore 121 as core 2088 on socket 8 EAL: Detected lcore 122 as core 2088 on socket 8 EAL: Detected lcore 123 as core 2088 on socket 8 EAL: Detected lcore 124 as core 2092 on socket 8 EAL: Detected lcore 125 as core 2092 on socket 8 EAL: Detected lcore 126 as core 2092 on socket 8 EAL: Detected lcore 127 as core 2092 on socket 8 EAL: Detected lcore 128 as core 2096 on socket 8 EAL: Detected lcore 129 as core 2096 on socket 8 EAL: Detected lcore 130 as core 2096 on socket 8 EAL: Detected lcore 131 as core 2096 on socket 8 EAL: Detected lcore 132 as core 2100 on socket 8 EAL: Detected lcore 133 as core 2100 on socket 8 EAL: Detected lcore 134 as core 2100 on socket 8 EAL: Detected lcore 135 as core 2100 on socket 8 EAL: Detected lcore 136 as core 2104 on socket 8 EAL: Detected lcore 137 as core 2104 on socket 8 EAL: Detected lcore 138 as core 2104 on socket 8 EAL: Detected lcore 139 as core 2104 on socket 8 EAL: Detected lcore 140 as core 2108 on socket 8 EAL: Detected lcore 141 as core 2108 on socket 8 EAL: Detected lcore 142 as core 2108 on socket 8 EAL: Detected lcore 143 as core 2108 on socket 8 EAL: Detected lcore 144 as core 2112 on socket 8 EAL: Detected lcore 145 as core 2112 on socket 8 EAL: Detected lcore 146 as core 2112 on socket 8 EAL: Detected lcore 147 as core 2112 on socket 8 EAL: Detected lcore 148 as core 2116 on socket 8 EAL: Detected lcore 149 as core 2116 on socket 8 EAL: Detected lcore 150 as core 2116 on socket 8 EAL: Detected lcore 151 as core 2116 on socket 8 EAL: Detected lcore 152 as core 2136 on socket 8 EAL: Detected lcore 153 as core 2136 on socket 8 EAL: Detected lcore 154 as core 2136 on socket 8 EAL: Detected lcore 155 as core 2136 on socket 8 EAL: Detected lcore 156 as core 2140 on socket 8 EAL: Detected lcore 157 as core 2140 on socket 8 EAL: Detected lcore 158 as core 2140 on socket 8 EAL: Detected lcore 159 as core 2140 on socket 8 EAL: Support maximum 1536 logical core(s) by configuration. EAL: Detected 160 lcore(s) EAL: Detected 2 NUMA nodes EAL: No shared files mode enabled, IPC will be disabled EAL: No shared files mode enabled, IPC is disabled EAL: VFIO PCI modules not loaded EAL: Bus pci wants IOVA as 'DC' EAL: Buses did not request a specific IOVA mode. EAL: IOMMU is available, selecting IOVA as VA mode. EAL: Module /sys/module/rte=5Fkni not found! error 2 (No such file or direc= tory) EAL: Selected IOVA mode 'VA' EAL: No available hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: IOMMU type 1 (Type 1) is not supported EAL: IOMMU type 7 (sPAPR) is supported EAL: IOMMU type 8 (No-IOMMU) is not supported EAL: VFIO support initialized EAL: Ask a virtual area of 0x30000 bytes EAL: Virtual area found at 0x200000000000 (size =3D 0x30000) EAL: Setting up physically contiguous memory... EAL: Setting maximum number of open files to 1048576 EAL: Detected memory type: socket=5Fid:0 hugepage=5Fsz:2097152 EAL: Detected memory type: socket=5Fid:8 hugepage=5Fsz:2097152 EAL: Creating 4 segment lists: n=5Fsegs:8192 socket=5Fid:0 hugepage=5Fsz:20= 97152 EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200000030000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200000200000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200400200000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200400400000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200800400000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200800600000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x200c00600000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x200c00800000 (size =3D 0x400000000) EAL: Creating 4 segment lists: n=5Fsegs:8192 socket=5Fid:8 hugepage=5Fsz:20= 97152 EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201000800000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201000a00000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201400a00000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201400c00000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201800c00000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201800e00000 (size =3D 0x400000000) EAL: Ask a virtual area of 0x70000 bytes EAL: Virtual area found at 0x201c00e00000 (size =3D 0x70000) EAL: Memseg list allocated: 0x800kB at socket 8 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0x201c01000000 (size =3D 0x400000000) EAL: Hugepages will be freed exactly as allocated. EAL: No shared files mode enabled, IPC is disabled EAL: TSC frequency is ~510000 KHz EAL: Master lcore 0 is ready (tid=3D7430194644a0;cpuset=3D[0]) EAL: Trying to obtain current memory policy. EAL: Setting policy MPOL=5FPREFERRED for socket 0 EAL: Restoring previous memory policy: 0 EAL: request: mp=5Fmalloc=5Fsync EAL: No shared files mode enabled, IPC is disabled EAL: Heap on socket 0 was expanded by 2MB EAL: No shared files mode enabled, IPC is disabled EAL: Mem event callback 'spdk:(nil)' registered EAL: PCI device 0000:01:00.0 on NUMA socket 0 EAL: probe driver: 144d:a822 spdk=5Fnvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0000:01:00.0 cannot be used EAL: PCI device 0003:01:00.0 on NUMA socket 0 EAL: probe driver: 144d:a822 spdk=5Fnvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0003:01:00.0 cannot be used EAL: PCI device 0030:01:00.0 on NUMA socket 8 EAL: probe driver: 144d:a822 spdk=5Fnvme EAL: Expecting 'PA' IOVA mode but current mode is 'VA', not initializing EAL: Requested device 0030:01:00.0 cannot be used No NVMe controllers found.