From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-DM3-obe.outbound.protection.outlook.com (mail-dm3nam03on0069.outbound.protection.outlook.com [104.47.41.69]) by dpdk.org (Postfix) with ESMTP id 52C624C8E for ; Fri, 9 Mar 2018 10:16:15 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=iYp+vyi0+wiKphhOaDvxlqd3OgP8apMbNzAaJs3UD5E=; b=H92GnHuw9TTsWuLfmRWU2so2dKNTfdrTDbjz7I7XmWCsBIpWJ6ogJBeE965qQX5xRPAJMlYohWzfc4ltoYXsxzjUs4J+RV5E6uJk1omEkB0EpiWk2spJqWoqveogZOOfmMxhi300R8LwUu9iSMtcIrtVbo+rWSrwOAKeJase0V0= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Pavan.Bhagavatula@cavium.com; Received: from ltp-pvn (111.93.218.67) by BN6PR07MB3459.namprd07.prod.outlook.com (10.161.153.22) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.548.13; Fri, 9 Mar 2018 09:16:01 +0000 Date: Fri, 9 Mar 2018 14:45:15 +0530 From: Pavan Nikhilesh To: "Burakov, Anatoly" , keith.wiles@intel.com, jianfeng.tan@intel.com, andras.kovacs@ericsson.com, laszlo.vadkeri@ericsson.com, benjamin.walker@intel.com, bruce.richardson@intel.com, thomas@monjalon.net, konstantin.ananyev@intel.com, kuralamudhan.ramakrishnan@intel.com, louise.m.daly@intel.com, nelio.laranjeiro@6wind.com, yskoh@mellanox.com, pepperjo@japf.ch, jerin.jacob@caviumnetworks.com, hemant.agrawal@nxp.com, olivier.matz@6wind.com Cc: dev@dpdk.org Message-ID: <20180309091513.GA5781@ltp-pvn> References: <20180308101805.GA9526@ltp-pvn> <20180308111337.GA11638@ltp-pvn> <20180308133612.GA16647@ltp-pvn> <57c18da9-7377-3c0b-4aa2-9b97ef206f4f@intel.com> <55a2a182-27d5-b59a-0993-5b988f041e98@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <55a2a182-27d5-b59a-0993-5b988f041e98@intel.com> User-Agent: Mutt/1.9.3 (2018-01-21) X-Originating-IP: [111.93.218.67] X-ClientProxiedBy: MA1PR0101CA0024.INDPRD01.PROD.OUTLOOK.COM (52.134.136.162) To BN6PR07MB3459.namprd07.prod.outlook.com (10.161.153.22) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: b59cdf62-f775-4f61-f2fc-08d5859e663d X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(4604075)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:BN6PR07MB3459; X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3459; 3:ofv7eaMIYOkOG+4P1nEOuBQJWniOGthRrCb/MfMlxVxQWOTuRZRFNKdD73fCjxluEwVCTmeiFGLGATBhHIbktCIrM01pnQlJPUfgUcTRbLwTRhMO0Y+AKlfTYzTxRdRm4EaQ0WS8LrsggvkQkmHq79MKGumjB3029siPBmTDXlHyieAV0tmNYEhPKcGmvuuN1uRnQL9hYi8oZfz05+L3KwYuJhSq+JXujtQVkfbjRgSj7iOoJZut0BMLI+KIIwdI; 25:IEg2Ou7dGsXUBw2OORjxhebb9KaImMmI73AtWZZGjH2/waQ/hV+G9KxMIFa5csSJ2K5W2AFZ5lcViXjo2BWQskDXGC1P4wvcgRN692qQh28c/XgO0xl5CqIwWvxbnOyqr5AJqQsrhXWQeQSlgrwcw6OovdAwuyMvXuojes3DcG477T0UIfPq4ZAeYWT6FsJc17Qef+AlQ4xtrvTkeule0zhpqj7B1Je6ybg4fNwzUoVPVQXHua/hD6TiKMa0pwet6VZ3rP1YQRZKUIoz7rzG06S7pyCg37xkoRlw25YkycWKat3D/0vKVYA+GKQ/mGvpsg+OIpgnQ9HwGj4Vjiiq2Q==; 31:g1rQHKAx/eo3iaCh3UssoC4YE/B1ywd1TK1LqZIM/e6R+3ffDNEVfCz+Ktz/p9xUlhdEw+e0VXZIhI/luVOHbo6f4qGcimgWwkeIEV4v2qfY7xTU2Y3WsOKcDa9Ke79IREDI3sgRNmhPjvodNLWkTfV8mvBF67hxq4CMduuVO1lRW/vMaXfmeySKVihqL6aFi6NDWr2FtzvLj3YAgnghes8295y1QWLRsEVjWAonAZ0= X-MS-TrafficTypeDiagnostic: BN6PR07MB3459: X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3459; 20:2cXcz67VnD740U28sMD2ZEwcUEAEMklMjK0WbCidsm56poPF14wizjcP6h6rangJz4y2YKgFHASJuBYe5G43FFXI08MnN8E9A2ngzp+EkZbelfAAuzNug1MHOJHBCb6HmZ3c3hqYQEJx3GEV5/Y2i/Uu7ToPI8AOtD+EDGRJOAo5/gAsi/Ph6bdeIESYAyEGPL7CYc7B3V25JPeg1ajIDDcgf3nM6dbLaD912gQttv4WJ0q4HaFJSf76yZ7YY/Rwy8FgA56hWUIBUE4C7MCHyxmnf9KWIQ5ViGcUU1GXi2sr82Sce9Fmxoh6nv70P4FwA8MRQOE0ycCoy1XtwnbZb5PGwmI3NKg5E5A9FOX6W8PJX7rZiziiCDu/OqgxTFcrrYambcGRdfAFsdP378sE0UqzL+bNKDZIeSBxsSMsQOa5h1xSpV3sfeAKyrM1VYroQ3mI13Ik4iAGoq6T6epazSPlp/i2RLWrOWiaJf46KooBEWrRydwBSsaxIIBql/AUgp1RdF0W6fNmG9it+Uo4VleSKuDAxOYI0Jk0Ge+LzkdDmrzHGdh937Hlx+YuEHeYDs8mo+eF/sO1DxLuT+aMRaJQbR82I8vC1NewUVu7/xo=; 4:CozRIgDH0oJRwkN1Ed0O5yEh+eqixD67RaQ71l8qWO4QZ3vEgnzPi7T69g69TrpQiQMxpSsOyz6rMfpexbBeKWOe7Z/A7AEQaVSCzhOmz1iNV7TDdpMjwY452VvdHF8YaE0SrJOsV/3/KI82GGjcQrx1+XHCWgrK6idgOLGX+jmNsT3fNgfmaUHWuOgEtal05NP17GUKDBxUG7QPrfq4BCZiZf5rM3OwY6ddmbuogJojbxm0FXVhtgMfreP5+kKtcfdkBespyaUb/X4C+yPCiJt8AVFBjEgukOBIWhwfvdscFGHxmiy5q1tSoUkLs7cC X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(166708455590820); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(10201501046)(3002001)(93006095)(3231220)(944501244)(52105095)(6041310)(20161123560045)(20161123558120)(20161123564045)(20161123562045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011); SRVR:BN6PR07MB3459; BCL:0; PCL:0; RULEID:; SRVR:BN6PR07MB3459; X-Forefront-PRVS: 0606BBEB39 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(39380400002)(39850400004)(346002)(396003)(366004)(376002)(199004)(189003)(68736007)(2906002)(33716001)(6116002)(3846002)(5009440100003)(7736002)(47776003)(1076002)(66066001)(5660300001)(52116002)(6496006)(97736004)(76176011)(93886005)(58126008)(42882007)(8656006)(316002)(33656002)(26005)(6666003)(72206003)(478600001)(2950100002)(25786009)(16526019)(4326008)(53546011)(386003)(59450400001)(2870700001)(33896004)(6306002)(106356001)(53936002)(55016002)(50466002)(6246003)(229853002)(305945005)(7416002)(105586002)(9686003)(966005)(8936002)(186003)(8676002)(81156014)(81166006)(23756003)(18370500001)(107986001)(921003)(42262002)(1121003); DIR:OUT; SFP:1101; SCL:1; SRVR:BN6PR07MB3459; H:ltp-pvn; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?iso-8859-1?Q?1; BN6PR07MB3459; 23:hHXVpTOD362UjKOxcpYAeCp9wnVm5Tcbaq5xFn8?= =?iso-8859-1?Q?Z8uvx0iMYkcNDAUqDS+y8ifUs47rOHvSUrkeJxnb0Yv9JiNIqzd04Y0D2G?= =?iso-8859-1?Q?mdf6/XlaWBHa9BXsrmczccWaAVIVrxEWRvuBkPeE5qShXTtIXdddOPb7dP?= =?iso-8859-1?Q?sAljcPvIb3wK73QVHG2MSbb2RXh9xwPSBAWkGlI84Gq3hGUXbPhFe/WHn7?= =?iso-8859-1?Q?926RFL/0aXTHATsYwkIJitjLF0I2dSp+RxjEh2TM/eC1hu0wYKU5jfMXmr?= =?iso-8859-1?Q?AEV4Mv+REnFCVWdgCsfhqHuDfJv5v+FGKpHW+kx3yrwTd//vtZCBfTOxzu?= =?iso-8859-1?Q?zYwbuf5Lvqa2HPa7LS3FuJ0C68wk5xRUx1W6j4uW98OL/XaBZVmkzpsPpu?= =?iso-8859-1?Q?jm2mx2AW97+sMZCeZucJNgAYQ1Xsl8hLxdcGZK0+Z6esH1RAfYUiejD5/G?= =?iso-8859-1?Q?jVV9a2FwcFAUqkkxfG1tyA6Z/ou2DvLns4PvvEBMkv+M9lx+hxazDZFQsT?= =?iso-8859-1?Q?hUs7qEElvcP9SpZoXYxicHj2p1kxyu/x4AKOcfJLA4LI+2lzUqtO8Fch4o?= =?iso-8859-1?Q?hmzjxXRZwYoV2ER7x5OqhdjZu8ONhgrIlMZuaOnPuyc+oKehWWlSjrsCbv?= =?iso-8859-1?Q?/ywQkqGAhKOAZLM8xIPWESI2CAjBqPROuVy3bT712aZCOtR4qFI7f/CvIE?= =?iso-8859-1?Q?rGMWKYuKts+nuJzGVfyiezddmQn42HgcMZgom+I7iQDBuJGlUApm4JEEkv?= =?iso-8859-1?Q?+Y+dLliEGXjufWGhWnCChd216vZlPXJq800W3GxLnBIfttBOFdscZN+F21?= =?iso-8859-1?Q?+yjpj4av4wAd7xsAsJYEWVGBI8OlxLGWuU625GUen7V0V3yG++atG8c2ea?= =?iso-8859-1?Q?7q9BhZ7DFjNFPXWXDey2uhhrB+ZIF91leGlvjf13svg40yP7waZXo3KxI2?= =?iso-8859-1?Q?TG13LhhC1Pk2CXpUAQX5i83Q0stLhO9XWF2Qt0XD8OxtsOzSU7Un5s7MZ3?= =?iso-8859-1?Q?vNpCoL/Gt9p+cdr7f93CJK9H2NNCvM3EWn8GitlDWwfKbq9gjKcWA1Y+PA?= =?iso-8859-1?Q?QRV25XTiozb693y+ltdp+f6m5X8IBKwSiFxgQCKDnHU5/mnvqQ+5cjrh2Y?= =?iso-8859-1?Q?Kb8GmOQh5GL1Li15P0FZ4aeka6H7qwLT0D44An1M9PM16We2U6N7Hc1oOP?= =?iso-8859-1?Q?b/9iLm7PdJzMzCnvr/6uLHBvrcfWX0vjaswRajsmTz8V+VGvPJ5xNus2AL?= =?iso-8859-1?Q?PvEFE5n8mOPO5Ty6LnIBYrt4P3KO9iKVOEWjLvh3wcLnpAy/w4OAY2KEak?= =?iso-8859-1?Q?sXblAThg4jVmQL1nilzRzkGoQtrAY6eWw2cvJfV7xaGFqNm3V0KM9yQM4R?= =?iso-8859-1?Q?MC98U5RCSijB3lmBiXj/RNHUFiN1gwS0QBjjX3vwVQz40rdDv4hiOVk+nE?= =?iso-8859-1?Q?ED8E7jemPQu3NbotvBMrLB8DdjONPcACg/O0P8pftcWRFvgg0tnaUWzyn8?= =?iso-8859-1?Q?h0pCYD/wqIUETZUkqVqhMmMOuNPtGFyRTnsRvMx3n?= X-Microsoft-Antispam-Message-Info: q694NlNYclc5kYgb5lmk+oi/J/kZOTYUCjUxUtaw+PRk6GPLBrQFqSZW1Ga6V6+N8zeTGwmjtQLE9rtGa/NKiIsUvpxsZ+RuK8YudGFWYf1ntyeZ/kJe+Kvzdl/hKzMvTR4SWnFPPBuWGR9WUjcV+Xndhdo+BTLKx572TxSj8GzmhGkYvRkB9OPLeNtJVBbD X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3459; 6:dQaLND5KBLF65+Pvi9XW5dfHRx+eDvlH14bxcNGuxkSqDkzjT5WG64NNNAWeO0Ed52+oI0WTl5NdM4AAA8i2qfr5AAVcCU4i9nPATj5ck80/BzcP5W6OxT6N2Zzu5IlCIKjn7Ny8mFN/9nKl9lRlLXQsOlNDeF2KPYejX0a1l3/yhCCrAB691wYlhkLtc+1NEuQv19XuafLtKZJ8YYSiMEBEU4HlGXhqT2gkBP+KLKNBUs/Q3O4ukHha82ugQkFJt3q6ixrFlP6pTLEwRjdtqJc66OSlfkbyIqamIo2J2qiT/UUKbeCD8fhQ/RAg+5bYS6qH5HipDiNDXVIL7yhsGe532LXuBe2alwZN/Ya6ZhQ=; 5:C/zWgBtb2MYsZLiSfwTf3iWmMQ6x6VvYpAfbVwu1IqSxa1X1jEfPF4C1sO7eBzMIYbLGU6+qCu74WNFIPNpvxcgXRWDDnZ54esiG1RfSSvrJofEtnRBC2+wBihMKYf3v7NAB8XoEIH8JRJOpeiWzTvzEbBocyuqQzbOb87OtXMU=; 24:nAcC9RSl66ODixSYWHnnCUPE3i+TeDxb+k3UAnbVKNySvmznb8yyTLs4R/cyHlDQ+LwiGCClzt9Xf9pD9Aug2pZ5Nky4ckSZxPwSeWIHpPo=; 7:r5LAgPOt8v14QK9XT3lJn+OmMLzBcs1lIDp/QiedWtrUC+AMtmSa9zsMkQOXRLh+h/0tUc0Wt7JV7e8FLH9G7X4NazJxzjXrYEg8UMIsZZ/ZLjp4pTZyZ6cx/ZRLSBPjPcav2w1YlmNEaG2kKsvJcwI9LY2yM1b3kfm/DB0TujIXqkTANcwKa781P/TNatdPJ38e6gSID9hN6oGZXrSIEAK8OAJHBU7srZcuWDlVtVR2isOXR7C7d8k4uetQhx3Q SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Mar 2018 09:16:01.1857 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: b59cdf62-f775-4f61-f2fc-08d5859e663d X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 711e4ccf-2e9b-4bcf-a551-4094005b6194 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR07MB3459 Subject: Re: [dpdk-dev] [PATCH v2 00/41] Memory Hotplug for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Mar 2018 09:16:15 -0000 On Thu, Mar 08, 2018 at 08:33:21PM +0000, Burakov, Anatoly wrote: > On 08-Mar-18 8:11 PM, Burakov, Anatoly wrote: > > On 08-Mar-18 2:36 PM, Burakov, Anatoly wrote: > > > On 08-Mar-18 1:36 PM, Pavan Nikhilesh wrote: > > > > Hi Anatoly, > > > > > > > > We are currently facing issues with running testpmd on thunderx > > > > platform. > > > > The issue seems to be with vfio > > > > > > > > EAL: Detected 24 lcore(s) > > > > EAL: Detected 1 NUMA nodes > > > > EAL: No free hugepages reported in hugepages-2048kB > > > > EAL: Multi-process socket /var/run/.rte_unix > > > > EAL: Probing VFIO support... > > > > EAL: VFIO support initialized > > > > EAL:   VFIO support not initialized > > > > > > > > > > > > > > > > EAL:   probe driver: 177d:a053 octeontx_fpavf > > > > EAL: PCI device 0001:01:00.1 on NUMA socket 0 > > > > EAL:   probe driver: 177d:a034 net_thunderx > > > > EAL:   using IOMMU type 1 (Type 1) > > > > EAL:   cannot set up DMA remapping, error 22 (Invalid argument) > > > > EAL:   0001:01:00.1 DMA remapping failed, error 22 (Invalid argument) > > > > EAL: Requested device 0001:01:00.1 cannot be used > > > > EAL: PCI device 0001:01:00.2 on NUMA socket 0 > > > > > > > > testpmd: No probed ethernet devices > > > > testpmd: create a new mbuf pool : n=251456, > > > > size=2176, socket=0 > > > > testpmd: preferred mempool ops selected: ring_mp_mc > > > > EAL:   VFIO support not initialized > > > > EAL:   VFIO support not initialized > > > > EAL:   VFIO support not initialized > > > > Done > > > > > > > > > > > > This is because rte_service_init() calls rte_calloc() before > > > > rte_bus_probe() and vfio_dma_mem_map fails because iommu type is > > > > not set. > > > > > > > > Call stack: > > > > gdb) bt > > > > #0  vfio_dma_mem_map (vaddr=281439006359552, iova=11274289152, > > > > len=536870912, do_map=1) at > > > > /root/clean/dpdk/lib/librte_eal/linuxapp/eal/eal_vfio.c:967 > > > > #1  0x00000000004fd974 in rte_vfio_dma_map > > > > (vaddr=281439006359552, iova=11274289152, len=536870912) at > > > > /root/clean/dpdk/lib/librte_eal/linuxapp/eal/eal_vfio.c:988 > > > > #2  0x00000000004fbe78 in vfio_mem_event_callback > > > > (type=RTE_MEM_EVENT_ALLOC, addr=0xfff7a0000000, len=536870912) > > > > at /root/clean/dpdk/lib/librte_eal/linuxapp/eal/eal_vfio.c:240 > > > > #3  0x00000000005070ac in eal_memalloc_notify > > > > (event=RTE_MEM_EVENT_ALLOC, start=0xfff7a0000000, len=536870912) > > > > at > > > > /root/clean/dpdk/lib/librte_eal/common/eal_common_memalloc.c:177 > > > > #4  0x0000000000515c98 in try_expand_heap_primary > > > > (heap=0xffffb7fb167c, pg_sz=536870912, elt_size=8192, socket=0, > > > > flags=0, align=128, bound=0, contig=false) at > > > > /root/clean/dpdk/lib/librte_eal/common/malloc_heap.c:247 > > > > #5  0x0000000000515e94 in try_expand_heap (heap=0xffffb7fb167c, > > > > pg_sz=536870912, elt_size=8192, socket=0, flags=0, align=128, > > > > bound=0, contig=false) at > > > > /root/clean/dpdk/lib/librte_eal/common/malloc_heap.c:327 > > > > #6  0x00000000005163a0 in alloc_more_mem_on_socket > > > > (heap=0xffffb7fb167c, size=8192, socket=0, flags=0, align=128, > > > > bound=0, contig=false) at > > > > /root/clean/dpdk/lib/librte_eal/common/malloc_heap.c:455 > > > > #7  0x0000000000516514 in heap_alloc_on_socket (type=0x85bf90 > > > > "rte_services", size=8192, socket=0, flags=0, align=128, > > > > bound=0, contig=false) at > > > > /root/clean/dpdk/lib/librte_eal/common/malloc_heap.c:491 > > > > #8  0x0000000000516664 in malloc_heap_alloc (type=0x85bf90 > > > > "rte_services", size=8192, socket_arg=-1, flags=0, align=128, > > > > bound=0, contig=false) at > > > > /root/clean/dpdk/lib/librte_eal/common/malloc_heap.c:527 > > > > #9  0x0000000000513b54 in rte_malloc_socket (type=0x85bf90 > > > > "rte_services", size=8192, align=128, socket_arg=-1) at > > > > /root/clean/dpdk/lib/librte_eal/common/rte_malloc.c:54 > > > > #10 0x0000000000513bc8 in rte_zmalloc_socket (type=0x85bf90 > > > > "rte_services", size=8192, align=128, socket=-1) at > > > > /root/clean/dpdk/lib/librte_eal/common/rte_malloc.c:72 > > > > #11 0x0000000000513c00 in rte_zmalloc (type=0x85bf90 > > > > "rte_services", size=8192, align=128) at > > > > /root/clean/dpdk/lib/librte_eal/common/rte_malloc.c:81 > > > > #12 0x0000000000513c90 in rte_calloc (type=0x85bf90 > > > > "rte_services", num=64, size=128, align=128) at > > > > /root/clean/dpdk/lib/librte_eal/common/rte_malloc.c:99 > > > > #13 0x0000000000518cec in rte_service_init () at > > > > /root/clean/dpdk/lib/librte_eal/common/rte_service.c:81 > > > > #14 0x00000000004f55f4 in rte_eal_init (argc=3, > > > > argv=0xfffffffff488) at > > > > /root/clean/dpdk/lib/librte_eal/linuxapp/eal/eal.c:959 > > > > #15 0x000000000045af5c in main (argc=3, argv=0xfffffffff488) at > > > > /root/clean/dpdk/app/test-pmd/testpmd.c:2483 > > > > > > > > > > > > Also, I have tried running with --legacy-mem but I'm stuck in > > > > `pci_find_max_end_va` loop  because `rte_fbarray_find_next_used` > > > > always return > > > > 0. > > > > > HugePages_Total:      15 > > > > HugePages_Free:       11 > > > > HugePages_Rsvd:        0 > > > > HugePages_Surp:        0 > > > > Hugepagesize:     524288 kB > > > > > > > > Call Stack: > > > > (gdb) bt > > > > #0  find_next (arr=0xffffb7fb009c, start=0, used=true) at > > > > /root/clean/dpdk/lib/librte_eal/common/eal_common_fbarray.c:248 > > > > #1  0x00000000005132a8 in rte_fbarray_find_next_used > > > > (arr=0xffffb7fb009c, start=0) at > > > > /root/clean/dpdk/lib/librte_eal/common/eal_common_fbarray.c:700 > > > > #2  0x000000000052d030 in pci_find_max_end_va () at > > > > /root/clean/dpdk/drivers/bus/pci/linux/pci.c:138 > > > > #3  0x0000000000530ab8 in pci_vfio_map_resource_primary > > > > (dev=0xeae700) at > > > > /root/clean/dpdk/drivers/bus/pci/linux/pci_vfio.c:499 > > > > #4  0x0000000000530ffc in pci_vfio_map_resource (dev=0xeae700) > > > > at /root/clean/dpdk/drivers/bus/pci/linux/pci_vfio.c:601 > > > > #5  0x000000000052ce90 in rte_pci_map_device (dev=0xeae700) at > > > > /root/clean/dpdk/drivers/bus/pci/linux/pci.c:75 > > > > #6  0x0000000000531a20 in rte_pci_probe_one_driver (dr=0x997e20 > > > > , dev=0xeae700) at > > > > /root/clean/dpdk/drivers/bus/pci/pci_common.c:164 > > > > #7  0x0000000000531c68 in pci_probe_all_drivers (dev=0xeae700) > > > > at /root/clean/dpdk/drivers/bus/pci/pci_common.c:249 > > > > #8  0x0000000000531f68 in rte_pci_probe () at > > > > /root/clean/dpdk/drivers/bus/pci/pci_common.c:359 > > > > #9  0x000000000050a140 in rte_bus_probe () at > > > > /root/clean/dpdk/lib/librte_eal/common/eal_common_bus.c:98 > > > > #10 0x00000000004f55f4 in rte_eal_init (argc=1, > > > > argv=0xfffffffff498) at > > > > /root/clean/dpdk/lib/librte_eal/linuxapp/eal/eal.c:967 > > > > #11 0x000000000045af5c in main (argc=1, argv=0xfffffffff498) at > > > > /root/clean/dpdk/app/test-pmd/testpmd.c:2483 > > > > > > > > Am I missing something here? > > > > > > I'll look into those, thanks! > > > > > > Btw, i've now set up a github repo with the patchset applied: > > > > > > https://github.com/anatolyburakov/dpdk > > > > > > I will be pushing quick fixes there before spinning new revisions, > > > so we can discover and fix bugs more rapidly. I'll fix compile > > > issues reported earlier, then i'll take a look at your issues. The > > > latter one seems like a typo, the former is probably a matter of > > > moving things around a bit. > > > > > > (also, pull requests welcome if you find it easier to fix things > > > yourself and submit patches against my tree!) > > > > > > Thanks for testing. > > > > > > > I've looked into the failures. > > > > The VFIO one is not actually a failure. It only prints out errors > > because rte_malloc is called before VFIO is initialized. However, once > > VFIO *is* initialized, all of that memory would be added to VFIO, so > > these error messages are harmless. Regardless, i've added a check to see > > if init is finished before printing out those errors, so they won't be > > printed out any more. > > > > Second one is a typo on my part that got lost in one of the rebases. > > > > I've pushed fixes for both into the github repo. > > > > Although i do wonder where do the DMA remapping errors come from. The error > message says "invalid argument", so that doesn't come from rte_service or > anything to do with rte_malloc - this is us not providing valid arguments to > VFIO. I'm not seeing these errors on my system. I'll check on others to be > sure. I have taken a look at the github tree the issues with VFIO are gone, Although compilation issues with dpaa/dpaa2 are still present due to their dependency on `rte_eal_get_physmem_layout`. > > -- > Thanks, > Anatoly Thanks, Pavan