From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01on0088.outbound.protection.outlook.com [104.47.2.88]) by dpdk.org (Postfix) with ESMTP id 0C6BB2C12 for ; Wed, 21 Mar 2018 14:46:33 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=7WwyKpAXGUlLF8G5RV1qLVTKZa/UPT9gcaeqyQuuGBo=; b=EIHGJ06Hi+W0sMKwLuov2RGku+h1PZQeXWuItRl+tlmlDNex4Z7GK8iJogPawkUtOev7Hf2n8n4kArZgA6zeULqGyfybbB1oyjZKxY4Iv4fhk7n91DJ2BQVyzRQACa+voW3OuwFMIe77SJ+CszERrKo3u31JyF/KL6q9JnhYYG0= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shreyansh.jain@nxp.com; Received: from mail-wm0-f50.google.com (74.125.82.50) by DB6PR0402MB2775.eurprd04.prod.outlook.com (2603:10a6:4:96::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.588.14; Wed, 21 Mar 2018 13:46:31 +0000 Received: by mail-wm0-f50.google.com with SMTP id l16so9957720wmh.3 for ; Wed, 21 Mar 2018 06:46:31 -0700 (PDT) X-Gm-Message-State: AElRT7GSPPUXmPiquP4PbsKNLYvP9aB05Xqm6emOD4ZnypMiZhl2DM3x OPDc9NV7CLWl1NvNw+bqV7aWUl4q57Sk3GdQtF4= X-Google-Smtp-Source: AG47ELtiJkftrbvFiN11LYg4CN5/ErXSMfDeaUGWtUn6R4+yG/zaGfpf2VAFc95TtO3jMvboWp+PU1ObEH+3B1kiAJU= X-Received: by 10.28.13.142 with SMTP id 136mr2949723wmn.95.1521639987452; Wed, 21 Mar 2018 06:46:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.28.50.67 with HTTP; Wed, 21 Mar 2018 06:45:57 -0700 (PDT) In-Reply-To: References: <20180308101805.GA9526@ltp-pvn> <20180308111337.GA11638@ltp-pvn> <20180308133612.GA16647@ltp-pvn> <57c18da9-7377-3c0b-4aa2-9b97ef206f4f@intel.com> <55a2a182-27d5-b59a-0993-5b988f041e98@intel.com> <20180309091513.GA5781@ltp-pvn> From: Shreyansh Jain Date: Wed, 21 Mar 2018 19:15:57 +0530 X-Gmail-Original-Message-ID: Message-ID: To: "Burakov, Anatoly" Cc: dev@dpdk.org, Hemant Agrawal Content-Type: text/plain; charset="UTF-8" X-Originating-IP: [74.125.82.50] X-ClientProxiedBy: VI1PR0601CA0027.eurprd06.prod.outlook.com (2603:10a6:800:1e::37) To DB6PR0402MB2775.eurprd04.prod.outlook.com (2603:10a6:4:96::12) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 972685ea-1517-4632-c3e9-08d58f3227af X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(48565401081)(5600026)(4604075)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:DB6PR0402MB2775; X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2775; 3:54Q+3b3pGk/kuEUkjcOA6Ig/4JHQIbPpdOAAZ9PRE0XotmvvnO5Yfr9T21Ovw/XpGaAmh3QNH4P33P7hTh5BqKKP4oUKizYkSCmPaGHaVLovZk4ppXKPna4Ln9y7I9lyKC8/FiWtd3nFNP5ijSLzvgrKRbnKPFc/Vvra3pBNF1gcGbEGIYNVenqmABnCtIKXZ6d9bPg3DY13Prk1McDlEF7w1pJ0WoAK4VjhIzt794x5eCLuno51NKqbU3E6tcWO; 25:mIb4V2+S/jhnX73JXxyMFX2Vaa3sUSB5WIdP76+uvemBs6TaC+A/6I+bhuKmARc7geoAzwXCQQ7Ld/KQmy/7j065xFmWUSxfXHTQWNAc36wEDdrA3jSrgIRlop9Yd6b1e6ndQVWJ7D8Aiz/+hAatvsPVMIsauM4SEB2hS3FtSfppKAGwxIrmliky4yx4SVUMSOZ7ZENxWec/4R3hdEjiYH0kM1+byv+umTO5XA1pK8EW5KYsiIyFWqF70lzTKlNs0oeL9xo3SgHTfO4EHX96sFerNsM3z6yOyFiGUHY8lCeh2ia16ecFcKi0isJuFBNog4J2WsDg0XXomlFw9NnL2g==; 31:/VWhQutEPH+qVnABCkltKB5dRRJ2uFH42x8unnFomukFONfHg3oT18ZLxQb4sL/xQufYRPl4xNl5SePicZKSbrvpVm24HNK0UNciE4wacacTzxgW9wJMwS6gziM8CNUm7OG6Y9lg+UPM6BDzvftO66QEmCN41J7D8eBvG13HbEBqxAjBtdK/cZq2pRU0uAvSvbslOCPB0Py/z03boixDW+nZQn5TqeVTRjrjmTZYHTg= X-MS-TrafficTypeDiagnostic: DB6PR0402MB2775: X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2775; 20:CkHxtAQXr7a7MrWY5PYEJyd2u6pbosHyBVgE9i9k9Sm9lX3iw3YVizPT1dBP/MYMrdo3bm6g6lztTKlw0tgLAngw0NywPYdHbJMp5xvmlYNczAEDYqJa6jOgbChz4i5CiWOB+QjKL7oS0r6UQF7IcjdcyfFr2s3YNn6yovkt7buwkrfKhYFU9x9UjOSiiGNrALhuA1T6gxHOpf7T0/WmnEnBE094hER5sOr6OYvQNk5eT+Up397QDAkx0k0XpWknMHWW91Rvkvfsmy/pFRNWBTFITI6HegPwMhB10fSifDn+Ondy0uMFgHwJthLcZrn4flF5xaHqyOxnSw2l5Lk0dpVEH0u1/unG1YVZnXiKg9Qu6ayOq6hABlGv1vdYR73HXH8rO8hyG3TN8JLw5bpi9ECadzHrEsb99sGezBpaUY8bVYIKVuslrQabCwPRL0tf6fnpsOeki0TybykrBSdVLkNQWr3VKeTtsxCQVQmOng9x3rNkBYGEGwSNTj21IRy9; 4:uLS543vjwlDM7HgMf/BGX6JezcxBvbJKrzUIFXQRsQwYtpspc4xUf6dZsil67K9dpWHlfkuc6Rqlrw4hAy4z3VLH+tUzaLatM1XSqJMo9S5c36T9fctJOqAcf3HZtgup0U7Mg7MTzxCjWqVrKsp1oFkc5XY63f9E8o4S4BdL0sfspQfd2py4Tx6L8P93dZCu8DHCu2E3pzbDdpjsc2TmSYiy9gkG2ucPfydFJ7CKilpOrrwDnv4i3zw6LTqRDV2t9gM7jklqsNuBEEFVuhhXsdJ89NsajgHlTDmkNPmvf1OAb1SB1IimRnFKvy92TZPa1Wqs3eNyXIeOGkzUbusNlDnJBWhqtgpEcLkFMewbMyK5Mz0YLhrtws8TwEW8uhyS X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(190756311086443)(185117386973197)(228905959029699); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(3002001)(10201501046)(3231221)(944501323)(52105095)(93006095)(93001095)(6055026)(6041310)(20161123562045)(20161123558120)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011); SRVR:DB6PR0402MB2775; BCL:0; PCL:0; RULEID:; SRVR:DB6PR0402MB2775; X-Forefront-PRVS: 0618E4E7E1 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(39380400002)(366004)(346002)(376002)(39860400002)(396003)(189003)(199004)(50834003)(42186006)(105586002)(5820100001)(50466002)(966005)(186003)(6116002)(3846002)(2906002)(61726006)(6246003)(53936002)(122856001)(478600001)(86362001)(53376002)(114624004)(97736004)(106356001)(52116002)(8936002)(6306002)(9686003)(23676004)(59450400001)(9896002)(55446002)(305945005)(93516011)(7736002)(76176011)(81166006)(2950100002)(229853002)(33896004)(81156014)(5660300001)(95326003)(8676002)(6862004)(16586007)(26005)(53546011)(316002)(69596002)(93886005)(4326008)(61266001)(68736007)(47776003)(498394004)(386003)(55236004)(66066001)(98316002)(55456009); DIR:OUT; SFP:1101; SCL:1; SRVR:DB6PR0402MB2775; H:mail-wm0-f50.google.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: nxp.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtEQjZQUjA0MDJNQjI3NzU7MjM6cTRhbVFrNWgrdmVxL0o4ZGl6Q2FiNUpr?= =?utf-8?B?N2VDcmkwT1g0V1V1VGxOek4vTnREbjBNWXgwMzlVSW9KNXc5WmhHa09nZ3BB?= =?utf-8?B?dVJ6elk5N2NlRHE2VnllOTNQZGVlT1NYeTh2ODB3bEtsY1dmWWdSdDVIZTIv?= =?utf-8?B?cWZpSSttNlExQWp1bzdGVU9iNGJ3aENHNVh0ZzRLL3hkTlRDcDNKTHIycW53?= =?utf-8?B?bjdMRUlGVXpzSTFkYjlxNzJvS25lL25yY3pHTzdyL0VtakpyMWI3RlErMS9u?= =?utf-8?B?QWlaTFZTK1Z1d1NsU244RDFTOUtaRlRqMnJEdmYySWk3NEJGaDI3eVRiRFRM?= =?utf-8?B?VFhaV3hNZVp3QWZtU0hCZW5GMzFjTG94L09EaksvaDdjSUNsSytUaWRGVzF1?= =?utf-8?B?aFovb1ZyUmZkRGsrQlJjeFNBNlRYYTNNM3ZTVmRLNW95VkVhb1hMOWhuUG1j?= =?utf-8?B?dURLVStIck9QbEpWZXBDWmNxaDZtS1lLeUNlVFU2enIwaStaT3YyTkpJMUNl?= =?utf-8?B?SFJ0cFNqa1k0RDN6L3hNZXMySWdRTnB5Z1ovQ29FMTRlL2VUenJRVDYzaXRB?= =?utf-8?B?d2F3L0xoUWZDdXVUa0FMemFDU2c3RzVvb0J0dG14VmdBT0lOdmVVWlRkdnB3?= =?utf-8?B?OXdhVjNXd2laa2p1Q1I5R25QTkNrUTNUaVh2bmpITmpRaDh6ZmZmVkt4N21k?= =?utf-8?B?M0RtSWR1NnpuU0xWcWpFMEtSTk1JM01TOTdyTHNjdEVNQUtpUVpmMzJNWGFo?= =?utf-8?B?SlZubHhId1ErUFJFdlFNZlkyK2RCd0JkRDEyVTJ1NmZNbkM0Y1kxdElnOEdt?= =?utf-8?B?djEwR0I3UFVjazJ5ZHNlWGxSTXlCSU5Rb2xkazVSVkRLUndiZHk1VDUxcEkr?= =?utf-8?B?ZFAzM0hudVNmRkhYN3hEaG4vYUFFMjh0Yk1CN21Sd1VtK0QrSjFLekxQaHZz?= =?utf-8?B?WU9yblRzWUFpYWErb3VodUVzaDlWa2RlSUVGRU12R1c2S3J0Qytzc0s1TlRw?= =?utf-8?B?WHY3cG1ZaFZGbzlDY0R1c1lmamxrMWx6R3pCQjRVL3pxMGU4T01uVEcxbVhQ?= =?utf-8?B?UEdJSGNnZlMycXFJS3VUeTkxaVd0WEQrR21Hb3VJb1ZNdlA2b1hweTlTaGY2?= =?utf-8?B?RVdONjgzZHpBK21nQlVPcUVOdTc1NllFYTJSczdnOHF2YVp3bDhTTG8reXlM?= =?utf-8?B?WEJoamF1c3hRMUE2OG5lSzBUMkV4MmtYVlFIUEN5STB3M2ozN3RVOVFZd1Bp?= =?utf-8?B?b2dzR3B4ajdvVllWb0JvNFdTRmNNQk1qWTQwZldmalpZNXZPVEJTSVRjZVBp?= =?utf-8?B?TXl6WGJIcElNOExFYkJWQWZSaDAyWSs0QjV3eHBnZFdNdHJ6K2ZoajJLTksr?= =?utf-8?B?Q3g5bkE1ai8wMEIrQncyZDVPdEp0ZGxuT0hqK24xNko2YmcwUW5mWHJxUTNt?= =?utf-8?B?TisrcnlCTUdDSUl0MXJwTzl2ZVlCWExhSEVMWmk3WHlIb3U5aTg5Ny9OSHRD?= =?utf-8?B?ZnlKY0Znd2M2U1B6QTA3VXB4ZVg0WWd1M1FMbUNjNTNOM1RncmhkMldBamVG?= =?utf-8?B?OE5ZdERoakYyS0tkcG9ZQkk5MDBRYUZqSjBaWk9ma01NbmNEUmYwUEpMRGhD?= =?utf-8?B?eWIyNlhzdmwzMENISlBxNVREVXJEWFFsbmd4L1FrNmprQXZzd1p6ekh0S1VW?= =?utf-8?B?b3JrbHIzdFd1eHNTQTcwcS94NEVWL0VMR2x0NWllUnZEeXpKYWxObmYxRHF4?= =?utf-8?B?VDhYSE52KzJZZHVYdlFoTldNV0hWY1JzS1hWcW5QbUVWODV6Vm12N3dhQU5k?= =?utf-8?B?eTloVmVzOHEyZHdWN2J1azFQYng3ajRMWkJzQXhqdVllVnJWbTNWT0REbVVj?= =?utf-8?B?TlR1S2ZRdFdUa3FBRXlSUGxxRUFyRXhwdTJqbnZnTzJibjNBWVZEWFp3aEM1?= =?utf-8?B?RFNEMHJmRzNyaitORHBjcjFQSjVzNGVlUXFDTnpXMTNkL2ZWMFowMmhleGI0?= =?utf-8?B?QjRYNi9JWFdZeTZDRWs4Rm1QR2xTSjUxYlROSHNnPT0=?= X-Microsoft-Antispam-Message-Info: JyKKYfzSWEWBT5kXOz5T8+uWZjp7z8O8RFmssZ36AM9gMn+e9clSsN5xDRKNBteyqSwv1b5/fSUYQZAD9X4LxnRl5jeGEDVaoGL8Qb0jOdNk+GjpI3iXMKhdfecn0usdlYLJVfg729AmYFVJ2BwHnZwDPPhdrU81g1zrGnAJ5Hodf2k4XdN6VX1sXilP31ni X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2775; 6:e1R1t4HkslGIdKUbsVdH4HWtVAQ7EOgsicbyzAVM9tq1GA8gAVfteODJZ0bYRN7JECN6kaE6Z0wgrlu5KOqAEQxufnkSpAFbvfK8YNRS3YAX630Zi81OzwQ86yj/qGm5R8Yu1l6T8PS+HP6YHMXXHEHuMUO4yMb0PMlxV9rszMefkN+8p91vBm9Q1UP86/mDXn3Z7ZsPG5VWjtoGGG4cQP5vA41Rj5HvdW71Sd86z2HhKN+T23Pbk5B/F3d2JWPnc02+pEl0NnNZYS9ALLvh52DALqN13SmGANVngZYn6oeoXqB5PfszvOqEWPn7Etc5hEJ0Gkt43QAWZY15uTgYol6i9MFuoWHj6TTrryjzLb8=; 5:mj3ZXJagdlBb9dJATDA8IwPbxnJfOU4QMK3HjVEK9Ok0kYpmjhI09E/1HHmZtnopkGpC0hOR5kZsIUbVdENI9pKnWKlvgSOv51ERnlf9HCTLx6pB69O+9vsvnV0FwOkmQn9JjgJ0FEx2bpzUIbIik7mzpnjR6VPHCFV85IZFIdw=; 24:JdEiIPorRkMGHbscriXV/Bbce7QztpNM7noyt62LYr1lftKiJTVNJIYYzOxmkBkleCx7WH9FtAcW+TisW9AqgBsnVK3HgA0ewwcc7YrnUt4=; 7:94i10HyEzFjGvb+7VwnEbtGfu3lV+ooapttBeIyrCoICP5VBrlk1o7fjT+fHxyriQ1t2+lCSKg9OdSf5Shi2Ah1xnUnA6LP7EW4tAvsamo0iudn1N3xaAvCRHjknbF1im5xJhPKmL55+Etmn5OJsQrkSFKgNkZvMi6FcPnzgMehR7t58Sdm+S8/uSMAfLfSjAC5wIyPDkSgjGq5S0WErWzAh1pEWVnefI2ZpPKTApHpwD0LWn0uXvFGULwXBnGHm SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Mar 2018 13:46:31.9604 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 972685ea-1517-4632-c3e9-08d58f3227af X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0402MB2775 Subject: Re: [dpdk-dev] [PATCH v2 00/41] Memory Hotplug for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 21 Mar 2018 13:46:33 -0000 Hello Anatoly, This is not necessarily right chain to reply to, but reusing this email for another issue in DPAA2 so that all issues can be at a single place. On Thu, Mar 15, 2018 at 7:31 PM, Shreyansh Jain wrote: > Hello Anatoly, > > On Tue, Mar 13, 2018 at 10:47 AM, Shreyansh Jain wrote: >> Hello Anatoly, >> >> On Fri, Mar 9, 2018 at 4:12 PM, Burakov, Anatoly >> wrote: >>> On 09-Mar-18 9:15 AM, Pavan Nikhilesh wrote: >> >> [...] >> >>>> >>>> >>>> I have taken a look at the github tree the issues with VFIO are gone, >>>> Although >>>> compilation issues with dpaa/dpaa2 are still present due to their >>>> dependency on >>>> `rte_eal_get_physmem_layout`. >>> >>> >>> I've fixed the dpaa compile issue and pushed it to github. I've tried to >>> keep the semantics the same as before, but i can't compile-test (let alone >>> test-test) them as i don't have access to a system with dpaa bus. >> >> Thanks. I will have a look at this. > > Just a heads-up, DPAA2 is broken on top-of-tree (github: > 784e041f6b520) as of now: > > --->8--- > root@ls2088ardb:~/shreyansh/07_dpdk_memory# > ./arm64-dpaa2-linuxapp-gcc/app/testpmd -c 0xE -n 1 --log-level=eal,8 > --log-level=mem,8 -- -i --portmask=0x3 > EAL: Detected lcore 0 as core 0 on socket 0 > EAL: Detected lcore 1 as core 1 on socket 0 > EAL: Detected lcore 2 as core 0 on socket 0 > EAL: Detected lcore 3 as core 1 on socket 0 > EAL: Detected lcore 4 as core 0 on socket 0 > EAL: Detected lcore 5 as core 1 on socket 0 > EAL: Detected lcore 6 as core 0 on socket 0 > EAL: Detected lcore 7 as core 1 on socket 0 > EAL: Support maximum 16 logical core(s) by configuration. > EAL: Detected 8 lcore(s) > EAL: Detected 1 NUMA nodes > EAL: VFIO PCI modules not loaded > EAL: DPAA Bus not present. Skipping. > EAL: Container: dprc.2 has VFIO iommu group id = 4 > EAL: fslmc: Bus scan completed > EAL: Module /sys/module/rte_kni not found! error 2 (No such file or directory) > EAL: Multi-process socket /var/run/.rte_unix > EAL: Probing VFIO support... > EAL: IOMMU type 1 (Type 1) is supported > EAL: IOMMU type 7 (sPAPR) is not supported > EAL: IOMMU type 8 (No-IOMMU) is not supported > EAL: VFIO support initialized > EAL: Mem event callback 'vfio_mem_event_clb' registered > EAL: Ask a virtual area of 0x2e000 bytes > EAL: Virtual area found at 0xffff86cae000 (size = 0x2e000) > EAL: Setting up physically contiguous memory... > EAL: Ask a virtual area of 0x1000 bytes > EAL: Virtual area found at 0xffff8873f000 (size = 0x1000) > EAL: Memseg list allocated: 0x100000kB at socket 0 > EAL: Ask a virtual area of 0x800000000 bytes > EAL: Virtual area found at 0xfff780000000 (size = 0x800000000) > EAL: Ask a virtual area of 0x1000 bytes > EAL: Virtual area found at 0xffff8873e000 (size = 0x1000) > EAL: Memseg list allocated: 0x100000kB at socket 0 > EAL: Ask a virtual area of 0x800000000 bytes > EAL: Virtual area found at 0xffef40000000 (size = 0x800000000) > EAL: Ask a virtual area of 0x1000 bytes > EAL: Virtual area found at 0xffff8873d000 (size = 0x1000) > EAL: Memseg list allocated: 0x100000kB at socket 0 > EAL: Ask a virtual area of 0x800000000 bytes > EAL: Virtual area found at 0xffe700000000 (size = 0x800000000) > EAL: Ask a virtual area of 0x1000 bytes > EAL: Virtual area found at 0xffff8873c000 (size = 0x1000) > EAL: Memseg list allocated: 0x100000kB at socket 0 > EAL: Ask a virtual area of 0x800000000 bytes > EAL: Virtual area found at 0xffdec0000000 (size = 0x800000000) > EAL: TSC frequency is ~25000 KHz > EAL: Master lcore 1 is ready (tid=88742110;cpuset=[1]) > EAL: lcore 3 is ready (tid=85cab910;cpuset=[3]) > EAL: lcore 2 is ready (tid=864ab910;cpuset=[2]) > EAL: eal_memalloc_alloc_page_bulk(): couldn't find suitable memseg_list > error allocating rte services array > EAL: FATAL: rte_service_init() failed > > EAL: rte_service_init() failed > > PANIC in main(): > Cannot init EAL > 1: [./arm64-dpaa2-linuxapp-gcc/app/testpmd(rte_dump_stack+0x38) [0x4f37a8]] > Aborted > --->8-- > > Above is an initial output - still investigating. I will keep you posted. > While working on issue reported in [1], I have found another issue which I might need you help. [1] http://dpdk.org/ml/archives/dev/2018-March/093202.html For [1], I bypassed by changing the mempool_add_elem code for time being - it now allows non-contiguous (not explicitly demanded contiguous) allocations to go through rte_mempool_populate_iova. With that, I was able to get DPAA2 working. Problem is: 1. When I am working with 1GB pages, I/O is working fine. 2. When using 2MB pages (1024 num), the initialization somewhere after VFIO layer fails. All with IOVA=VA mode. Some logs: This is the output of the virtual memory layout demanded by DPDK: --->8--- EAL: Ask a virtual area of 0x2e000 bytes EAL: Virtual area found at 0xffffb6561000 (size = 0x2e000) EAL: Setting up physically contiguous memory... EAL: Ask a virtual area of 0x59000 bytes EAL: Virtual area found at 0xffffb6508000 (size = 0x59000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0xfffbb6400000 (size = 0x400000000) EAL: Ask a virtual area of 0x59000 bytes EAL: Virtual area found at 0xfffbb62af000 (size = 0x59000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0xfff7b6200000 (size = 0x400000000) EAL: Ask a virtual area of 0x59000 bytes EAL: Virtual area found at 0xfff7b6056000 (size = 0x59000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0xfff3b6000000 (size = 0x400000000) EAL: Ask a virtual area of 0x59000 bytes EAL: Virtual area found at 0xfff3b5dfd000 (size = 0x59000) EAL: Memseg list allocated: 0x800kB at socket 0 EAL: Ask a virtual area of 0x400000000 bytes EAL: Virtual area found at 0xffefb5c00000 (size = 0x400000000) --->8--- Then, somehow VFIO mapping is able to find only a single page to map --->8--- EAL: Device (dpci.1) abstracted from VFIO EAL: -->Initial SHM Virtual ADDR FFFBB6400000 EAL: -----> DMA size 0x200000 EAL: Total 1 segments found. --->8--- Then, these logs appear probably when DPAA2 code requests for memory. I am not sure why it repeats the same '...expanded by 10MB'. --->8--- EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 2MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB EAL: Calling mem event callback vfio_mem_event_clbEAL: request: mp_malloc_sync EAL: Heap on socket 0 was expanded by 10MB LPM or EM none selected, default LPM on Initializing port 0 ... --->8--- l3fwd is stuck at this point. What I observe is that DPAA2 driver has gone ahead to register the queues (queue_setup) with hardware and the memory has either overrun (smaller than requested size mapped) or the addresses are corrupt (that is, not dma-able). (I get SMMU faults, indicating one of these cases) There is some change from you in the fslmc/fslmc_vfio.c file (rte_fslmc_vfio_dmamap()). Ideally, that code should have walked over all the available pages for mapping but that didn't happen and only a single virtual area got dma-mapped. --->8--- EAL: Device (dpci.1) abstracted from VFIO EAL: -->Initial SHM Virtual ADDR FFFBB6400000 EAL: -----> DMA size 0x200000 EAL: Total 1 segments found. --->8--- I am looking into this but if there is some hint which come to your mind, it might help. Regards, Shreyansh