From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-db5eur01hn0204.outbound.protection.outlook.com [104.47.2.204]) by dpdk.org (Postfix) with ESMTP id A76F21CBD2 for ; Thu, 5 Apr 2018 16:09:09 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=XB4xOoAeN3qI2V//fOgXl2mffvhRtr2XBb9bctwbqp0=; b=Ta3ou3I4F8vHqUPNLWozmaTm0w7s+UfsA0r1zvJ8brtkFkuM4vMhjs32fC2wRZATcbJ36RkBCuXsJ3dfEiSok9mfqzWp+c8tqY6Ab/zqhJ2ARnCtrkeFDpuPTTlgqK8CbBMlVCLSYoRKhpTGHKfO+dl+LDZ61rOK6kfT/qm6Y8Y= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shreyansh.jain@nxp.com; Received: from [10.232.14.39] (14.142.187.166) by DB6PR0402MB2773.eurprd04.prod.outlook.com (2603:10a6:4:96::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.631.10; Thu, 5 Apr 2018 14:09:04 +0000 To: Anatoly Burakov , dev@dpdk.org Cc: keith.wiles@intel.com, jianfeng.tan@intel.com, andras.kovacs@ericsson.com, laszlo.vadkeri@ericsson.com, benjamin.walker@intel.com, bruce.richardson@intel.com, thomas@monjalon.net, konstantin.ananyev@intel.com, kuralamudhan.ramakrishnan@intel.com, louise.m.daly@intel.com, nelio.laranjeiro@6wind.com, yskoh@mellanox.com, pepperjo@japf.ch, jerin.jacob@caviumnetworks.com, hemant.agrawal@nxp.com, olivier.matz@6wind.com, shreyansh.jain@nxp.com, gowrishankar.m@linux.vnet.ibm.com References: From: Shreyansh Jain Message-ID: <49bcdac0-2631-361d-c454-088c5c70f6b1@nxp.com> Date: Thu, 5 Apr 2018 19:54:18 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: [14.142.187.166] X-ClientProxiedBy: BM1PR01CA0110.INDPRD01.PROD.OUTLOOK.COM (2603:1096:b00::26) To DB6PR0402MB2773.eurprd04.prod.outlook.com (2603:10a6:4:96::10) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: 1d783a4b-c44f-4581-2dce-08d59afecbeb X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(48565401081)(5600026)(4604075)(4534165)(7168020)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:DB6PR0402MB2773; X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2773; 3:56hdc5hRgHivF7Pxc6u8No2UGSRiB8Pfnhh4Mawwd1geoXN/GiENXgT8FID22MPQQ9rLluT1UyHlgMuJjRliJZ+ovbCPBAZqa+6a37uHQNRIsTo6zmISZkdsWiIObVk2dQl93o7ToN+3ZKQhpH9wWxRXuUpzOf6hhSVcaOVZ+xGE6LSlZDTpZWGiESFQwWzAKt2F2hHtJqi2MhQWafcwUp35pxPEwL7EIcAT3SI6DCrFpenfAeTNv6Nt/oKr7+PS; 25:3D9Qmi2eJG9Aj9LNg+7HJIkYX9ZDR6PUicY3D0b0G5z9NuWRh7jYk1VcGFq1nEt5jDdxbA5npbn3uIDpypBR5rjnDUviyDia5hvjC7Uu4GzwCpgKqDw57OBYOiRizH/njR3DZawTxv6CLZc2dxmNu467CZgb8AwKK5FoaDee3WX5MSyqqfzLhfZQjpH5R5JBXWKbM3fMGGQAKQliTq5QaalrDRIzbY8mzE0zkVI3QinoBizbG4OYnhl3YN5XVgMO63Shz2vS3VGcl1S8TPXym4/dPUzY8UXVhSHJmY2KvPEujo1Pru+fZULlUVWc8/Tr3I99LqMjDcg3O2V/D/6FWw==; 31:rj1OkTkpdz4A1AJkxmjhlRLkq20FZBuqdpwuaXLoeyGpDLTeLmCTMJc2chmmU9S2ZLe2V7ZP2g6Yv0QUl6KBI7bynSSNvkM7bcf8sojNDvFEyVGMvElo5iFnrx2Knskv9vdNxhvpdMzJdfG96has90YVQN0CCFsZgcIdGp1hw+xxKk8epSWwzj+WlzVPgT/nFIbGDcs/uq1sCfslrrxzY7bDLBhp3MeMikx/Ml+qDIw= X-MS-TrafficTypeDiagnostic: DB6PR0402MB2773: X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2773; 20:kOuAmx8t0VwGZ38pmEbVyfT6r3Xpwf3lRuMQ96sWHV1j0/Q+6q1xpsBtEqt7yrhD+oigJ+C/TUAy+hLoEVGQ3nuZliIs+QM3qdnUJO0JunM7vuCaZ3S2ntZ9pIbM6kJqZLuHLzrEHmE8uRt5PXz73wpEpEnL8DoHZXSrpgAD8lJrod2z15YDhZYjdhU89Z4FoCC5MztgTd+t4tIdxgsLmM1ys0Z/Dwe5pJhZpK1VBWwFMgjZ3EPt1clxjM+5dtzSl9t4qfGUHeyJgIUz4o5TqftPilWeF1oCyWmU2bHxscucZXpQaJM4Sv5KpOqC0ThTTa3YI4fl89+1K68lwfnQfY6KwK+mOFnq453FV/gGTNwF4vrw62SjW1lHnglmfRuPuhdPRY6JkA8f554i5hnQYsCGCKGj+gIU9DJmYqdLdgTNDyFSNW+K26RMSflrkiaepNF1w4lCnJSUrcbyZIQmOHhyhEd+kTcKt0uat6yGG11JhUZIiqMAuJjpECQn8hY6; 4:7oQ0p4LZBu9z6Y3Gepqh2G4cXZPnT+uZhArL9ZTTZTLbcxITrwylUvEn8Py3XLTGw16yahhRRUinpKrt+0VxU9rb5XbcTTfH85RECmugbkZbSXnfw8gP5GDvFProeG+RD/WKSQGyKKMAwrmbd4q5WeWEgwocclVVALTssK6JlFM3r88nAdF7+V07PKK3weeu4GEVdeZJfQ9tdq4BF8+4AB89wG3KlSlM8lAqXjSxfFmNsclSI+0kd80QfIHebPSPHbn4Uoevdte5JEZpfFeVV/MTs7/Td/6dp8R44bjRXoIShf6LDE4AEonBI+hRn0+A4/40mBJ/m3KJUJ2269/PFX47miJK4A4vzbauhQTyusYV6quLs4SM0ggDCcSbgVB0 X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(166708455590820)(131327999870524)(17755550239193); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(10201501046)(3231221)(944501327)(52105095)(93006095)(93001095)(3002001)(6055026)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123558120)(20161123564045)(20161123562045)(6072148)(201708071742011); SRVR:DB6PR0402MB2773; BCL:0; PCL:0; RULEID:; SRVR:DB6PR0402MB2773; X-Forefront-PRVS: 06339BAE63 X-Forefront-Antispam-Report: SFV:SPM; SFS:(10009020)(6049001)(346002)(39860400002)(396003)(366004)(376002)(39380400002)(51914003)(199004)(189003)(50466002)(97736004)(386003)(65956001)(316002)(16576012)(4326008)(65806001)(55236004)(31686004)(25786009)(67846002)(230700001)(966005)(446003)(105586002)(64126003)(53936002)(11346002)(66066001)(486006)(81166006)(6486002)(81156014)(5660300001)(68736007)(2486003)(36756003)(23676004)(31696002)(229853002)(52146003)(6306002)(52116002)(478600001)(956004)(86362001)(6666003)(5009440100003)(7416002)(305945005)(53376002)(8676002)(7736002)(76176011)(77096007)(26005)(6246003)(186003)(16526019)(8936002)(47776003)(65826007)(3846002)(2616005)(59450400001)(6116002)(2906002)(58126008)(106356001)(476003)(533714002)(110426004); DIR:OUT; SFP:1501; SCL:5; SRVR:DB6PR0402MB2773; H:[10.232.14.39]; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; Received-SPF: None (protection.outlook.com: nxp.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtEQjZQUjA0MDJNQjI3NzM7MjM6Y2VmTC9XdkdXVnJtMjM4L1AvR2cxUWJ5?= =?utf-8?B?ek8vZ0RhRExGYVEyVWxrdFRXWXRweEZpcURpaUJmVFpJTkxlQnk1WVhOMkFt?= =?utf-8?B?b0RYR0p4cGwzTHVUMlZ1U2FxSlFadVl2VEJDNUNnenJmdHFWaW1sZCt6c1pM?= =?utf-8?B?VUw0bEZwUlBPeHB6SmZWNzh1Um9wbnFTMTFpMnMraVJIbVJZK2xSaFNBZmRT?= =?utf-8?B?ZWQrdktGM1NIMHlzRTlvUnM2QWNnVlhwQmJDZnZoYWhvUlp5UmtZbk9IUUgz?= =?utf-8?B?SHVjOWxvaDdFUTdkTzFCVTNQaUxaZUxhL3lKRTBGZmxMWnp2bkxCcE9FSkFy?= =?utf-8?B?WG95OFE0THpldjZ3eFBGcnZxLzY3YktBKzRIVGYwbW9TWHVIZC9SaUJYSkJP?= =?utf-8?B?ZGlUUzRxcjFQdXZIU3owcXpwR3RxS2tmZjhsd0ZoSm1OUUo5WU5qdFpPNzhZ?= =?utf-8?B?dFlnZVZ0Tk4xSmp1dWl0NWdLemFtK0FpZDlaYkl4YUhpSVpCb3JncEVwaXdB?= =?utf-8?B?QTBDQVVnclhWN0VLSmowZGpMUGRQZ0RzTzhsSDlvY0kveVlPLzJXdmpWZGQ4?= =?utf-8?B?NDBHcVRReTVWUjk4MytjbFVUSWM2cUNTcXdOK0JPSysybE5LenpUR0xya2dN?= =?utf-8?B?MGs2TU9WLzQvWEoyejNWbGFQL2tSdlpLZVQ2Z200dnZrZUdac2RmcHViZW53?= =?utf-8?B?SmxNZkZScU1tWVlLQUVaZFkxTHhHbnJERWxuSC8vdmNOQUFjUDNUSHgvd0lx?= =?utf-8?B?WUxoUUNGeUg1QmE0d3RBNDZnU1ZNWkNKbFBaeFA1MzVaeGp1TVRJOUlBSjA5?= =?utf-8?B?eFRRM2tPZWtNNGpsaTRXVVc4UnoySWdMSHpXWXhxN2NGK0trV3piTzF6c2JY?= =?utf-8?B?TmdwYVRUS0NNWGxwLzVwUGVkM2VJKzErYWl0bGl0YWFyV3gzQkRXdnU2bTJK?= =?utf-8?B?S1FsRW03VmxCTVBFM1AvUExjRFJIL0U5UEEvNjNuNkkwczlSSlFqOTE0NEVX?= =?utf-8?B?bmtVTXY2LzdzK0IwTzRGU0t3dk9TL0ExZW5ySGNVbFFZdGlRSzUyWmxTaW1V?= =?utf-8?B?YzBPTzMvcE1CRDNyN0JCYmp6OGZncDkwenNCa0ZLemdJS0RkckZqdnAvOUNW?= =?utf-8?B?d05RUS9tbVVqTmJyeGh2R1VFV0RiQjRtTlpISmF2SnlXWVJxSnpCaVJaWllS?= =?utf-8?B?OFVOcWlRODJMbGpsa25iOXhQYTM0bWR6VWdUenV3OXBEdVQ1UGNKcEpFMW9B?= =?utf-8?B?OGFvZk85REdwSHFVOG5uSFh4eXkvblBjRURrc0hXNE1SMVFRNjlkaGkzRUR6?= =?utf-8?B?L1AzdWhyNVYvTkJVUGJzcWtHd2dwUXBUdi9DbzZPaUVhb240V0E4NFhnYWRS?= =?utf-8?B?V25JQ0J6dzdFTFM2ZS9VeFBpNnlPSDBRaGJMa2FxV3RLMW9GTjl6MGR2NlRL?= =?utf-8?B?R0tJSHFlaWN6SHNWN0trSmVMUjdHb3Y4d2o3Y3J6TVZmS0J0Ly9jdXRPa1Ew?= =?utf-8?B?MnFIYmVXeVN4bGkxa2pua2tnZDRnVmxnSFRwcTdXOFljZXJRSGxORVpxeFl3?= =?utf-8?B?cXNFTUcvdUl3Zks1KzNxbHgrWWIxMUZPMFVvd241a3F1LzF5RGNLdmtwQ2lH?= =?utf-8?B?WFpMZ3ZheEFINkJyQkFHdjdiY0lZTzQrVmZ4MGZld1BJK25hYk9hV2JUQzBM?= =?utf-8?B?R2Z2SFpFVG4vM2w3TmJEbWg5WHNzVkpEV3MzMzdzZitGbkRoeTNNbEZ2SkN1?= =?utf-8?B?REZXRXk3K2t6V3RCcHVrOGVmSzNFSEZ0U1I5SGpHd0VObDdIb0ZZakpLd0VE?= =?utf-8?B?c25WamxBMlJmcTZYcE84ZW5sNHN3dEx3RXA0YXV4T2xnZVFLVWxVM0htS0F5?= =?utf-8?B?Tks4bk9pbjJLa05lSHByaU01Mi8ybzBiaks2Rlo4T3JpZ21MYmMrZWpyWkdX?= =?utf-8?B?MW5uU3ZhcnhkK1UyQ2cvd2RjY1BkbVVaL0NpRFF4dlNuM05XVVNGbWl3MXhs?= =?utf-8?B?MEhCZEpmOGVMVWJxdkVTMHVQRi9MdSt3N0VaY0hRcTJHbXl0Rmh5ZjRmMXNM?= =?utf-8?B?T0pJYWs3Ty9mSTdVelh3WlFaU0x1eU9FTEczMU9xV2p0Q29YVk12d0lpOHBu?= =?utf-8?B?QTgrSWlSUFJNTFRwWDVkM2dMVDE4eW16WkpzZExiaVN3a2ZPb1J0Z3lEaUZh?= =?utf-8?B?Q1diSkZoTThhaTVMWXRrZjllS05INUIxVENPdFdKa1NPRDhkeE1FcklzUDZ4?= =?utf-8?Q?RKxT/SqzmYxkQVPjWKk+?= X-Microsoft-Antispam-Message-Info: 8HMrsICP55dfV+DvirjZjovLj7E+c3/Hut1IPnE9hBYvgL3xHtbgj8O9JgkDuvIM672W/AZRiJ4M2SngF/MUvrsbWctzUprhewnUlW6NyBXk4cBAu7IyeeyA6C9N+SaSMU99i3ZaSIh5jNlzYsxAk6HRcyppZeyXi2X7pQOP1vNM+bVYku4Z+RjvfVnMEHoNyMISYneaqaTpo4q0zVP2/2k30MwL5ENMotiN43isOxS6b27r6NMJFOV3xYFVJza67Spn9Z7LhY7+OY+BC8X5iMGgpT3UvLHc+cWXQTTuiPf0CfmBMWFjBqxd6lzJheGVSzVZHxFMrW4ngSSkbpGvL87wfBfJsiYXBPrtY56Y71O8PkiKhCQA2QWNIjHxfjVX X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2773; 6:h30NPKj7IEPgmGnRXMupzZv/EQcaxY25tQi0up6AMtcqwnw16n5OCSdimuRqJ23rylVGJy3jUIqXZRWdr3yVbdaT0JCCvBMpElqTOY8KcpXOsCoH//mOAr1+6XN20kE7kugzoYefKLZTJNgy0jCrneq7O66GKl2c4IXWIkQWp/I3b3Rf8l+gF5hc7JYS10VsMRwMxoG/0Q58g3zM5S7oUBO90jApDm0TMqW+NPWMwXViXHB+kswVGL6pr+Cr4Xjj+vtwLNNLSZhAHg0yfupu0yQrPZpaxJhG4bX9LA+4nBAM9xFLCpAO/9vbboxWqQ4Gsizpm5fDs1471513obO7cZpoAdQUgn7devcXzqPRnkFpzOBHu8qZchrgtWlmd3rlHLLEJr58/y4mvksRXOJ/7j4gfWSqUdi6S0dOqstCDel/kdML3jT46ycikQDFyl7PYICKjOBARGFAF63lTWVJSweSdGTmq2wKbZYzOhyRysLhbUWp2iOGbuZK/rwmrKDV; 5:SrdvYwJOk10scC9BFKrz0ObgCatvZCwIZ/990NqvUnXulnULaTRSqpLrlsuj4wm1LmQGEUJWBagC9Uh/xQDDZcEP5otzCmzRdREEmXkSMcy0uw96b052nzh1hdQsA8LOE/ala69Xio49x5WSfKKnbsiPPYvlNaiHWSYHyuLK2Dc=; 24:kf934nEm+Wo2eIjCmxDqubmK21Sbs5+5+iEuiQq4Mdklsiy5P0nUt3bNdr62ZhoxCrVhy2xencfs5DU/dpttJg== SpamDiagnosticOutput: 1:22 X-Microsoft-Exchange-Diagnostics: 1; DB6PR0402MB2773; 7:GIGoOcP0erUo4HjJdwxRqGKCh/SHChTI60mRfHtKRnQ5H3OhrykU9mnUkSyWn9Vnn1npTGZTZffx/rNMwl21CRENib/jXC7VRCmYmRwg1ISxRlwVW8QPIpgsjSm3PhlUdfr0fnl5yJfcVoOoAjGZ59qvUpU5n8Q2hW1Jqhsd1OWqlz/tbAuB5IqRriR/ZxW3Medhq96ZWAqNcWlEoG5EvCjAt796ex4TQSEHxGQ8tmYecPqTuaRljyuZFjowKcUE X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Apr 2018 14:09:04.2601 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 1d783a4b-c44f-4581-2dce-08d59afecbeb X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0402MB2773 Subject: Re: [dpdk-dev] [PATCH v3 00/68] Memory Hotplug for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Apr 2018 14:09:10 -0000 Hello Anatoly, On Wednesday 04 April 2018 04:51 AM, Anatoly Burakov wrote: > This patchset introduces dynamic memory allocation for DPDK (aka memory > hotplug). Based upon RFC submitted in December [1]. > > Dependencies (to be applied in specified order): > - IPC asynchronous request API patch [2] > - Function to return number of sockets [3] > - EAL IOVA fix [4] > > Deprecation notices relevant to this patchset: > - General outline of memory hotplug changes [5] > - EAL NUMA node count changes [6] > > The vast majority of changes are in the EAL and malloc, the external API > disruption is minimal: a new set of API's are added for contiguous memory > allocation for rte_memzone, and a few API additions in rte_memory due to > switch to memseg_lists as opposed to memsegs. Every other API change is > internal to EAL, and all of the memory allocation/freeing is handled > through rte_malloc, with no externally visible API changes. > > Quick outline of all changes done as part of this patchset: > > * Malloc heap adjusted to handle holes in address space > * Single memseg list replaced by multiple memseg lists > * VA space for hugepages is preallocated in advance > * Added alloc/free for pages happening as needed on rte_malloc/rte_free > * Added contiguous memory allocation API's for rte_memzone > * Added convenience API calls to walk over memsegs > * Integrated Pawel Wodkowski's patch for registering/unregistering memory > with VFIO [7] > * Callbacks for registering memory allocations > * Callbacks for allowing/disallowing allocations above specified limit > * Multiprocess support done via DPDK IPC introduced in 18.02 > > The biggest difference is a "memseg" now represents a single page (as opposed to > being a big contiguous block of pages). As a consequence, both memzones and > malloc elements are no longer guaranteed to be physically contiguous, unless > the user asks for it at reserve time. To preserve whatever functionality that > was dependent on previous behavior, a legacy memory option is also provided, > however it is expected (or perhaps vainly hoped) to be temporary solution. > > Why multiple memseg lists instead of one? Since memseg is a single page now, > the list of memsegs will get quite big, and we need to locate pages somehow > when we allocate and free them. We could of course just walk the list and > allocate one contiguous chunk of VA space for memsegs, but this > implementation uses separate lists instead in order to speed up many > operations with memseg lists. > > For v3, the following limitations are present: > - VFIO support is only smoke-tested (but is expected to work), VFIO support > with secondary processes is not tested; work is ongoing to validate VFIO > for all use cases > - FSLMC bus VFIO code is not yet integrated, work is in progress > > For testing, it is recommended to use the GitHub repository [8], as it will > have all of the dependencies already integrated. > > v3: > - Lots of compile fixes > - Fixes for multiprocess synchronization > - Introduced support for sPAPR IOMMU, courtesy of Gowrishankar @ IBM > - Fixes for mempool size calculation > - Added convenience memseg walk() API's > - Added alloc validation callback > > v2: - fixed deadlock at init > - reverted rte_panic changes at init, this is now handled inside IPC > > [1] http://dpdk.org/dev/patchwork/bundle/aburakov/Memory_RFC/ > [2] http://dpdk.org/dev/patchwork/bundle/aburakov/IPC_Async_Request/ > [3] http://dpdk.org/dev/patchwork/bundle/aburakov/Num_Sockets/ > [4] http://dpdk.org/dev/patchwork/bundle/aburakov/IOVA_mode_fixes/ > [5] http://dpdk.org/dev/patchwork/patch/34002/ > [6] http://dpdk.org/dev/patchwork/patch/33853/ > [7] http://dpdk.org/dev/patchwork/patch/24484/ > [8] https://github.com/anatolyburakov/dpdk > Thanks for the huge work and continuously answering my barrage of questions. Here is the update for dpaa/dpaa2. Incremental to [1]: Note: Results based on github repo (16fbfef04a37bb9d714), rather than this series over master. Though, it shouldn't make that big a difference. PA: Physical Addressing mode VA: Virtual Addressing mode 1. DPAA2 PA and VA work OK over the github repo a. Almost equal performance for VA cases as compared to non-hotplug. Whether in --legacy-mem or without it. ($ see below) b. 70~90% drops in performance for PA case, depending on page size used (# see below) 2. DPAA PA (there is no VA mode) works with a minor fix over v3 which Anatoly knows about might incorporate in v4 (Patch 50/68) a. 70-90% performance drop. (# see below) ($) There are some changes in dpaa2 code base which I will share against relevant patch in this series. That can be incorporated into v4 to enable dpaa2 in VA mode. (#) Physical addressing cases for both, dpaa/dpaa2, depend heavily on the fact that physical addressing was the base and was available in sorted manner. This is reversed/negated with hotplugging support. So, rework of both the drivers is required from this perspective. There are some suggestions floated by Anatoly and internally, but work still needs to be done. It also impacts a lot of use-cases for virtualization (no-iommu). [1] http://dpdk.org/ml/archives/dev/2018-March/094184.html