From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from aer-iport-2.cisco.com (aer-iport-2.cisco.com [173.38.203.52]) by dpdk.org (Postfix) with ESMTP id 5AA4F11C5 for ; Thu, 23 Mar 2017 17:25:01 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=2171; q=dns/txt; s=iport; t=1490286301; x=1491495901; h=subject:to:references:from:message-id:date:mime-version: in-reply-to:content-transfer-encoding; bh=Nr1s+AbkVQg3JQwF+wMNXiJX8kuJOsaV71u/tcy1oN8=; b=Oza1yExTbKuZfHtjJoCK4v/ePFMFHPxuaKehbH8vKKe91KrI7I80qYT5 kVTlf4Aq29nOvEH5cmFnCJ9q76aGQxKO22xls/qYcrsgCUuD0uNH2gzd4 P71ncj0GtkuT3p4nJcXYUqBvnKSoN7pQ1cUnC7gFjXjMQkFLPK3kgUosF k=; X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DgAQB89dNY/xbLJq1dGQEBAQEBAQEBA?= =?us-ascii?q?QEBBwEBAQEBhDKBC4Niig9zkFyVSYIOKoV4AoNUGAECAQEBAQEBAWsohRYBBSM?= =?us-ascii?q?VUQsYAgImAgJXBgEMCAEBigIOqlqCJoo+AQEBAQEBAQEBAQEBAQEBAQEBAQEBH?= =?us-ascii?q?YELhUOCBYJqh1qCXwEEnFWGe4tPgk+ICoZWjz2EJR84gQQkFggXFYcbPjWKCQE?= =?us-ascii?q?BAQ?= X-IronPort-AV: E=Sophos;i="5.36,210,1486425600"; d="scan'208";a="650633699" Received: from aer-iport-nat.cisco.com (HELO aer-core-1.cisco.com) ([173.38.203.22]) by aer-iport-2.cisco.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 23 Mar 2017 16:25:00 +0000 Received: from [10.61.201.105] ([10.61.201.105]) by aer-core-1.cisco.com (8.14.5/8.14.5) with ESMTP id v2NGP0YR028829; Thu, 23 Mar 2017 16:25:00 GMT To: Sergio Gonzalez Monroy , dev@dpdk.org References: <4a774c72-bd59-ea52-b65f-ed8cb0b8a700@cisco.com> <61219f8c-972d-3e18-6e75-57207d7e149c@intel.com> From: Ruslan Bilovol Message-ID: Date: Thu, 23 Mar 2017 18:24:59 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [dpdk-dev] Is contiguous hugepages memory still required in latest DPDKs? X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Mar 2017 16:25:01 -0000 On 03/22/2017 02:08 PM, Ruslan Bilovol wrote: > On 03/21/2017 04:41 PM, Sergio Gonzalez Monroy wrote: >> The DPDK will still try to allocate contiguous hugepages. >> Since DPDK v16.07 the mempool library is able to create a mempool with multiple chunks of memory. >> You would still have the contig memory restriction for any other DPDK library or app. Another question: are there any improvements in contiguous hugepages requirements in latest DPDK (v17.02)? Thanks, Ruslan >> >> Are you pre-allocating hugepages on boot (kernel cmdline) or runtime? > I tried both cases, and there is no much difference between them. > (I used debug prints in kernel to see physical address of preallocated hugepages > > Main issue is that linux kernel memory allocation algorithm was changed > with "fair zone allocator policy" commits, and in my case need to > pre-allocate 2x or even 3x more hugepages now. > > Regards, > Ruslan > >> >> Sergio >> >> On 21/03/2017 14:20, Ruslan Bilovol wrote: >>> Hi, >>> >>> Recently after moving to 4.4 Linux kernel we found that DPDK v16.07 >>> can't find physically contiguous chunk of hugepages memory. >>> >>> I've tracked this down to kernel commits >>> 81c0a2bb515f ("mm: page_alloc: fair zone allocator policy") >>> fff4068cba48 ("mm: page_alloc: revert NUMA aspect of fair allocation policy") >>> 4ffeaf3560a5 ("mm: page_alloc: reduce cost of the fair zone allocation policy") >>> >>> These commits changed default page allocator behavior so it now allocates >>> memory proportionally from preferred and lower zones. Hugepages >>> are scattered proportionally among few memory zones, so possibility >>> to find big physically contiguous chunk of hugepages memory is much lower. >>> >>> I see that there were some attempts to move from contiguous hugepages >>> approach, like http://dpdk.org/ml/archives/dev/2016-March/035201.html >>> Also some discussion here: http://dpdk.org/ml/archives/users/2016-October/001050.html >>> >>> The question: is contiguous hugepages memory still required in latest DPDKs, >>> and if not, since which version? >>> >>> Thanks, >>> Ruslan >>> >> >