From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 803525B3C for ; Fri, 9 Mar 2018 11:56:13 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga004.jf.intel.com ([10.7.209.38]) by orsmga102.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Mar 2018 02:56:12 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.47,445,1515484800"; d="scan'208";a="181288848" Received: from aburakov-mobl.ger.corp.intel.com (HELO [10.252.24.59]) ([10.252.24.59]) by orsmga004.jf.intel.com with ESMTP; 09 Mar 2018 02:56:10 -0800 To: Venumadhav Josyula , Venumadhav Josyula , "dev@dpdk.org" References: <07d7fd2f-4b73-4e79-160b-2f30e80fdb19@intel.com> From: "Burakov, Anatoly" Message-ID: <1476c49a-732e-2d1e-c95b-fd9c42ad9c6e@intel.com> Date: Fri, 9 Mar 2018 10:56:10 +0000 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 8bit Subject: Re: [dpdk-dev] Api in dpdk to get total free physical memory X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Mar 2018 10:56:14 -0000 On 09-Mar-18 9:59 AM, Venumadhav Josyula wrote: > Hi Anatoly, > > Like we have api, rte_eal_get_physmem_size, which returns the total > memory physical Ram memory. This is eal_common_memory.c, we need > following following which would return free memory. For that that I was > referring we need to api get the free physical ram memory > ‘rte_eal_get_physmem_free’ for the we wanted to submit patch. > > Thanks, > > Regards > > Venumadhav Hi Venumadhav, Yes, i understand what you're referring to. I'm just saying that 1) getting malloc heap stats will provide you with similar (and arguably more practically useful) information, and 2) there are changes (hopefully) coming that will lessen usefulness of such an API because it would be possible to allocate hugepages at runtime, instead of preallocating them at startup. You're welcome to submit your patches, of course, but i would question the usefulness of such an API in light of coming changes to memory subsystem, because the "free" memory will not be the actual amount of free memory you have. Imagine the following: // you have roughly 1MB of free memory free_mem = rte_eal_get_free_mem(); printf("%luMB\n", free_mem >> 20); // prints "1MB" rte_malloc(1 << 20); // allocate 1MB of memory // causes allocation of 1G page free_mem = rte_eal_get_free_mem(); printf("%luMB\n", free_mem >> 20); // prints "1024MB" A second ago you had 1MB of "free space", next second you have 1G free space, despite the fact that you didn't free any memory - you just allocated more pages. "Amount of free space" will have little meaning when you can allocate more pages on the fly. I hope i've explained it clearly enough. > > *From:*dev [mailto:dev-bounces@dpdk.org] *On Behalf Of *Burakov, Anatoly > *Sent:* Friday, March 09, 2018 2:36 PM > *To:* Venumadhav Josyula ; dev@dpdk.org > *Subject:* Re: [dpdk-dev] Api in dpdk to get total free physical memory > > On 08-Mar-18 9:36 PM, Venumadhav Josyula wrote: > > Hi All, > > > > > > > > Like ‘rte_eal_get_physmem_size’ api to the total size of the physical > > memory. Is there an API to get to get total free memory physical memory > > available ? > > > > > > > > We want such API we are planning to implement such API for the same > > > > > > > > /* get the total size of memory */ > > > > uint64_t > > > > rte_eal_get_physmem_free(int socket_id) > > > > { > > > > const struct rte_mem_config *mcfg; > > > > unsigned i = 0; > > > > uint64_t total_len = 0; > > > > > > > > /* get pointer to global configuration */ > > > > mcfg = rte_eal_get_configuration()->mem_config; > > > > > > > > for (i=0; i > > > if (mcfg->free_memseg[i].addr == NULL) > > > > break; > > > > > > > > if (mcfg->free_memseg[i].len == 0) > > > > continue; > > > > > > > > /* bad socket ID */ > > > > if (socket_id != SOCKET_ID_ANY && > > > > mcfg->free_memseg[i].socket_id != SOCKET_ID_ANY && > > > > socket_id != mcfg->free_memseg[i].socket_id) > > > > continue; > > > > > > > > total_len += mcfg->free_memseg[i].len; > > > > } > > > > > > > > return total_len; > > > > } > > > > > > > > Thanks, > > > > Regards > > > > Venu > > > > All memory is registered on the heap, so you might want to look at heap > stats to get the same information :) It would also arguably be more > useful because just the size of memory will not tell you how much you > can allocate, because memory may be heavily fragmented, and heap stats > will also tell you biggest free memory block size. > > Bear in mind, however, that there is work in progress [1] to enable > mapping/unmapping hugepages at runtime, which would make such an API > more or less useless - just because you don't have much free space *now* > doesn't mean you can't allocate more :) > > [1] http://dpdk.org/ml/archives/dev/2018-March/092070.html > > -- > Thanks, > Anatoly > -- Thanks, Anatoly