Re: Calculating number of HugeTLBs required

[Patrick Mahan <mahan@mahan.org>]

On 3/10/25 2:21 PM, Stephen Hemminger wrote:
> On Tue, 4 Mar 2025 11:22:50 -0800
> Patrick Mahan <mahan@mahan.org> wrote:
> 
>> Morning,
>>
>> This might be simple question, but it has my curiosity itching.
>>
>> I did a quick scan through the documentation, but I did not see any good
>> guidelines for determining the number of HugeTLB based on the number of PMDs and
>> number of RX/TX queues.
>>
>> I'm am looking at three different platforms, one has 2 ports (ixgbe), one has 3
>> ports (1 e1000 and 2 i40es) and a third has 2 ports (1 e1000 and 1 Cavium liquidIO).
>>
>> I'm trying to come up with some means of defining the HugeTLB requirements other
>> than trial and error.
>>
>> Thanks,
>>
>> Patrick
> 
> There is on exact way to estimate this. But for most applications the largest memory footprint
> is the mbuf pool. For sizing the mbuf pool you need to account for all the NIC's, queues, and descriptor arrays
> as well as any internal staging buffers.

That's what I thought, but I was hoping for some group wisdom here.  I am trying 
to construct the various startup (two are systemd and one is still sysvinit) to 
try and calculate this based on, as you pointed out, the # of NICS, the # of 
queues, etc.  The code was already using HugeTLBs for other stuff (RiB/FiB, 
database) that I had written code to calculate that information based on the # of 
entries in the database, the maximum # of routes, etc at boot time to reserve. 
The move to DPDK adds more complexity to this as we are looking at leveraging 
more CPU cores, which may mean more queues, which means more packets, etc.

Right now I've done some, back of the envelope, calculations, but that is not a 
way to dynamically approach this.

Anyways, thanks for responding...

Patick