DPDK usage discussions
 help / color / Atom feed
* Re: [dpdk-users] How can create a mempool more than 20GB?
       [not found] <5d7782d8.1c69fb81.26d5e.d195SMTPIN_ADDED_BROKEN@mx.google.com>
@ 2019-09-10 17:36 ` Stephen Hemminger
  2019-09-11  2:21   ` [dpdk-users] 答复: " 宋捷
  0 siblings, 1 reply; 2+ messages in thread
From: Stephen Hemminger @ 2019-09-10 17:36 UTC (permalink / raw)
  To: 宋捷; +Cc: users, Van Haaren, Harry

On Tue, 10 Sep 2019 19:02:37 +0800
宋捷 <songj@zctt.com> wrote:

> Hi All,
> 
>  
> 
>        I assigned 40GB hugepages for each node.
> 
> 
> 
>  
> 
>        I need a huge mempool buffer (20GB) for save received packets, I
> create a mempool as follow:
> 
> rte_pktmbuf_pool_create("rx_dump_pool",  8*1000*1000, 0, 0,
> RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() );
> 
>  
> 
> RTE_MBUF_DEFAULT_BUF_SIZE is 2048+128 , I think rte_pktmbuf_pool_create
> should create 8*1000*1000*(2176)≈16G buffer, 
> 
> But failed with below prompt:
> 
> EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list
> 
> EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list
> 
> EAL: Error - exiting with code: 1
> 
>  
> 
> I try to reduce the size, the mempool can be created successfully as follow:
> 
> rte_pktmbuf_pool_create("rx_dump_pool", 5000000, 0, 0,
> RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() );
> 
>  
> 
>  
> 
> Does DPDK mempool has a limited size ?  I have no ideal for this L
> 
>  

You are going to need 1G huge pages on this, and a system with very large
amount of memory. To setup 1G huge pages requires settings on kernel command line.

Also expect slow startup times with that much memory.



^ permalink raw reply	[flat|nested] 2+ messages in thread

* [dpdk-users] 答复: How can create a mempool more than 20GB?
  2019-09-10 17:36 ` [dpdk-users] How can create a mempool more than 20GB? Stephen Hemminger
@ 2019-09-11  2:21   ` " 宋捷
  0 siblings, 0 replies; 2+ messages in thread
From: 宋捷 @ 2019-09-11  2:21 UTC (permalink / raw)
  To: Stephen Hemminger; +Cc: users, Van Haaren, Harry

Hi Stephen,

Expert,you are correct, 
I update the default hugepage size from 2M to 1G, it's worked.

Thanks you very much!


Jie



-----邮件原件-----
发件人: Stephen Hemminger [mailto:stephen@networkplumber.org] 
发送时间: 2019年9月11日 1:36
收件人: 宋捷 <songj@zctt.com>
抄送: 'users' <users@dpdk.org>; 'Van Haaren, Harry' <harry.van.haaren@intel.com>
主题: Re: How can create a mempool more than 20GB?

On Tue, 10 Sep 2019 19:02:37 +0800
宋捷 <songj@zctt.com> wrote:

> Hi All,
> 
>  
> 
>        I assigned 40GB hugepages for each node.
> 
> 
> 
>  
> 
>        I need a huge mempool buffer (20GB) for save received packets, 
> I create a mempool as follow:
> 
> rte_pktmbuf_pool_create("rx_dump_pool",  8*1000*1000, 0, 0, 
> RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() );
> 
>  
> 
> RTE_MBUF_DEFAULT_BUF_SIZE is 2048+128 , I think 
> rte_pktmbuf_pool_create should create 8*1000*1000*(2176)≈16G buffer,
> 
> But failed with below prompt:
> 
> EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list
> 
> EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list
> 
> EAL: Error - exiting with code: 1
> 
>  
> 
> I try to reduce the size, the mempool can be created successfully as follow:
> 
> rte_pktmbuf_pool_create("rx_dump_pool", 5000000, 0, 0, 
> RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() );
> 
>  
> 
>  
> 
> Does DPDK mempool has a limited size ?  I have no ideal for this L
> 
>  

You are going to need 1G huge pages on this, and a system with very large amount of memory. To setup 1G huge pages requires settings on kernel command line.

Also expect slow startup times with that much memory.






^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, back to index

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <5d7782d8.1c69fb81.26d5e.d195SMTPIN_ADDED_BROKEN@mx.google.com>
2019-09-10 17:36 ` [dpdk-users] How can create a mempool more than 20GB? Stephen Hemminger
2019-09-11  2:21   ` [dpdk-users] 答复: " 宋捷

DPDK usage discussions

Archives are clonable:
	git clone --mirror http://inbox.dpdk.org/users/0 users/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 users users/ http://inbox.dpdk.org/users \
		users@dpdk.org
	public-inbox-index users


Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.users


AGPL code for this site: git clone https://public-inbox.org/ public-inbox