From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C03D7A2EEB for ; Tue, 10 Sep 2019 19:36:27 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 366D31E964; Tue, 10 Sep 2019 19:36:27 +0200 (CEST) Received: from mail-wr1-f52.google.com (mail-wr1-f52.google.com [209.85.221.52]) by dpdk.org (Postfix) with ESMTP id DDD4E1E56C for ; Tue, 10 Sep 2019 19:36:25 +0200 (CEST) Received: by mail-wr1-f52.google.com with SMTP id l16so21469528wrv.12 for ; Tue, 10 Sep 2019 10:36:25 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=UQhy870tm+CTlEiCZ+6T6gtS8qVdxOnR3vc/JF38jWE=; b=pGLdgrUXiASYZfoNiT4kI8qjrOWnd9eCK3wUkmS6PbADm3pTJ566LYOkNw5tqd0Zl1 5MwA9xmase0qkUg1rdYHndUfHKxmy/r3HL157Y2Y6ExaHyHcYExnH1a4G/HkTbnnKNmw Iu5iczb/sSmnvTF/ueZKRYdM7WX7DzWPfXUa2Y2Qlr84IL5Nx+rS+61I+Q6NUsoS359T XEQ3uA15NKwV6gmu1b3cbhZ2PtMh49VJkpx4rK7aswdHgDSrCdaHyJnrHrFZCdH4rqeY GRHJ52CV6Iesr4x/w6Fgmt97AG8dpbLLbGq+8iuCw3TqAUlDqz6ZAVNuFJz7xFna2Q1I 3H5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=UQhy870tm+CTlEiCZ+6T6gtS8qVdxOnR3vc/JF38jWE=; b=m8/jMEjuTFK4jpwqX/oZ+dJ3Q31LlrtUPF9VBUPIK4kfXFb3ohM2PXAROSEQcOzMZo y9muPYJQHR5ICBA2uxXbdIrR4VXasPxeWJcyPsWkymRG5rOEprLL9zFQcfRoAWezh9MJ qyE3WHkvFUzjxsmqkxW59MdOYeOnPT/fz7jVqp1kSX0zh+Rk1fhOPfOC2OIiHCIb61ao auZXzqRxDujwb0rnDFEenEE2QOPt+DWWRKdyA2yCdUWo7YSST2oGCpQkRwEG3aB94ChM 5xgDTIHsRVyrE4ta9ObIeC2HyEuHeVMyOHfPgCUjfNJq79g0aGAPCEblyYwPGJRmmRvW heLw== X-Gm-Message-State: APjAAAWA0brO7TzXVWsb+jBZ9MBnlKLekstMVMfdxdsaqopAia256XFM 4ii1cYRiyNdPZ9eB6tdNkkS0Ng== X-Google-Smtp-Source: APXvYqwJyyEXz3w0Bwt8W11X2kM+0hO43LUA2MOo6FRSSIhrRfOs/FO65/Enz9rf/msQOBK1SN5Xrg== X-Received: by 2002:adf:feca:: with SMTP id q10mr22775728wrs.159.1568136985412; Tue, 10 Sep 2019 10:36:25 -0700 (PDT) Received: from xps13 (110.8.30.213.rev.vodafone.pt. [213.30.8.110]) by smtp.gmail.com with ESMTPSA id r65sm471025wmr.9.2019.09.10.10.36.24 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Tue, 10 Sep 2019 10:36:25 -0700 (PDT) Date: Tue, 10 Sep 2019 18:36:21 +0100 From: Stephen Hemminger To: =?UTF-8?B?5a6L5o23?= Cc: "'users'" , "'Van Haaren, Harry'" Message-ID: <20190910183621.50d50ddb@xps13> In-Reply-To: <5d7782d8.1c69fb81.26d5e.d195SMTPIN_ADDED_BROKEN@mx.google.com> References: <5d7782d8.1c69fb81.26d5e.d195SMTPIN_ADDED_BROKEN@mx.google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-users] How can create a mempool more than 20GB? X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" On Tue, 10 Sep 2019 19:02:37 +0800 =E5=AE=8B=E6=8D=B7 wrote: > Hi All, >=20 > =20 >=20 > I assigned 40GB hugepages for each node. >=20 >=20 >=20 > =20 >=20 > I need a huge mempool buffer (20GB) for save received packets, I > create a mempool as follow: >=20 > rte_pktmbuf_pool_create("rx_dump_pool", 8*1000*1000, 0, 0, > RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() ); >=20 > =20 >=20 > RTE_MBUF_DEFAULT_BUF_SIZE is 2048+128 , I think rte_pktmbuf_pool_create > should create 8*1000*1000*(2176)=E2=89=8816G buffer,=20 >=20 > But failed with below prompt: >=20 > EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list >=20 > EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list >=20 > EAL: Error - exiting with code: 1 >=20 > =20 >=20 > I try to reduce the size, the mempool can be created successfully as foll= ow: >=20 > rte_pktmbuf_pool_create("rx_dump_pool", 5000000, 0, 0, > RTE_MBUF_DEFAULT_BUF_SIZE, rte_socket_id() ); >=20 > =20 >=20 > =20 >=20 > Does DPDK mempool has a limited size ? I have no ideal for this L >=20 > =20 You are going to need 1G huge pages on this, and a system with very large amount of memory. To setup 1G huge pages requires settings on kernel comman= d line. Also expect slow startup times with that much memory.