From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <stephen@networkplumber.org>
Received: from mail-pl0-f44.google.com (mail-pl0-f44.google.com
 [209.85.160.44]) by dpdk.org (Postfix) with ESMTP id C68732661
 for <users@dpdk.org>; Wed,  8 Aug 2018 19:30:54 +0200 (CEST)
Received: by mail-pl0-f44.google.com with SMTP id s17-v6so1325694plp.7
 for <users@dpdk.org>; Wed, 08 Aug 2018 10:30:54 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=networkplumber-org.20150623.gappssmtp.com; s=20150623;
 h=date:from:to:cc:subject:message-id:in-reply-to:references
 :mime-version:content-transfer-encoding;
 bh=gQ5oe/5NlGQhhtjnpNIMHSuH0KGnVOaenp8tsg16hfw=;
 b=cHdV9M5ma5kGphBa+pzuMotWtscnTi4050xaLdT+NeNWW57P54RYuqtUewwqW6OTeX
 su6AnS+izdhQFIQIXdk3vzThu/sgK692cermACGRBXQiqQvD/SZclSVNuwz117acgvJR
 Hp9MBzr1AVdRdszoiSGSjiu1QaAIUe1J0yrCU1hqfafv50blTM3BEmMfjxn50mNrDBjT
 ZcSxRI6TpJ/MYPNL7x3fLV5tcIifYs293cervrJXs643iENdp09JkKuf22uLzBJFNfYW
 AAXnOR5BEBqLL83FEjDoIrRIkrDQZ/NfpqLqsnTZGi6G85Lkk7Yd+0fH/JeqOZyNipbI
 XvPw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to
 :references:mime-version:content-transfer-encoding;
 bh=gQ5oe/5NlGQhhtjnpNIMHSuH0KGnVOaenp8tsg16hfw=;
 b=uFzjxSofqL3a7oAJcncIowOWZBNaD3tq1glyT6KNnX872UOemkrzi+tetZNgSQ39fA
 p2mUy9Gw/GlnLyFLqDa+6d3gfiz7Rq98lLs/NzcqCorkGezH6c+vh4Tzk+Pf5e8/qvQN
 vcZtiYHjnHBYO3i9kLFfaH+R64y7GLhTtXp0vXPLlXBFB9VGNx7qaXYjLjx7Vund7+Mo
 sP8Bdu4Yx9eo9ZcP1jeq4V7W6nr8ixIIOjk1jbXPOCLSwzQiS6cufyYMz4o9opyVpmIT
 O8AB7rCBn0JXabuZ+3bqmqbhQYVe5MzLBBmw3RGRkkTa/D+yhGx0UL3osy/3LSWw/JW5
 ffsA==
X-Gm-Message-State: AOUpUlGv+I9oUdjXrPDEOu4P+hhsyP/6OApqzJx43hQq5rnQr65XHV6z
 rcyMGnuCbu++N81RpEN6g54QRQ==
X-Google-Smtp-Source: AA+uWPyudS8hdBgF+10ABkqHtApS4ld4C0HRUHuFE6MzSqEKdmx6V6bXDHrat3GXnAEKGjI/kyttbQ==
X-Received: by 2002:a17:902:9f90:: with SMTP id
 g16-v6mr3419009plq.304.1533749453814; 
 Wed, 08 Aug 2018 10:30:53 -0700 (PDT)
Received: from xeon-e3 (204-195-22-127.wavecable.com. [204.195.22.127])
 by smtp.gmail.com with ESMTPSA id v3-v6sm12510891pgb.54.2018.08.08.10.30.53
 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
 Wed, 08 Aug 2018 10:30:53 -0700 (PDT)
Date: Wed, 8 Aug 2018 10:26:57 -0700
From: Stephen Hemminger <stephen@networkplumber.org>
To: Anshu Boonapalli <anshu.boonapalli@gmail.com>
Cc: "Singh, Satish 1. (Nokia - IN/Bangalore)" <satish.1.singh@nokia.com>,
 "users@dpdk.org" <users@dpdk.org>
Message-ID: <20180808102657.5221fda5@xeon-e3>
In-Reply-To: <CA+=pU-J_bp_AWhPo=HjMHVLzZzA0tn4VX0vd1Tk_w-3GCDcejA@mail.gmail.com>
References: <CA+=pU-+WS_2GxrT8oFGE9=vvVc5q_q1kFxgDSYkcKzJy=rwf9Q@mail.gmail.com>
 <DB5PR07MB152767E1533096374473CEA889260@DB5PR07MB1527.eurprd07.prod.outlook.com>
 <CA+=pU-J_bp_AWhPo=HjMHVLzZzA0tn4VX0vd1Tk_w-3GCDcejA@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Subject: Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool
 0x7fc988c33e40: not virtually contiguous
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Wed, 08 Aug 2018 17:30:55 -0000

On Wed, 8 Aug 2018 09:37:10 -0700
Anshu Boonapalli <anshu.boonapalli@gmail.com> wrote:

> The system i am working on has ~1TB of RAM.
> 
> On Tue, Aug 7, 2018 at 9:28 PM Singh, Satish 1. (Nokia - IN/Bangalore) <
> satish.1.singh@nokia.com> wrote:  
> 
> > Hi,
> >
> > According to your configuration, yiu are allocation 80K*2MB = 160GB of
> > memory, do you have that much Ram in your system?
> >
> > Regards,
> > SATISH SINGH
> >
> > -----Original Message-----
> > From: users <users-bounces@dpdk.org> On Behalf Of Anshu Boonapalli
> > Sent: Tuesday, August 7, 2018 10:33 PM
> > To: users@dpdk.org
> > Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool
> > 0x7fc988c33e40: not virtually contiguous
> >
> > hi,
> >
> > I am facing this failure intermittently during the rte_eal_init call, when
> > using relatively large number of hugepages (~80k+ of 2MB hugepages).
> >
> > The mempool for this scenario is allocated using rte_mempool_create() and
> > all associated documentation/source seems to indicate the pool returned
> > should be virtually contiguous.
> >
> > Have any of you experienced this failure and figured out a resolution?
> >
> > Thanks,
> > -Anshu
> >  

With lots of memory you are going to overwhelm the IOMMU with 2M pages.
Better to use 1G huge pages.