From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-ve1eur01on0096.outbound.protection.outlook.com [104.47.1.96]) by dpdk.org (Postfix) with ESMTP id 98BD12C23 for ; Thu, 9 Aug 2018 05:30:30 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nokia.onmicrosoft.com; s=selector1-nokia-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=024e18uhShye88hy7Oq2qwpgpVCIemhq43PHdqj8sT8=; b=S/RqNeBP3c3pnQwGX/78zcbnU4CwiFNMf36dqlBFb5otl3awaCNvxdi7rxQCYNC8apL/Z5TUz5lXnBbW7ye1GQPBP/kgMiEvhiamyyvIwO6LJnTRzswFBZzSK18GPGlW+leWPonf4PoXReYjDBbQPNkk4glqluYIMl7Q+ZzCZ4Q= Received: from DB5PR07MB1527.eurprd07.prod.outlook.com (10.165.212.21) by DB5PR07MB0888.eurprd07.prod.outlook.com (10.161.196.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1038.10; Thu, 9 Aug 2018 03:30:29 +0000 Received: from DB5PR07MB1527.eurprd07.prod.outlook.com ([fe80::741e:644c:5c32:579a]) by DB5PR07MB1527.eurprd07.prod.outlook.com ([fe80::741e:644c:5c32:579a%5]) with mapi id 15.20.1038.013; Thu, 9 Aug 2018 03:30:29 +0000 From: "Singh, Satish 1. (Nokia - IN/Bangalore)" To: Stephen Hemminger , Anshu Boonapalli CC: "users@dpdk.org" Thread-Topic: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous Thread-Index: AQHULzYV7xrl9GI970yowCFIzws89aS2G5eAgACodwA= Date: Thu, 9 Aug 2018 03:30:29 +0000 Message-ID: References: <20180808102657.5221fda5@xeon-e3> In-Reply-To: <20180808102657.5221fda5@xeon-e3> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [131.228.32.183] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB5PR07MB0888; 6:RDjYBZxMPN/jLWnCN17KgcnbQVLaAwP0w+rvWfrE5O79hGBUTdlhnkMy5plaXkFIiOnADH0ES3gfmWUMgpnwmTGW93F1yR9P6+JHiu4mQj09ePMr9s3A6m2iYGzhoYPD5QK8F9KicFRC2R7scB179/yfSRx7NV7z4s5R1i7oM08Tnc6BcDc1VSoVPKTjg4xe7s0mhSwfP6BSXcl/TFMoFYOTIV8xDQtmpsfH3V6rEvSGWfamYhp16D6Lh9AbIq/Z0fzBcwra32fadSkHex0pEMjmj4yYDp9INXRC/gVlR/1Mxxex0Vvc4rfdm0aEhpaVKRgTKpxxpiIJKdh11RwW4XRsQxLDPErJbvasuWPUTxE4SVpnPdnrgY8dj3fDIn0Wo7s1vpnIGwCplvSTZVfp7Tz2H5PsXG1il8h0ni3ecD5VykeaFHxl5IS8+PutXkHbopSUitwrZYDG7oelRe9SMQ==; 5:zRNEIVvxHlX7U9vIAcxyrdSUjg2Tp4XAbxepClnYgiagCbBUOoQg/cxbWgfTaoIbmDbiZ63n5rh2iZR45U2/Qn2u1YTvqy2waZtO7OOyPMPbwc73iKUemWehz2rv7XQI1BSB7ivtz1+IcqkbOZRRgDOVkrB1hcevXLKM6ZaT90Y=; 7:xKk9YzQkJGLYgyUUpMp9h8Cu5vbwqjPCuc/qzB8NjUtSQEmuE1L1pKb8BQZFW4MgyLw9iIjMdhVK/86CZ1MBHP/BtU5G2KgJjB3z3rMVW6pIV7jN4oAFkfORqiqzzsWEpGcxTROVii15p9A08BG3vXbiw9ltHiFnGfUm0Ipazm5CYQ3TB2LdAqmwXSltvEMhZdQtwz8Jy1yectSqajFHG3+6UUT/AVxEP91Bsw5VjSOOX4H+uZ/BIVKZOU66Fa48 x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: cdb5a8d7-8413-4d83-3553-08d5fda8747b x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989117)(5600074)(711020)(4618075)(4534165)(4627221)(201703031133081)(201702281549075)(8990107)(2017052603328)(7193020); SRVR:DB5PR07MB0888; x-ms-traffictypediagnostic: DB5PR07MB0888: authentication-results: spf=none (sender IP is ) smtp.mailfrom=satish.1.singh@nokia.com; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(82608151540597)(85827821059158)(109105607167333)(195916259791689); x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(5005006)(8121501046)(3002001)(10201501046)(93006095)(93001095)(3231311)(11241501184)(806099)(944501410)(52105095)(6055026)(149027)(150027)(6041310)(20161123564045)(20161123562045)(20161123558120)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011)(7699016); SRVR:DB5PR07MB0888; BCL:0; PCL:0; RULEID:; SRVR:DB5PR07MB0888; x-forefront-prvs: 0759F7A50A x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(39860400002)(136003)(396003)(346002)(376002)(189003)(13464003)(199004)(14454004)(81166006)(8676002)(81156014)(14444005)(8936002)(6116002)(93886005)(68736007)(256004)(2900100001)(3846002)(478600001)(97736004)(5660300001)(229853002)(6436002)(5250100002)(9686003)(4326008)(25786009)(7736002)(2906002)(305945005)(106356001)(316002)(74316002)(110136005)(55016002)(105586002)(53936002)(39060400002)(53546011)(66066001)(6506007)(486006)(86362001)(99286004)(6246003)(102836004)(33656002)(26005)(476003)(446003)(186003)(76176011)(7696005)(11346002); DIR:OUT; SFP:1102; SCL:1; SRVR:DB5PR07MB0888; H:DB5PR07MB1527.eurprd07.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: nokia.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: s7IveyDG3W6p1MuvKDb7NJOyQjTfFXw7TIlMgi0Dag8bkFB+naI6TgzipWoAG1UM1c5kESeEaoZwXsK9w02W8TJT0rFET4eapt/BNLUhr4hJdpsfZi0k+svYOccvRlFq0GvF4qcqp/3QaL5RnvAFDOVfT7zKCM/Mbej/dUYQ2aIZb2PpcDCw1sTBThThNwhEomN7EHueUkT+GZNLJ8PcHvHaLK4PJUM3JDS+hyU7tOZjNKEjB7cphsBj/g/viEHeLNwlVxHF9HUp2gDjBOSaxC3NMgig0kl5PpojyvGrmhz48shyDHVtYbf5fxSEHBUkZJxBTSxh2SQ7HP3vk401AgVpoV+dMN5XiGiadYAihA5LcEYeCDcowO0/7M48IyHfxgBtAxx/SzwBpq+0r+msJg== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: nokia.com X-MS-Exchange-CrossTenant-Network-Message-Id: cdb5a8d7-8413-4d83-3553-08d5fda8747b X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Aug 2018 03:30:29.2316 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 5d471751-9675-428d-917b-70f44f9630b0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR07MB0888 Subject: Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Aug 2018 03:30:31 -0000 Hi, Sorry again to ask same question, is it 1TB RAM or 1TB of external memory(H= ardisk). Regards, SATISH SINGH -----Original Message----- From: Stephen Hemminger =20 Sent: Wednesday, August 8, 2018 10:57 PM To: Anshu Boonapalli Cc: Singh, Satish 1. (Nokia - IN/Bangalore) ; use= rs@dpdk.org Subject: Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33= e40: not virtually contiguous On Wed, 8 Aug 2018 09:37:10 -0700 Anshu Boonapalli wrote: > The system i am working on has ~1TB of RAM. >=20 > On Tue, Aug 7, 2018 at 9:28 PM Singh, Satish 1. (Nokia - IN/Bangalore)=20 > < satish.1.singh@nokia.com> wrote: >=20 > > Hi, > > > > According to your configuration, yiu are allocation 80K*2MB =3D 160GB=20 > > of memory, do you have that much Ram in your system? > > > > Regards, > > SATISH SINGH > > > > -----Original Message----- > > From: users On Behalf Of Anshu Boonapalli > > Sent: Tuesday, August 7, 2018 10:33 PM > > To: users@dpdk.org > > Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool > > 0x7fc988c33e40: not virtually contiguous > > > > hi, > > > > I am facing this failure intermittently during the rte_eal_init=20 > > call, when using relatively large number of hugepages (~80k+ of 2MB hug= epages). > > > > The mempool for this scenario is allocated using=20 > > rte_mempool_create() and all associated documentation/source seems=20 > > to indicate the pool returned should be virtually contiguous. > > > > Have any of you experienced this failure and figured out a resolution? > > > > Thanks, > > -Anshu > > =20 With lots of memory you are going to overwhelm the IOMMU with 2M pages. Better to use 1G huge pages.