[dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[Anshu Boonapalli]

hi,

I am facing this failure intermittently during the rte_eal_init call, when
using relatively large number of hugepages (~80k+ of 2MB hugepages).

The mempool for this scenario is allocated using rte_mempool_create() and
all associated documentation/source seems to indicate the pool returned
should be virtually contiguous.

Have any of you experienced this failure and figured out a resolution?

Thanks,
-Anshu

Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[Singh, Satish 1. (Nokia - IN/Bangalore)]

Hi,

According to your configuration, yiu are allocation 80K*2MB = 160GB of memory, do you have that much Ram in your system?

Regards,
SATISH SINGH

-----Original Message-----
From: users <users-bounces@dpdk.org> On Behalf Of Anshu Boonapalli
Sent: Tuesday, August 7, 2018 10:33 PM
To: users@dpdk.org
Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

hi,

I am facing this failure intermittently during the rte_eal_init call, when using relatively large number of hugepages (~80k+ of 2MB hugepages).

The mempool for this scenario is allocated using rte_mempool_create() and all associated documentation/source seems to indicate the pool returned should be virtually contiguous.

Have any of you experienced this failure and figured out a resolution?

Thanks,
-Anshu

Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[Anshu Boonapalli]

The system i am working on has ~1TB of RAM.

On Tue, Aug 7, 2018 at 9:28 PM Singh, Satish 1. (Nokia - IN/Bangalore) <
satish.1.singh@nokia.com> wrote:

> Hi,
>
> According to your configuration, yiu are allocation 80K*2MB = 160GB of
> memory, do you have that much Ram in your system?
>
> Regards,
> SATISH SINGH
>
> -----Original Message-----
> From: users <users-bounces@dpdk.org> On Behalf Of Anshu Boonapalli
> Sent: Tuesday, August 7, 2018 10:33 PM
> To: users@dpdk.org
> Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool
> 0x7fc988c33e40: not virtually contiguous
>
> hi,
>
> I am facing this failure intermittently during the rte_eal_init call, when
> using relatively large number of hugepages (~80k+ of 2MB hugepages).
>
> The mempool for this scenario is allocated using rte_mempool_create() and
> all associated documentation/source seems to indicate the pool returned
> should be virtually contiguous.
>
> Have any of you experienced this failure and figured out a resolution?
>
> Thanks,
> -Anshu
>

Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[Stephen Hemminger]

On Wed, 8 Aug 2018 09:37:10 -0700
Anshu Boonapalli <anshu.boonapalli@gmail.com> wrote:

> The system i am working on has ~1TB of RAM.
> 
> On Tue, Aug 7, 2018 at 9:28 PM Singh, Satish 1. (Nokia - IN/Bangalore) <
> satish.1.singh@nokia.com> wrote:  
> 
> > Hi,
> >
> > According to your configuration, yiu are allocation 80K*2MB = 160GB of
> > memory, do you have that much Ram in your system?
> >
> > Regards,
> > SATISH SINGH
> >
> > -----Original Message-----
> > From: users <users-bounces@dpdk.org> On Behalf Of Anshu Boonapalli
> > Sent: Tuesday, August 7, 2018 10:33 PM
> > To: users@dpdk.org
> > Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool
> > 0x7fc988c33e40: not virtually contiguous
> >
> > hi,
> >
> > I am facing this failure intermittently during the rte_eal_init call, when
> > using relatively large number of hugepages (~80k+ of 2MB hugepages).
> >
> > The mempool for this scenario is allocated using rte_mempool_create() and
> > all associated documentation/source seems to indicate the pool returned
> > should be virtually contiguous.
> >
> > Have any of you experienced this failure and figured out a resolution?
> >
> > Thanks,
> > -Anshu
> >  

With lots of memory you are going to overwhelm the IOMMU with 2M pages.
Better to use 1G huge pages.

Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

[Singh, Satish 1. (Nokia - IN/Bangalore)]

Hi,

Sorry again to ask same question, is it 1TB RAM or 1TB of external memory(Hardisk).

Regards,
SATISH SINGH

-----Original Message-----
From: Stephen Hemminger <stephen@networkplumber.org> 
Sent: Wednesday, August 8, 2018 10:57 PM
To: Anshu Boonapalli <anshu.boonapalli@gmail.com>
Cc: Singh, Satish 1. (Nokia - IN/Bangalore) <satish.1.singh@nokia.com>; users@dpdk.org
Subject: Re: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool 0x7fc988c33e40: not virtually contiguous

On Wed, 8 Aug 2018 09:37:10 -0700
Anshu Boonapalli <anshu.boonapalli@gmail.com> wrote:

> The system i am working on has ~1TB of RAM.
> 
> On Tue, Aug 7, 2018 at 9:28 PM Singh, Satish 1. (Nokia - IN/Bangalore) 
> < satish.1.singh@nokia.com> wrote:
> 
> > Hi,
> >
> > According to your configuration, yiu are allocation 80K*2MB = 160GB 
> > of memory, do you have that much Ram in your system?
> >
> > Regards,
> > SATISH SINGH
> >
> > -----Original Message-----
> > From: users <users-bounces@dpdk.org> On Behalf Of Anshu Boonapalli
> > Sent: Tuesday, August 7, 2018 10:33 PM
> > To: users@dpdk.org
> > Subject: [dpdk-users] DPDK 17.11.2 - PMD: net_mlx5: mempool
> > 0x7fc988c33e40: not virtually contiguous
> >
> > hi,
> >
> > I am facing this failure intermittently during the rte_eal_init 
> > call, when using relatively large number of hugepages (~80k+ of 2MB hugepages).
> >
> > The mempool for this scenario is allocated using 
> > rte_mempool_create() and all associated documentation/source seems 
> > to indicate the pool returned should be virtually contiguous.
> >
> > Have any of you experienced this failure and figured out a resolution?
> >
> > Thanks,
> > -Anshu
> >  

With lots of memory you are going to overwhelm the IOMMU with 2M pages.
Better to use 1G huge pages.