From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id C493E2B88 for ; Thu, 23 Feb 2017 16:20:40 +0100 (CET) Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by orsmga105.jf.intel.com with ESMTP; 23 Feb 2017 07:20:39 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.35,198,1484035200"; d="scan'208";a="827667085" Received: from njohnsso-mobl1.ger.corp.intel.com (HELO [10.252.17.161]) ([10.252.17.161]) by FMSMGA003.fm.intel.com with ESMTP; 23 Feb 2017 07:20:37 -0800 To: Sushil Adhikari , "Wiles, Keith" References: <18013811-F9E1-42C6-A87B-D087018AF0B9@intel.com> <6649EDAE-E9E4-4C49-855C-56E37BD4FA88@intel.com> <986FF8E4-1D37-4275-B9E3-8C7E19996461@intel.com> <516ac630-f787-9bae-88b3-2ef5b35cda9d@intel.com> Cc: "users@dpdk.org" From: Sergio Gonzalez Monroy Message-ID: Date: Thu, 23 Feb 2017 15:20:37 +0000 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.1.1 MIME-Version: 1.0 In-Reply-To: <516ac630-f787-9bae-88b3-2ef5b35cda9d@intel.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [dpdk-users] Larger number of hugepages causes bus error. X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2017 15:20:41 -0000 Nevermind the 'root' question, given that it works with 256 hugepages :) On 23/02/2017 15:18, Sergio Gonzalez Monroy wrote: > That line is just setting to 0 a shared memory area where we store > hugepage information. > > Are you running as privileged user (ie. root)? > What is the result of 'ulimit -aHS'? > > Thanks, > Sergio > > On 23/02/2017 03:18, Sushil Adhikari wrote: >> Thank you Keith for the response, >> >> Yes it should be line 1142 not 1405, I was using 16.11 and now I'm using >> 17.02 and still getting the same error. >> >> On Wed, Feb 22, 2017 at 8:46 PM, Wiles, Keith >> wrote: >> >>>> On Feb 22, 2017, at 6:43 PM, Wiles, Keith >>>> wrote: >>>> >>>>> On Feb 22, 2017, at 6:30 PM, Sushil Adhikari >>> wrote: >>>>> I used the basic command line option "dpdkTimer -c 0xf -n 4" >>>>> And to update on my findings so far I have narrowed down to this >>> line(1405) >>>>> memset(hugepage, 0, nr_hugefiles * sizeof(struct hugepage_file)); >>>>> of function rte_eal_hugepage_init() in file >>> dpdk\lib\librte_eal\linuxapp\eal\eal_memory.c >>>> What version of DPDK are you using? I was looking at the file at 1405 >>> and I do not see a memset() call. >>> >>> I found the memset call at 1142 in my 17.05-rc0 code. Please try the >>> latest version and see if you get the same problem. >>> >>>>> Yes I have the hugepages of size 2MB(2048) and when I calculate the >>> memory this memset function is trying to set, it comes out to >>> 512(nr_hugefiles) * 4144 ( sizeof(struct hugepage_file) ) = 2121728 >>> which >>> larger than 2MB, so my doubt is that the hugepages I have >>> allocated(512*2MB) is not contiguous 1GB memory its trying to access >>> memory >>> thats not part of hugepage, is that a possibility, even though I am >>> setting >>> up hugepages during boot time by providing it through kernel option. >>>>> >>>>> On Wed, Feb 22, 2017 at 8:05 PM, Wiles, Keith >>> wrote: >>>>>> On Feb 22, 2017, at 3:05 PM, Sushil Adhikari >>> wrote: >>>>>> Hi, >>>>>> >>>>>> I was trying to run dpdk timer app by setting 512 2MB hugepages >>>>>> but the >>>>>> application crashed with following error >>>>>> EAL: Detected 4 lcore(s) >>>>>> EAL: Probing VFIO support... >>>>>> Bus error (core dumped) >>>>>> >>>>>> If I reduce the number of hugepages to 256 it works fine. I >>>>>> wondering >>> what >>>>>> could be the problem here. Here's my cpu info >>>>> I normally run with 2048 x 2 or 2048 per socket on my machine. >>>>> What is >>> the command line you are using to start the application? >>>>>> processor : 0 >>>>>> vendor_id : GenuineIntel >>>>>> cpu family : 6 >>>>>> model : 26 >>>>>> model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz >>>>>> stepping : 5 >>>>>> microcode : 0x11 >>>>>> cpu MHz : 2794.000 >>>>>> cache size : 8192 KB >>>>>> physical id : 0 >>>>>> siblings : 4 >>>>>> core id : 0 >>>>>> cpu cores : 4 >>>>>> apicid : 0 >>>>>> initial apicid : 0 >>>>>> fpu : yes >>>>>> fpu_exception : yes >>>>>> cpuid level : 11 >>>>>> wp : yes >>>>>> flags : fpu vme de pse tsc msr pae mce cx8 apic sep >>>>>> mtrr pge >>> mca >>>>>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe >>>>>> syscall >>> nx >>>>>> rdtscp lm constant_tsc arch_ >>>>>> perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni >>> dtes64 >>>>>> monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt >>>>>> lahf_lm ida dtherm tpr_shadow vnm >>>>>> i flexpriority ept vpid >>>>>> bugs : >>>>>> bogomips : 5600.00 >>>>>> clflush size : 64 >>>>>> cache_alignment : 64 >>>>>> address sizes : 36 bits physical, 48 bits virtual >>>>>> power management: >>>>>> >>>>>> processor : 1 >>>>>> vendor_id : GenuineIntel >>>>>> cpu family : 6 >>>>>> model : 26 >>>>>> model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz >>>>>> stepping : 5 >>>>>> microcode : 0x11 >>>>>> cpu MHz : 2794.000 >>>>>> cache size : 8192 KB >>>>>> physical id : 0 >>>>>> siblings : 4 >>>>>> core id : 1 >>>>>> cpu cores : 4 >>>>>> apicid : 2 >>>>>> initial apicid : 2 >>>>>> fpu : yes >>>>>> fpu_exception : yes >>>>>> cpuid level : 11 >>>>>> wp : yes >>>>>> flags : fpu vme de pse tsc msr pae mce cx8 apic sep >>>>>> mtrr pge >>> mca >>>>>> cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe >>>>>> syscall >>> nx >>>>>> rdtscp lm constant_tsc arch_ >>>>>> perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni >>> dtes64 >>>>>> monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt >>>>>> lahf_lm ida dtherm tpr_shadow vnm >>>>>> i flexpriority ept vpid >>>>>> bugs : >>>>>> bogomips : 5600.00 >>>>>> clflush size : 64 >>>>>> cache_alignment : 64 >>>>>> address sizes : 36 bits physical, 48 bits virtual >>>>>> power management:...... >>>>>> >>>>>> And Here's my meminfo >>>>>> >>>>>> MemTotal: 24679608 kB >>>>>> MemFree: 24014156 kB >>>>>> MemAvailable: 23950600 kB >>>>>> Buffers: 3540 kB >>>>>> Cached: 31436 kB >>>>>> SwapCached: 0 kB >>>>>> Active: 21980 kB >>>>>> Inactive: 22256 kB >>>>>> Active(anon): 10760 kB >>>>>> Inactive(anon): 2940 kB >>>>>> Active(file): 11220 kB >>>>>> Inactive(file): 19316 kB >>>>>> Unevictable: 0 kB >>>>>> Mlocked: 0 kB >>>>>> SwapTotal: 0 kB >>>>>> SwapFree: 0 kB >>>>>> Dirty: 32 kB >>>>>> Writeback: 0 kB >>>>>> AnonPages: 9252 kB >>>>>> Mapped: 11912 kB >>>>>> Shmem: 4448 kB >>>>>> Slab: 27712 kB >>>>>> SReclaimable: 11276 kB >>>>>> SUnreclaim: 16436 kB >>>>>> KernelStack: 2672 kB >>>>>> PageTables: 1000 kB >>>>>> NFS_Unstable: 0 kB >>>>>> Bounce: 0 kB >>>>>> WritebackTmp: 0 kB >>>>>> CommitLimit: 12077660 kB >>>>>> Committed_AS: 137792 kB >>>>>> VmallocTotal: 34359738367 kB >>>>>> VmallocUsed: 0 kB >>>>>> VmallocChunk: 0 kB >>>>>> HardwareCorrupted: 0 kB >>>>>> AnonHugePages: 2048 kB >>>>>> CmaTotal: 0 kB >>>>>> CmaFree: 0 kB >>>>>> HugePages_Total: 256 >>>>>> HugePages_Free: 0 >>>>>> HugePages_Rsvd: 0 >>>>>> HugePages_Surp: 0 >>>>>> Hugepagesize: 2048 kB >>>>>> DirectMap4k: 22000 kB >>>>>> DirectMap2M: 25133056 kB >>>>> Regards, >>>>> Keith >>>>> >>>>> >>>> Regards, >>>> Keith >>> Regards, >>> Keith >>> >>> >