From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-f67.google.com (mail-oi0-f67.google.com [209.85.218.67]) by dpdk.org (Postfix) with ESMTP id 5540F2C2B for ; Thu, 23 Feb 2017 03:30:54 +0100 (CET) Received: by mail-oi0-f67.google.com with SMTP id 2so404908oif.0 for ; Wed, 22 Feb 2017 18:30:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=7q6GaehqA4gpq+iTlQdWQN3qoqTdYJZ5EIuLcWGtRpg=; b=k/HsUj/wn8uKS2WR+th1u8KcNHABmZf8TI8pYh8+PjzC7+LIbWRAfPui5VZhMx7Uci Hkm13I/ZOK3mEfNMk+r3HFCyw7UbbOhEq7/SX6kStJ5KRA7oY5gOpDgEny762RfCjiX7 1v3P6UDvnKPpY17KCHa4T7mcqSPynzDIkh4mF+UTUsh/gNSRn80yh0ZnvBz8p6QZOvYw KL43Zzh/1CArL4OkYwGEpkFnp35nHm6iU9unnG7UdXSgcqVtNXcu3UNf2SUOEtJxAFvL yjVXO53S0hO1/pds6dj+q6se8mHH9kRBU8T5Qqxx6b8X/9ozJXoqX/NGvVJxtVlBTpOB lo3w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=7q6GaehqA4gpq+iTlQdWQN3qoqTdYJZ5EIuLcWGtRpg=; b=jYN1a9R4LgHCwVv6OOaGDbrIKE9zUxhmSaEmelW16Y3HALZbwCN/wJHy/xLGk0uO+u KkLAHam+OjzjqQ3brKI9CiLvB6vNjFYURffYyjXhWF2+TdFiMLlOco4zfRjeNskomDIV vYFmZA6zBkFUYDHdnyl3hLQacVFvsRDg9Lc8CUuJETKSPPmPL3zGk5XxnrNVoiNXwKDa B7DiAEVn5u8HMnu3vNFwkaA1f+wVLdQGJSwesJVnQHErNTIfownHdKWnXT/rpwEZdHsQ txHfulbeVu2kXW2StNZ2c5ZdaQNHB1T6eP5/1jdSSxit7Rc+2MWa+4UZ9D1R++ob8GIE Gtkg== X-Gm-Message-State: AMke39mxikTcBPY9hEBSgBa+RaghMrV69BSqDZlSfaTid490hnHJdh+bK3QKRw8/ieSoMrik4y0RybpkdHrhhQ== X-Received: by 10.202.72.2 with SMTP id v2mr5947627oia.179.1487817053551; Wed, 22 Feb 2017 18:30:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.182.110.38 with HTTP; Wed, 22 Feb 2017 18:30:33 -0800 (PST) In-Reply-To: <18013811-F9E1-42C6-A87B-D087018AF0B9@intel.com> References: <18013811-F9E1-42C6-A87B-D087018AF0B9@intel.com> From: Sushil Adhikari Date: Wed, 22 Feb 2017 20:30:33 -0600 Message-ID: To: "Wiles, Keith" Cc: "users@dpdk.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Larger number of hugepages causes bus error. X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Feb 2017 02:30:54 -0000 I used the basic command line option "dpdkTimer -c 0xf -n 4" And to update on my findings so far I have narrowed down to this line(1405) memset(hugepage, 0, nr_hugefiles * sizeof(struct hugepage_file)); of function rte_eal_hugepage_init() in file dpdk\lib\librte_eal\linuxapp\eal\eal_memory.c Yes I have the hugepages of size 2MB(2048) and when I calculate the memory this memset function is trying to set, it comes out to 512(nr_hugefiles) * 4144 ( sizeof(struct hugepage_file) ) = 2121728 which larger than 2MB, so my doubt is that the hugepages I have allocated(512*2MB) is not contiguous 1GB memory its trying to access memory thats not part of hugepage, is that a possibility, even though I am setting up hugepages during boot time by providing it through kernel option. On Wed, Feb 22, 2017 at 8:05 PM, Wiles, Keith wrote: > > > On Feb 22, 2017, at 3:05 PM, Sushil Adhikari > wrote: > > > > Hi, > > > > I was trying to run dpdk timer app by setting 512 2MB hugepages but the > > application crashed with following error > > EAL: Detected 4 lcore(s) > > EAL: Probing VFIO support... > > Bus error (core dumped) > > > > If I reduce the number of hugepages to 256 it works fine. I wondering > what > > could be the problem here. Here's my cpu info > > I normally run with 2048 x 2 or 2048 per socket on my machine. What is the > command line you are using to start the application? > > > > > processor : 0 > > vendor_id : GenuineIntel > > cpu family : 6 > > model : 26 > > model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz > > stepping : 5 > > microcode : 0x11 > > cpu MHz : 2794.000 > > cache size : 8192 KB > > physical id : 0 > > siblings : 4 > > core id : 0 > > cpu cores : 4 > > apicid : 0 > > initial apicid : 0 > > fpu : yes > > fpu_exception : yes > > cpuid level : 11 > > wp : yes > > flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge > mca > > cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx > > rdtscp lm constant_tsc arch_ > > perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni > dtes64 > > monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt > > lahf_lm ida dtherm tpr_shadow vnm > > i flexpriority ept vpid > > bugs : > > bogomips : 5600.00 > > clflush size : 64 > > cache_alignment : 64 > > address sizes : 36 bits physical, 48 bits virtual > > power management: > > > > processor : 1 > > vendor_id : GenuineIntel > > cpu family : 6 > > model : 26 > > model name : Intel(R) Core(TM) i7 CPU 950 @ 3.07GHz > > stepping : 5 > > microcode : 0x11 > > cpu MHz : 2794.000 > > cache size : 8192 KB > > physical id : 0 > > siblings : 4 > > core id : 1 > > cpu cores : 4 > > apicid : 2 > > initial apicid : 2 > > fpu : yes > > fpu_exception : yes > > cpuid level : 11 > > wp : yes > > flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge > mca > > cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx > > rdtscp lm constant_tsc arch_ > > perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni > dtes64 > > monitor ds_cpl vmx est tm2 ssse3 cx16 xtpr pdcm sse4_1 sse4_2 popcnt > > lahf_lm ida dtherm tpr_shadow vnm > > i flexpriority ept vpid > > bugs : > > bogomips : 5600.00 > > clflush size : 64 > > cache_alignment : 64 > > address sizes : 36 bits physical, 48 bits virtual > > power management:...... > > > > And Here's my meminfo > > > > MemTotal: 24679608 kB > > MemFree: 24014156 kB > > MemAvailable: 23950600 kB > > Buffers: 3540 kB > > Cached: 31436 kB > > SwapCached: 0 kB > > Active: 21980 kB > > Inactive: 22256 kB > > Active(anon): 10760 kB > > Inactive(anon): 2940 kB > > Active(file): 11220 kB > > Inactive(file): 19316 kB > > Unevictable: 0 kB > > Mlocked: 0 kB > > SwapTotal: 0 kB > > SwapFree: 0 kB > > Dirty: 32 kB > > Writeback: 0 kB > > AnonPages: 9252 kB > > Mapped: 11912 kB > > Shmem: 4448 kB > > Slab: 27712 kB > > SReclaimable: 11276 kB > > SUnreclaim: 16436 kB > > KernelStack: 2672 kB > > PageTables: 1000 kB > > NFS_Unstable: 0 kB > > Bounce: 0 kB > > WritebackTmp: 0 kB > > CommitLimit: 12077660 kB > > Committed_AS: 137792 kB > > VmallocTotal: 34359738367 kB > > VmallocUsed: 0 kB > > VmallocChunk: 0 kB > > HardwareCorrupted: 0 kB > > AnonHugePages: 2048 kB > > CmaTotal: 0 kB > > CmaFree: 0 kB > > HugePages_Total: 256 > > HugePages_Free: 0 > > HugePages_Rsvd: 0 > > HugePages_Surp: 0 > > Hugepagesize: 2048 kB > > DirectMap4k: 22000 kB > > DirectMap2M: 25133056 kB > > Regards, > Keith > >