From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9BF0845932 for ; Sat, 7 Sep 2024 22:36:13 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 170EC402F1; Sat, 7 Sep 2024 22:36:13 +0200 (CEST) Received: from mail-pf1-f175.google.com (mail-pf1-f175.google.com [209.85.210.175]) by mails.dpdk.org (Postfix) with ESMTP id 82E0B4026F for ; Sat, 7 Sep 2024 22:36:11 +0200 (CEST) Received: by mail-pf1-f175.google.com with SMTP id d2e1a72fcca58-7178cab62e6so2772898b3a.2 for ; Sat, 07 Sep 2024 13:36:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1725741370; x=1726346170; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Ow0n4hxWGBh90C234f89GAO7NzqyrW17z0uYWxEvW6M=; b=DlovIbWQecTp3/nHtuUqjwcJDaezzRGMgJxbq1ZcldKxQXzBhl8XGkPdHXPvtlH9GU CsZ/ht7WHlc772fSMfdvicmcqnsz0LhBegsYkS9xRnShYz8MRHAr2t6z4Ub3/6fsoWnN 52DA0sLFmXULEKIjqJ3rj3upbx04V3n8GzPTw5BKuCsf+iCeoyEWzXep0S+10/rcU+Xg Z2pGYxLfjWxXwVTgPDeWC4TnmwqyCR1m7OLAiELQQdkHRqGOxbNht9X5BpZIs15Ydpwv QvVPph/alrCneKjOw3+aQclHN//KFHzP6t+hz0KTupWKD66y2cHps19XyM4CwYTUDNBW z+3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1725741370; x=1726346170; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Ow0n4hxWGBh90C234f89GAO7NzqyrW17z0uYWxEvW6M=; b=VAYLAO7H3hyOvRrq6YuLWhJAN/YMBbcy+IER3d+HId7HBzBZCGuMBVCeJCDUysiTWb IopokwhD30sK8nw9rjLwMCs5tIkD3ppJSU3zzL/hAwhnBy6iDVn4XpO9C2MwKSJtzwZB eHQzZ2P2e+PGpDvZ+l6mBTe2AwCImArE7YAkWwDgMFuWrl0d/okHBWbApCaDoziEGBWJ ZdrP0ASXVqskiA+ksU4k3VFNHaAg5LB/60CZzf1Mai4imJdPgIcPJoMm6pzsm1tEBDkE jqQZK807FgyuAjosM/PPtFlc8vQ/+Xm747W7HZITQIrX37vOaaUKsWouGL2paHdiPIKU l6/g== X-Gm-Message-State: AOJu0YxAswZKkCGXZ6u7sIVawWj+gEhOHxZECP1iN0GZv1Oh4ABZ4xpw 5Do6IhFItn/kxdffDOYZLN69xpU1xSop1l9gJCZ0f7g2CzxckwM0DUaDm4Gq2US50BV1DPEHGCr 9EtzwpBrWvi8ZqkqDXPetbYzH+bU= X-Google-Smtp-Source: AGHT+IF7ul5kxordPfTp0Mqp+tY9tzdtWcjrOGFKHbY+nlGgYsesBFcm93muo1B+9oGL8xNaBjm6k5EAXwOMCBzt28Y= X-Received: by 2002:a05:6a00:2e11:b0:70d:1dcf:e2a5 with SMTP id d2e1a72fcca58-718d5ded080mr8021496b3a.3.1725741370338; Sat, 07 Sep 2024 13:36:10 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Dmitry Kozlyuk Date: Sat, 7 Sep 2024 23:35:58 +0300 Message-ID: Subject: Re: hugepage mapping to memseg failure To: "Lombardo, Ed" Cc: users Content-Type: multipart/alternative; boundary="0000000000005a77cd06218d7946" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --0000000000005a77cd06218d7946 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Ed, On Fri, Sep 6, 2024, 16:43 Lombardo, Ed wrote: > The rte_eal_init() arguments are: > > =E2=80=98app_name, -c0x2, -n4, --socket-mem=3D2048, --legacy-mem, --no-te= lemetry=E2=80=99 > > > > Could it be that the hugpages are not contiguous and reboot clears this > issue, not able to confirm. > Yes, this is likely the root cause. Since you're building DPDK yourself, you can print cur->physaddr around line 900 (see the link below). In legacy mode, DPDK leaves "holes" (unused elements) in memory segment lists between pages that are not physically contiguous. Because in your case the segment list has only two elements, there is no room for two segments for two hugepages plus a hole segment between them. http://git.dpdk.org/dpdk/tree/lib/eal/linux/eal_memory.c#n832 Your options then are: - not using legacy memory mode; - increasing *_MAX_MEM_MB_* constants to 3072 (will also increase VIRT). > --0000000000005a77cd06218d7946 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Ed,=C2=A0

On Fri, Sep 6, 2024, 16:43 Lombardo, Ed &l= t;Ed.Lombardo@netscout.com> wrote:

The rte_eal_init() arguments are:

=E2=80=98app_name, -c0x2, -n4, --socket-mem=3D2048, = --legacy-mem, --no-telemetry=E2=80=99

=C2=A0

Could it be that the hugpages are not contiguous and= reboot clears this issue, not able to confirm.

Yes, this is likely the root cause. Since yo= u're building DPDK yourself, you can print cur->physaddr around line= 900 (see the link below). In legacy mode, DPDK leaves "holes" (u= nused elements) in memory segment lists between pages that are not physical= ly contiguous. Because in your case the segment list has only two elements,= there is no room for two segments for two hugepages plus a hole segment be= tween them.
http://git.dpdk.org/dpdk/tree/lib/eal/linux/eal_memory.c#n832

Your options then are:
- not using legacy memory mode;
= - increasing *_MAX_MEM_MB_* constants to 3072 (will also increase VIRT).=C2= =A0

--0000000000005a77cd06218d7946--