From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 7BDEF43294 for ; Sun, 5 Nov 2023 19:23:05 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 022094029E; Sun, 5 Nov 2023 19:23:05 +0100 (CET) Received: from mail-oi1-f180.google.com (mail-oi1-f180.google.com [209.85.167.180]) by mails.dpdk.org (Postfix) with ESMTP id 4C5A940278 for ; Sun, 5 Nov 2023 19:23:03 +0100 (CET) Received: by mail-oi1-f180.google.com with SMTP id 5614622812f47-3b2e22a4004so2474316b6e.3 for ; Sun, 05 Nov 2023 10:23:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1699208582; x=1699813382; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=2ycZguZ3P3oeTnUy4y2L0ndN0vzmTX5Nt1qzxS/R+vE=; b=NE4kTPJuDebXAD51VjqhH/cG+PU4m+uzSE+iOtn9VmctHBWtt97cTfA6X8rZz4nfWK ZRty+FoXes6F1OTLfK+sKQkKEPmPHcbUPfcHywvzGnsRvgJ+shz0cIpJKDak9XwKg4Sn 94lAt3KigQVfw5HIf5ISRA8t0qfc5NS39nSkKMvSZnPztif8jOsiw4rlkOy1VlaanTMe g03wP1MjPiVXDZcDHTIsEsmP/X06KDlDr6W3Uvq+Y9CaDnuZ8D+hxmYv0fxpBGcWXqL0 oeOcErIaIQLxbdqS2zo8oWCrjbQ9C7PJxHhg85QhZl5fm3/xPmGuHTfBVWPq8K5Ixg1C ohUw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699208582; x=1699813382; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=2ycZguZ3P3oeTnUy4y2L0ndN0vzmTX5Nt1qzxS/R+vE=; b=IBMk60swu1No5Ilu99c2rR9wVCnQk6xMEcdnRBReGM6AUTeOruz6rLgLcF78R5fH/C YCR2mUhsW2E5CT86+GyaU/JghDVcNacLz0KJSptMbutttx+wZcEd0lbnP7jikR2ksu29 VoRyWLaAo+5Z8aLFKJ83JfQgu7igYx28L/9GVjOq3Y1T4vqqma7VS7poqWO4o3KKNMnL Ho9awvooJQCPO3KbHu13gyO846kJUnbMmpzMF4ZW+21JS2H3se5dxDWcjSyo9Sni08wn +eege7X7VTnS7NonblnbxxxbUVHc0JuWm3fBl6XzuqPOGRFPbb1UVnP0Jvn/EJ/JuPx4 YZig== X-Gm-Message-State: AOJu0Yx64aIL/B86qOsQwZAINnkHGFaWkmaU5tr/E6/59skCGpjjpxXn Y2IwyhO7uk/bZiwYbL4bxqhZsRaogzEIz0zrG0g= X-Google-Smtp-Source: AGHT+IGb1ui44fFkQ+5oiQln60qG4r9z/StJ6u4lLdoqDiugbCTncrQMT+GGnG0fAq0Y6WOvJD8XhbV/bGK0JCU0cYA= X-Received: by 2002:a05:6808:2e90:b0:3b5:95eb:f76e with SMTP id gt16-20020a0568082e9000b003b595ebf76emr7933534oib.24.1699208582301; Sun, 05 Nov 2023 10:23:02 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Dmitry Kozlyuk Date: Sun, 5 Nov 2023 21:22:50 +0300 Message-ID: Subject: Re: DPDK 22.11.2 requires too much VIRT memory, how to reduce To: "Lombardo, Ed" Cc: users Content-Type: multipart/alternative; boundary="000000000000f28c9406096bd326" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --000000000000f28c9406096bd326 Content-Type: text/plain; charset="UTF-8" Hi Ed, DPDK indeed reserves a large amount of virtual address space at startup. This does not prevent DPDK from running on low-memory systems, since this reservation does not consume physical memory. So the large figure in VIRT is not an issue. Hugepages are mapped on demand. Each mapped hugepage consunes a file descriptor. If you use 2MB hugepages, the number of open files can exhaust the limit easily. If you don't want to increase it, please see: https://doc.dpdk.org/guides/prog_guide/env_abstraction_layer.html#segment-file-descriptors > --000000000000f28c9406096bd326 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Ed,=C2=A0

DPDK indeed reserves a large amount of virtual address space at= startup. This does not prevent DPDK from running on low-memory systems, si= nce this reservation does not consume physical memory. So the large figure = in VIRT is not an issue. Hugepages are mapped on demand. Each mapped hugepa= ge consunes a file descriptor. If you use 2MB hugepages, the number of open= files can exhaust the limit easily. If you don't want to increase it, = please see:=C2=A0https://doc.dpdk.org/guides/pr= og_guide/env_abstraction_layer.html#segment-file-descriptors
--000000000000f28c9406096bd326--