From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8BC17A0C46; Wed, 9 Jun 2021 14:28:22 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1604540FDF; Wed, 9 Jun 2021 14:28:22 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id BA5E84003C for ; Wed, 9 Jun 2021 14:28:20 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1623241700; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ETYTLTBJisLOl/QPJcUpLKmdU9OT2U0waWBbf28r/6g=; b=XD82ZM4yGQ3FdLmZuA1JTCatR3JY5bZv1EQkLOs5wlatChL4l2GH/4PGp4r5zez3jyh/Z/ BU2bxepEFb1G4dI5/jx+g9AwaM2/ZvOVnsN4VsyOvdaoLWjLldrwak8LcvYidtPbOjKkeG eLXQfNzd/U6NOtVTNq/7MkyAtLQw01s= Received: from mail-ua1-f72.google.com (mail-ua1-f72.google.com [209.85.222.72]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-210-DUmdbvBoPNSe7UeQVshQMw-1; Wed, 09 Jun 2021 08:28:15 -0400 X-MC-Unique: DUmdbvBoPNSe7UeQVshQMw-1 Received: by mail-ua1-f72.google.com with SMTP id k4-20020ab073440000b029024cae85c5a0so7903803uap.18 for ; Wed, 09 Jun 2021 05:28:15 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=ETYTLTBJisLOl/QPJcUpLKmdU9OT2U0waWBbf28r/6g=; b=L7iVwhLeCbbKbT8E9ZKiSppFPysVq7WAhnY0acWycB/R0pL2VWjIuMUO6aIGdfH40L r49wTaNqd/rVnTOse5BCaolyqpKK+tyILFzbmUv37LCqWBcDGbAKxTHzw367ZywIAZ56 ydUJW1Z9oC7s/AYu+HGIZH1/3xu+y2u2gfPF0CwE97zxOsoyBxD2rf34w3eTLS7ashPy S0TGEUZ6Epxqsg7F0Gi2BIVkm1OPdyKnRGNuNDecY/n2l6QRcf1jzsJmcs2ol7vEPQPU gh92rgTkFbPvwK/QdWY/3ahfScD5PZ2E28gGfdXgEVZYAPsVe+S7BMNWJE5XfYMrTptM GquA== X-Gm-Message-State: AOAM532Bb/bD3ZCnpSFv6syWrtcKefmLgP9GP5Fm53pyG7GOyy/YD7Pt Ic7D9b0A8nUM2dpzjWOY2O9s12KdcuAu77QaBxaGVh+XYCg5Lc7QloWR0NbeJOFNGZ4oBEaw18i sJl6zgXLFnwoQZnOSMUI= X-Received: by 2002:a67:7cc4:: with SMTP id x187mr4834461vsc.17.1623241695517; Wed, 09 Jun 2021 05:28:15 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzAj7n7Fnr+hXmkx5u2TxN+dZED3tqnULp7MtzHesQWioPko6jns6g2pHwrhq3srSdNJfnTxHK9mUJzXoXaW9A= X-Received: by 2002:a67:7cc4:: with SMTP id x187mr4834441vsc.17.1623241695326; Wed, 09 Jun 2021 05:28:15 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: David Marchand Date: Wed, 9 Jun 2021 14:28:04 +0200 Message-ID: To: Shanmugasundaram M Cc: dev , Olivier Matz , Guillaume Gaudonville , Jean-Mickael Guerin Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=dmarchan@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-dev] Reg 6Wind fastpath DPDK 18.11.1 virtual memory allocation ( 54.5GB of anonymous mapping) X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Wed, Jun 9, 2021 at 2:02 PM Shanmugasundaram M wrote: > We are using 6Wind fastpath(fp-rte) which is using DPDK version 18.11.1. > We are seeing 65.5G(preallocated during startup) of virtual memory for > fp-rte on a 32GB machine, 10G of that was huge pages (5000 mappings of 2M.) > > We found 4 strange anon (4K size) segments totaling 54.5G (16+16+16+6.5). > Note: we changed / customized memory CONFIG_RTE_MAX_MEMSEG_PER_LIST=24576 > and default value of CONFIG_RTE_MAX_MEMSEG_LISTS=64 used. > Kindly let us know > 1. Why are allocating 54.5 GB anonymous mapping > 2. When will we use it ? This is likely pre-reserved virtual memory from the DPDK allocator. This virtual memory won't probably never be used. But you'd better ask 6WIND guys as they maintain their own DPDK downstream. Copying a few guys. -- David Marchand