From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 317F8A00C2 for ; Tue, 27 Sep 2022 18:02:00 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2657441133; Tue, 27 Sep 2022 18:02:00 +0200 (CEST) Received: from mail-lj1-f176.google.com (mail-lj1-f176.google.com [209.85.208.176]) by mails.dpdk.org (Postfix) with ESMTP id B47E340694 for ; Tue, 27 Sep 2022 18:01:58 +0200 (CEST) Received: by mail-lj1-f176.google.com with SMTP id j24so11445581lja.4 for ; Tue, 27 Sep 2022 09:01:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date; bh=I6U20hKVqwrVuDWeeDDnOPEjzrikTcuXtg+oaSkhrKM=; b=Z8jB9SrOiZ/W2+OomaqUP3aUf/njFJ8F3ZlcZDhGTofr2uTJLbUNS+et8Cwbb1hb31 HrbRKoY0l596wz3ehbwtBRo8g5y0DFbBr95T2qAzLSHl5W/ZkWaOleXswR0locme83wv 4nkwSwwTGr4JNEGph0zNVUEpDMHMd+rg2GYtD+W7dOy0tq6XNpjc33GrHFXfOOp1YDgn 6E+vBH8fo6ZmatJ16f1gW2x20zUDZbytgC8MAFFWVQEvXf1PGjoNK1cLYANDLO+zgqS3 6QTJYwlGP0cWyFZ+pR715MUUZw/gtOWjhzHWhh8K7Zdm/3X8KUKYlZXoP7snKybLfmF2 YaYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date; bh=I6U20hKVqwrVuDWeeDDnOPEjzrikTcuXtg+oaSkhrKM=; b=ylzvSuFeF1l+KB2IwMcNhBv2RUl0Ns6LL6UpSju05shrfmmZBkGEOaavm4NF/8HY8r LUwlltWln7fTBNwpgsR/xkC4MG1Y2KaUZSvhOLKOcjXICw5TstwEgbQJQqnTq/ZckuWN 4MwnsRHazVEJUG3pk1At+860QwOtmNkiOwYV8pdnNzs4hgo8iv2fMKtc47W0YwsvCw+H UrDe5pfyyLG9A7ARhjxj3w+jcMbyhneWUyl5RlXXjHDdGrCfjM/4osLRt4IbYF9MuRzN 5lI6c65qPRUm3ikjL32MSKxdKpPV5G/MysSk4ROpjJ+PXJ1QNDG/Y/gxbGvzpLj7hj7U BXNQ== X-Gm-Message-State: ACrzQf01m6KGiY/Ch9vvEh86lLk/jPrgYGSv2IVt4Pi0alQ5WpiAVFE6 HXbi+g7yuUqu5Bfq0P8X+6c= X-Google-Smtp-Source: AMsMyM4u+0ACaMm/sgROfzRQoMl9HZjHCX5KeM201EcJe+bfO0I+hlSW+6XWg+kle9dkXABzplIszw== X-Received: by 2002:a2e:9447:0:b0:261:e71e:e3d with SMTP id o7-20020a2e9447000000b00261e71e0e3dmr9798197ljh.227.1664294518145; Tue, 27 Sep 2022 09:01:58 -0700 (PDT) Received: from sovereign (broadband-37-110-65-23.ip.moscow.rt.ru. [37.110.65.23]) by smtp.gmail.com with ESMTPSA id k17-20020ac24f11000000b004896ed8dce3sm201645lfr.2.2022.09.27.09.01.57 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 27 Sep 2022 09:01:57 -0700 (PDT) Date: Tue, 27 Sep 2022 19:01:56 +0300 From: Dmitry Kozlyuk To: Robert Hable Cc: "users@dpdk.org" , Tyler Retzlaff , "Dmitry Malloy (MESHCHANINOV)" Subject: Re: Windows mbuf pool memory allocation Message-ID: <20220927190156.31d59e0f@sovereign> In-Reply-To: References: X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Hi Robert, 2022-09-27 15:22 (UTC+0000), Robert Hable: > Hello, > > I have a question about mbuf pool memory allocation. When I have my machine freshly started, it usually works flawless to run testpmd. But after a few days uptime sometimes the allocation of the mbuf pool fails. Currently I get the error "Not enough space". > What could be the reason behind this that it works after a reboot, but not after a few days uptime? > According to the windows taskmanager there is still 32.8 GB free memory, and only 30.3 GB is currently used. Looks like RAM fragmentation. If the system is out of contiguous hugepage spans, --iova-mode=va should help. If the system cannot find contiguous RAM for a single 2MB hugepage, there's not solution that I know of, there's no option to reserve hugepages (or none that I know of---Dmitry, Tyler?) > > c:\Dev\Extern\dpdk\build\app>dpdk-testpmd.exe > EAL: Detected CPU lcores: 20 > EAL: Detected NUMA nodes: 1 > EAL: Multi-process support is requested, but not available. > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:01:00.0 (socket 0) > mlx5_common: DevX read access NIC register=0X9055 failed errno=0 status=0 syndrome=0 > mlx5_net: mlx5_os_dev_shared_handler_install: is not supported > mlx5_net: Rx CQE 128B compression is not supported. > EAL: Probe PCI driver: mlx5_pci (15b3:1015) device: 0000:01:00.1 (socket 0) > mlx5_common: DevX read access NIC register=0X9055 failed errno=0 status=0 syndrome=0 > mlx5_net: mlx5_os_dev_shared_handler_install: is not supported > mlx5_net: Rx CQE 128B compression is not supported. > testpmd: create a new mbuf pool : n=299456, size=2176, socket=0 > testpmd: preferred mempool ops selected: ring_mp_mc > EAL: Error - exiting with code: 1 > Cause: Creation of mbuf pool for socket 0 failed: Not enough space --log-level=lib.eal:debug would show which allocation failed.