From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id C7BAFA00C4; Fri, 25 Mar 2022 16:56:33 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A10AB40687; Fri, 25 Mar 2022 16:56:33 +0100 (CET) Received: from inbox.dpdk.org (inbox.dpdk.org [95.142.172.178]) by mails.dpdk.org (Postfix) with ESMTP id 812BA40140 for ; Fri, 25 Mar 2022 16:56:32 +0100 (CET) Received: by inbox.dpdk.org (Postfix, from userid 33) id 6DD78A034C; Fri, 25 Mar 2022 16:56:32 +0100 (CET) From: bugzilla@dpdk.org To: dev@dpdk.org Subject: [Bug 983] [21.11] net/mlx5: increase in number of required hugepages Date: Fri, 25 Mar 2022 15:56:32 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: DPDK X-Bugzilla-Component: ethdev X-Bugzilla-Version: 21.11 X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: tudor.cornea@gmail.com X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: dev@dpdk.org X-Bugzilla-Target-Milestone: future X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org https://bugs.dpdk.org/show_bug.cgi?id=3D983 Bug ID: 983 Summary: [21.11] net/mlx5: increase in number of required hugepages Product: DPDK Version: 21.11 Hardware: x86 OS: Linux Status: UNCONFIRMED Severity: normal Priority: Normal Component: ethdev Assignee: dev@dpdk.org Reporter: tudor.cornea@gmail.com Target Milestone: future Greetings, I'm developing a DPDK application, and recently I've found myself in the ne= ed to upgrade from version 20.11 to version 21.11. I noticed that when I use a ConnectX-6 NIC in PCI-Passthrough mode it seems= to require me to allocate a few extra hugepages. I have not seen this behavior when I use the NIC in SR-IOV mode, or with other existing drivers. I've not seen this in version 20.11. I think I may have managed to reproduce the same behavior using dpdk-testpm= d. I am using 2 MB hugepages on my local setup. DPDK 20.11 - Mlx5 Driver NR_HUGEPAGES=3D200 mount -p /mnt/hugepages mount -t hugetlbfs hugetlbfs /mnt/hugepages sysctl vm.nr_hugepages=3D"${NR_NUGEPAGES}" ./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-4 --log-level=3D.*,8 DPDK 21.11 - Mlx5 Driver NR_HUGEPAGES=3D220 mount -p /mnt/hugepages mount -t hugetlbfs hugetlbfs /mnt/hugepages sysctl vm.nr_hugepages=3D"${NR_NUGEPAGES}" ./x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-4 --log-level=3D.*,8 It seems that starting with DPDK 21.11, I have to allocate an extra 20 hugepages, otherwise the driver fails in allocating the mbuf pool. testpmd: create a new mbuf pool : n=3D171456, size=3D2176, socke= t=3D0 testpmd: preferred mempool ops selected: ring_mp_mc EAL: Error - exiting with code: 1 Cause: Creation of mbuf pool for socket 0 failed: Cannot allocate memory I am trying to keep the number of used hugepages to a minimum, and I was curious if something changed in the new driver that could determine it to require more hugepages when managing a PF. I've tried to look at the PMD gu= ide [1] and then at the code, but I haven't really found anything yet which cou= ld help me explain the increase. The NIC that I'm using is the following: 00:04.0 Ethernet controller: Mellanox Technologies MT28908 Family [ConnectX= -6] OS Distribution: Ubuntu 20.04 [1] https://doc.dpdk.org/guides-21.11/nics/mlx5.html?highlight=3Dmlx5 --=20 You are receiving this mail because: You are the assignee for the bug.=