From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60064.outbound.protection.outlook.com [40.107.6.64]) by dpdk.org (Postfix) with ESMTP id 85898F11 for ; Thu, 17 Jan 2019 02:45:42 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=F/ZKPa8yfBfdUui5/+xVA7YgMqUgyDGkDQ2H3sPNb9U=; b=Tom0ikG8ayc6X9D8oA+SBQV0kOAWLN9piS2bw+kn23pMJsu9z/qQQlla57KlmR5v4sFip3x8vU+ANPHqpzryq2h0tGlN5A/MuMmMROp0xvyJhHcNYhbNQGzL2+Tp323eBE+OFpXS9fEuE16CLKX4vwnmR/eBomxuuUUCGdQ3X24= Received: from DB3PR0502MB3980.eurprd05.prod.outlook.com (52.134.72.27) by DB3PR0502MB4042.eurprd05.prod.outlook.com (52.134.68.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1516.18; Thu, 17 Jan 2019 01:45:41 +0000 Received: from DB3PR0502MB3980.eurprd05.prod.outlook.com ([fe80::1da8:cd09:4e78:111c]) by DB3PR0502MB3980.eurprd05.prod.outlook.com ([fe80::1da8:cd09:4e78:111c%2]) with mapi id 15.20.1537.018; Thu, 17 Jan 2019 01:45:41 +0000 From: Yongseok Koh To: Amedeo Sapio CC: Erez Ferber , Kiran Vedere Thread-Topic: [dpdk-dev] MLX5 QP creation failure - cannot allocate memory Thread-Index: AQHUrd+eAfJjJem7T0CFah20QuE6IaWysPOA Date: Thu, 17 Jan 2019 01:45:40 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=yskoh@mellanox.com; x-originating-ip: [69.181.245.183] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB3PR0502MB4042; 6:q+h1Ll8kZGQEvm3NJ6D21pYr1/9YWvzntkR7heIPvWvHGFn+Bm2mDUhbyEfAyMwrebZNgaeWi8eKBvhxJWqnoP/vsxhVe/phDmoLycHsH9zD+9bfhxr2TjTPSKkHohU0m64odjSSHjJVBeumui2KidQOU1bgC96smZ7+3COCaIGvtrP/fklwQEsbJr3urP0JlWfK6ELYbmU0Wxx9DAOKx4joL3s1K1090ReRa29KVp1/pp+H8iNiEOJrxuAgg5HW2qZ8BQkpv0mX8DeZDwMJePxBhBBA7Uk/eEkSdlXG79It3AMuaC9od0bhZxte1VHxb+1RhhjMFXFg9eZPQHhg35KXTJHdxgC2H2vZRhyI5uAre/attLTBza5G3VQPn5XEouh8egWbt+1gUrI/axHEKNwZYQ2qXbT6nxCC47Wap6rruE+36Zdr6BdT+SLvMUSepFdq5zXPz+rLYg4C9WF/iA==; 5:aueRHvix3cp6BFbis4ZqIMkCMTs98u75JpLHzXSGrtuNyOSmymQzM7PRUubBhRc64D9lNwa27tFJzl44AoW4/+qngQ3/qvZA9VfwisxY9Q236hnLvR6bc2uTPlOMROzcBLPEIYFlHVJ9ltAgmfCy+uEw2jNTqSMoB3k8u6VngrHDOdddEEdYQ6StZDS4KHSDacAKSuQzVDLcZU1cB7tx2A==; 7:QKWNcNYQpR25+SEJet8ROjOx4IBIA7Zv4TDrHCqhIa58G2toqpyODtpehHXVNf1flFci8UEdGZ4YxxURiFCGR8Onqwys79IjjoeWquGxGVajXCvYB4BQqjMeqmPe3NUZAWLjCpNdOnfC5lEL+1pk/Q== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: fadc3a6b-6430-4dd0-0c4d-08d67c1d7cdc x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600109)(711020)(4618075)(2017052603328)(7153060)(7193020); SRVR:DB3PR0502MB4042; x-ms-traffictypediagnostic: DB3PR0502MB4042: x-microsoft-antispam-prvs: x-forefront-prvs: 0920602B08 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(396003)(39860400002)(136003)(346002)(376002)(53754006)(199004)(189003)(36756003)(106356001)(71200400001)(71190400001)(105586002)(83716004)(8676002)(316002)(8936002)(478600001)(446003)(2616005)(82746002)(25786009)(39060400002)(256004)(14444005)(476003)(33656002)(6916009)(86362001)(4744005)(11346002)(4326008)(97736004)(14454004)(186003)(305945005)(53936002)(102836004)(68736007)(229853002)(107886003)(81156014)(2906002)(53546011)(3846002)(6246003)(5660300001)(6506007)(7736002)(6486002)(81166006)(6116002)(26005)(76176011)(6436002)(54906003)(66066001)(6512007)(486006)(99286004); DIR:OUT; SFP:1101; SCL:1; SRVR:DB3PR0502MB4042; H:DB3PR0502MB3980.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: TqFaJe+/m8K0UK3xGZ1llfAC7SKf18+WZ0qM6H/AI1L4La7wFa8Rwp7OLQVzAa2etF3u4ExPZs5URdeFjj+WJa5JiXp5P9R5yb+2i2EY9lC0Tg3FLiCLG3r88j0OxQmnkE6A0FB5JyKBeSRXqDvQXFDKW4K64mQB0VI1DZ4I90ltWVj/sIiezg8T2gTxnoTXcOy2nCJ+X3wtVWG8ejYL+nhQ9MoUCfCVzH0lqQWS44BZu9W7aYzAw+oFiB9KmswuT7B7dMJRr5dF16ozIugYj1MRxeDJHSHPeIzQwy8sOcwuQn2qe3XoaJKYtZHr64laeqe6QFIylhcfnRjEvGPrvfmbJHRI5kuuyBV6CnSmE+H0f/LDkD96f+ddwcqLLyU6AlQdfW2aTtDnexLF2Rgi5kVg6CHTT5ZAbGo3h6ZEa2w= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-ID: <0E8799B8D0FFBE479077D790721D42A1@eurprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: fadc3a6b-6430-4dd0-0c4d-08d67c1d7cdc X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Jan 2019 01:45:40.9234 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB3PR0502MB4042 X-Mailman-Approved-At: Sat, 19 Jan 2019 00:14:28 +0100 Subject: Re: [dpdk-dev] MLX5 QP creation failure - cannot allocate memory X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Jan 2019 01:45:42 -0000 > On Jan 16, 2019, at 1:07 PM, Amedeo Sapio wrote: >=20 > Hi all, >=20 > I am developing a DPDK program using a Mellanox ConnectX-5 100G. > My program starts N workers (one per core), and each worker deals with it= s > own dedicated TX and RX queue, therefore I need to setup N TX and N RX > queues. >=20 > For each RX queue I create a mbuf pool with: > n =3D 262144 > cache size =3D 512 > priv_size =3D 0 > data_room_size =3D RTE_MBUF_DEFAULT_BUF_SIZE >=20 > For N<=3D4 everything works fine, but with N=3D8, 'rte_eth_dev_start' re= turns: > "Unknown error -12" > and the following error: > net_mlx5: port 0 Tx queue 0 QP creation failure > net_mlx5: port 0 Tx queue allocation failed: Cannot allocate memory >=20 > I tried > - to increment the number of Hugepages (up to 64x1G) > - change the pool size in different ways > - both dpdk 18.05 and 18.11 >=20 > but with no success. Do you have any suggestions on what could be the iss= ue? Copying Erez and Kran. Thanks, Yongseok=