From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80048.outbound.protection.outlook.com [40.107.8.48]) by dpdk.org (Postfix) with ESMTP id 322466904 for ; Thu, 6 Dec 2018 10:21:53 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=5k55BLsP4QtfwoUAsOjvSw9EcLbQELOtgoKmHCfrGq0=; b=p61x5LXfPFdixm80b2jsnNMj0gZKFWUtexjARA+6eNsFeeUUMDNzT2VMEVXgEhDCMLvmbJrVcUExsAYgTEmKbycBPTqQ58w2iaQxTP1uvEVZhi9OlKsyo/F8+VM9LeXTm2NPjVUseb+inzkGYAgCKy6NR6uR5cNKEqnePT/0oJU= Received: from DB7PR05MB4426.eurprd05.prod.outlook.com (52.134.109.15) by DB7PR05MB5036.eurprd05.prod.outlook.com (20.176.236.208) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1404.19; Thu, 6 Dec 2018 09:21:51 +0000 Received: from DB7PR05MB4426.eurprd05.prod.outlook.com ([fe80::f59c:f6f0:665b:8b16]) by DB7PR05MB4426.eurprd05.prod.outlook.com ([fe80::f59c:f6f0:665b:8b16%4]) with mapi id 15.20.1361.019; Thu, 6 Dec 2018 09:21:51 +0000 From: Shahaf Shuler To: Tom Barbette , Yongseok Koh CC: "users@dpdk.org" Thread-Topic: Unregistered mempool in secondary Thread-Index: AQHUjO2LmQco5PWHo0uingmMOU1mvKVxTSaggAAQ9qaAABImoA== Date: Thu, 6 Dec 2018 09:21:51 +0000 Message-ID: References: <1544053277210.30241@kth.se>, <1544084334026.77073@kth.se> In-Reply-To: <1544084334026.77073@kth.se> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; x-originating-ip: [193.47.165.251] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; DB7PR05MB5036; 6:r+L/ux9PZYor20GZR8rBiX5cg+TLVKJxoGiZkPamW0HorrZFXc6wXy68N91iW0ieMj8g7eUBfcEsQa5/Px2j5Xc68fGm38QSLKuVl29qVBN3E8mmAqOWCc6j5RsPV+xffMagF+0E5zYDJBwPnJcGrNXS+2xvStkOeirM829ozWgjtyXTh/vymwHkXQLtFak11LTj6E4A3uYjcrt/Tvt5n7kg1+PzZnWTysPC6DpTxQ9/OmM0vQFzq3AWWxWwRCeWWVxkleSE6W28I9fIcXMMh8M3u9X83FT6AdRibCncQwKDGUuD9gNsazOYwvf2U3V+Qmu8rtv8FTXdIJXhZQ2XDMZw/KeBm3LcLCN7rG8CC49PQ7XLqhvD7jQ7sqSp+eTobO+nDzfQEo0KmHKh0j1geHw8xfV764Trjkpr5hXc8NEMSBR1jiJ72fPriFDWWOqj1ADCjoxYlg2yAXTWmzoy4g==; 5:4NGMhAA+k9eUC/Wkyr+eCdIreymh/YAp0iSq9dU8qSJkNTHAZgAPAE+M9XDpRiyz/MkV43SMiZawqATN5ziXnnZwHQM04HaeNJ31UaF83SUoP8UF8qjxWPqUiCi5Gj5EnwFg8WbmsK4O9TuO0npG3Pzuwf+v9r1jgnh+MmboNXw=; 7:hUBzJNns1eeh7n10lFopY5UGJTizh0CsfQUPe/we8bl/MeB1RuIRNJ1AwppIRaNomcX9eHN8w/XzCBNVd8aGzOIPAUD4OSoh87rfOpGrIM6rX+x3tI1U9IfXleJIa0C8k0cd3C98pvU0xW5jSxUGIA== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 75294a4e-d726-456f-e1c4-08d65b5c41bf x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(8989299)(5600074)(711020)(4618075)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:DB7PR05MB5036; x-ms-traffictypediagnostic: DB7PR05MB5036: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(3002001)(3231455)(999002)(944501520)(52105112)(93006095)(93001095)(10201501046)(6055026)(148016)(149066)(150057)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123564045)(20161123558120)(20161123562045)(201708071742011)(7699051)(76991095); SRVR:DB7PR05MB5036; BCL:0; PCL:0; RULEID:; SRVR:DB7PR05MB5036; x-forefront-prvs: 087894CD3C x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(346002)(376002)(366004)(39860400002)(136003)(396003)(199004)(189003)(106356001)(76176011)(14454004)(6116002)(7696005)(790700001)(3846002)(3480700005)(2906002)(11346002)(74316002)(105586002)(7736002)(71200400001)(446003)(476003)(66574009)(71190400001)(236005)(6306002)(55016002)(6506007)(26005)(9686003)(54896002)(53936002)(186003)(53546011)(102836004)(4326008)(256004)(14444005)(99286004)(6246003)(6436002)(33656002)(81156014)(486006)(8676002)(8936002)(5660300001)(81166006)(66066001)(6636002)(229853002)(86362001)(25786009)(478600001)(97736004)(68736007)(110136005)(316002); DIR:OUT; SFP:1101; SCL:1; SRVR:DB7PR05MB5036; H:DB7PR05MB4426.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: G0M3aPPP47rBH3AVhWxsscfuRZKyqQjlpM7NNp/vJv+RM/TH716kaWpnYGJBlZhDn22bmTF+R6rogCg+Dsd0SBlAfebVl8GQwCPuBDa2rMCKoR2ckorz1xdBv3R7SCnMgZ09gKbarxaqUx+QUDWqSfhqXz2Bi61WqpIlYu7yLP9VRpciIMxWX973e+TWBA98RDQydr5PitF8OjilGUwBJjnVoXXIH6uTiHM7i5HkapSDC++cYR/ct/6CK5ILe9OONFKZrbfGn8DpHwFo2O+PCIy4U84zQL+7rwIeWDZPk6haWDX22/hULFMk2mPgFzs4uq1E6sMRuFywsFvy0x8aSYm5MDvkHFkXZU6X7+S0KpU= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 75294a4e-d726-456f-e1c4-08d65b5c41bf X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Dec 2018 09:21:51.6935 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB7PR05MB5036 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Unregistered mempool in secondary X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Dec 2018 09:21:53 -0000 Do you reproduce this issue w/ testpmd? Can you provide the instruction on how to? From: Tom Barbette Sent: Thursday, December 6, 2018 10:19 AM To: Shahaf Shuler ; Yongseok Koh Cc: users@dpdk.org Subject: RE: Unregistered mempool in secondary Hi Shahaf, Both devices are initialized in the primary with rte_eth_dev_start, and que= ues also (each with their own packet pool). It's just that the secondary re= ad from the initialized queue. If you're mentionning something more to do, then I did not understand. Whic= h function would that be? To ask port 0 to register port 1's pools and vice= versa? Thanks ! Tom ________________________________ De : Shahaf Shuler > Envoy=E9 : jeudi 6 d=E9cembre 2018 08:18 =C0 : Tom Barbette; Yongseok Koh Cc : users@dpdk.org Objet : RE: Unregistered mempool in secondary Hi Tom, There is a complete isolation between the resources of each port. Meaning, mempool cannot be registered on one port and be used on the other = (w/o explicit registration). In order your solution to work, the primary process needs to probe both por= ts, so that the mempool_walk will happen on both and the pool will be regis= tered to both. From: Tom Barbette > Sent: Thursday, December 6, 2018 1:41 AM To: Shahaf Shuler >; Yong= seok Koh > Cc: users@dpdk.org Subject: Unregistered mempool in secondary Hi mlx5 maintainers, Since we're using a second ConnectX 5 NIC plugged to our second CPU socket,= we see the following message when flowing packets through that port : net_mlx5: port 1 using address (0x6000712742c0) of unregistered mempool in = secondary process, please create mempool before rte_eth_dev_start() The secondary process has all of the primary process pools registered via r= te_mempool_walk (2 as we have 2 numa nodes). But that address in the error = message is actually not between any of the pool->mz->addr_64 + pool->mz->s= ize range. So maybe this comes from an automatically created pool of the pr= imary ? If so, how can we force it to be created before we call eth_dev_sta= rt? We think the only change is that the second port is now a dedicated NIC on = the second socket, instead of the second port of the same NIC on the first = socket. But we are not 100% sure this is the triggering event. The same tes= t worked before, still with DPDK 18.08. Thanks, Tom