From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 011C3A0C4D; Mon, 4 Oct 2021 18:36:43 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id BCD8341387; Mon, 4 Oct 2021 18:36:42 +0200 (CEST) Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70049.outbound.protection.outlook.com [40.107.7.49]) by mails.dpdk.org (Postfix) with ESMTP id D08D941385 for ; Mon, 4 Oct 2021 18:36:40 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=o8pVEJUSvFzzxGu8fRqYtlo/cTqW9zFQENoJl/4fh+s=; b=UfHdHN7GwyEYlSW1wSS/Mljdar5P/HQXXziDX1Wupo+F3UhW1d2c+UgoSSOVhIj+XdOTEINHzhzzKcB2GXtm4ZnRz+apJAT6p4GgbcYQh3qXdj98ispxy9BXnytyIUQtO3Guwk3hYxVqUJGbPIfUvTZWh6andUEpgfc2szRn0r4= Received: from DB6PR07CA0100.eurprd07.prod.outlook.com (2603:10a6:6:2c::14) by AM0PR08MB3396.eurprd08.prod.outlook.com (2603:10a6:208:dd::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4566.19; Mon, 4 Oct 2021 16:36:28 +0000 Received: from DB5EUR03FT019.eop-EUR03.prod.protection.outlook.com (2603:10a6:6:2c:cafe::6b) by DB6PR07CA0100.outlook.office365.com (2603:10a6:6:2c::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4587.11 via Frontend Transport; Mon, 4 Oct 2021 16:36:28 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.33.187.114) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=pass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.33.187.114 as permitted sender) receiver=protection.outlook.com; client-ip=63.33.187.114; helo=64aa7808-outbound-2.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-2.mta.getcheckrecipient.com (63.33.187.114) by DB5EUR03FT019.mail.protection.outlook.com (10.152.20.163) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4566.14 via Frontend Transport; Mon, 4 Oct 2021 16:36:28 +0000 Received: ("Tessian outbound 173d710607ad:v103"); Mon, 04 Oct 2021 16:36:28 +0000 X-CR-MTA-TID: 64aa7808 Received: from 463a31b4c490.2 by 64aa7808-outbound-1.mta.getcheckrecipient.com id D3DA3A3C-D470-48A2-B347-BAFC12AB4D8D.1; Mon, 04 Oct 2021 16:36:17 +0000 Received: from EUR05-VI1-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 463a31b4c490.2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Mon, 04 Oct 2021 16:36:17 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UsoUGqzyjcQLtgfG+GHbLn+AepOSLjN37g08SGR3h8vCwa7aAYA58KskrGS5Il6nRD67ZLMiV4q9F+mRcGL5PKxCQWWa5TPNfS4ZEkkxpPxKveCkZiUPBaikEIU16Uf18DJHMKat8HVAxm/8UrOqcNgAuLfm8F1m9gJmC+Gbs0J6Wb1942YhbvUjecU6ZDS/lDJPIONS42+WivfKvrEsAwvLipTmNhCpTxuMCdGbhNq6OwsQBQEYT+XECoXNRxRbdDobeorXUjXX2wpb5xNszfcR/UvsLzyfCo4a++qKnXvF5Ik6ebxzJ7MZfCIXA1AByRD7UN4eLIWRtI3Dv6B3rg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=o8pVEJUSvFzzxGu8fRqYtlo/cTqW9zFQENoJl/4fh+s=; b=n24TPoArVfvcryBA1MeL5101cvOkG/FMilJwa4xWanCaes4FllpCQBBU2k6QzlvBNu3BgBmsbgGhi8yxesh2cqS4+r3t2YGToeTVxKZs6fDIRqFGEIfULS+Jf1rCK5xy3ZauABG8HEDdu27R0kbPcQYSwG9BXL3cnhZXWUbjBBtpLIeNdnTpWa2baGwzT/oUjt67sEhzm4DEVCmytwu1UTf7FXg5YHzayjw40+s3JDPDGIJnMedJ1j62urQ7xRFvk3L7iEM6ZowsYvfD/cLUzBYGKOybbFyACt1BXWlCRoK20b2kB4vYWyD/R5QI/h2woD6ykDaaM5orz8nqJrI1OA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=o8pVEJUSvFzzxGu8fRqYtlo/cTqW9zFQENoJl/4fh+s=; b=UfHdHN7GwyEYlSW1wSS/Mljdar5P/HQXXziDX1Wupo+F3UhW1d2c+UgoSSOVhIj+XdOTEINHzhzzKcB2GXtm4ZnRz+apJAT6p4GgbcYQh3qXdj98ispxy9BXnytyIUQtO3Guwk3hYxVqUJGbPIfUvTZWh6andUEpgfc2szRn0r4= Received: from DBAPR08MB5814.eurprd08.prod.outlook.com (2603:10a6:10:1b1::6) by DB7PR08MB4219.eurprd08.prod.outlook.com (2603:10a6:10:34::31) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4566.19; Mon, 4 Oct 2021 16:36:14 +0000 Received: from DBAPR08MB5814.eurprd08.prod.outlook.com ([fe80::8501:86ca:a393:17b7]) by DBAPR08MB5814.eurprd08.prod.outlook.com ([fe80::8501:86ca:a393:17b7%7]) with mapi id 15.20.4566.022; Mon, 4 Oct 2021 16:36:14 +0000 From: Honnappa Nagarahalli To: "Ananyev, Konstantin" , Dharmik Thakkar , Olivier Matz , Andrew Rybchenko CC: "dev@dpdk.org" , nd , Ruifeng Wang , nd , nd Thread-Topic: [dpdk-dev] [RFC] mempool: implement index-based per core cache Thread-Index: AQHXtwuB3FbH85c80U2vmaazO82iNau+1ETwgAE6tgCAAv3qYA== Date: Mon, 4 Oct 2021 16:36:14 +0000 Message-ID: References: <20210930172735.2675627-1-dharmik.thakkar@arm.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: D138BE051FC18347B2F5B90D393AB5D3.0 x-checkrecipientchecked: true Authentication-Results-Original: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=arm.com; x-ms-publictraffictype: Email X-MS-Office365-Filtering-Correlation-Id: fb84f5a5-42e4-4270-810f-08d987551d80 x-ms-traffictypediagnostic: DB7PR08MB4219:|AM0PR08MB3396: x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:8273;OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: qolUL9tGNjJ/3Sho50nCfLwR1hjBbi+chri96ku2izrRgg9By31AiX0eUAad50vVKrqiqjJHRel9hTs/GogrKUj4yNdhMyeznBuI9nuljsaOPNIrdnPvESwsUNCmIlT3mo7vcZ059GD3X2C5wSbL5QjeykdHE5pTqGJ33bLfj/WUZUb4uZWc80oXIwMNmXfd6FrtYyJoKAUNMgjLrQXRygR2/jaYbvXCNFQOIJROrQR0x7i7h9oLPMnD686g0JXAsEVFZdqx9E+cBDaPuUoKIK4eg0h8wAKz2OFsrMYk8pnyEpQbjamNCf2zHbPH/I/xiY703neXbbiBhonhPp76+iHBnUdnVkeIkC1CwkQ7GVMk1RhZAu3Pn3HXiR+rajByXV4VqUHg917Pbo+94SGn7BrD00eVEq2b08+AGsrxoA6cFlN25BtQiVqeaNHwPe7dwDuiPvlS0JhEPwYbmEDkNDzZjcqQpc9W30tCzLIuXVHV7CKq6bul14BwU+SJy3eBLiZYB0lhOcvZ2M1IJIvY975ZpASYabwhXZTdKFgWw7XGvmW1p3E07C5mpM0v21FY+O5jpJvN7BXZc0zDKRp4y+YtXa61/8zNXaEAv+0rumL5KWjZxZAZgaVy5OFuFO03/2KeiANojZDLykoMs7dkXtrJct2Qt7Vo2au34n/3/eMmw1Ty8pvCsX8a8suQztTeiUDkgVuMZiEt+ugl2Okhcg== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DBAPR08MB5814.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(366004)(4744005)(86362001)(2906002)(7696005)(8676002)(38070700005)(110136005)(6506007)(54906003)(52536014)(71200400001)(4326008)(26005)(9686003)(55016002)(76116006)(316002)(66946007)(5660300002)(66556008)(8936002)(33656002)(64756008)(66446008)(122000001)(66476007)(508600001)(38100700002)(186003); DIR:OUT; SFP:1101; Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB7PR08MB4219 Original-Authentication-Results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT019.eop-EUR03.prod.protection.outlook.com X-MS-Office365-Filtering-Correlation-Id-Prvs: 226611b1-a2dc-4b46-1b8f-08d987551532 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: mbU+C3roS6BsNSuahTRmSRmh4lzw1g7XZWFOWPh9xNZxibNRvv5b6vvKg1eymOlLrqsm6oj6AgucgnYSpp5qCrHg1QCzV5ClbPkAuCPLJBlkH1OalM9jyQ05v0pVdJwW+xsjIiunus9DBPkOi0v8uuX/nNs5Jc02rRuvaBXxEUzlZigzA0YTJrfw3p7bzt8wo+1keuWs25OIW6vOO1Txb2/t7KIXhh6fzuwhNMYyNLrtYFKifsGNCF8cu8txJzOs2x/NS7L5QnP/qCdVR1ONH+QcniyNAqBvhltLhbkPxcEHMWgYEvsFU/jZHzHhBDBPtvFTyl1LkClEBqFxaXDQOQyi6wfD7tHapoq+lUJMe0mM5lQQ5kxggg6NHHkpvuqhee76/SOSoCkofsVSZVHEwq97U/rUTj9n/0YdT0m4eySUGfPrZvVzmNZlU24lnAMrn055urf/zvFJ5fwB35pS11pkyTraIMQLCgtTiyyW1CtoPAq5prC6VN3v9CxkZIsRzCyk3Hr7y9t0x+pC0R+ujtXpEXhIlBxwRbMYZCID4JnMGamFMEeIp+Tiqs+n41ArYI4FHWjLREzjryNpyCjYV5mom3GOsWsqPmGilhX9MqFV/N6tCQMsgtZK67pO/I4IfS0fgy0NdrODpozQn2TK46VhGNoLEVrpDUmvZggayJz5U/tFQupYNcpXdF+qNv2V1LOJVU5q7gHqRFJcp/IPkQ== X-Forefront-Antispam-Report: CIP:63.33.187.114; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-2.mta.getcheckrecipient.com; PTR:ec2-63-33-187-114.eu-west-1.compute.amazonaws.com; CAT:NONE; SFS:(4636009)(46966006)(36840700001)(86362001)(7696005)(70206006)(70586007)(2906002)(508600001)(26005)(52536014)(5660300002)(6506007)(4744005)(81166007)(186003)(8936002)(356005)(8676002)(4326008)(336012)(82310400003)(47076005)(316002)(54906003)(33656002)(9686003)(36860700001)(110136005)(55016002); DIR:OUT; SFP:1101; X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Oct 2021 16:36:28.6486 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: fb84f5a5-42e4-4270-810f-08d987551d80 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.33.187.114]; Helo=[64aa7808-outbound-2.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR03FT019.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3396 Subject: Re: [dpdk-dev] [RFC] mempool: implement index-based per core cache X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" >=20 >=20 > > > > Current mempool per core cache implementation is based on pointer > > > > For most architectures, each pointer consumes 64b Replace it with > > > > index-based implementation, where in each buffer is addressed by > > > > (pool address + index) > > > > > > I don't think it is going to work: > > > On 64-bit systems difference between pool address and it's elem > > > address could be bigger than 4GB. > > Are you talking about a case where the memory pool size is more than 4G= B? >=20 > That is one possible scenario. > Another possibility - user populates mempool himself with some external > memory by calling rte_mempool_populate_iova() directly. Is the concern that IOVA might not be contiguous for all the memory used by= the mempool? > I suppose such situation can even occur even with normal > rte_mempool_create(), though it should be a really rare one. All in all, this feature needs to be configurable during compile time. >=20 > > > > >