From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id C2864A050D; Tue, 26 Apr 2022 23:01:26 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 657C441109; Tue, 26 Apr 2022 23:01:26 +0200 (CEST) Received: from EUR01-VE1-obe.outbound.protection.outlook.com (mail-eopbgr140089.outbound.protection.outlook.com [40.107.14.89]) by mails.dpdk.org (Postfix) with ESMTP id C0FF840E78 for ; Tue, 26 Apr 2022 23:01:25 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JuLRr17cnMX5MWD82st4RUj9licMxCxPQFJ5mic2fkFtvnCd9UJIc+tBIMH+pgnH6dUmjUAGbC/jvUK3ocMT2kVm4UUhLV7HGoWhAI0Zxtu0Rncv7dJH+x9lbiuUbCrXc7mL2vPg8GC9n7S19dltyBKRwiWAROL9f0ebLAlSapliWpa2QuDYrAOlgrIeb4qhDcgqFv8hHgutqahDwn+kzP2y0A5VcovTVaswvVoHUScCF4FsBOTeiIHIN8kDpv5o0nVE8Cw4ERao0H9C5//BMixg/s9uReEZ3HIZRdqHG9Zet27qUigFCrBj/I709d8Yd2jE5pONoo5+N5PNN6qLgQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=kfXwGz+/GBCF5bcfh0IhDMM6GHpkBdVTt5EKErh1u6k=; b=cSvZ4MqPvDeuniL6a+1KcI1BWtRiR+h7upTG14cwdGUThG6up7ak3xoWjpcztAPCEu0NMxtVQAoQRbRM8RTV2Bmjds2OurCF8Lox7RPfCQ9lLWEdjJyoPh9AkkT7OPO3b6hW8p9v1u0UK6TWYgP0cg1Z6JINcyprXIk+tZsg4tKNU1ukB2eABZGv51WpOfZwMe+GNVSMMlWl5/WxQwO1afU33adQeEeoY3iJW5NecrrMlC4R9NoxdCrIor0azuiIrPeUlsj5IgnXoWxJaV5rHN2v9x5TE1WeBH3ImslpIcKVKbAufWosuevrc2t8Q3DGlto2X+Yis42Ida635V7yqA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=xsightlabs.com; dmarc=pass action=none header.from=xsightlabs.com; dkim=pass header.d=xsightlabs.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsightlabs.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=kfXwGz+/GBCF5bcfh0IhDMM6GHpkBdVTt5EKErh1u6k=; b=bzeNOW9uUmak5XFcwBKEe3X2DvVmDr6XULhfULVB0Nh+am94PGJ4ygq5W8uDvgMFPoWV/kdyn/XD2f6PhsFC5NAq56bMOHAHgXfuCLsyOR+obc1WMlzwyjyxDj6Yfk4K+9iFYfkraJrEyXkQR9GEEP8So87Q6SbrzphyeSkWv4Y= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=xsightlabs.com; Received: from DB9P193MB1482.EURP193.PROD.OUTLOOK.COM (2603:10a6:10:2a6::7) by PR3P193MB1040.EURP193.PROD.OUTLOOK.COM (2603:10a6:102:a1::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.14; Tue, 26 Apr 2022 21:01:24 +0000 Received: from DB9P193MB1482.EURP193.PROD.OUTLOOK.COM ([fe80::281a:860b:67a1:2cd9]) by DB9P193MB1482.EURP193.PROD.OUTLOOK.COM ([fe80::281a:860b:67a1:2cd9%9]) with mapi id 15.20.5186.021; Tue, 26 Apr 2022 21:01:24 +0000 Message-ID: <53a03de6-fb78-986e-64f6-890b08321343@xsightlabs.com> Date: Tue, 26 Apr 2022 17:01:18 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.8.1 Subject: Re: [RFC] eal: allow worker lcore stacks to be allocated from hugepage memory To: Stephen Hemminger Cc: dev@dpdk.org References: <20220426122000.24743-1-donw@xsightlabs.com> <20220426075858.2c28f427@hermes.local> From: Don Wallwork In-Reply-To: <20220426075858.2c28f427@hermes.local> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: VI1P195CA0039.EURP195.PROD.OUTLOOK.COM (2603:10a6:802:5a::28) To DB9P193MB1482.EURP193.PROD.OUTLOOK.COM (2603:10a6:10:2a6::7) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e33d9321-ea90-4d75-66c4-08da27c7ec13 X-MS-TrafficTypeDiagnostic: PR3P193MB1040:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: LoJ1+ra6QLln3/dznSihHUj1x66UlSV0Z1eF9VKpBEqpmTecUqQQJMopwVnc7CMNM3RG9nIrnmK4XQlTyuFeWXh71dXh/1Azlo/l4Og9MED5udokGn5ZNg7tE/IMiTY8BalrXkQnIiyZ8gfRSOVJBhKMiNUIeVk+Q8dae/7h07V078Tx0SelU0tpgPl9fQwl9Ldf6my9NuCi6EWkAaXQ6vdn23AYfv7p6J+xjcGUT1XkQomq/UxlW/ci2xVHZuFQVYrCk6MrtrjcPCbhjcrwahyHt+5X5LFxUzAyVRk1ASK/prAkI7nErMDo0B7cgJ5Ic4RYuRzsNHpHBh1il6e1kNg+93SlT6skZaG/MSx9o15GeD6BF5gVTYj3tO1lMIT/ALHqOR+FqI1YJhKpA8IsbE/XrQJBogdtlfrfYgA1TgQSDatImwXUgDByW5CsXgavoZqRwQqwgRstjWuc/E/+Y8L/9dcisyfL3iak/A95qcYvZnPZz/d9O7Rwkw7amZPXnUpDb/RlDn2LE357mW0nWSRhGeIJJXyxuYTilpChE66qzRLJ3lZlHKwIqlcYydhv9QkZAyloyMA83V9aKnIJRbrPgfmUMuOrWaIrUER3YzQdLYEXzDLa3zTnqSLV3Zl4H+Glas9btu9osLPlmHLuvF+/CanwB3NffsaqRREmBFzp93qI+HQr/JCPUx6J0tU3nGtYAuOD0zxdgiEgOEzI0Kc6LgtDE9H+0KfOW18xYFcS/hNUmrGw6Q95qqik2mXuWrDwsxpyRwwCEvqewfwh0w== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9P193MB1482.EURP193.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230001)(4636009)(366004)(5660300002)(316002)(83380400001)(4326008)(53546011)(8936002)(6506007)(31686004)(2906002)(66946007)(86362001)(36756003)(31696002)(8676002)(66556008)(66476007)(38350700002)(38100700002)(6486002)(6666004)(508600001)(26005)(6512007)(52116002)(2616005)(186003)(6916009)(43740500002)(45980500001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?QndXOGZLbFhiNWtITFFTWEVsRzlzeWU2c1MveVU4Qnlia3dXV1M4Z0NENUNt?= =?utf-8?B?UVhjQXZ3RS9NWUN2SE5LTUJWZGNDRm9rVm55azZVRGp5dElSdjhreEpVazU5?= =?utf-8?B?V2lvN1FKK2szTWxNcVFtZnhUS1JCbWVmZFI5Sks1UnVUVkF2cExsWHNTaklG?= =?utf-8?B?VW5WMythZFRoNnRVM0lZOFJmVDZ1T1hnMkppdHRiRnFvSjgvRUpSanl5T0p4?= =?utf-8?B?Tk56VGx4RmZ0czhzWUtJMmhKWVczNHVORUc0LzZ3UC9PWDIxbDc0QmJld2k2?= =?utf-8?B?SUxYSEsySVJpUld1RmtGMndqc3NnZm1nNXk3RXlNc3RvMjNoclIwZ0RPUjQ1?= =?utf-8?B?ZWtUdVZuYW5sd0Rmc2xPWW40cytzYzJBRTZzQXRZSSszOXduOHY4NlJHOU4x?= =?utf-8?B?YWNYN29yeTNXUlR4Z01QV0NVTFF4aHF0UlZ5WmVLbEJqOVYzVjFSeDVQT0Q1?= =?utf-8?B?UXdyQlRFa2ppN01UeEZZRzNyMURlczRyM3VKQVlvckFXdW5EY2ozaE04bFZU?= =?utf-8?B?a1VEL0RqVDFyUFZzMk1JVC84elFSK0lGU3lvVTRMU1hCSCs5SmVBNFhWSThN?= =?utf-8?B?WXJTcEN4cXcvaUdSOUd0TnVaM2JhWkF3TGFUc2RUcDVNUktJVG9nM0kydUJK?= =?utf-8?B?QThmUGZ4a3hPeDc4NmtzeVF6eHVuRkRmQ3AxcGxjWUdEN1lidGhRU0wzUDl1?= =?utf-8?B?d0o3K25zdWIxQTFXdjQyTndPZ0FuSGJLMWsxelRXcTczSGNIeU01YzFIeVcx?= =?utf-8?B?TEtZSU5EVEpia0Z0MjJubGRROXJyRFNveHlUanZIV0EvWStEb1RBazY0T3Vy?= =?utf-8?B?Y0hER1c1eTE1Y0RWTUlvTGR6WlJNL24wNFRmd2xNd2JwNGZudnNjVXY2d3JV?= =?utf-8?B?R0cwNGsvSUY2a1V6Sjh0UFFVOFdmak5xT1FPdWtFNEJiUlMySjVyM1gzRTVt?= =?utf-8?B?QW9nZ1pMbStBd1FmMmoraU1oeE1POXpkV0MzUnd5QTZCTnVaQyt6MzlOWWdC?= =?utf-8?B?ZGhBN0oySUdxbzA4NjNhcXRwUW1hYm9pOG9SUVQyRUdVbmVGN1AreFRPOUhE?= =?utf-8?B?VXJFK3piakhzdGFlMmcwdWF5ejR6VzJrSnF0UEdUQzlDejQ2U3pDcFVWcHFQ?= =?utf-8?B?V05FR3Y2M3lyajVWWlNZOUxkZUhVbUR4NFdKVmFlTzRNK1pWN0dBZVNRRUpS?= =?utf-8?B?Q3d0bWNyUlMrbm5xUG9pV013ck5SdzZnT0FZTUNyclBWbm1QYjBCcWRzN0dh?= =?utf-8?B?K1ZMbXNUdlRITTNmSG9CaEY2bGRVNUJETWRqeUdEQkRDNTliUzRKT3Bkbmti?= =?utf-8?B?dGNuMjVQR3NidVBQb21XMGFLMHN2d3ZUcVRXQUpGM3cvT0J5SlhJbU9TTE5v?= =?utf-8?B?cDZ6U3dVL0M0dDR4RCsxY2Joam9EYWRSQkU0NjArL05FamhsTXBvU2I5MGpq?= =?utf-8?B?VG54RUU1U05NWGtlR0srU1JVRHJkR1BpT0VyekpwVlBMVnAveHJWYUZDWCt0?= =?utf-8?B?bkxneTFhTnZWLzlVY0tNekhBeUhrTDNGUDRpZ1RPU1hBWGgrNXFSaW11SjBW?= =?utf-8?B?OHNSNEc5UmpHYzQ4Rk1HWk81UWRRR2lwUVFFVnQ3QjZEOGp6SFkzUXhOWVVl?= =?utf-8?B?Mkg4WmQwd21Wc1Uwd3Y4Y0E2YXRQSWZKRjNMNGVuOWZHM0YyUWcwSlY1TTE1?= =?utf-8?B?NnQvMlZEWkIzNTJvMHQ2S2tyWlY0NDluZ1FSNFgya1hEdGNMYWdaaXMzL0Vk?= =?utf-8?B?dkVqRzFZZjJKU3dmTnF4VythS0pkTGpjWHFjUUV3YnJCcjBhRUUzT3JWNGxZ?= =?utf-8?B?bVRYM3ZvYnNCNkNGWGpXcjZQSzlkRlpTY3g0cmN6OWpPZHJQci9TamM3UHpV?= =?utf-8?B?TzJYT2k5RTdubG1mRWZadTlMV2RWWWxNZzU5UDN5aHRSeGVMSzQ4ZFFxRXhR?= =?utf-8?B?ZkJDMnpBbnRvTWJrRXFOSzd6SG5vanpIR0dsT3ZKanlHWmlOaDJwZTM2L0NL?= =?utf-8?B?MlFOZHBFTVdmMW5qczFnRXhocGxpUld3endRaXBvQjZlRjRBa2k2ankvZ2lR?= =?utf-8?B?RjIwVkJUNzRERFREZWljK1VhMTJXSENzbXJ2b3NRbTNVekQ4OTdnRU1pdklR?= =?utf-8?B?dTBsUllVOFFXMmM0ZllxK212U1ZCSmZxUUEwUTNoNVFiVDErMjRyZXRpdStm?= =?utf-8?B?RUxaMVRzWFpYbUt5bytOR0VxQllwVmd5Y1d0YzJneVh1QXFRaUlVU2NXdmVn?= =?utf-8?B?SkZGaXN1dFJCUlExVFZZeXJIN21kUG9FaTNqMzUvUmo5TStUbER3V0FPN0xn?= =?utf-8?B?Mjg4ME05THBuOFdsRG1mK1htUmp4NHd0Q0lhUGtpRitmVWlPUHVKQT09?= X-OriginatorOrg: xsightlabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: e33d9321-ea90-4d75-66c4-08da27c7ec13 X-MS-Exchange-CrossTenant-AuthSource: DB9P193MB1482.EURP193.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Apr 2022 21:01:24.0398 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 646a3e34-83ea-4273-9177-ab01923abaa9 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: TSIyQFY+7bNZUyx2wy0WnfEFYCQbOOqF0qGWXV+ef4/PtD8Je6jVMDV1sGezxRhTgnDNne/JXek96876u//Qqg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PR3P193MB1040 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On 4/26/2022 10:58 AM, Stephen Hemminger wrote: > On Tue, 26 Apr 2022 08:19:59 -0400 > Don Wallwork wrote: > >> Add support for using hugepages for worker lcore stack memory. The >> intent is to improve performance by reducing stack memory related TLB >> misses and also by using memory local to the NUMA node of each lcore. >> >> Platforms desiring to make use of this capability must enable the >> associated option flag and stack size settings in platform config >> files. >> --- >> lib/eal/linux/eal.c | 39 +++++++++++++++++++++++++++++++++++++++ >> 1 file changed, 39 insertions(+) >> > Good idea but having a fixed size stack makes writing complex application > more difficult. Plus you lose the safety of guard pages. Thanks for the quick reply. The expectation is that use of this optional feature would be limited to cases where the performance gains justify the implications of these tradeoffs. For example, a specific data plane application may be okay with limited stack size and could be tested to ensure stack usage remains within limits. Also, since this applies only to worker threads, the main thread would not be impacted by this change.