From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 051EAA0545; Tue, 21 Jun 2022 16:52:52 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 9DF134069C; Tue, 21 Jun 2022 16:52:52 +0200 (CEST) Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2060.outbound.protection.outlook.com [40.107.21.60]) by mails.dpdk.org (Postfix) with ESMTP id A4BC940151 for ; Tue, 21 Jun 2022 16:52:51 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nEJYsQnFgXhVMXT7CZm9utGz1fhM7mLG9WXioq/alFmntIY95klOg3lrAoqRscaEFOeLgCCDc1jGRdM1hY64+sbQ1kiVAeool24sq+lUv17nzkPtSrIOwxQPEGR0aazq/IklEiZzdjBIgIE1h6pSBm88Dd3ylS0UpUvyXRRDF0L1N3rexwD2fKWxDaR1meV7uAyKG3jtKaxs/yGSsc+eX5A6tox8MRP52P/15kz8d6W4nhrmbH5desJyRdU0TzjMXNT4MpGRCgK4VkjG03/XhaDFDYCreYhdyH2nlcP27INGivLDY5IqJFTHflbOexy0TK4V7knQTrTTiX9hj2OCJg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=S1s4CTAal/mUTJNLmktTHyL2RlAp764pg+eULo2lvRs=; b=MTSmI8g6SxrR/hRpW2OQ97YBPBnY+8fIqtjUFsKTsbGCg8DKRABueQOCi75ytBiwR78orY+hLtYTT2qXJq0R8VRhvwhQdBwv46IYHg4W2JMHiogKbzwHjyirD5QwhCU7JkJuXLZkJyoSOOlr4BTpYC3ZT4Yq8UOfjwOXya92wO1KRpmNWCnjxpZzJwqL8Eb9Km3TLdCanQXNhCPwDXwIEv5elpu9ceedKz6OfTTZQgoqrTdnCHIilgcXrqAu+2PAVejpt+QCTjfZFYcP1rXXWbN/OxdX19Wp9PxGAEvT9VrwfPzxMwsA8r58GCMyvO/42elVe6+W4Ws8yLPLFP4KOg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=xsightlabs.com; dmarc=pass action=none header.from=xsightlabs.com; dkim=pass header.d=xsightlabs.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xsightlabs.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=S1s4CTAal/mUTJNLmktTHyL2RlAp764pg+eULo2lvRs=; b=VohnAnWnJrgH65N5YV3TcJBxkENoVawXZj+Hu2/m9pT6+835XQMGhKUHg5LSvSOruEmpW5sQuDRMt9cBedSybFbvY+HiRcxIx9w7qNPLsAFlUjkSQYKrTP8ReO9nAc5zZ8Mv4UBFVFxZ2qiYLiKKYSctS98tctI7HgERPpzcNj8= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=xsightlabs.com; Received: from DB9P193MB1482.EURP193.PROD.OUTLOOK.COM (2603:10a6:10:2a6::7) by PAXP193MB1839.EURP193.PROD.OUTLOOK.COM (2603:10a6:102:1c6::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5353.15; Tue, 21 Jun 2022 14:52:50 +0000 Received: from DB9P193MB1482.EURP193.PROD.OUTLOOK.COM ([fe80::61af:58cb:6533:1aaf]) by DB9P193MB1482.EURP193.PROD.OUTLOOK.COM ([fe80::61af:58cb:6533:1aaf%9]) with mapi id 15.20.5353.022; Tue, 21 Jun 2022 14:52:50 +0000 Message-ID: Date: Tue, 21 Jun 2022 10:52:43 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Thunderbird/91.10.0 Subject: Re: [PATCH v6] eal: allow worker lcore stacks to be allocated from hugepage memory To: Thomas Monjalon , "Burakov, Anatoly" , Dmitry Kozlyuk , David Marchand Cc: dev@dpdk.org, Stephen Hemminger , Chengwen Feng , =?UTF-8?Q?Morten_Br=c3=b8rup?= , Bruce Richardson , Honnappa Nagarahalli , nd , "Wang, Haiyue" , Kathleen.Capella@arm.com References: <20220502141058.12707-1-donw@xsightlabs.com> <11989770.5MRjnR8RnV@thomas> <6401977.6fTUFtlzNn@thomas> From: Don Wallwork In-Reply-To: <6401977.6fTUFtlzNn@thomas> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: VI1PR09CA0136.eurprd09.prod.outlook.com (2603:10a6:803:12c::20) To DB9P193MB1482.EURP193.PROD.OUTLOOK.COM (2603:10a6:10:2a6::7) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 2e06973e-e500-4a45-8456-08da5395b63a X-MS-TrafficTypeDiagnostic: PAXP193MB1839:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: uG9n6CZfHQAg2MwJyYKDv+PN5ZpQolwUJT8ObWndHBk5SuGYVXa0QAz16R5oYnM23FfPwAf48TF7XOqm3XeERzBgMGlLRTXFeLdrlPNMEZXrVkM0Vf5gbWJv9OchPeLrNBubjQ7tfeJRhgQN7zlnSF7Ya8VqQTm/N6Ll/iHlIle9dRXyPCeBg4tjK7fq5x6fRv4UIhRPWGUdsXMJscJW0ZBPms/o1NJR9fAgmi8ersjM67GxNcDjGHiR7bQJyoUq3BNimrGVt70U/h4jXCeYrxOlwcZuSAqIZNgNii1wPJ3QymmEV3WWHY+b7H4CTW3EDi+CQ5bPJwz4uS1dT4tSGHeEASeQy07P7171hzTjl3V7cywXkfdqq1keyOLkGQx5Ik9jYPpMFUyCiX3VJap3lMJNERMwde7D29HgLiEGEaJLlVwYY/qcBwD9uC0cjeyw0+0OqBG8dqSPsWI40LS4Og2KR+ZtQFwCM/sk/eOkOgYjCOysbwDwLlItTU6+qkXVzLfU0Nxq8cWKH+ugqRKq0FIloQo1+VxAWVl5h8LVroc8GRDffJhb6ci7TBZy2DiXSlG0fuVJ5afOM8EpiquBpv/2aJQ5GyiH6KH48oOEnMP+pxH7jPNHsjcHelC23n4Icd4bFc4MzG9VVq2a861pQrFCA+RUNA/ONScff48deoyiqWqdhwMvsb70rFiW7W/mQqJgCUlJUc9HQ43sI0PA/QTf5nKwaXiTA5mBtnEwTSDvj0h1ha02keQoTqeCrBtfI6v5iwiKyROmw87Rmpn0Yg== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB9P193MB1482.EURP193.PROD.OUTLOOK.COM; PTR:; CAT:NONE; SFS:(13230016)(4636009)(376002)(136003)(39850400004)(346002)(396003)(366004)(110136005)(66476007)(8676002)(54906003)(66556008)(83380400001)(478600001)(31696002)(186003)(66946007)(6486002)(38350700002)(6666004)(41300700001)(2906002)(26005)(316002)(6506007)(86362001)(53546011)(5660300002)(6512007)(36756003)(7416002)(31686004)(2616005)(4326008)(38100700002)(52116002)(8936002)(43740500002)(45980500001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?SnlWM3B3ZUFUZ3l1OUNCT3V1dVJDQVVQU2xXYk9YdEU4QTF0WlN6dEN1TUU5?= =?utf-8?B?ZVhaYzZTbFJiTHdIb0lQTVNoTjU2MXVRa1VKQ3ZlakQ2emhSN1lJWmpwdWhl?= =?utf-8?B?VVppNXc1K0ZSYkhZSXJGbkg5RTUzMXhpdlVxaTBFb0R0TFk3UWRCUVlKNXl2?= =?utf-8?B?L1dWcG1ZRis0c09aeE54TGRoUC9wb09OTnpBSGNoeVVNRG1FN1dxNmZuVGJX?= =?utf-8?B?NVM3UkxEV3g0QndTNGVlU3lFVzllRm02UlVoM1ozUlRZbEozUnpXbTJNdWNM?= =?utf-8?B?bmZ5N1hGNXREWjZGUkRiVDJIb0wrQWZqbXY5N01ENndtZTVsMXMrdyt1Ukk0?= =?utf-8?B?K0FFUnRMN0w5WGVqSE1qbUQ5UWM2ZmRDUzU0d21iYXRyWWMwYmtlbFhyV3FG?= =?utf-8?B?TFZST0dNMndVNVhMQVdjSStsRVhabGoyR2FTTHowWkVFcVZkdlg0RW1TYVZG?= =?utf-8?B?bmlOMnhRMmhkaDdmaDNpQmJnZzJnblZ6dUo3TGY2RDFTdmdQb1JLWHdsd0xv?= =?utf-8?B?RU1jNlRQa1Z2bjB3QTJrc3BtWnc4MEt2YVlReFcrMDFkLyszdnc3K0RWOGVu?= =?utf-8?B?RXc4YlV0Mjd4TXJaT1YraWtnc3FVempRN0gxdE02TXhwZ1BTdS9DNGxIbkZV?= =?utf-8?B?TTdzVEZIakFkNWhITHJRdjE3SUpzVU1RMzMwc1o0bnVpLzdUcVAyRDV4ZSt3?= =?utf-8?B?MitrME5NSDhRSTlRQW9lUCt3NmNNS0lzc2kwRzcwUTJCMXFPUHJoUWdZejk0?= =?utf-8?B?UnpLalNldTIwa3VNR3BVRVI5WTlMd2c0T2E2NCtBR0lDRjdWU2thZnhoYnoy?= =?utf-8?B?RFBCNElRVU5vNEM2RzhORUMrSnhnZTRYOVRUL0YwT2VEdWdtTmIyeTFEZjlU?= =?utf-8?B?VjdXanZUWVZMZ3pTblpYNDBmSmpGRkxpWjlHNEtqWm1ZK1dVNjFoU3BaSFM2?= =?utf-8?B?K1d0SXg2ekhieFJ5K280Rm9jV2FRY21BbmY1dlZNakl2M2RoekZITDFQQlNZ?= =?utf-8?B?eFFjTUtkZ0twMHNKYmhaYXFSZ1dEWjZhT1ZueFpwblpvNmdsL0d0QXp4OXhz?= =?utf-8?B?bnI5aTJnMHdlUUpFdEtSQUhmRHZiY0FiZTFaM1hwZVI0N3BzTVdVY1U5RG1P?= =?utf-8?B?WjZLVHlhUnU1NHJuWnZwUFVDdVNIeG1YeU96WEJNSGxsZ25ZTVNvMnAyMldL?= =?utf-8?B?T04ydGVlanJPQm5MdkU0YnFOMi9BTDMyelFkTHNudC9EVmQ1WS9YYjNVb0NB?= =?utf-8?B?R0sveWh3a05qUzl5YVJFbWI1ekNmdnNuMFZhbTdjZUdlWm9mSUtXSUxWQk9T?= =?utf-8?B?MW5LblRHaVJlUWZzQ0VqcFEwN0Q2QS9IQ1cybDk2dXJneHZjMi80TTlRWW1k?= =?utf-8?B?NFd0eUQ1TlpvQUMvZFppN1kyK2hsa2VVOW9pY1FIRi83OHJuVUx3ZkpEWFpV?= =?utf-8?B?M2pBR2ZSZHFpcnBlSHFZdy9ZbVE1bnNTRGprOUdkU3hDYTJwZUdlNlZjMkEw?= =?utf-8?B?blU5b3NRVEhIb0wrNlpNY0l1eVNlSkV4bFZwK01pRmVHL1ZBRVVVQmo5L0No?= =?utf-8?B?eXpFSXBTNkhRMFUxK2IzeVlwWlg1dURMTTZ4ZVJEbUJLRzNiWFE4Sk15QTR1?= =?utf-8?B?VE1udkk3UHR5dTBpZm4xRVJUcGE3aHBySDVMWEZTWjg0OWU2SVJwNzRTME1C?= =?utf-8?B?THI3bmFrVTBVaHhjdWRUUWROZ1R1RlEyZG01NVU3L3dVU1pFWjJnd293VHVI?= =?utf-8?B?UkU0bFJodEVFaFk1d05NeDRHUVNVcVFtWTBRRGc0ZFdiZW1BejhBNnYwSnQr?= =?utf-8?B?cGIrQVgxMmxLR1h1YytuaWJmM3h6ZE1Oa2pUeDR0SlVuMVNOZFMrdFdPaGpk?= =?utf-8?B?bG50TGluMjBRZWhPbWgrb2ZpK2pyVUM5c1dIUDNuK1doL0VTVWl3cU1JNnFN?= =?utf-8?B?UVNDVkN0R1FrMjVGVVFRZXBVbVgrbmlNWlRYNXRQaVhUZ1ZLejlFQlFmcVRJ?= =?utf-8?B?RWs2aDFHVktEalBLZmVNaGZtKzZoeEZqakN6YVp5U0Fvd1NJSkJXRTV5Z2ZH?= =?utf-8?B?SVp0MEIrNDVUQ0M1NmhRbVFTWjNMTEk3eitrNVc2UUdsMkp0Uk5MTWRiNm52?= =?utf-8?B?TWV3cVdaMFhXQzhOLzd3VFVoeWRRa0psKytiWGkwVGp6LzE4TTNhS1k0bVBV?= =?utf-8?B?WnNidzZvVUViY3NvMGRpbEpRek1xdWZHdzNLVldRVEJjcno3RG1KSGs3dUZ5?= =?utf-8?B?YWZ3Zm5KRkJWTHNjd01jSGJGTkJhb2FMN0FCN2xlaDR1M3JWZXl0dXNxNHFm?= =?utf-8?B?dW4yZHd5enprdDRWTTJYU1FTMzFQdGNtTzdneldTVWVuejFMUFJqdz09?= X-OriginatorOrg: xsightlabs.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2e06973e-e500-4a45-8456-08da5395b63a X-MS-Exchange-CrossTenant-AuthSource: DB9P193MB1482.EURP193.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Jun 2022 14:52:50.0117 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 646a3e34-83ea-4273-9177-ab01923abaa9 X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: pwflwR8jqThdrvR6gnIi4SDnfcPCowh6fg3OW7LSbZ/sf6EKsI4Xd4wzT6BlahUp5j77NO2nfv8aE3BGAkZlSQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXP193MB1839 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On 6/21/2022 10:42 AM, Thomas Monjalon wrote: > 21/06/2022 14:31, Don Wallwork: >> On 6/21/2022 6:37 AM, Thomas Monjalon wrote: >>> 20/06/2022 10:35, David Marchand: >>>> On Tue, May 24, 2022 at 9:52 PM Don Wallwork wrote: >>>>> Add support for using hugepages for worker lcore stack memory. The >>>>> intent is to improve performance by reducing stack memory related TLB >>>>> misses and also by using memory local to the NUMA node of each lcore. >>>>> EAL option '--huge-worker-stack [stack-size-in-kbytes]' is added to allow >>>>> the feature to be enabled at runtime. If the size is not specified, >>>>> the system pthread stack size will be used. >>>> - About the name of the option... I don't have a better name. >>>> >>>> Just want to highlight, that what this patch does is use the DPDK >>>> memory allocator for the stack memory. >>>> It happens that DPDK memory allocator is primarily used with >>>> hugepages, but this is not systematic for example with the "no-huge" >>>> mode of the DPDK memory allocator. >>>> >>>> IOW, in this patch current form, you can still run as: >>>> >>>> # dpdk-testpmd -c 3 --no-huge --huge-worker-stack=16 -m 40 -- etc... >>>> >>>> Opinions? >>> The name of the option should not include "huge". >>> What about "--worker-stack" ? >>> If disabled (equal zero), the workers should use the default stack memory. >>> >>> >> Wouldn't that have the potential to create confusion? The point of this >> change is to allocate worker stacks from hugepages. Removing huge >> from the option name could give the impression that the command is >> simply to control worker stack size. > It means if we control the worker stack size with a DPDK option, > DPDK memory will be used. > But we cannot force hugepage with this option. > Hugepage is not always available and it can be disabled in DPDK. The command could be rejected if hugepages are not available. That's not in the patch currently, but can be added.