From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8860A42BD2; Mon, 29 May 2023 12:38:07 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6057C410DD; Mon, 29 May 2023 12:38:07 +0200 (CEST) Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by mails.dpdk.org (Postfix) with ESMTP id 0BB8D410D7; Mon, 29 May 2023 12:38:04 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1685356685; x=1716892685; h=message-id:date:subject:to:cc:references:from: in-reply-to:content-transfer-encoding:mime-version; bh=Grp7rog0eT7KWfsLOcDFiPrJ6t30fw50S1bEplkeQAc=; b=iZIVGbdmkH59VphWwRE5mjmspzzvVfhCiVvQBtWit3iPss4zAz0jP1ps rGw8JkRVdvvbOgPXUaRcjUWAIM8KmOUeZtx9RBdWlFIA/lQwdko4pEmNf z8NDjwL3rWKzAQkUmOiWg3g9eWEhK7UvigkI4pcWaYPhgEsjBW2wwrArA LI+FTgJovQVZhc8jEKo6KOI6Xh79Ye5U7s0Xsjtyw1M2u22wvb6QDf2JG 9LMDapZNRBEPVKRWPbrO4dAOM0S1KgDcBvo3b/2Q9ajljg5NtVudujnu8 wXP697ivQ3Ts8LOJt92d5LMBebh/GyY6iSjtU4jjzBmPvOc/FSrEN9SWi g==; X-IronPort-AV: E=McAfee;i="6600,9927,10724"; a="354690757" X-IronPort-AV: E=Sophos;i="6.00,201,1681196400"; d="scan'208";a="354690757" Received: from fmsmga008.fm.intel.com ([10.253.24.58]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 29 May 2023 03:38:03 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10724"; a="771123503" X-IronPort-AV: E=Sophos;i="6.00,201,1681196400"; d="scan'208";a="771123503" Received: from orsmsx601.amr.corp.intel.com ([10.22.229.14]) by fmsmga008.fm.intel.com with ESMTP; 29 May 2023 03:38:03 -0700 Received: from orsmsx611.amr.corp.intel.com (10.22.229.24) by ORSMSX601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Mon, 29 May 2023 03:38:03 -0700 Received: from orsmsx603.amr.corp.intel.com (10.22.229.16) by ORSMSX611.amr.corp.intel.com (10.22.229.24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23; Mon, 29 May 2023 03:38:02 -0700 Received: from ORSEDG601.ED.cps.intel.com (10.7.248.6) by orsmsx603.amr.corp.intel.com (10.22.229.16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.23 via Frontend Transport; Mon, 29 May 2023 03:38:02 -0700 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (104.47.58.101) by edgegateway.intel.com (134.134.137.102) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.23; Mon, 29 May 2023 03:38:02 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FYCwqREzdPSRTJNqD1T271pZzKAeoPROjXVHVHyROtqvhVJzOkXqAt1Nt7R4Jvunwco2VY1r6iU2uNqNY9C8pKFJmwV98OFAmOflqzc2lLy7S/SmpWjEcJSKd4H6ps9kIdsCm0xJBqx5eKuXcABu0KwYmtNblYkNI3x03kyuI1Mx+Ag968JmTxY0w9JK47frHbd0WeCOch129y/ezwDr/ZFdMAKUWPsp0XUBcmcGRIVX0sJrGQk6VihapKWzk9Pij+G0GOQBEi6SqW76iZy2ROUn2Jb28Iqc09gOFzJ5CVNqaCFfkcPGTcNBNl3t0yO/z0+kNxNXUmV/nCPdQ24PwQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=RWwr5Dc8Oifm5Uho4/sGL2kIhy3zNQuX9X8zH8vUyUc=; b=cXqUAUL0nu9QSqyLya6BkqlIMO/fCsc8bjijCyk2QA+DtgewzUkXjENBLWvYhgHluWUIvPbtGGE8wlxZWB8ssRKQQnHrkTQwL0aTzU6WfyKNFM972aZCXe6bs8xBNUMCFIpUuHxmkoylvCSHd9kha4gQJ64RCM2P5i5/lOH8Q5Mw+dkI2hZYao1Gh2tjYcPVSyZMdcqHdZ63eb8JABzmLFS10RXd8k28s8/YyC8OrR5wzc2CfJVHs3lRMUJzNuPeoiZA6ViUaT4nFVYdXbBz2JoI0hXnqbg1QhoFebAkWhdlCeSmndwQrtwfKtIcQ3JZZ2iMzR1vycDcK8XbzGxZWA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DM4PR11MB6502.namprd11.prod.outlook.com (2603:10b6:8:89::7) by SA1PR11MB5804.namprd11.prod.outlook.com (2603:10b6:806:237::17) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6433.21; Mon, 29 May 2023 10:38:00 +0000 Received: from DM4PR11MB6502.namprd11.prod.outlook.com ([fe80::49c0:aa4c:e5b4:e718]) by DM4PR11MB6502.namprd11.prod.outlook.com ([fe80::49c0:aa4c:e5b4:e718%7]) with mapi id 15.20.6433.022; Mon, 29 May 2023 10:38:00 +0000 Message-ID: <3c912445-827c-b01b-335e-211a9026a988@intel.com> Date: Mon, 29 May 2023 11:37:52 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0 Thunderbird/102.11.0 Subject: Re: [PATCH v8] enhance NUMA affinity heuristic Content-Language: en-US To: Stephen Hemminger CC: Kaisen You , , , , , , , , References: <20230523025004.192071-1-kaisenx.you@intel.com> <20230526084535.374803-1-kaisenx.you@intel.com> <63f43dcf-0a03-d1f8-5120-39714cc712d9@intel.com> <20230526105008.287cc5f0@hermes.local> From: "Burakov, Anatoly" In-Reply-To: <20230526105008.287cc5f0@hermes.local> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: LO4P265CA0293.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:38f::11) To DM4PR11MB6502.namprd11.prod.outlook.com (2603:10b6:8:89::7) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DM4PR11MB6502:EE_|SA1PR11MB5804:EE_ X-MS-Office365-Filtering-Correlation-Id: 5f7ab128-f55f-4a77-c8ec-08db6030c5e2 X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: OloH/LSsvRLo9YV+0aUi2jxqN89dOrpbxFImM3fyD0ucKsfbzRX5YKT5T1CnzTU1W29iiHBOn8BLOLOUp3Ge5fKjgcywvkyjkl78YRSFTsY7i34lB038KHv6e6XXDf1FNrFRNLD/tAFcuFVe4bmTbkT+ok1UWSSZEbZEXZRQMCY3xDSkfwRALu6ea8bvrYb7R3KhIOEnzfeSQB+OmgvrcKPPVPgG89Qzfh1DT3TxuKeC9FbMZoOYBWvZ+0asvi9z+1ftQQD915D4qtdMTaE5mHOSwOXTm+9Fhz2dsrTiDUizDkUlQO91Tv7nR1yUjDR8RBHocMc5W8gOV90S9QCGd+WPkXLBwtUUIR/lEVsWlP3bq84UBktd2sFvhBlREpkbmLInDxp5krRbz+JGMBiEOqh3NRur0IQzQNSheuIklK7jVNhmham5G3lNXQn9NnU5tb24SW8sD9aw6qgbfB3L8GRwGojYKUSZ29B8RRCEtMEhsoZRzEMZS9HWO0rYuOl8b+U7zrAelRjbBtT2CgHgPVp6OuDu9PAePAcdsZQAwYJ0YWiIW4b+nAZhPw02Cd8chuJxddCwucH7TWfi1dcibxe3ul5nugmWSJUd1j1vbTESKdPjhEtsg6SKN3NWhF9E7ZFmAC3prFFpXCELhLyBRg== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM4PR11MB6502.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(366004)(376002)(346002)(136003)(39860400002)(396003)(451199021)(31686004)(2616005)(66946007)(31696002)(186003)(53546011)(83380400001)(4326008)(2906002)(4744005)(5660300002)(6506007)(6512007)(26005)(36756003)(86362001)(478600001)(8676002)(8936002)(66556008)(66476007)(6916009)(6666004)(316002)(38100700002)(41300700001)(6486002)(82960400001)(43740500002)(45980500001); DIR:OUT; SFP:1102; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?UEQ1OHAxM25jRG9zWXVLak5GRk9MV2FKZVR1UEZNQW1Yd0FXbVpoVWxreCtB?= =?utf-8?B?RmhjVkRHajliM1RTb2JnL3F6dFdkelJFampjWlNnRG1zTzlMaUpFc2lMKzMr?= =?utf-8?B?NzBZUHpwZG9iT3dJRFdPU29QeXNnTmJFeHRtbGtrdHRJNno4NFpKeHZNZFhF?= =?utf-8?B?cFFjNlFlZjF6aU9NajJkdys2U0JZQ1I5S1JIQkRVUUJGOWVqVkR2UmtONjVZ?= =?utf-8?B?b09rSUxRV01ERWtGTlJseHdyN0tRbFJOeTBRZEI5WnBBYWJGVklFSXlid3ZE?= =?utf-8?B?aVl3OHJkWkJDNUJFQzNaYmtMTWJTSkFOQ0dlMCtESU5wdWFsZndRQlNrY0R5?= =?utf-8?B?bW1zNGRtbGJnUE84UDg0RkZNT1FvSUlaVlRxTXdEVGllSVZLWmNrQUg1UVoy?= =?utf-8?B?VlFDTVF5dW16SEROZno2c0lQUi9lRDVteHZUR3lCMU1jSk1SNXpsdDlTWXhN?= =?utf-8?B?Q0RQcnl3ZzNnNlpwYm1sQ1hRcHJyc2J0OUVpSmVmNGZMZzlGZFNQNDhDZ1Jy?= =?utf-8?B?YlUwcDllRzAvMU5vdFFqQUc5TTIvL1hLaWVqMW9nbWVma2p3WEo1a2JjcTc2?= =?utf-8?B?TUlrSFBHWC8yOFZyUmxwNzZKL3ZoOVZ3bm9zSmVCRkt1SXJDR05qKytlSE9O?= =?utf-8?B?M0lCVnFjKzJ6cGNJMjZZTXB4VlRlbWE2VG11T0hFcGtKQkdPUDI5OHdnYmFz?= =?utf-8?B?eFpBZVlyN3Vja0pISzZNUStMOEJady9zV24wckJZOFhYUVZZNmkyUjN6UmVU?= =?utf-8?B?dzBFZDFLb3RTMjFtcVhFWVRDR2V4Z2FQZzRyNjhKR3dKQUlNS3FYd0U4UVpD?= =?utf-8?B?U01RMWVNMjhWc1JlUDNMKytGZlpWWVdTWVBONkFPT3RPQnFpSU9jZ2RacEQr?= =?utf-8?B?TFlvZnRvemt2WlM2MklKSUljZWpLUGxTOEh4NjlDK25LOEw0bkh6TkdlS2F3?= =?utf-8?B?c1I4SHJRZ0Y3eHZNeHdXTXBUM0pKaTJraU5WM2ZVSWZMSm4vYlhzTHF5alJm?= =?utf-8?B?VVBqbWQzVnQzcnhJS2JCV1Rvbm9iMTBGTVJOTHl1cGpMNjd0UEtwMnNnTFhM?= =?utf-8?B?RFNrOHQ3bmlXK2xIenVoREs2YmV4UzdyWmFNSU9pWXhqOGRXWTJCOHhacEZS?= =?utf-8?B?N1dtNTJaUHprTi9NT1lOVkhmRWc3cURqTDk4eG1KRE50bnRFVFFtNFZ4RlpF?= =?utf-8?B?VElaVFY0VkkzTXJhWEpyZVU4WEhwMCtWT3czRVMzZXhIOGlreVJ4TjNpMjRI?= =?utf-8?B?NWlZZjJBSXhFMUhjSkgwR09SbGtKNUFrVW9pTHkvZjRJemc1NTNUMzErcVhB?= =?utf-8?B?Ni9hTWRqa1FNb0xoS0RDMUhBT1FpRVJuOU9JQnQ5SW1pNEJJa005L3g4bm0w?= =?utf-8?B?UEhwc1RLa1NTR09UQmorRFREUzFnVTM2ZEdBSm11cG9vc0VHSk13dFZNZnRE?= =?utf-8?B?R1k4MmczK3FUODJHaHBKYllkSkFWYW1uRDFOaTYyTGlwbVFVTzZkNVowcnVw?= =?utf-8?B?bzI1ZzBsV0hlQ0pLdlp1OTJrTDV5eDlIL1o3WGVyV1ptSnp6clJ2L0MzKzZn?= =?utf-8?B?RE5wcm1TazJLQldyZFlidlBSRFVhRmRLSjlrengwLzhQd3kweWhDZWZMRVFW?= =?utf-8?B?amFTS0ltR1VxZnVZRzdHZG1GbG5CK0ZpNFJ0WTN2Z01CY09veDhxZmVhWXd2?= =?utf-8?B?ekJaTmo2ZkJwL2ttVWYybC82UmpiYVB0U2huSUI2SVJ3Y2s1elQvUGRLenhj?= =?utf-8?B?Z0Y0OTZLNldBS1BNR2szTmUvcFBkdDhvNzJuVXV4VTQvdTNKR251dEpKRDI4?= =?utf-8?B?L0xIYWgvbVpVQTMzY0dyUmdnQThDNVhqU3BYdzltZkt3Y1NQWGJiSFdBTU96?= =?utf-8?B?eHpWMXQwQ1JHeFJCY0JUWldYY1dCdGxUcDQwbVZvbC9pTHJQcnkwQXgwOWM0?= =?utf-8?B?ZWN5VGEwVVIvSVIwY3hCb25WWWlOa3EyeU50M1JNdTJackVLbGlIOFk5MlJa?= =?utf-8?B?SUFVRXdKNzNidG5qZ1RxWGJNVkdhSTVYZWpocml0YjBxS0I2Ym5WdkZ3Vm15?= =?utf-8?B?bytDdGQ5WE12ZllXeDEyamxRUExWSTM4QWloTkM3d25tYnFpeGp1R201Wk1P?= =?utf-8?B?VVhWazA3a0lwVUlFUUNPYmwra2ViNkJzbERieTZOTmtNZ2VpM3NGdDRrRHRT?= =?utf-8?B?Q2c9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: 5f7ab128-f55f-4a77-c8ec-08db6030c5e2 X-MS-Exchange-CrossTenant-AuthSource: DM4PR11MB6502.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 29 May 2023 10:38:00.0962 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: 6K/GK07P3BBWtHUc7xknTyqT7mz1ttoJe0yXA8u2OzGHKZDz/ZfApXfyKv4kBrTzHkSvrIJehYBD8Fb+LwItvdZAuGDz2F7J/rY/wMVBthI= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SA1PR11MB5804 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On 5/26/2023 6:50 PM, Stephen Hemminger wrote: > On Fri, 26 May 2023 15:44:15 +0100 > "Burakov, Anatoly" wrote: > >>> + /* Set control thread socket ID to SOCKET_ID_ANY as control >>> + * threads may be scheduled on any NUMA node. >>> + */ >>> + RTE_PER_LCORE(_socket_id) = SOCKET_ID_ANY; > > This is not always true. Read the control thread documentation. > If DPDK application is run in a cgroup with cpuset, it maybe limited differently. The point was more to highlight that control thread NUMA affinity is "undefined" (and depends on a lot of factors) rather than necessarily "uses all NUMA nodes". IMO the message is OK, even if technically it's not 100% accurate. I mean, we could do some magic and figure out the effective NUMA node of a control thread, but do you think this would be worth the effort? -- Thanks, Anatoly