From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9C00745BAA; Wed, 23 Oct 2024 07:12:38 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 146CB40A81; Wed, 23 Oct 2024 07:12:30 +0200 (CEST) Received: from NAM12-BN8-obe.outbound.protection.outlook.com (mail-bn8nam12on2083.outbound.protection.outlook.com [40.107.237.83]) by mails.dpdk.org (Postfix) with ESMTP id AF71540A81 for ; Wed, 23 Oct 2024 07:12:22 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=EVBqkhIM8oDdDltnBH6NZj7rbjWaSuo6VAEI5R/XUZxPTS3gvq8Dkym8Mcuy0bZCSUNefoB3rgnvSHvR33Ba3QOXayyIKqrEwmD7mtKDMV5cy5gfHlNykvI7jgbPjx2iSuEdwuiHZJPnXSVfXWTC/JYCqCJ/RcR2HKQT1WB3rAIdhZFVBkORPH38wUd/s3AZ5VctouYi2/nmwxtsSiOeEqyC+X/0WjhxZygAzKfCMahIvoFbMzOPP/kXWOX4+keTiqj3Oy4vM+mZwTKRkgTbiaI5LjEP6t5cqAU6TCLJEprkwHDYKG8HnfJkciHPfsSOk9v+3ajCQKt1UPQCfsbcUQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=V/EPiP8rgy4KnpqwFJwEznE1fYvFUPjIBrRrskutTVI=; b=FAQJHL0niI57dbWt5jqYQvRuAe3qQi0ne0iOPJ4mxFA472mSKw4/2CHHWzTuUPOAbKAoVzLstS13HlFrNfnh1h1t43FAr4rTNL1JttsoBIvLpPOuGPTqxBXrQAb1dcaEiuItTfZscUvFgSJ8dHasTY25p0njkc5324xMddz8eIPbbEmmNzJbdguWZ0wxaCfYackw+PE3ZVwqVFKzSBB6W1L+VhM7uj4rQH4FHxIC4ZTZIUokeMoAVfqyiEWLOf30Eo4ikT9Ldocpe0AA62lC8RLVHRs9MDoPXelPaGM3bamj4M6ExyME9UesIGm9T1GrOZKSeRTJrUL46TeQ6/r1QQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 165.204.84.17) smtp.rcpttodomain=intel.com smtp.mailfrom=amd.com; dmarc=pass (p=quarantine sp=quarantine pct=100) action=none header.from=amd.com; dkim=none (message not signed); arc=none (0) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V/EPiP8rgy4KnpqwFJwEznE1fYvFUPjIBrRrskutTVI=; b=VJY21ZyOatU0rFrDeQlnfjk4dAooCApdEG8d4JyY8H6OPDdpkquO2icZVZWXqRV+dqmfLhAGQQDlqe7JOQhdGwL7c8w1Ww1zSnmMIVfBzlFWCejB9L4dEW4jiWyUsGlNJvdkADg8RJ2pCT3NXiYZHMYqIFDq5ZIVimi7BQws9RI= Received: from BL1PR13CA0269.namprd13.prod.outlook.com (2603:10b6:208:2ba::34) by IA0PR12MB7773.namprd12.prod.outlook.com (2603:10b6:208:431::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8093.17; Wed, 23 Oct 2024 05:12:18 +0000 Received: from BL6PEPF00020E64.namprd04.prod.outlook.com (2603:10b6:208:2ba:cafe::96) by BL1PR13CA0269.outlook.office365.com (2603:10b6:208:2ba::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8093.17 via Frontend Transport; Wed, 23 Oct 2024 05:12:18 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 165.204.84.17) smtp.mailfrom=amd.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=amd.com; Received-SPF: Pass (protection.outlook.com: domain of amd.com designates 165.204.84.17 as permitted sender) receiver=protection.outlook.com; client-ip=165.204.84.17; helo=SATLEXMB04.amd.com; pr=C Received: from SATLEXMB04.amd.com (165.204.84.17) by BL6PEPF00020E64.mail.protection.outlook.com (10.167.249.25) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.8093.14 via Frontend Transport; Wed, 23 Oct 2024 05:12:18 +0000 Received: from jfw9ny3-os.amd.com (10.180.168.240) by SATLEXMB04.amd.com (10.181.40.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 23 Oct 2024 00:12:08 -0500 From: Sivaprasad Tummala To: , , , , , , , , CC: Subject: [PATCH v9 4/6] drivers/power: uncore support for AMD EPYC processors Date: Wed, 23 Oct 2024 05:11:36 +0000 Message-ID: <20241023051139.1066426-5-sivaprasad.tummala@amd.com> X-Mailer: git-send-email 2.34.1 In-Reply-To: <20241023051139.1066426-1-sivaprasad.tummala@amd.com> References: <20241022184133.700367-1-sivaprasad.tummala@amd.com> <20241023051139.1066426-1-sivaprasad.tummala@amd.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [10.180.168.240] X-ClientProxiedBy: SATLEXMB04.amd.com (10.181.40.145) To SATLEXMB04.amd.com (10.181.40.145) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: BL6PEPF00020E64:EE_|IA0PR12MB7773:EE_ X-MS-Office365-Filtering-Correlation-Id: 310aae2e-cea2-4558-ed87-08dcf3214416 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; ARA:13230040|36860700013|376014|1800799024|82310400026; X-Microsoft-Antispam-Message-Info: =?us-ascii?Q?DjV/Adeidd8yBPnI6yNRnWQKZ/2++vjH4uB3bQFOM1iMPXcpwMi/T8ry63aI?= =?us-ascii?Q?3VIfEU/LCn4YeTR7vRwVMXcfhycCGQpCcy7ezngMzQikVJp9OgvH/IIg4TZ+?= =?us-ascii?Q?KgDDsqElNFUskYKsRbAm1ncWQoecByYt5bI1L0ZQaDevX5wbgaGHAElya5L6?= =?us-ascii?Q?5Dcpz4QC9xtJ7aHItPZVr7zBRWEdczCi4v5hzUT+D6zgPAlp6KKNgQ+L6Gwg?= =?us-ascii?Q?YCfUNowHwg/vFPGSwjEhtFQ8AdCtf0T3khoZGFt/zWIUKAbLYWM0Eq8koZHT?= =?us-ascii?Q?PwMyLmESVY3kYXhJDixJuMNW83pTPbg2x6R1Uoe1cb7RhJyqcpfQOynElMXR?= =?us-ascii?Q?SIqpZr6YSDxTZ7kQ+wAgHitrbX/GK7X/l1NSS858eSbQg111qn7oOGYnH0YU?= =?us-ascii?Q?5frVigpMaM/8CQus3/D5JlHGr6qRjJvGeP7qRnLSU3ZKDQbhkC2FPWRsLfVr?= =?us-ascii?Q?qhWuBde4uKoIxv7fPR9NUfG/Be44rgY6dCaCqj0oS2wy3akkNP2/tZNcMtWi?= =?us-ascii?Q?Ig+CumjsK6kmlCuH65moBuJfL87N7DU2/+vYTWPX4dhI9Neah/lJ70qg34jr?= =?us-ascii?Q?csMdCkVCEQbHvXbouIwtgwag3CebKBTp6N7z1AsylLCPv16fphrz2sL7tcWR?= =?us-ascii?Q?TktJOrHMtSnDuxIk6K8wmv0JSTFLpO3iRS/OpHtdm+NO6lqSwKq0kj0n9Ut5?= =?us-ascii?Q?fffRWlN0YW4kYk6M+4qwYfQ22NR5V1G6SoQM/M155d6yY4gWp3jhDIjcH8H2?= =?us-ascii?Q?SnKzyzjzIUSvR8RpOMWMLbEKO4uaVqIUqHGJUyKLQPMpgNbGhsCGZXoEgFvx?= =?us-ascii?Q?2aL6rFRZhvXZATB8QbUfHNwj6fR7m4LYOUVKBGXdmO8lvSfKCOaNQy9oF0mi?= =?us-ascii?Q?mPDcjV3fxVvIexNVEdcr9kbnv9u9+iCYNxoy6Ps0zKPxPOyIPGGzQ+rWBMFr?= =?us-ascii?Q?3cMnvH3zS45cTPmqg4Lyf2do9dAeblsKHYtmGWdsUdTRlxnN62/vz6rYDP5J?= =?us-ascii?Q?YyhCHEmwKke1awUkooKwDy3sXzVa+XwzcxI+57qv0vsP21nzamOvUwuWjjwf?= =?us-ascii?Q?iuCFS1dXsswI5v9dMHzI9WrVsJ/uImz5JHYe4yImjrHq8xPjq5MqPEazyO0V?= =?us-ascii?Q?x+ULRx+OStE0eIoSkyKD1rSV/AHAl137WNkh7xJAbBxtitCnc3KKpGXAJ3Ud?= =?us-ascii?Q?A36AIcAY4gYxWF46YkktHkm1kc94Pi1v88Fi9C93BZpAaUnejApN+4iIeFmL?= =?us-ascii?Q?SzbrtykW0iqcom0D0RpBavgovebJdsG7xMrqDi2EafpcOrwut/ZALI8kqXHk?= =?us-ascii?Q?VjqZ5d2tD/lNZ8R0zZP47X4O2Z7WN9ujtyTwheOLm7qKxs7fOLPFXXrMCljo?= =?us-ascii?Q?iWl0v/gGGhT6ZccU5jWBUQy+3RRV5QV8K1U5qPRkOfmZyJ9Abg=3D=3D?= X-Forefront-Antispam-Report: CIP:165.204.84.17; CTRY:US; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:SATLEXMB04.amd.com; PTR:InfoDomainNonexistent; CAT:NONE; SFS:(13230040)(36860700013)(376014)(1800799024)(82310400026); DIR:OUT; SFP:1101; X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 23 Oct 2024 05:12:18.0966 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 310aae2e-cea2-4558-ed87-08dcf3214416 X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=3dd8961f-e488-4e60-8e11-a82d994e183d; Ip=[165.204.84.17]; Helo=[SATLEXMB04.amd.com] X-MS-Exchange-CrossTenant-AuthSource: BL6PEPF00020E64.namprd04.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: IA0PR12MB7773 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org This patch introduces driver support for power management of uncore components in AMD EPYC processors. v9: - documentation update v2: - fixed typo in comments section. - added fabric frequency get support for legacy platforms. Signed-off-by: Sivaprasad Tummala --- doc/guides/prog_guide/power_man.rst | 14 ++ drivers/power/amd_uncore/amd_uncore.c | 329 ++++++++++++++++++++++++++ drivers/power/amd_uncore/amd_uncore.h | 225 ++++++++++++++++++ drivers/power/amd_uncore/meson.build | 20 ++ drivers/power/meson.build | 1 + 5 files changed, 589 insertions(+) create mode 100644 drivers/power/amd_uncore/amd_uncore.c create mode 100644 drivers/power/amd_uncore/amd_uncore.h create mode 100644 drivers/power/amd_uncore/meson.build diff --git a/doc/guides/prog_guide/power_man.rst b/doc/guides/prog_guide/power_man.rst index 1810ecf93b..b06cc36438 100644 --- a/doc/guides/prog_guide/power_man.rst +++ b/doc/guides/prog_guide/power_man.rst @@ -203,6 +203,8 @@ to achieve high performance: L3 cache, on-die memory controller, etc. Significant power savings can be achieved by reducing the uncore frequency to its lowest value. +Intel Uncore +~~~~~~~~~~~~ The Linux kernel provides the driver "intel-uncore-frequency" to control the uncore frequency limits for x86 platform. The driver is available from kernel version 5.6 and above. @@ -211,6 +213,18 @@ which was added in 5.6. This manipulates the context of MSR 0x620, which sets min/max of the uncore for the SKU. +AMD EPYC Uncore +~~~~~~~~~~~~~~~ +On AMD EPYC platforms, the Host System Management Port (HSMP) kernel module +facilitates user-level access to HSMP mailboxes, which are implemented by +the firmware in the System Management Unit (SMU). +The AMD HSMP driver is available starting from kernel version 5.18. +Please ensure that CONFIG_AMD_HSMP is enabled in your kernel configuration. + +Additionally, the EPYC System Management Interface In-band Library for Linux +offers essential APIs, enabling user-space software to effectively manage +system functions. + Uncore API Overview ~~~~~~~~~~~~~~~~~~~ diff --git a/drivers/power/amd_uncore/amd_uncore.c b/drivers/power/amd_uncore/amd_uncore.c new file mode 100644 index 0000000000..c3e95cdc08 --- /dev/null +++ b/drivers/power/amd_uncore/amd_uncore.c @@ -0,0 +1,329 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(c) 2024 Advanced Micro Devices, Inc. + */ + +#include +#include +#include + +#include + +#include "amd_uncore.h" +#include "power_common.h" +#include "e_smi/e_smi.h" + +#define MAX_NUMA_DIE 8 + +struct __rte_cache_aligned uncore_power_info { + unsigned int die; /* Core die id */ + unsigned int pkg; /* Package id */ + uint32_t freqs[RTE_MAX_UNCORE_FREQS]; /* Frequency array */ + uint32_t nb_freqs; /* Number of available freqs */ + uint32_t curr_idx; /* Freq index in freqs array */ + uint32_t max_freq; /* System max uncore freq */ + uint32_t min_freq; /* System min uncore freq */ +}; + +static struct uncore_power_info uncore_info[RTE_MAX_NUMA_NODES][MAX_NUMA_DIE]; +static int esmi_initialized; +static unsigned int hsmp_proto_ver; + +static int +set_uncore_freq_internal(struct uncore_power_info *ui, uint32_t idx) +{ + int ret; + + if (idx >= RTE_MAX_UNCORE_FREQS || idx >= ui->nb_freqs) { + POWER_LOG(DEBUG, "Invalid uncore frequency index %u, which " + "should be less than %u", idx, ui->nb_freqs); + return -1; + } + + ret = esmi_apb_disable(ui->pkg, idx); + if (ret != ESMI_SUCCESS) { + POWER_LOG(ERR, "DF P-state '%u' set failed for pkg %02u", + idx, ui->pkg); + return -1; + } + + POWER_DEBUG_LOG("DF P-state '%u' to be set for pkg %02u die %02u", + idx, ui->pkg, ui->die); + + /* write the minimum value first if the target freq is less than current max */ + ui->curr_idx = idx; + + return 0; +} + +static int +power_init_for_setting_uncore_freq(struct uncore_power_info *ui) +{ + switch (hsmp_proto_ver) { + case HSMP_PROTO_VER5: + ui->max_freq = 1800000; /* Hz */ + ui->min_freq = 1200000; /* Hz */ + break; + case HSMP_PROTO_VER2: + default: + ui->max_freq = 1600000; /* Hz */ + ui->min_freq = 1200000; /* Hz */ + } + + return 0; +} + +/* + * Get the available uncore frequencies of the specific die. + */ +static int +power_get_available_uncore_freqs(struct uncore_power_info *ui) +{ + ui->nb_freqs = 3; + if (ui->nb_freqs >= RTE_MAX_UNCORE_FREQS) { + POWER_LOG(ERR, "Too many available uncore frequencies: %d", + ui->nb_freqs); + return -1; + } + + /* Generate the uncore freq bucket array. */ + switch (hsmp_proto_ver) { + case HSMP_PROTO_VER5: + ui->freqs[0] = 1800000; + ui->freqs[1] = 1440000; + ui->freqs[2] = 1200000; + break; + case HSMP_PROTO_VER2: + default: + ui->freqs[0] = 1600000; + ui->freqs[1] = 1333000; + ui->freqs[2] = 1200000; + } + + POWER_DEBUG_LOG("%d frequency(s) of pkg %02u die %02u are available", + ui->num_uncore_freqs, ui->pkg, ui->die); + + return 0; +} + +static int +check_pkg_die_values(unsigned int pkg, unsigned int die) +{ + unsigned int max_pkgs, max_dies; + max_pkgs = power_amd_uncore_get_num_pkgs(); + if (max_pkgs == 0) + return -1; + if (pkg >= max_pkgs) { + POWER_LOG(DEBUG, "Package number %02u can not exceed %u", + pkg, max_pkgs); + return -1; + } + + max_dies = power_amd_uncore_get_num_dies(pkg); + if (max_dies == 0) + return -1; + if (die >= max_dies) { + POWER_LOG(DEBUG, "Die number %02u can not exceed %u", + die, max_dies); + return -1; + } + + return 0; +} + +static void +power_amd_uncore_esmi_init(void) +{ + if (esmi_init() == ESMI_SUCCESS) { + if (esmi_hsmp_proto_ver_get(&hsmp_proto_ver) == + ESMI_SUCCESS) + esmi_initialized = 1; + } +} + +int +power_amd_uncore_init(unsigned int pkg, unsigned int die) +{ + struct uncore_power_info *ui; + int ret; + + if (!esmi_initialized) { + ret = esmi_init(); + if (ret != ESMI_SUCCESS) { + POWER_LOG(DEBUG, "ESMI Not initialized, drivers not found"); + return -1; + } + ret = esmi_hsmp_proto_ver_get(&hsmp_proto_ver); + if (ret != ESMI_SUCCESS) { + POWER_LOG(DEBUG, "HSMP Proto Version Get failed with " + "error %s", esmi_get_err_msg(ret)); + esmi_exit(); + return -1; + } + esmi_initialized = 1; + } + + ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + ui = &uncore_info[pkg][die]; + ui->die = die; + ui->pkg = pkg; + + /* Init for setting uncore die frequency */ + if (power_init_for_setting_uncore_freq(ui) < 0) { + POWER_LOG(DEBUG, "Cannot init for setting uncore frequency for " + "pkg %02u die %02u", pkg, die); + return -1; + } + + /* Get the available frequencies */ + if (power_get_available_uncore_freqs(ui) < 0) { + POWER_LOG(DEBUG, "Cannot get available uncore frequencies of " + "pkg %02u die %02u", pkg, die); + return -1; + } + + return 0; +} + +int +power_amd_uncore_exit(unsigned int pkg, unsigned int die) +{ + struct uncore_power_info *ui; + + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + ui = &uncore_info[pkg][die]; + ui->nb_freqs = 0; + + if (esmi_initialized) { + esmi_exit(); + esmi_initialized = 0; + } + + return 0; +} + +uint32_t +power_get_amd_uncore_freq(unsigned int pkg, unsigned int die) +{ + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + return uncore_info[pkg][die].curr_idx; +} + +int +power_set_amd_uncore_freq(unsigned int pkg, unsigned int die, uint32_t index) +{ + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + return set_uncore_freq_internal(&(uncore_info[pkg][die]), index); +} + +int +power_amd_uncore_freq_max(unsigned int pkg, unsigned int die) +{ + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + return set_uncore_freq_internal(&(uncore_info[pkg][die]), 0); +} + + +int +power_amd_uncore_freq_min(unsigned int pkg, unsigned int die) +{ + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + struct uncore_power_info *ui = &uncore_info[pkg][die]; + + return set_uncore_freq_internal(&(uncore_info[pkg][die]), ui->nb_freqs - 1); +} + +int +power_amd_uncore_freqs(unsigned int pkg, unsigned int die, uint32_t *freqs, uint32_t num) +{ + struct uncore_power_info *ui; + + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + if (freqs == NULL) { + POWER_LOG(ERR, "NULL buffer supplied"); + return 0; + } + + ui = &uncore_info[pkg][die]; + if (num < ui->nb_freqs) { + POWER_LOG(ERR, "Buffer size is not enough"); + return 0; + } + rte_memcpy(freqs, ui->freqs, ui->nb_freqs * sizeof(uint32_t)); + + return ui->nb_freqs; +} + +int +power_amd_uncore_get_num_freqs(unsigned int pkg, unsigned int die) +{ + int ret = check_pkg_die_values(pkg, die); + if (ret < 0) + return -1; + + return uncore_info[pkg][die].nb_freqs; +} + +unsigned int +power_amd_uncore_get_num_pkgs(void) +{ + uint32_t num_pkgs = 0; + int ret; + + if (esmi_initialized) { + ret = esmi_number_of_sockets_get(&num_pkgs); + if (ret != ESMI_SUCCESS) { + POWER_LOG(ERR, "Failed to get number of sockets"); + num_pkgs = 0; + } + } + return num_pkgs; +} + +unsigned int +power_amd_uncore_get_num_dies(unsigned int pkg) +{ + if (pkg >= power_amd_uncore_get_num_pkgs()) { + POWER_LOG(ERR, "Invalid package ID"); + return 0; + } + + return 1; +} + +static struct rte_power_uncore_ops amd_uncore_ops = { + .name = "amd-hsmp", + .cb = power_amd_uncore_esmi_init, + .init = power_amd_uncore_init, + .exit = power_amd_uncore_exit, + .get_avail_freqs = power_amd_uncore_freqs, + .get_num_pkgs = power_amd_uncore_get_num_pkgs, + .get_num_dies = power_amd_uncore_get_num_dies, + .get_num_freqs = power_amd_uncore_get_num_freqs, + .get_freq = power_get_amd_uncore_freq, + .set_freq = power_set_amd_uncore_freq, + .freq_max = power_amd_uncore_freq_max, + .freq_min = power_amd_uncore_freq_min, +}; + +RTE_POWER_REGISTER_UNCORE_OPS(amd_uncore_ops); diff --git a/drivers/power/amd_uncore/amd_uncore.h b/drivers/power/amd_uncore/amd_uncore.h new file mode 100644 index 0000000000..a142034479 --- /dev/null +++ b/drivers/power/amd_uncore/amd_uncore.h @@ -0,0 +1,225 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright(c) 2024 Advanced Micro Devices, Inc. + */ + +#ifndef POWER_AMD_UNCORE_H +#define POWER_AMD_UNCORE_H + +/** + * @file + * RTE AMD Uncore Frequency Management + */ + +#include "power_uncore_ops.h" + +#ifdef __cplusplus +extern "C" { +#endif + +/** + * Initialize uncore frequency management for specific die on a package. + * It will get the available frequencies and prepare to set new die frequencies. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * - 0 on success. + * - Negative on error. + */ +int +power_amd_uncore_init(unsigned int pkg, unsigned int die); + +/** + * Exit uncore frequency management on a specific die on a package. + * It will restore uncore min and* max values to previous values + * before initialization of API. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * - 0 on success. + * - Negative on error. + */ +int +power_amd_uncore_exit(unsigned int pkg, unsigned int die); + +/** + * Return the current index of available frequencies of a specific die on a package. + * It should be protected outside of this function for threadsafe. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * The current index of available frequencies. + * If error, it will return 'RTE_POWER_INVALID_FREQ_INDEX = (~0)'. + */ +uint32_t +power_get_amd_uncore_freq(unsigned int pkg, unsigned int die); + +/** + * Set minimum and maximum uncore frequency for specified die on a package + * to specified index value. + * It should be protected outside of this function for threadsafe. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * @param index + * The index of available frequencies. + * + * @return + * - 1 on success with frequency changed. + * - 0 on success without frequency changed. + * - Negative on error. + */ +int +power_set_amd_uncore_freq(unsigned int pkg, unsigned int die, uint32_t index); + +/** + * Set minimum and maximum uncore frequency for specified die on a package + * to maximum value according to the available frequencies. + * It should be protected outside of this function for threadsafe. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * - 1 on success with frequency changed. + * - 0 on success without frequency changed. + * - Negative on error. + */ +int +power_amd_uncore_freq_max(unsigned int pkg, unsigned int die); + +/** + * Set minimum and maximum uncore frequency for specified die on a package + * to minimum value according to the available frequencies. + * It should be protected outside of this function for threadsafe. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * - 1 on success with frequency changed. + * - 0 on success without frequency changed. + * - Negative on error. + */ +int +power_amd_uncore_freq_min(unsigned int pkg, unsigned int die); + +/** + * Return the list of available frequencies in the index array. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * @param freqs + * The buffer array to save the frequencies. + * @param num + * The number of frequencies to get. + * + * @return + * - The number of available index's in frequency array. + * - Negative on error. + */ +int +power_amd_uncore_freqs(unsigned int pkg, unsigned int die, + unsigned int *freqs, unsigned int num); + +/** + * Return the list length of available frequencies in the index array. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * @param die + * Die number. + * Each package can have several dies connected together via the uncore mesh. + * + * @return + * - The number of available index's in frequency array. + * - Negative on error. + */ +int +power_amd_uncore_get_num_freqs(unsigned int pkg, unsigned int die); + +/** + * Return the number of packages (CPUs) on a system + * by parsing the uncore sysfs directory. + * + * This function should NOT be called in the fast path. + * + * @return + * - Zero on error. + * - Number of package on system on success. + */ +unsigned int +power_amd_uncore_get_num_pkgs(void); + +/** + * Return the number of dies for pakckages (CPUs) specified + * from parsing the uncore sysfs directory. + * + * This function should NOT be called in the fast path. + * + * @param pkg + * Package number. + * Each physical CPU in a system is referred to as a package. + * + * @return + * - Zero on error. + * - Number of dies for package on sucecss. + */ +unsigned int +power_amd_uncore_get_num_dies(unsigned int pkg); + +#ifdef __cplusplus +} +#endif + +#endif /* POWER_INTEL_UNCORE_H */ diff --git a/drivers/power/amd_uncore/meson.build b/drivers/power/amd_uncore/meson.build new file mode 100644 index 0000000000..8cbab47b01 --- /dev/null +++ b/drivers/power/amd_uncore/meson.build @@ -0,0 +1,20 @@ +# SPDX-License-Identifier: BSD-3-Clause +# Copyright(c) 2024 Advanced Micro Devices, Inc. + +if not is_linux + build = false + reason = 'only supported on Linux' + subdir_done() +endif + +ESMI_header = '#include' +lib = cc.find_library('e_smi64', required: false) +if not lib.found() + build = false + reason = 'missing dependency, "libe_smi"' +else + ext_deps += lib +endif + +sources = files('amd_uncore.c') +deps += ['power'] diff --git a/drivers/power/meson.build b/drivers/power/meson.build index c83047af94..4ba5954e13 100644 --- a/drivers/power/meson.build +++ b/drivers/power/meson.build @@ -7,6 +7,7 @@ drivers = [ 'cppc', 'kvm_vm', 'pstate', + 'amd_uncore', 'intel_uncore' ] -- 2.34.1