From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2E0CD42A3E; Tue, 2 May 2023 13:19:40 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B248C40E2D; Tue, 2 May 2023 13:19:39 +0200 (CEST) Received: from NAM12-DM6-obe.outbound.protection.outlook.com (mail-dm6nam12on2058.outbound.protection.outlook.com [40.107.243.58]) by mails.dpdk.org (Postfix) with ESMTP id 00AFF406A2 for ; Tue, 2 May 2023 13:19:38 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SDIyBaFXKkSTBaTFzYZf+I5y1+5462qXMaQsa43LN+vh+mbaKmL/fgixg2trlJ5u87sDtRtK0Bdttr2WltruZsgpuzhB1zL32P4DkhdTKZM2ZxeEZk/QuAg2/40KrTQP4/rHnkT3XYisedFXsQHxqy5xUJ9ZVUMxLPKeljjKu/SiN4hO0Pf/s+XZOjSkgTdKHVlFbQlWfMtEIuc5edjaoGAgMqPKsLeHy4QieoKdyDNhtts1TK4nGJ0K5xRH4nG1ert99vddKAhmm86eo5QLMdWzprlN2Npbq0RwLuJEWZDfkgwo0OFV2U5AI4l8acXdZmwSPxFJf16Cxy9bnJBvIA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=sUdzN9MSlPI4lwXKwJQ6ow4pLBo6IFmfj5Yc81fW6h8=; b=cAxoKye7U45JbJLVle3XrBmiWX4QZnDSoKpdwsW7jfCm8PqDT85UIkXSD36i8Ao52mytnMs5etBibq0k4Zajugpnu/XYmgZSAEZPSOAIqNTk1b/+rj8LPMnZfW6udBmfhhsL58C2TkDCjqF7V4B0lTIDVyfC0d/gWWd/S+1A2NJSy98Z3aBjtqdrYJ7x8dI/ENSg2+CSW6J1fAB5flSNwDUxu2PSYoyrsuu/tI5f5J0tykAElN4R9scvExi96seI/R7ohGOrAm0WtwgU/vacEee53t8l1TPwQWUHRlD5GXNocrKMIjN38n9sXPg1kBJpAOW3o1hW2kcTJ1GGsX40+A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=amd.com; dmarc=pass action=none header.from=amd.com; dkim=pass header.d=amd.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=amd.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=sUdzN9MSlPI4lwXKwJQ6ow4pLBo6IFmfj5Yc81fW6h8=; b=Q7xOUJAG0JXmQzt0+MvJewif1m54DI0IL2IGB+xZ9Q08v3CItzhNeoE8XptLCdWgZkMR/M0IV0kHSlAoPDYsQg42REvHkko/6X319uMkudUWB3q9ACokBPpgY2lO169blIm6qZJX+jG+u4UuZSWrgpXSA2TDGntlKmhKedAtsvc= Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=amd.com; Received: from CH2PR12MB4294.namprd12.prod.outlook.com (2603:10b6:610:a9::11) by DM6PR12MB4466.namprd12.prod.outlook.com (2603:10b6:5:2ae::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6340.31; Tue, 2 May 2023 11:19:35 +0000 Received: from CH2PR12MB4294.namprd12.prod.outlook.com ([fe80::e818:77ea:75b5:f8cc]) by CH2PR12MB4294.namprd12.prod.outlook.com ([fe80::e818:77ea:75b5:f8cc%5]) with mapi id 15.20.6340.031; Tue, 2 May 2023 11:19:34 +0000 Message-ID: Date: Tue, 2 May 2023 12:19:28 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.10.1 Content-Language: en-US To: Jerin Jacob Cc: Sivaprasad Tummala , david.hunt@intel.com, jerinj@marvell.com, harry.van.haaren@intel.com, dev@dpdk.org, Pavan Nikhilesh , "McDaniel, Timothy" , Shijith Thotton , Hemant Agrawal , Sachin Saxena , =?UTF-8?Q?Mattias_R=c3=b6nnblom?= , Peter Mccarthy , Liang Ma References: <20230419095427.563185-1-sivaprasad.tummala@amd.com> <324d5201-da95-f926-5580-f74ca5c09799@amd.com> From: Ferruh Yigit Subject: Re: [RFC PATCH 1/5] eventdev: add power monitoring API on event port In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ClientProxiedBy: LO2P265CA0500.GBRP265.PROD.OUTLOOK.COM (2603:10a6:600:13b::7) To CH2PR12MB4294.namprd12.prod.outlook.com (2603:10b6:610:a9::11) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: CH2PR12MB4294:EE_|DM6PR12MB4466:EE_ X-MS-Office365-Filtering-Correlation-Id: 63800d59-0fcb-4957-6e5c-08db4aff1bb0 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: hUZbZMqNHR+Mhriqc44Y6R8AE6MLqF2AxlBjGKgHwjz/ug7+m9o2K3Hg332BK7lc84rEstphbdkWA0ML8n7P0gamzjMXkqmgEqdIaeFxFpn8VQ/JkGLwEK02X3SPTP+ygYbp8PWrpLjXaJt4O+MDNRxXgkPsKpmUVDp4QeIIvEBA4GYHm+rO3YHxfuOW8q7HqVHRw4c8PAZERNtCs3SBo8IfV7YPzWXIKEBL9u7EOKDeE6IEZT9KjWLdMFMuVusm918Cl1yG4oHtVU24b0lAKGLyl1J9RsbXm3fXU2wnqFTQZqiB7i8sCQJKMgiKOmYrHiVLOYKo47W4kDbWUCC7JKHrRUbxT8A+z8s/YGYIXvtBr6cEzCmn3reeKfvdxwLAiWUpo35KjYwzzCUlU5+sQLmS6AcxrBdTDs1Gd6fwemqasB6BD0yJsVOEIjYhriL61AUpMGIe2dxyQRdp7O6e4eYlsteYy+DgDkaYkk5CzoXab1Q1a9hIjunh+za4Gow4ye7T6MNBfU0nKbRxJNBZiXkYMzFp6OhAAV0SUzRBSGf7T+2L/bwrSXBTyVUlrtcEqWfdtjEhCz1hTKMKYjCgWQZujXgOb6YtUDVsl7WBFIrfE/XpA0nyD5gKYLuyIRoPa27piuHrWqmtbq5nbu5lmw== X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH2PR12MB4294.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(4636009)(396003)(346002)(376002)(39860400002)(136003)(366004)(451199021)(316002)(41300700001)(44832011)(8936002)(8676002)(83380400001)(31686004)(86362001)(66946007)(66556008)(4326008)(66476007)(2616005)(2906002)(7416002)(6916009)(5660300002)(38100700002)(36756003)(6486002)(31696002)(54906003)(53546011)(26005)(6506007)(6512007)(6666004)(186003)(478600001)(43740500002)(45980500001); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?THN1Y1d4ejFpMWxEZHFBeGtmdkJRa1F4OUJoOS9kcEtjTys5VmZFaXpyUkhi?= =?utf-8?B?YjhobW8zcmNKTTZMQytKUEV4VHNKcE1OQ2xBaSs2cS9ZYTlGb0RCUmhscEh6?= =?utf-8?B?TkdsVmtGMktkSTFIMzQrVVEvaHdXU1hvUlF4MnB1b2prcWNTNkF3enlHM2lj?= =?utf-8?B?c0IzOXl1bFFxYlU5dVpyZ1BwOUlheGppSjIwYzBlUFUyeHlvRTAwY1grQ1RF?= =?utf-8?B?anRMckl3cW1POW11K2tvbDNON0ZTSGd4dWl2cGdOb1BjWkpGbEJZMGxiR3Uy?= =?utf-8?B?TkN3cXVOUUZhNmhob1Rlb0N2UG9SWmpxVlp6Wm5aWW1kbHVwVFRRcStQZjhM?= =?utf-8?B?bVpkY2s0amxiZHhPT0lSekRJSkxnbXk0QzhiRDFrSnMrdytFRDUzMjNwSmFz?= =?utf-8?B?OXdXS3F3ZkFaUDdsRlJTSVVzUlB1ayt6Mm4vWHZTUGFsZXI0djRCZFVJTjRE?= =?utf-8?B?NVN6TnNPdFNlWG4remswdTRjOHhRUGZlcFRjc3R0Ky9oVmp1bWZCeGpOSGZV?= =?utf-8?B?YTcwUk5oMytzdGFDQkpnZDFJU0ZLY3g1bThrYnVJaHMzeEQ5VmQyTlB1RG00?= =?utf-8?B?dGlYVGxOb2NkYWJTREJBckwySHQxRkFmVmxwVkVuU2V4eEhzUWV6Vk0ycytN?= =?utf-8?B?NHFVSmxxRnY3S0I2TnYxaVhKQ3RWQVNLMTdDYjZIQ1NuSitaSTk3cEovbUdu?= =?utf-8?B?eENwOU9rOVJGN0x0VGJIeStTUGUxd21GdnVoMjJtbE9VM0xybjV3K2J2Z3Fy?= =?utf-8?B?b1F4cjJaa1Z5d09ZSVFxZDkvK1RrSS9GMUdDY2U1dDZ5SEh3MVVJbHpLRVZB?= =?utf-8?B?MGR5cHY4WnJvUjErUjNXMTZHa2NCbmsxTGNyWUp0U01aVDlhQkFHZHYxVVVN?= =?utf-8?B?SzVWOU1yTDJBMUdlbUxQUzFIRzAzTCsvTzZTbkV1RTg3MGtldGpwUS8xYmVX?= =?utf-8?B?SWYyYjA0VmRVRjZKZDdrcy9IK3BmRlU1eTkwMlpSMkhMQmdydUtBMGhzeVhr?= =?utf-8?B?d2FZcURiR1NraVFBbm4ySVRFWXNxYjZ6UUNZc3BZbVcreHRpMnAxMFRFeVg4?= =?utf-8?B?ejNTZHVXNGJMR2RrRXIrWmFSL1BwZ0ZxUDdXUXdUbW11VVd4cFNOYi85Q29q?= =?utf-8?B?KzBSVWZ6Y2ZvSnB2SG1MNlpoN1F4WWFVQVdOcmo2bGY3N2g2K1p6bVJlRzhE?= =?utf-8?B?Q0J4dXBscjBwY0R3S3FzRXBUbGhxdVkrM0hOK0NBSW5rRXlWWVFUSkdaVm1G?= =?utf-8?B?bzMwOEtsdE1PVFZ6ZWwvQU44ZXVrMkZOWmxaQlNDWGtyRTNxdURPZmpqeDM1?= =?utf-8?B?UWxNNXM1NHFsV2llZVVCbjRmZ0JYWlQyVTZpd2xJRlEyZmVyQVVJNndmSGhE?= =?utf-8?B?SjA2L1hBYndlUUV6Y0JHYm5oL0VwMDA1bVVNejVFbEZlS1c1RnhxWWF6RlBn?= =?utf-8?B?a09QQno5UVVKRkVSMDhROWpmbk5UN1VmSjNad0k2dzh3VUdpOEREeHY0clpX?= =?utf-8?B?ajdBa1l0ZWN0N3NHRk1EUVVYYjdIcFF6aVV3QWJ6S1FFUHU5MHhBR0xLMlox?= =?utf-8?B?MnFJUHBjTHlGK0MzQ2hyMVQ2WnU4ZDF4SjVzUm4xdHBWT0pFdEZLTFZMOVFY?= =?utf-8?B?NzdXNXZnM0ZEaFpGMklpU2wzbUZpOVV1V21tTjRwZEdCYVlZK3NaVHllOW9l?= =?utf-8?B?UW9BbFZDL2d2RS9MdThjakQ1ZFltMDQzbzZMandBNDhIYU5aanlJWlhjMzJz?= =?utf-8?B?RTVCNkJKNTFRN3VrZWNCZHcwZ1ZDSVQySTMwbGtRcjhYUmF0STNQQmNWWkcv?= =?utf-8?B?eDd0anZUdDF1MDc0QUJ5dlE0RzViUnNXS1ZUek14SzZxTXNHbkJxaFhjTVJ1?= =?utf-8?B?YUFpUlpqZ1Y5aXhyNTJvdGJqSXNIUjVyckJmMFZqeHBwV29xWnhUUDhNTVZB?= =?utf-8?B?cFNIL1A3MHRxUmhzcG1zdXI5V21HR0h2NjVvZVZyS3lLSHVyVGoyTnpReTB3?= =?utf-8?B?Vm5uOHdqK2hvZnlYS1JCU3ZZcGdGeEthWmtDNklRS1lUdzNMZHE1amZnOFAx?= =?utf-8?B?MmlhMzRMbFdVcGlycVFuV1Z4Uit5WkFpMm0yVWkvQW9HUjJIZit6UlRiVjJj?= =?utf-8?Q?53yx5PDt7RNpwjkm+Y0XEU1DP?= X-OriginatorOrg: amd.com X-MS-Exchange-CrossTenant-Network-Message-Id: 63800d59-0fcb-4957-6e5c-08db4aff1bb0 X-MS-Exchange-CrossTenant-AuthSource: CH2PR12MB4294.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 May 2023 11:19:34.7455 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 3dd8961f-e488-4e60-8e11-a82d994e183d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: toMwhY6xo8wO6vpgp36W6O2phA4zBSvBbvHRmW2Bg0xFTfifl6i44yEl6ecVA27G X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4466 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On 4/25/2023 5:09 AM, Jerin Jacob wrote: > On Mon, Apr 24, 2023 at 9:36 PM Ferruh Yigit wrote: >> >> On 4/19/2023 11:15 AM, Jerin Jacob wrote: >>> On Wed, Apr 19, 2023 at 3:24 PM Sivaprasad Tummala >>> wrote: >>>> >>>> A new API to allow power monitoring condition on event port to >>>> optimize power when no events are arriving on an event port for >>>> the worker core to process in an eventdev based pipelined application. >>>> >>>> Signed-off-by: Sivaprasad Tummala >>>> + * >>>> + * @param dev_id >>>> + * Eventdev id >>>> + * @param port_id >>>> + * Eventdev port id >>>> + * @param pmc >>>> + * The pointer to power-optimized monitoring condition structure. >>>> + * >>>> + * @return >>>> + * - 0: Success. >>>> + * -ENOTSUP: Operation not supported. >>>> + * -EINVAL: Invalid parameters. >>>> + * -ENODEV: Invalid device ID. >>>> + */ >>>> +__rte_experimental >>>> +int >>>> +rte_event_port_get_monitor_addr(uint8_t dev_id, uint8_t port_id, >>>> + struct rte_power_monitor_cond *pmc); >>> >>> + eventdev driver maintainers >>> >>> I think, we don't need to expose this application due to applications >>> 1)To make applications to be transparent whether power saving is enabled or not? >>> 2)Some HW and Arch already supports power managent in driver and in HW >>> (Not using CPU architecture directly) >>> >>> If so, that will be translated to following, >>> a) Add rte_event_port_power_saving_ena_dis(uint8_t dev_id, uint8_t >>> port_id, bool ena) for controlling power saving in slowpath. >>> b) Create reusable PMD private function based on the CPU architecture >>> power saving primitive to cover the PMD don't have native power saving >>> support. >>> c)Update rte_event_dequeue_burst() burst of PMD callback to use (b). >>> >>> >> >> Hi Jerin, > > Hi Ferruh, > >> >> ethdev approach seems applied here. > > Understands that. But none of the NIC HW supports power management at > HW level like eventdev, so that way > for what we are doing for ethdev is a correct abstraction for ethdev. > What I understand is there is HW based event manager and SW based ones, SW based ones can benefit more from CPU power optimizations, for HW event managers if there is not enough benefit they can just ignore the feature. >> >> In ethdev, 'rte_event_port_get_monitor_addr()' equivalent is >> 'rte_eth_get_monitor_addr()'. >> >> Although 'rte_eth_get_monitor_addr()' is public API, it is currently >> only called from Rx/Tx callback functions implemented in the power library. >> But I assume intention to make it public is to enable users to implement >> their own callback functions that has custom algorithm for the power >> management. > > If there is a use case for customizing with own callback, we can provide that. > Provided NULL is valid with default algorithm. > >> >> And probably same is true for the 'rte_event_port_get_monitor_addr()'. >> >> >> Also instead of implementing power features for withing PMDs, isn't it >> better to have a common eventdev layer for it? > > We can have rte_evetdev_pmd_* APIs as non-public APIs. > My only objection is to NOT introduce _monitor_ APIs at eventdev level, > Instead, _monitor_ is one way to do it in SW, So we need higher level > of abstraction. > I see, this seems a trade off between flexibility and usability. If application has access to _monitor_ APIs, they can be more flexible to implement their own logic. Another option can be application provides the policy with an API and monitor API used to realize the policy, but for this case it can be challenge to find and implement correct policies. >> >> For the PMDs benefit from HW event manager, just not implementing >> .get_monitor_addr() dev_ops will make them free from power related APIs. > > But application fast path code gets diverged by exposing low level primitives. > I am not clear with concern above, but for application that use default callbacks, 'rte_power_eventdev_pmgmt_port_enable()' needs to be called to enable this feature, if not called datapath is not impacted. And if not dequeue callback added at all, custom or default, data path is not impacted at all.