From: "Hunt, David" <david.hunt@intel.com>
To: Thomas Monjalon <thomas@monjalon.net>
Cc: dev@dpdk.org, "Ananyev, Konstantin" <konstantin.ananyev@intel.com>
Subject: Re: [dpdk-dev] [PATCH v1 0/10] Policy Based Power Control for Guest
Date: Fri, 22 Sep 2017 14:12:08 +0100 [thread overview]
Message-ID: <6d81ac23-09aa-becd-6cc3-5e4d9418cb75@intel.com> (raw)
In-Reply-To: <1541048.iMoFMbgTmX@xps>
On 22/9/2017 2:03 PM, Thomas Monjalon wrote:
> 22/09/2017 12:28, Hunt, David:
>> On 22/9/2017 10:51 AM, Thomas Monjalon wrote:
>>> 29/08/2017 15:03, Ananyev, Konstantin:
>>>> Hi Dave,
>>>>
>>>>> This patchset adds the facility for a guest VM to send a policy down to
>>>>> the host that will allow the host to scale up/down cpu frequencies
>>>>> depending on the policy criteria independently of the DPDK app running in
>>>>> the guest. This differs from the previous vm_power implementation where
>>>>> individual scale up/down requests were send from the guest to the host via
>>>>> virtio-serial.
>>>>>
>>>>> It's a modification of the vm_power_manager app that runs in the host, and
>>>>> the guest_vm_power_app example app that runs in the guest. This allows the
>>>>> guest to send down a policy to the host via virtio-serial, which then allows
>>>>> the host to scale up/down based on the criteria in the policy, resulting in
>>>>> quicker scale up/down than individual requests coming from the guest.
>>>>> It also means that the DPDK application running in the guest does not need
>>>>> to be modified in any way, it is unaware that it's cores are being scaled
>>>>> up/down, reducing the effort in implementing a power-aware infrastructure.
>>>>>
>>>>> The usage model is as follows:
>>>>> 1. Set up the VF's and assign to the guest in the usual way.
>>>>> 2. run vm_power_manager on the host, creating a channel to the guest.
>>>>> 3. Start the guest_vm_power_mgr app on the guest, which establishes
>>>>> a virtio-serial channel to the host.
>>>>> 4. Send down the profile for the guest using the "send_profile now" command.
>>>>> There is an example profile hard-coded into guest_vm_power_mgr.
>>>>> 5. Stop the guest_vm_power_mgr and run your normal power-unaware application.
>>>>> 6. Send traffic into the VFs at varying traffic rates.
>>>>> Observe the frequency change on the host (turbostat -i 1)
>>>>>
>>>>> The sequence of code changes are as follows:
>>>>>
>>>>> Firstly, two new API calls are added to the ethdev layer
>>>>> 1. One to convert a VF id to a PF id. In the patchset
>>>>> this id is a MAC address. This is needed so that the host can map the VFs
>>>>> in the profile to PF so in can monitor the traffic on the relevant PF at the
>>>>> host level.
>>>>> 2. The other function is to read the low-level traffic throughput on the NIC.
>>>>> Currently this API reads a NIC register for speed, but we are looking at
>>>>> using a more generic way to get these stats, suggestions welcome.
>>>> Why do you need a server (host) to collect RX/TX statistics for VM?
>>>> Such method seems to have a lot of limitations:
>>>> - no clear method to identify to which VM that VF belongs.
>>>> - rely on HW ability to provide such statistics for PF
>>>> (limited HW support).
>>>> - wouldn't work if PF is not controlled by the same DPDK app.
>>>> Why not to make it client(VM) responsibility to collect that statistics and
>>>> periodically send it to the server?
>>>> Then server just will have to process that data and make decision.
>>> Any progress Dave?
>>>
>>> You have another series "turbo boost API". Does it depends on this one?
>> Hi Thomas,
>>
>> We're still working on updates based on Konstantin's feedback above, and
>> hope to have a new patch set submitted to the mailing list early next
>> week. This will remove the ethdev layer changes, and uses pre-existing
>> stats-api.
>>
>> In relation to the Turbo patch, they are still independent, but when we
>> have the next revision of the Policy patch submitted, I'll do a new
>> version of the Turbo patch so that it can be applied on top of the
>> policy patch.
> OK, thanks
>
> If the turbo patch is independent, I can push it now?
Yes, absolutely. And I can then ensure the next version of the policy
patch-set applies on top of it.
Regards,
Dave.
next prev parent reply other threads:[~2017-09-22 13:12 UTC|newest]
Thread overview: 105+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-08-25 16:02 David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 01/10] net/i40e: add API to convert VF Id to PF Id David Hunt
2017-09-22 9:56 ` Thomas Monjalon
2017-09-22 12:39 ` Hunt, David
2017-09-25 2:43 ` Wu, Jingjing
2017-09-25 9:57 ` Hunt, David
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 02/10] net/i40e: add API to get received packet count David Hunt
2017-09-25 2:47 ` Wu, Jingjing
2017-09-25 9:59 ` Hunt, David
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 03/10] lib/librte_power: add extra msg type for policies David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 04/10] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 05/10] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 06/10] examples/vm_power_mgr: add policy to channels David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 07/10] examples/vm_power_mgr: add port initialisation David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 08/10] examples/guest_cli: add send policy to host David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 09/10] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-08-25 16:02 ` [dpdk-dev] [PATCH v1 10/10] net/i40e: set register for no drop David Hunt
2017-09-25 2:50 ` Wu, Jingjing
2017-09-25 9:44 ` Hunt, David
2017-08-29 13:03 ` [dpdk-dev] [PATCH v1 0/10] Policy Based Power Control for Guest Ananyev, Konstantin
2017-09-22 9:51 ` Thomas Monjalon
2017-09-22 10:28 ` Hunt, David
2017-09-22 13:03 ` Thomas Monjalon
2017-09-22 13:12 ` Hunt, David [this message]
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2] " David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 1/8] net/i40e: add API to convert VF MAC to VSI index David Hunt
2017-09-26 14:04 ` Wu, Jingjing
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 2/8] lib/librte_power: add extra msg type for policies David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 3/8] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 4/8] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 5/8] examples/vm_power_mgr: add policy to channels David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 6/8] examples/vm_power_mgr: add port initialisation David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 7/8] examples/guest_cli: add send policy to host David Hunt
2017-09-25 12:27 ` [dpdk-dev] [PATCH v2 8/8] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4] Policy Based Power Control for Guest David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 1/9] net/i40e: add API to convert VF MAC to VF id David Hunt
2017-10-04 15:26 ` santosh
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 2/9] lib/librte_power: add extra msg type for policies David Hunt
2017-10-04 15:36 ` santosh
2017-10-05 8:38 ` Hunt, David
2017-10-05 9:21 ` santosh
2017-10-05 9:51 ` Hunt, David
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 3/9] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 4/9] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 5/9] examples/vm_power_mgr: add policy to channels David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 6/9] examples/vm_power_mgr: add port initialisation David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 7/9] power: add send channel msg function to map file David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 8/9] examples/guest_cli: add send policy to host David Hunt
2017-10-04 9:15 ` [dpdk-dev] [PATCH v4 9/9] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 0/9] Policy Based Power Control for Guest David Hunt
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 1/9] net/i40e: add API to convert VF MAC to VF id David Hunt
2017-10-04 15:41 ` santosh
2017-10-05 8:31 ` Hunt, David
2017-10-05 9:22 ` santosh
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 2/9] lib/librte_power: add extra msg type for policies David Hunt
2017-10-04 15:47 ` santosh
2017-10-05 8:41 ` Hunt, David
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 3/9] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-10-04 15:58 ` santosh
2017-10-05 8:44 ` Hunt, David
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 4/9] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-10-04 16:04 ` santosh
2017-10-05 8:47 ` Hunt, David
2017-10-05 9:07 ` santosh
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 5/9] examples/vm_power_mgr: add policy to channels David Hunt
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 6/9] examples/vm_power_mgr: add port initialisation David Hunt
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 7/9] power: add send channel msg function to map file David Hunt
2017-10-04 16:20 ` santosh
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 8/9] examples/guest_cli: add send policy to host David Hunt
2017-10-04 15:25 ` [dpdk-dev] [PATCH v5 9/9] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 0/9] Policy Based Power Control for Guest David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 1/9] net/i40e: add API to convert VF MAC to VF id David Hunt
2017-10-05 12:45 ` Ananyev, Konstantin
2017-10-05 12:51 ` Hunt, David
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 2/9] lib/librte_power: add extra msg type for policies David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 3/9] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 4/9] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 5/9] examples/vm_power_mgr: add policy to channels David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 6/9] examples/vm_power_mgr: add port initialisation David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 7/9] power: add send channel msg function to map file David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 8/9] examples/guest_cli: add send policy to host David Hunt
2017-10-05 12:25 ` [dpdk-dev] [PATCH v6 9/9] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 0/9] Policy Based Power Control for Guest David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 1/9] net/i40e: add API to convert VF MAC to VF id David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 2/9] lib/librte_power: add extra msg type for policies David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 3/9] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 4/9] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 5/9] examples/vm_power_mgr: add policy to channels David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 6/9] examples/vm_power_mgr: add port initialisation David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 7/9] power: add send channel msg function to map file David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 8/9] examples/guest_cli: add send policy to host David Hunt
2017-10-05 13:28 ` [dpdk-dev] [PATCH v7 9/9] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-05 13:54 ` [dpdk-dev] [PATCH v7 0/9] Policy Based Power Control for Guest Ananyev, Konstantin
2017-10-05 14:12 ` santosh
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 " David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 1/9] net/i40e: add API to convert VF MAC to VF id David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 2/9] lib/librte_power: add extra msg type for policies David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 3/9] examples/vm_power_mgr: add vcpu to pcpu mapping David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 4/9] examples/vm_power_mgr: add scale to medium freq fn David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 5/9] examples/vm_power_mgr: add policy to channels David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 6/9] examples/vm_power_mgr: add port initialisation David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 7/9] power: add send channel msg function to map file David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 8/9] examples/guest_cli: add send policy to host David Hunt
2017-10-05 14:34 ` [dpdk-dev] [PATCH v8 9/9] examples/vm_power_mgr: set MAC address of VF David Hunt
2017-10-09 22:34 ` [dpdk-dev] [PATCH v8 0/9] Policy Based Power Control for Guest Ferruh Yigit
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=6d81ac23-09aa-becd-6cc3-5e4d9418cb75@intel.com \
--to=david.hunt@intel.com \
--cc=dev@dpdk.org \
--cc=konstantin.ananyev@intel.com \
--cc=thomas@monjalon.net \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).