From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-eopbgr30072.outbound.protection.outlook.com [40.107.3.72]) by dpdk.org (Postfix) with ESMTP id 2DA96377C for ; Wed, 20 Jul 2016 10:59:41 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=TogaNetworksLtd.onmicrosoft.com; s=selector1-toganetworks-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=/QodDBEg2C0cGDs/4+Vmn/SXMadVW6x5lEmI/1iM670=; b=pgUjkhJzv7xjds+JKDQnkzjSpxB1O2PC8MWtUv4r4qojCMgXGaeX9xEz7eahVnrKF/pvSV+O1uUPfUUIPMYG7QpXcMQh5g5gWBdLhMAX6YR3fKfBA+5biPSDVGBKUoWQATXvN3DnFspoH/wDNAP25tEOqLFXgtNvmFgW5GsktHw= Received: from VI1PR02MB1727.eurprd02.prod.outlook.com (10.166.41.144) by VI1PR02MB1728.eurprd02.prod.outlook.com (10.166.41.145) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.544.10; Wed, 20 Jul 2016 08:59:38 +0000 Received: from VI1PR02MB1727.eurprd02.prod.outlook.com ([10.166.41.144]) by VI1PR02MB1727.eurprd02.prod.outlook.com ([10.166.41.144]) with mapi id 15.01.0544.013; Wed, 20 Jul 2016 08:59:38 +0000 From: Eli Britstein To: Declan Doherty , Tetsuya Mukawa , "dev@dpdk.org" CC: "Iremonger, Bernard" Thread-Topic: [dpdk-dev] SRIOV hot unplug Thread-Index: AdHgBokZEAYxOrFcS1eredTEovecxAAZgTVwABioLMAAJjldAAARcAJgAAaCeoAAAKhcQAAmgoPA Date: Wed, 20 Jul 2016 08:59:37 +0000 Message-ID: References: <8CEF83825BEC744B83065625E567D7C21A04F18C@IRSMSX108.ger.corp.intel.com> <7be321ba-9eb7-2932-ae73-dc7a33b225e6@igel.co.jp> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=eli.britstein@toganetworks.com; x-originating-ip: [84.94.204.35] x-ms-office365-filtering-correlation-id: bbfa1c1c-a6a3-4fc9-49a4-08d3b07c2dcd x-microsoft-exchange-diagnostics: 1; VI1PR02MB1728; 6:nKHGuqS0oZtnlariOyyoL7GkWEOrH5Q05I+iQG/Moj5wfvEC4791WsYyVliJL0b3jU4mZxlfqYyVAIIcNhTVA2gRKv/avxTOfH4ouwUFXvsBz2HeH0VHwwz4QafADFG/hHxFiWAQy1jacEuL+sDRqD6Nb+5LM/3EeBwTZAAOCARag0TCMUlmjsFbu2QWjoQoe2sSLR0jtZFhke3uikvPs4VYHeU3BARGLmaiQyzEsoOreB7WaQAqM1/CVe2BftXa5uKD7ZeoB/cK0MiBBgOwgJq2Cdqxbk38Ldi8jCtYGDHjWOVFwiwWhvpznqGgGCO2; 5:3j7+1483z7eqYUBF2Y8gQOrKmWgeXeVad925ZvkciLwoPEdVsoDBvZqqRRl1apXBZzM6VlyIlACcTC4QdrGwhL2MyqLdn4rhAeXP4goPt+Op7FRSxMW/ZuxnMzzRlNKWXav58E/na7eQLysPUpWC8A==; 24:W3hv8gG/DcDEwMAFezsxLWJ7nOoJ2FvUOCKlxMAFFz/2h+AJbMElsFAHK22tFaBj+5eSLnTMtma93Un7QGEtB/f7qlRN68LGyWyG7KEHeD8=; 7:1RZwH/nhJt1nJ7/mrZY3VvcJ97FwsO+jLq2y7Tyqjz2BYt9ag/us4tQ/oXEfUloilWUpCKjkdM7bjrGUkPqpy2gN5ldjKASGzLCG+WQoDipzBQ3bppvPEwmTiGn4LwsoxyF6D5sVqnaWz1AdSHpFyBINcaKYX2B4FLS9dWAXtfokt6Vdy7CZHY+6AmH1bpSFbMOuxCXE+X0jQXc0pTDoXDX8SZs7ftQRy1bOxZnJo8/277r2bmQme4oEF8Efcw+Y x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:VI1PR02MB1728; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(72170088055959)(228905959029699)(17755550239193); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040130)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6041072)(6043046); SRVR:VI1PR02MB1728; BCL:0; PCL:0; RULEID:; SRVR:VI1PR02MB1728; x-forefront-prvs: 000947967F x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(377454003)(189002)(199003)(13464003)(34854003)(24454002)(42154003)(50986999)(54356999)(76176999)(10400500002)(101416001)(106356001)(81166006)(81156014)(19580405001)(3660700001)(19580395003)(15975445007)(5001770100001)(3280700002)(8676002)(9686002)(92566002)(77096005)(93886004)(8936002)(76576001)(86362001)(345774005)(66066001)(11100500001)(87936001)(7736002)(7696003)(105586002)(7846002)(33656002)(15395725005)(305945005)(74316002)(2906002)(122556002)(586003)(3846002)(6116002)(102836003)(5890100001)(2501003)(5002640100001)(5003600100003)(97736004)(4326007)(189998001)(2900100001)(68736007)(2950100001)(21314002); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR02MB1728; H:VI1PR02MB1727.eurprd02.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: toganetworks.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: toganetworks.com X-MS-Exchange-CrossTenant-originalarrivaltime: 20 Jul 2016 08:59:37.5810 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 73f7e7df-ca98-4f08-bf85-f137b447da96 X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR02MB1728 Subject: Re: [dpdk-dev] SRIOV hot unplug X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jul 2016 08:59:41 -0000 Integrating Tetsuya's last comments on top of the latest message and reply. > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Eli Britstein > Sent: Tuesday, 19 July, 2016 5:34 PM > To: Declan Doherty; Tetsuya Mukawa; dev@dpdk.org > Cc: Iremonger, Bernard > Subject: Re: [dpdk-dev] SRIOV hot unplug > > > > > -----Original Message----- > > From: Declan Doherty [mailto:declan.doherty@intel.com] > > Sent: Tuesday, 19 July, 2016 5:15 PM > > To: Eli Britstein; Tetsuya Mukawa; dev@dpdk.org > > Cc: Iremonger, Bernard > > Subject: Re: [dpdk-dev] SRIOV hot unplug > > > > On 07/19/2016 12:18 PM, Eli Britstein wrote: > > > > > > > > >> -----Original Message----- > > >> From: Tetsuya Mukawa [mailto:mukawa@igel.co.jp] > > >> Sent: Tuesday, 19 July, 2016 5:49 AM > > >> To: Eli Britstein; dev@dpdk.org > > >> Cc: Iremonger, Bernard > > >> Subject: Re: [dpdk-dev] SRIOV hot unplug > > >> > > >> Hi Eli, > > >> > > >> On 2016/07/18 17:47, Eli Britstein wrote: > > >>> Hi Bernard, > > >>> > > >>> Thank you for your answer. > > >>> However, to do this, I have to have some communication protocol to > > >>> the > > >> VM's application in order for it to do this sequence and > > >> acknowledge that it is now safe to proceed with detaching the device= . > > >>> This implies some kind of integration from the host side, which I > > >>> would like > > >> to avoid. > > >> > > >> I guess you should have some kind of communication channel to > > >> notice the hotpluging events from host to VM. > > > [Eli Britstein] > > > In order just to notice the hotplugging events inside the VM, I can > > > use add some udev action in the VM, in /etc/udev/rules.d/XXX > > > However, > > those are asynchronous events. The host proceeds with unplugging > > without waiting for the VM to acknowledge it. > > > [Tetsuya] Yes, it will be asynchronous. > > >> > > >>> Do you think might there be any other way for the application to > > >>> handle > > >> such event in a smooth way? > > >> > > >> So far, I guess having one more virtio-net device will be easiest wa= y. > > > [Eli Britstein] > > > Could you please elaborate your meaning? How do you mean to use this > > extra virtio-net device? > > > [Tetsuya] If you have one more network device, you can send and receive som= e kind of control messages between host and VM. It may be okay to use general socket API for this additional network device= . So I guess it's not so difficult to additionally implement it. [Eli Britstein] Again, my goal is to do the hot unplug *without* any change= /integration in the host side, just from the guest side. Thanks, Eli Thanks, Tetsuya > > > To clarify: I would like to have my bond device automatically set > > > the vNIC as > > its primary, and close/remove the VF before it is unplugged. > > > > > > Thanks, > > > Eli > > > > The only that I can think of which would allow bonding to support this > > is if you could force a link down notification to the VF. The bonding > > driver should automatically then fail over to the vNIC, but again this > > is asynchronous event so I'm not sure how you could confirm this > > action from the host other than by monitoring traffic? > [Eli Britstein] > How can I force link down notification to the VF? > > > > > Also I don't know if the DPDK environment has been tested to support > > the removal of dynamic hot-plugging you are suggesting via the udev > action. > > There are no hooks that I'm aware of which would detect that the PCI > > device is no longer available and then clean the resources away in DPDK= . > > > > > > > > > > > > > > Also could you please drop the footer/disclaimer on replies to the > > mailing list (see http://dpdk.org/ml) > > -------------------------------------------------------------------------= --------------------- > --------------------------------------------------- > This email and any files transmitted and/or attachments with it are > confidential and proprietary information of Toga Networks Ltd., and > intended solely for the use of the individual or entity to whom they are > addressed. > If you have received this email in error please notify the system manager= . > This message contains confidential information of Toga Networks Ltd., and= is > intended only for the individual named. If you are not the named addresse= e > you should not disseminate, distribute or copy this e-mail. Please notify= the > sender immediately by e-mail if you have received this e-mail by mistake = and > delete this e-mail from your system. If you are not the intended recipien= t > you are notified that disclosing, copying, distributing or taking any act= ion in > reliance on the contents of this information is strictly prohibited. > -------------------------------------------------------------------------= --------------------- > -------------------------------------------------- > > -------------------------------------------------------------------------= --------------------- > --------------------------------------------------- > This email and any files transmitted and/or attachments with it are > confidential and proprietary information of Toga Networks Ltd., and > intended solely for the use of the individual or entity to whom they are > addressed. > If you have received this email in error please notify the system manager= . > This message contains confidential information of Toga Networks Ltd., and= is > intended only for the individual named. If you are not the named addresse= e > you should not disseminate, distribute or copy this e-mail. Please notify= the > sender immediately by e-mail if you have received this e-mail by mistake = and > delete this e-mail from your system. If you are not the intended recipien= t > you are notified that disclosing, copying, distributing or taking any act= ion in > reliance on the contents of this information is strictly prohibited. > -------------------------------------------------------------------------= --------------------- > -------------------------------------------------- ---------------------------------------------------------------------------= ---------------------------------------------------------------------- This email and any files transmitted and/or attachments with it are confide= ntial and proprietary information of Toga Networks Ltd., and intended solely for the use of the individual or en= tity to whom they are addressed. If you have received this email in error please notify the system manager. = This message contains confidential information of Toga Networks Ltd., and is intended only for the individual = named. If you are not the named addressee you should not disseminate, distribute or copy this e-mail. Pleas= e notify the sender immediately by e-mail if you have received this e-mail by mistake and delete this e-mai= l from your system. If you are not the intended recipient you are notified that disclosing, copying, distribut= ing or taking any action in reliance on the contents of this information is strictly prohibited. ---------------------------------------------------------------------------= ---------------------------------------------------------------------