From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pd0-f170.google.com (mail-pd0-f170.google.com [209.85.192.170]) by dpdk.org (Postfix) with ESMTP id D7388DE0 for ; Mon, 25 Nov 2013 20:54:16 +0100 (CET) Received: by mail-pd0-f170.google.com with SMTP id g10so6213660pdj.15 for ; Mon, 25 Nov 2013 11:55:16 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:user-agent:date:subject:from:to:message-id :thread-topic:in-reply-to:mime-version:content-type :content-transfer-encoding; bh=nqg1m8DFDfOrKxL1ZlyDhTpuq+ZAJ4dhJWHpUiCz1Fc=; b=IcH4kt+aQBrbdt1uQmO+iCO7M4Y4ppGxfKpNpJs1IJ/BJGPj6zYuQtbvyqYz9hy8Yo 5d4us7m7cNmQduSJ7nLz0Hno4y3GXq4SYG5ZOcN0dk1XFvZVoTNSDja4YEITikupW+p3 H7rSwsMO9+5ccyhWkPEVMSDYmxtXf28S4TZuWUuxKFQ9K5YTvKtgpXwFS9bJs4Zl3NHo vBz07K/OISqVCifh2HGKqUn2JYRM58wUWEZcgUgff9d08Z5QGoa6s+jAnMA0JtaUcJsD Wo6p177HZ2LjpucGRyFwPOXUEIYYglYsob3AKXzxJNonuBZPyuxRbJCAW3+2DNRSO6R3 MGNA== X-Gm-Message-State: ALoCoQk194npZKzqxrSR7NBJY/c38FMqPzi1mtTYB0ne1r5q1Cnfxl09HvU4ZUHeVHRE+9yh5+WV X-Received: by 10.66.149.73 with SMTP id ty9mr28739955pab.36.1385409315913; Mon, 25 Nov 2013 11:55:15 -0800 (PST) Received: from [10.0.1.90] (50-193-46-99-static.hfc.comcastbusiness.net. [50.193.46.99]) by mx.google.com with ESMTPSA id uf2sm75186231pbc.28.2013.11.25.11.55.13 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Mon, 25 Nov 2013 11:55:14 -0800 (PST) User-Agent: Microsoft-MacOutlook/14.3.7.130812 Date: Mon, 25 Nov 2013 11:55:16 -0800 From: "Jeff Venable, Sr." To: Prashant Upadhyaya , "Richardson, Bruce" , "dev@dpdk.org" Message-ID: Thread-Topic: [dpdk-dev] Query regarding multiple processes in DPDK In-Reply-To: Mime-version: 1.0 Content-type: text/plain; charset="ISO-8859-1" Content-transfer-encoding: quoted-printable Subject: Re: [dpdk-dev] Query regarding multiple processes in DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Nov 2013 19:54:17 -0000 The memory configuration will persist while the files describing them do. By default, these are located in /var/run/.rte_config and /var/run/.rte_hugepage_info. Even if you terminate all processes, you can still launch new secondary processes which will find those files and attach, and unless something is messing with your huge pages the memory state will be as it was left before. The logic for these file locations is in lib/librte_eal/linuxapp/eal/include/eal_filesystem.h if you want to review the code. You can search the rest of the code for calls to these functions to locate the logic regarding what=B9s stored in the files. Jeff On 11/25/13, 5:57 AM, "Prashant Upadhyaya" wrote: >Hi Bruce, > >Thanks, this was very useful information. > >Regards >-Prashant > > >-----Original Message----- >From: Richardson, Bruce [mailto:bruce.richardson@intel.com] >Sent: Monday, November 25, 2013 2:59 PM >To: Prashant Upadhyaya; dev@dpdk.org >Subject: RE: Query regarding multiple processes in DPDK > >If the primary process dies: >a) The memory does not go away, so the second process can still use it >b) When restarting the primary process, you should restart it as a >secondary one, to ensure it reattaches to memory properly instead of >trying to re-initialize it. > >Regards >/Bruce > >> -----Original Message----- >> From: Prashant Upadhyaya [mailto:prashant.upadhyaya@aricent.com] >> Sent: Monday, November 25, 2013 4:08 AM >> To: Richardson, Bruce; dev@dpdk.org >> Subject: RE: Query regarding multiple processes in DPDK >> >> Hi Bruce, >> >> One more question -- >> >> Suppose the first instance comes up as primary and creates the mbuf >> pool and rings etc. [ok] Now, the second instance comes up as >> secondary and does the corresponding lookup functions [ok] Now the >> primary exits -- at this point can the secondary still run with all >> the memory to which it had done the lookup intact, or does the fact >> that primary died will lead to all the memory also taken away with it >> so that the secondary can no longer function now ? >> >> Regards >> -Prashant >> >> >> -----Original Message----- >> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Prashant >> Upadhyaya >> Sent: Friday, November 22, 2013 7:16 PM >> To: Richardson, Bruce; dev@dpdk.org >> Subject: Re: [dpdk-dev] Query regarding multiple processes in DPDK >> >> Thanks Bruce, I think your suggested example of multi_process answers >> my questions. >> >> Regards >> -Prashant >> >> >> -----Original Message----- >> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Prashant >> Upadhyaya >> Sent: Friday, November 22, 2013 7:10 PM >> To: Richardson, Bruce; dev@dpdk.org >> Subject: Re: [dpdk-dev] Query regarding multiple processes in DPDK >> >> Hi Bruce, >> >> Thanks. >> >> Regarding your comment -- >> [BR] It will depend upon the application, but in most cases you >> probably want to have slightly different code paths for primary and >> secondary instances. For example, if a process is running as primary >> instance, it will probably call rte_mempool_create or rte_ring_create. >> A secondary instance which wants to use these should instead call >> rte_mempool_lookup and rte_ring_lookup instead. >> For an example of how to write the one binary to be used as both >> primary and secondary process, I suggest looking at the symmetric_mp >> example application in the examples/multi_process/ directory. >> >> I was really hoping that the --proc-type=3Dauto, would make the DPDK >> libraries internally resolving all this stuff, is that not the case ? >> I have not started reading the code for all this yet. >> I must launch the same executable twice in my usecase. Even if the >> executable code has to make different calls when it comes up as >> secondary, is there a way for the usercode to know that it has really >> come up as secondary when the --proc-type=3Dauto is used ? >> >> Regards >> -Prashant >> >> -----Original Message----- >> From: Richardson, Bruce [mailto:bruce.richardson@intel.com] >> Sent: Friday, November 22, 2013 7:02 PM >> To: Prashant Upadhyaya; dev@dpdk.org >> Subject: RE: Query regarding multiple processes in DPDK >> >> Hi Prashant >> >> > =3D=3D=3D >> > The EAL also supports an auto-detection mode (set by EAL >> > --proc-type=3Dauto flag), whereby an Intel(r) DPDK process is started >> > as a secondary instance if a primary instance is already running. >> > =3D=3D=3D >> > >> > So does this mean that if I have a DPDK exe foo.out, then when I run >> > the first instance of foo.out with -proc-type =3D auto, then foo.out >> > will run as a primary process and when I spawn the second instance >> > of foo.out (with first already running) again with -proc-type=3Dauto, >> > then this second instance automatically becomes secondary ? >> [BR] Yes, that is the idea. >> >> > >> > Also is there any user code initialization change required or >> > exactly the same code will work for both the processes ? >> [BR] It will depend upon the application, but in most cases you >> probably want to have slightly different code paths for primary and >> secondary instances. For example, if a process is running as primary >> instance, it will probably call rte_mempool_create or rte_ring_create. >> A secondary instance which wants to use these should instead call >> rte_mempool_lookup and rte_ring_lookup instead. >> For an example of how to write the one binary to be used as both >> primary and secondary process, I suggest looking at the symmetric_mp >> example application in the examples/multi_process/ directory. >> >> Regards, >> /Bruce >> >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> Please refer to http://www.aricent.com/legal/email_disclaimer.html >> for important disclosures regarding this electronic communication. >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> Please refer to http://www.aricent.com/legal/email_disclaimer.html >> for important disclosures regarding this electronic communication. >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> >> >> >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> Please refer to http://www.aricent.com/legal/email_disclaimer.html >> for important disclosures regarding this electronic communication. >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > > > >=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >=3D=3D=3D=3D=3D >Please refer to http://www.aricent.com/legal/email_disclaimer.html >for important disclosures regarding this electronic communication. >=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >=3D=3D=3D=3D=3D