From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 652E268B7 for ; Fri, 4 Oct 2013 18:44:22 +0200 (CEST) Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga102.jf.intel.com with ESMTP; 04 Oct 2013 09:41:52 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.90,1034,1371106800"; d="scan'208";a="387963876" Received: from irsmsx101.ger.corp.intel.com ([163.33.3.153]) by orsmga001.jf.intel.com with ESMTP; 04 Oct 2013 09:45:02 -0700 Received: from irsmsx152.ger.corp.intel.com (163.33.192.66) by IRSMSX101.ger.corp.intel.com (163.33.3.153) with Microsoft SMTP Server (TLS) id 14.3.123.3; Fri, 4 Oct 2013 17:45:01 +0100 Received: from irsmsx103.ger.corp.intel.com ([169.254.3.100]) by IRSMSX152.ger.corp.intel.com ([163.33.192.66]) with mapi id 14.03.0123.003; Fri, 4 Oct 2013 17:45:01 +0100 From: "Richardson, Bruce" To: Stephen Hemminger , Walter de Donato Thread-Topic: [dpdk-dev] Multi-process on the same host Thread-Index: AQHOwPi1ZpeHXUFcUk+AuEej9EH9AZnkrbUAgAAR29A= Date: Fri, 4 Oct 2013 16:45:00 +0000 Message-ID: <59AF69C657FD0841A61C55336867B5B01A94CDBD@IRSMSX103.ger.corp.intel.com> References: <20131004093852.03ccedf5@nehalam.linuxnetplumber.net> In-Reply-To: <20131004093852.03ccedf5@nehalam.linuxnetplumber.net> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [163.33.239.182] Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] Multi-process on the same host X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Oct 2013 16:44:22 -0000 > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Stephen > Hemminger > Sent: Friday, October 04, 2013 5:39 PM > To: Walter de Donato > Cc: dev@dpdk.org > Subject: Re: [dpdk-dev] Multi-process on the same host > = > On Fri, 4 Oct 2013 13:47:02 +0200 > Walter de Donato wrote: > = > > Hello, > > > > I've been using DPDK for a while and now I encountered the following > issue: > > when I try to run two primary processes on the same host (with > > --no-shconf option enabled) respectively sending packets on one port > > and receiving them on a different port (the two ports are directly > > connected with a CAT-6 cable), I get this error on the receiving proces= s: > > > > Program received signal SIGSEGV, Segmentation fault. > > 0x00000000004158a0 in rte_eth_rx_burst (port_id=3D0 '\000', > queue_id=3D0, > > rx_pkts=3D0x7ffff5baa8f0, nb_pkts=3D128) at > > /home/devel/dpdk/build/include/rte_ethdev.h:1658 > > 1658 return (*dev->rx_pkt_burst)(dev->data- > >rx_queues[queue_id], > > rx_pkts, nb_pkts); > > > > To give some more details: > > - the options given to the two processes: > > ./receiver -c 0x3 -n 2 -m 200 --no-shconf -- -p 0x1 > > ./sender -c 0xc -n 2 -m 200 --no-shconf -- -p 0x2 > > where the -p option is the binary mask to select the ports to enable. > > - the network card is a dualport Intel X540: > > port 0: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev > 01) > > port 1: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 > > (rev 01) > > - this is the hugeadm --pool-list output: > > Size Minimum Current Maximum Default > > 1073741824 2 2 2 * > > > > My first question is: should it be possible to let separate primary > > processes coexist if they use different resources (cores, ports, > > memory pools)? > > > > A second question is: there is any other workaround to let this > > scenario work without merging the two processes into two lcores of the > same process? > > > > Thanks in advance, > > -Walter > = > The problem is that huge TLB filesystem is a shared resource. > Because of that the memory pools of the two processes overlap, and > memory pools are used for packet buffers, malloc, etc. > = > You might be able to use no-huge, but then other things would probably > break. The way to run two primary processes side by side is documented in the docu= ment "Intel(r) Data Plane Development Kit (Intel(r) DPDK): Programmer's Gui= de" available at: http://www.intel.com/content/www/us/en/intelligent-system= s/intel-technology/intel-dpdk-programmers-guide.html and is covered in sect= ion 17.2.3. You need to pass the "--file-prefix" flag when running your app= lication to force the processes to use different hugepage files so they are= not shared among the two processes. Regards, /Bruce -------------------------------------------------------------- Intel Shannon Limited Registered in Ireland Registered Office: Collinstown Industrial Park, Leixlip, County Kildare Registered Number: 308263 Business address: Dromore House, East Park, Shannon, Co. Clare This e-mail and any attachments may contain confidential material for the s= ole use of the intended recipient(s). Any review or distribution by others = is strictly prohibited. If you are not the intended recipient, please conta= ct the sender and delete all copies.