From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pa0-f54.google.com (mail-pa0-f54.google.com [209.85.220.54]) by dpdk.org (Postfix) with ESMTP id 9CECB1F3 for ; Fri, 4 Oct 2013 18:38:12 +0200 (CEST) Received: by mail-pa0-f54.google.com with SMTP id kx10so4437678pab.41 for ; Fri, 04 Oct 2013 09:38:55 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-type:content-transfer-encoding; bh=CCivVLWhE0PXNCxA+u7zimwbbIewm7kpR7nsFmgKPD0=; b=Hn6lEIUx5G+4GAbbHJv3tF2U3EiHSG6iqHKIJQVyg1UNDWwbjS0bGaqQWquPCqw/TH x2suuMCCd9G6obXvIKG4eUo0UvNdqW+2/jrdTs1tgtuvfUNZk8GFmFz1DvMV5p5W0cpo rNWPorY86JsSLU817E6QorxP/wQ0XoJ0yxiXQQjH4VJuNpkTeSZ5P5ij8Ve/9Y+SwEG1 AXozuwsH2xijqFQhdR9N87fwxDjJuYCZHVYnD4prO3k4oSQzOsRItLoVnHGDnKCB389c T8JDdspmD+XUrREficdKZmDg2h7xN+1a6tjgjfG3mvmC23MaQVdz76czarBpwDrzzt7I m3tg== X-Gm-Message-State: ALoCoQm6v9/ytOok0x9fOCqZgmQKHNnmgXi9100TCV22nOxd/I4BBzExLfbSLP5NGC9vq5KL4Cji X-Received: by 10.66.180.200 with SMTP id dq8mr16834526pac.104.1380904735618; Fri, 04 Oct 2013 09:38:55 -0700 (PDT) Received: from nehalam.linuxnetplumber.net (static-50-53-83-51.bvtn.or.frontiernet.net. [50.53.83.51]) by mx.google.com with ESMTPSA id b3sm15735916pbu.38.1969.12.31.16.00.00 (version=TLSv1.2 cipher=RC4-SHA bits=128/128); Fri, 04 Oct 2013 09:38:55 -0700 (PDT) Date: Fri, 4 Oct 2013 09:38:52 -0700 From: Stephen Hemminger To: Walter de Donato Message-ID: <20131004093852.03ccedf5@nehalam.linuxnetplumber.net> In-Reply-To: References: X-Mailer: Claws Mail 3.8.1 (GTK+ 2.24.10; x86_64-pc-linux-gnu) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: dev@dpdk.org Subject: Re: [dpdk-dev] Multi-process on the same host X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Oct 2013 16:38:13 -0000 On Fri, 4 Oct 2013 13:47:02 +0200 Walter de Donato wrote: > Hello, > > I've been using DPDK for a while and now I encountered the following issue: > when I try to run two primary processes on the same host (with --no-shconf > option enabled) respectively sending packets on one port and receiving them > on a different port (the two ports are directly connected with a CAT-6 > cable), I get this error on the receiving process: > > Program received signal SIGSEGV, Segmentation fault. > 0x00000000004158a0 in rte_eth_rx_burst (port_id=0 '\000', queue_id=0, > rx_pkts=0x7ffff5baa8f0, nb_pkts=128) at > /home/devel/dpdk/build/include/rte_ethdev.h:1658 > 1658 return (*dev->rx_pkt_burst)(dev->data->rx_queues[queue_id], > rx_pkts, nb_pkts); > > To give some more details: > - the options given to the two processes: > ./receiver -c 0x3 -n 2 -m 200 --no-shconf -- -p 0x1 > ./sender -c 0xc -n 2 -m 200 --no-shconf -- -p 0x2 > where the -p option is the binary mask to select the ports to enable. > - the network card is a dualport Intel X540: > port 0: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01) > port 1: Intel Corporation Ethernet Controller 10 Gigabit X540-AT2 (rev 01) > - this is the hugeadm --pool-list output: > Size Minimum Current Maximum Default > 1073741824 2 2 2 * > > My first question is: should it be possible to let separate primary > processes coexist if they use different resources (cores, ports, memory > pools)? > > A second question is: there is any other workaround to let this scenario > work without merging the two processes into two lcores of the same process? > > Thanks in advance, > -Walter The problem is that huge TLB filesystem is a shared resource. Because of that the memory pools of the two processes overlap, and memory pools are used for packet buffers, malloc, etc. You might be able to use no-huge, but then other things would probably break.