From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f42.google.com (mail-wm0-f42.google.com [74.125.82.42]) by dpdk.org (Postfix) with ESMTP id D5CA12B94 for ; Sat, 11 Mar 2017 16:45:44 +0100 (CET) Received: by mail-wm0-f42.google.com with SMTP id n11so13789257wma.0 for ; Sat, 11 Mar 2017 07:45:44 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=4RTEZoh+ipgHyHjTBLEr3UaX8+luHESouiyLTTzvpm4=; b=LAWwxnr6nMV6ItSQ8IEwAvTJe6/Wli8siFGAjcYDblcidN3UJrCoiVGixFPOlkVv5L CizKKQfUXKiZbZqboBhwIknAFq5F2uLj3vdKe9eDH+n9PDWhV8+Yhyc505qabDst4D9c uF91I38xXXsVCpVsCH9lBk8vuZtTYfTCq1SiGtP5GXE9pFXsOTdYvNWVtgQEGJup3FW5 BsJtDlokGwJKUC/5/qxKbxE4psGqdcZkUa1A92WWmwf2T+oGv+6x7BzP28QxHTlp8b83 P5CqwJ/xea+wvc0l5eqZy/I6ks0PKoNaz4NWJDoNdvIZt3oRsGGmA5S8dhAu9UqHi4/1 7+4g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=4RTEZoh+ipgHyHjTBLEr3UaX8+luHESouiyLTTzvpm4=; b=TuOrfL9KHoIeWxxS9LVq0K6nkGNlvgcUYG2eQVrskeeHR9786I9IBRGbzPT9F9IMze x08ReGmwz0vvYYl0U1/dvyBq/vJoih/rqURc01/LF5Jq7lsjOE+2glXGhfQvTSafNAB0 WEh/23mcWGA6T/KoX6sbDvdbb9KE76VCWPuc23MmljgHjGyNNYmlLf7em/EjJU+yvY0q irfky5+70C5OZKdbOfRNcMeYtObJAvKioCzVd5qSKtjW9YwGy8nm/mjcdfOGD0otM+gd OKJyo2B0zsxFlJ35NJLJpnA7KzxQTf1jFnC8tW2f+j/irUZ7rCrnY8WR0PgxVEpEpyPT MuxQ== X-Gm-Message-State: AFeK/H0m+k4yH/AMmlXgivMHwRNJUezIF1C7i23cyXU7I2XN4Qi3BEnwNpI3QkYZen4JhDj6A+4zQFE2Rkg6mg== X-Received: by 10.28.98.2 with SMTP id w2mr3683184wmb.66.1489247144548; Sat, 11 Mar 2017 07:45:44 -0800 (PST) MIME-Version: 1.0 Received: by 10.28.141.80 with HTTP; Sat, 11 Mar 2017 07:45:24 -0800 (PST) In-Reply-To: References: From: Kai Zhang Date: Sat, 11 Mar 2017 23:45:24 +0800 Message-ID: To: "Wiles, Keith" Cc: "users@dpdk.org" Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Issue with more Cores assigned: Cannot mmap device resource file X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 11 Mar 2017 15:45:45 -0000 Hi Keith, Thank you for your reply. I have tested my program on two machines A) 1 x Intel E5-2650 v4, 12 cores [UMA] B) 2 x Intel E5-2640 v4, 10 cores [NUMA] I am very sure that the primary process uses different cores with the secondary process. The strange thing is that my program works correctly on machine *B*. But on machine *A*, the above issue happens with more than 4 cores assigned to the secondary process. I have tried to assign cores 1-5 to the secondary process and also tried other core assignment policies, but the error still happens rte_eal_init() with more than 4 cores. Regards, Kai On Sat, Mar 11, 2017 at 10:52 PM, Wiles, Keith wrote: > > > On Mar 10, 2017, at 9:35 PM, Kai Zhang wrote: > > > > Hi, there > > > > I am using DPDK-16.11 on XL710 40GbE NIC. OS: CentOS 7.3.1611 with Linux > > kernel version 3.8.0-30. > > > > I have a master process and a secondary process. When I run the secondary > > process with less than or equal to 4 cores, it works correctly. Such as: > > sudo ./program -l 4,5,6,7 -n 4 --proc-type=secondary > > sudo ./program -c 0x0f -n 4 --proc-type=secondary > > > > However, there will be error in the rte_eal_init if I assign more than 4 > > cores. > > sudo ./program -l 0,1,2,3,4 -n 4 --proc-type=secondary > > sudo ./program -c 0x1f -n 4 --proc-type=secondary > > > > EAL: Cannot mmap device resource file > > /sys/bus/pci/devices/0000:02:00.0/resource0 to address: 0x7fff65bfc000 > > EAL: Error - exiting with code: 1 > > Cause: Requested device 0000:02:00.0 cannot be used > > I assume you have at least 8 cores. Have you tried -l 1-5 on the secondary > process. > > You did not show the primary process command line, but the if you use 1-5 > then you can only give primary process -l 6-7 or two cores. It is always a > reasonable thing is to leave core zero for linux to use. > > Also it could be you ran out of memory or hugepages you allocated to the > system. > > > > > Anyone knows why this happens? > > > > Thanks a lot, > > Kai Zhang > > Regards, > Keith > >