From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ua1-f44.google.com (mail-ua1-f44.google.com [209.85.222.44]) by dpdk.org (Postfix) with ESMTP id BB24B1B1F4 for ; Wed, 30 Jan 2019 08:47:16 +0100 (CET) Received: by mail-ua1-f44.google.com with SMTP id n7so7759836uao.7 for ; Tue, 29 Jan 2019 23:47:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=imvisiontech-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=+1dtTpOOcgT/hKe4ipMUgHGIAXxQ0xvc5fpjtXzzOE0=; b=ANwtSGFssTv+PpLWMgvnTNOxazOBOGlwPZ3N2S/cVjs0tmRQxyyIJj2PWOJy/wi3+4 oZ/6GfhUSl1xmGPjsqEFIiAZz/rd/0phA4ySETPSDFQoB8pdBnWPE1vzBlHimMjdJx7l ctcdcrBagp/BpDxVC+y2rONIgm+ptkjp8aXRJdvGTqTLofMEyiBcO9yxI1xgaGS3DOcF Mc+jRFBh/CKbU2CyI+l37ju9OD2CuUtJRShOzAfje+tQlagaaN3UUTTaxAp5HpUa73il GujuFLyaFRnRS8VOxF3nm9bQdnm/5blPeSkOqcsZ37laOXWQ2SChNoHAL1ycErMTskg/ hV/Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=+1dtTpOOcgT/hKe4ipMUgHGIAXxQ0xvc5fpjtXzzOE0=; b=CTKGqYs7EkjDG/pv2nxoNcShb84vRnp8LLMIC9hsxBa4aXuMPeanTFNhL41g4Jy//j xVvz4wpQcY/9KM4Un7kLcpuhrnzhOx9+YMi2Iq7rmgkC9pXwccc4nT68E5F8guYPItoo Up76/7za49vwq+UpOwSfxLvDnF3whz/vrJNcVkbsjvTHCUIZ8KoceBixwltm/cTUyUed wJFMiAH0+Rh8olTKtxamAsY8EO7ZVembeIeFvtoorIrf5bTtpobavJRrjoDK4cJQG6QG TIQm71uPNuUqM7EnyEsNIeOmC78FsLppo8Jea8LgB7w3wZmhu13tp+2QJWjMJpCSd25s 3EYQ== X-Gm-Message-State: AJcUuke9y7V++0dDDbK9H4hxduEX/j7C6a+7nqLVH6Q6g7/0/vCd3qTr DPu7/RzsKk1RVHYDRD+f4fT5aGus2F7AAxZcQbZ5zA== X-Google-Smtp-Source: ALg8bN6mWEiZah/MJTl+S53Sxhqb7zik5+dqTGbgsGnf//TjvoeaTw9asCbtmb5D3AzyBp0mPVtT8pmY8CA11+/0dj8= X-Received: by 2002:ab0:5a31:: with SMTP id l46mr11602582uad.92.1548834436008; Tue, 29 Jan 2019 23:47:16 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Shirley Avishour Date: Wed, 30 Jan 2019 09:47:04 +0200 Message-ID: To: Rami Rosen Cc: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] running dpdk application on the same machine with other none dpdk application X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jan 2019 07:47:17 -0000 Hi Rami, Thanks for the quick reply. So in fact there is no way to tell the kernel not to run kernel threads on specific cpus? Even not by compiling the kernel with specific flags? Do you know if the PF_NO_SETAFFINITY flag can help in any way? Thanks, Shirley. On Wed, Jan 30, 2019 at 9:26 AM Rami Rosen wrote: > Hi Shirley, > > I think you are right, isolcpus is for userspace threads. > ... > "Use the isolcpus parameter on the kernel command line to isolate certain > cores from user-space tasks." > ... > See: > > https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/performance_tuning_guide/sect-red_hat_enterprise_linux-performance_tuning_guide-cpu-configuration_suggestions > So if there is no way to configure JVM to use specified kernel cores (and > I am afraid there is no such way), > I am not sure how this can be solved. > > Regards, > Rami Rosen > > > On Wed, Jan 30, 2019 at 9:05 AM Shirley Avishour > wrote: > >> Hi Rami, >> >> This is the printout for cat /proc/cmdline >> BOOT_IMAGE=/boot/vmlinuz-4.15.0-43-generic >> root=UUID=6f1a210b-a30f-456d-bf16-bbb210da5666 ro default_hugepagesz=2M >> hugepagesz=2M hugepages=4096 isolcpus=1-5 nohz_full=1-5 rcu_nocbs=1-5 >> >> The requires cpus are in fact isolated but jvm generate some kernel >> threads as well and I'm afraid that these kernel space threads eventually >> use all cores. isolcpus is not applies on kernel space threads. >> >> Shirley. >> >> >> >> On Wed, Jan 30, 2019 at 8:57 AM Rami Rosen wrote: >> >>> Hi Shirley, >>> >Running java based applications on the same server with a dpdk based >>> application has an impact on the dpdk performance. >>> Probably since the JVM generates kernel based processes. I >>> >>> This is true, but as far as I know, using isolcpus should prevent these >>> processes to run on the isolated cores. >>> >>> Just to be on the safe side: did you make sure with cat /proc/cmdline on >>> the kernel you are actually running indeed >>> has the "isolcpus=1-5" you added in grub ? sometimes, especially in >>> multi OS hosts, adding entries in /etc/default/grub and running grub2-mkconfig >>> is not enough, if you boot from a different partition. >>> >>> Regards, >>> Rami Rosen >>> >>> >>> > > -- > regards, > Rami Rosen >