From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-vs1-f53.google.com (mail-vs1-f53.google.com [209.85.217.53]) by dpdk.org (Postfix) with ESMTP id 151691B1DD for ; Wed, 30 Jan 2019 07:32:05 +0100 (CET) Received: by mail-vs1-f53.google.com with SMTP id y27so13626134vsi.1 for ; Tue, 29 Jan 2019 22:32:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=imvisiontech-com.20150623.gappssmtp.com; s=20150623; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=zfL6/wPXbwUyI6JDZHbhS6Ipwhv7lhgCseuQdWi9O1E=; b=F2fJNUXKto89ZnkIldjki+NTL/tFkT/U52bLfqlNCUHeTi6tpMgxtFYEiscxttzPKY N2U2w+Gv9hQYqPt2nS/LN3EsJMO1jvOMDKBlelyNq6MFU6CmZ3x/S6Vx1a2QeXAL7sb/ xBlgrpnm8acor4i7Ic+kwdQ1NlTQFje6XbqUuIBLROKZWlop5I+tPP43ijex8vMAVT1x RuIN02ph+gMrG4jhqJIGKtVSmO+oTzDiNNNZmIWl+sF8RBTUZiedCu1AvgBbHEr2PucN qcPGVg1mE8JcMzfNvQKIAonL8JH3eWfe4s3lpCJXhGnyIM7cTbxC7aPEC+fv3Fx0D3Z5 QHDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=zfL6/wPXbwUyI6JDZHbhS6Ipwhv7lhgCseuQdWi9O1E=; b=PELwDKv6yoCM7e0Ji/WjDAbKwyuuW2DYULNbKSKWLfOIbi4HUy8v20kJVcWp6Ud+/z 9ojgWAu+S3z1mbLj0S8ovNPRO2m+S7usMoptVA887i4IJmTw7LF8sPBJnraKuuE5RPXF VOl8Iey8oqGtI2ymCl8sMblq8qECb+ne4PeaBpL8xbG7v5GIYCK+cjUVBMYPalgD6Bjx VpjnJANNoScEBxj+lTRlfV9j+hWP0SqN9si9xEDt+n1Y2+Zbtg9T9RCFZnum9jc7LsNu yvp1uWBlz0j0eqh/N7BQNggMTMDoxax8YIpO5yjfBltcz2hr3bN0ui+cwPnX4T0054Dl Ph8A== X-Gm-Message-State: AJcUukegYM/u9JeGY595ZWK+z7nPEA1LFtUUiEQ9byFMWKWdBSirAR5d i6yFFXBdjN/QEdB8Qy3QPwmojDgWqXMA4qjulsOeRw== X-Google-Smtp-Source: ALg8bN5o33ey88ciDX48lXBcI4rGM1nos/nyqWEYFQgRW3+YfZW3Kjm2A8pLJlO8Hqnaxw9IyNQp8hf8pxgY7/i9SIM= X-Received: by 2002:a67:1cc5:: with SMTP id c188mr12570220vsc.195.1548829925300; Tue, 29 Jan 2019 22:32:05 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Shirley Avishour Date: Wed, 30 Jan 2019 08:31:54 +0200 Message-ID: To: Rami Rosen Cc: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] running dpdk application on the same machine with other none dpdk application X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 30 Jan 2019 06:32:06 -0000 Hi Rami, In order to isolate the required core we add isolcpus to the grub: GRUB_CMDLINE_LINUX_DEFAULT="default_hugepagesz=2M hugepagesz=1G hugepages=8 isolcpus=1-5" To disable hyperthreading for these cores we add command to the rcl.local: (which in fact disables the peer logical core) echo 0 > /sys/devices/system/cpu/cpu23/online echo 0 > /sys/devices/system/cpu/cpu24/online echo 0 > /sys/devices/system/cpu/cpu25/online echo 0 > /sys/devices/system/cpu/cpu26/online echo 0 > /sys/devices/system/cpu/cpu27/online our dpdk application runs on cores 1-5: --lcores='(0,4-6)@5,1@1,2@2,3@3,7@4' But cpu isolation does not prevent from kernel processes/threads from running on isolated cpus. Running java based applications on the same server with a dpdk based application has an impact on the dpdk performance. Probably since the JVM generates kernel based processes. It can be either GC (garbage collection) or other operations. We are looking for a way to prevent these kernel threads from using the isolated cores. Thanks, Shirley. On Wed, Jan 30, 2019 at 8:09 AM Rami Rosen wrote: > Hi, Shirley > > >In order to do that we isolated the dpdk application cores and disabled > hyperthreading for those cores. > >we are using 5 cores for the dpdk application (which is in fact 10 since > hyperthreading is disabled). > > Short clarification question: did you do it with EAL paramater ? > > Was it with > -l CORELIST / --lcores COREMAP EAL parameter ? > > Did you try also the isolcpus Linux kernel parameter in order to isolate > cores from the general Linux scheduler? > > Regards, > Rami Rosen > > > On Tue, Jan 29, 2019 at 6:32 PM Shirley Avishour > wrote: > >> Hi, >> We are trying to run a dpdk based application one the same machine with >> other java based applications. >> In order to do that we isolated the dpdk application cores and disabled >> hyperthreading for those cores. >> But sporadically we encounter misses over the interface. >> We are running on a single socket cpu with 44 hyperthreaded cores. >> we are using 5 cores for the dpdk application (which is in fact 10 since >> hyperthreading is disabled). >> My guess is that probably GC (garbage collection) running from the kernel >> and perhaps over the isolated threads causing the misses. >> Is there a way to solve this issue? Is there a way to isolate cores for >> kernel processes/threads? >> Thanks in advance, >> Shirley. >> > > > -- > regards, > Rami Rosen >