From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 57B55A00E6 for ; Thu, 21 Mar 2019 15:45:06 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 9D2BF1B501; Thu, 21 Mar 2019 15:45:05 +0100 (CET) Received: from mail-io1-f54.google.com (mail-io1-f54.google.com [209.85.166.54]) by dpdk.org (Postfix) with ESMTP id 00F8C1B4F9 for ; Thu, 21 Mar 2019 15:45:03 +0100 (CET) Received: by mail-io1-f54.google.com with SMTP id v10so5407321iom.8 for ; Thu, 21 Mar 2019 07:45:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=flowmon.com; s=google; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=0Ceff6HUgF/wN3T7v9QgJpVsmgyQEcsExzXy/c/k/VI=; b=P/ULMrIngx7nj/NnBT5itSadM2JjA4D564a1qiDJd+CZjBNexvD/uALnyuIAF8NS46 kkhGZo9+cqWMNRSBIlC/IjGdEgOSviKrTWNuhw8svOKufjEPpCxpGgAUkcrmJTjIu4VB IdMjlEqust63cvi7awQ04c5uw69MY3PjY6HRY+H8UQ3OkP58Z/TIhbIFqKPlIT/gK9ih c+2yBvIuSfcqmKm1H2Nd14zGQXJr2MblrnI/BF1UBYWzXKv+Ys7/YzpQsRTmsBrPUTcs ZYepDBU0AplYuEdo6dp8i14Yak87QEyKJy/ZDY3IKaG2OCh0S0UC99MoXqnwgV0OOFn4 V6Dg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=0Ceff6HUgF/wN3T7v9QgJpVsmgyQEcsExzXy/c/k/VI=; b=i5djlAVWJNN3ib0+cdCNyUzjtchmvdj7Oe6JHzYDKuHzlkq0t94XCb3vWUm7URfXVJ huMZKa1q/YcFAFjOb1k1ML5CjF5BsN4dmP1VtgHmy26UMWGgl7zgYbUPmXfPeRfjdsxK p26JBewbUk01N1YWEg9XU95HsCBYrSXb0dkfVDZRuBizV3G9ZLRMA2vMVD6QBPpt4y/Q ZwcRYCpiGKHpz5tiJTXUitk4sW43UmBxdJ84IiEzM2Ly+UwV3SLTT0cB1r3ukj8UTtFt 34RTe0VZiyjWoiPLbYS0FK7r1W25EYcqNLwjUQhkuVvfYCXd+sBRmB4jWopx9j86QMdU xr1Q== X-Gm-Message-State: APjAAAXF4Hkg/wDZRNvZHlIwq/7Im2y6G5BKvYcOnG8+OevbgXIYJ8Sy kM0m9UD8m/YQRjJ7CWg5wwumRFElWLAVV+0R1Eiphw== X-Google-Smtp-Source: APXvYqz1rSm/n4098qBMG+l8VZboGs+Tx4M62mM8Uh5qtFCWPZdjw38ZHsbR28LF6rBkDBsmixwCfRSmBuAQhHMZeZo= X-Received: by 2002:a5e:930d:: with SMTP id k13mr2833693iom.230.1553179503425; Thu, 21 Mar 2019 07:45:03 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: =?UTF-8?B?VG9tw6HFoSBKw6Fuc2vDvQ==?= Date: Thu, 21 Mar 2019 15:44:52 +0100 Message-ID: To: Paul T Cc: "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] X710 DA2 (2x10G) performance 64B packet X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Thanks Paul for another suggestion. This is my boot setup now: default_hugepagesz=3D1G hugepagesz=3D1G isolcpus=3D1-4 nohz_full=3D1-4 rcu_= nocbs=3D1-4 and I am using 16x 1GB hugepages on the NUMA node. But so far no improvement. Tomas On Thu, Mar 21, 2019 at 3:31 PM Paul T wrote: > 1GB huge page chunks instead of 2MB would also be worth a try > > ------------------------------ > *From:* Tom=C3=A1=C5=A1 J=C3=A1nsk=C3=BD > *Sent:* 21 March 2019 14:00 > *To:* Paul T > *Cc:* users@dpdk.org > *Subject:* Re: [dpdk-users] X710 DA2 (2x10G) performance 64B packet > > Hi Paul, > > thank you for your suggestion. > I tried isolating the cores; however, the improvement was negligible. > > Tomas > > On Thu, Mar 21, 2019 at 12:50 PM Paul T wrote: > > Hi Tomas, > > I would isolate the CPUs in which the dpdk threads are running from the > linux schedular. The low packet drop at 64B makes me thing its context > switching happen on the core because of the linux scheduler. > > Use the following command in the linux command line params in your grub > config: > isolcpus=3Dcpus to isolate, e.g. 1,3,4 or 1-4 > > Regards > > Paul > > Message: 3 > Date: Thu, 21 Mar 2019 10:53:34 +0100 > From: Tom?? J?nsk? > To: users@dpdk.org > Subject: [dpdk-users] X710 DA2 (2x10G) performance 64B packets > Message-ID: > 9CLMQrSQ@mail.gmail.com> > Content-Type: text/plain; charset=3D"UTF-8" > > Hello DPDK users, > > I am having an issue concerning the performance of X710 DA2 (2x10G) NIC > when using testpmd (and also l2fwd) application on both ports. > > HW and SW parameters: > CPUs: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz x16 > Disabled hyperthreading. > All used lcores and ports are on the same NUMA node (0). > Hugepages: 1024x 2MB on the NUMA node 0. > RAM: 64 GB > > DPDK version: 18.05.1 > Modue: IGB UIO > GCC version: 4.8.5 > > When using testpmd application only on one port: > ./testpmd -b 0000:04:00.0 -n 4 --lcore=3D0@0,2@2 -- --socket-num=3D0 > --nb-cores=3D1 --nb-ports=3D1 --numa --forward-mode=3Drxonly > > 14.63 Mpps (64B packet length) - 0.01% packets dropped > > When using testmpd on both ports: > ./testpmd -n 4 --lcore=3D0@0,2@2,4@4 -- --socket-num=3D0 --nb-cores=3D2 > --nb-ports=3D2 --numa --forward-mode=3Drxonly > > 28.08 Mpps (64B packet length) - 3.47% packets dropped > > Does anybody have an explanation why am I experiencing this performance > drop? > Any suggestion would be much appreciated. > > Thank you > Tomas > >