From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 138E1A00E6 for ; Thu, 21 Mar 2019 15:31:19 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 229FE1B516; Thu, 21 Mar 2019 15:31:18 +0100 (CET) Received: from EUR03-AM5-obe.outbound.protection.outlook.com (mail-oln040092070037.outbound.protection.outlook.com [40.92.70.37]) by dpdk.org (Postfix) with ESMTP id 1F4CC1B4EB for ; Thu, 21 Mar 2019 15:31:17 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=outlook.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=kyHdOuPUMbx6ShWLFtNYhvTPwRjr8vC4YG9EWrK553c=; b=U038mAVJtdaU5I2dgcRS6Dt6KMpsbi+R+D9i94Ri3kULZd1XUEujIK+lHx03Kb/ORuSzaN3PVozUWsMdwgRp1Ov7rqEx5JpgrOuuuV7tjbtHocxS6iCLExWOyznhHyok4cduZQs/QDcDnh89vBym8j0txYyZ6LPjDMBzAkd4REW44chiGU04RzXNkwc41ewauhkidRVSl297fc8DeaoZYAqzjQLKW5T7UIswkXvurkc75NxbN+exWzsMBonQqa9btlZNuvMSgB7RFfov8cDz3+GQ0Hn087rbEH1w+MeW1PrROxu0J2VVM/bkE8sgrd5mU+j+ZenMe7g18HCcJGzjyw== Received: from VE1EUR03FT028.eop-EUR03.prod.protection.outlook.com (10.152.18.58) by VE1EUR03HT064.eop-EUR03.prod.protection.outlook.com (10.152.19.118) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1730.9; Thu, 21 Mar 2019 14:31:16 +0000 Received: from DB7PR06MB4827.eurprd06.prod.outlook.com (10.152.18.55) by VE1EUR03FT028.mail.protection.outlook.com (10.152.18.88) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.1730.9 via Frontend Transport; Thu, 21 Mar 2019 14:31:16 +0000 Received: from DB7PR06MB4827.eurprd06.prod.outlook.com ([fe80::2880:3922:8b80:c7a9]) by DB7PR06MB4827.eurprd06.prod.outlook.com ([fe80::2880:3922:8b80:c7a9%3]) with mapi id 15.20.1730.013; Thu, 21 Mar 2019 14:31:16 +0000 From: Paul T To: =?Windows-1252?B?VG9t4ZogSuFuc2v9?= CC: "users@dpdk.org" Thread-Topic: [dpdk-users] X710 DA2 (2x10G) performance 64B packet Thread-Index: AQHU39vLqflED5egHECF4rNso/elc6YWHUuAgAAIY5k= Date: Thu, 21 Mar 2019 14:31:16 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-GB X-MS-Has-Attach: X-MS-TNEF-Correlator: x-incomingtopheadermarker: OriginalChecksum:F02D371A81058010DFBDBDD94ADBD519CC59E7F8F44603E5787BCB4C62EE3B17; UpperCasedChecksum:13B58695A4328CFBAD6E8D5C07FA7247163C250F84D383BB78A67E288EEDF0A9; SizeAsReceived:6990; Count:45 x-ms-exchange-messagesentrepresentingtype: 1 x-tmn: [3oDqbKqudnkDfxuRQgNd99ylMsxIe/do] x-ms-publictraffictype: Email x-incomingheadercount: 45 x-eopattributedmessage: 0 x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(20181119110)(201702061078)(5061506573)(5061507331)(1603103135)(2017031320274)(2017031323274)(2017031324274)(2017031322404)(1601125500)(1603101475)(1701031045); SRVR:VE1EUR03HT064; x-ms-traffictypediagnostic: VE1EUR03HT064: x-microsoft-antispam-message-info: 9AvhQesRed6bJqNEhhw0H7tYcXeXzQU8rwwEbBMrR6OE/K892BTVNrzyi2rW2vlQ MIME-Version: 1.0 X-OriginatorOrg: outlook.com X-MS-Exchange-CrossTenant-RMS-PersistedConsumerOrg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-Network-Message-Id: 71cde0d2-1f67-4e27-0026-08d6ae09e06e X-MS-Exchange-CrossTenant-rms-persistedconsumerorg: 00000000-0000-0000-0000-000000000000 X-MS-Exchange-CrossTenant-originalarrivaltime: 21 Mar 2019 14:31:16.1887 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Internet X-MS-Exchange-CrossTenant-id: 84df9e7f-e9f6-40af-b435-aaaaaaaaaaaa X-MS-Exchange-Transport-CrossTenantHeadersStamped: VE1EUR03HT064 Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] X710 DA2 (2x10G) performance 64B packet X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" 1GB huge page chunks instead of 2MB would also be worth a try ________________________________ From: Tom=E1=9A J=E1nsk=FD Sent: 21 March 2019 14:00 To: Paul T Cc: users@dpdk.org Subject: Re: [dpdk-users] X710 DA2 (2x10G) performance 64B packet Hi Paul, thank you for your suggestion. I tried isolating the cores; however, the improvement was negligible. Tomas On Thu, Mar 21, 2019 at 12:50 PM Paul T > wrote: Hi Tomas, I would isolate the CPUs in which the dpdk threads are running from the lin= ux schedular. The low packet drop at 64B makes me thing its context switch= ing happen on the core because of the linux scheduler. Use the following command in the linux command line params in your grub con= fig: isolcpus=3Dcpus to isolate, e.g. 1,3,4 or 1-4 Regards Paul Message: 3 Date: Thu, 21 Mar 2019 10:53:34 +0100 From: Tom?? J?nsk? > To: users@dpdk.org Subject: [dpdk-users] X710 DA2 (2x10G) performance 64B packets Message-ID: > Content-Type: text/plain; charset=3D"UTF-8" Hello DPDK users, I am having an issue concerning the performance of X710 DA2 (2x10G) NIC when using testpmd (and also l2fwd) application on both ports. HW and SW parameters: CPUs: Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz x16 Disabled hyperthreading. All used lcores and ports are on the same NUMA node (0). Hugepages: 1024x 2MB on the NUMA node 0. RAM: 64 GB DPDK version: 18.05.1 Modue: IGB UIO GCC version: 4.8.5 When using testpmd application only on one port: ./testpmd -b 0000:04:00.0 -n 4 --lcore=3D0@0,2@2 -- --socket-num=3D0 --nb-cores=3D1 --nb-ports=3D1 --numa --forward-mode=3Drxonly 14.63 Mpps (64B packet length) - 0.01% packets dropped When using testmpd on both ports: ./testpmd -n 4 --lcore=3D0@0,2@2,4@4 -- --socket-num=3D0 --nb-cores=3D2 --nb-ports=3D2 --numa --forward-mode=3Drxonly 28.08 Mpps (64B packet length) - 3.47% packets dropped Does anybody have an explanation why am I experiencing this performance drop? Any suggestion would be much appreciated. Thank you Tomas