From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from APC01-HK2-obe.outbound.protection.outlook.com (mail-hk2apc01on0103.outbound.protection.outlook.com [104.47.124.103]) by dpdk.org (Postfix) with ESMTP id 585845A3E for ; Mon, 17 Apr 2017 15:17:22 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=artesyn.onmicrosoft.com; s=selector1-artesyn-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=C4mxXNoCi8dvRZV64WiOc+0wgT3UeWqJkHV4fIwqyG4=; b=RQ7leHeocoJ2urKWValIMn4jXPXKQqQAx3yDuzb9aJS4lpRkbg2wSf3s/i1Po6Tt20eA4NxArFjRkbDZmCdfFPLhpus3tozBdZquQzabx36MJv/tDjfBV5m9MI72fddSpdErv3TEt+dMJaJm9e73xdgxkSTiFO40Xzkvo4KWnZA= Received: from HK2PR01MB1297.apcprd01.prod.exchangelabs.com (10.167.66.139) by HK2PR01MB1298.apcprd01.prod.exchangelabs.com (10.167.66.140) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1034.10; Mon, 17 Apr 2017 13:17:18 +0000 Received: from HK2PR01MB1297.apcprd01.prod.exchangelabs.com ([10.167.66.139]) by HK2PR01MB1297.apcprd01.prod.exchangelabs.com ([10.167.66.139]) with mapi id 15.01.1034.013; Mon, 17 Apr 2017 13:17:18 +0000 From: "Sawant, Sunil (Artesyn)" To: "users@dpdk.org" Thread-Topic: KNI optimization techniques Thread-Index: AdK3fO9KrNDkaJcNRwe9HG0CuLvXGg== Date: Mon, 17 Apr 2017 13:17:17 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=Artesyn.com; x-originating-ip: [61.14.178.149] x-microsoft-exchange-diagnostics: 1; HK2PR01MB1298; 7:30eRSwT7bIjWBXoaTePJgTNqZlolLR5dz4bS+h4/GpI0hkUQhW947Rc5ruE+TvUIByGfYRfDWDerUcSSFsbIdrihtVlXVmXd0dpT2YmMnz7xUiu+d4qJ2e9o1yjnsWLMG7J9aN11IXA1jwz8ChyI1H2es8l2+PRidxqSTxY0qkHlAbKrhOBFKJKOI+w/eVtBw2dcNZcr9XdG1PPIIlT76L6eeqe/8hfQLL0x7Blt/hEpne0FhXSESKXg51Ae4ThxFmzjavfnROsbBWgflFwuroGe6T+VJJaZG6jhtP37l0YTBGcUXIb95LmnFU5GfuHZ0FKdPYhGubibKdpMU5UIVQ== x-ms-office365-filtering-correlation-id: c9fcbb6f-314f-4ab4-675b-08d48594129e x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(2017030254075)(48565401081)(201703131423075)(201703031133081)(201702281549075); SRVR:HK2PR01MB1298; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(158342451672863)(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(8121501046)(5005006)(10201501046)(93006095)(93001095)(3002001)(6055026)(6041248)(20161123560025)(201703131423075)(201702281528075)(201703061421075)(20161123562025)(20161123564025)(20161123555025)(6072148); SRVR:HK2PR01MB1298; BCL:0; PCL:0; RULEID:; SRVR:HK2PR01MB1298; x-forefront-prvs: 02801ACE41 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(39450400003)(39860400002)(39850400002)(39400400002)(39840400002)(39410400002)(189998001)(5630700001)(19609705001)(7906003)(54356999)(7116003)(25786009)(5660300001)(3280700002)(97736004)(18717965001)(74316002)(50986999)(7736002)(966004)(66066001)(53376002)(2906002)(790700001)(81166006)(122556002)(5640700003)(606005)(8676002)(9326002)(1730700003)(3846002)(8936002)(6506006)(110136004)(102836003)(6436002)(6116002)(38730400002)(3480700004)(7696004)(55016002)(6916009)(3660700001)(2900100001)(77096006)(99286003)(86362001)(6306002)(236005)(33656002)(54896002)(2501003)(53936002)(9686003)(2351001); DIR:OUT; SFP:1102; SCL:1; SRVR:HK2PR01MB1298; H:HK2PR01MB1297.apcprd01.prod.exchangelabs.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: artesyn.com X-MS-Exchange-CrossTenant-originalarrivaltime: 17 Apr 2017 13:17:17.8701 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 8050a2ab-3c11-48a1-9e5d-34f1dbd1f144 X-MS-Exchange-Transport-CrossTenantHeadersStamped: HK2PR01MB1298 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] KNI optimization techniques X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 17 Apr 2017 13:17:23 -0000 Hi, Requirement - Looking for KNI optimization techniques to speed-up packet tr= ansfer from DPDK Port to it corresponding Ethernet interface ( further to D= HCP server on Host machine). Case - DSPs, while booting, try to fetch the boot image on the Host machine= . They use TFTP protocol to boot. Now, DSPs fail to boot as the DHCP DISCOV= ER packets sent by DSPs are delayed over KNI. From the time, the DISCOVER i= s generated to the time the host sends DHCP OFFERs to the DSPs, a huge time= delay is observed (~ 4s). The boot process works fine without DPDK. Environment - DPDK 2.1.0 on RHEL 6.4, 64 bit, 8 cores. Other details - MemTotal: 32961560 kB MemFree: 23676720 kB isolcpus=3D3,5,7 default_hugepagesz=3D1G hugepagesz=3D1G hugepages=3D8 Optimizations done - * Increased Hugepage size * Isolated CPU cores * Tweaked BIOS parameters - http://dpdk.org/doc/guides-16.04/linux_g= sg/nic_perf_intel_platform.html * Having multiple kthread for each port * Making KNI threads RT and having highest priority The delay is persistent even after all the above optimizations are done. Co= uld anyone please suggest more/better optimizations ? Is there any way wher= e KNI just transmits the packets the moment it receives (without buffering = ) ? Thanks, Sunil D. Sawant