From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id EDC8510D2C for ; Thu, 22 Dec 2016 12:36:37 +0100 (CET) Received: from orsmga005.jf.intel.com ([10.7.209.41]) by fmsmga105.fm.intel.com with ESMTP; 22 Dec 2016 03:36:37 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.33,388,1477983600"; d="scan'208";a="45400758" Received: from silpixa00397515.ir.intel.com (HELO silpixa00397515.ger.corp.intel.com) ([10.237.223.14]) by orsmga005.jf.intel.com with ESMTP; 22 Dec 2016 03:36:36 -0800 From: David Hunt To: dev@dpdk.org Cc: bruce.richardson@intel.com Date: Thu, 22 Dec 2016 04:37:03 +0000 Message-Id: <1482381428-148094-1-git-send-email-david.hunt@intel.com> X-Mailer: git-send-email 2.7.4 In-Reply-To: <1480567821-70846-2-git-send-email-david.hunt@intel.com> References: <1480567821-70846-2-git-send-email-david.hunt@intel.com> Subject: [dpdk-dev] [PATCH v2 0/5] distributor library performance enhancements X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Dec 2016 11:36:38 -0000 This patch aims to improve the throughput of the distributor library. It adds a series of API calls similar to the original API, but with "_burst" in the function names. Usage is similar (but not identical), in that there are now bursts of mbufs sent to each worker at a time instead of a single mbuf pointer. See the header file rte_distributor_burst.h for more details on API usage. It uses a similar handshake mechanism to the previous version of the library, in that bits are used to indicate when packets are ready to be sent to a worker and ready to be returned from a worker. One main difference is that instead of sending one packet in a cache line, it makes use of the 7 free spaces in the same cache line in order to send up to 8 packets at a time to/from a worker. The flow matching algorithm has had significant re-work, and now keeps an array of inflight flows and an array of backlog flows, and matches incoming flows to the inflight/backlog flows of all workers so that flow pinning to workers can be maintained. The Flow Match algorithm has both scalar and a vector versions, and a function pointer is used to select the post appropriate function at run time, depending on the presence of the SSE2 cpu flag. On non-x86 platforms, the the scalar match function is selected, which should still gives a good boost in performance over the non-burst API. v2 changes: * Created a common distributor_priv.h header file with common definitions and structures. * Added a scalar version so it can be built and used on machines without sse2 instruction set * Added unit autotests * Added perf autotest * Added doc updates Notes: Apps using the birst API must now work in bursts, as up to 8 are given to a worker at a time For performance in matching, Flow ID's are 15-bits (non-zero) Original API (and code) is kept for backward compatibility Performance Gains 2.2GHz Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz 2 x XL710 40GbE NICS to 2 x 40Gbps traffic generator channels 64b packets separate cores for rx, tx, distributor 1 worker - 4.8x 4 workers - 2.9x 8 workers - 1.8x 12 workers - 2.1x 16 workers - 1.8x [PATCH v2 1/5] lib: distributor performance enhancements [PATCH v2 2/5] test: unit tests for new distributor burst api [PATCH v2 3/5] test: add distributor_perf autotest [PATCH v2 4/5] example: distributor app showing burst api [PATCH v2 5/5] doc: distributor library changes for new burst api