From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id D3D2CA0548; Thu, 8 Sep 2022 04:10:18 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 7296E4021F; Thu, 8 Sep 2022 04:10:18 +0200 (CEST) Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by mails.dpdk.org (Postfix) with ESMTP id 8D344400D6 for ; Thu, 8 Sep 2022 04:10:17 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1662603017; x=1694139017; h=from:to:cc:subject:date:message-id:mime-version: content-transfer-encoding; bh=hN9SYMwFDyzjiycbJ3uCiAFbuoZV87FxPGNmPV92nXQ=; b=FeVBfpWenpynx9UV+D6W5KZOhtNAmXtQwoRh5CYrLYMmQJQEnZbRLFxp tvkjBMCj3P+nl5D/Q6Fq7lmzmprj2ogxisz0g/x6bjWYlzzN3au4SB2Cd TNMUA6Ad30SAjVZmt91mceTZEke63cJz1w3bpe1hU11aObUapOksUgcBJ d8VmLDaDNkvUobmFwgu8E8JOnh6stg1q783cosxrTfLrt28SfTC2uCl9f s0axizK4b+CaQ5cMm7bhCB6CKOB44A7JkH/FLEzA0kZARUevpdgVre9tV qvhiGx6rDYkWfQzXKvkY6ICksDi42KbsuMn15vdidWRDVjwjSqEJMob51 w==; X-IronPort-AV: E=McAfee;i="6500,9779,10463"; a="383336872" X-IronPort-AV: E=Sophos;i="5.93,298,1654585200"; d="scan'208";a="383336872" Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 07 Sep 2022 19:10:16 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.93,298,1654585200"; d="scan'208";a="565755808" Received: from dpdk-zhirun-lmm.sh.intel.com ([10.67.118.241]) by orsmga003.jf.intel.com with ESMTP; 07 Sep 2022 19:10:14 -0700 From: Zhirun Yan To: dev@dpdk.org, jerinj@marvell.com, kirankumark@marvell.com Cc: cunming.liang@intel.com, haiyue.wang@intel.com, Zhirun Yan Subject: [RFC, v1 0/6] graph enhancement for multi-core dispatch Date: Thu, 8 Sep 2022 10:09:53 +0800 Message-Id: <20220908020959.1675953-1-zhirun.yan@intel.com> X-Mailer: git-send-email 2.25.1 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Currently, the rte_graph_walk() and rte_node_enqueue* fast path API functions in graph lib implementation are designed to work on single-core. This solution(RFC) proposes usage of cross-core dispatching mechanism to enhance the graph scaling strategy. We introduce Scheduler Workqueue then we could directly dispatch streams to another worker core which is affinity with a specific node. This RFC： 1. Introduce core affinity API and graph clone API. 2. Introduce key functions to enqueue/dequeue for dispatching streams. 3. Enhance rte_graph_walk by cross-core dispatch. 4. Add l2fwd-graph example and stats for cross-core dispatching. With this patch set, it could easily plan and orchestrate stream on multi-core systems. Future work: 1. Support to affinity lcore set for one node. 2. Use l3fwd-graph instead of l2fwd-graph as example in patch 06. 3. Add new parameter, like --node(nodeid, lcoreid) to config node for core affinity. Comments and suggestions are welcome. Thanks! Haiyue Wang (1): examples: add l2fwd-graph Zhirun Yan (5): graph: introduce core affinity API into graph graph: introduce graph clone API for other worker core graph: enable stream moving cross cores graph: enhance graph walk by cross-core dispatch graph: add stats for corss-core dispatching examples/l2fwd-graph/main.c | 455 +++++++++++++++++++++++++++++++ examples/l2fwd-graph/meson.build | 25 ++ examples/l2fwd-graph/node.c | 263 ++++++++++++++++++ examples/l2fwd-graph/node.h | 64 +++++ examples/meson.build | 1 + lib/graph/graph.c | 121 ++++++++ lib/graph/graph_debug.c | 4 + lib/graph/graph_populate.c | 1 + lib/graph/graph_private.h | 43 +++ lib/graph/graph_sched.c | 194 +++++++++++++ lib/graph/graph_stats.c | 19 +- lib/graph/meson.build | 2 + lib/graph/node.c | 25 ++ lib/graph/rte_graph.h | 50 ++++ lib/graph/rte_graph_worker.h | 59 ++++ lib/graph/version.map | 5 + 16 files changed, 1327 insertions(+), 4 deletions(-) create mode 100644 examples/l2fwd-graph/main.c create mode 100644 examples/l2fwd-graph/meson.build create mode 100644 examples/l2fwd-graph/node.c create mode 100644 examples/l2fwd-graph/node.h create mode 100644 lib/graph/graph_sched.c -- 2.25.1