From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 20400A0032;
	Thu, 15 Sep 2022 04:15:02 +0200 (CEST)
Received: from [217.70.189.124] (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id B17FA4021E;
	Thu, 15 Sep 2022 04:15:01 +0200 (CEST)
Received: from mga14.intel.com (mga14.intel.com [192.55.52.115])
 by mails.dpdk.org (Postfix) with ESMTP id 9170040156
 for <dev@dpdk.org>; Thu, 15 Sep 2022 04:14:58 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple;
 d=intel.com; i=@intel.com; q=dns/txt; s=Intel;
 t=1663208099; x=1694744099;
 h=from:to:cc:subject:date:message-id:in-reply-to:
 references:mime-version:content-transfer-encoding;
 bh=ywBT0JtgEfzoK8YxyeCGbnvNKpbSN07Efh+3IInN0Mk=;
 b=mUOO6+SbhCdrm2fwJrkdsCxIBZnvBgQS60acT73jOKjUyT2O+Vde0TCl
 6S7ZN+imhtAl94Zc+bKgmZRCWhpbcMnG2cxLnT1wv1twa0ob76Qw2MvmT
 io4JOBJp7Tb9jB96Mq6LCLmMh2o/93z5UTLoJQm9jMmvHF93oY2YT9XKI
 DRv/wsZrHzS+kadq1ikDmLYzHQWLLm2bW5h+lKKzd6fU61/Pzj7uKobWT
 j3yT9WLTGwUzMDDYeowLxDMqn1xS3pP91CqSJsHmw+9CPKYgbszeRRkBe
 MxtuMgVzFU4uQthK8p756wOOOhqog6jI1UUwu9OSEMPwcoRvZZqKXDpQs Q==;
X-IronPort-AV: E=McAfee;i="6500,9779,10470"; a="298588073"
X-IronPort-AV: E=Sophos;i="5.93,316,1654585200"; d="scan'208";a="298588073"
Received: from fmsmga008.fm.intel.com ([10.253.24.58])
 by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384;
 14 Sep 2022 19:14:57 -0700
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.93,316,1654585200"; d="scan'208";a="679306774"
Received: from dpdk-lrong-icx-01.sh.intel.com ([10.67.119.18])
 by fmsmga008.fm.intel.com with ESMTP; 14 Sep 2022 19:14:55 -0700
From: Leyi Rong <leyi.rong@intel.com>
To: ferruh.yigit@xilinx.com, david.marchand@redhat.com, suanmingm@nvidia.com,
 yipeng1.wang@intel.com, zaoxingliu@gmail.com, sameh.gobriel@intel.com
Cc: dev@dpdk.org,
	Leyi Rong <leyi.rong@intel.com>
Subject: [PATCH v3 0/2] introduce NitroSketch Mode into membership library
Date: Thu, 15 Sep 2022 10:14:50 +0800
Message-Id: <20220915021452.272075-1-leyi.rong@intel.com>
X-Mailer: git-send-email 2.25.1
In-Reply-To: <20220810074518.1695013-1-leyi.rong@intel.com>
References: <20220810074518.1695013-1-leyi.rong@intel.com>
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org

This patchset introduce a brand new NitroSketch Mode into membership
library. This algorithm provides high-fidelity approximate measurements
and appears as a promissing alternative to triditional approches such as
packet sampling.

---
v3:
- mark below new added APIs as "experimental":
	rte_member_add_byte_count()
	rte_member_query_count()
	rte_member_report_heavyhitter()
- meson build file rework for potential runtime issue.

v2:
- attach paper link to commit log.
- fix potential memory leaks in test_member.c.
- build error fix according to CI build fail log.

Leyi Rong (2):
  member: implement NitroSketch mode
  test/member: add functional and perf tests for sketch

 app/test/test_member.c                | 272 ++++++++++++
 app/test/test_member_perf.c           | 153 ++++++-
 lib/member/meson.build                |  42 +-
 lib/member/rte_member.c               |  75 ++++
 lib/member/rte_member.h               | 154 ++++++-
 lib/member/rte_member_heap.h          | 424 ++++++++++++++++++
 lib/member/rte_member_sketch.c        | 594 ++++++++++++++++++++++++++
 lib/member/rte_member_sketch.h        |  97 +++++
 lib/member/rte_member_sketch_avx512.c |  69 +++
 lib/member/rte_member_sketch_avx512.h |  36 ++
 lib/member/rte_xxh64_avx512.h         | 117 +++++
 lib/member/version.map                |   9 +
 12 files changed, 2034 insertions(+), 8 deletions(-)
 create mode 100644 lib/member/rte_member_heap.h
 create mode 100644 lib/member/rte_member_sketch.c
 create mode 100644 lib/member/rte_member_sketch.h
 create mode 100644 lib/member/rte_member_sketch_avx512.c
 create mode 100644 lib/member/rte_member_sketch_avx512.h
 create mode 100644 lib/member/rte_xxh64_avx512.h

-- 
2.25.1