From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id CD780A0548; Mon, 20 Sep 2021 14:53:41 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5E84D41103; Mon, 20 Sep 2021 14:53:29 +0200 (CEST) Received: from AZHDRRW-EX01.nvidia.com (azhdrrw-ex01.nvidia.com [20.51.104.162]) by mails.dpdk.org (Postfix) with ESMTP id C3F9A410F4 for ; Mon, 20 Sep 2021 14:53:25 +0200 (CEST) Received: from NAM04-BN8-obe.outbound.protection.outlook.com (104.47.74.48) by mxs.oss.nvidia.com (10.13.234.36) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.2.858.15; Mon, 20 Sep 2021 05:53:25 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RV16LNDoMpgHq6dXhDNFLEWToecMxVLKNAdG0TFL4fSDighATDJYvzHbiKankONx4jv3nDAkUh+luYK63w1Msq9ESSLOuYc4tBygZgfedfMwNxof0E3NxlIK9x5qAJvzKxgiJa0gXmaCJyvZuxCjZTl5mtAjLYXTLt3CTThGGTNzfsBHpsumIlKm38bs9P1rlmStvQimpcLkS6wuP/fe70ncyiqnhGx3M0Y3vfcMoSHv7w7tgFpcmCa1HnZbSweiSb8OXXsRg7jzRc4HnU2Nb9X9mnR6vHJIAo7IFjojru3juxQ5Rqjj0Rlnr1c9oRzVrowOCPC53L0JsJgqS03J5g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Zn9i7bfX3Lt4DCmVUPxHH2VbFndJc3jgrRYOpS4F+Ds=; b=HvmVrBsbLnTAkLO5b9IXOzUU07lMVWOV/BhC6ouzaobGKY7fP0Y43TVhQuV+zyzVNFPqb0K1IPU8qdIkcVCviePn6KalRdyMlZytiEAzZGuG2rF6K1IT2CF+wE12/Gxv6ia57uhtBvhZw1SX+DhaUSBV4nKyC/cxp6DzRc6peZJIXF0eMCpwlA+havD0Td0g3Bx7H4afBYNUzdOzfcyD+HfTcmaBRFnydjJ5RbayvffZPF5D/p1+1m8k3isP7eULzAW73i9YG5MSrGyWG3TPjSmBN9sQYQwwgULjXMvjj2/A791BWRKO/I50f1Rnontvq7mCyHjg0MAUN1EHpXBdVg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 216.228.112.35) smtp.rcpttodomain=intel.com smtp.mailfrom=nvidia.com; dmarc=pass (p=quarantine sp=none pct=100) action=none header.from=nvidia.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Nvidia.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Zn9i7bfX3Lt4DCmVUPxHH2VbFndJc3jgrRYOpS4F+Ds=; b=Kd0Tt2IjPjFUt/cqoxad440Oz2gfc8py0WPiXhXlIhQe++MRgyQhKW6V2I7Vb7RGLmGrLnKdJ2gLJesRkrSa29m2JkU1acX4toxW9kpXRlfDetmaLWsbbBwOZQ27iRNwj9A/J8vlqFCRuGVlBtzD1dzohRMngosCCei2JhyKv8GwBoKSeGYCF3dOg6e6tUjl53jhXnLeuLWRmu/rxhzO0/Rjw+eIwGCei3rNyTmPTntm4HQxo/LWfn5FtN2L2cThWcq/FsGeuJtXpzc8SMwTpkm6XXHAuaHWAlnDVxHcANWq+nfwT6OmfBJy/57rGK/ETXnimGBbv9/OgdkH5BFfOQ== Received: from MWHPR07CA0004.namprd07.prod.outlook.com (2603:10b6:300:116::14) by CY4PR1201MB2518.namprd12.prod.outlook.com (2603:10b6:903:d6::23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4523.16; Mon, 20 Sep 2021 12:53:23 +0000 Received: from CO1NAM11FT039.eop-nam11.prod.protection.outlook.com (2603:10b6:300:116:cafe::87) by MWHPR07CA0004.outlook.office365.com (2603:10b6:300:116::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4523.14 via Frontend Transport; Mon, 20 Sep 2021 12:53:23 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 216.228.112.35) smtp.mailfrom=nvidia.com; intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=pass action=none header.from=nvidia.com; Received-SPF: Pass (protection.outlook.com: domain of nvidia.com designates 216.228.112.35 as permitted sender) receiver=protection.outlook.com; client-ip=216.228.112.35; helo=mail.nvidia.com; Received: from mail.nvidia.com (216.228.112.35) by CO1NAM11FT039.mail.protection.outlook.com (10.13.174.110) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.4523.14 via Frontend Transport; Mon, 20 Sep 2021 12:53:23 +0000 Received: from DRHQMAIL107.nvidia.com (10.27.9.16) by HQMAIL111.nvidia.com (172.20.187.18) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Mon, 20 Sep 2021 12:53:22 +0000 Received: from nvidia.com (172.20.187.5) by DRHQMAIL107.nvidia.com (10.27.9.16) with Microsoft SMTP Server (TLS) id 15.0.1497.18; Mon, 20 Sep 2021 12:53:20 +0000 From: To: CC: Anatoly Burakov , Dmitry Kozlyuk , Viacheslav Ovsiienko Date: Mon, 20 Sep 2021 15:53:02 +0300 Message-ID: <20210920125302.820273-4-dkozlyuk@nvidia.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20210920125302.820273-1-dkozlyuk@nvidia.com> References: <20210914103456.535427-1-dkozlyuk@nvidia.com> <20210920125302.820273-1-dkozlyuk@nvidia.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Content-Type: text/plain X-Originating-IP: [172.20.187.5] X-ClientProxiedBy: HQMAIL105.nvidia.com (172.20.187.12) To DRHQMAIL107.nvidia.com (10.27.9.16) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 1d6cf29d-a383-4b9a-eac2-08d97c35a165 X-MS-TrafficTypeDiagnostic: CY4PR1201MB2518: X-Microsoft-Antispam-PRVS: X-MS-Exchange-Transport-Forked: True X-MS-Oob-TLC-OOBClassifiers: OLM:1923; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: X7PWYEJqQZYWu2Th32Ch7qiaHcctxMQtd7PMT2jYrprXrHTfZrY/NJkc7HKmFxAjWf+smZcm3eIDaXi+LrU+mWcofSsDBkbkh3U0BaOaPvFRE/s9KDKyInoveEJnN4Bk3GHtxC4F4RhjKXD1wiXf3fzRDSJekdT945QryYTPIvqrjsHI4kFu/tXhEgs5O8tiOE44BcjjT04NZ+uKS/CQ3sMwoltMqyoRF+ILVbZMayBhnCt793S4NGcnhelKKQ8j4VMDVO0tMKyGiDJHzq+gonB624uZTaVE5ze/8dEcVWssT0UWcqqdhL4/Goifw3i2gJpFNsQhTyULZrzx6mslMnENh6cx4P0hOZhxu0A/kZWpTD7ZS8q6Cy1cJYfFI4fs2mhJlEfwThBuLwB0JJPX8BaCFFy9HzQeHRbg/oB1tueuR4/mHfg4CcvofsTbWvJThzvJKnPPdJqcL77XWWwoPGG9EGP2Ojj69P4TGo4x8Es+Ic+QQl8bu2kt9ztURI+JdiaKBAiG7AIFNiA1HtfUj+V18rH2VdcKXKylty63IhD5sD9NJwo2NVA3J3yR3nY5EYYC11mDRilg4RP2Z+3HIlxaW2/PwvhDYfJEUSrWZzxrfufGFGnaQ4HopkX1fZYzXb1IW26OgNb/QW7f6UZPGR8fni/Xa4WjQczDb3rxK5BxfEzrGMRG+Ex0tfWld3zl X-Forefront-Antispam-Report: CIP:216.228.112.35; CTRY:US; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:mail.nvidia.com; PTR:schybrid02.nvidia.com; CAT:NONE; SFS:(4636009)(36840700001)(46966006)(2616005)(36756003)(107886003)(186003)(336012)(356005)(2906002)(5660300002)(54906003)(7636003)(82310400003)(1076003)(6286002)(70586007)(6916009)(70206006)(36860700001)(16526019)(7696005)(47076005)(316002)(4326008)(8936002)(8676002)(26005)(508600001)(2876002)(426003)(86362001)(55016002)(6666004)(36906005); DIR:OUT; SFP:1101; X-MS-Exchange-CrossTenant-OriginalArrivalTime: 20 Sep 2021 12:53:23.1358 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 1d6cf29d-a383-4b9a-eac2-08d97c35a165 X-MS-Exchange-CrossTenant-Id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=43083d15-7273-40c1-b7db-39efd9ccc17a; Ip=[216.228.112.35]; Helo=[mail.nvidia.com] X-MS-Exchange-CrossTenant-AuthSource: CO1NAM11FT039.eop-nam11.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR1201MB2518 Subject: [dpdk-dev] [PATCH v4 3/3] app/test: add allocator performance autotest X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" From: Dmitry Kozlyuk Memory allocator performance is crucial to applications that deal with large amount of memory or allocate frequently. DPDK allocator performance is affected by EAL options, API used and, at least, allocation size. New autotest is intended to be run with different EAL options. It measures performance with a range of sizes for dirrerent APIs: rte_malloc, rte_zmalloc, and rte_memzone_reserve. Work distribution between allocation and deallocation depends on EAL options. The test prints both times and total time to ease comparison. Memory can be filled with zeroes at different points of allocation path, but it always takes considerable fraction of overall timing. This is why the test measures filling speed and prints how long clearing would take for each size as a hint. Signed-off-by: Dmitry Kozlyuk Reviewed-by: Viacheslav Ovsiienko --- app/test/meson.build | 2 + app/test/test_malloc_perf.c | 157 ++++++++++++++++++++++++++++++++++++ 2 files changed, 159 insertions(+) create mode 100644 app/test/test_malloc_perf.c diff --git a/app/test/meson.build b/app/test/meson.build index a7611686ad..a48dc79463 100644 --- a/app/test/meson.build +++ b/app/test/meson.build @@ -84,6 +84,7 @@ test_sources = files( 'test_lpm6_perf.c', 'test_lpm_perf.c', 'test_malloc.c', + 'test_malloc_perf.c', 'test_mbuf.c', 'test_member.c', 'test_member_perf.c', @@ -281,6 +282,7 @@ fast_tests = [ perf_test_names = [ 'ring_perf_autotest', + 'malloc_perf_autotest', 'mempool_perf_autotest', 'memcpy_perf_autotest', 'hash_perf_autotest', diff --git a/app/test/test_malloc_perf.c b/app/test/test_malloc_perf.c new file mode 100644 index 0000000000..4435894095 --- /dev/null +++ b/app/test/test_malloc_perf.c @@ -0,0 +1,157 @@ +#include +#include +#include +#include +#include +#include + +#include "test.h" + +typedef void * (alloc_t)(const char *name, size_t size, unsigned int align); +typedef void (free_t)(void *addr); + +static const uint64_t KB = 1 << 10; +static const uint64_t GB = 1 << 30; + +static double +tsc_to_us(uint64_t tsc, size_t runs) +{ + return (double)tsc / rte_get_tsc_hz() * US_PER_S / runs; +} + +static int +test_memset_perf(double *us_per_gb) +{ + static const size_t RUNS = 20; + + void *ptr; + size_t i; + uint64_t tsc; + + puts("Performance: memset"); + + ptr = rte_malloc(NULL, GB, 0); + if (ptr == NULL) { + printf("rte_malloc(size=%"PRIx64") failed\n", GB); + return -1; + } + + tsc = rte_rdtsc_precise(); + for (i = 0; i < RUNS; i++) + memset(ptr, 0, GB); + tsc = rte_rdtsc_precise() - tsc; + + *us_per_gb = tsc_to_us(tsc, RUNS); + printf("Result: %f.3 GiB/s <=> %.2f us/MiB\n", + US_PER_S / *us_per_gb, *us_per_gb / KB); + + rte_free(ptr); + putchar('\n'); + return 0; +} + +static int +test_alloc_perf(const char *name, alloc_t *alloc_fn, free_t free_fn, + size_t max_runs, double memset_gb_us) +{ + static const size_t SIZES[] = { + 1 << 6, 1 << 7, 1 << 10, 1 << 12, 1 << 16, 1 << 20, + 1 << 21, 1 << 22, 1 << 24, 1 << 30 }; + + size_t i, j; + void **ptrs; + + printf("Performance: %s\n", name); + + ptrs = calloc(max_runs, sizeof(ptrs[0])); + if (ptrs == NULL) { + puts("Cannot allocate memory for pointers"); + return -1; + } + + printf("%12s%8s%12s%12s%12s%12s\n", + "Size (B)", "Runs", "Alloc (us)", "Free (us)", + "Total (us)", "memset (us)"); + for (i = 0; i < RTE_DIM(SIZES); i++) { + size_t size = SIZES[i]; + size_t runs_done; + uint64_t tsc_start, tsc_alloc, tsc_free; + double alloc_time, free_time, memset_time; + + tsc_start = rte_rdtsc_precise(); + for (j = 0; j < max_runs; j++) { + ptrs[j] = alloc_fn(NULL, size, 0); + if (ptrs[j] == NULL) + break; + } + tsc_alloc = rte_rdtsc_precise() - tsc_start; + + if (j == 0) { + printf("%12zu Interrupted: out of memory.\n", size); + break; + } + runs_done = j; + + tsc_start = rte_rdtsc_precise(); + for (j = 0; j < runs_done && ptrs[j] != NULL; j++) + free_fn(ptrs[j]); + tsc_free = rte_rdtsc_precise() - tsc_start; + + alloc_time = tsc_to_us(tsc_alloc, runs_done); + free_time = tsc_to_us(tsc_free, runs_done); + memset_time = memset_gb_us * size / GB; + printf("%12zu%8zu%12.2f%12.2f%12.2f%12.2f\n", + size, runs_done, alloc_time, free_time, + alloc_time + free_time, memset_time); + + memset(ptrs, 0, max_runs * sizeof(ptrs[0])); + } + + free(ptrs); + putchar('\n'); + return 0; +} + +static void * +memzone_alloc(const char *name __rte_unused, size_t size, unsigned int align) +{ + const struct rte_memzone *mz; + char gen_name[RTE_MEMZONE_NAMESIZE]; + + snprintf(gen_name, sizeof(gen_name), "test-mz-%"PRIx64, rte_rdtsc()); + mz = rte_memzone_reserve_aligned(gen_name, size, SOCKET_ID_ANY, + RTE_MEMZONE_1GB | RTE_MEMZONE_SIZE_HINT_ONLY, align); + return (void *)(uintptr_t)mz; +} + +static void +memzone_free(void *addr) +{ + rte_memzone_free((struct rte_memzone *)addr); +} + +static int +test_malloc_perf(void) +{ + static const size_t MAX_RUNS = 10000; + + double memset_gb_us; + + if (test_memset_perf(&memset_gb_us) < 0) + return -1; + + if (test_alloc_perf("rte_malloc", rte_malloc, rte_free, + MAX_RUNS, memset_gb_us) < 0) + return -1; + if (test_alloc_perf("rte_zmalloc", rte_zmalloc, rte_free, + MAX_RUNS, memset_gb_us) < 0) + return -1; + + if (test_alloc_perf("rte_memzone_reserve", memzone_alloc, memzone_free, + RTE_MAX_MEMZONE - 1, memset_gb_us) < 0) + return -1; + + return 0; +} + +REGISTER_TEST_COMMAND(malloc_perf_autotest, test_malloc_perf); -- 2.25.1