From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 311F145804 for ; Fri, 23 Aug 2024 18:22:18 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 281654336F; Fri, 23 Aug 2024 18:22:18 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id 65011402BE for ; Fri, 23 Aug 2024 18:22:16 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1724430136; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aIF/ZPIAsOzAmxnzZX3xXnIoaTg3u30MJZ7KkdISyP0=; b=FBVIn1Lb3kqg+iRbL0ylxGW3SVWFX0Dm2ORqzR+JbRZJvd65XFsjUGotB9ecBEXBWYZy8z Usr79VW7L2JRNc0EGtcMfOHTSfQfNvRsmntDEtMoZetIHkT1PiCyLGkat/T4eqxT5k/NKZ zygbhbStC9OhNoxT/x1wMe5PYH8fgb4= Received: from mx-prod-mc-03.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-682-OIRyPYYyNyiYR5JivYKTAQ-1; Fri, 23 Aug 2024 12:22:12 -0400 X-MC-Unique: OIRyPYYyNyiYR5JivYKTAQ-1 Received: from mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.17]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-03.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id CA9E41955D4A; Fri, 23 Aug 2024 16:22:11 +0000 (UTC) Received: from rh.redhat.com (unknown [10.39.193.224]) by mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id 210DC1955F44; Fri, 23 Aug 2024 16:22:09 +0000 (UTC) From: Kevin Traynor To: Anatoly Burakov Cc: Vipin Padmam Ramesh , dpdk stable Subject: patch 'fbarray: fix lookahead ignore mask handling' has been queued to stable release 21.11.8 Date: Fri, 23 Aug 2024 17:18:20 +0100 Message-ID: <20240823161929.1004778-72-ktraynor@redhat.com> In-Reply-To: <20240823161929.1004778-1-ktraynor@redhat.com> References: <20240823161929.1004778-1-ktraynor@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.0 on 10.30.177.17 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="US-ASCII"; x-default=true X-BeenThere: stable@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: patches for DPDK stable branches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: stable-bounces@dpdk.org Hi, FYI, your patch has been queued to stable release 21.11.8 Note it hasn't been pushed to http://dpdk.org/browse/dpdk-stable yet. It will be pushed if I get no objections before 08/28/24. So please shout if anyone has objections. Also note that after the patch there's a diff of the upstream commit vs the patch applied to the branch. This will indicate if there was any rebasing needed to apply to the stable branch. If there were code changes for rebasing (ie: not only metadata diffs), please double check that the rebase was correctly done. Queued patches are on a temporary branch at: https://github.com/kevintraynor/dpdk-stable This queued commit can be viewed at: https://github.com/kevintraynor/dpdk-stable/commit/0f46faa56ff6ccd95acd4ac2677370bee2e92200 Thanks. Kevin --- >From 0f46faa56ff6ccd95acd4ac2677370bee2e92200 Mon Sep 17 00:00:00 2001 From: Anatoly Burakov Date: Mon, 8 Jul 2024 17:07:34 +0100 Subject: [PATCH] fbarray: fix lookahead ignore mask handling [ upstream commit a344719c181aac28cb2ada0d2ddbfee8ad737a1a ] When lookahead mask does not have its first bit set, we can infer that we've lost our run. However, currently, we set ignore mask to ignore `need` number of bits, which is incorrect because while there is no *current* run within those bits, we might still be able to start a new run within those ignored bits later. This issue is fixed by counting how many shifts it took to lose the run, and this is the number of bits we should ignore (+1 to skip one we stopped on). Also, add unit tests to reproduce the problem. Fixes: c44d09811b40 ("eal: add shared indexed file-backed array") Signed-off-by: Vipin Padmam Ramesh Signed-off-by: Anatoly Burakov --- app/test/test_fbarray.c | 28 ++++++++++++++++++++++++++++ lib/eal/common/eal_common_fbarray.c | 13 ++++++++++--- 2 files changed, 38 insertions(+), 3 deletions(-) diff --git a/app/test/test_fbarray.c b/app/test/test_fbarray.c index f448d4f196..38a62cd456 100644 --- a/app/test/test_fbarray.c +++ b/app/test/test_fbarray.c @@ -756,4 +756,30 @@ static int test_lookbehind(void) } +static int test_lookahead_mask(void) +{ + /* + * There is a certain type of lookahead behavior we want to test here, + * namely masking of bits that were scanned with lookahead but that we + * know do not match our criteria. This is achieved in following steps: + * + * 0. Look for a big enough chunk of free space (say, 62 elements) + * 1. Trigger lookahead by breaking a run somewhere inside mask 0 + * (indices 0-63) + * 2. Fail lookahead by breaking the run somewhere inside mask 1 + * (indices 64-127) + * 3. Ensure that we can still find free space in mask 1 afterwards + */ + + /* break run on first mask */ + rte_fbarray_set_used(¶m.arr, 61); + /* break run on second mask */ + rte_fbarray_set_used(¶m.arr, 70); + + /* we expect to find free space at 71 */ + TEST_ASSERT_EQUAL(rte_fbarray_find_next_n_free(¶m.arr, 0, 62), + 71, "Free chunk index is wrong\n"); + return TEST_SUCCESS; +} + static struct unit_test_suite fbarray_test_suite = { .suite_name = "fbarray autotest", @@ -771,4 +797,6 @@ static struct unit_test_suite fbarray_test_suite = { TEST_CASE_ST(lookahead_test_setup, reset_array, test_lookahead), TEST_CASE_ST(lookbehind_test_setup, reset_array, test_lookbehind), + /* setup for these tests is more complex so do it in test func */ + TEST_CASE_ST(NULL, reset_array, test_lookahead_mask), TEST_CASES_END() } diff --git a/lib/eal/common/eal_common_fbarray.c b/lib/eal/common/eal_common_fbarray.c index 0013ef2c55..def47ceef0 100644 --- a/lib/eal/common/eal_common_fbarray.c +++ b/lib/eal/common/eal_common_fbarray.c @@ -220,4 +220,6 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, lookahead_idx++) { unsigned int s_idx, need; + uint64_t first_bit = 1; + lookahead_msk = msk->data[lookahead_idx]; @@ -229,9 +231,14 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, need = RTE_MIN(left, MASK_ALIGN); - for (s_idx = 0; s_idx < need - 1; s_idx++) + /* count number of shifts we performed */ + for (s_idx = 0; s_idx < need - 1; s_idx++) { lookahead_msk &= lookahead_msk >> 1ULL; + /* did we lose the run yet? */ + if ((lookahead_msk & first_bit) == 0) + break; + } /* if first bit is not set, we've lost the run */ - if ((lookahead_msk & 1) == 0) { + if ((lookahead_msk & first_bit) == 0) { /* * we've scanned this far, so we know there are @@ -239,5 +246,5 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, * as well, so skip that on next iteration. */ - ignore_msk = ~((1ULL << need) - 1); + ignore_msk = ~((1ULL << (s_idx + 1)) - 1); /* outer loop will increment msk_idx so add 1 */ msk_idx = lookahead_idx - 1; -- 2.46.0 --- Diff of the applied patch vs upstream commit (please double-check if non-empty: --- --- - 2024-08-23 17:18:11.944459067 +0100 +++ 0072-fbarray-fix-lookahead-ignore-mask-handling.patch 2024-08-23 17:18:09.751430214 +0100 @@ -1 +1 @@ -From a344719c181aac28cb2ada0d2ddbfee8ad737a1a Mon Sep 17 00:00:00 2001 +From 0f46faa56ff6ccd95acd4ac2677370bee2e92200 Mon Sep 17 00:00:00 2001 @@ -5,0 +6,2 @@ +[ upstream commit a344719c181aac28cb2ada0d2ddbfee8ad737a1a ] + @@ -19 +20,0 @@ -Cc: stable@dpdk.org @@ -29 +30 @@ -index 147d6e2a07..4b17ef6be3 100644 +index f448d4f196..38a62cd456 100644 @@ -71 +72 @@ -index b4f0b0b0c3..195f8394be 100644 +index 0013ef2c55..def47ceef0 100644 @@ -74 +75 @@ -@@ -217,4 +217,6 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, +@@ -220,4 +220,6 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, @@ -81 +82 @@ -@@ -226,9 +228,14 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, +@@ -229,9 +231,14 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, @@ -98 +99 @@ -@@ -236,5 +243,5 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n, +@@ -239,5 +246,5 @@ find_next_n(const struct rte_fbarray *arr, unsigned int start, unsigned int n,