From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C0DA7A317C for ; Thu, 17 Oct 2019 15:16:09 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 7F5401C0CE; Thu, 17 Oct 2019 15:16:09 +0200 (CEST) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by dpdk.org (Postfix) with ESMTP id 1A0671C02C for ; Thu, 17 Oct 2019 15:16:08 +0200 (CEST) Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 552B5C01B808; Thu, 17 Oct 2019 13:16:07 +0000 (UTC) Received: from dhcp-25.97.bos.redhat.com (ovpn-123-224.rdu2.redhat.com [10.10.123.224]) by smtp.corp.redhat.com (Postfix) with ESMTPS id EC8B55C1B5; Thu, 17 Oct 2019 13:16:05 +0000 (UTC) From: Aaron Conole To: Amit Gupta Cc: Honnappa Nagarahalli , "Wang\, Yipeng1" , "Gobriel\, Sameh" , "Richardson\, Bruce" , "De Lara Guarch\, Pablo" , "dev\@dpdk.org" , nd References: <1567748973-24192-3-git-send-email-agupta3@marvell.com> <1568362357-18061-1-git-send-email-agupta3@marvell.com> Date: Thu, 17 Oct 2019 09:16:04 -0400 In-Reply-To: (Amit Gupta's message of "Thu, 17 Oct 2019 04:57:09 +0000") Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.32]); Thu, 17 Oct 2019 13:16:07 +0000 (UTC) Subject: Re: [dpdk-dev] [PATCH v2 1/1] test/meson: hash lf test moved to dpdk perf testsuite X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Amit Gupta writes: >> -----Original Message----- >> From: Honnappa Nagarahalli >> Sent: Friday, September 13, 2019 9:17 PM >> To: Wang, Yipeng1 ; Aaron Conole >> ; Amit Gupta >> Cc: Gobriel, Sameh ; Richardson, Bruce >> ; De Lara Guarch, Pablo >> ; dev@dpdk.org; Honnappa Nagarahalli >> ; nd ; nd >> Subject: [EXT] RE: [dpdk-dev] [PATCH v2 1/1] test/meson: hash lf test moved >> to dpdk perf testsuite >> >> External Email >> >> ---------------------------------------------------------------------- >> >> >> > > >> > > writes: >> > > >> > > > From: Amit Gupta >> > > > >> > > > hash_readwrite_lf test always getting TIMEOUT as required time to >> > > > finish this test was much longer compare to time required for fast >> > > > tests(10s). Hence, the test is being renamed moved to perf test >> > > > category for its execution to complete. >> > > > >> > > > Signed-off-by: Amit Gupta >> > > > --- >> > > >> > > Okay. I'll note that we pass the '-t 3' flag, so it is actually >> > > timing out with 30s instead of the default 10. We do this because >> > > occasionally the lpm6 and table tests would also exceed the 10s >> > > timeout in the travis environment. I agree, it's better to pull the >> > > perf part >> > of tests out. >> > > >> > > I think there isn't any additional functional test in this readwrite - is that >> so? >> > > If it is, then we need to also prioritize adding back in some of the >> > > functional testing. Maybe I misread the lf_autotest, though. >> > > >> > [Wang, Yipeng] >> > Yes that is my concern too, if we just move all the lock-free test >> > into perf test then we miss the functional test. >> > Would any of you like to consider adding a small functional test into >> > the readwrite or readwrite_lf_functional? >> > That would be great :) >> Yes, I will take up for readwrite_lf_functional. But, I do not have much >> bandwidth for 19.11. I suggest we move only part of the tests to perf tests >> instead for 19.11, this would serve both the purposes. >> >> Amit, would it be possible to check what tests will run within the timeout >> period? >> > > @Wang, Yipeng1, is it good if we do the change as @Honnappa > Nagarahalli suggestion of changing 'hash_readwrite_lf_autotest' to > 'hash_readwrite_lf_perf_autotest' for the time being and later once > have sufficient bandwidth we can move only perf part of the test to > perf tests. NAK. I don't like that proposal. While it's true that there are occasional TIMEOUT failures with the current setup, I'd much prefer these timeouts (which we can easily distinguish) to removing the test from the travis chain. My understanding is that there *are* some functionality being exercised by this test that isn't exercised elsewhere. I'd prefer we don't sacrifice the coverage.