From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 906C842637; Mon, 25 Sep 2023 18:26:50 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 68941402D5; Mon, 25 Sep 2023 18:26:50 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.133.124]) by mails.dpdk.org (Postfix) with ESMTP id ABCC740041 for ; Mon, 25 Sep 2023 18:26:49 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1695659209; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=PEFvR4FXA7tIVpsFSaW+NjhQ0P+B/qobTVB7gm8rCds=; b=Y+ubjr0LupEv9QwLMv1L4vvs7Zowqdb3jNxw/+fd3mOBeHGDxyJJ9fQxZjn4TQL6tbkDy2 T7tqpkSV8YPG4Eva8KZlt2gslGdNswU2lfBb+7EJSGGo+9Bnv8o8UPCKPlCrkGpY7dHVbM LYoWN3t5/GOhoNsNnUuvdh8f1yvpFuU= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id us-mta-424-KUNSRdOmOU--5L_cMFltYA-1; Mon, 25 Sep 2023 12:26:47 -0400 X-MC-Unique: KUNSRdOmOU--5L_cMFltYA-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 8D1918039C8; Mon, 25 Sep 2023 16:26:46 +0000 (UTC) Received: from RHTPC1VM0NT (unknown [10.22.8.239]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 585452026D4B; Mon, 25 Sep 2023 16:26:46 +0000 (UTC) From: Aaron Conole To: Bruce Richardson Cc: dev@dpdk.org, Thomas Monjalon Subject: Re: [PATCH v4] app/test: add support for skipping tests References: <20230817105851.501947-1-bruce.richardson@intel.com> <20230914151636.278641-1-bruce.richardson@intel.com> Date: Mon, 25 Sep 2023 12:26:44 -0400 In-Reply-To: <20230914151636.278641-1-bruce.richardson@intel.com> (Bruce Richardson's message of "Thu, 14 Sep 2023 16:16:36 +0100") Message-ID: User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux) MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.1 on 10.11.54.4 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Bruce Richardson writes: > When called from automated tools, like meson test, it is often useful to > skip tests in a test suite, without having to alter the test build. To > do so, we add support for DPDK_TEST_SKIP environment variable, where one > can provide a comma-separated list of tests. When the test binary is > called to run one of the tests on the list via either cmdline parameter > or environment variable (as done with meson test), the test will not > actually be run, but will be reported skipped. > > Example run: > $ DPDK_TEST_SKIP=dump_devargs,dump_ring meson test --suite=debug-tests > ... > 1/9 DPDK:debug-tests / dump_devargs SKIP 1.11s > 2/9 DPDK:debug-tests / dump_log_types OK 1.06s > 3/9 DPDK:debug-tests / dump_malloc_heaps OK 1.11s > 4/9 DPDK:debug-tests / dump_malloc_stats OK 1.07s > 5/9 DPDK:debug-tests / dump_mempool OK 1.11s > 6/9 DPDK:debug-tests / dump_memzone OK 1.06s > 7/9 DPDK:debug-tests / dump_physmem OK 1.13s > 8/9 DPDK:debug-tests / dump_ring SKIP 1.04s > 9/9 DPDK:debug-tests / dump_struct_sizes OK 1.10s > > Ok: 7 > Expected Fail: 0 > Fail: 0 > Unexpected Pass: 0 > Skipped: 2 > Timeout: 0 > > Signed-off-by: Bruce Richardson > Acked-by: Thomas Monjalon > > --- Acked-by: Aaron Conole