From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 77A464269E; Mon, 2 Oct 2023 11:20:41 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 130F140294; Mon, 2 Oct 2023 11:20:41 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by mails.dpdk.org (Postfix) with ESMTP id ED8814003C for ; Mon, 2 Oct 2023 11:20:38 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1696238438; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=2shmmdpJeoIbzEka74jlbalsB4j/8WtmPy1iEpKGzkQ=; b=S20yknU3rP2pB3CyUc2EMBZ4bQxVWdnRdLzpU6gW5VrxhklMALcTjiIUL9KBniJYQ+NN/N EpCWENB1jdJx6G7XQcZmYBQKQaujDvLGajclqgkyQLNEvysLrGn+mDVXYVS9kEBk5PY3M0 Tz1dh/BO4LZl+eK1GAQvG9vesGHD8ms= Received: from mail-lj1-f200.google.com (mail-lj1-f200.google.com [209.85.208.200]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-531-ZllPs9ztMx6N--9dbGQTtA-1; Mon, 02 Oct 2023 05:20:37 -0400 X-MC-Unique: ZllPs9ztMx6N--9dbGQTtA-1 Received: by mail-lj1-f200.google.com with SMTP id 38308e7fff4ca-2c01ce3c29fso230947221fa.3 for ; Mon, 02 Oct 2023 02:20:36 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696238435; x=1696843235; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=2shmmdpJeoIbzEka74jlbalsB4j/8WtmPy1iEpKGzkQ=; b=RG0CjdXECzxXI0Vsp5re9Ltqhszl84f5c/p9bQpDcX+FR67l9ZqgYE3/cxuMXJkisS VOqj9Amaao+JxSW2LHZTIoUz251OuqiTY4K3aVH9aFHI8l1SfE0DOlhXYmmQNYvVitIp Rs6WNfnb6zpkMNjrcFM1uyc7dKnJn8HPFGrvIKY1DZ/FuZwrlpZwYBVgqVSSIXF8kj3V 7990UngAANA0xM0VW3jv+891vOn2p5pzuTYCDKZd2TkUhUdNrUgdpMYkoXhS+Fjobw/6 gi3adQo9UpfPjjEOik8wXvGGDl7j1ZI+ZFaGxRxTbLsOqtm5iQjejh8EwhWgz0xIVP+x QfCQ== X-Gm-Message-State: AOJu0Yz68+TE21SxszdkSctKxcl2iZmRq8mMwFmEZ9KJtXS2Xmb/Rl3j JYn106AKmhiVHzX48qIXr70gTSJh0d5PFRd7j7Jj+NWBEJdyI9tdvph+K+9LJ8SZ5QLsZUhcoqe f085UxN4KIxnm7Hf1/Ag= X-Received: by 2002:a2e:9ccb:0:b0:2bf:fab9:db28 with SMTP id g11-20020a2e9ccb000000b002bffab9db28mr9134740ljj.6.1696238435674; Mon, 02 Oct 2023 02:20:35 -0700 (PDT) X-Google-Smtp-Source: AGHT+IEQpG5BqXrBIhEAiIzJwnTVbDuLylGHSjFahP+ZjageFTmbAd4IkgIOsjH45x/dyA5pYwxV0qqLcAY4foT3XOM= X-Received: by 2002:a2e:9ccb:0:b0:2bf:fab9:db28 with SMTP id g11-20020a2e9ccb000000b002bffab9db28mr9134724ljj.6.1696238435247; Mon, 02 Oct 2023 02:20:35 -0700 (PDT) MIME-Version: 1.0 References: <20230817105851.501947-1-bruce.richardson@intel.com> <20230914151636.278641-1-bruce.richardson@intel.com> In-Reply-To: From: David Marchand Date: Mon, 2 Oct 2023 11:20:23 +0200 Message-ID: Subject: Re: [PATCH v4] app/test: add support for skipping tests To: Bruce Richardson Cc: dev@dpdk.org, Thomas Monjalon , Aaron Conole X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Mon, Sep 25, 2023 at 6:27=E2=80=AFPM Aaron Conole w= rote: > Bruce Richardson writes: > > > When called from automated tools, like meson test, it is often useful t= o > > skip tests in a test suite, without having to alter the test build. To > > do so, we add support for DPDK_TEST_SKIP environment variable, where on= e > > can provide a comma-separated list of tests. When the test binary is > > called to run one of the tests on the list via either cmdline parameter > > or environment variable (as done with meson test), the test will not > > actually be run, but will be reported skipped. > > > > Example run: > > $ DPDK_TEST_SKIP=3Ddump_devargs,dump_ring meson test --suite=3Ddebug-= tests > > ... > > 1/9 DPDK:debug-tests / dump_devargs SKIP 1.11s > > 2/9 DPDK:debug-tests / dump_log_types OK 1.06s > > 3/9 DPDK:debug-tests / dump_malloc_heaps OK 1.11s > > 4/9 DPDK:debug-tests / dump_malloc_stats OK 1.07s > > 5/9 DPDK:debug-tests / dump_mempool OK 1.11s > > 6/9 DPDK:debug-tests / dump_memzone OK 1.06s > > 7/9 DPDK:debug-tests / dump_physmem OK 1.13s > > 8/9 DPDK:debug-tests / dump_ring SKIP 1.04s > > 9/9 DPDK:debug-tests / dump_struct_sizes OK 1.10s > > > > Ok: 7 > > Expected Fail: 0 > > Fail: 0 > > Unexpected Pass: 0 > > Skipped: 2 > > Timeout: 0 > > > > Signed-off-by: Bruce Richardson > > Acked-by: Thomas Monjalon > Acked-by: Aaron Conole Applied, thanks. --=20 David Marchand