From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 285C34588C; Wed, 28 Aug 2024 22:37:20 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id BEB7F402BE; Wed, 28 Aug 2024 22:37:19 +0200 (CEST) Received: from mail-pl1-f171.google.com (mail-pl1-f171.google.com [209.85.214.171]) by mails.dpdk.org (Postfix) with ESMTP id 11DD540295 for ; Wed, 28 Aug 2024 22:37:19 +0200 (CEST) Received: by mail-pl1-f171.google.com with SMTP id d9443c01a7336-201e52ca0caso51371745ad.3 for ; Wed, 28 Aug 2024 13:37:18 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1724877438; x=1725482238; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=dN5KqJvQ5YKaEINIT4Pw6et5DU6Nm09sSrRbcEv/dSU=; b=iMhpUq8TFo3uPTOkTBweyRbDUjg+SqSV9hZ2PxTsU68WeAC8d+NFsD3IyDy/A4RSMW 3cNfa8sN5WU6S1B0sBK8pfFrGA+k71i+BalC1vf6jYpgLwaMuGdVj+HftZl//WMlhAoh 6p0gn1Z3WIfMnA57zDncV+5BWKKL0O1ajbTms= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1724877438; x=1725482238; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=dN5KqJvQ5YKaEINIT4Pw6et5DU6Nm09sSrRbcEv/dSU=; b=Y3x5RaXD2x5X1/EDdEtAQ2ydh8Guy5K4Q0asPzv+GVPKYR0pSoyW10vV1XwqOjScTk un9JvlKiN3rdZR3br1W5ulNiaiJHmmv9gDHq7Ehfah7gtss7w0NKlhhnybNtcOTduXDV nRQY+aEPqcdGLgcgSmgzEdU6ommYu72q86U8zASyjzq4amSxdzdVmfhxi/zFjUIXrU+D EefpfzHJrk76/rXl2Xj5LsRmrcB+Bh9jAW6USDVHL6pbyI1IenQ77AeBtCwO27xT8Of/ QsmqdVA3mdep6FEboVLpmLLyOBWxYBWIWFQ7B9sLbbCfk5Pe0RaReftKZ1McrCgtuqNc xFvA== X-Forwarded-Encrypted: i=1; AJvYcCUZZyeT0CLmGdqoKCvgSWUU5hebV2DHHDlndXrOhJYH0ZkySQG9nbn+wKsOBAIua4LWEfw=@dpdk.org X-Gm-Message-State: AOJu0YxsSp/sb63snRjlTx+XWKEA2XnFxK/DHTOovq8mQ211CoSkTLjn TIoKIg+Mp/pwTrb9AP4dCIrhRasASzq3WmMBCXzcdWxn6v3lGLo+xx+m7XGidBjpnkqOanMNviM Y6Cu4FN4RzMY5iGlr4aBeV8+ckfgzwfh7KieGNg== X-Google-Smtp-Source: AGHT+IHqb0KchpDyAArDrWEMosIqp5ijypB7YdMfQRgVivnc+mUufcaj97pOLFPm//dXMk8LvlxoD+kjbhvDcCiVNRc= X-Received: by 2002:a17:902:ce0d:b0:1f7:21fd:aba3 with SMTP id d9443c01a7336-2050c37b35fmr8942945ad.34.1724877438050; Wed, 28 Aug 2024 13:37:18 -0700 (PDT) MIME-Version: 1.0 References: <20240301155416.96960-1-juraj.linkes@pantheon.tech> <20240821145315.97974-1-juraj.linkes@pantheon.tech> <20240821145315.97974-5-juraj.linkes@pantheon.tech> In-Reply-To: <20240821145315.97974-5-juraj.linkes@pantheon.tech> From: Dean Marx Date: Wed, 28 Aug 2024 16:37:28 -0400 Message-ID: Subject: Re: [PATCH v3 04/12] dts: add mechanism to skip test cases or suites To: =?UTF-8?Q?Juraj_Linke=C5=A1?= Cc: thomas@monjalon.net, Honnappa.Nagarahalli@arm.com, jspewock@iol.unh.edu, probb@iol.unh.edu, paul.szczepanek@arm.com, Luca.Vizzarro@arm.com, npratte@iol.unh.edu, alex.chapman@arm.com, dev@dpdk.org Content-Type: multipart/alternative; boundary="000000000000fa02540620c4525e" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --000000000000fa02540620c4525e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Wed, Aug 21, 2024 at 10:53=E2=80=AFAM Juraj Linke=C5=A1 wrote: > If a test case is not relevant to the testing environment (such as when > a NIC doesn't support a tested feature), the framework should skip it. > The mechanism is a skeleton without actual logic that would set a test > case or suite to be skipped. > > The mechanism uses a protocol to extend test suites and test cases with > additional attributes that track whether the test case or suite should > be skipped the reason for skipping it. > > Also update the results module with the new SKIP result. > > Signed-off-by: Juraj Linke=C5=A1 > Reviewed-by: Dean Marx --000000000000fa02540620c4525e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
On Wed, Aug 21, 2024 at 10:53=E2=80=AFAM = Juraj Linke=C5=A1 <juraj.linkes@pantheon.tech> wrote:
If a= test case is not relevant to the testing environment (such as when
a NIC doesn't support a tested feature), the framework should skip it.<= br> The mechanism is a skeleton without actual logic that would set a test
case or suite to be skipped.

The mechanism uses a protocol to extend test suites and test cases with
additional attributes that track whether the test case or suite should
be skipped the reason for skipping it.

Also update the results module with the new SKIP result.

Signed-off-by: Juraj Linke=C5=A1 <juraj.linkes@pantheon.tech>

Reviewed-by: Dean Marx <dmarx@iol.unh.edu>=C2=A0
--000000000000fa02540620c4525e--