From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 513C045A12; Mon, 23 Sep 2024 21:26:21 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1F0D0402CA; Mon, 23 Sep 2024 21:26:20 +0200 (CEST) Received: from mail-pl1-f169.google.com (mail-pl1-f169.google.com [209.85.214.169]) by mails.dpdk.org (Postfix) with ESMTP id 1FC62402CA for ; Mon, 23 Sep 2024 21:26:19 +0200 (CEST) Received: by mail-pl1-f169.google.com with SMTP id d9443c01a7336-2053525bd90so43518535ad.0 for ; Mon, 23 Sep 2024 12:26:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1727119578; x=1727724378; darn=dpdk.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=Ki7BYsBq+tQvKzI5KtI4UZIpciaYbPmeVM1cX3zOgT8=; b=jBqTj0Ce+Y2eC/9oVgDXpUztZF5fEHKSa4zA3tpUzbabZahPL0QgPlMYwJ+fJ48pQU JcRm5YafY1emAK6MT93zHqFhIUGtMCIASV8KvtbDhYtU0cHCgHEvHeSBTCpJZnl9hMbg /dvM35RWkwJF9v/HK7YZNSUEneF65Cz9b5v20= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1727119578; x=1727724378; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Ki7BYsBq+tQvKzI5KtI4UZIpciaYbPmeVM1cX3zOgT8=; b=v06WKNddjRw5hGc5o+WQN27q4QMH58w2yRolt7+20BZCg2Zz6q1Bqwwe4hRJCavave 8ZArFW7Z35pkiKOoPK3D1KKnSpgOgiSs0wW+72j8PPzRZx/yOeG9T6QNPqH8GMjVCnRF XXqU0/4GU0+n1kAnwW1lnLRaHHi6DCaNfLYdIKJUy3ahWHkOgXt5wkqIlQ2d3Lu8QYwB KIQASSdWNFDT/Us+CoRSv3Y8ldiXffqK60KvPosIWk/TOeE8zpwucMSV2EhKkDvlnVA4 ncdzOvRWkPxdqFiYVNUrqPouNQTYR8Qgdc3ATtxE7gqXfRiBlXAP9LAnBaaThfa65JKm rL+Q== X-Forwarded-Encrypted: i=1; AJvYcCUIz2iQMsjDiUmJVW1iQlDxCpS1vLY9BxtgV1c9kfA8GS5yzK+ll1bMf0G8tZiupQTh524=@dpdk.org X-Gm-Message-State: AOJu0YwORPYY9UFIpVrFafKZ31cA07kd3peM4nhxUY/WgcMiDGUisHGV EnIA8f7XHQujZsPQ0D4A2zQif/zPCqd+a6uXPKTDdzqMqwIDM8f+VptqLoNvXk+XydoNRQBb5Pf 2yUv6VWV2aajr/HCwKaYwK0PUQU8qD6LZc+GkMZ4AhsUZuAF7 X-Google-Smtp-Source: AGHT+IEGKqXo1wJXp7fSChw2UcBr0IvOFDNkyZM15hPUw7XC2eSXssh3OjSs8aHcdAOPJUWA0GZHr503dVOBXTB0dA4= X-Received: by 2002:a17:903:2c8:b0:207:625:cf04 with SMTP id d9443c01a7336-208d8565119mr197671075ad.52.1727119578308; Mon, 23 Sep 2024 12:26:18 -0700 (PDT) MIME-Version: 1.0 References: <20240301155416.96960-1-juraj.linkes@pantheon.tech> <20240923150210.57269-1-juraj.linkes@pantheon.tech> <20240923150210.57269-3-juraj.linkes@pantheon.tech> In-Reply-To: <20240923150210.57269-3-juraj.linkes@pantheon.tech> From: Jeremy Spewock Date: Mon, 23 Sep 2024 15:26:07 -0400 Message-ID: Subject: Re: [PATCH v4 03/11] dts: add mechanism to skip test cases or suites To: =?UTF-8?Q?Juraj_Linke=C5=A1?= Cc: thomas@monjalon.net, Honnappa.Nagarahalli@arm.com, paul.szczepanek@arm.com, Luca.Vizzarro@arm.com, alex.chapman@arm.com, probb@iol.unh.edu, npratte@iol.unh.edu, dmarx@iol.unh.edu, dev@dpdk.org Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Mon, Sep 23, 2024 at 11:02=E2=80=AFAM Juraj Linke=C5=A1 wrote: > > If a test case is not relevant to the testing environment (such as when > a NIC doesn't support a tested feature), the framework should skip it. > The mechanism is a skeleton without actual logic that would set a test > case or suite to be skipped. > > The mechanism uses a protocol to extend test suites and test cases with > additional attributes that track whether the test case or suite should > be skipped the reason for skipping it. > > Also update the results module with the new SKIP result. > > Signed-off-by: Juraj Linke=C5=A1 > Reviewed-by: Dean Marx Reviewed-by: Jeremy Spewock