From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id CF21A438F3; Thu, 18 Jan 2024 13:32:54 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C767842D45; Thu, 18 Jan 2024 13:32:54 +0100 (CET) Received: from mail-ej1-f51.google.com (mail-ej1-f51.google.com [209.85.218.51]) by mails.dpdk.org (Postfix) with ESMTP id 12BFA40295 for ; Thu, 18 Jan 2024 13:32:51 +0100 (CET) Received: by mail-ej1-f51.google.com with SMTP id a640c23a62f3a-a2f22bfb4e6so54826966b.0 for ; Thu, 18 Jan 2024 04:32:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=pantheon.tech; s=google; t=1705581171; x=1706185971; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Mg+xWpBfozVcMt09QJ/TLmWkyS1glaeVmCZKp1RNTIM=; b=swXYT2YAgvLB1NOn3E3eUEx041EPTxoj37JeFb2Pe+zHRWjwKrhvhAdJWsbkskYSVS SWs05v3PE1TOJeXcOG0YPKG0HI6dI4itICZuFGw05JJkqNvnZWuhjABdf1YsdhMAj9Ah aXgbOMf0n/6+IhuI8voMSockjC+Zs0rzaDKDAzWIOmzqikib81UJlMMmCFveqArsMtOt MYJc0EzBVZ4OIPrHC2xZrCIiggcrgDs/K/hu1dJuwLRAcW+LDZlJ/L26EEDc4AqcdB2q Dfc17LUm8qaxrdn4aIFloch5upmXdF/w7G9IoNOQRco/toxSp7TbGrs1ZDE6KJ5M8Ke9 d/mw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705581171; x=1706185971; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Mg+xWpBfozVcMt09QJ/TLmWkyS1glaeVmCZKp1RNTIM=; b=CdO6RPYk1ccht7be2NOhVX/SZDB3BrrC7G21l/PwiYT/uQlEIDnrQTW3Zb6WqwmYB0 TBO9SQ9e+vnm4PaFd+n0Lfa2EorxVDKi6bnqXBrEm/r1zY/340FRab4SR9Qlkx00/rgJ JRYq985dwDycgK3lOMIaOs/0/vGOAeI05zKC44Q+xhlWVsz/DHf5pj4xCDbKxeEjbUdK zfTlueC4pra3DY497rIeHvSYdbT1ChUp9c08qvp0oz4WXqfo5pK2BimdrCtxYzWjqcVj PS78RofjQfOzbUS/UQ6FeAwzieX7uvLfVUUhcJjBPgpuvLEBJfDRdBrILqtZ90DoZY/u +9zA== X-Gm-Message-State: AOJu0Yzeu5Y8xW3NoxGhFP5YWlem0OxdWOxuCfmStfQGTwcoWenECXYE qs1SdUOLW44/U3N4cvzIY3P1+M3k3GibbQyPVtdDF03KTqilF9BRAEvIHUpsOUnQcnV9G1hQn2T IgKprXk3BENSv/oDXX2XgG8UI/hCeynusIlNmOg== X-Google-Smtp-Source: AGHT+IGapJzh/SbFr7uCXTCc12dPR0Emr5Fz2qt5MQ9YU54/f4NG3UAvcDJtEzh4EbO7Nk6dBEbBDGSXYDtXaayohhI= X-Received: by 2002:a17:907:78c7:b0:a2c:b5a1:f8 with SMTP id kv7-20020a17090778c700b00a2cb5a100f8mr499225ejc.37.1705581170835; Thu, 18 Jan 2024 04:32:50 -0800 (PST) MIME-Version: 1.0 References: <2a287ee7-cda4-f2ab-a4e6-a47021f8573f@nvidia.com> <377a847b-7be4-bda7-9020-173b2ca5bc92@nvidia.com> In-Reply-To: From: =?UTF-8?Q?Juraj_Linke=C5=A1?= Date: Thu, 18 Jan 2024 13:32:39 +0100 Message-ID: Subject: Re: DTS testpmd and SCAPY integration To: Honnappa Nagarahalli Cc: "Etelson, Gregory" , "thomas@monjalon.net" , Paul Szczepanek , Luca Vizzarro , Yoan Picchi , Jeremy Spewock , Patrick Robb , "ci@dpdk.org" , "dev@dpdk.org" , nd , Asaf Penso , Maayan Kashani Content-Type: multipart/alternative; boundary="000000000000d2d8d2060f378f16" X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org --000000000000d2d8d2060f378f16 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi folks, Let me summarize the yesterday's discussion in a few keys points: - Greg's proposal aims at simplicity and is useful mainly for test cases which can be written in a few minutes. More complex test cases are not suitable for the YAML approach. - The above implies that the YAML based test cases would be supported alongside the existing approach. This fast way to implement simple test cases would likely be a valuable addition. - The big picture idea behind the YAML test cases is to take an application with interactive input, send commands, collect output and compare the output with expected string(s). - Greg may be able to make the code available and may assess how to integrate it with DTS. Regards, Juraj On Mon, Jan 8, 2024 at 6:36=E2=80=AFPM Honnappa Nagarahalli < Honnappa.Nagarahalli@arm.com> wrote: > > > > > > Hello Honnappa, > > > > [snip] > > > > > Hi Gregory, > > > I do not fully understand your proposal, it will be helpful to > join the DTS > > meetings to discuss this further. > > > > > > > Agree, let's discuss the proposal details during the DTS meeting. > > > > > YAML has wide support built around it. By using our own text format, > we will > > have to build the parsing support etc ourselves. > > > > > > However, YAML is supposed to be easy to read and understand. Is it > just a > > matter for getting used to it? > > > > > > > I selected YAML for 2 reasons: > > * Plain and intuitive YAML format minimized test meta data. > > By the meta data I refer to control tags and markup characters > > that are not test commands. > > * YAML has Python parser. > I have mis-understood your proposal. I agree with your above comments. > +1 for the proposal. > > > > > Regards, > > Gregory > > > > > > --000000000000d2d8d2060f378f16 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi folks,

Let me summarize the yesterda= y's discussion in a few keys points:
  • Greg's propo= sal aims at simplicity and is useful mainly for test cases which can be wri= tten in a few minutes. More complex test cases are not suitable for the YAM= L approach.
  • The above implies=C2=A0that the YAML based test cases w= ould be supported alongside the existing approach. This fast way to impleme= nt simple test cases would likely be a valuable addition.
  • The b= ig picture idea behind the YAML test cases is to take an application with i= nteractive input, send commands, collect output and compare the output with= expected string(s).
  • Greg may be able to make the code available an= d may assess how to integrate it with DTS.
Regards,
Juraj

On Mon, Jan 8, 2024 at 6:36=E2=80=AFPM Honnappa Nagarahal= li <Honnappa.Nagarahalli= @arm.com> wrote:
<snip>

>
> Hello Honnappa,
>
> [snip]
>
> > Hi Gregory,
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 I do not fully understand your proposa= l, it will be helpful to join the DTS
> meetings to discuss this further.
> >
>
> Agree, let's discuss the proposal details during the DTS meeting.<= br> >
> > YAML has wide support built around it. By using our own text form= at, we will
> have to build the parsing support etc ourselves.
> >
> > However, YAML is supposed to be easy to read and understand. Is i= t just a
> matter for getting used to it?
> >
>
> I selected YAML for 2 reasons:
>=C2=A0 =C2=A0 * Plain and intuitive YAML format minimized test meta dat= a.
>=C2=A0 =C2=A0 =C2=A0 By the meta data I refer to control tags and marku= p characters
>=C2=A0 =C2=A0 =C2=A0 that are not test commands.
>=C2=A0 =C2=A0 * YAML has Python parser.
I have mis-understood your proposal. I agree with your above comments.
+1 for the proposal.

>
> Regards,
> Gregory
>
>

--000000000000d2d8d2060f378f16--