From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 78FFB43902; Fri, 19 Jan 2024 21:01:17 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5ECA9427E2; Fri, 19 Jan 2024 21:01:17 +0100 (CET) Received: from mail-oo1-f41.google.com (mail-oo1-f41.google.com [209.85.161.41]) by mails.dpdk.org (Postfix) with ESMTP id 5ACA74029F for ; Fri, 19 Jan 2024 21:01:16 +0100 (CET) Received: by mail-oo1-f41.google.com with SMTP id 006d021491bc7-59938699589so558967eaf.3 for ; Fri, 19 Jan 2024 12:01:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1705694475; x=1706299275; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=8Cas8+YyssTDoC+yJSquHQ4EmAD5CFWKFFIyYGUodfY=; b=HUXBq72hv0XJweUDQnAsK3JCVAGSUsGkaMoL1u/18dMa3NiU34P8eFj/F4N42v/3gT z1uUsRgrWqnMVwgqHY8ZJxvcO4cUJedoj3nig3nwMXgYamWn2INwMT4a5dEnvwpF+7wC 1NaBAmWSXfKqMM1DejpXB9WKtDK41Ap0N+EbY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705694475; x=1706299275; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=8Cas8+YyssTDoC+yJSquHQ4EmAD5CFWKFFIyYGUodfY=; b=Vul9RwMG3ya3L7z5Yeo28+/G9qAuX2a0bqcdzteWZz+Zqd2vKDY65K5xa6M6vA6xSV v2gBbnahkf5FCrSHCSsgH3e1pjpj4hQdyxmYtdENtljHalNepTpQ4an3ncu7WAXouNsp BTKcQ3R2D2dIalTTcL4i68YlJLwBWcJwMSZP3MBzhFWJ0Ypv8zrOsn5JeNY4Ljy+nbPE TsVVNPhSdxyaLYGTXzOlag/le8W1ULompGdaOJBgjIZuUc0VsJKISyp1+mUxcZo2D4UR ImEHRn2UYiyvb+347bckpEK6g2OWetpGD3e05P4Zh7crAQDGlLOHVwC1w+5ZA+fLnpuE jC2Q== X-Gm-Message-State: AOJu0YxbjV6rSU5lq4a0I/66kxUBqyYZ/dHXIfCLJb+Jo+/iiPlxno0j uwsONZw/kIOOu5WWrSiNsw7ni/ZNo0ksZ9Lm5Pe5TtI/O/4ysmP7l781/xML3a/6BSub+zBwB1V c8UuYN86UDWRn4vkx+lT0qXpBpdZuIWYdK/Mm3g== X-Google-Smtp-Source: AGHT+IHmH6FNc22+FsAvEadmyMgxCdUuM10r8gG04nT1dnKVekB3ne3uXE4cyU3x6ehDiPY849xDsM6Q+MzX9E5iQMI= X-Received: by 2002:a4a:e747:0:b0:599:430c:616a with SMTP id n7-20020a4ae747000000b00599430c616amr240667oov.3.1705694474022; Fri, 19 Jan 2024 12:01:14 -0800 (PST) MIME-Version: 1.0 References: <2a287ee7-cda4-f2ab-a4e6-a47021f8573f@nvidia.com> <377a847b-7be4-bda7-9020-173b2ca5bc92@nvidia.com> In-Reply-To: From: Patrick Robb Date: Fri, 19 Jan 2024 15:01:03 -0500 Message-ID: Subject: Re: DTS testpmd and SCAPY integration To: =?UTF-8?Q?Juraj_Linke=C5=A1?= Cc: Honnappa Nagarahalli , "Etelson, Gregory" , "thomas@monjalon.net" , Paul Szczepanek , Luca Vizzarro , Yoan Picchi , Jeremy Spewock , "ci@dpdk.org" , "dev@dpdk.org" , nd , Asaf Penso , Maayan Kashani Content-Type: multipart/alternative; boundary="0000000000003845e9060f51f1bd" X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org --0000000000003845e9060f51f1bd Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Thanks for summarizing Juraj. As we discussed at the CI meeting yesterday, we should get together next week to workshop some rough testsuites based on the ideas which have been proposed above, and discussed in the DTS meeting and CI testing meeting. Just to get something on the calendar I scheduled a zoom for next wednesday at 2pm UTC, but yall let me know if you prefer something different. All are welcome of course. https://unh.zoom.us/j/94747183133 On Thu, Jan 18, 2024 at 7:32=E2=80=AFAM Juraj Linke=C5=A1 wrote: > Hi folks, > > Let me summarize the yesterday's discussion in a few keys points: > > - Greg's proposal aims at simplicity and is useful mainly for test > cases which can be written in a few minutes. More complex test cases a= re > not suitable for the YAML approach. > - The above implies that the YAML based test cases would be supported > alongside the existing approach. This fast way to implement simple tes= t > cases would likely be a valuable addition. > - The big picture idea behind the YAML test cases is to take an > application with interactive input, send commands, collect output and > compare the output with expected string(s). > - Greg may be able to make the code available and may assess how to > integrate it with DTS. > > Regards, > Juraj > > On Mon, Jan 8, 2024 at 6:36=E2=80=AFPM Honnappa Nagarahalli < > Honnappa.Nagarahalli@arm.com> wrote: > >> >> >> > >> > Hello Honnappa, >> > >> > [snip] >> > >> > > Hi Gregory, >> > > I do not fully understand your proposal, it will be helpful t= o >> join the DTS >> > meetings to discuss this further. >> > > >> > >> > Agree, let's discuss the proposal details during the DTS meeting. >> > >> > > YAML has wide support built around it. By using our own text format, >> we will >> > have to build the parsing support etc ourselves. >> > > >> > > However, YAML is supposed to be easy to read and understand. Is it >> just a >> > matter for getting used to it? >> > > >> > >> > I selected YAML for 2 reasons: >> > * Plain and intuitive YAML format minimized test meta data. >> > By the meta data I refer to control tags and markup characters >> > that are not test commands. >> > * YAML has Python parser. >> I have mis-understood your proposal. I agree with your above comments. >> +1 for the proposal. >> >> > >> > Regards, >> > Gregory >> > >> > >> >> --=20 Patrick Robb Technical Service Manager UNH InterOperability Laboratory 21 Madbury Rd, Suite 100, Durham, NH 03824 www.iol.unh.edu --0000000000003845e9060f51f1bd Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Thanks for summarizing Juraj.

As we dis= cussed at the CI meeting yesterday, we should get together next week to wor= kshop some rough testsuites based on the ideas which have been proposed abo= ve, and discussed in the DTS meeting and CI testing meeting.=C2=A0

Just to get something on the calendar=C2=A0I scheduled a z= oom for next wednesday at 2pm UTC, but yall let me know if you prefer somet= hing different. All are welcome of course.=C2=A0

<= a href=3D"https://unh.zoom.us/j/94747183133" id=3D"gmail-ow1101" style=3D"f= ont-family:Roboto,Helvetica,Arial,sans-serif;font-size:14px;background-colo= r:rgb(241,243,244)">https://unh.zoom.us/j/94747183133


On Thu, Jan 18, 2024 at 7:32=E2=80=AFAM Juraj Linke= =C5=A1 <juraj.linkes@pantheon.tech> wrote:
Hi folks,

<= div>Let me summarize the yesterday's discussion in a few keys points:
  • Greg's proposal aims at simplicity and is useful mainl= y for test cases which can be written in a few minutes. More complex test c= ases are not suitable for the YAML approach.
  • The above implies=C2= =A0that the YAML based test cases would be supported alongside the existing= approach. This fast way to implement simple test cases would likely be a v= aluable addition.
  • The big picture idea behind the YAML test cas= es is to take an application with interactive input, send commands, collect= output and compare the output with expected string(s).
  • Greg may be= able to make the code available and may assess how to integrate it with DT= S.
Regards,
Juraj

On Mon, Jan 8, 2024 = at 6:36=E2=80=AFPM Honnappa Nagarahalli <Honnappa.Nagarahalli@arm.com> wro= te:
<snip>=

>
> Hello Honnappa,
>
> [snip]
>
> > Hi Gregory,
> >=C2=A0 =C2=A0 =C2=A0 =C2=A0 I do not fully understand your proposa= l, it will be helpful to join the DTS
> meetings to discuss this further.
> >
>
> Agree, let's discuss the proposal details during the DTS meeting.<= br> >
> > YAML has wide support built around it. By using our own text form= at, we will
> have to build the parsing support etc ourselves.
> >
> > However, YAML is supposed to be easy to read and understand. Is i= t just a
> matter for getting used to it?
> >
>
> I selected YAML for 2 reasons:
>=C2=A0 =C2=A0 * Plain and intuitive YAML format minimized test meta dat= a.
>=C2=A0 =C2=A0 =C2=A0 By the meta data I refer to control tags and marku= p characters
>=C2=A0 =C2=A0 =C2=A0 that are not test commands.
>=C2=A0 =C2=A0 * YAML has Python parser.
I have mis-understood your proposal. I agree with your above comments.
+1 for the proposal.

>
> Regards,
> Gregory
>
>



--

Patrick Robb

<= span style=3D"font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-= color:transparent;vertical-align:baseline;white-space:pre-wrap">Technical S= ervice Manager

UNH InterOperability Laboratory

21 Madbury Rd, Suite 100, Durham, NH 03824

www.iol.unh.edu


--0000000000003845e9060f51f1bd--