From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3D48A42606; Thu, 21 Sep 2023 15:48:00 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 14190402D2; Thu, 21 Sep 2023 15:48:00 +0200 (CEST) Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) by mails.dpdk.org (Postfix) with ESMTP id 7C820402C9 for ; Thu, 21 Sep 2023 15:47:59 +0200 (CEST) Received: by mail-oi1-f176.google.com with SMTP id 5614622812f47-3adf115ba79so633741b6e.3 for ; Thu, 21 Sep 2023 06:47:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1695304079; x=1695908879; darn=dpdk.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=nGGD0hSGmz6nB9VxahH8m7h+CQWkAivruVMY/w1rkQE=; b=fMW+4nTE4MX2zEFYF1ULk0X+j0sTHds1gaRc2QyW8iX5EziOhQFY1uuGGjUfsxlvHy CV4V4lluR1JJvQV+BdnUX1Vp8C5wkmsMNE+VvIac2qK+MTPGomD0+tDE5qs7JqsvlpNt tRKpoAOsmPdIbeSjgXAXpqMQ5lpRAr1yNZbos= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1695304079; x=1695908879; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=nGGD0hSGmz6nB9VxahH8m7h+CQWkAivruVMY/w1rkQE=; b=jZ6Fe2yH8X5/p4p7Hhuhb+Wg+xEIXERZPYUCdAQtKeiEIQN0RCWr0P9wxqAyhT7Cvt DpfnTpsVaJoVIUb5AEUsAKBzO6QT91ypuXO1pvTHudTFBdqYp4490C7ZImEYjT7dkIbt HEuFDRwnVOVP93OdtYkt3h2zglY7Wv3yrX5pFobtEcokOIU49EBZAfgsaPoXy0jkRaGx vjLlMu90JeDNmuF5aTU/ec+3K8nDbxxweouSefDgfRszf997yIl4GOSv+/mBLkIkAE0x Qitnbn8xLey6aG9Fy8DKgWSkDO2ClcgAPbyDVFJd+4NSrR2KO3Q4+N9UrX6L4BlLBHCy OWVg== X-Gm-Message-State: AOJu0Yzh5oevgA2VsudAPfaMAdFYvkf11VSkktJpRzPTBs0rfSOdSJ7P jT6nPd3oaUdfY6nCcUW2nft0+6P6sDpTawITBkyxFJGW+BkIVV+8ybo= X-Google-Smtp-Source: AGHT+IFpdRwxyIEqTX6HWLqWzwCFs3g2vRvE14vGtqzvm4xBpL64IWheXrapC1Jv5z2QnwBDQEF/g4/ypx9Z0haLlic= X-Received: by 2002:a05:6808:1912:b0:3a7:46d2:5203 with SMTP id bf18-20020a056808191200b003a746d25203mr5969918oib.51.1695304078480; Thu, 21 Sep 2023 06:47:58 -0700 (PDT) MIME-Version: 1.0 From: Patrick Robb Date: Thu, 21 Sep 2023 09:47:47 -0400 Message-ID: Subject: Community CI Meeting Minutes - September 21, 2023 To: ci@dpdk.org, dts@dpdk.org Content-Type: multipart/alternative; boundary="000000000000626ec80605debde9" X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org --000000000000626ec80605debde9 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable FYI I will be pulling some of these items into next week's CI meeting too, because due to the irregular meeting date and some people being on vacation we had low attendance, and I would like to see further discussion on some of these topics. September 21, 2023 Attendees 1. Patrick Robb 2. Lincoln Lavoie 3. Ali Alnubani 4. Juraj Linke=C5=A1 Agenda 1. General Announcements 2. CI Status 3. DTS Improvements & Test Development 4. Any other business Minutes General Announcements * DPDK Summit was Sept 12-13 * Patrick went to gov board and tech board dinners to give a lab update and talk about future plans for the lab/SOW talks * Add next-* staging branches for maintainers, like exists currently for LTS releases * =E2=80=9CTest on push=E2=80=9D function desired, like how 21.11-= staging works now? * =E2=80=9CReporting completeness=E2=80=9D by submitting PENDING to p= atchwork initially during a testrun, then overwriting later with PASS/FAIL (or similar solution also accomplishing showing reporting completeness) * Redundancy testing with other public labs? * Patrick produced a document showing what Intel lab tests which the community lab doesn=E2=80=99t: https://docs.google.com/document/d/1dDVhUFlk3DoQzf0AvyqaVYzJiCDFx5uAnU6_qbi= vxe4/edit?usp=3Dsharing * TLDR: For DTS, we have basically the same hardware and could likely add the functional tests and functional-smoke tests Intel Lab is using to our testruns. For compile testing, we mostly use the same distros, but a few gaps there can be easily bridged. The most interesting gap in compile testing is we almost exclusively compile with GCC and static library linking, whereas Intel Lab has more diversity like more extensive use of Clang than us, more extensive use of shared libraries vs static, and some use of debug build type. * Investigate testing DPDK using cloud platforms? * Honnappa asked about adding another DTS developer at the lab. This is probably possible, but it would require additional funding to the lab of course. Will have to discuss further with tech board and bring it to gov board if desired. * Poll the tech board to determine what CI testing improvements are needed in 2024 CI Status UNH-IOL Community Lab * Mellanox perf testing: * Hardware Refresh * The CX6 NIC is running with no reporting. It is testing at line rates for performance test runs with frame sizes 256-1518, but is falling below line rate for the test when run for 64B and 128B frames. * Ali is going to remote onto the testbed soon to take a look * Traffic generator may be the bottleneck - need to check this * Use trex-console with arg -rt, monitor traffic stats while DTS is running * CX7: arrived in the mail yesterday. I will install in Braum/Lucian today and setup DTS * Intel 8970 QAT Accelerator card: * Have built a custom kernel which Ampere is running now, with QAT drivers statically built in * Seg fault when echoing a VF number into (device address)/sriov_numvfs. Sent an email to arm people yesterday explaining this. * TS-Factory ethdev testsuite has been run on cx5, xl710, and E810 NICS * Per conversation with the tech board at DPDK summit * We can run this testing periodically, and will be running the full testsuite (for now, no use of the new =E2=80=9Cdial=E2=80=9D feature which = reduces the scope from 6000 testcases to a lower number) * We will publish a human readable testing report to a =E2=80=9CBubli= k=E2=80=9D website instance on our dashboard * We won=E2=80=99t be comparing current runs against previous runs to determine a pass/fail/etc based on how current runs compare to older runs. Those human cycles would better be put into DTS. * Periodic testing: next-net-intel is now added as a periodically tested branch in UNH CI Intel Lab * None Loongarch Lab * None Github Actions * None DTS Improvements & Test Development * Dperf is a new DPDK application which can act as a traffic generator. The maintainer gave a talk at DPDK Summit and Honnappa and I chatted with him about whether we can create a traffic generator subclass for dperf, as an alternative to using Trex, which currently is our only option. We should sync on this soon, although it will not be a part of 23.11 roadmap. * https://github.com/baidu/dperf * Juraj and Patrick will look more closely at this so we can have a more in depth conversation next week when Honnappa and Paul are here * Is 23.11 roadmap emailed out? * We need to hash out the details of creating a class abstracting setting packet configuration, and whether this is needed * Using scapy itself is probably most appropriate. Adding another layer is just more work and may be less stable. * How to inject ssh keys into the container running DTS? * It may be best to just bake it in from the Dockerfile, and people can just destroy the image and rebuild if they need a new key Any other business * Next meeting is September 28, 2023 * Thank you Juraj and Honnappa for presenting with me :) --000000000000626ec80605debde9 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
FYI I will be pulling some of these items into next w= eek's CI meeting too, because due to the irregular meeting date and som= e people being on vacation we had low attendance, and I would like to see f= urther discussion on some of these topics.=C2=A0

Septem= ber 21, 2023
Attendees
1. Patrick Robb
2. Lincoln Lavoie
3. Ali= Alnubani
4. Juraj Linke=C5=A1
Agenda
1. General Announcements
= 2. CI Status
3. DTS Improvements & Test Development
4. Any other = business
Minutes
General Announcements
* DPDK Summit was Sept 12-1= 3
=C2=A0 =C2=A0* Patrick went to gov board and tech board dinners to giv= e a lab update and talk about future plans for the lab/SOW talks
=C2=A0 = =C2=A0 =C2=A0 * Add next-* staging branches for maintainers, like exists cu= rrently for LTS releases
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0* =E2=80=9CTe= st on push=E2=80=9D function desired, like how 21.11-staging works now?
= =C2=A0 =C2=A0 =C2=A0 * =E2=80=9CReporting completeness=E2=80=9D by submitti= ng PENDING to patchwork initially during a testrun, then overwriting later = with PASS/FAIL (or similar solution also accomplishing showing reporting co= mpleteness)
=C2=A0 =C2=A0 =C2=A0 * Redundancy testing with other public = labs?
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0* Patrick produced a document sh= owing what Intel lab tests which the community lab doesn=E2=80=99t: https://docs.google.com/document/d/1dDVhUFlk3D= oQzf0AvyqaVYzJiCDFx5uAnU6_qbivxe4/edit?usp=3Dsharing
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0* TLDR: For DTS, we have basically the same hardware an= d could likely add the functional tests and functional-smoke tests Intel La= b is using to our testruns. For compile testing, we mostly use the same dis= tros, but a few gaps there can be easily bridged. The most interesting gap = in compile testing is we almost exclusively compile with GCC and static lib= rary linking, whereas Intel Lab has more diversity like more extensive use = of Clang than us, more extensive use of shared libraries vs static, and som= e use of debug build type.
=C2=A0 =C2=A0 =C2=A0 * Investigate testing D= PDK using cloud platforms?
=C2=A0 =C2=A0 =C2=A0 * Honnappa asked about a= dding another DTS developer at the lab. This is probably possible, but it w= ould require additional funding to the lab of course. Will have to discuss = further with tech board and bring it to gov board if desired.
=C2=A0 =C2= =A0 =C2=A0 * Poll the tech board to determine what CI testing improvements = are needed in 2024
CI Status
UNH-IOL Community Lab
* Mellanox perf= testing:
=C2=A0 =C2=A0* Hardware Refresh
=C2=A0 =C2=A0 =C2=A0 * The = CX6 NIC is running with no reporting. It is testing at line rates for perfo= rmance test runs with frame sizes 256-1518, but is falling below line rate = for the test when run for 64B and 128B frames.
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0* Ali is going to remote onto the testbed soon to take a look
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0* Traffic generator may be the bottleneck= - need to check this
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 * Use tr= ex-console with arg -rt, monitor traffic stats while DTS is running
=C2= =A0 =C2=A0 =C2=A0 * CX7: arrived in the mail yesterday. I will install in B= raum/Lucian today and setup DTS
* Intel 8970 QAT Accelerator card:
= =C2=A0 =C2=A0* Have built a custom kernel which Ampere is running now, with= QAT drivers statically built in
=C2=A0 =C2=A0 =C2=A0 * Seg fault when e= choing a VF number into (device address)/sriov_numvfs. Sent an email to arm= people yesterday explaining this.
* TS-Factory ethdev testsuite has bee= n run on cx5, xl710, and E810 NICS
=C2=A0 =C2=A0* Per conversation with = the tech board at DPDK summit
=C2=A0 =C2=A0 =C2=A0 * We can run this tes= ting periodically, and will be running the full testsuite (for now, no use = of the new =E2=80=9Cdial=E2=80=9D feature which reduces the scope from 6000= testcases to a lower number)
=C2=A0 =C2=A0 =C2=A0 * We will publish a h= uman readable testing report to a =E2=80=9CBublik=E2=80=9D website instance= on our dashboard
=C2=A0 =C2=A0 =C2=A0 * We won=E2=80=99t be comparing c= urrent runs against previous runs to determine a pass/fail/etc based on how= current runs compare to older runs. Those human cycles would better be put= into DTS.
* Periodic testing: next-net-intel is now added as a periodi= cally tested branch in UNH CI
Intel Lab
* None
Loongarch Lab
* = None
Github Actions
* None
DTS Improvements & Test Development=
* Dperf is a new DPDK application which can act as a traffic generator.= The maintainer gave a talk at DPDK Summit and Honnappa and I chatted with = him about whether we can create a traffic generator subclass for dperf, as = an alternative to using Trex, which currently is our only option. We should= sync on this soon,=C2=A0although it will not be a part of 23.11 roadmap.=C2=A0 =C2=A0* https://github.= com/baidu/dperf
=C2=A0 =C2=A0* Juraj and Patrick will look more clos= ely at this so we can have a more in depth conversation next week when Honn= appa and Paul are here
* Is 23.11 roadmap emailed out?
* We need to h= ash out the details of creating a class abstracting setting packet configur= ation, and whether this is needed
=C2=A0 =C2=A0* Using scapy itself is p= robably most appropriate. Adding another layer is just more work and may be= less stable.
* How to inject ssh keys into the container running DTS? <= br>=C2=A0 =C2=A0* It may be best to just bake it in from the Dockerfile, an= d people can just destroy the image and rebuild if they need a new key
A= ny other business
* Next meeting is September 28, 2023
* Thank you Ju= raj and Honnappa for presenting with me :)
--000000000000626ec80605debde9--