From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2ED1D438F6; Thu, 18 Jan 2024 20:59:34 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 54C9E40EDF; Thu, 18 Jan 2024 20:59:33 +0100 (CET) Received: from mail-ot1-f52.google.com (mail-ot1-f52.google.com [209.85.210.52]) by mails.dpdk.org (Postfix) with ESMTP id 76D4140E2D for ; Thu, 18 Jan 2024 20:59:31 +0100 (CET) Received: by mail-ot1-f52.google.com with SMTP id 46e09a7af769-6ddf05b1922so10146a34.2 for ; Thu, 18 Jan 2024 11:59:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1705607970; x=1706212770; darn=dpdk.org; h=cc:to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=wC8p0yUZN4O1DAzNqnLYc8d4YSRXare4UFdz2mvAffY=; b=CEeoYL/WVcvy9RmmOJRCWf8fbutQdFmeHV/+lstKw80/voDcFJmNI0Il1JEacktyl8 dcCzQrIpB11q3fxOx8+n4mRN+wJUStqgOFxvcMwqh6MbbyKnUnAhzysDoO2ppJOvCvb3 HiixACBrLc6OANBeC8W9InjNvVcYyihhn0t04= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705607970; x=1706212770; h=cc:to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=wC8p0yUZN4O1DAzNqnLYc8d4YSRXare4UFdz2mvAffY=; b=JlV4vYGsygSxcFcgiSu5ySjmYa2ocP/i4C1QU+6j16HbeWALLEZIpd4QuqBfc4cJk4 ol9CRuoSBwcCeLJuUt+zJPxMkwmuxvfxvDo/yj9AWmLPreRTdD12gRVdYm079Yfxnmgp 90EjhHoB6CS3Ztcm3bfIH2+j9rMGthMZXfzDdlHaS49uUaVMD27Q449avS91mdkoYQIT ojjEHx+kqLp3aEytNezLkDxOPdsRWxiygckp8cGp19zTQhnyJjXWL1yEYFythVm84iIF vlZOdOo7bPYpwlm9a3dT4rjttXeOWKpHT3kcKmEF8e8q25v4MHcIXlzIlCUP5Rxdny0D Lr3g== X-Gm-Message-State: AOJu0YxWY5LWjwGGhS2nEebNBSUfNElVxyDKDG/YJ/zdC03UB+CFqOrL H5xvRkCl4KMkktkvPKi5MRR4W7Tj54W1V5aqz4AqOZ95OPD6Uorx8xDbqRwV2Y5iYcamC2UJOZz 9fD/5/RWKONN2pXn5uvhFg/oWG8AHX4R88tA3HA1IP2D1YiEK7jY= X-Google-Smtp-Source: AGHT+IHpvPEW4dnvihu4rP8qzvUNEAVO8A+R298uujn3T6PaNLGNud00blabyOF12O4R3OnkVVRWzGS72QhYNYJ48TM= X-Received: by 2002:a05:6870:3041:b0:204:fca:ce23 with SMTP id u1-20020a056870304100b002040fcace23mr1321802oau.28.1705607970048; Thu, 18 Jan 2024 11:59:30 -0800 (PST) MIME-Version: 1.0 From: Patrick Robb Date: Thu, 18 Jan 2024 14:59:19 -0500 Message-ID: Subject: Community CI Meeting Minutes - January 18, 2024 To: ci@dpdk.org Cc: dts@dpdk.org, dev@dpdk.org Content-Type: multipart/alternative; boundary="0000000000002e5f5d060f3dcd7e" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --0000000000002e5f5d060f3dcd7e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable January 18, 2024 ##################################################################### Attendees 1. Lincoln Lavoie 2. Thomas Monjalon 3. Aaron Conole 4. Jeremy Spewock 5. Paul Szczepanek 6. Ali Alnubani 7. Juraj Linke=C5=A1 ##################################################################### Minutes =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D General Announcements * First 2024 DTS WG meeting was held yesterday, and the minutes are here: https://docs.google.com/document/d/1pG_NGuwYgPuovwIfhvcs9u8PNYIJuInsFr0GeTU= IU4k/edit?usp=3Dsharing * Patrick Robb will publish the meeting minutes =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D CI Status --------------------------------------------------------------------- UNH-IOL Community Lab * Octeon CN106XX: Patrick worked with Hiral this week about the process for SDK rebuild. This will have to happen regularly, but we now have a VM setup which will serve as the place to rebuild SDK and act as TFTP server for the Octeon board. * After that we need to iron out switching rootfs to ubuntu, setting up DTS on the tester, validating this works fine in a CI context (Phanendra from Marvell has approved of the concept). * The Intel server arrived in the mail yesterday. We will mount the system this week and begin setup. As a reminder this now unblocks: * E810 testing for Intel * Traffic gen for the CX7 testing (this server will act as TG) * Traffic gen for the Octeon CN106xx board * The new create dpdk artifact for ci testing script is in production at UNH, and Adam is submitting the V3 patchseries for this to dpdk-ci today * There is an update from the patchwork maintainer about supporting Depends-on via patchwork. I encourage everyone to read his full thoughts on the issue below, but shorthand conclusions are: * He prefers to only support Depends-on on a series basis, not a series or patch basis. * Patrick will update the CI testing thread on this topic, but this may require the DPDK community agreeing to a new approach. From looking through the dev mailing list, it seems that series dependency is the typical use, but there are also some examples of developers using patch dependency. * Keep the same syntax which allows for depends-on: patch, but in reality translate this to depends on that patch=E2=80=99s series * He will need some help for the effort. We can ping the DPDK community to look for volunteers. Or, it can possibly become a community ask for development at the DPDK Community Lab. Looking at it at a high level I don=E2=80=99t think the scope will be too bad. * Full thread: https://github.com/getpatchwork/git-pw/issues/71 * Arm-Ampere still needs a kernel rebuild for the QAT card * Standing up ts-factory testing framework * Adam did the first cx-5 run on an ARM system, and will do an Intel XL710 run on an ARM system today. Both will be published on Oktet Lab=E2=80= =99s Bublik for review. * Unlike our ARM testbeds, our x86 servers are single server TG/DUT testbeds, which breaks an assumption in ts-factory. My view on how to proceed is bring testing online with what works now (arm), then review the value with the community, and choose a strategy for x86 based on what we learn from running this at the lab. * Andrew from Oktet labs has added some missing components to GitHub for the data visualization tool (Bublik), and has finished categorizing the tests for the XL710 and the expected results for that NIC * Old DTS patches: * We noticed that as DPDK has grown, the compile time also increases and the old compile timeout for the DUT is no longer valid on some slower systems. Jeremy will submit a patch extending the timeout. * Once the cx7 is online, patrick will submit the patch adding the cx6 and cx7 to the NIC registry in DTS * Lincoln saw the email thread about DPDK failing to build on FreeBSD 14. We are only testing FreeBSD 13 in the lab right now, so we will add coverage for 14. --------------------------------------------------------------------- Intel Lab * John says there is still no new person who can act as a contact. There have been further staffing changes at Intel, so it may be hard to get a contact soon, but Patrick will keep asking. --------------------------------------------------------------------- Github Actions * Cirrus CI: Adding support for this to the 0 day robot. Aaron submitted a patch for polling for Cirrus ci status in ovs. * They are getting a server to migrate the VM over to, so there should be minimal downtime associated with the hardware moving from Westford to another state. --------------------------------------------------------------------- Loongarch Lab * None =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D DTS Improvements & Test Development * scapy/templated yaml for tests: * One motivation is for making writing simple tests in minimal time (like 3 minutes). Should we aim for a target of writing a testsuite in minutes, not hours? * Testing is broken down into phases, and you simply write in the raw scapy commands or values to pass to testpmd * At the end, compare output string to an expected output string written in the YAML * Is it possible to get the best of both worlds? We can try to remain with python only, but use python annotations and assign python to TG, DUT commands etc. * Gregory also splits the configuration of platform and test configuration. * We should draw up a =E2=80=9Cpseudo=E2=80=9D version of this structure= d test setup via python, and review as a group * If we can draw this up we can compare against a currently written test (like Jeremy=E2=80=99s scatter test), and then we will have a practica= l example of the effort difference between the two approaches. * The API will evolve over time - for drawing up an example, we can make up whatever we want * By using a templating system (or some python =E2=80=9Csyntactic sugar= =E2=80=9D), we may remove some of the boilerplate overhead form writing a suite - possibly a major value for making writing testsuites easier. * Obviously this all needs to be documented. * Paul: It may be a good approach to have a few more people write at least one testsuite according to the current approach. Then, we use these new tests to guide the creation of the =E2=80=9Cnew=E2=80=9D approach. Hope= fully we learn what works, what needs to be improved and refactored out into the framework - pre-proving the validity of the new approach. * All DTS people will try to workshop next week to investigate what a new approach would look like in concrete terms. * DTS group will go through all the new Bugzilla tickets at the next DTS meeting. * Jeremy has volunteered to at least one during this release: * https://bugs.dpdk.org/show_bug.cgi?id=3D1359 =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Any other business * Next Meeting: February 1, 2024 --0000000000002e5f5d060f3dcd7e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
January 18, 2024

##################################= ###################################
Attendees
1. Lincoln Lavoie
2.= Thomas Monjalon
3. Aaron Conole
4. Jeremy Spewock
5. Paul Szczepa= nek
6. Ali Alnubani
7. Juraj Linke=C5=A1

#####################= ################################################
Minutes

=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
General Announcement= s
* First 2024 DTS WG meeting was held yesterday, and the minutes are he= re: https://docs.google.com/document/d/= 1pG_NGuwYgPuovwIfhvcs9u8PNYIJuInsFr0GeTUIU4k/edit?usp=3Dsharing
=C2= =A0 =C2=A0* Patrick Robb will publish the meeting minutes
=C2=A0 =C2=A0<= br>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
CI Status
---------------------------------------------------------------------=
UNH-IOL Community Lab
* Octeon CN106XX: Patrick worked with Hiral th= is week about the process for SDK rebuild. This will have to happen regular= ly, but we now have a VM setup which will serve as the place to rebuild SDK= and act as TFTP server for the Octeon board.
=C2=A0 =C2=A0* After that = we need to iron out switching rootfs to ubuntu, setting up DTS on the teste= r, validating this works fine in a CI context (Phanendra from Marvell has a= pproved of the concept).
* The Intel server arrived in the mail yesterda= y. We will mount the system this week and begin setup. As a reminder this n= ow unblocks:
=C2=A0 =C2=A0* E810 testing for Intel
=C2=A0 =C2=A0* Tra= ffic gen for the CX7 testing (this server will act as TG)
=C2=A0 =C2=A0*= Traffic gen for the Octeon CN106xx board
* The new create dpdk artifact= for ci testing script is in production at UNH, and Adam is submitting the = V3 patchseries for this to dpdk-ci today
* There is an update from the p= atchwork maintainer about supporting Depends-on via patchwork. I encourage = everyone to read his full thoughts on the issue below, but shorthand conclu= sions are:
=C2=A0 =C2=A0* He prefers to only support Depends-on on a ser= ies basis, not a series or patch basis.
=C2=A0 =C2=A0 =C2=A0 * Patrick w= ill update the CI testing thread on this topic, but this may require the DP= DK community agreeing to a new approach. From looking through the dev maili= ng list, it seems that series dependency is the typical use, but there are = also some examples of developers using patch dependency.
=C2=A0 =C2=A0 = =C2=A0 * Keep the same syntax which allows for depends-on: patch, but in re= ality translate this to depends on that patch=E2=80=99s series
=C2=A0 = =C2=A0* He will need some help for the effort. We can ping the DPDK communi= ty to look for volunteers. Or, it can possibly become a community ask for d= evelopment at the DPDK Community Lab. Looking at it at a high level I don= =E2=80=99t think the scope will be too bad.
=C2=A0 =C2=A0* Full thread: = https://github= .com/getpatchwork/git-pw/issues/71
* Arm-Ampere still needs a kernel= rebuild for the QAT card
* Standing up ts-factory testing framework
= =C2=A0 =C2=A0* Adam did the first cx-5 run on an ARM system, and will do an= Intel XL710 run on an ARM system today. Both will be published on Oktet La= b=E2=80=99s Bublik for review.
=C2=A0 =C2=A0* Unlike our ARM testbeds, o= ur x86 servers are single server TG/DUT testbeds, which breaks an assumptio= n in ts-factory. My view on how to proceed is bring testing online with wha= t works now (arm), then review the value with the community, and choose a s= trategy for x86 based on what we learn from running this at the lab.
= =C2=A0 =C2=A0* Andrew from Oktet labs has added some missing components to = GitHub for the data visualization tool (Bublik), and has finished categoriz= ing the tests for the XL710 and the expected results for that NIC
* Old = DTS patches:
=C2=A0 =C2=A0* We noticed that as DPDK has grown, the comp= ile time also increases and the old compile timeout for the DUT is no longe= r valid on some slower systems. Jeremy will submit a patch extending the ti= meout.
=C2=A0 =C2=A0* Once the cx7 is online, patrick will submit the pa= tch adding the cx6 and cx7 to the NIC registry in DTS
* Lincoln saw the = email thread about DPDK failing to build on FreeBSD 14. We are only testing= FreeBSD 13 in the lab right now, so we will add coverage for 14.

--= -------------------------------------------------------------------
Inte= l Lab
* John says there is still no new person who can act as a contact.= There have been further staffing changes at Intel, so it may be hard to ge= t a contact soon, but Patrick will keep asking.

--------------------= -------------------------------------------------
Github Actions
* Ci= rrus CI: Adding support for this to the 0 day robot. Aaron submitted a patc= h for polling for Cirrus ci status in ovs.
* They are getting a server = to migrate the VM over to, so there should be minimal downtime associated w= ith the hardware moving from Westford to another state.

------------= ---------------------------------------------------------
Loongarch Lab<= br>* None

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
DTS Improvements & Test Development
* scapy/templated yaml for t= ests:
=C2=A0 =C2=A0* One motivation is for making writing simple tests i= n minimal time (like 3 minutes). Should we aim for a target of writing a te= stsuite in minutes, not hours?
=C2=A0 =C2=A0* Testing is broken down in= to phases, and you simply write in the raw scapy commands or values to pass= to testpmd
=C2=A0 =C2=A0* At the end, compare output string to an expec= ted output string written in the YAML
=C2=A0 =C2=A0* Is it possible to g= et the best of both worlds? We can try to remain with python only, but use = python annotations and assign python to TG, DUT commands etc.
=C2=A0 = =C2=A0* Gregory also splits the configuration of platform and test configur= ation.
=C2=A0 =C2=A0* We should draw up a =E2=80=9Cpseudo=E2=80=9D vers= ion of this structured test setup via python, and review as a group
=C2= =A0 =C2=A0 =C2=A0 * If we can draw this up we can compare against a current= ly written test (like Jeremy=E2=80=99s scatter test), and then we will have= a practical example of the effort difference between the two approaches.=C2=A0 =C2=A0 =C2=A0 * The API will evolve over time - for drawing up an = example, we can make up whatever we want
=C2=A0 =C2=A0* By using a templ= ating system (or some python =E2=80=9Csyntactic sugar=E2=80=9D), we may rem= ove some of the boilerplate overhead form writing a suite - possibly a majo= r value for making writing testsuites easier.
=C2=A0 =C2=A0* Obviously t= his all needs to be documented.
=C2=A0 =C2=A0* Paul: It may be a good a= pproach to have a few more people write at least one testsuite according to= the current approach. Then, we use these new tests to guide the creation o= f the =E2=80=9Cnew=E2=80=9D approach. Hopefully we learn what works, what n= eeds to be improved and refactored out into the framework - pre-proving the= validity of the new approach.
=C2=A0 =C2=A0* All DTS people will try to= workshop next week to investigate what a new approach would look like in c= oncrete terms.
=C2=A0 =C2=A0* DTS group will go through all the new Bugz= illa tickets at the next DTS meeting.
=C2=A0 =C2=A0 =C2=A0 * Jeremy has= volunteered to at least one during this release:
=C2=A0 =C2=A0 =C2=A0 *= https://bugs.dpdk= .org/show_bug.cgi?id=3D1359
=C2=A0 =C2=A0 =C2=A0
=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
Any other business
* Next = Meeting: February 1, 2024
--0000000000002e5f5d060f3dcd7e--