From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4BD58A0546 for ; Fri, 19 Feb 2021 14:59:32 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 1379D160924; Fri, 19 Feb 2021 14:59:32 +0100 (CET) Received: from mail-ej1-f41.google.com (mail-ej1-f41.google.com [209.85.218.41]) by mails.dpdk.org (Postfix) with ESMTP id 09BBB16091E for ; Fri, 19 Feb 2021 14:59:30 +0100 (CET) Received: by mail-ej1-f41.google.com with SMTP id g5so13510283ejt.2 for ; Fri, 19 Feb 2021 05:59:29 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; h=mime-version:from:date:message-id:subject:to; bh=cA6SxgfyHJIi3ledLO1xisXcL/k5AxFkM85ml+R2MPQ=; b=hmQRznFwGK2noVPGTk1IU7bSpUvHjLAxMBpmMMErrd+Z0vGOy9yPGYpzJgHdpZJMju qZNCV72ZaJc0GdG/jqp+bAKd4Z21R/JKN0KTopjlE191kOzPs7kEZZdkrnOeSRwigL+J 1kesv8TUYQ6PyBRHvfEKrw35Y7b0rn0j55uco= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=cA6SxgfyHJIi3ledLO1xisXcL/k5AxFkM85ml+R2MPQ=; b=b1XHbHpz5gfrP+4XSonVbftYmn7sN4dkKeC23F0LN2vAs4IW5GIv6S93fhmkbLTrW3 2gzXJ9D16yjYtbp5t5jA+bcDSHqGjU7hamaR1/+C1SguYA7OwF4Nk6WG903Lwtukvk9s SvP2MNR2IqMZ9nym1vQtYfAzrqhZLqOplHe07abTNG4DaF6LQAkvM9VfEkIXZtWLioSs qcmJWGlJr5S2T9StGZseFZ7c2tcO7HHq+qe/TBdNMYERuK2Xq0T5TlA4iTRncJLXihVj P1UIjAnJFkbPtIi74O8WHuy/y2FkmOABzxjoe+XxdlxPLak0+vGBV/wfaKqNgpW0N+kG PXhg== X-Gm-Message-State: AOAM5304aZhe/6+0Nkm5DaGFH1eYw1B8QyNAsGmZ9ngmRCmFajFOBS+5 F93PtP5QByA5cNuAuxFbLpTbpWKAe+aSUoFTl56ImM3XDeMx+A== X-Google-Smtp-Source: ABdhPJytoFRuhWmmzEIjdTSRelBrqM2DtbnA+EQXncZe7PSQ8pBmNqdMXwZQPaWgLaUuc5A7ToPXoDSwck3r+vbY5ZM= X-Received: by 2002:a17:907:20ec:: with SMTP id rh12mr8625917ejb.282.1613743169177; Fri, 19 Feb 2021 05:59:29 -0800 (PST) MIME-Version: 1.0 From: Lincoln Lavoie Date: Fri, 19 Feb 2021 08:57:00 -0500 Message-ID: To: ci@dpdk.org Content-Type: multipart/alternative; boundary="0000000000005ba46f05bbb0dc3e" Subject: [dpdk-ci] Community CI Meeting Minute - February 18, 2021 X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org Sender: "ci" --0000000000005ba46f05bbb0dc3e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable February 18, 2021 ############################################################# Attendees 1. Lincoln Lavoie 2. Brandon Lo 3. Thomas Monjalon 4. Lijuan Tu 5. Ali Alnubani 6. David Liu 7. Juraj Linke=C5=A1 8. Michael Santana 9. Tomasz Zawadzki 10. Michael Santana 11. Owen Hilyard ############################################################# Agenda 1. CI Status 2. Bugzilla Status 3. Test Development 4. Any other business ############################################################# Minutes =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D CI Status ------------------------------------------------------------- UNH-IOL Community CI Lab * SPDK was failing due to changes in DPDK / SPDK and new dependence on vhost. Vhost has been enabled and is now in production. * ABI Reference - Needs to be updated to 21.02 release - this will be handled today. * Performance and functional testing for Intel and Mellanox NICs on aarch64 are now running and should be stable, working on bringing Broadcom 25G NIC online. * Containers for RHEL7 and RHEL8 have been created, working on getting these into production. This is being done as part of a larger effort to move as many of the compile / unit test jobs into containers as possible, which will allow for more =E2=80=9Cworkers.=E2=80=9D The goal is to keep t= he backlog of the compile and unit testing as short as possible. Need to look into c-cache enabled for the containers via an external mount / volume. * Completed development on pipeline changes for the performance and functional testing (i.e. hardware dependent testing), that will leverage the patch categorization contribution submitted to dpdk-ci. This is intended to allow for more targeted testing, i.e. on test and build what is necessary. Note, this dpdk-ci patch still needs review and merge. * Update so failures on the dashboard that are not the main compilation test cases (i.e. downstream projects) will show up as a warning (orange, not red). This is not yet deployed in production * Performance test emails now send out percent differences instead of raw value differences. Question to the group, do you want this change on the stats (grafana instances as well)? * Upcoming maintenance - Lab will send out notices to the dpdk-ci as this work happens, etc. * Migration to the containers - planning to migrate one job at a time (i.e. swapping to containers one at a time). * Migration to the new pipeline structure for hardware dependent testing. This will require some down time (stop new jobs from starting), for the migration. That will only impact the functional / performance testing. ------------------------------------------------------------- Intel Lab * Working on a change to allow systems to continue to run test cases for systems where the build succeeds, dropping / stopping only on the systems where the build failed. This will probably be ready in the next two weeks. ------------------------------------------------------------- Travis / Github Actions / OBS * GitHub Actions & Travis * Reports should now be flowing, we've pushed the latest set of scripts to the pw-ci repo * ARM folks worked out a deal with the travis people and we have credits to run the DPDK jobs on travis-ci, so they are going * Currently, some jobs are intermittently failing due to a bad version.map file - see http://mails.dpdk.org/archives/dev/2021-February/199761.html * OBS * We have a few mechanisms now to declare branches as no longer needed, so we will use those to clear branch status on the OBS builds. * Plan is to adapt the OBS scripts to the rest of the pw-ci framework. Maybe 3 weeks time. * "Pw-ci" * Bigger question about whether to fold all of pw-ci into the dpdk CI scripts and abandon the pw-ci repo we have. That's a separate discussion, really, but it might make sense since it includes scripts to detect changes on patchwork, submit to different CI backends (like jenkins, obs, travis, etc.), poll status, and report that status. * Group wants to move the discussion over to the dpdk ci mailing list. Lincoln will send out a mail to kick things off. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Bugzilla Status * https://bugs.dpdk.org/buglist.cgi?bug_status=3DUNCONFIRMED&bug_status=3DCON= FIRMED&bug_status=3DIN_PROGRESS&columnlist=3Dproduct%2Ccomponent%2Cpriority= %2Cbug_status%2Cassigned_to%2Cshort_desc%2Cchangeddate&component=3Djob%20sc= ripts&component=3DUNH%20infra&component=3DIntel%20Lab&component=3DTravis%20= CI&list_id=3D3419&order=3Dpriority%2Cchangeddate%20DESC&product=3Dlab&query= _format=3Dadvanced&resolution=3D--- * Reviewed and updated bugs in bugzilla. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Test Development * Aaron, Trishan, and Lincoln are working to finalize the 2021 priorities and should have that list available to this group for the next meeting. =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Any other business * Next Meeting: February 25, 2021, then 2 weeks after that (back to the original schedule) * Patchworks is going to be updated on Sunday, February 21, at 4am PST. It will be down for a few minutes during this time. * Performance testing failures - change to failure if fluctuation is larger than x%. Should open a bug for this, Ali will do the first write up. --=20 *Lincoln Lavoie* Principal Engineer, Broadband Technologies 21 Madbury Rd., Ste. 100, Durham, NH 03824 lylavoie@iol.unh.edu https://www.iol.unh.edu +1-603-674-2755 (m) --0000000000005ba46f05bbb0dc3e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Feb= ruary 18, 2021

#####################################################= ########
Attendees

1. Lincoln Lavoie
2. Brandon Lo
3. Thoma= s Monjalon
4. Lijuan Tu
5. Ali Alnubani
6. David Liu
7. Juraj L= inke=C5=A1
8. Michael Santana
9. Tomasz Zawadzki
10. Michael Santa= na
11. Owen Hilyard

#############################################= ################
Agenda

1. CI Status
2. Bugzilla Status
3. = Test Development
4. Any other business

##########################= ###################################
Minutes

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D
CI Status

------------------------------------------= -------------------
UNH-IOL Community CI Lab

* SPDK was failing d= ue to changes in DPDK / SPDK and new dependence on vhost.=C2=A0 Vhost has b= een enabled and is now in production.
* ABI Reference - Needs to be upd= ated to 21.02 release - this will be handled today.
* Performance and fu= nctional testing for Intel and Mellanox NICs on aarch64 are now running and= should be stable, working on bringing Broadcom 25G NIC online.
* Contai= ners for RHEL7 and RHEL8 have been created, working on getting these into p= roduction.=C2=A0 This is being done as part of a larger effort to move as m= any of the compile / unit test jobs into containers as possible, which will= allow for more =E2=80=9Cworkers.=E2=80=9D =C2=A0The goal is to keep the ba= cklog of the compile and unit testing as short as possible. Need to look in= to c-cache enabled for the containers via an external mount / volume.
* = Completed development on pipeline changes for the performance and functiona= l testing (i.e. hardware dependent testing), that will leverage the patch c= ategorization contribution submitted to dpdk-ci.=C2=A0 This is intended to = allow for more targeted testing, i.e. on test and build what is necessary.= =C2=A0 Note, this dpdk-ci patch still needs review and merge.
* Update s= o failures on the dashboard that are not the main compilation test cases (i= .e. downstream projects) will show up as a warning (orange, not red).=C2=A0= This is not yet deployed in production
* Performance test emails now se= nd out percent differences instead of raw value differences. Question to th= e group, do you want this change on the stats (grafana instances as well)?<= br>* Upcoming maintenance - Lab will send out notices to the dpdk-ci as thi= s work happens, etc.
=C2=A0 =C2=A0* Migration to the containers - planni= ng to migrate one job at a time (i.e. swapping to containers one at a time)= .
=C2=A0 =C2=A0* Migration to the new pipeline structure for hardware de= pendent testing.=C2=A0 This will require some down time (stop new jobs from= starting), for the migration.=C2=A0 That will only impact the functional /= performance testing.

----------------------------------------------= ---------------
Intel Lab

* Working on a change to allow systems = to continue to run test cases for systems where the build succeeds, droppin= g / stopping only on the systems where the build failed.=C2=A0 This will pr= obably be ready in the next two weeks.

-----------------------------= --------------------------------
Travis / Github Actions / OBS

* = GitHub Actions & Travis
=C2=A0 =C2=A0* Reports should now be flowing= , we've pushed the latest set of scripts to the pw-ci repo
=C2=A0 = =C2=A0* ARM folks worked out a deal with the travis people and we have cred= its to run the DPDK jobs on travis-ci, so they are going
=C2=A0 =C2=A0* = Currently, some jobs are intermittently failing due to a bad version.map fi= le - see http://mails.dpdk.org/archives/dev/2021-February/199761.html
= * OBS
=C2=A0 =C2=A0* We have a few mechanisms now to declare branches as= no longer needed, so we will use those to clear branch status on the OBS b= uilds.
=C2=A0 =C2=A0* Plan is to adapt the OBS scripts to the rest of th= e pw-ci framework. Maybe 3 weeks time.
* "Pw-ci"
=C2=A0 =C2= =A0* Bigger question about whether to fold all of pw-ci into the dpdk CI sc= ripts and abandon the pw-ci repo we have.=C2=A0 That's a separate discu= ssion, really, but it might make sense since it includes scripts to detect = changes on patchwork, submit to different CI backends (like jenkins, obs, t= ravis, etc.), poll status, and report that status.
=C2=A0 =C2=A0 =C2=A0 = * Group wants to move the discussion over to the dpdk ci mailing list. Linc= oln will send out a mail to kick things off.

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D
Bugzilla Status

* https://bugs.= dpdk.org/buglist.cgi?bug_status=3DUNCONFIRMED&bug_status=3DCONFIRMED&am= p;bug_status=3DIN_PROGRESS&columnlist=3Dproduct%2Ccomponent%2Cpriority%= 2Cbug_status%2Cassigned_to%2Cshort_desc%2Cchangeddate&component=3Djob%2= 0scripts&component=3DUNH%20infra&component=3DIntel%20Lab&compon= ent=3DTravis%20CI&list_id=3D3419&order=3Dpriority%2Cchangeddate%20D= ESC&product=3Dlab&query_format=3Dadvanced&resolution=3D--- =
* Reviewed and updated bugs in bugzilla.

=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D
Test Development

* Aaron, Trishan, and Lincoln are w= orking to finalize the 2021 priorities and should have that list available = to this group for the next meeting.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D
Any other business

* Next Meeting: February 25, 2021, then 2 = weeks after that (back to the original schedule)
* Patchworks is going t= o be updated on Sunday, February 21, at 4am PST.=C2=A0 It will be down for = a few minutes during this time. =C2=A0
* Performance testing failures - = change to failure if fluctuation is larger than x%.=C2=A0 Should open a bug= for this, Ali will do the first write up.


--
Lincoln Lavoie
Principal Engineer, Broadband Technologies
21 Madbury Rd., Ste.= 100, Durham, NH 03824
+1-603-= 674-2755 (m)

--0000000000005ba46f05bbb0dc3e--