From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <ci-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 82B16A0548
	for <public@inbox.dpdk.org>; Mon, 17 May 2021 22:58:18 +0200 (CEST)
Received: from [217.70.189.124] (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 6A0354014E;
	Mon, 17 May 2021 22:58:18 +0200 (CEST)
Received: from inbox.dpdk.org (inbox.dpdk.org [95.142.172.178])
 by mails.dpdk.org (Postfix) with ESMTP id 4FB7E40041
 for <ci@dpdk.org>; Mon, 17 May 2021 22:58:17 +0200 (CEST)
Received: by inbox.dpdk.org (Postfix, from userid 33)
 id 1549CA0A0A; Mon, 17 May 2021 22:58:17 +0200 (CEST)
From: bugzilla@dpdk.org
To: ci@dpdk.org
Date: Mon, 17 May 2021 20:58:17 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: lab
X-Bugzilla-Component: UNH infra
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: normal
X-Bugzilla-Who: lylavoie@iol.unh.edu
X-Bugzilla-Status: UNCONFIRMED
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: Normal
X-Bugzilla-Assigned-To: ci@dpdk.org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform
 op_sys bug_status bug_severity priority component assigned_to reporter cc
 target_milestone
Message-ID: <bug-704-149@http.bugs.dpdk.org/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://bugs.dpdk.org/
Auto-Submitted: auto-generated
X-Auto-Response-Suppress: All
MIME-Version: 1.0
Subject: [dpdk-ci] [Bug 704] Epic: Migrate Performance Testing to use
 Percentage Metric
X-BeenThere: ci@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK CI discussions <ci.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/ci>,
 <mailto:ci-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/ci/>
List-Post: <mailto:ci@dpdk.org>
List-Help: <mailto:ci-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/ci>,
 <mailto:ci-request@dpdk.org?subject=subscribe>
Errors-To: ci-bounces@dpdk.org
Sender: "ci" <ci-bounces@dpdk.org>

https://bugs.dpdk.org/show_bug.cgi?id=3D704

            Bug ID: 704
           Summary: Epic: Migrate Performance Testing to use Percentage
                    Metric
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci@dpdk.org
          Reporter: lylavoie@iol.unh.edu
                CC: dpdklab@iol.unh.edu
  Target Milestone: ---

Summary: During Q1 2021, the Community CI group agreed to move the test met=
ric
from an absolute requirement (i.e. a difference of X pps causes a fail) to a
percentage based metric (i.e. a difference of X% from the baseline for that=
 DUT
causes a fail).=20

* Completed Q1 Story: Create migration plan to document all changes require=
d to
lab database, migration, and job runners, and deployment changes for DTS
change.=20
*Completed Q1 Story: Add Dashboard plots for additional hardware running in=
 the
lab.=20
* Q2 Story: Test and deploy DTS patch / changes for percentage changes.  Th=
is
will also require a migration of the database store the percentage metric,
along with a conversion of older data.
* Q2 Story: Update Dashboard plots to show the percentage based metrics.

--=20
You are receiving this mail because:
You are the assignee for the bug.=