From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <ci-bounces@dpdk.org>
Received: from dpdk.org (dpdk.org [92.243.14.124])
	by inbox.dpdk.org (Postfix) with ESMTP id 21F49A0598
	for <public@inbox.dpdk.org>; Tue, 21 Apr 2020 18:24:17 +0200 (CEST)
Received: from [92.243.14.124] (localhost [127.0.0.1])
	by dpdk.org (Postfix) with ESMTP id 1AAD31D408;
	Tue, 21 Apr 2020 18:24:17 +0200 (CEST)
Received: from inbox.dpdk.org (xvm-172-178.dc0.ghst.net [95.142.172.178])
 by dpdk.org (Postfix) with ESMTP id 1B27D1D37E
 for <ci@dpdk.org>; Tue, 21 Apr 2020 18:24:16 +0200 (CEST)
Received: by inbox.dpdk.org (Postfix, from userid 33)
 id 06ED4A0599; Tue, 21 Apr 2020 18:24:15 +0200 (CEST)
From: bugzilla@dpdk.org
To: ci@dpdk.org
Date: Tue, 21 Apr 2020 16:24:16 +0000
X-Bugzilla-Reason: AssignedTo
X-Bugzilla-Type: new
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: lab
X-Bugzilla-Component: UNH infra
X-Bugzilla-Version: unspecified
X-Bugzilla-Keywords: 
X-Bugzilla-Severity: normal
X-Bugzilla-Who: lylavoie@iol.unh.edu
X-Bugzilla-Status: UNCONFIRMED
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: Normal
X-Bugzilla-Assigned-To: ci@dpdk.org
X-Bugzilla-Target-Milestone: ---
X-Bugzilla-Flags: 
X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform
 op_sys bug_status bug_severity priority component assigned_to reporter cc
 target_milestone
Message-ID: <bug-459-149@http.bugs.dpdk.org/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: http://bugs.dpdk.org/
Auto-Submitted: auto-generated
X-Auto-Response-Suppress: All
MIME-Version: 1.0
Subject: [dpdk-ci] [Bug 459] Performance Turning and Results Stability
 Issues on NXP test environment
X-BeenThere: ci@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK CI discussions <ci.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/ci>,
 <mailto:ci-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/ci/>
List-Post: <mailto:ci@dpdk.org>
List-Help: <mailto:ci-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/ci>,
 <mailto:ci-request@dpdk.org?subject=subscribe>
Errors-To: ci-bounces@dpdk.org
Sender: "ci" <ci-bounces@dpdk.org>

https://bugs.dpdk.org/show_bug.cgi?id=3D459

            Bug ID: 459
           Summary: Performance Turning and Results Stability Issues on
                    NXP test environment
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci@dpdk.org
          Reporter: lylavoie@iol.unh.edu
                CC: dpdklab@iol.unh.edu
  Target Milestone: ---

The NXP test environment seems to exhibit drops in performance on patches t=
hat
should not have impacted performance testing. The system should be turned by
NXP participants to avoid false negative results (i.e. drops in performance=
).=20=20

Some ideas raised during the testing meeting on April 21 include running ea=
ch
patch multiple times, to either average or throw out outlying measurements.=
=20
This would require changes to the CI scripts.

Other option is to provide additional measurements (i.e. CPU temp) to deter=
mine
if that is impacting the performance.

Less ideal would be increasing the threshold for the failure (i.e. to 2% lo=
ss,
etc.).  That is up to each lab participant to set for their hardware.

--=20
You are receiving this mail because:
You are the assignee for the bug.=