DPDK CI discussions
 help / color / mirror / Atom feed
From: bugzilla@dpdk.org
To: ci@dpdk.org
Subject: [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment
Date: Tue, 21 Apr 2020 16:24:16 +0000
Message-ID: <bug-459-149@http.bugs.dpdk.org/> (raw)


            Bug ID: 459
           Summary: Performance Turning and Results Stability Issues on
                    NXP test environment
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci@dpdk.org
          Reporter: lylavoie@iol.unh.edu
                CC: dpdklab@iol.unh.edu
  Target Milestone: ---

The NXP test environment seems to exhibit drops in performance on patches that
should not have impacted performance testing. The system should be turned by
NXP participants to avoid false negative results (i.e. drops in performance).  

Some ideas raised during the testing meeting on April 21 include running each
patch multiple times, to either average or throw out outlying measurements. 
This would require changes to the CI scripts.

Other option is to provide additional measurements (i.e. CPU temp) to determine
if that is impacting the performance.

Less ideal would be increasing the threshold for the failure (i.e. to 2% loss,
etc.).  That is up to each lab participant to set for their hardware.

You are receiving this mail because:
You are the assignee for the bug.

             reply	other threads:[~2020-04-21 16:24 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-04-21 16:24 bugzilla [this message]
2020-06-16 12:51 ` bugzilla

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=bug-459-149@http.bugs.dpdk.org/ \
    --to=bugzilla@dpdk.org \
    --cc=ci@dpdk.org \


* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

DPDK CI discussions

This inbox may be cloned and mirrored by anyone:

	git clone --mirror https://inbox.dpdk.org/ci/0 ci/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ci ci/ https://inbox.dpdk.org/ci \
	public-inbox-index ci

Example config snippet for mirrors.
Newsgroup available over NNTP:

AGPL code for this site: git clone https://public-inbox.org/public-inbox.git