DPDK CI discussions
 help / color / Atom feed
* [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment
@ 2020-04-21 16:24 bugzilla
  2020-06-16 12:51 ` bugzilla
  0 siblings, 1 reply; 2+ messages in thread
From: bugzilla @ 2020-04-21 16:24 UTC (permalink / raw)
  To: ci

https://bugs.dpdk.org/show_bug.cgi?id=459

            Bug ID: 459
           Summary: Performance Turning and Results Stability Issues on
                    NXP test environment
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci@dpdk.org
          Reporter: lylavoie@iol.unh.edu
                CC: dpdklab@iol.unh.edu
  Target Milestone: ---

The NXP test environment seems to exhibit drops in performance on patches that
should not have impacted performance testing. The system should be turned by
NXP participants to avoid false negative results (i.e. drops in performance).  

Some ideas raised during the testing meeting on April 21 include running each
patch multiple times, to either average or throw out outlying measurements. 
This would require changes to the CI scripts.

Other option is to provide additional measurements (i.e. CPU temp) to determine
if that is impacting the performance.

Less ideal would be increasing the threshold for the failure (i.e. to 2% loss,
etc.).  That is up to each lab participant to set for their hardware.

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 2+ messages in thread

* [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment
  2020-04-21 16:24 [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment bugzilla
@ 2020-06-16 12:51 ` bugzilla
  0 siblings, 0 replies; 2+ messages in thread
From: bugzilla @ 2020-06-16 12:51 UTC (permalink / raw)
  To: ci

https://bugs.dpdk.org/show_bug.cgi?id=459

Brandon Lo (blo@iol.unh.edu) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |RESOLVED
                 CC|                            |blo@iol.unh.edu
         Resolution|---                         |FIXED

--- Comment #1 from Brandon Lo (blo@iol.unh.edu) ---
Closed since NXP hasn't failed in quite a while.

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, back to index

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-04-21 16:24 [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment bugzilla
2020-06-16 12:51 ` bugzilla

DPDK CI discussions

Archives are clonable:
	git clone --mirror http://inbox.dpdk.org/ci/0 ci/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ci ci/ http://inbox.dpdk.org/ci \
		ci@dpdk.org
	public-inbox-index ci


Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.ci


AGPL code for this site: git clone https://public-inbox.org/ public-inbox