DPDK CI discussions
 help / color / mirror / Atom feed
* [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment
@ 2020-04-21 16:24 bugzilla
  2020-06-16 12:51 ` bugzilla
  0 siblings, 1 reply; 2+ messages in thread
From: bugzilla @ 2020-04-21 16:24 UTC (permalink / raw)
  To: ci

https://bugs.dpdk.org/show_bug.cgi?id=459

            Bug ID: 459
           Summary: Performance Turning and Results Stability Issues on
                    NXP test environment
           Product: lab
           Version: unspecified
          Hardware: All
                OS: All
            Status: UNCONFIRMED
          Severity: normal
          Priority: Normal
         Component: UNH infra
          Assignee: ci@dpdk.org
          Reporter: lylavoie@iol.unh.edu
                CC: dpdklab@iol.unh.edu
  Target Milestone: ---

The NXP test environment seems to exhibit drops in performance on patches that
should not have impacted performance testing. The system should be turned by
NXP participants to avoid false negative results (i.e. drops in performance).  

Some ideas raised during the testing meeting on April 21 include running each
patch multiple times, to either average or throw out outlying measurements. 
This would require changes to the CI scripts.

Other option is to provide additional measurements (i.e. CPU temp) to determine
if that is impacting the performance.

Less ideal would be increasing the threshold for the failure (i.e. to 2% loss,
etc.).  That is up to each lab participant to set for their hardware.

-- 
You are receiving this mail because:
You are the assignee for the bug.

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2020-06-16 12:51 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-04-21 16:24 [dpdk-ci] [Bug 459] Performance Turning and Results Stability Issues on NXP test environment bugzilla
2020-06-16 12:51 ` bugzilla

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).