Test-Label: iol-mellanox-Performance
Test-Status: FAILURE
http://dpdk.org/patch/89167

_Performance Testing issues_

Submitter: Tyler Retzlaff <roretzla@linux.microsoft.com>
Date: Monday, March 15 2021 23:55:24 
DPDK git baseline: Repo:dpdk
  Branch: master
  CommitID:5d20515e0c260377fcd23fab785070c4391cc59d

89167 --> performance testing fail

Test environment and result as below:

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-5 100000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | -0.24635%                           |
+------------+---------+-------------------------------------+
| 128        | 256     | -0.01291%                           |
+------------+---------+-------------------------------------+
| 256        | 256     | -0.11947%                           |
+------------+---------+-------------------------------------+
| 512        | 256     | 0.14091%                            |
+------------+---------+-------------------------------------+
| 1024       | 256     | 0.84284%                            |
+------------+---------+-------------------------------------+
| 1518       | 256     | 0.20052%                            |
+------------+---------+-------------------------------------+

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-4 Lx 40000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | 0.55751%                            |
+------------+---------+-------------------------------------+
| 128        | 256     | -1.65018%                           |
+------------+---------+-------------------------------------+
| 256        | 256     | -0.0876%                            |
+------------+---------+-------------------------------------+
| 512        | 256     | -0.14377%                           |
+------------+---------+-------------------------------------+
| 1024       | 256     | -0.17721%                           |
+------------+---------+-------------------------------------+
| 1518       | 256     | 0.0%                                |
+------------+---------+-------------------------------------+

Ubuntu 18.04
Kernel: 4.15.0-generic
Compiler: gcc 7.4
NIC: Mellanox ConnectX-4 Lx 25000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 0/6

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 256     | -0.3125%                            |
+------------+---------+-------------------------------------+
| 128        | 256     | -0.08284%                           |
+------------+---------+-------------------------------------+
| 256        | 256     | 0.90045%                            |
+------------+---------+-------------------------------------+
| 512        | 256     | -0.87001%                           |
+------------+---------+-------------------------------------+
| 1024       | 256     | -0.08358%                           |
+------------+---------+-------------------------------------+
| 1518       | 256     | 0.0493%                             |
+------------+---------+-------------------------------------+

Ubuntu 18.04 ARM
Kernel: 4.15.0-132-generic
Compiler: gcc 7.5
NIC: Arm Mellanox ConnectX-5 10000 Mbps
Target: x86_64-native-linuxapp-gcc
Fail/Total: 3/4

Detail performance results: 
+------------+---------+-------------------------------------+
| frame_size | txd/rxd | throughput difference from expected |
+============+=========+=====================================+
| 64         | 128     | -2.5539%                            |
+------------+---------+-------------------------------------+
| 64         | 256     | -32.67865%                          |
+------------+---------+-------------------------------------+
| 64         | 512     | -51.35022%                          |
+------------+---------+-------------------------------------+
| 64         | 2048    | -50.36496%                          |
+------------+---------+-------------------------------------+

To view detailed results, visit:
https://lab.dpdk.org/results/dashboard/patchsets/15955/

UNH-IOL DPDK Community Lab

To manage your email subscriptions, visit: 
https://lab.dpdk.org/results/dashboard/preferences/subscriptions/