I think this is because a series applied, http://patchwork.dpdk.org/project/dts/list/?series=15990

This series changed pass/fail determination to percentage.

> -----Original Message-----
> From: Mo, YufengX <yufengx.mo@intel.com>
> Sent: 2021年6月29日 17:08
> To: Brandon Lo <blo@iol.unh.edu>
> Cc: ci@dpdk.org; Tu, Lijuan <lijuan.tu@intel.com>; Xu, Qian Q
> <qian.q.xu@intel.com>; O'Driscoll, Tim <tim.odriscoll@intel.com>; Chen,
> Zhaoyan <zhaoyan.chen@intel.com>; David Marchand
> <david.marchand@redhat.com>; dpdklab@iol.unh.edu; Lincoln Lavoie
> <lylavoie@iol.unh.edu>; Thomas Monjalon <thomas@monjalon.net>; Liang,
> LongfengX <longfengx.liang@intel.com>
> Subject: patchset error for ci/iol-intel-Performance
>
> hi, Brandon Lo
>
>
> Can you help to check below server test result?
> It seems that the content is wrong in multiple test report as attached patchset
> test report mail.
>
>
> Today
> ================================
>
> Ubuntu 18.04
> Kernel: 4.15.0-generic
> Compiler: gcc 7.4
> NIC: Intel Corporation Ethernet Converged Network Adapter XL710-QDA2 40000
> Mbps
> Target: x86_64-native-linuxapp-gcc
> Fail/Total: 2/4
>
> Detail performance results:
> +------------+---------+----------+-------------+------------------------------+
> | frame_size | txd/rxd | num_cpus | num_threads |  throughput difference from
> |
> |            |         |          |             |           expected           |
> +============+=========+==========+=============+================
> ==============+
> | 64         | 512     | 1        | 1           | -4.04739%                    |
> +------------+---------+----------+-------------+------------------------------+
> | 64         | 2048    | 1        | 1           | -16.85513%                   |
> +------------+---------+----------+-------------+------------------------------+
> | 1          | 2       | 512      | 64          | 0.42264%                     |
> +------------+---------+----------+-------------+------------------------------+
> | 1          | 2       | 2048     | 64          | -0.30279%                    |
> +------------+---------+----------+-------------+------------------------------+
>
>
> Before
> ====================================================
>
> Ubuntu 18.04
> Kernel: 4.15.0-generic
> Compiler: gcc 7.4
> NIC: Intel Corporation Ethernet Converged Network Adapter 82599ES 10000
> Mbps
> Target: x86_64-native-linuxapp-gcc
> Fail/Total: 0/2
>
> Detail performance results:
> +------------+---------+-------------------------------------+
> | frame_size | txd/rxd | throughput difference from expected |
> +============+=========+=====================================+
> | 64         | 512     | -0.41763%                           |
> +------------+---------+-------------------------------------+
> | 64         | 2048    | -0.26103%                           |
> +------------+---------+-------------------------------------+
>
>
>
> BRs
> Yufen, Mo
>
>