Re: [dpdk-stable] 18.11.2 (LTS) patches review and test

[Ju-Hyoung Lee <juhlee@microsoft.com>]

Hello,

(Sorry for late response, we should fix the automation issue before sending out the result. This is test result of http://git.dpdk.org/dpdk-stable/snapshot/dpdk-stable-18.11.2-rc1.tar.xz)

DPDK https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=moKSeRiVoqwg0x6gESsSzYjrX6BGYunR8pM6XIQj7lA%3D&reserved=0,  was validated on Azure for Canonical UbuntuServer 16.04-LTS latest, Canonical UbuntuServer 18.04-DAILY-LTS latest, RedHat RHEL 7-RAW latest, RedHat RHEL 7.5 latest, Openlogic CentOS 7.5 latest, SUSE SLES 15 latest.
Tested with Mellanox and netvsc poll-mode drivers.
The tests were executed using LISAv2 framework (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FLIS%2FLISAv2&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=8Ql%2FeIuU230b1RE89fy9JCdXFDx6s3%2BNZEgIWH%2BinCg%3D&reserved=0).

Test case description:

* VERIFY-DPDK-COMPLIANCE - verifies kernel is supported and that the build is successful
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST - verifies using testpmd that packets can be sent from a VM to another VM
* VERIFY-DPDK-OVS - builds OVS with DPDK support and tests if the OVS DPDK ports can be created (only on Ubuntu)
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK - disables/enables Accelerated Networking for the NICs under test and makes sure DPDK works in both scenarios
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC - disables/enables Accelerated Networking for the NICs while generating traffic using testpmd
* PERF-DPDK-FWD-PPS-DS15 - verifies DPDK forwarding performance using testpmd on 2, 4, 8 cores, rx and io mode on size Standard_DS15_v2
* PERF-DPDK-SINGLE-CORE-PPS-DS4 - verifies DPDK performance using testpmd on 1 core, rx and io mode on size Standard_DS4_v2
* PERF-DPDK-SINGLE-CORE-PPS-DS15 - verifies DPDK performance using testpmd on 1 core, rx and io mode on size Standard_DS15_v2
* PERF-DPDK-MULTICORE-PPS-DS15 - verifies DPDK performance using testpmd on 2, 4, 8 cores, rx and io mode on size Standard_DS15_v2
* PERF-DPDK-MULTICORE-PPS-F32 - verifies DPDK performance using testpmd on 2, 4, 8, 16 cores, rx and io mode on size Standard_F32s_v2
* DPDK-RING-LATENCY - verifies DPDK CPU latency using https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fshemminger%2Fdpdk-ring-ping.git&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=GZlkGkRZoNpVJYegaKY1ILBarjJj%2BeCc1Yv%2BcJ4Ysng%3D&reserved=0

 DPDK job exited with status: UNSTABLE - https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Flinuxpipeline.westus2.cloudapp.azure.com%2Fjob%2Fpipeline-dpdk-validation%2Fjob%2Fmaster%2F73%2F&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=8ocjqXbVj5S4LbehCorNTA%2BLh6Wcvkcg%2BM4WiuOYDUs%3D&reserved=0. 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=moKSeRiVoqwg0x6gESsSzYjrX6BGYunR8pM6XIQj7lA%3D&reserved=0' and Azure image: 'Canonical UbuntuServer 16.04-LTS latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED 
* VERIFY-DPDK-OVS: ABORTED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: ABORTED 
* PERF-DPDK-FWD-PPS-DS15: PASSED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958301676&sdata=moKSeRiVoqwg0x6gESsSzYjrX6BGYunR8pM6XIQj7lA%3D&reserved=0' and Azure image: 'Canonical UbuntuServer 18.04-DAILY-LTS latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED 
* VERIFY-DPDK-OVS: ABORTED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED 
* PERF-DPDK-FWD-PPS-DS15: PASSED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958311665&sdata=lCDzrPrhl0whSSU4NPpSOOHZ5rORWFVOrGCs0JdIHIY%3D&reserved=0' and Azure image: 'RedHat RHEL 7-RAW latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED 
* VERIFY-DPDK-OVS: SKIPPED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: ABORTED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED 
* PERF-DPDK-FWD-PPS-DS15: PASSED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958311665&sdata=lCDzrPrhl0whSSU4NPpSOOHZ5rORWFVOrGCs0JdIHIY%3D&reserved=0' and Azure image: 'RedHat RHEL 7.5 latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: FAILED 
* VERIFY-DPDK-OVS: SKIPPED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: ABORTED 
* PERF-DPDK-FWD-PPS-DS15: PASSED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958311665&sdata=lCDzrPrhl0whSSU4NPpSOOHZ5rORWFVOrGCs0JdIHIY%3D&reserved=0' and Azure image: 'Openlogic CentOS 7.5 latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED 
* VERIFY-DPDK-OVS: SKIPPED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: ABORTED 
* PERF-DPDK-FWD-PPS-DS15: ABORTED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 

Test results for DPDK 'https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fgit.dpdk.org%2Fdpdk-stable%2Fsnapshot%2Fdpdk-stable-18.11.2-rc1.tar.xz&data=02%7C01%7Cjuhlee%40microsoft.com%7Ccb20e6d3246248f7a01708d6e54da2cf%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636948518958311665&sdata=lCDzrPrhl0whSSU4NPpSOOHZ5rORWFVOrGCs0JdIHIY%3D&reserved=0' and Azure image: 'SUSE SLES 15 latest': 
 
* PERF-DPDK-SINGLE-CORE-PPS-DS4: FAILED 
* VERIFY-DPDK-OVS: SKIPPED 
* VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED 
* VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED 
* VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED 
* PERF-DPDK-FWD-PPS-DS15: PASSED 
* PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED 
* VERIFY-DPDK-COMPLIANCE: PASSED 
* VERIFY-DPDK-RING-LATENCY: PASSED 


Thank you,
Jenkins DPDK

-----Original Message-----
From: Kevin Traynor <ktraynor@redhat.com> 
Sent: Friday, May 24, 2019 9:51 AM
To: dwilder <dwilder@us.ibm.com>
Cc: dpdk stable <stable@dpdk.org>; dev@dpdk.org; Sitong Liu <siliu@redhat.com>; Pei Zhang <pezhang@redhat.com>; Raslan Darawsheh <rasland@mellanox.com>; qian.q.xu@intel.com; Ju-Hyoung Lee <juhlee@microsoft.com>; Ian Stokes <ian.stokes@intel.com>; Ali Alnubani <alialnu@mellanox.com>; David Christensen <drc@linux.vnet.ibm.com>; benjamin.walker@intel.com; Thomas Monjalon <thomas@monjalon.net>; John McNamara <john.mcnamara@intel.com>; Luca Boccassi <bluca@debian.org>; Jerin Jacob Kollanukkaran <jerinj@marvell.com>; Hemant Agrawal <hemant.agrawal@nxp.com>; Akhil Goyal <akhil.goyal@nxp.com>
Subject: Re: [dpdk-stable] 18.11.2 (LTS) patches review and test

On 24/05/2019 17:46, dwilder wrote:
> Hi Kevin-
> 
> I tested 8.11.2 RC1 on IBM Power9 hardware.  No issues or performance 
> degradation were observed.
> 

Thanks David. Good news on a Friday is always welcome :-)

> Tests run:
>   * Single port stability test using l3fwd (16 cpus) and TRex, tested 
> 64 and 1500 byte packets at a 0.0% drop rate for 4 hours each.
> 
> System tested:
>   - IBM Power9 Model 8335-101 CPU: 2.3 (pvr 004e 1203)
> 
> Tested NICs:
>   - ConnectX-5 (fw 16.23.1020).
> 
> OS Tested
>   - Ubuntu 18.04.2 LTS (kernel 4.15.0-47-generic)
> 

I will add it to the release notes,

thanks,
Kevin.

> Regards,
> Dave