From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 65D4CA2EFC for ; Tue, 15 Oct 2019 18:21:18 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 3EABF1ED89; Tue, 15 Oct 2019 18:21:18 +0200 (CEST) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by dpdk.org (Postfix) with ESMTP id 9CFC31ED68; Tue, 15 Oct 2019 18:21:14 +0200 (CEST) Received: from smtp.corp.redhat.com (int-mx07.intmail.prod.int.phx2.redhat.com [10.5.11.22]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id CCA093082231; Tue, 15 Oct 2019 16:21:13 +0000 (UTC) Received: from [10.36.118.67] (unknown [10.36.118.67]) by smtp.corp.redhat.com (Postfix) with ESMTP id D65E5100EBD5; Tue, 15 Oct 2019 16:21:08 +0000 (UTC) From: Kevin Traynor To: Ju-Hyoung Lee , Abhishek Marathe , "stable@dpdk.org" Cc: "dev@dpdk.org" , Akhil Goyal , Ali Alnubani , "benjamin.walker@intel.com" , David Christensen , Hemant Agrawal , Ian Stokes , Jerin Jacob , John McNamara , Luca Boccassi , Pei Zhang , "pingx.yu@intel.com" , "qian.q.xu@intel.com" , Raslan Darawsheh , Thomas Monjalon , "yuan.peng@intel.com" , "zhaoyan.chen@intel.com" References: <20190913163100.30002-1-ktraynor@redhat.com> <20191003132036.29258-1-ktraynor@redhat.com> <4cb0a062-0c12-caa0-16bf-6a9b78bef325@redhat.com> Message-ID: Date: Tue, 15 Oct 2019 17:21:07 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.1.1 MIME-Version: 1.0 In-Reply-To: <4cb0a062-0c12-caa0-16bf-6a9b78bef325@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Scanned-By: MIMEDefang 2.84 on 10.5.11.22 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.47]); Tue, 15 Oct 2019 16:21:14 +0000 (UTC) Subject: Re: [dpdk-stable] 18.11.3 (LTS) patches review and test X-BeenThere: stable@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches for DPDK stable branches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: stable-bounces@dpdk.org Sender: "stable" On 11/10/2019 22:19, Kevin Traynor wrote: > On 11/10/2019 17:33, Ju-Hyoung Lee wrote: >> Is there any other partners have done DPDK performance test with different OS distro? > > There was a few other perf testings reported elsewhere in reply to this > thread and there wasn't other perf drop reported. I only know the distro > of the Red Hat testing (RHEL). To summarize, > > Intel and IBM reported perf testing, Red Hat did perf testing with > SR-IOV. There was also some OVS perf testing from Ian, but that may be a > little less relevant as there is a lot of OVS involved in the datapath. > > Mellanox haven't reported their testing results yet, so seen as you are > using a Mellanox NIC their results may be interesting. > > I've ran some OVS and testpmd tests on RHEL. For testpmd I see perf > within 0.06% of 18.11.2. > >> I wonder if this is distro-specific or Azure-specific. >> > > These are the netvsc/failsafe changes, in case you wanted to clone the > repo (git://dpdk.org/dpdk-stable branch 18.11) and revert them for > investigating: > $ git log --oneline v18.11.2..v18.11.3-rc2 | grep -e netvsc -e failsafe > 822c98c8a net/netvsc: fix definition of offload values > a8a965216 net/netvsc: fix xstats for VF device > 9fd8123bd net/netvsc: fix xstats id > ddc352a3f net/netvsc: fix RSS offload settings > ad4093aac net/netvsc: initialize VF spinlock > 2f05eb233 net/failsafe: fix reported device info > Hi Abishek/Ju, Any update on this issue? Were you able to bisect to which commit is causing an issue in your tests? thanks, Kevin. >> Ju >> >> -----Original Message----- >> From: Abhishek Marathe >> Sent: Friday, October 11, 2019 9:30 AM >> To: Kevin Traynor ; stable@dpdk.org >> Cc: dev@dpdk.org; Akhil Goyal ; Ali Alnubani ; benjamin.walker@intel.com; David Christensen ; Hemant Agrawal ; Ian Stokes ; Jerin Jacob ; John McNamara ; Ju-Hyoung Lee ; Luca Boccassi ; Pei Zhang ; pingx.yu@intel.com; qian.q.xu@intel.com; Raslan Darawsheh ; Thomas Monjalon ; yuan.peng@intel.com; zhaoyan.chen@intel.com >> Subject: RE: 18.11.3 (LTS) patches review and test >> >> Hi All, >> >> Our Findings while testing DPDK 18.11.3-rc2 release: >> 1. PERF-DPDK-MULTICORE-PPS-F32: This testcase is failing for almost all the distros. I can reproduce the problem but there are no errors in the Kernel logs / Test Execution logs. It seems that failure is due to lower performance than threshold. As this testcase was not failing for the previous releases, we are going to investigate it further. > > What is Standard_F32s_v2? What is the result and the threshold? > > thanks, > Kevin. > >> 2. We are getting low performance for Ubuntu distribution failed testcases. >> >> Test Result: >> >> DPDK v18.11.3-rc2 was validated on Azure for Canonical UbuntuServer 16.04-LTS latest, Canonical UbuntuServer 18.04-DAILY-LTS latest, RedHat RHEL 7-RAW latest, RedHat RHEL 7.5 latest, Openlogic CentOS 7.5 latest, SUSE SLES 15 latest. >> Tested with Mellanox and netvsc poll-mode drivers. >> The tests were executed using LISAv2 framework (https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2FLIS%2FLISAv2&data=02%7C01%7Cjuhlee%40microsoft.com%7C8ad50d4d779c486a550e08d74e68350b%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637064081778210151&sdata=vcX1Tnc4v8w2RbdL4xNOQbkrvba4R5lyymiznEYj4Dk%3D&reserved=0). >> >> Test case description: >> >> * VERIFY-DPDK-COMPLIANCE - verifies kernel is supported and that the build is successful >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST - verifies using testpmd that packets can be sent from a VM to another VM >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK - disables/enables Accelerated Networking for the NICs under test and makes sure DPDK works in both scenarios >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC - disables/enables Accelerated Networking for the NICs while generating traffic using testpmd >> >> * PERF-DPDK-FWD-PPS-DS15 - verifies DPDK forwarding performance using testpmd on 2, 4, 8 cores, rx and io mode on size Standard_DS15_v2 >> * PERF-DPDK-SINGLE-CORE-PPS-DS4 - verifies DPDK performance using testpmd on 1 core, rx and io mode on size Standard_DS4_v2 >> * PERF-DPDK-SINGLE-CORE-PPS-DS15 - verifies DPDK performance using testpmd on 1 core, rx and io mode on size Standard_DS15_v2 >> * PERF-DPDK-MULTICORE-PPS-DS15 - verifies DPDK performance using testpmd on 2, 4, 8 cores, rx and io mode on size Standard_DS15_v2 >> * PERF-DPDK-MULTICORE-PPS-F32 - verifies DPDK performance using testpmd on 2, 4, 8, 16 cores, rx and io mode on size Standard_F32s_v2 >> >> * DPDK-RING-LATENCY - verifies DPDK CPU latency using https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fshemminger%2Fdpdk-ring-ping.git&data=02%7C01%7Cjuhlee%40microsoft.com%7C8ad50d4d779c486a550e08d74e68350b%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637064081778210151&sdata=w1ShwRLxHcqibCZKwDmyxWjH5AIlz096gLsek4J1zGY%3D&reserved=0 >> * VERIFY-DPDK-PRIMARY-SECONDARY-PROCESSES - verifies primary / secondary processes support for DPDK. Runs only on RHEL and Ubuntu distros with Linux kernel >= 4.20 >> >> * VERIFY-DPDK-OVS - builds OVS with DPDK support and tests if the OVS DPDK ports can be created. Runs only on Ubuntu distro. >> * VERIFY-DPDK-VPP - builds VPP with DPDK support and tests if the VPP ports are present. Runs only on RHEL and Ubuntu distros. >> * VERIFY-DPDK-NFF-GO - builds NFF-GO with DPDK support and runs the functional tests from the NFF-GO repository. Runs only on Ubuntu distro. >> >> DPDK job exited with status: UNSTABLE - https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Flinuxpipeline.westus2.cloudapp.azure.com%2Fjob%2FDPDK%2Fjob%2Fpipeline-dpdk-validation%2Fjob%2Fmaster%2F252%2F&data=02%7C01%7Cjuhlee%40microsoft.com%7C8ad50d4d779c486a550e08d74e68350b%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637064081778210151&sdata=jy8T4kTBur4KpeCWFix4s5Pr8KiYFnSW9RPS9Cbjz4I%3D&reserved=0. >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'Canonical UbuntuServer 16.04-LTS latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: FAILED >> * VERIFY-DPDK-OVS: PASSED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: FAILED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: ABORTED >> * PERF-DPDK-FWD-PPS-DS15: FAILED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: FAILED >> * PERF-DPDK-MULTICORE-PPS-DS15: FAILED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'Canonical UbuntuServer 18.04-DAILY-LTS latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: FAILED >> * VERIFY-DPDK-OVS: PASSED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: FAILED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED >> * PERF-DPDK-FWD-PPS-DS15: FAILED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: FAILED >> * PERF-DPDK-MULTICORE-PPS-DS15: ABORTED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'RedHat RHEL 7-RAW latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: FAILED >> * VERIFY-DPDK-OVS: SKIPPED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: ABORTED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED >> * PERF-DPDK-FWD-PPS-DS15: PASSED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED >> * PERF-DPDK-MULTICORE-PPS-DS15: PASSED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'RedHat RHEL 7.5 latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED >> * VERIFY-DPDK-OVS: SKIPPED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: ABORTED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED >> * PERF-DPDK-FWD-PPS-DS15: PASSED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED >> * PERF-DPDK-MULTICORE-PPS-DS15: PASSED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'Openlogic CentOS 7.5 latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED >> * VERIFY-DPDK-OVS: SKIPPED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: PASSED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED >> * PERF-DPDK-FWD-PPS-DS15: PASSED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED >> * PERF-DPDK-MULTICORE-PPS-DS15: PASSED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Test results for DPDK 'v18.11.3-rc2' and Azure image: 'SUSE SLES 15 latest': >> >> * PERF-DPDK-SINGLE-CORE-PPS-DS4: PASSED >> * VERIFY-DPDK-OVS: SKIPPED >> * VERIFY-DPDK-BUILD-AND-TESTPMD-TEST: PASSED >> * VERIFY-SRIOV-FAILSAFE-FOR-DPDK: PASSED >> * PERF-DPDK-MULTICORE-PPS-F32: FAILED >> * VERIFY-DPDK-FAILSAFE-DURING-TRAFFIC: PASSED >> * PERF-DPDK-FWD-PPS-DS15: PASSED >> * PERF-DPDK-SINGLE-CORE-PPS-DS15: PASSED >> * PERF-DPDK-MULTICORE-PPS-DS15: PASSED >> * VERIFY-DPDK-COMPLIANCE: PASSED >> * VERIFY-DPDK-RING-LATENCY: PASSED >> >> Regards, >> Abhishek >> >> -----Original Message----- >> From: Kevin Traynor >> Sent: Thursday, October 3, 2019 6:21 AM >> To: stable@dpdk.org >> Cc: dev@dpdk.org; Abhishek Marathe ; Akhil Goyal ; Ali Alnubani ; benjamin.walker@intel.com; David Christensen ; Hemant Agrawal ; Ian Stokes ; Jerin Jacob ; John McNamara ; Ju-Hyoung Lee ; Kevin Traynor ; Luca Boccassi ; Pei Zhang ; pingx.yu@intel.com; qian.q.xu@intel.com; Raslan Darawsheh ; Thomas Monjalon ; yuan.peng@intel.com; zhaoyan.chen@intel.com >> Subject: 18.11.3 (LTS) patches review and test >> >> Hi all, >> >> Here is a list of patches targeted for LTS release 18.11.3. >> >> The planned date for the final release is 14th October. >> >> Please note the commits since RC1 below. They are primarily to address some build issues for 32-bit with meson and FreeBSD. >> As such, I would expect that most RC1 testing is still valid and does not need to be repeated. >> >> Please help with testing and validation of your use cases and report any issues/results in reply to this mail. For the final release the fixes and reported validations will be added to the release notes. >> >> A release candidate tarball can be found at: >> >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdpdk.org%2Fbrowse%2Fdpdk-stable%2Ftag%2F%3Fid%3Dv18.11.3-rc2&data=02%7C01%7Cjuhlee%40microsoft.com%7C8ad50d4d779c486a550e08d74e68350b%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637064081778210151&sdata=ZFrDBkGh1jgKt7h8jEqv7BtZ%2FhGvPH7xGw%2B6vvGHk4o%3D&reserved=0 >> >> These patches are located at branch 18.11 of dpdk-stable repo: >> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fdpdk.org%2Fbrowse%2Fdpdk-stable%2F&data=02%7C01%7Cjuhlee%40microsoft.com%7C8ad50d4d779c486a550e08d74e68350b%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637064081778210151&sdata=BqMqA%2FKc%2BOg%2FNrXO%2Bf1k0Vqw5xjONqqYVPPh4js2H9M%3D&reserved=0 >> >> Commits since RC1: >> 9e7c637c6 build: add libatomic dependency for 32-bit clang 6c576d41c mem: mark unused function in 32-bit builds >> 7ffe32a15 build: remove unnecessary large file support defines 5c3c20a8a build: enable large file support on 32-bit >> 5633216d4 net/nfp: disable for 32-bit meson builds >> c97d4cd35 build: set RTE_ARCH_64 based on pointer size >> 86e56d5f9 ethdev: fix endian annotation for SPI item d908ee9de build: enable BSD features visibility for FreeBSD >> >> Thanks. >> >> Kevin Traynor >> >> --- [snipped list of patches]