* [PATCH] test_plans: remove NICStatistics and stability
@ 2022-05-25 11:24 Lijuan Tu
0 siblings, 0 replies; 3+ messages in thread
From: Lijuan Tu @ 2022-05-25 11:24 UTC (permalink / raw)
To: dts; +Cc: Lijuan Tu
They are out of maintenance for some years.
Signed-off-by: Lijuan Tu <lijuan.tu@intel.com>
---
test_plans/NICStatistics_test_plan.rst | 147 -------------------------
test_plans/stability_test_plan.rst | 97 ----------------
2 files changed, 244 deletions(-)
delete mode 100644 test_plans/NICStatistics_test_plan.rst
delete mode 100644 test_plans/stability_test_plan.rst
diff --git a/test_plans/NICStatistics_test_plan.rst b/test_plans/NICStatistics_test_plan.rst
deleted file mode 100644
index a5f00981..00000000
--- a/test_plans/NICStatistics_test_plan.rst
+++ /dev/null
@@ -1,147 +0,0 @@
-.. Copyright (c) <2010-2017>, Intel Corporation
- All rights reserved.
-
- Redistribution and use in source and binary forms, with or without
- modification, are permitted provided that the following conditions
- are met:
-
- - Redistributions of source code must retain the above copyright
- notice, this list of conditions and the following disclaimer.
-
- - Redistributions in binary form must reproduce the above copyright
- notice, this list of conditions and the following disclaimer in
- the documentation and/or other materials provided with the
- distribution.
-
- - Neither the name of Intel Corporation nor the names of its
- contributors may be used to endorse or promote products derived
- from this software without specific prior written permission.
-
- THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
- "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
- LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
- FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
- COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
- INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
- (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
- SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
- HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
- STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
- ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
- OF THE POSSIBILITY OF SUCH DAMAGE.
-
-====================
-NIC Statistics Tests
-====================
-
-This document provides benchmark tests for the userland Intel®
-82599 Gigabit Ethernet Controller Poll Mode Driver (PMD).
-The userland PMD application runs the ``IO forwarding mode`` test
-described in the PMD test plan document with different parameters for
-the configuration of 82599 NIC ports.
-
-The core configuration description is:
-
-- 1C/1T: 1 Physical Core, 1 Logical Core per physical core (1 Hyperthread)
- using core #2 (socket 0, 2nd physical core)
-
-- 1C/2T: 1 Physical Core, 2 Logical Cores per physical core (2 Hyperthreads)
- using core #2 and #14 (socket 0, 2nd physical core, 2 Hyperthreads)
-
-- 2C/1T: 2 Physical Cores, 1 Logical Core per physical core
- using core #2 and #4 (socket 0, 2nd and 3rd physical cores)
-
-
-Prerequisites
-=============
-
-Each of the 10Gb Ethernet* ports of the DUT is directly connected in
-full-duplex to a different port of the peer traffic generator.
-
-Using interactive commands, the traffic generator can be configured to
-send and receive in parallel, on a given set of ports.
-
-The tool ``vtbwrun`` (included in Intel® VTune™ Performance Analyzer)
-will be used to monitor memory activities while running network
-benchmarks to check the number of ``Memory Partial Writes`` and the
-distribution of memory accesses among available Memory Channels. This
-will only be done on the userland application, as the tool requires a
-Linux environment to be running in order to be used.
-
-If using vfio the kernel must be >= 3.6+ and VT-d must be enabled in bios.When
-using vfio, use the following commands to load the vfio driver and bind it
-to the device under test::
-
- modprobe vfio
- modprobe vfio-pci
- usertools/dpdk-devbind.py --bind=vfio-pci device_bus_id
-
-Test Case: Performance Benchmarking
-===================================
-
-The linuxapp is started with the following parameters, for each of
-the configurations referenced above:
-
-1C/1T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x4 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-1C/2T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x4004 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-2C/1T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x14 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-
-The throughput is measured for each of these cases for the packet size
-of 64, 65, 128, 256, 512, 1024, 1280 and 1518 bytes.
-The results are printed in the following table:
-
-+-------+---------+---------+---------+-----------+
-| Frame | 1C/1T | 1C/2T | 2C/1 | wirespeed |
-| Size | | | | |
-+-------+---------+---------+---------+-----------+
-| 64 | | | | |
-+-------+---------+---------+---------+-----------+
-| 65 | | | | |
-+-------+---------+---------+---------+-----------+
-| 128 | | | | |
-+-------+---------+---------+---------+-----------+
-| 256 | | | | |
-+-------+---------+---------+---------+-----------+
-| 512 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1024 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1280 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1518 | | | | |
-+-------+---------+---------+---------+-----------+
-
-
-The memory partial writes are measured with the ``vtbwrun`` application and printed
-in the following table:::
-
-
- Sampling Duration: 000000.00 micro-seconds
- --- Logical Processor 0 ---||--- Logical Processor 1 ---
- ---------------------------------------||---------------------------------------
- --- Intersocket QPI Utilization ---||--- Intersocket QPI Utilization ---
- ---------------------------------------||---------------------------------------
- --- Reads (MB/s): 0.00 ---||--- Reads (MB/s): 0.00 ---
- --- Writes(MB/s): 0.00 ---||--- Writes(MB/s): 0.00 ---
- ---------------------------------------||---------------------------------------
- --- Memory Performance Monitoring ---||--- Memory Performance Monitoring ---
- ---------------------------------------||---------------------------------------
- --- Mem Ch 0: #Ptl Wr: 0000.00 ---||--- Mem Ch 0: #Ptl Wr: 0.00 ---
- --- Mem Ch 1: #Ptl Wr: 0000.00 ---||--- Mem Ch 1: Ptl Wr (MB/s): 0.00 ---
- --- Mem Ch 2: #Ptl Wr: 0000.00 ---||--- Mem Ch 2: #Ptl Wr: 0.00 ---
- --- ND0 Mem #Ptl Wr: 0000.00 ---||--- ND1 #Ptl Wr: 0.00 ---
diff --git a/test_plans/stability_test_plan.rst b/test_plans/stability_test_plan.rst
deleted file mode 100644
index c051954a..00000000
--- a/test_plans/stability_test_plan.rst
+++ /dev/null
@@ -1,97 +0,0 @@
-.. Copyright (c) <2011-2017>, Intel Corporation
- All rights reserved.
-
- Redistribution and use in source and binary forms, with or without
- modification, are permitted provided that the following conditions
- are met:
-
- - Redistributions of source code must retain the above copyright
- notice, this list of conditions and the following disclaimer.
-
- - Redistributions in binary form must reproduce the above copyright
- notice, this list of conditions and the following disclaimer in
- the documentation and/or other materials provided with the
- distribution.
-
- - Neither the name of Intel Corporation nor the names of its
- contributors may be used to endorse or promote products derived
- from this software without specific prior written permission.
-
- THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
- "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
- LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
- FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
- COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
- INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
- (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
- SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
- HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
- STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
- ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
- OF THE POSSIBILITY OF SUCH DAMAGE.
-
-===============
-Stability Tests
-===============
-
-This is the test report for the Intel® DPDK Linux user space stability tests
-described in the test plan document.
-
-Test Case: Stress test
-======================
-
-Run under heavy traffic for a long time. At the end of the test period, check
-that the traffic is still flowing and there is no drop in the throughput rate.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports. Recommended test duration:
-24 hours.
-
-Test Case: Repetitive system restart
-====================================
-
-Check that the system is still working after the application is shut down and
-restarted repeatedly under heavy traffic load. After the last test iteration,
-the traffic should still be flowing through the system with no drop in the
-throughput rate.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports.
-
-Test Case: Packet integrity test
-================================
-
-Capture output packets selectively and check that the packet headers are as
-expected, with the payload not corrupted or truncated.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports.
-
-Test Case: Cable removal test
-=============================
-
-Check that the traffic stops when the cable is removed and resumes with no drop
-in the throughput rate after the cable is reinserted.
-
-Test Case: Mix of different NIC types
-=====================================
-
-Check that a mix of different NIC types is supported. The system should
-recognize all the NICs that are part of the system and are supported by the
-DPDK PMD. Check that ports from NICs of different type can send and
-receive traffic at the same time.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 1GbE ports (e.g. Intel 82576 NIC) and
-two 10GbE ports (e.g. Intel 82599 NIC).
-
-Test Case: Coexistence of kernel space drivers with Poll Mode Drivers
-=====================================================================
-
-Verify that DPDK PMD running in user space can work with the kernel
-space space NIC drivers.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 1GbE ports (e.g. Intel 82576 NIC) and
-two 10GbE ports (e.g. Intel 82599 NIC). Kernel space driver for Intel 82576 NIC
-used for management.
--
2.25.1
^ permalink raw reply [flat|nested] 3+ messages in thread
* [PATCH] test_plans: remove NICStatistics and stability
@ 2022-06-21 6:35 Lijuan Tu
2022-06-21 6:57 ` lijuan.tu
0 siblings, 1 reply; 3+ messages in thread
From: Lijuan Tu @ 2022-06-21 6:35 UTC (permalink / raw)
To: dts; +Cc: Lijuan Tu
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=a, Size: 9540 bytes --]
They are out of maintenance for some years.
Signed-off-by: Lijuan Tu <lijuan.tu@intel.com>
---
test_plans/NICStatistics_test_plan.rst | 118 -------------------------
test_plans/index.rst | 2 -
test_plans/stability_test_plan.rst | 68 --------------
3 files changed, 188 deletions(-)
delete mode 100644 test_plans/NICStatistics_test_plan.rst
delete mode 100644 test_plans/stability_test_plan.rst
diff --git a/test_plans/NICStatistics_test_plan.rst b/test_plans/NICStatistics_test_plan.rst
deleted file mode 100644
index 3ed6a917..00000000
--- a/test_plans/NICStatistics_test_plan.rst
+++ /dev/null
@@ -1,118 +0,0 @@
-.. SPDX-License-Identifier: BSD-3-Clause
- Copyright(c) 2010-2017 Intel Corporation
-
-====================
-NIC Statistics Tests
-====================
-
-This document provides benchmark tests for the userland Intel®
-82599 Gigabit Ethernet Controller Poll Mode Driver (PMD).
-The userland PMD application runs the ``IO forwarding mode`` test
-described in the PMD test plan document with different parameters for
-the configuration of 82599 NIC ports.
-
-The core configuration description is:
-
-- 1C/1T: 1 Physical Core, 1 Logical Core per physical core (1 Hyperthread)
- using core #2 (socket 0, 2nd physical core)
-
-- 1C/2T: 1 Physical Core, 2 Logical Cores per physical core (2 Hyperthreads)
- using core #2 and #14 (socket 0, 2nd physical core, 2 Hyperthreads)
-
-- 2C/1T: 2 Physical Cores, 1 Logical Core per physical core
- using core #2 and #4 (socket 0, 2nd and 3rd physical cores)
-
-
-Prerequisites
-=============
-
-Each of the 10Gb Ethernet* ports of the DUT is directly connected in
-full-duplex to a different port of the peer traffic generator.
-
-Using interactive commands, the traffic generator can be configured to
-send and receive in parallel, on a given set of ports.
-
-The tool ``vtbwrun`` (included in Intel® VTune™ Performance Analyzer)
-will be used to monitor memory activities while running network
-benchmarks to check the number of ``Memory Partial Writes`` and the
-distribution of memory accesses among available Memory Channels. This
-will only be done on the userland application, as the tool requires a
-Linux environment to be running in order to be used.
-
-If using vfio the kernel must be >= 3.6+ and VT-d must be enabled in bios.When
-using vfio, use the following commands to load the vfio driver and bind it
-to the device under test::
-
- modprobe vfio
- modprobe vfio-pci
- usertools/dpdk-devbind.py --bind=vfio-pci device_bus_id
-
-Test Case: Performance Benchmarking
-===================================
-
-The linuxapp is started with the following parameters, for each of
-the configurations referenced above:
-
-1C/1T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x4 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-1C/2T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x4004 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-2C/1T::
-
- -c 0xffffff -n 3 -- -i --coremask=0x14 \
- --rxd=512 --txd=512 --burst=32 --txfreet=32 --rxfreet=64 --mbcache=128 --portmask=0xffff \
- --rxpt=4 --rxht=4 --rxwt=16 --txpt=36 --txht=0 --txwt=0 --txrst=32
-
-
-The throughput is measured for each of these cases for the packet size
-of 64, 65, 128, 256, 512, 1024, 1280 and 1518 bytes.
-The results are printed in the following table:
-
-+-------+---------+---------+---------+-----------+
-| Frame | 1C/1T | 1C/2T | 2C/1 | wirespeed |
-| Size | | | | |
-+-------+---------+---------+---------+-----------+
-| 64 | | | | |
-+-------+---------+---------+---------+-----------+
-| 65 | | | | |
-+-------+---------+---------+---------+-----------+
-| 128 | | | | |
-+-------+---------+---------+---------+-----------+
-| 256 | | | | |
-+-------+---------+---------+---------+-----------+
-| 512 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1024 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1280 | | | | |
-+-------+---------+---------+---------+-----------+
-| 1518 | | | | |
-+-------+---------+---------+---------+-----------+
-
-
-The memory partial writes are measured with the ``vtbwrun`` application and printed
-in the following table:::
-
-
- Sampling Duration: 000000.00 micro-seconds
- --- Logical Processor 0 ---||--- Logical Processor 1 ---
- ---------------------------------------||---------------------------------------
- --- Intersocket QPI Utilization ---||--- Intersocket QPI Utilization ---
- ---------------------------------------||---------------------------------------
- --- Reads (MB/s): 0.00 ---||--- Reads (MB/s): 0.00 ---
- --- Writes(MB/s): 0.00 ---||--- Writes(MB/s): 0.00 ---
- ---------------------------------------||---------------------------------------
- --- Memory Performance Monitoring ---||--- Memory Performance Monitoring ---
- ---------------------------------------||---------------------------------------
- --- Mem Ch 0: #Ptl Wr: 0000.00 ---||--- Mem Ch 0: #Ptl Wr: 0.00 ---
- --- Mem Ch 1: #Ptl Wr: 0000.00 ---||--- Mem Ch 1: Ptl Wr (MB/s): 0.00 ---
- --- Mem Ch 2: #Ptl Wr: 0000.00 ---||--- Mem Ch 2: #Ptl Wr: 0.00 ---
- --- ND0 Mem #Ptl Wr: 0000.00 ---||--- ND1 #Ptl Wr: 0.00 ---
diff --git a/test_plans/index.rst b/test_plans/index.rst
index 10ca5fdc..a78dd0f5 100644
--- a/test_plans/index.rst
+++ b/test_plans/index.rst
@@ -104,7 +104,6 @@ The following are the test plans for the DPDK DTS automated test system.
metering_and_policing_test_plan
mtu_update_test_plan
multiple_pthread_test_plan
- NICStatistics_test_plan
ntb_test_plan
nvgre_test_plan
perf_virtio_user_loopback_test_plan
@@ -144,7 +143,6 @@ The following are the test plans for the DPDK DTS automated test system.
vhost_user_interrupt_test_plan
vhost_user_interrupt_cbdma_test_plan
sriov_kvm_test_plan
- stability_test_plan
stats_checks_test_plan
eventdev_pipeline_test_plan
tso_test_plan
diff --git a/test_plans/stability_test_plan.rst b/test_plans/stability_test_plan.rst
deleted file mode 100644
index 6e3ab01a..00000000
--- a/test_plans/stability_test_plan.rst
+++ /dev/null
@@ -1,68 +0,0 @@
-.. SPDX-License-Identifier: BSD-3-Clause
- Copyright(c) 2011-2017 Intel Corporation
-
-===============
-Stability Tests
-===============
-
-This is the test report for the Intel® DPDK Linux user space stability tests
-described in the test plan document.
-
-Test Case: Stress test
-======================
-
-Run under heavy traffic for a long time. At the end of the test period, check
-that the traffic is still flowing and there is no drop in the throughput rate.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports. Recommended test duration:
-24 hours.
-
-Test Case: Repetitive system restart
-====================================
-
-Check that the system is still working after the application is shut down and
-restarted repeatedly under heavy traffic load. After the last test iteration,
-the traffic should still be flowing through the system with no drop in the
-throughput rate.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports.
-
-Test Case: Packet integrity test
-================================
-
-Capture output packets selectively and check that the packet headers are as
-expected, with the payload not corrupted or truncated.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 10GbE ports.
-
-Test Case: Cable removal test
-=============================
-
-Check that the traffic stops when the cable is removed and resumes with no drop
-in the throughput rate after the cable is reinserted.
-
-Test Case: Mix of different NIC types
-=====================================
-
-Check that a mix of different NIC types is supported. The system should
-recognize all the NICs that are part of the system and are supported by the
-DPDK PMD. Check that ports from NICs of different type can send and
-receive traffic at the same time.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 1GbE ports (e.g. Intel 82576 NIC) and
-two 10GbE ports (e.g. Intel 82599 NIC).
-
-Test Case: Coexistence of kernel space drivers with Poll Mode Drivers
-=====================================================================
-
-Verify that DPDK PMD running in user space can work with the kernel
-space space NIC drivers.
-
-Recommended test configuration: testpmd application using a single logical core
-to handle line rate traffic from two 1GbE ports (e.g. Intel 82576 NIC) and
-two 10GbE ports (e.g. Intel 82599 NIC). Kernel space driver for Intel 82576 NIC
-used for management.
--
2.25.1
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2022-06-21 6:57 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-05-25 11:24 [PATCH] test_plans: remove NICStatistics and stability Lijuan Tu
2022-06-21 6:35 Lijuan Tu
2022-06-21 6:57 ` lijuan.tu
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).