[dts] [dts 1/3] [PATCH V2] add shutdown api test for niantic and fortville NIC test

[dts] [dts 1/3] [PATCH V2] add shutdown api test for niantic and fortville NIC test

[huilong,xu]

From: huilong xu <huilongx.xu@intel.com>


Signed-off-by: huilong xu <huilongx.xu@intel.com>
---
 executions/execution.cfg     |    3 ++-
 executions/execution_FVL.cfg |    3 ++-
 2 files changed, 4 insertions(+), 2 deletions(-)

diff --git a/executions/execution.cfg b/executions/execution.cfg
index e5c6198..a749008 100644
--- a/executions/execution.cfg
+++ b/executions/execution.cfg
@@ -19,7 +19,8 @@ test_suites=
     pmd_bonded,
     dynamic_config,
     generic_filter,
-    dual_vlan
+    dual_vlan,
+    shutdown_api
 targets=
     x86_64-native-linuxapp-gcc
 parameters=nic_type=cfg:func=true
diff --git a/executions/execution_FVL.cfg b/executions/execution_FVL.cfg
index 12990d8..bd278ba 100644
--- a/executions/execution_FVL.cfg
+++ b/executions/execution_FVL.cfg
@@ -6,7 +6,8 @@ test_suites=
     dynamic_config,
     generic_filter,
     dual_vlan,
-    vlan
+    vlan,
+    shutdown_api
 targets=
     x86_64-native-linuxapp-gcc
 parameters=nic_type=cfg:func=true
-- 
1.7.4.4

[dts] [dts 2/3] [PATCH V2] add shutdown api test plan

[huilong,xu]

From: huilong xu <huilongx.xu@intel.com>


Signed-off-by: huilong xu <huilongx.xu@intel.com>
---
 test_plans/shutdown_api_test_plan.rst |  167 +++++++++++++++++++++++++++++++++
 1 files changed, 167 insertions(+), 0 deletions(-)
 create mode 100644 test_plans/shutdown_api_test_plan.rst

diff --git a/test_plans/shutdown_api_test_plan.rst b/test_plans/shutdown_api_test_plan.rst
new file mode 100644
index 0000000..0dd47b9
--- /dev/null
+++ b/test_plans/shutdown_api_test_plan.rst
@@ -0,0 +1,167 @@
+.. <COPYRIGHT_TAG>
+
+======================================
+Intel® DPDK Shutdown API Feature Tests
+======================================
+
+This tests for Shutdown API feature can be run on linux userspace. It
+will check if NIC port can be stopped and restarted without exiting the
+application process. Furthermore, it will check if it can reconfigure
+new configurations for a port after the port is stopped, and if it is
+able to restart with those new configurations. It is based on testpmd
+application.
+
+The test is performed by running the testpmd application and using a
+traffic generator. Port/queue configurations can be set interactively,
+and still be set at the command line when launching the application in
+order to be compatible with previous test framework.
+
+Prerequisites
+-------------
+
+Support igb_uio and vfio driver, if used vfio, kernel need 3.6+ and enable vt-d in bios.
+When used vfio , used "modprobe vfio" and "modprobe vfio-pci" insmod vfiod driver, then used
+"./tools/dpdk_nic_bind.py --bind=vfio-pci device_bus_id" to bind vfio driver to test driver.
+
+Assume port A and B are connected to the remote ports, e.g. packet generator.
+To run the testpmd application in linuxapp environment with 4 lcores,
+4 channels with other default parameters in interactive mode.
+
+	$ ./testpmd -c 0xf -n 4 -- -i
+
+Test Case: Stop and Restart
+---------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "start" to start forwarding packets.
+3. check that testpmd is able to forward traffic.
+4. run "stop" to stop forwarding packets.
+5. run "port stop all" to stop all ports.
+6. check on the tester side that the ports are down using ethtool.
+7. run "port start all" to restart all ports.
+8. check on the tester side that the ports are up using ethtool
+9. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully.
+
+Test Case: Reset RX/TX Queues
+-----------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config all rxq 2" to change the number of receiving queues to two.
+4. run "port config all txq 2" to change the number of transmiting queues to two.
+5. run "port start all" to restart all ports.
+6. check with "show config rxtx" that the configuration for these parameters changed.
+7. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully.
+
+Test Case: Set promiscuous mode
+-------------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if promiscuous mode setting works well after reconfiguring
+it while all ports are stopped
+2. run "port stop all" to stop all ports.
+3. run "set promisc all off" to disable promiscuous mode on all ports.
+4. run "port start all" to restart all ports.
+5. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check that testpmd is NOT able to receive and forward packets
+successfully.
+6. run "port stop all" to stop all ports.
+7. run "set promisc all on" to enable promiscuous mode on all ports.
+8. run "port start all" to restart all ports.
+9. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check that testpmd is able to receive and forward packets
+successfully.
+
+
+
+Test Case: Reconfigure All Ports With The Same Configurations (CRC)
+-------------------------------------------------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config all crc-strip on" to enable the CRC stripping mode.
+4. run "port start all" to restart all ports.
+5. check with "show config rxtx" that the configuration for these parameters changed.
+6. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully. Check that the packet received is 4 bytes smaller than the packet sent.
+
+Test Case: Change Link Speed
+----------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config all speed SPEED duplex HALF/FULL" to select the new config for the link.
+4. run "port start all" to restart all ports.
+5. check on the tester side that the configuration actually changed using ethtool.
+6. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully.
+7. repeat this process for every compatible speed depending on the NIC driver.
+
+Test Case: Enable/Disable Jumbo Frame
+-------------------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config all max-pkt-len 2048" to set the maximum packet length.
+4. run "port start all" to restart all ports.
+5. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully. Check this with the following packet sizes: 2047, 2048 & 2049. Only the third one should fail.
+
+Test Case: Enable/Disable RSS
+-----------------------------
+
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config rss ip" to enable RSS.
+4. run "port start all" to restart all ports.
+5. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully.
+
+Test Case: Change the Number of rxd/txd
+---------------------------------------
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "port stop all" to stop all ports.
+3. run "port config all rxd 1024" to change the rx descriptors.
+4. run "port config all txd 1024" to change the tx descriptors.
+5. run "port start all" to restart all ports.
+6. check with "show config rxtx" that the descriptors were actually changed.
+6. run "start" again to restart the forwarding, then start packet generator to transmit
+and receive packets, and check if testpmd is able to receive and forward packets
+successfully.
+
+Test Case: link stats
+---------------------------------------
+1. If the testpmd application is not launched, run it as above command. Follow
+below steps to check if it works well after reconfiguring all ports without
+changing any configurations.
+2. run "set fwd mac" to set fwd type.
+3. run "start" to start the forwarding, then start packet generator to transmit
+and receive packets
+4. run "set link-down port X" to set all port link down
+5. check on the tester side that the configuration actually changed using ethtool.
+6. start packet generator to transmit and not receive packets
+7. run "set link-up port X" to set all port link up
+8. start packet generator to transmit and receive packets
+successfully
-- 
1.7.4.4

Re: [dts] [dts 2/3] [PATCH V2] add shutdown api test plan

[Fu, JingguoX]

> -----Original Message-----
> From: Xu, HuilongX
> Sent: Friday, May 29, 2015 10:19
> To: dts@dpdk.org
> Cc: Fu, JingguoX; Xu, HuilongX
> Subject: [dts 2/3] [PATCH V2] add shutdown api test plan
> 
> From: huilong xu <huilongx.xu@intel.com>
> 
> 
> Signed-off-by: huilong xu <huilongx.xu@intel.com>
> ---
>  test_plans/shutdown_api_test_plan.rst |  167
> +++++++++++++++++++++++++++++++++
>  1 files changed, 167 insertions(+), 0 deletions(-)
>  create mode 100644 test_plans/shutdown_api_test_plan.rst
> 
> diff --git a/test_plans/shutdown_api_test_plan.rst
> b/test_plans/shutdown_api_test_plan.rst
> new file mode 100644
> index 0000000..0dd47b9
> --- /dev/null
> +++ b/test_plans/shutdown_api_test_plan.rst
> @@ -0,0 +1,167 @@
> +.. <COPYRIGHT_TAG>
> +
> +======================================
> +Intel® DPDK Shutdown API Feature Tests
> +======================================
> +
> +This tests for Shutdown API feature can be run on linux userspace. It
> +will check if NIC port can be stopped and restarted without exiting the
> +application process. Furthermore, it will check if it can reconfigure
> +new configurations for a port after the port is stopped, and if it is
> +able to restart with those new configurations. It is based on testpmd
> +application.
> +
> +The test is performed by running the testpmd application and using a
> +traffic generator. Port/queue configurations can be set interactively,
> +and still be set at the command line when launching the application in
> +order to be compatible with previous test framework.
> +
> +Prerequisites
> +-------------
> +
> +Support igb_uio and vfio driver, if used vfio, kernel need 3.6+ and enable
> vt-d in bios.
> +When used vfio , used "modprobe vfio" and "modprobe vfio-pci" insmod vfiod
> driver, then used
> +"./tools/dpdk_nic_bind.py --bind=vfio-pci device_bus_id" to bind vfio driver
> to test driver.
> +
> +Assume port A and B are connected to the remote ports, e.g. packet generator.
> +To run the testpmd application in linuxapp environment with 4 lcores,
> +4 channels with other default parameters in interactive mode.
> +
> +	$ ./testpmd -c 0xf -n 4 -- -i
> +
> +Test Case: Stop and Restart
> +---------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "start" to start forwarding packets.
> +3. check that testpmd is able to forward traffic.
> +4. run "stop" to stop forwarding packets.
> +5. run "port stop all" to stop all ports.
> +6. check on the tester side that the ports are down using ethtool.
> +7. run "port start all" to restart all ports.
> +8. check on the tester side that the ports are up using ethtool
> +9. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully.
> +
> +Test Case: Reset RX/TX Queues
> +-----------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config all rxq 2" to change the number of receiving queues to
> two.
> +4. run "port config all txq 2" to change the number of transmiting queues to
> two.
> +5. run "port start all" to restart all ports.
> +6. check with "show config rxtx" that the configuration for these parameters
> changed.
> +7. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully.
> +
> +Test Case: Set promiscuous mode
> +-------------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if promiscuous mode setting works well after
> reconfiguring
> +it while all ports are stopped
> +2. run "port stop all" to stop all ports.
> +3. run "set promisc all off" to disable promiscuous mode on all ports.
> +4. run "port start all" to restart all ports.
> +5. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check that testpmd is NOT able to receive and
> forward packets
> +successfully.
> +6. run "port stop all" to stop all ports.
> +7. run "set promisc all on" to enable promiscuous mode on all ports.
> +8. run "port start all" to restart all ports.
> +9. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check that testpmd is able to receive and forward
> packets
> +successfully.
> +
> +
> +
> +Test Case: Reconfigure All Ports With The Same Configurations (CRC)
> +-------------------------------------------------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config all crc-strip on" to enable the CRC stripping mode.
> +4. run "port start all" to restart all ports.
> +5. check with "show config rxtx" that the configuration for these parameters
> changed.
> +6. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully. Check that the packet received is 4 bytes smaller than the
> packet sent.
> +
> +Test Case: Change Link Speed
> +----------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config all speed SPEED duplex HALF/FULL" to select the new
> config for the link.
> +4. run "port start all" to restart all ports.
> +5. check on the tester side that the configuration actually changed using
> ethtool.
> +6. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully.
> +7. repeat this process for every compatible speed depending on the NIC driver.
> +
> +Test Case: Enable/Disable Jumbo Frame
> +-------------------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config all max-pkt-len 2048" to set the maximum packet length.
> +4. run "port start all" to restart all ports.
> +5. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully. Check this with the following packet sizes: 2047, 2048 & 2049.
> Only the third one should fail.
> +
> +Test Case: Enable/Disable RSS
> +-----------------------------
> +
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config rss ip" to enable RSS.
> +4. run "port start all" to restart all ports.
> +5. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully.
> +
> +Test Case: Change the Number of rxd/txd
> +---------------------------------------
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "port stop all" to stop all ports.
> +3. run "port config all rxd 1024" to change the rx descriptors.
> +4. run "port config all txd 1024" to change the tx descriptors.
> +5. run "port start all" to restart all ports.
> +6. check with "show config rxtx" that the descriptors were actually changed.
> +6. run "start" again to restart the forwarding, then start packet generator
> to transmit
> +and receive packets, and check if testpmd is able to receive and forward
> packets
> +successfully.
> +
> +Test Case: link stats
> +---------------------------------------
> +1. If the testpmd application is not launched, run it as above command.
> Follow
> +below steps to check if it works well after reconfiguring all ports without
> +changing any configurations.
> +2. run "set fwd mac" to set fwd type.
> +3. run "start" to start the forwarding, then start packet generator to
> transmit
> +and receive packets
> +4. run "set link-down port X" to set all port link down
> +5. check on the tester side that the configuration actually changed using
> ethtool.
> +6. start packet generator to transmit and not receive packets
> +7. run "set link-up port X" to set all port link up
> +8. start packet generator to transmit and receive packets
> +successfully
> --
> 1.7.4.4

Acked-by: Jingguo Fu <jingguox.fu@intel.com>

[dts] [dts 3/3] [PATCH V2] add shutdown api test code

[huilong,xu]

From: huilong xu <huilongx.xu@intel.com>


Signed-off-by: huilong xu <huilongx.xu@intel.com>
---
 tests/TestSuite_shutdown_api.py |  488 +++++++++++++++++++++++++++++++++++++++
 1 files changed, 488 insertions(+), 0 deletions(-)
 create mode 100644 tests/TestSuite_shutdown_api.py

diff --git a/tests/TestSuite_shutdown_api.py b/tests/TestSuite_shutdown_api.py
new file mode 100644
index 0000000..fd38ae8
--- /dev/null
+++ b/tests/TestSuite_shutdown_api.py
@@ -0,0 +1,488 @@
+# <COPYRIGHT_TAG>
+
+"""
+DPDK Test suite.
+
+Test Shutdown API Feature
+
+"""
+
+import dts
+import time
+import re
+import os
+from test_case import TestCase
+from pmd_output import PmdOutput
+from setting import HEADER_SIZE
+
+#
+#
+# Test class.
+#
+
+
+class TestShutdownApi(TestCase):
+
+    #
+    #
+    #
+    # Test cases.
+    #
+
+    def set_up_all(self):
+        """
+        Run at the start of each test suite.
+        """
+        self.ports = self.dut.get_ports()
+        print self.nic, self.ports
+        self.verify(len(self.ports) >= 2, "Insufficient number of ports.")
+        self.ports_socket = self.dut.get_numa_id(self.ports[0])
+
+        for port in self.ports:
+            self.tester.send_expect("ifconfig %s mtu %s" % (
+                self.tester.get_interface(self.tester.get_local_port(port)), 5000), "# ")
+
+        self.pmdout = PmdOutput(self.dut)
+
+    def get_stats(self, portid):
+        """
+        Get packets number from port statistic.
+        """
+        output = PmdOutput(self.dut)
+        stats = output.get_pmd_stats(portid)
+        return stats
+
+    def check_forwarding(self, ports, nic, testerports=[None, None], pktSize=64, received=True, crcStrip=False, vlan=False):
+        for i in range(len(ports)):
+            if i % 2 == 0:
+                self.send_packet(ports[i], ports[i + 1], self.nic, testerports[1], pktSize, received, crcStrip=crcStrip, vlan=vlan)
+                self.send_packet(ports[i + 1], ports[i], self.nic, testerports[0], pktSize, received, crcStrip=crcStrip, vlan=vlan)
+
+    def send_packet(self, txPort, rxPort, nic, testerports=None, pktSize=64, received=True, crcStrip=False, vlan=False):
+        """
+        Send packages according to parameters.
+        """
+        port0_stats = self.get_stats(txPort)
+        gp0tx_pkts, gp0tx_bytes = [port0_stats['TX-packets'], port0_stats['TX-bytes']]
+        port1_stats = self.get_stats(rxPort)
+        gp1rx_pkts, gp1rx_err, gp1rx_bytes = [port1_stats['RX-packets'], port1_stats['RX-errors'], port1_stats['RX-bytes']]
+        time.sleep(5)
+
+        if testerports is None:
+            itf = self.tester.get_interface(self.tester.get_local_port(rxPort))
+        else:
+            itf = testerports
+        mac = self.dut.get_mac_address(txPort)
+
+        self.tester.scapy_foreground()
+        if self.nic in ["fortville_eagle", "fortville_spirit",
+                        "fortville_spirit_single", "bartonhills",
+                        "powerville", "springville", "hartwell"]:
+            pktlen = pktSize - HEADER_SIZE['eth'] -4 
+        else:
+            pktlen = pktSize - HEADER_SIZE['eth']
+        padding = pktlen - HEADER_SIZE['ip']
+
+        if vlan:
+            self.tester.scapy_append('sendp([Ether(dst="%s")/Dot1Q(vlan=1)/IP()/Raw(load="\x50"*%s)], iface="%s")' % (mac, padding, itf))
+        else:
+            self.tester.scapy_append('sendp([Ether(dst="%s")/IP()/Raw(load="\x50"*%s)], iface="%s")' % (mac, padding, itf))
+
+        self.tester.scapy_execute()
+        time.sleep(3)
+
+        port0_stats = self.get_stats(txPort)
+        p0tx_pkts, p0tx_bytes = [port0_stats['TX-packets'], port0_stats['TX-bytes']]
+        port1_stats = self.get_stats(rxPort)
+        p1rx_pkts, p1rx_err, p1rx_bytes = [port1_stats['RX-packets'], port1_stats['RX-errors'], port1_stats['RX-bytes']]
+        time.sleep(5)
+
+        p0tx_pkts -= gp0tx_pkts
+        p0tx_bytes -= gp0tx_bytes
+        p1rx_pkts -= gp1rx_pkts
+        p1rx_bytes -= gp1rx_bytes
+        p1rx_err -= gp1rx_err
+        if received:
+
+            if vlan:
+                self.verify(p0tx_pkts == p1rx_pkts,
+                            "Wrong TX pkts p0_tx=%d, p1_rx=%d" % (p0tx_pkts, p1rx_pkts))
+            else:
+                if self.nic in ["fortville_eagle", "fortville_spirit",
+                                "fortville_spirit_single", "bartonhills",
+                                "powerville", "springville", "hartwell"]:
+
+                    self.verify(p0tx_bytes == pktSize,
+                                "Wrong TX bytes p0_tx=%d, pktSize=%d" % (p0tx_bytes, pktSize))
+                else:
+                    self.verify(p0tx_bytes == pktSize,
+                                "Wrong TX bytes p0_tx=%d, pktSize=%d" % (p0tx_bytes, pktSize))
+            if crcStrip:
+                if self.nic in ["fortville_eagle", "fortville_spirit",
+                                "fortville_spirit_single", "bartonhills",
+                                "powerville", "springville", "hartwell"]:
+                    self.verify(p1rx_bytes - 4 == pktSize,
+                                "Wrong RX bytes CRC strip: p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
+                else:
+                    self.verify(p1rx_bytes == pktSize - 4,
+                                "Wrong RX bytes CRC strip: p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
+            else:
+                if vlan:
+                    if self.nic in ["fortville_eagle", "fortville_spirit",
+                                    "fortville_spirit_single", "bartonhills",
+                                    "powerville", "springville", "hartwell"]:
+                            self.verify(p1rx_bytes == pktSize,
+                                        "Wrong RX bytes No CRC strip: p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
+                    else:
+                        self.verify(p1rx_bytes == pktSize + 4,
+                                    "Wrong RX bytes No CRC strip: p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
+                else:
+                    self.verify(p1rx_bytes == pktSize,
+                                "Wrong RX bytes No CRC strip: p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
+        else:
+            self.verify(
+                p0tx_pkts == 0, "Packet not dropped p0tx_pkts=%d" % p0tx_pkts)
+            self.verify(
+                p0tx_bytes == 0, "Packet not dropped p0tx_bytes=%d" % p0tx_bytes)
+
+    def check_ports(self, ports, status):
+        """
+            Check link status of the ports.
+        """
+        for port in ports:
+            out = self.tester.send_expect(
+                "ethtool %s" % self.tester.get_interface(self.tester.get_local_port(port)), "# ")
+            if status:
+                self.verify("Link detected: yes" in out, "Wrong link status")
+            else:
+                self.verify("Link detected: no" in out, "Wrong link status")
+
+    def set_up(self):
+        """
+        Run before each test case.
+        """
+        pass
+
+    def test_stop_restart(self):
+        """
+        Stop and Restar.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+        self.dut.send_expect("stop", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic, received=False)
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.check_ports(self.ports, False)
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.check_ports(self.ports, True)
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+    def test_set_promiscuousmode(self):
+        """
+        Promiscuous mode.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask([self.ports[0], self.ports[1]]), self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("set promisc all off", "testpmd> ")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.dut.send_expect("start", "testpmd> ")
+
+        try:
+            self.check_forwarding([self.ports[0], self.ports[1]], self.nic)
+        except dts.VerifyFailure as e:
+            print 'promiscuous mode is working correctly'
+        except Exception as e:
+            print "   !!! DEBUG IT: " + e.message
+            return "FAIL"
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("set promisc all on", "testpmd> ")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding([self.ports[0], self.ports[1]], self.nic)
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("set promisc all off", "testpmd> ")
+        self.dut.send_expect("start", "testpmd> ")
+        self.dut.send_expect("quit", "# ", 30)
+
+    def test_reset_queues(self):
+        """
+        Reset RX/TX Queues.
+        """
+        testerports = [self.tester.get_interface(self.tester.get_local_port(self.ports[0])),
+                       self.tester.get_interface(self.tester.get_local_port(self.ports[1]))
+                       ]
+        #blackList = self.dut.create_blacklist_string(self.target, self.nic)
+
+        self.pmdout.start_testpmd("1S/8C/1T", "--portmask=%s" % dts.create_mask([self.ports[0], self.ports[1]]), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all rxq 2", "testpmd> ")
+        self.dut.send_expect("port config all txq 2", "testpmd> ")
+        #self.dut.send_expect("set coremask 0x1e", "testpmd> ")
+        self.dut.send_expect("set coremask 0xe0", "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify("RX queues=2" in out, "RX queues not reconfigured properly")
+        self.verify("TX queues=2" in out, "TX queues not reconfigured properly")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding([0, 1], self.nic, testerports)
+        self.dut.send_expect("quit", "# ", 30)
+        #self.dut.send_expect("rmmod igb_uio", "# ", 20)
+        #self.dut.send_expect("insmod ./%s/kmod/igb_uio.ko" % self.target, "#")
+        #self.dut.bind_interfaces_linux()
+
+    def test_reconfigure_ports(self):
+        """
+        Reconfigure All Ports With The Same Configurations (CRC)
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all crc-strip on", "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify(
+            "CRC stripping enabled" in out, "CRC stripping not enabled properly")
+        self.dut.send_expect("start", "testpmd> ")
+        if self.nic in ["fortville_eagle", "fortville_spirit", "fortville_spirit_single"]:
+            self.check_forwarding(self.ports, self.nic, crcStrip=False)
+        else:
+            self.check_forwarding(self.ports, self.nic, crcStrip=True)
+             
+
+    def test_change_linkspeed(self):
+        """
+        Change Link Speed.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        out = self.tester.send_expect(
+            "ethtool %s" % self.tester.get_interface(self.tester.get_local_port(self.ports[0])), "# ")
+        if 'fortville_spirit' == self.nic:
+            result_scanner = r"([0-9]+)baseSR4/([A-Za-z]+)"
+        else:
+            result_scanner = r"([0-9]+)baseT/([A-Za-z]+)"
+        scanner = re.compile(result_scanner, re.DOTALL)
+        m = scanner.findall(out)
+        configs = m[:-(len(m) / 2)]
+        for config in configs:
+            print config
+            self.dut.send_expect("port stop all", "testpmd> ", 100)
+            for port in self.ports:
+                self.dut.send_expect("port config %d speed %s duplex %s" % (port,
+                                                                            config[0], config[1].lower()), "testpmd> ")
+            self.dut.send_expect("set fwd mac", "testpmd>")
+            self.dut.send_expect("port start all", "testpmd> ", 100)
+            time.sleep(5)  # sleep few seconds for link stable
+
+            for port in self.ports:
+                out = self.tester.send_expect(
+                    "ethtool %s" % self.tester.get_interface(self.tester.get_local_port(port)), "# ")
+                self.verify("Speed: %s" % config[0] in out,
+                            "Wrong speed reported by the self.tester.")
+                self.verify("Duplex: %s" % config[1] in out,
+                            "Wrong link type reported by the self.tester.")
+            self.dut.send_expect("start", "testpmd> ")
+            self.check_forwarding(self.ports, self.nic)
+            self.dut.send_expect("stop", "testpmd> ")
+
+    def failed_test_enable_disablejumbo(self):
+        """
+        Enable/Disable Jumbo Frames.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("vlan set strip off all", "testpmd> ")
+        self.dut.send_expect("port config all max-pkt-len 2048", "testpmd> ")
+        for port in self.ports:
+            self.dut.send_expect("rx_vlan add 1 %d" % port, "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.dut.send_expect("start", "testpmd> ")
+
+        self.check_forwarding(self.ports, self.nic, pktSize=2047, vlan=True)
+        self.check_forwarding(self.ports, self.nic, pktSize=2048, vlan=True)
+        self.check_forwarding(self.ports, self.nic, pktSize=2049, received=False, vlan=True)
+
+        self.dut.send_expect("stop", "testpmd> ")
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all hw-vlan off", "testpmd> ")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.dut.send_expect("start", "testpmd> ")
+        if ((self.nic == "bartonhills") or (self.nic == "powerville") or (self.nic == "springville") or (self.nic == "hartwell")):
+            self.check_forwarding(self.ports, self.nic, pktSize=2051)
+            self.check_forwarding(self.ports, self.nic, pktSize=2052)
+            self.check_forwarding(self.ports, self.nic, pktSize=2053, received=False)
+        else:
+            self.check_forwarding(self.ports, self.nic, pktSize=2047)
+            self.check_forwarding(self.ports, self.nic, pktSize=2048)
+            self.check_forwarding(self.ports, self.nic, pktSize=2049, received=False)
+
+    def test_enable_disablerss(self):
+        """
+        Enable/Disable RSS.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config rss ip", "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+    def test_change_numberrxdtxd(self):
+        """
+        Enable/Disable Jumbo Frame.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all rxd 1024", "testpmd> ")
+        self.dut.send_expect("port config all txd 1024", "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify(
+            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
+        self.verify(
+            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+    def test_change_numberrxdtxdaftercycle(self):
+        """
+        Change the Number of rxd/txd.
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all rxd 1024", "testpmd> ")
+        self.dut.send_expect("port config all txd 1024", "testpmd> ")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify(
+            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
+        self.verify(
+            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+        self.dut.send_expect("stop", "testpmd> ")
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify(
+            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
+        self.verify(
+            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+    def test_change_thresholds(self):
+        """
+        Change RX/TX thresholds
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.dut.send_expect("port stop all", "testpmd> ", 100)
+        self.dut.send_expect("port config all txfreet 32", "testpmd> ")
+        self.dut.send_expect("port config all txrst 32", "testpmd> ")
+        self.dut.send_expect("port config all rxfreet 32", "testpmd> ")
+        self.dut.send_expect("port config all txpt 64", "testpmd> ")
+        self.dut.send_expect("port config all txht 64", "testpmd> ")
+        self.dut.send_expect("port config all txwt 0", "testpmd> ")
+        self.dut.send_expect("port config all rxpt 64", "testpmd> ")
+        self.dut.send_expect("port config all rxht 64", "testpmd> ")
+        self.dut.send_expect("port config all rxwt 64", "testpmd> ")
+        self.dut.send_expect("port start all", "testpmd> ", 100)
+        out = self.dut.send_expect("show config rxtx", "testpmd> ")
+        self.verify("RX free threshold=32" in out,
+                    "RX descriptor not reconfigured properly")
+        self.verify("TX free threshold=32" in out,
+                    "TX descriptor not reconfigured properly")
+        self.verify("TX RS bit threshold=32" in out,
+                    "TX descriptor not reconfigured properly")
+        self.verify("pthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.verify("hthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.verify("wthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.verify("pthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.verify("hthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.verify("wthresh=64" in out, "TX descriptor not reconfigured properly")
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("start", "testpmd> ")
+        self.check_forwarding(self.ports, self.nic)
+
+    def test_stress_test(self):
+        """
+        Start/stop stress test.
+        """
+        stress_iterations = 10
+
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+
+        self.tester.scapy_append('wrpcap("test.pcap", [Ether()/IP()/UDP()/()])')
+        tgenInput = []
+
+        for port in self.ports:
+            tgenInput.append((self.tester.get_local_port(
+                port), self.tester.get_local_port(port), "test.pcap"))
+
+        for _ in range(stress_iterations):
+            self.dut.send_expect("port stop all", "testpmd> ", 100)
+            self.dut.send_expect("set fwd mac", "testpmd>")
+            self.dut.send_expect("port start all", "testpmd> ", 100)
+            self.dut.send_expect("start", "testpmd> ")
+            self.check_forwarding(self.ports, self.nic)
+            self.dut.send_expect("stop", "testpmd> ")
+
+        self.dut.send_expect("quit", "# ")
+
+    def test_link_stats(self):
+        """
+        port link stats test
+        """
+        self.pmdout.start_testpmd("Default", "--portmask=%s" % dts.create_mask(self.ports), socket=self.ports_socket)
+        self.dut.send_expect("set fwd mac", "testpmd>")
+        self.dut.send_expect("start", "testpmd>")
+
+        # default test
+        # self.check_forwarding([0,1], self.nic)
+
+        ports_num = len(self.ports)
+        # link down test
+        for i in range(ports_num):
+            self.dut.send_expect("set link-down port %d" % i, "testpmd>")
+        # leep few seconds for NIC link status update
+        time.sleep(5)
+        self.check_ports(self.ports, False)
+
+        # link up test
+        for j in range(ports_num):
+            self.dut.send_expect("set link-up port %d" % j, "testpmd>")
+        time.sleep(5)
+        self.check_ports(self.ports, True)
+        self.check_forwarding(self.ports, self.nic)
+
+    def tear_down(self):
+        """
+        Run after each test case.
+        """
+        self.dut.kill_all()
+
+    def tear_down_all(self):
+        """
+        Run after each test suite.
+        """
+        self.dut.kill_all()
-- 
1.7.4.4

Re: [dts] [dts 3/3] [PATCH V2] add shutdown api test code

[Fu, JingguoX]

> -----Original Message-----
> From: Xu, HuilongX
> Sent: Friday, May 29, 2015 10:19
> To: dts@dpdk.org
> Cc: Fu, JingguoX; Xu, HuilongX
> Subject: [dts 3/3] [PATCH V2] add shutdown api test code
> 
> From: huilong xu <huilongx.xu@intel.com>
> 
> 
> Signed-off-by: huilong xu <huilongx.xu@intel.com>
> ---
>  tests/TestSuite_shutdown_api.py |  488
> +++++++++++++++++++++++++++++++++++++++
>  1 files changed, 488 insertions(+), 0 deletions(-)
>  create mode 100644 tests/TestSuite_shutdown_api.py
> 
> diff --git a/tests/TestSuite_shutdown_api.py b/tests/TestSuite_shutdown_api.py
> new file mode 100644
> index 0000000..fd38ae8
> --- /dev/null
> +++ b/tests/TestSuite_shutdown_api.py
> @@ -0,0 +1,488 @@
> +# <COPYRIGHT_TAG>
> +
> +"""
> +DPDK Test suite.
> +
> +Test Shutdown API Feature
> +
> +"""
> +
> +import dts
> +import time
> +import re
> +import os
> +from test_case import TestCase
> +from pmd_output import PmdOutput
> +from setting import HEADER_SIZE
> +
> +#
> +#
> +# Test class.
> +#
> +
> +
> +class TestShutdownApi(TestCase):
> +
> +    #
> +    #
> +    #
> +    # Test cases.
> +    #
> +
> +    def set_up_all(self):
> +        """
> +        Run at the start of each test suite.
> +        """
> +        self.ports = self.dut.get_ports()
> +        print self.nic, self.ports
> +        self.verify(len(self.ports) >= 2, "Insufficient number of ports.")
> +        self.ports_socket = self.dut.get_numa_id(self.ports[0])
> +
> +        for port in self.ports:
> +            self.tester.send_expect("ifconfig %s mtu %s" % (
> +                self.tester.get_interface(self.tester.get_local_port(port)),
> 5000), "# ")
> +
> +        self.pmdout = PmdOutput(self.dut)
> +
> +    def get_stats(self, portid):
> +        """
> +        Get packets number from port statistic.
> +        """
> +        output = PmdOutput(self.dut)
> +        stats = output.get_pmd_stats(portid)
> +        return stats
> +
> +    def check_forwarding(self, ports, nic, testerports=[None, None],
> pktSize=64, received=True, crcStrip=False, vlan=False):
> +        for i in range(len(ports)):
> +            if i % 2 == 0:
> +                self.send_packet(ports[i], ports[i + 1], self.nic,
> testerports[1], pktSize, received, crcStrip=crcStrip, vlan=vlan)
> +                self.send_packet(ports[i + 1], ports[i], self.nic,
> testerports[0], pktSize, received, crcStrip=crcStrip, vlan=vlan)
> +
> +    def send_packet(self, txPort, rxPort, nic, testerports=None, pktSize=64,
> received=True, crcStrip=False, vlan=False):
> +        """
> +        Send packages according to parameters.
> +        """
> +        port0_stats = self.get_stats(txPort)
> +        gp0tx_pkts, gp0tx_bytes = [port0_stats['TX-packets'],
> port0_stats['TX-bytes']]
> +        port1_stats = self.get_stats(rxPort)
> +        gp1rx_pkts, gp1rx_err, gp1rx_bytes = [port1_stats['RX-packets'],
> port1_stats['RX-errors'], port1_stats['RX-bytes']]
> +        time.sleep(5)
> +
> +        if testerports is None:
> +            itf =
> self.tester.get_interface(self.tester.get_local_port(rxPort))
> +        else:
> +            itf = testerports
> +        mac = self.dut.get_mac_address(txPort)
> +
> +        self.tester.scapy_foreground()
> +        if self.nic in ["fortville_eagle", "fortville_spirit",
> +                        "fortville_spirit_single", "bartonhills",
> +                        "powerville", "springville", "hartwell"]:
> +            pktlen = pktSize - HEADER_SIZE['eth'] -4
> +        else:
> +            pktlen = pktSize - HEADER_SIZE['eth']
> +        padding = pktlen - HEADER_SIZE['ip']
> +
> +        if vlan:
> +
> self.tester.scapy_append('sendp([Ether(dst="%s")/Dot1Q(vlan=1)/IP()/Raw(load="
> \x50"*%s)], iface="%s")' % (mac, padding, itf))
> +        else:
> +
> self.tester.scapy_append('sendp([Ether(dst="%s")/IP()/Raw(load="\x50"*%s)],
> iface="%s")' % (mac, padding, itf))
> +
> +        self.tester.scapy_execute()
> +        time.sleep(3)
> +
> +        port0_stats = self.get_stats(txPort)
> +        p0tx_pkts, p0tx_bytes = [port0_stats['TX-packets'], port0_stats['TX-
> bytes']]
> +        port1_stats = self.get_stats(rxPort)
> +        p1rx_pkts, p1rx_err, p1rx_bytes = [port1_stats['RX-packets'],
> port1_stats['RX-errors'], port1_stats['RX-bytes']]
> +        time.sleep(5)
> +
> +        p0tx_pkts -= gp0tx_pkts
> +        p0tx_bytes -= gp0tx_bytes
> +        p1rx_pkts -= gp1rx_pkts
> +        p1rx_bytes -= gp1rx_bytes
> +        p1rx_err -= gp1rx_err
> +        if received:
> +
> +            if vlan:
> +                self.verify(p0tx_pkts == p1rx_pkts,
> +                            "Wrong TX pkts p0_tx=%d, p1_rx=%d" % (p0tx_pkts,
> p1rx_pkts))
> +            else:
> +                if self.nic in ["fortville_eagle", "fortville_spirit",
> +                                "fortville_spirit_single", "bartonhills",
> +                                "powerville", "springville", "hartwell"]:
> +
> +                    self.verify(p0tx_bytes == pktSize,
> +                                "Wrong TX bytes p0_tx=%d, pktSize=%d" %
> (p0tx_bytes, pktSize))
> +                else:
> +                    self.verify(p0tx_bytes == pktSize,
> +                                "Wrong TX bytes p0_tx=%d, pktSize=%d" %
> (p0tx_bytes, pktSize))
> +            if crcStrip:
> +                if self.nic in ["fortville_eagle", "fortville_spirit",
> +                                "fortville_spirit_single", "bartonhills",
> +                                "powerville", "springville", "hartwell"]:
> +                    self.verify(p1rx_bytes - 4 == pktSize,
> +                                "Wrong RX bytes CRC strip: p1_rx=%d,
> pktSize=%d" % (p1rx_bytes, pktSize))
> +                else:
> +                    self.verify(p1rx_bytes == pktSize - 4,
> +                                "Wrong RX bytes CRC strip: p1_rx=%d,
> pktSize=%d" % (p1rx_bytes, pktSize))
> +            else:
> +                if vlan:
> +                    if self.nic in ["fortville_eagle", "fortville_spirit",
> +                                    "fortville_spirit_single", "bartonhills",
> +                                    "powerville", "springville", "hartwell"]:
> +                            self.verify(p1rx_bytes == pktSize,
> +                                        "Wrong RX bytes No CRC strip:
> p1_rx=%d, pktSize=%d" % (p1rx_bytes, pktSize))
> +                    else:
> +                        self.verify(p1rx_bytes == pktSize + 4,
> +                                    "Wrong RX bytes No CRC strip: p1_rx=%d,
> pktSize=%d" % (p1rx_bytes, pktSize))
> +                else:
> +                    self.verify(p1rx_bytes == pktSize,
> +                                "Wrong RX bytes No CRC strip: p1_rx=%d,
> pktSize=%d" % (p1rx_bytes, pktSize))
> +        else:
> +            self.verify(
> +                p0tx_pkts == 0, "Packet not dropped p0tx_pkts=%d" % p0tx_pkts)
> +            self.verify(
> +                p0tx_bytes == 0, "Packet not dropped p0tx_bytes=%d" %
> p0tx_bytes)
> +
> +    def check_ports(self, ports, status):
> +        """
> +            Check link status of the ports.
> +        """
> +        for port in ports:
> +            out = self.tester.send_expect(
> +                "ethtool %s" %
> self.tester.get_interface(self.tester.get_local_port(port)), "# ")
> +            if status:
> +                self.verify("Link detected: yes" in out, "Wrong link status")
> +            else:
> +                self.verify("Link detected: no" in out, "Wrong link status")
> +
> +    def set_up(self):
> +        """
> +        Run before each test case.
> +        """
> +        pass
> +
> +    def test_stop_restart(self):
> +        """
> +        Stop and Restar.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +        self.dut.send_expect("stop", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic, received=False)
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.check_ports(self.ports, False)
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.check_ports(self.ports, True)
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def test_set_promiscuousmode(self):
> +        """
> +        Promiscuous mode.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask([self.ports[0], self.ports[1]]), self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("set promisc all off", "testpmd> ")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.dut.send_expect("start", "testpmd> ")
> +
> +        try:
> +            self.check_forwarding([self.ports[0], self.ports[1]], self.nic)
> +        except dts.VerifyFailure as e:
> +            print 'promiscuous mode is working correctly'
> +        except Exception as e:
> +            print "   !!! DEBUG IT: " + e.message
> +            return "FAIL"
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("set promisc all on", "testpmd> ")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding([self.ports[0], self.ports[1]], self.nic)
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("set promisc all off", "testpmd> ")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.dut.send_expect("quit", "# ", 30)
> +
> +    def test_reset_queues(self):
> +        """
> +        Reset RX/TX Queues.
> +        """
> +        testerports =
> [self.tester.get_interface(self.tester.get_local_port(self.ports[0])),
> +
> self.tester.get_interface(self.tester.get_local_port(self.ports[1]))
> +                       ]
> +        #blackList = self.dut.create_blacklist_string(self.target, self.nic)
> +
> +        self.pmdout.start_testpmd("1S/8C/1T", "--portmask=%s" %
> dts.create_mask([self.ports[0], self.ports[1]]), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all rxq 2", "testpmd> ")
> +        self.dut.send_expect("port config all txq 2", "testpmd> ")
> +        #self.dut.send_expect("set coremask 0x1e", "testpmd> ")
> +        self.dut.send_expect("set coremask 0xe0", "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify("RX queues=2" in out, "RX queues not reconfigured
> properly")
> +        self.verify("TX queues=2" in out, "TX queues not reconfigured
> properly")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding([0, 1], self.nic, testerports)
> +        self.dut.send_expect("quit", "# ", 30)
> +        #self.dut.send_expect("rmmod igb_uio", "# ", 20)
> +        #self.dut.send_expect("insmod ./%s/kmod/igb_uio.ko" % self.target,
> "#")
> +        #self.dut.bind_interfaces_linux()
> +
> +    def test_reconfigure_ports(self):
> +        """
> +        Reconfigure All Ports With The Same Configurations (CRC)
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all crc-strip on", "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify(
> +            "CRC stripping enabled" in out, "CRC stripping not enabled
> properly")
> +        self.dut.send_expect("start", "testpmd> ")
> +        if self.nic in ["fortville_eagle", "fortville_spirit",
> "fortville_spirit_single"]:
> +            self.check_forwarding(self.ports, self.nic, crcStrip=False)
> +        else:
> +            self.check_forwarding(self.ports, self.nic, crcStrip=True)
> +
> +
> +    def test_change_linkspeed(self):
> +        """
> +        Change Link Speed.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        out = self.tester.send_expect(
> +            "ethtool %s" %
> self.tester.get_interface(self.tester.get_local_port(self.ports[0])), "# ")
> +        if 'fortville_spirit' == self.nic:
> +            result_scanner = r"([0-9]+)baseSR4/([A-Za-z]+)"
> +        else:
> +            result_scanner = r"([0-9]+)baseT/([A-Za-z]+)"
> +        scanner = re.compile(result_scanner, re.DOTALL)
> +        m = scanner.findall(out)
> +        configs = m[:-(len(m) / 2)]
> +        for config in configs:
> +            print config
> +            self.dut.send_expect("port stop all", "testpmd> ", 100)
> +            for port in self.ports:
> +                self.dut.send_expect("port config %d speed %s duplex %s" %
> (port,
> +
> config[0], config[1].lower()), "testpmd> ")
> +            self.dut.send_expect("set fwd mac", "testpmd>")
> +            self.dut.send_expect("port start all", "testpmd> ", 100)
> +            time.sleep(5)  # sleep few seconds for link stable
> +
> +            for port in self.ports:
> +                out = self.tester.send_expect(
> +                    "ethtool %s" %
> self.tester.get_interface(self.tester.get_local_port(port)), "# ")
> +                self.verify("Speed: %s" % config[0] in out,
> +                            "Wrong speed reported by the self.tester.")
> +                self.verify("Duplex: %s" % config[1] in out,
> +                            "Wrong link type reported by the self.tester.")
> +            self.dut.send_expect("start", "testpmd> ")
> +            self.check_forwarding(self.ports, self.nic)
> +            self.dut.send_expect("stop", "testpmd> ")
> +
> +    def failed_test_enable_disablejumbo(self):
> +        """
> +        Enable/Disable Jumbo Frames.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("vlan set strip off all", "testpmd> ")
> +        self.dut.send_expect("port config all max-pkt-len 2048", "testpmd> ")
> +        for port in self.ports:
> +            self.dut.send_expect("rx_vlan add 1 %d" % port, "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.dut.send_expect("start", "testpmd> ")
> +
> +        self.check_forwarding(self.ports, self.nic, pktSize=2047, vlan=True)
> +        self.check_forwarding(self.ports, self.nic, pktSize=2048, vlan=True)
> +        self.check_forwarding(self.ports, self.nic, pktSize=2049,
> received=False, vlan=True)
> +
> +        self.dut.send_expect("stop", "testpmd> ")
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all hw-vlan off", "testpmd> ")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.dut.send_expect("start", "testpmd> ")
> +        if ((self.nic == "bartonhills") or (self.nic == "powerville") or
> (self.nic == "springville") or (self.nic == "hartwell")):
> +            self.check_forwarding(self.ports, self.nic, pktSize=2051)
> +            self.check_forwarding(self.ports, self.nic, pktSize=2052)
> +            self.check_forwarding(self.ports, self.nic, pktSize=2053,
> received=False)
> +        else:
> +            self.check_forwarding(self.ports, self.nic, pktSize=2047)
> +            self.check_forwarding(self.ports, self.nic, pktSize=2048)
> +            self.check_forwarding(self.ports, self.nic, pktSize=2049,
> received=False)
> +
> +    def test_enable_disablerss(self):
> +        """
> +        Enable/Disable RSS.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config rss ip", "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def test_change_numberrxdtxd(self):
> +        """
> +        Enable/Disable Jumbo Frame.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all rxd 1024", "testpmd> ")
> +        self.dut.send_expect("port config all txd 1024", "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify(
> +            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
> +        self.verify(
> +            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def test_change_numberrxdtxdaftercycle(self):
> +        """
> +        Change the Number of rxd/txd.
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all rxd 1024", "testpmd> ")
> +        self.dut.send_expect("port config all txd 1024", "testpmd> ")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify(
> +            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
> +        self.verify(
> +            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +        self.dut.send_expect("stop", "testpmd> ")
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify(
> +            "RX desc=1024" in out, "RX descriptor not reconfigured properly")
> +        self.verify(
> +            "TX desc=1024" in out, "TX descriptor not reconfigured properly")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def test_change_thresholds(self):
> +        """
> +        Change RX/TX thresholds
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.dut.send_expect("port stop all", "testpmd> ", 100)
> +        self.dut.send_expect("port config all txfreet 32", "testpmd> ")
> +        self.dut.send_expect("port config all txrst 32", "testpmd> ")
> +        self.dut.send_expect("port config all rxfreet 32", "testpmd> ")
> +        self.dut.send_expect("port config all txpt 64", "testpmd> ")
> +        self.dut.send_expect("port config all txht 64", "testpmd> ")
> +        self.dut.send_expect("port config all txwt 0", "testpmd> ")
> +        self.dut.send_expect("port config all rxpt 64", "testpmd> ")
> +        self.dut.send_expect("port config all rxht 64", "testpmd> ")
> +        self.dut.send_expect("port config all rxwt 64", "testpmd> ")
> +        self.dut.send_expect("port start all", "testpmd> ", 100)
> +        out = self.dut.send_expect("show config rxtx", "testpmd> ")
> +        self.verify("RX free threshold=32" in out,
> +                    "RX descriptor not reconfigured properly")
> +        self.verify("TX free threshold=32" in out,
> +                    "TX descriptor not reconfigured properly")
> +        self.verify("TX RS bit threshold=32" in out,
> +                    "TX descriptor not reconfigured properly")
> +        self.verify("pthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.verify("hthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.verify("wthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.verify("pthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.verify("hthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.verify("wthresh=64" in out, "TX descriptor not reconfigured
> properly")
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("start", "testpmd> ")
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def test_stress_test(self):
> +        """
> +        Start/stop stress test.
> +        """
> +        stress_iterations = 10
> +
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +
> +        self.tester.scapy_append('wrpcap("test.pcap",
> [Ether()/IP()/UDP()/()])')
> +        tgenInput = []
> +
> +        for port in self.ports:
> +            tgenInput.append((self.tester.get_local_port(
> +                port), self.tester.get_local_port(port), "test.pcap"))
> +
> +        for _ in range(stress_iterations):
> +            self.dut.send_expect("port stop all", "testpmd> ", 100)
> +            self.dut.send_expect("set fwd mac", "testpmd>")
> +            self.dut.send_expect("port start all", "testpmd> ", 100)
> +            self.dut.send_expect("start", "testpmd> ")
> +            self.check_forwarding(self.ports, self.nic)
> +            self.dut.send_expect("stop", "testpmd> ")
> +
> +        self.dut.send_expect("quit", "# ")
> +
> +    def test_link_stats(self):
> +        """
> +        port link stats test
> +        """
> +        self.pmdout.start_testpmd("Default", "--portmask=%s" %
> dts.create_mask(self.ports), socket=self.ports_socket)
> +        self.dut.send_expect("set fwd mac", "testpmd>")
> +        self.dut.send_expect("start", "testpmd>")
> +
> +        # default test
> +        # self.check_forwarding([0,1], self.nic)
> +
> +        ports_num = len(self.ports)
> +        # link down test
> +        for i in range(ports_num):
> +            self.dut.send_expect("set link-down port %d" % i, "testpmd>")
> +        # leep few seconds for NIC link status update
> +        time.sleep(5)
> +        self.check_ports(self.ports, False)
> +
> +        # link up test
> +        for j in range(ports_num):
> +            self.dut.send_expect("set link-up port %d" % j, "testpmd>")
> +        time.sleep(5)
> +        self.check_ports(self.ports, True)
> +        self.check_forwarding(self.ports, self.nic)
> +
> +    def tear_down(self):
> +        """
> +        Run after each test case.
> +        """
> +        self.dut.kill_all()
> +
> +    def tear_down_all(self):
> +        """
> +        Run after each test suite.
> +        """
> +        self.dut.kill_all()
> --
> 1.7.4.4

Acked-by: Jingguo Fu <jingguox.fu@intel.com>

Re: [dts] [dts 1/3] [PATCH V2] add shutdown api test for niantic and fortville NIC test

[Liu, Yong]

Thanks, applied in 1.1 branch.

> -----Original Message-----
> From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of huilong,xu
> Sent: Friday, May 29, 2015 10:19 AM
> To: dts@dpdk.org
> Cc: Fu, JingguoX
> Subject: [dts] [dts 1/3] [PATCH V2] add shutdown api test for niantic and
> fortville NIC test
> 
> From: huilong xu <huilongx.xu@intel.com>
> 
> 
> Signed-off-by: huilong xu <huilongx.xu@intel.com>
> ---
>  executions/execution.cfg     |    3 ++-
>  executions/execution_FVL.cfg |    3 ++-
>  2 files changed, 4 insertions(+), 2 deletions(-)
> 
> diff --git a/executions/execution.cfg b/executions/execution.cfg
> index e5c6198..a749008 100644
> --- a/executions/execution.cfg
> +++ b/executions/execution.cfg
> @@ -19,7 +19,8 @@ test_suites=
>      pmd_bonded,
>      dynamic_config,
>      generic_filter,
> -    dual_vlan
> +    dual_vlan,
> +    shutdown_api
>  targets=
>      x86_64-native-linuxapp-gcc
>  parameters=nic_type=cfg:func=true
> diff --git a/executions/execution_FVL.cfg b/executions/execution_FVL.cfg
> index 12990d8..bd278ba 100644
> --- a/executions/execution_FVL.cfg
> +++ b/executions/execution_FVL.cfg
> @@ -6,7 +6,8 @@ test_suites=
>      dynamic_config,
>      generic_filter,
>      dual_vlan,
> -    vlan
> +    vlan,
> +    shutdown_api
>  targets=
>      x86_64-native-linuxapp-gcc
>  parameters=nic_type=cfg:func=true
> --
> 1.7.4.4

Re: [dts] [dts 1/3] [PATCH V2] add shutdown api test for niantic and fortville NIC test

[Fu, JingguoX]

> -----Original Message-----
> From: Xu, HuilongX
> Sent: Friday, May 29, 2015 10:19
> To: dts@dpdk.org
> Cc: Fu, JingguoX; Xu, HuilongX
> Subject: [dts 1/3] [PATCH V2] add shutdown api test for niantic and fortville
> NIC test
> 
> From: huilong xu <huilongx.xu@intel.com>
> 
> 
> Signed-off-by: huilong xu <huilongx.xu@intel.com>
> ---
>  executions/execution.cfg     |    3 ++-
>  executions/execution_FVL.cfg |    3 ++-
>  2 files changed, 4 insertions(+), 2 deletions(-)
> 
> diff --git a/executions/execution.cfg b/executions/execution.cfg
> index e5c6198..a749008 100644
> --- a/executions/execution.cfg
> +++ b/executions/execution.cfg
> @@ -19,7 +19,8 @@ test_suites=
>      pmd_bonded,
>      dynamic_config,
>      generic_filter,
> -    dual_vlan
> +    dual_vlan,
> +    shutdown_api
>  targets=
>      x86_64-native-linuxapp-gcc
>  parameters=nic_type=cfg:func=true
> diff --git a/executions/execution_FVL.cfg b/executions/execution_FVL.cfg
> index 12990d8..bd278ba 100644
> --- a/executions/execution_FVL.cfg
> +++ b/executions/execution_FVL.cfg
> @@ -6,7 +6,8 @@ test_suites=
>      dynamic_config,
>      generic_filter,
>      dual_vlan,
> -    vlan
> +    vlan,
> +    shutdown_api
>  targets=
>      x86_64-native-linuxapp-gcc
>  parameters=nic_type=cfg:func=true
> --
> 1.7.4.4

Acked-by: Jingguo Fu <jingguox.fu@intel.com>