test suite reviews and discussions
 help / color / mirror / Atom feed
* RE: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan
  2021-11-11 17:32 ` [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan Lingli Chen
@ 2021-11-11  9:34   ` Chen, LingliX
  2021-11-22  8:32     ` Wang, Yinan
  2021-11-25  3:33     ` Tu, Lijuan
  0 siblings, 2 replies; 6+ messages in thread
From: Chen, LingliX @ 2021-11-11  9:34 UTC (permalink / raw)
  To: dts; +Cc: Wang, Yinan

[-- Attachment #1: Type: text/plain, Size: 456 bytes --]


> -----Original Message-----
> From: Chen, LingliX <linglix.chen@intel.com>
> Sent: Friday, November 12, 2021 1:33 AM
> To: dts@dpdk.org
> Cc: Chen, LingliX <linglix.chen@intel.com>
> Subject: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify
> case sync with testplan
> 
> Modify case 3, 4, 8, 10 sync with testplan.
> 
> Signed-off-by: Lingli Chen <linglix.chen@intel.com>

Tested-by: Lingli Chen <linglix.chen@intel.com>

[-- Attachment #2: TestLoopbackVirtioUserServerMode.log --]
[-- Type: application/octet-stream, Size: 35297 bytes --]

11/11/2021 16:32:37                            dts: 
TEST SUITE : TestLoopbackVirtioUserServerMode
11/11/2021 16:32:37                            dts: NIC :        fortville_spirit
11/11/2021 16:32:37             dut.10.240.183.220: 
11/11/2021 16:32:37                         tester: 
11/11/2021 16:32:37             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:32:37             dut.10.240.183.220: 1048576
11/11/2021 16:32:37 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_launch_virtio11_first Begin
11/11/2021 16:32:37             dut.10.240.183.220:  
11/11/2021 16:32:37                         tester: 
11/11/2021 16:32:37             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:32:38             dut.10.240.183.220: 
11/11/2021 16:32:38             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:32:38             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:32:41             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:32:41             dut.10.240.183.220: 1048576
11/11/2021 16:33:16 TestLoopbackVirtioUserServerMode: ['lanuch virtio first', '64', 12.3411781, 1, '']
11/11/2021 16:33:16 TestLoopbackVirtioUserServerMode: 
+---------------------+----------+------------------+--------------+-------+
|        Mode         | Pkt_size | Throughput(Mpps) | Queue Number | Cycle |
+=====================+==========+==================+==============+=======+
| lanuch virtio first | 64       | 12.341           | 1            |       |
+---------------------+----------+------------------+--------------+-------+
11/11/2021 16:33:17 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_launch_virtio11_first Result PASSED:
11/11/2021 16:33:17             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:33:17             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:33:20 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_launch_virtio_first Begin
11/11/2021 16:33:20             dut.10.240.183.220:  
11/11/2021 16:33:20                         tester: 
11/11/2021 16:33:20             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:33:20             dut.10.240.183.220: 
11/11/2021 16:33:20             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:33:20             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:33:24             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:33:24             dut.10.240.183.220: 1048576
11/11/2021 16:33:58 TestLoopbackVirtioUserServerMode: ['lanuch virtio first', '64', 10.0701811, 1, '']
11/11/2021 16:33:59 TestLoopbackVirtioUserServerMode: 
+---------------------+----------+------------------+--------------+-------+
|        Mode         | Pkt_size | Throughput(Mpps) | Queue Number | Cycle |
+=====================+==========+==================+==============+=======+
| lanuch virtio first | 64       | 10.070           | 1            |       |
+---------------------+----------+------------------+--------------+-------+
11/11/2021 16:34:00 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_launch_virtio_first Result PASSED:
11/11/2021 16:34:00             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:34:00             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:34:03 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_inorder_mergeable_path Begin
11/11/2021 16:34:03             dut.10.240.183.220:  
11/11/2021 16:34:03                         tester: 
11/11/2021 16:34:03             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:34:03             dut.10.240.183.220: 
11/11/2021 16:34:03             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:34:03             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:34:17             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:34:17             dut.10.240.183.220: 1048576
11/11/2021 16:34:42 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder mergeable path', '8k', 1.605271, 2, 'before reconnet']
11/11/2021 16:34:42 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:35:07 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder mergeable path', '8k', 1.567375, 2, 'reconnet from vhost']
11/11/2021 16:35:07 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:35:08             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:35:08             dut.10.240.183.220: 1048576
11/11/2021 16:35:33 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder mergeable path', '8k', 1.6015819, 2, 'reconnet from virtio_user']
11/11/2021 16:35:33 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:35:47 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder mergeable path', '8k', 1.5632753, 2, 'after port restart']
11/11/2021 16:35:47 TestLoopbackVirtioUserServerMode: 
+----------------------------------+----------+------------------+--------------+---------------------------+
|               Mode               | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==================================+==========+==================+==============+===========================+
| virtio1.0 inorder mergeable path | 8k       | 1.605            | 2            | before reconnet           |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder mergeable path | 8k       | 1.567            | 2            | reconnet from vhost       |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder mergeable path | 8k       | 1.602            | 2            | reconnet from virtio_user |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder mergeable path | 8k       | 1.563            | 2            | after port restart        |
+----------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:35:49 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_inorder_mergeable_path Result PASSED:
11/11/2021 16:35:49             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:35:49             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:35:51 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_inorder_non_mergeable_path Begin
11/11/2021 16:35:51             dut.10.240.183.220:  
11/11/2021 16:35:52                         tester: 
11/11/2021 16:35:52             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:35:52             dut.10.240.183.220: 
11/11/2021 16:35:52             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:35:52             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:36:05             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:36:06             dut.10.240.183.220: 1048576
11/11/2021 16:36:30 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder non_mergeable path', '64', 20.4216092, 2, 'before reconnet']
11/11/2021 16:36:30 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:36:56 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder non_mergeable path', '64', 20.0933635, 2, 'reconnet from vhost']
11/11/2021 16:36:56 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:36:56             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:36:56             dut.10.240.183.220: 1048576
11/11/2021 16:37:21 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder non_mergeable path', '64', 20.1014011, 2, 'reconnet from virtio_user']
11/11/2021 16:37:21 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:37:36 TestLoopbackVirtioUserServerMode: ['virtio1.0 inorder non_mergeable path', '64', 20.1232493, 2, 'after port restart']
11/11/2021 16:37:36 TestLoopbackVirtioUserServerMode: 
+--------------------------------------+----------+------------------+--------------+---------------------------+
|                 Mode                 | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+======================================+==========+==================+==============+===========================+
| virtio1.0 inorder non_mergeable path | 64       | 20.422           | 2            | before reconnet           |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder non_mergeable path | 64       | 20.093           | 2            | reconnet from vhost       |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder non_mergeable path | 64       | 20.101           | 2            | reconnet from virtio_user |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 inorder non_mergeable path | 64       | 20.123           | 2            | after port restart        |
+--------------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:37:37 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_inorder_non_mergeable_path Result PASSED:
11/11/2021 16:37:37             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:37:37             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:37:40 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_mergeable_path Begin
11/11/2021 16:37:40             dut.10.240.183.220:  
11/11/2021 16:37:40                         tester: 
11/11/2021 16:37:40             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:37:40             dut.10.240.183.220: 
11/11/2021 16:37:40             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:37:40             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:37:54             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:37:54             dut.10.240.183.220: 1048576
11/11/2021 16:38:19 TestLoopbackVirtioUserServerMode: ['virtio1.0 mergeable path', '8k', 1.5041071, 8, 'before reconnet']
11/11/2021 16:38:19 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:38:44 TestLoopbackVirtioUserServerMode: ['virtio1.0 mergeable path', '8k', 1.4837793, 8, 'reconnet from vhost']
11/11/2021 16:38:44 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:38:45             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:38:45             dut.10.240.183.220: 1048576
11/11/2021 16:39:10 TestLoopbackVirtioUserServerMode: ['virtio1.0 mergeable path', '8k', 1.504703, 8, 'reconnet from virtio_user']
11/11/2021 16:39:10 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:39:24 TestLoopbackVirtioUserServerMode: ['virtio1.0 mergeable path', '8k', 1.4674132, 8, 'after port restart']
11/11/2021 16:39:24 TestLoopbackVirtioUserServerMode: 
+--------------------------+----------+------------------+--------------+---------------------------+
|           Mode           | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==========================+==========+==================+==============+===========================+
| virtio1.0 mergeable path | 8k       | 1.504            | 8            | before reconnet           |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 mergeable path | 8k       | 1.484            | 8            | reconnet from vhost       |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 mergeable path | 8k       | 1.505            | 8            | reconnet from virtio_user |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 mergeable path | 8k       | 1.467            | 8            | after port restart        |
+--------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:39:26 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_mergeable_path Result PASSED:
11/11/2021 16:39:26             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:39:26             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:39:29 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_non_mergeable_path Begin
11/11/2021 16:39:29             dut.10.240.183.220:  
11/11/2021 16:39:29                         tester: 
11/11/2021 16:39:29             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:39:29             dut.10.240.183.220: 
11/11/2021 16:39:29             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:39:29             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:39:43             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:39:43             dut.10.240.183.220: 1048576
11/11/2021 16:40:08 TestLoopbackVirtioUserServerMode: ['virtio1.0 non_mergeable path', '64', 19.9584751, 2, 'before reconnet']
11/11/2021 16:40:08 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:40:33 TestLoopbackVirtioUserServerMode: ['virtio1.0 non_mergeable path', '64', 19.8783003, 2, 'reconnet from vhost']
11/11/2021 16:40:33 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:40:34             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:40:34             dut.10.240.183.220: 1048576
11/11/2021 16:40:59 TestLoopbackVirtioUserServerMode: ['virtio1.0 non_mergeable path', '64', 19.8613081, 2, 'reconnet from virtio_user']
11/11/2021 16:40:59 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:41:13 TestLoopbackVirtioUserServerMode: ['virtio1.0 non_mergeable path', '64', 19.8773524, 2, 'after port restart']
11/11/2021 16:41:13 TestLoopbackVirtioUserServerMode: 
+------------------------------+----------+------------------+--------------+---------------------------+
|             Mode             | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==============================+==========+==================+==============+===========================+
| virtio1.0 non_mergeable path | 64       | 19.958           | 2            | before reconnet           |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 non_mergeable path | 64       | 19.878           | 2            | reconnet from vhost       |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 non_mergeable path | 64       | 19.861           | 2            | reconnet from virtio_user |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 non_mergeable path | 64       | 19.877           | 2            | after port restart        |
+------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:41:14 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_non_mergeable_path Result PASSED:
11/11/2021 16:41:14             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:41:14             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:41:17 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_vector_rx_path Begin
11/11/2021 16:41:17             dut.10.240.183.220:  
11/11/2021 16:41:17                         tester: 
11/11/2021 16:41:17             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:41:17             dut.10.240.183.220: 
11/11/2021 16:41:17             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:41:18             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:41:31             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:41:31             dut.10.240.183.220: 1048576
11/11/2021 16:41:56 TestLoopbackVirtioUserServerMode: ['virtio1.0 vector_rx path', '64', 19.9721759, 2, 'before reconnet']
11/11/2021 16:41:56 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:42:21 TestLoopbackVirtioUserServerMode: ['virtio1.0 vector_rx path', '64', 19.842448, 2, 'reconnet from vhost']
11/11/2021 16:42:21 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:42:22             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:42:22             dut.10.240.183.220: 1048576
11/11/2021 16:42:47 TestLoopbackVirtioUserServerMode: ['virtio1.0 vector_rx path', '64', 19.8442414, 2, 'reconnet from virtio_user']
11/11/2021 16:42:47 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:43:02 TestLoopbackVirtioUserServerMode: ['virtio1.0 vector_rx path', '64', 19.8363877, 2, 'after port restart']
11/11/2021 16:43:02 TestLoopbackVirtioUserServerMode: 
+--------------------------+----------+------------------+--------------+---------------------------+
|           Mode           | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==========================+==========+==================+==============+===========================+
| virtio1.0 vector_rx path | 64       | 19.972           | 2            | before reconnet           |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 vector_rx path | 64       | 19.842           | 2            | reconnet from vhost       |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 vector_rx path | 64       | 19.844           | 2            | reconnet from virtio_user |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.0 vector_rx path | 64       | 19.836           | 2            | after port restart        |
+--------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:43:03 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio10_vector_rx_path Result PASSED:
11/11/2021 16:43:03             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:43:03             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:43:06 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_mergeable_path Begin
11/11/2021 16:43:06             dut.10.240.183.220:  
11/11/2021 16:43:06                         tester: 
11/11/2021 16:43:06             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:43:06             dut.10.240.183.220: 
11/11/2021 16:43:06             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:43:06             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:43:20             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:43:20             dut.10.240.183.220: 1048576
11/11/2021 16:43:45 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder mergeable path', '8k', 1.4457656, 8, 'before reconnet']
11/11/2021 16:43:45 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:44:10 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder mergeable path', '8k', 1.4291266, 8, 'reconnet from vhost']
11/11/2021 16:44:10 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:44:11             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:44:11             dut.10.240.183.220: 1048576
11/11/2021 16:44:36 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder mergeable path', '8k', 1.4458138, 8, 'reconnet from virtio user']
11/11/2021 16:44:36 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:44:50 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder mergeable path', '8k', 1.4453421, 8, 'after port restart']
11/11/2021 16:44:50 TestLoopbackVirtioUserServerMode: 
+----------------------------------+----------+------------------+--------------+---------------------------+
|               Mode               | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==================================+==========+==================+==============+===========================+
| virtio1.1 inorder mergeable path | 8k       | 1.446            | 8            | before reconnet           |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder mergeable path | 8k       | 1.429            | 8            | reconnet from vhost       |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder mergeable path | 8k       | 1.446            | 8            | reconnet from virtio user |
+----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder mergeable path | 8k       | 1.445            | 8            | after port restart        |
+----------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:44:52 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_mergeable_path Result PASSED:
11/11/2021 16:44:52             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:44:52             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:44:54 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_non_mergeable_path Begin
11/11/2021 16:44:55             dut.10.240.183.220:  
11/11/2021 16:44:55                         tester: 
11/11/2021 16:44:55             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:44:55             dut.10.240.183.220: 
11/11/2021 16:44:55             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:44:55             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:45:09             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:45:09             dut.10.240.183.220: 1048576
11/11/2021 16:45:33 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder non_mergeable path', '64', 28.1411045, 2, 'before reconnet']
11/11/2021 16:45:33 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:45:59 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder non_mergeable path', '64', 28.2530656, 2, 'reconnet from vhost']
11/11/2021 16:45:59 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:45:59             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:45:59             dut.10.240.183.220: 1048576
11/11/2021 16:46:25 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder non_mergeable path', '64', 27.9297348, 2, 'reconnet from virtio_user']
11/11/2021 16:46:25 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:46:39 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder non_mergeable path', '64', 28.4039964, 2, 'after port restart']
11/11/2021 16:46:39 TestLoopbackVirtioUserServerMode: 
+--------------------------------------+----------+------------------+--------------+---------------------------+
|                 Mode                 | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+======================================+==========+==================+==============+===========================+
| virtio1.1 inorder non_mergeable path | 64       | 28.141           | 2            | before reconnet           |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder non_mergeable path | 64       | 28.253           | 2            | reconnet from vhost       |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder non_mergeable path | 64       | 27.930           | 2            | reconnet from virtio_user |
+--------------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder non_mergeable path | 64       | 28.404           | 2            | after port restart        |
+--------------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:46:40 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_non_mergeable_path Result PASSED:
11/11/2021 16:46:40             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:46:40             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:46:43 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_vectorized_path Begin
11/11/2021 16:46:43             dut.10.240.183.220:  
11/11/2021 16:46:43                         tester: 
11/11/2021 16:46:43             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:46:43             dut.10.240.183.220: 
11/11/2021 16:46:43             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:46:43             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:46:57             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:46:57             dut.10.240.183.220: 1048576
11/11/2021 16:47:22 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder vectorized path', '64', 28.3654356, 2, 'before reconnet']
11/11/2021 16:47:22 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:47:47 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder vectorized path', '64', 28.3076742, 2, 'reconnet from vhost']
11/11/2021 16:47:47 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:47:48             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:47:48             dut.10.240.183.220: 1048576
11/11/2021 16:48:13 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder vectorized path', '64', 28.1348219, 2, 'reconnet from virtio_user']
11/11/2021 16:48:13 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:48:27 TestLoopbackVirtioUserServerMode: ['virtio1.1 inorder vectorized path', '64', 28.1742994, 2, 'after port restart']
11/11/2021 16:48:27 TestLoopbackVirtioUserServerMode: 
+-----------------------------------+----------+------------------+--------------+---------------------------+
|               Mode                | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+===================================+==========+==================+==============+===========================+
| virtio1.1 inorder vectorized path | 64       | 28.365           | 2            | before reconnet           |
+-----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder vectorized path | 64       | 28.308           | 2            | reconnet from vhost       |
+-----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder vectorized path | 64       | 28.135           | 2            | reconnet from virtio_user |
+-----------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 inorder vectorized path | 64       | 28.174           | 2            | after port restart        |
+-----------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:48:29 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_inorder_vectorized_path Result PASSED:
11/11/2021 16:48:29             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:48:29             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:48:32 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_mergeable_path Begin
11/11/2021 16:48:32             dut.10.240.183.220:  
11/11/2021 16:48:32                         tester: 
11/11/2021 16:48:32             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:48:32             dut.10.240.183.220: 
11/11/2021 16:48:32             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:48:32             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:48:46             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:48:46             dut.10.240.183.220: 1048576
11/11/2021 16:49:11 TestLoopbackVirtioUserServerMode: ['virtio1.1 mergeable path', '8k', 1.4509962, 2, 'before reconnet']
11/11/2021 16:49:11 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:49:36 TestLoopbackVirtioUserServerMode: ['virtio1.1 mergeable path', '8k', 1.4209534, 2, 'reconnet from vhost']
11/11/2021 16:49:36 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:49:37             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:49:37             dut.10.240.183.220: 1048576
11/11/2021 16:50:02 TestLoopbackVirtioUserServerMode: ['virtio1.1 mergeable path', '8k', 1.4560152, 2, 'reconnet from virtio user']
11/11/2021 16:50:02 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:50:16 TestLoopbackVirtioUserServerMode: ['virtio1.1 mergeable path', '8k', 1.4461282, 2, 'after port restart']
11/11/2021 16:50:16 TestLoopbackVirtioUserServerMode: 
+--------------------------+----------+------------------+--------------+---------------------------+
|           Mode           | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==========================+==========+==================+==============+===========================+
| virtio1.1 mergeable path | 8k       | 1.451            | 2            | before reconnet           |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 mergeable path | 8k       | 1.421            | 2            | reconnet from vhost       |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 mergeable path | 8k       | 1.456            | 2            | reconnet from virtio user |
+--------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 mergeable path | 8k       | 1.446            | 2            | after port restart        |
+--------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:50:17 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_mergeable_path Result PASSED:
11/11/2021 16:50:17             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:50:18             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:50:20 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_non_mergeable_path Begin
11/11/2021 16:50:20             dut.10.240.183.220:  
11/11/2021 16:50:21                         tester: 
11/11/2021 16:50:21             dut.10.240.183.220: rm -rf ./vhost-net*
11/11/2021 16:50:21             dut.10.240.183.220: 
11/11/2021 16:50:21             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:50:21             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:50:34             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:50:34             dut.10.240.183.220: 1048576
11/11/2021 16:50:59 TestLoopbackVirtioUserServerMode: ['virtio1.1 non_mergeable path', '64', 27.7232849, 2, 'before reconnet']
11/11/2021 16:50:59 TestLoopbackVirtioUserServerMode: now reconnet from vhost
11/11/2021 16:51:24 TestLoopbackVirtioUserServerMode: ['virtio1.1 non_mergeable path', '64', 27.7245637, 2, 'reconnet from vhost']
11/11/2021 16:51:24 TestLoopbackVirtioUserServerMode: now reconnet from virtio_user
11/11/2021 16:51:25             dut.10.240.183.220: cat /proc/meminfo |grep Hugepagesize|awk '{print($2)}'
11/11/2021 16:51:25             dut.10.240.183.220: 1048576
11/11/2021 16:51:50 TestLoopbackVirtioUserServerMode: ['virtio1.1 non_mergeable path', '64', 27.8431473, 2, 'reconnet from virtio_user']
11/11/2021 16:51:50 TestLoopbackVirtioUserServerMode: now vhost port restart
11/11/2021 16:52:05 TestLoopbackVirtioUserServerMode: ['virtio1.1 non_mergeable path', '64', 27.8310099, 2, 'after port restart']
11/11/2021 16:52:05 TestLoopbackVirtioUserServerMode: 
+------------------------------+----------+------------------+--------------+---------------------------+
|             Mode             | Pkt_size | Throughput(Mpps) | Queue Number |           Cycle           |
+==============================+==========+==================+==============+===========================+
| virtio1.1 non_mergeable path | 64       | 27.723           | 2            | before reconnet           |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 non_mergeable path | 64       | 27.725           | 2            | reconnet from vhost       |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 non_mergeable path | 64       | 27.843           | 2            | reconnet from virtio_user |
+------------------------------+----------+------------------+--------------+---------------------------+
| virtio1.1 non_mergeable path | 64       | 27.831           | 2            | after port restart        |
+------------------------------+----------+------------------+--------------+---------------------------+
11/11/2021 16:52:06 TestLoopbackVirtioUserServerMode: Test Case test_server_mode_reconnect_with_virtio11_non_mergeable_path Result PASSED:
11/11/2021 16:52:06             dut.10.240.183.220: killall -s INT dpdk-testpmd 
11/11/2021 16:52:06             dut.10.240.183.220: dpdk-testpmd: no process found
11/11/2021 16:52:09                            dts: 
TEST SUITE ENDED: TestLoopbackVirtioUserServerMode

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [dts][PATCH V1 0/2] loopback_virtio_user_server_mode: modify for case coverage improvement
@ 2021-11-11 17:32 Lingli Chen
  2021-11-11 17:32 ` [dts][PATCH V1 1/2] test_plans/loopback_virtio_user_server_mode: " Lingli Chen
  2021-11-11 17:32 ` [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan Lingli Chen
  0 siblings, 2 replies; 6+ messages in thread
From: Lingli Chen @ 2021-11-11 17:32 UTC (permalink / raw)
  To: dts; +Cc: Lingli Chen

test_plans and test suite modify for case coverage improvement

Lingli Chen (2):
  test_plans/loopback_virtio_user_server_mode: modify for case coverage
    improvement
  tests/loopback_virtio_user_server_mode: Modify case sync with testplan

 ...back_virtio_user_server_mode_test_plan.rst | 136 ++++++++------
 ...tSuite_loopback_virtio_user_server_mode.py | 170 ++++++++++++------
 2 files changed, 193 insertions(+), 113 deletions(-)

-- 
2.33.1


^ permalink raw reply	[flat|nested] 6+ messages in thread

* [dts][PATCH V1 1/2] test_plans/loopback_virtio_user_server_mode: modify for case coverage improvement
  2021-11-11 17:32 [dts][PATCH V1 0/2] loopback_virtio_user_server_mode: modify for case coverage improvement Lingli Chen
@ 2021-11-11 17:32 ` Lingli Chen
  2021-11-11 17:32 ` [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan Lingli Chen
  1 sibling, 0 replies; 6+ messages in thread
From: Lingli Chen @ 2021-11-11 17:32 UTC (permalink / raw)
  To: dts; +Cc: Lingli Chen

1. Case 3, Case 10 change to 8 queues.
2. Case 3, 4, 8, 10 add 8k packets.

Signed-off-by: Lingli Chen <linglix.chen@intel.com>
---
 ...back_virtio_user_server_mode_test_plan.rst | 136 +++++++++++-------
 1 file changed, 81 insertions(+), 55 deletions(-)

diff --git a/test_plans/loopback_virtio_user_server_mode_test_plan.rst b/test_plans/loopback_virtio_user_server_mode_test_plan.rst
index 18d580f4..f3e9f1de 100644
--- a/test_plans/loopback_virtio_user_server_mode_test_plan.rst
+++ b/test_plans/loopback_virtio_user_server_mode_test_plan.rst
@@ -84,35 +84,38 @@ Test Case 2:  Basic test for split ring server mode
 Test Case 3: loopback reconnect test with split ring mergeable path and server mode
 ===================================================================================
 
-1. launch vhost as client mode with 2 queues::
+1. launch vhost as client mode with 8 queues::
 
     rm -rf vhost-net*
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
-    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
+    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=8' -- -i --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 8 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
-    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=1,in_order=0 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
+    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=8,mrg_rxbuf=1,in_order=0 \
+    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
     testpmd> show port info 0
     #it should show "down"
 
-4. Relaunch vhost and send packets::
+4. Relaunch vhost and send chain packets::
 
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
-    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
+    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=8' -- -i --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -130,22 +133,24 @@ Test Case 3: loopback reconnect test with split ring mergeable path and server m
 8. Relaunch virtio-user and send packets::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
-    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=1,in_order=0 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
+    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=8,mrg_rxbuf=1,in_order=0 \
+    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
       testpmd>stop
       testpmd>port stop 0
       testpmd>port start 0
+      testpmd>set txpkts 2000,2000,2000,2000
       testpmd>start tx_first 32
       testpmd>show port stats all
 
@@ -164,13 +169,15 @@ Test Case 4: loopback reconnect test with split ring inorder mergeable path and
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues, check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=1,in_order=1 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -182,9 +189,10 @@ Test Case 4: loopback reconnect test with split ring inorder mergeable path and
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
     --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -205,19 +213,21 @@ Test Case 4: loopback reconnect test with split ring inorder mergeable path and
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=1,in_order=1\
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
       testpmd>stop
       testpmd>port stop 0
       testpmd>port start 0
+      testpmd>set txpkts 2000,2000,2000,2000
       testpmd>start tx_first 32
       testpmd>show port stats all
 
@@ -236,13 +246,14 @@ Test Case 5: loopback reconnect test with split ring inorder non-mergeable path
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=0,in_order=1 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -256,7 +267,7 @@ Test Case 5: loopback reconnect test with split ring inorder non-mergeable path
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -279,13 +290,13 @@ Test Case 5: loopback reconnect test with split ring inorder non-mergeable path
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
       testpmd>stop
       testpmd>port stop 0
@@ -308,13 +319,14 @@ Test Case 6: loopback reconnect test with split ring non-mergeable path and serv
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=0,in_order=0,vectorized=1 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -328,7 +340,7 @@ Test Case 6: loopback reconnect test with split ring non-mergeable path and serv
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -351,13 +363,13 @@ Test Case 6: loopback reconnect test with split ring non-mergeable path and serv
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
       testpmd>stop
       testpmd>port stop 0
@@ -380,13 +392,14 @@ Test Case 7: loopback reconnect test with split ring vector_rx path and server m
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,mrg_rxbuf=0,in_order=0,vectorized=1 \
     -- -i --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -400,7 +413,7 @@ Test Case 7: loopback reconnect test with split ring vector_rx path and server m
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -423,13 +436,13 @@ Test Case 7: loopback reconnect test with split ring vector_rx path and server m
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
       testpmd>stop
       testpmd>port stop 0
@@ -452,13 +465,15 @@ Test Case 8: loopback reconnect test with packed ring mergeable path and server
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=0 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -470,9 +485,10 @@ Test Case 8: loopback reconnect test with packed ring mergeable path and server
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
     --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -493,19 +509,21 @@ Test Case 8: loopback reconnect test with packed ring mergeable path and server
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=0 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
      testpmd>stop
      testpmd>port stop 0
      testpmd>port start 0
+     testpmd>set txpkts 2000,2000,2000,2000
      testpmd>start tx_first 32
      testpmd>show port stats all
 
@@ -524,13 +542,14 @@ Test Case 9: loopback reconnect test with packed ring non-mergeable path and ser
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=0 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -544,7 +563,7 @@ Test Case 9: loopback reconnect test with packed ring non-mergeable path and ser
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -567,13 +586,13 @@ Test Case 9: loopback reconnect test with packed ring non-mergeable path and ser
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
      testpmd>stop
      testpmd>port stop 0
@@ -588,21 +607,23 @@ Test Case 9: loopback reconnect test with packed ring non-mergeable path and ser
 Test Case 10: loopback reconnect test with packed ring inorder mergeable path and server mode
 =============================================================================================
 
-1. launch vhost as client mode with 2 queues::
+1. launch vhost as client mode with 8 queues::
 
     rm -rf vhost-net*
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
-    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
+    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=8' -- -i --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 8 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
-    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=1 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
+    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=8,packed_vq=1,mrg_rxbuf=1,in_order=1 \
+    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -612,11 +633,12 @@ Test Case 10: loopback reconnect test with packed ring inorder mergeable path an
 4. Relaunch vhost and send packets::
 
     ./testpmd -c 0xe -n 4 --no-pci --file-prefix=vhost \
-    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=2' -- -i --nb-cores=2 --rxq=2 --txq=2
+    --vdev 'eth_vhost0,iface=vhost-net,client=1,queues=8' -- -i --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -634,22 +656,24 @@ Test Case 10: loopback reconnect test with packed ring inorder mergeable path an
 8. Relaunch virtio-user and send packets::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
-    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=1,in_order=1 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
+    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=8,packed_vq=1,mrg_rxbuf=1,in_order=1 \
+    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=8 --txq=8
     >set fwd mac
+    >set txpkts 2000,2000,2000,2000
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
      testpmd>stop
      testpmd>port stop 0
      testpmd>port start 0
+     testpmd>set txpkts 2000,2000,2000,2000
      testpmd>start tx_first 32
      testpmd>show port stats all
 
@@ -668,13 +692,14 @@ Test Case 11: loopback reconnect test with packed ring inorder non-mergeable pat
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
     -- -i --rx-offloads=0x10 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -688,7 +713,7 @@ Test Case 11: loopback reconnect test with packed ring inorder non-mergeable pat
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -711,13 +736,13 @@ Test Case 11: loopback reconnect test with packed ring inorder non-mergeable pat
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
      testpmd>stop
      testpmd>port stop 0
@@ -740,13 +765,14 @@ Test Case 12: loopback reconnect test with packed ring vectorized path and serve
     >set fwd mac
     >start
 
-2. Launch virtio-user as server mode with 2 queues::
+2. Launch virtio-user as server mode with 2 queues and check throughput can get expected::
 
     ./testpmd -n 4 -l 5-7 --log-level=pmd.net.virtio.driver,8 --no-pci --file-prefix=virtio --force-max-simd-bitwidth=512 \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,server=1,queues=2,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
     -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=2 --rxq=2 --txq=2
     >set fwd mac
     >start tx_first 32
+    >show port stats all
 
 3. Quit vhost side testpmd, check the virtio-user side link status::
 
@@ -760,7 +786,7 @@ Test Case 12: loopback reconnect test with packed ring vectorized path and serve
     >set fwd mac
     >start tx_first 32
 
-5. Check the virtio-user side link status and run below command to get throughput,verify the loopback throughput is not zero::
+5. Check the virtio-user side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
@@ -783,13 +809,13 @@ Test Case 12: loopback reconnect test with packed ring vectorized path and serve
     >set fwd mac
     >start tx_first 32
 
-9. Check the vhost side link status and run below command to get throughput, verify the loopback throughput is not zero::
+9. Check the vhost side link status and run below command to get throughput, check throughput can get expected::
 
     testpmd> show port info 0
     #it should show up"
     testpmd>show port stats all
 
-10. Port restart at vhost side by below command and re-calculate the average throughput::
+10. Port restart at vhost side by below command and check throughput can get expected::
 
      testpmd>stop
      testpmd>port stop 0
-- 
2.33.1


^ permalink raw reply	[flat|nested] 6+ messages in thread

* [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan
  2021-11-11 17:32 [dts][PATCH V1 0/2] loopback_virtio_user_server_mode: modify for case coverage improvement Lingli Chen
  2021-11-11 17:32 ` [dts][PATCH V1 1/2] test_plans/loopback_virtio_user_server_mode: " Lingli Chen
@ 2021-11-11 17:32 ` Lingli Chen
  2021-11-11  9:34   ` Chen, LingliX
  1 sibling, 1 reply; 6+ messages in thread
From: Lingli Chen @ 2021-11-11 17:32 UTC (permalink / raw)
  To: dts; +Cc: Lingli Chen

Modify case 3, 4, 8, 10 sync with testplan.

Signed-off-by: Lingli Chen <linglix.chen@intel.com>
---
 ...tSuite_loopback_virtio_user_server_mode.py | 170 ++++++++++++------
 1 file changed, 112 insertions(+), 58 deletions(-)

diff --git a/tests/TestSuite_loopback_virtio_user_server_mode.py b/tests/TestSuite_loopback_virtio_user_server_mode.py
index 7fbfe804..ed01de2f 100644
--- a/tests/TestSuite_loopback_virtio_user_server_mode.py
+++ b/tests/TestSuite_loopback_virtio_user_server_mode.py
@@ -37,11 +37,10 @@ Test loopback virtio-user server mode
 """
 import re
 import time
-
 import framework.utils as utils
 from framework.pmd_output import PmdOutput
 from framework.test_case import TestCase
-
+from framework.packet import Packet
 
 class TestLoopbackVirtioUserServerMode(TestCase):
 
@@ -61,6 +60,12 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         self.core_list_host = self.core_list[3:6]
         self.path=self.dut.apps_name['test-pmd']
         self.testpmd_name = self.path.split("/")[-1]
+        self.app_pdump = self.dut.apps_name['pdump']
+        self.dump_pcap = "/root/pdump-rx.pcap"
+        self.device_str = ''
+        self.dut_ports = self.dut.get_ports()
+        self.ports_socket = self.dut.get_numa_id(self.dut_ports[0])
+        self.cbdma_dev_infos = []
 
     def set_up(self):
         """
@@ -108,13 +113,17 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         if set_fwd_mac:
             self.virtio_user_pmd.execute_cmd("set fwd mac", "testpmd> ", 120)
 
-    def lanuch_vhost_testpmd_with_multi_queue(self, extern_params=""):
+    def lanuch_vhost_testpmd_with_multi_queue(self, extern_params="", set_fwd_mac=True):
         """
         start testpmd with multi qeueue
         """
-        self.lanuch_vhost_testpmd(self.queue_number, self.nb_cores, extern_params=extern_params)
+        eal_params = "--vdev 'eth_vhost0,iface=vhost-net,client=1,queues={}'".format(self.queue_number)
+        param = "--rxq={} --txq={} --nb-cores={} {}".format(self.queue_number, self.queue_number, self.nb_cores, extern_params)
+        self.vhost_pmd.start_testpmd(self.core_list_host, param=param, no_pci=True, ports=[], eal_param=eal_params, prefix='vhost', fixed_prefix=True)
+        if set_fwd_mac:
+            self.vhost_pmd.execute_cmd("set fwd mac", "testpmd> ", 120)
 
-    def lanuch_virtio_user_testpmd_with_multi_queue(self, mode, extern_params=""):
+    def lanuch_virtio_user_testpmd_with_multi_queue(self, mode, extern_params="", set_fwd_mac=True):
         """
         start testpmd of vhost user
         """
@@ -126,7 +135,8 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         param = "{} --nb-cores={} --rxq={} --txq={}".format(extern_params, self.nb_cores, self.queue_number, self.queue_number)
         self.virtio_user_pmd.start_testpmd(cores=self.core_list_user, param=param, eal_param=eal_param, \
                 no_pci=True, ports=[], prefix="virtio", fixed_prefix=True)
-        self.virtio_user_pmd.execute_cmd("set fwd mac", "testpmd> ", 120)
+        if set_fwd_mac:
+            self.virtio_user_pmd.execute_cmd("set fwd mac", "testpmd> ", 120)
 
     def start_to_send_packets(self, session_rx, session_tx):
         """
@@ -136,6 +146,35 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         session_rx.send_command("start", 3)
         session_tx.send_expect("start tx_first 32", "testpmd> ", 30)
 
+    def start_to_send_8k_packets(self, session_rx, session_tx):
+        """
+        start the testpmd of vhost-user and virtio-user
+        start to send 8k packets
+        """
+        session_rx.send_command("start", 3)
+        session_tx.send_expect("set txpkts 2000,2000,2000,2000", "testpmd> ", 30)
+        session_tx.send_expect("start tx_first 32", "testpmd> ", 30)
+
+    def start_to_send_8k_packets_csum(self, session_tx):
+        """
+        start the testpmd of vhost-user, start to send 8k packets
+        """
+        session_tx.send_expect("set fwd csum", "testpmd> ", 30)
+        session_tx.send_expect("set txpkts 2000,2000,2000,2000", "testpmd> ", 30)
+        session_tx.send_expect("set burst 1", "testpmd> ", 30)
+        session_tx.send_expect("start tx_first 1", "testpmd> ", 10)
+        session_tx.send_expect("stop", "testpmd> ", 30)
+
+    def start_to_send_8k_packets_csum_cbdma(self, session_tx):
+        """
+        start the testpmd of vhost-user, start to send 8k packets
+        """
+        session_tx.send_expect("vhost enable tx all", "testpmd> ", 30)
+        session_tx.send_expect("set fwd csum", "testpmd> ", 30)
+        session_tx.send_expect("set txpkts 64,64,64,2000,2000,2000", "testpmd> ", 30)
+        session_tx.send_expect("start tx_first 32", "testpmd> ", 5)
+        session_tx.send_expect("stop", "testpmd> ", 30)
+
     def check_port_throughput_after_port_stop(self):
         """
         check the throughput after port stop
@@ -182,6 +221,16 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         self.check_port_link_status_after_port_restart()
         self.vhost_pmd.execute_cmd("start tx_first 32", "testpmd> ", 120)
 
+    def port_restart_send_8k_packets(self):
+        self.vhost_pmd.execute_cmd("stop", "testpmd> ", 120)
+        self.vhost_pmd.execute_cmd("port stop 0", "testpmd> ", 120)
+        self.check_port_throughput_after_port_stop()
+        self.vhost_pmd.execute_cmd("clear port stats all", "testpmd> ", 120)
+        self.vhost_pmd.execute_cmd("port start 0", "testpmd> ", 120)
+        self.check_port_link_status_after_port_restart()
+        self.vhost_pmd.execute_cmd("set txpkts 2000,2000,2000,2000", "testpmd> ", 120)
+        self.vhost_pmd.execute_cmd("start tx_first 32", "testpmd> ", 120)
+
     def relanuch_vhost_testpmd_with_multi_queue(self):
         self.vhost_pmd.execute_cmd("quit", "#", 60)
         self.check_link_status(self.virtio_user, "down")
@@ -192,7 +241,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         self.check_link_status(self.vhost, "down")
         self.lanuch_virtio_user_testpmd_with_multi_queue(mode, extern_params)
 
-    def calculate_avg_throughput(self, case_info, cycle):
+    def calculate_avg_throughput(self, case_info, cycle, Pkt_size=True):
         """
         calculate the average throughput
         """
@@ -206,14 +255,19 @@ class TestLoopbackVirtioUserServerMode(TestCase):
             result = lines.group(1)
             results += float(result)
         Mpps = results / (1000000 * 10)
-        self.verify(Mpps > 5, "port can not receive packets")
-
         results_row.append(case_info)
-        results_row.append('64')
+        if Pkt_size:
+            self.verify(Mpps > 5, "port can not receive packets")
+            results_row.append('64')
+        else:
+            self.verify(Mpps > 1, "port can not receive packets")
+            results_row.append('8k')
+
         results_row.append(Mpps)
         results_row.append(self.queue_number)
         results_row.append(cycle)
         self.result_table_add(results_row)
+        self.logger.info(results_row)
 
     def check_packets_of_each_queue(self):
         """
@@ -247,7 +301,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_launch_virtio_first(self):
         """
-        basic test for virtio-user server mode, launch virtio-user first
+        Test Case 2: basic test for split ring server mode, launch virtio-user first
         """
         self.queue_number = 1
         self.nb_cores = 1
@@ -263,7 +317,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_launch_virtio11_first(self):
         """
-        basic test for virtio-user server mode, launch virtio-user first
+        Test Case 1: basic test for packed ring server mode, launch virtio-user first
         """
         self.queue_number = 1
         self.nb_cores = 1
@@ -279,7 +333,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio11_mergeable_path(self):
         """
-        reconnect test with virtio 1.1 mergeable path and server mode
+        Test Case 8: reconnect test with virtio 1.1 mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
@@ -288,25 +342,25 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         extern_params = '--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
         self.lanuch_virtio_user_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "before reconnet")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "before reconnet", Pkt_size=False)
 
         # reconnect from vhost
         self.logger.info('now reconnet from vhost')
         self.relanuch_vhost_testpmd_with_multi_queue()
-        self.start_to_send_packets(self.virtio_user, self.vhost)
-        self.calculate_avg_throughput(case_info, "reconnet from vhost")
+        self.start_to_send_8k_packets(self.virtio_user, self.vhost)
+        self.calculate_avg_throughput(case_info, "reconnet from vhost", Pkt_size=False)
 
         # reconnet from virtio
         self.logger.info('now reconnet from virtio_user')
         self.relanuch_virtio_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "reconnet from virtio user")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "reconnet from virtio user", Pkt_size=False)
 
         # port restart
         self.logger.info('now vhost port restart')
-        self.port_restart()
-        self.calculate_avg_throughput(case_info, "after port restart")
+        self.port_restart_send_8k_packets()
+        self.calculate_avg_throughput(case_info, "after port restart", Pkt_size=False)
 
         self.result_table_print()
         self.check_packets_of_each_queue()
@@ -314,7 +368,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio11_non_mergeable_path(self):
         """
-        reconnect test with virtio 1.1 non_mergeable path and server mode
+        Test Case 9: reconnect test with virtio 1.1 non_mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
@@ -349,34 +403,34 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio11_inorder_mergeable_path(self):
         """
-        reconnect test with virtio 1.1 inorder mergeable path and server mode
+        Test Case 10: reconnect test with virtio 1.1 inorder mergeable path and server mode
         """
-        self.queue_number = 2
+        self.queue_number = 8
         self.nb_cores = 2
         case_info = 'virtio1.1 inorder mergeable path'
         mode = "packed_vq=1,in_order=1,mrg_rxbuf=1"
         extern_params = '--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
         self.lanuch_virtio_user_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "before reconnet")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "before reconnet", Pkt_size=False)
 
         # reconnect from vhost
         self.logger.info('now reconnet from vhost')
         self.relanuch_vhost_testpmd_with_multi_queue()
-        self.start_to_send_packets(self.virtio_user, self.vhost)
-        self.calculate_avg_throughput(case_info, "reconnet from vhost")
+        self.start_to_send_8k_packets(self.virtio_user, self.vhost)
+        self.calculate_avg_throughput(case_info, "reconnet from vhost", Pkt_size=False)
 
         # reconnet from virtio
         self.logger.info('now reconnet from virtio_user')
         self.relanuch_virtio_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "reconnet from virtio user")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "reconnet from virtio user", Pkt_size=False)
 
         # port restart
         self.logger.info('now vhost port restart')
-        self.port_restart()
-        self.calculate_avg_throughput(case_info, "after port restart")
+        self.port_restart_send_8k_packets()
+        self.calculate_avg_throughput(case_info, "after port restart", Pkt_size=False)
 
         self.result_table_print()
         self.check_packets_of_each_queue()
@@ -384,11 +438,11 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio11_inorder_non_mergeable_path(self):
         """
-        reconnect test with virtio 1.1 inorder non_mergeable path and server mode
+        Test Case 11: reconnect test with virtio 1.1 inorder non_mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
-        case_info = 'virtio1.1 non_mergeable path'
+        case_info = 'virtio1.1 inorder non_mergeable path'
         mode = "packed_vq=1,in_order=1,mrg_rxbuf=0,vectorized=1"
         extern_params = '--rx-offloads=0x10 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
@@ -419,11 +473,11 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio11_inorder_vectorized_path(self):
         """
-        reconnect test with virtio 1.1 inorder non_mergeable path and server mode
+        Test Case 12: reconnect test with virtio 1.1 inorder vectorized path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
-        case_info = 'virtio1.1 non_mergeable path'
+        case_info = 'virtio1.1 inorder vectorized path'
         mode = "packed_vq=1,in_order=1,mrg_rxbuf=0,vectorized=1"
         extern_params = '--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
@@ -454,7 +508,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio10_inorder_mergeable_path(self):
         """
-        reconnect test with virtio 1.0 inorder mergeable path and server mode
+        Test Case 4: reconnect test with virtio 1.0 inorder mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
@@ -463,25 +517,25 @@ class TestLoopbackVirtioUserServerMode(TestCase):
         extern_params = '--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
         self.lanuch_virtio_user_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "before reconnet")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "before reconnet", Pkt_size=False)
 
         # reconnet from vhost
         self.logger.info('now reconnet from vhost')
         self.relanuch_vhost_testpmd_with_multi_queue()
-        self.start_to_send_packets(self.virtio_user, self.vhost)
-        self.calculate_avg_throughput(case_info, "reconnet from vhost")
+        self.start_to_send_8k_packets(self.virtio_user, self.vhost)
+        self.calculate_avg_throughput(case_info, "reconnet from vhost", Pkt_size=False)
 
         # reconnet from virtio
         self.logger.info('now reconnet from virtio_user')
         self.relanuch_virtio_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "reconnet from virtio_user")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "reconnet from virtio_user", Pkt_size=False)
 
         # port restart
         self.logger.info('now vhost port restart')
-        self.port_restart()
-        self.calculate_avg_throughput(case_info, "after port restart")
+        self.port_restart_send_8k_packets()
+        self.calculate_avg_throughput(case_info, "after port restart", Pkt_size=False)
 
         self.result_table_print()
         self.check_packets_of_each_queue()
@@ -489,7 +543,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio10_inorder_non_mergeable_path(self):
         """
-        reconnect test with virtio 1.0 inorder non_mergeable path and server mode
+        Test Case 5: reconnect test with virtio 1.0 inorder non_mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
@@ -524,34 +578,34 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio10_mergeable_path(self):
         """
-        reconnect test with virtio 1.0 mergeable path and server mode
+        Test Case 3: reconnect test with virtio 1.0 mergeable path and server mode
         """
-        self.queue_number = 2
+        self.queue_number = 8
         self.nb_cores = 2
         case_info = 'virtio1.0 mergeable path'
         mode = "in_order=0,mrg_rxbuf=1"
         extern_params = '--tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip'
         self.lanuch_vhost_testpmd_with_multi_queue()
         self.lanuch_virtio_user_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "before reconnet")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "before reconnet", Pkt_size=False)
 
         # reconnet from vhost
         self.logger.info('now reconnet from vhost')
         self.relanuch_vhost_testpmd_with_multi_queue()
-        self.start_to_send_packets(self.virtio_user, self.vhost)
-        self.calculate_avg_throughput(case_info, "reconnet from vhost")
+        self.start_to_send_8k_packets(self.virtio_user, self.vhost)
+        self.calculate_avg_throughput(case_info, "reconnet from vhost", Pkt_size=False)
 
         # reconnet from virtio
         self.logger.info('now reconnet from virtio_user')
         self.relanuch_virtio_testpmd_with_multi_queue(mode=mode, extern_params=extern_params)
-        self.start_to_send_packets(self.vhost, self.virtio_user)
-        self.calculate_avg_throughput(case_info, "reconnet from virtio_user")
+        self.start_to_send_8k_packets(self.vhost, self.virtio_user)
+        self.calculate_avg_throughput(case_info, "reconnet from virtio_user", Pkt_size=False)
 
         # port restart
         self.logger.info('now vhost port restart')
-        self.port_restart()
-        self.calculate_avg_throughput(case_info, "after port restart")
+        self.port_restart_send_8k_packets()
+        self.calculate_avg_throughput(case_info, "after port restart", Pkt_size=False)
 
         self.result_table_print()
         self.check_packets_of_each_queue()
@@ -559,7 +613,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio10_non_mergeable_path(self):
         """
-        reconnect test with virtio 1.0 non_mergeable path and server mode
+        Test Case 6: reconnect test with virtio 1.0 non_mergeable path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
@@ -594,7 +648,7 @@ class TestLoopbackVirtioUserServerMode(TestCase):
 
     def test_server_mode_reconnect_with_virtio10_vector_rx_path(self):
         """
-        reconnect test with virtio 1.0 vector_rx path and server mode
+        Test Case 7: reconnect test with virtio 1.0 vector_rx path and server mode
         """
         self.queue_number = 2
         self.nb_cores = 2
-- 
2.33.1


^ permalink raw reply	[flat|nested] 6+ messages in thread

* RE: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan
  2021-11-11  9:34   ` Chen, LingliX
@ 2021-11-22  8:32     ` Wang, Yinan
  2021-11-25  3:33     ` Tu, Lijuan
  1 sibling, 0 replies; 6+ messages in thread
From: Wang, Yinan @ 2021-11-22  8:32 UTC (permalink / raw)
  To: Chen, LingliX, dts

Acked-by:  Yinan Wang <yinan.wang@intel.com>

> -----Original Message-----
> From: Chen, LingliX <linglix.chen@intel.com>
> Sent: 2021?11?11? 17:35
> To: dts@dpdk.org
> Cc: Wang, Yinan <yinan.wang@intel.com>
> Subject: RE: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode:
> Modify case sync with testplan
> 
> 
> > -----Original Message-----
> > From: Chen, LingliX <linglix.chen@intel.com>
> > Sent: Friday, November 12, 2021 1:33 AM
> > To: dts@dpdk.org
> > Cc: Chen, LingliX <linglix.chen@intel.com>
> > Subject: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode:
> Modify
> > case sync with testplan
> >
> > Modify case 3, 4, 8, 10 sync with testplan.
> >
> > Signed-off-by: Lingli Chen <linglix.chen@intel.com>
> 
> Tested-by: Lingli Chen <linglix.chen@intel.com>

^ permalink raw reply	[flat|nested] 6+ messages in thread

* RE: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan
  2021-11-11  9:34   ` Chen, LingliX
  2021-11-22  8:32     ` Wang, Yinan
@ 2021-11-25  3:33     ` Tu, Lijuan
  1 sibling, 0 replies; 6+ messages in thread
From: Tu, Lijuan @ 2021-11-25  3:33 UTC (permalink / raw)
  To: Chen, LingliX, dts; +Cc: Wang, Yinan



> -----Original Message-----
> From: Chen, LingliX <linglix.chen@intel.com>
> Sent: 2021年11月11日 17:35
> To: dts@dpdk.org
> Cc: Wang, Yinan <yinan.wang@intel.com>
> Subject: RE: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode:
> Modify case sync with testplan
> 
> 
> > -----Original Message-----
> > From: Chen, LingliX <linglix.chen@intel.com>
> > Sent: Friday, November 12, 2021 1:33 AM
> > To: dts@dpdk.org
> > Cc: Chen, LingliX <linglix.chen@intel.com>
> > Subject: [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode:
> > Modify case sync with testplan
> >
> > Modify case 3, 4, 8, 10 sync with testplan.
> >
> > Signed-off-by: Lingli Chen <linglix.chen@intel.com>
> 
> Tested-by: Lingli Chen <linglix.chen@intel.com>

Applied, thanks

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2021-11-25  3:33 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-11-11 17:32 [dts][PATCH V1 0/2] loopback_virtio_user_server_mode: modify for case coverage improvement Lingli Chen
2021-11-11 17:32 ` [dts][PATCH V1 1/2] test_plans/loopback_virtio_user_server_mode: " Lingli Chen
2021-11-11 17:32 ` [dts][PATCH V1 2/2] tests/loopback_virtio_user_server_mode: Modify case sync with testplan Lingli Chen
2021-11-11  9:34   ` Chen, LingliX
2021-11-22  8:32     ` Wang, Yinan
2021-11-25  3:33     ` Tu, Lijuan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).