test suite reviews and discussions
 help / color / mirror / Atom feed
* [dts] [PATCH v1] test_plans: update test cases for pvp_multi_paths_performance_test_plan.rst
@ 2020-04-29 19:38 Yinan
  2020-05-06  3:25 ` Tu, Lijuan
  0 siblings, 1 reply; 2+ messages in thread
From: Yinan @ 2020-04-29 19:38 UTC (permalink / raw)
  To: dts; +Cc: Wang Yinan

From: Wang Yinan <yinan.wang@intel.com>

Signed-off-by: Wang Yinan <yinan.wang@intel.com>
---
 conf/pvp_multi_paths_performance.cfg          |  2 +-
 .../pvp_multi_paths_performance_test_plan.rst | 23 ++++++++-----------
 2 files changed, 11 insertions(+), 14 deletions(-)

diff --git a/conf/pvp_multi_paths_performance.cfg b/conf/pvp_multi_paths_performance.cfg
index a725abb..4e13c1a 100644
--- a/conf/pvp_multi_paths_performance.cfg
+++ b/conf/pvp_multi_paths_performance.cfg
@@ -3,4 +3,4 @@ update_expected = True
 test_parameters = {64: [1024],1518: [1024]}
 test_duration = 60
 accepted_tolerance = 2
-expected_throughput = {'test_perf_pvp_virtio11_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_no_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_vector_rx': {64: {1024: 0.00}, 1518: {1024: 0.00}},}
+expected_throughput = {'test_perf_pvp_virtio11_vectorized': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_virtio11_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_vector_rx': {64: {1024: 0.00}, 1518: {1024: 0.00}},}
diff --git a/test_plans/pvp_multi_paths_performance_test_plan.rst b/test_plans/pvp_multi_paths_performance_test_plan.rst
index c326a20..c35b0e4 100644
--- a/test_plans/pvp_multi_paths_performance_test_plan.rst
+++ b/test_plans/pvp_multi_paths_performance_test_plan.rst
@@ -37,17 +37,14 @@ vhost/virtio pvp multi-paths performance test plan
 Benchmark PVP multi-paths performance with 10 tx/rx paths. Includes mergeable, non-mergeable, vectorized_rx,
 inorder mergeable, inorder non-mergeable, virtio 1.1 mergeable, virtio 1.1 non-mergeable,virtio 1.1 inorder
 mergeable, virtio 1.1 inorder non-mergeable, virtio1.1 vectorized path. Give 1 core for vhost and virtio respectively.
-
-Packed ring vectorized path will be selected when:
-    vectorized option is enabled
+Packed ring vectorized path need:
     AVX512F and required extensions are supported by compiler and host
-    virtio VERSION_1 and IN_ORDER features are negotiated
-    virtio mergeable feature is not negotiated
+    VERSION_1 and IN_ORDER features are negotiated
+    mergeable feature is not negotiated
     LRO offloading is disabled
-Split ring vectorized rx path will be selected when:
-    vectorized option is enabled
-    virtio mergeable and IN_ORDER features are not negotiated
-    LRO, chksum and vlan strip offloading are disabled
+Split ring vectorized rx path need:
+    mergeable and IN_ORDER features are not negotiated
+    LRO, chksum and vlan strip offloadings are disabled
 
 Test flow
 =========
@@ -190,7 +187,7 @@ Test Case 6: pvp test with non-mergeable path
 
     ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_order=0,mrg_rxbuf=0,vectorized=1 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --rxd=1024
+    -- -i --rx-offloads=0x10 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --rxd=1024
     >set fwd mac
     >start
 
@@ -214,7 +211,7 @@ Test Case 7: pvp test with vectorized_rx path
 
     ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_order=0,mrg_rxbuf=0,vectorized=1 \
-    -- -i --tx-offloads=0x0 --nb-cores=1 --txd=1024 --rxd=1024
+    -- -i --nb-cores=1 --txd=1024 --rxd=1024
     >set fwd mac
     >start
 
@@ -262,7 +259,7 @@ Test Case 9: pvp test with virtio 1.1 inorder non-mergeable path
 
     ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
-    -- -i --rx-offloads=0x10 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --rxd=1024
+    -- -i --rx-offloads=0x10 --nb-cores=1 --txd=1024 --rxd=1024
     >set fwd mac
     >start
 
@@ -285,7 +282,7 @@ Test Case 10: pvp test with virtio 1.1 vectorized path
 
     ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
     --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
-    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --rxd=1024
+    -- -i --nb-cores=1 --txd=1024 --rxd=1024
     >set fwd mac
     >start
 
-- 
2.17.1


^ permalink raw reply	[flat|nested] 2+ messages in thread

* Re: [dts] [PATCH v1] test_plans: update test cases for pvp_multi_paths_performance_test_plan.rst
  2020-04-29 19:38 [dts] [PATCH v1] test_plans: update test cases for pvp_multi_paths_performance_test_plan.rst Yinan
@ 2020-05-06  3:25 ` Tu, Lijuan
  0 siblings, 0 replies; 2+ messages in thread
From: Tu, Lijuan @ 2020-05-06  3:25 UTC (permalink / raw)
  To: Wang, Yinan, dts; +Cc: Wang, Yinan

Applied, thanks

> -----Original Message-----
> From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of Yinan
> Sent: Thursday, April 30, 2020 3:39 AM
> To: dts@dpdk.org
> Cc: Wang, Yinan <yinan.wang@intel.com>
> Subject: [dts] [PATCH v1] test_plans: update test cases for
> pvp_multi_paths_performance_test_plan.rst
> 
> From: Wang Yinan <yinan.wang@intel.com>
> 
> Signed-off-by: Wang Yinan <yinan.wang@intel.com>
> ---
>  conf/pvp_multi_paths_performance.cfg          |  2 +-
>  .../pvp_multi_paths_performance_test_plan.rst | 23 ++++++++-----------
>  2 files changed, 11 insertions(+), 14 deletions(-)
> 
> diff --git a/conf/pvp_multi_paths_performance.cfg
> b/conf/pvp_multi_paths_performance.cfg
> index a725abb..4e13c1a 100644
> --- a/conf/pvp_multi_paths_performance.cfg
> +++ b/conf/pvp_multi_paths_performance.cfg
> @@ -3,4 +3,4 @@ update_expected = True
>  test_parameters = {64: [1024],1518: [1024]}  test_duration = 60
> accepted_tolerance = 2 -expected_throughput =
> {'test_perf_pvp_virtio11_mergeable': {64: {1024: 0.00}, 1518: {1024: 0.00}},
> 'test_perf_pvp_virtio11_normal': {64: {1024: 0.00}, 1518: {1024: 0.00}},
> 'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518: {1024:
> 0.00}}, 'test_perf_pvp_virtio11_inorder_normal': {64: {1024: 0.00}, 1518:
> {1024: 0.00}}, 'test_perf_pvp_inorder_mergeable': {64: {1024: 0.00}, 1518:
> {1024: 0.00}}, 'test_perf_pvp_inorder_no_mergeable': {64: {1024: 0.00}, 1518:
> {1024: 0.00}},'test_perf_pvp_mergeable': {64: {1024: 0.00}, 1518: {1024:
> 0.00}},'test_perf_pvp_normal': {64: {1024: 0.00}, 1518: {1024:
> 0.00}},'test_perf_pvp_vector_rx': {64: {1024: 0.00}, 1518: {1024: 0.00}},}
> +expected_throughput = {'test_perf_pvp_virtio11_vectorized': {64: {1024:
> +0.00}, 1518: {1024: 0.00}},'test_perf_pvp_virtio11_mergeable': {64:
> +{1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_virtio11_normal':
> +{64: {1024: 0.00}, 1518: {1024: 0.00}},
> +'test_perf_pvp_virtio11_inorder_mergeable': {64: {1024: 0.00}, 1518:
> +{1024: 0.00}}, 'test_perf_pvp_virtio11_inorder_normal': {64: {1024:
> +0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_mergeable': {64:
> +{1024: 0.00}, 1518: {1024: 0.00}}, 'test_perf_pvp_inorder_normal': {64:
> +{1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_mergeable': {64:
> +{1024: 0.00}, 1518: {1024: 0.00}},'test_perf_pvp_normal': {64: {1024:
> +0.00}, 1518: {1024: 0.00}},'test_perf_pvp_vector_rx': {64: {1024:
> +0.00}, 1518: {1024: 0.00}},}
> diff --git a/test_plans/pvp_multi_paths_performance_test_plan.rst
> b/test_plans/pvp_multi_paths_performance_test_plan.rst
> index c326a20..c35b0e4 100644
> --- a/test_plans/pvp_multi_paths_performance_test_plan.rst
> +++ b/test_plans/pvp_multi_paths_performance_test_plan.rst
> @@ -37,17 +37,14 @@ vhost/virtio pvp multi-paths performance test plan
> Benchmark PVP multi-paths performance with 10 tx/rx paths. Includes
> mergeable, non-mergeable, vectorized_rx,  inorder mergeable, inorder non-
> mergeable, virtio 1.1 mergeable, virtio 1.1 non-mergeable,virtio 1.1 inorder
> mergeable, virtio 1.1 inorder non-mergeable, virtio1.1 vectorized path. Give 1
> core for vhost and virtio respectively.
> -
> -Packed ring vectorized path will be selected when:
> -    vectorized option is enabled
> +Packed ring vectorized path need:
>      AVX512F and required extensions are supported by compiler and host
> -    virtio VERSION_1 and IN_ORDER features are negotiated
> -    virtio mergeable feature is not negotiated
> +    VERSION_1 and IN_ORDER features are negotiated
> +    mergeable feature is not negotiated
>      LRO offloading is disabled
> -Split ring vectorized rx path will be selected when:
> -    vectorized option is enabled
> -    virtio mergeable and IN_ORDER features are not negotiated
> -    LRO, chksum and vlan strip offloading are disabled
> +Split ring vectorized rx path need:
> +    mergeable and IN_ORDER features are not negotiated
> +    LRO, chksum and vlan strip offloadings are disabled
> 
>  Test flow
>  =========
> @@ -190,7 +187,7 @@ Test Case 6: pvp test with non-mergeable path
> 
>      ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
>      --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,in_order=0,mrg_rxbuf=0,vectorized=1 \
> -    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --
> rxd=1024
> +    -- -i --rx-offloads=0x10 --enable-hw-vlan-strip --nb-cores=1
> + --txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
> @@ -214,7 +211,7 @@ Test Case 7: pvp test with vectorized_rx path
> 
>      ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
>      --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,in_order=0,mrg_rxbuf=0,vectorized=1 \
> -    -- -i --tx-offloads=0x0 --nb-cores=1 --txd=1024 --rxd=1024
> +    -- -i --nb-cores=1 --txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
> @@ -262,7 +259,7 @@ Test Case 9: pvp test with virtio 1.1 inorder non-
> mergeable path
> 
>      ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
>      --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
> -    -- -i --rx-offloads=0x10 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --
> rxd=1024
> +    -- -i --rx-offloads=0x10 --nb-cores=1 --txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
> @@ -285,7 +282,7 @@ Test Case 10: pvp test with virtio 1.1 vectorized path
> 
>      ./testpmd -n 4 -l 5-6 --no-pci --file-prefix=virtio \
>      --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=0,in_order=1,vectorized=1 \
> -    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --nb-cores=1 --txd=1024 --
> rxd=1024
> +    -- -i --nb-cores=1 --txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
> --
> 2.17.1


^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2020-05-06  3:25 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-04-29 19:38 [dts] [PATCH v1] test_plans: update test cases for pvp_multi_paths_performance_test_plan.rst Yinan
2020-05-06  3:25 ` Tu, Lijuan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).