test suite reviews and discussions
 help / color / mirror / Atom feed
From: "Tu, Lijuan" <lijuan.tu@intel.com>
To: "Wang, Yinan" <yinan.wang@intel.com>, "dts@dpdk.org" <dts@dpdk.org>
Cc: "Wang, Yinan" <yinan.wang@intel.com>
Subject: Re: [dts] [PATCH v2] test_plans/loopback_multi_paths_port_restart: add	test plan for loopback multi path port restart test
Date: Tue, 23 Apr 2019 20:29:45 +0000	[thread overview]
Message-ID: <8CE3E05A3F976642AAB0F4675D0AD20E0BA65908@SHSMSX101.ccr.corp.intel.com> (raw)
In-Reply-To: <20190422013128.27858-1-yinan.wang@intel.com>

Applied, thanks

> -----Original Message-----
> From: dts [mailto:dts-bounces@dpdk.org] On Behalf Of Yinan
> Sent: Sunday, April 21, 2019 6:31 PM
> To: dts@dpdk.org
> Cc: Wang, Yinan <yinan.wang@intel.com>
> Subject: [dts] [PATCH v2] test_plans/loopback_multi_paths_port_restart:
> add test plan for loopback multi path port restart test
> 
> From: Wang Yinan <yinan.wang@intel.com>
> 
> Signed-off-by: Wang Yinan <yinan.wang@intel.com>
> ---
>  ...ack_multi_paths_port_restart_test_plan.rst | 194 ++++++++++++------
>  1 file changed, 127 insertions(+), 67 deletions(-)
> 
> diff --git a/test_plans/loopback_multi_paths_port_restart_test_plan.rst
> b/test_plans/loopback_multi_paths_port_restart_test_plan.rst
> index 115a5e8..e7ec1df 100644
> --- a/test_plans/loopback_multi_paths_port_restart_test_plan.rst
> +++ b/test_plans/loopback_multi_paths_port_restart_test_plan.rst
> @@ -30,35 +30,33 @@
>     ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF
> ADVISED
>     OF THE POSSIBILITY OF SUCH DAMAGE.
> 
> -===========================================
> -Loopback multi-paths and port restart Tests -
> ===========================================
> +===============================================================
> ==
> +vhost/virtio loopback with multi-paths and port restart test plan
> +===============================================================
> ==
> 
>  Description
>  ===========
> 
> -Benchmark vhost/virtio-user loopback test with 7 RX/TX PATHs.
> -Includes Mergeable, Normal, Vector_RX, Inorder mergeable, -Inorder no-
> mergeable, Virtio 1.1 mergeable, Virtio 1.1 no-mergeable Path.
> +Benchmark vhost/virtio-user loopback test with 8 rx/tx paths.
> +Includes mergeable, normal, vector_rx, inorder mergeable, inorder
> +no-mergeable, virtio 1.1 mergeable, virtio 1.1 inorder, virtio 1.1 normal
> path.
>  Also cover port restart test with each path.
> 
> -
> -
> -Test Case 1:loopback test with Virtio 1.1 mergeable path -
> ================================================================
> ===========
> +Test Case 1: loopback test with virtio 1.1 mergeable path
> +=========================================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
>      ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
>      --legacy-mem --no-pci --file-prefix=virtio \
> -    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=1 \
> +
> + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_
> + vq=1,mrg_rxbuf=1,in_order=0 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> @@ -67,71 +65,118 @@ Test Case 1:loopback test with Virtio 1.1 mergeable
> path
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Repeat below command to get throughput 10 times,then calculate the
> average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
>      testpmd>show port stats all
> 
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> 
> -Test Case 2: loopback test with Virtio 1.1 no-mergeable path -
> ================================================================
> ===========
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
> +    testpmd>show port stats all
> +
> +Test Case 2: loopback test with virtio 1.1 normal path
> +======================================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
>      ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
>      --legacy-mem --no-pci --file-prefix=virtio \
> -    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,mrg_rxbuf=0 \
> +
> + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,packed_
> + vq=1,mrg_rxbuf=0,in_order=0 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> 
> -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in
> [64, 128, 256, 512, 1024, 1518]::
> +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs
> in [64, 128, 256, 512, 1024, 1518]::
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
>      testpmd>show port stats all
> 
> -Test Case 3: loopback test with Inorder mergeable path -
> ================================================================
> ===========
> +Test Case 3: loopback test with virtio 1.1 inorder path
> +=======================================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> +
> +2. Launch virtio-user by below command::
> +
> +    ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
> +    --legacy-mem --no-pci --file-prefix=virtio \
> +    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,packed_vq=1,in_order=1,mrg_rxbuf=0 \
> +    -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip
> + --nb-cores=1 --txd=1024 --rxd=1024
>      >set fwd mac
> +    >start
> +
> +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs
> in [64, 128, 256, 512, 1024, 1518]::
> +
> +    testpmd>set txpkts [frame_size]
> +    testpmd>start tx_first 32
> +
> +4. Get throughput 10 times and calculate the average throughput::
> +
> +    testpmd>show port stats all
> +
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> +
> +    testpmd>stop
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
> +    testpmd>show port stats all
> +
> +Test Case 4: loopback test with inorder mergeable path
> +======================================================
> +
> +1. Launch vhost by below command::
> +
> +    rm -rf vhost-net*
> +    ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
> +    --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' -
> - -i --nb-cores=1 --txd=1024 --rxd=1024
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
>      ./testpmd -n 4 -l 5-6 --socket-mem 1024,1024 \
>      --legacy-mem --no-pci --file-prefix=virtio \
> -    --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-
> net,in_order=1 \
> +
> + --vdev=net_virtio_user0,mac=00:01:02:03:04:05,path=./vhost-net,in_orde
> + r=1,mrg_rxbuf=1 \
>      -- -i --tx-offloads=0x0 --enable-hw-vlan-strip --rss-ip --nb-cores=1 --
> txd=1024 --rxd=1024
>      >set fwd mac
>      >start
> @@ -140,28 +185,32 @@ Test Case 3: loopback test with Inorder mergeable
> path
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
>      testpmd>show port stats all
> 
> -Test Case 4: loopback test with Inorder no-mergeable path -
> ================================================================
> ===========
> +Test Case 5: loopback test with inorder no-mergeable path
> +=========================================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
> @@ -172,32 +221,36 @@ Test Case 4: loopback test with Inorder no-
> mergeable path
>      >set fwd mac
>      >start
> 
> -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in
> [64, 128, 256, 512, 1024, 1518]::
> +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs
> in [64, 128, 256, 512, 1024, 1518]::
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
>      testpmd>show port stats all
> 
> -Test Case 5: loopback test with Mergeable path -
> ================================================================
> ===========
> +Test Case 6: loopback test with mergeable path
> +==============================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
> @@ -208,37 +261,36 @@ Test Case 5: loopback test with Mergeable path
>      >set fwd mac
>      >start
> 
> -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in
> [64, 128, 256, 512, 1024, 1518]::
> +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs
> in [64, 128, 256, 512, 1024, 1518]::
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart 100 times by below command and re-calculate the average
> througnput::
> +5. Port restart at vhost side 100 times and re-calculate the average
> throughput, verify the throughput is not zero after port restart::
> 
>      testpmd>stop
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>port start 0
>      ...
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
>      testpmd>show port stats all
> 
> -
> -
> -Test Case 6: loopback test with Normal path -
> ================================================================
> ===========
> +Test Case 7: loopback test with normal path
> +===========================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
> @@ -253,28 +305,32 @@ Test Case 6: loopback test with Normal path
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
>      testpmd>show port stats all
> 
> -Test Case 7: loopback test with Vector_RX path -
> ================================================================
> ===========
> +Test Case 8: loopback test with vector_rx path
> +==============================================
> 
>  1. Launch vhost by below command::
> 
>      rm -rf vhost-net*
>      ./testpmd -n 4 -l 2-4  --socket-mem 1024,1024 --legacy-mem --no-pci \
>      --file-prefix=vhost --vdev 'net_vhost0,iface=vhost-net,queues=1,client=0' --
> -i --nb-cores=1 --txd=1024 --rxd=1024
> -    >set fwd mac
> +    testpmd>set fwd mac
> 
>  2. Launch virtio-user by below command::
> 
> @@ -285,19 +341,23 @@ Test Case 7: loopback test with Vector_RX path
>      >set fwd mac
>      >start
> 
> -3. Send packets with vhost-testpmd,[frame_size] is the parameter changs in
> [64, 128, 256, 512, 1024, 1518]::
> +3. Send packets with vhost-testpmd, [frame_size] is the parameter changs
> in [64, 128, 256, 512, 1024, 1518]::
> 
>      testpmd>set txpkts [frame_size]
>      testpmd>start tx_first 32
> -    testpmd>start
> 
>  4. Get throughput 10 times and calculate the average throughput::
> 
>      testpmd>show port stats all
> 
> -5. Port restart by below command and re-calculate the average througnput::
> +5. Stop port at vhost side and re-calculate the average throughput, verify
> the throughput is zero after port stop::
> 
>      testpmd>stop
> -    testpmd>clear port stats all
> -    testpmd>start
> -    testpmd>show port stats all
> \ No newline at end of file
> +    testpmd>port stop 0
> +    testpmd>show port stats all
> +
> +6. Restart port at vhost side and re-calculate the average throughput, verify
> the throughput is not zero after port restart::
> +
> +    testpmd>port start 0
> +    testpmd>start tx_first 32
> +    testpmd>show port stats all
> --
> 2.17.1


      reply	other threads:[~2019-04-23 20:29 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-04-22  1:31 Yinan
2019-04-23 20:29 ` Tu, Lijuan [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8CE3E05A3F976642AAB0F4675D0AD20E0BA65908@SHSMSX101.ccr.corp.intel.com \
    --to=lijuan.tu@intel.com \
    --cc=dts@dpdk.org \
    --cc=yinan.wang@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).