test suite reviews and discussions
 help / color / Atom feed
From: "Wang, Yinan" <yinan.wang@intel.com>
To: "Xiao, QimaiX" <qimaix.xiao@intel.com>, "dts@dpdk.org" <dts@dpdk.org>
Cc: "Xiao, QimaiX" <qimaix.xiao@intel.com>
Subject: Re: [dts] [PATCH V1 11/11]virtio_pvp_regression: update script	according to testplan's update
Date: Wed, 25 Mar 2020 08:22:07 +0000
Message-ID: <1cb57e423ac14a10896ab077d2270d9e@intel.com> (raw)
In-Reply-To: <1585123857-130281-11-git-send-email-qimaix.xiao@intel.com>

Acked-by: Wang, Yinan <yinan.wang@intel.com>

> -----Original Message-----
> From: dts <dts-bounces@dpdk.org> On Behalf Of Xiao Qimai
> Sent: 2020^[$BG/^[(B3^[$B7n^[(B25^[$BF|^[(B 16:11
> To: dts@dpdk.org
> Cc: Xiao, QimaiX <qimaix.xiao@intel.com>
> Subject: [dts] [PATCH V1 11/11]virtio_pvp_regression: update script according to
> testplan's update
> 
> Signed-off-by: Xiao Qimai <qimaix.xiao@intel.com>
> ---
>  tests/TestSuite_virtio_pvp_regression.py | 34
> ++++++++++++++++++++++++++------
>  1 file changed, 28 insertions(+), 6 deletions(-)
> 
> diff --git a/tests/TestSuite_virtio_pvp_regression.py
> b/tests/TestSuite_virtio_pvp_regression.py
> index 97e522c..42aceae 100644
> --- a/tests/TestSuite_virtio_pvp_regression.py
> +++ b/tests/TestSuite_virtio_pvp_regression.py
> @@ -198,7 +198,7 @@ class TestVirtioPVPRegression(TestCase):
>                  if 'cpupin' in list(self.vm.params[i]['cpu'][0].keys()):
>                      self.vm.params[i]['cpu'][0].pop('cpupin')
> 
> -    def start_vm(self, qemu_path, qemu_version, modem, virtio_path):
> +    def start_vm(self, qemu_path, qemu_version, modem, virtio_path,
> packed=False):
>          """
>          start vm
>          """
> @@ -227,6 +227,8 @@ class TestVirtioPVPRegression(TestCase):
>              opt_args = 'disable-modern=false,' + opt_args
>          elif(modem == 0):
>              opt_args = 'disable-modern=true,' + opt_args
> +        if packed:
> +            opt_args = opt_args + ',packed=on'
>          vm_params['opt_settings'] = opt_args
>          self.vm.set_vm_device(**vm_params)
>          self.vm.load_config()
> @@ -344,7 +346,7 @@ class TestVirtioPVPRegression(TestCase):
>          self.dut.send_expect('killall -s INT qemu-system-x86_64', '# ')
>          self.dut.send_expect("rm -rf %s/vhost-net*" % self.base_dir, "#")
> 
> -    def pvp_regression_run(self, case_info, modem, virtio_path):
> +    def pvp_regression_run(self, case_info, modem, virtio_path,
> packed=False):
>          """
>          run different qemu verssion on different virtio path of pvp regression
>          modem = 0, start vm as virtio 0.95 @@ -357,7 +359,7 @@ class
> TestVirtioPVPRegression(TestCase):
>              version = self.qemu_list[i]["version"]
>              self.start_testpmd_as_vhost()
>              # use different modem and different path to start vm
> -            self.start_vm(path, version, modem, virtio_path)
> +            self.start_vm(path, version, modem, virtio_path,
> + packed=packed)
>              self.start_testpmd_in_vm(virtio_path)
>              self.logger.info("now testing the qemu path of %s" % path)
>              time.sleep(5)
> @@ -370,7 +372,7 @@ class TestVirtioPVPRegression(TestCase):
> 
>              self.logger.info('now reconnect from vm')
>              self.dut.send_expect('killall -s INT qemu-system-x86_64', '# ')
> -            self.start_vm(path, version, modem, virtio_path)
> +            self.start_vm(path, version, modem, virtio_path,
> + packed=packed)
>              self.start_testpmd_in_vm(virtio_path)
>              self.send_verify(case_info, version, "reconnect from vm")
> 
> @@ -397,7 +399,7 @@ class TestVirtioPVPRegression(TestCase):
>          virtio_path = 'mergeable'
>          self.pvp_regression_run(case_info, modem, virtio_path)
> 
> -    def test_perf_pvp_regression_normal_path(self):
> +    def test_perf_pvp_regression_non_mergeable_path(self):
>          """
>          Test the performance of one vm with virtio 0.95 on normal path
>          diff qemu + multi queue + reconnect @@ -407,7 +409,7 @@ class
> TestVirtioPVPRegression(TestCase):
>          virtio_path = 'normal'
>          self.pvp_regression_run(case_info, modem, virtio_path)
> 
> -    def test_perf_pvp_regression_modern_normal_path(self):
> +    def test_perf_pvp_regression_modern_non_mergeable_path(self):
>          """
>          Test the performance of one vm with virtio 1.0 on normal path
>          diff qemu + multi queue + reconnect @@ -437,6 +439,26 @@ class
> TestVirtioPVPRegression(TestCase):
>          virtio_path = 'vector_rx'
>          self.pvp_regression_run(case_info, modem, virtio_path)
> 
> +    def test_perf_pvp_with_virtio11_mergeable_path(self):
> +        """
> +        Test the performance of one vm with virtio 1.1 on mergeable path
> +        diff qemu + multi queue + reconnect
> +        """
> +        case_info = 'virtio-1.1 mergeable'
> +        modem = 1
> +        virtio_path = 'mergeable'
> +        self.pvp_regression_run(case_info, modem, virtio_path,
> + packed=True)
> +
> +    def test_perf_pvp_with_virtio11_non_mergeable_path(self):
> +        """
> +        Test the performance of one vm with virtio 1.1 on mergeable path
> +        diff qemu + multi queue + reconnect
> +        """
> +        case_info = 'virtio-1.1 normal'
> +        modem = 1
> +        virtio_path = 'normal'
> +        self.pvp_regression_run(case_info, modem, virtio_path,
> + packed=True)
> +
>      def tear_down(self):
>          """
>          Run after each test case.
> --
> 1.8.3.1


  reply index

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-03-25  8:10 [dts] [PATCH V1 01/11]loopback_multi_paths_port_restart: " Xiao Qimai
2020-03-25  8:10 ` [dts] [PATCH V1 02/11]loopback_multi_queues: " Xiao Qimai
2020-03-25  8:23   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 03/11]pvp_virtio_user_2M_hugepages: " Xiao Qimai
2020-03-25  8:23   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 04/11]pvp_virtio_user_4k_pages: " Xiao Qimai
2020-03-25  8:20   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 05/11]vhost_enqueue_interrupt: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 06/11]vhost_event_idx_interrupt: " Xiao Qimai
2020-03-25  8:21   ` Wang, Yinan
2020-03-31  2:59   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 07/11]vhost_user_live_migration: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan
2020-03-31  2:59   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 08/11]vhost_virtio_pmd_interrupt: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 09/11]vhost_virtio_user_interrupt: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan
2020-03-31  3:00   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 10/11]virtio_event_idx_interrupt: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan
2020-03-31  2:59   ` Xiao, QimaiX
2020-03-25  8:10 ` [dts] [PATCH V1 11/11]virtio_pvp_regression: " Xiao Qimai
2020-03-25  8:22   ` Wang, Yinan [this message]
2020-03-31  2:59   ` Xiao, QimaiX
2020-03-25  8:22 ` [dts] [PATCH V1 01/11]loopback_multi_paths_port_restart: " Wang, Yinan
2020-03-31  3:00 ` Xiao, QimaiX
2020-03-31  3:06 ` Tu, Lijuan

Reply instructions:

You may reply publically to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1cb57e423ac14a10896ab077d2270d9e@intel.com \
    --to=yinan.wang@intel.com \
    --cc=dts@dpdk.org \
    --cc=qimaix.xiao@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link

test suite reviews and discussions

Archives are clonable:
	git clone --mirror http://inbox.dpdk.org/dts/0 dts/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 dts dts/ http://inbox.dpdk.org/dts \
		dts@dpdk.org
	public-inbox-index dts


Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.dts


AGPL code for this site: git clone https://public-inbox.org/ public-inbox