test suite reviews and discussions
 help / color / mirror / Atom feed
From: Marvin Liu <yong.liu@intel.com>
To: dts@dpdk.org
Subject: [dts] [PATCH v1 00/16] Support parallel multiple virtual machine management
Date: Sun,  7 Jan 2018 21:49:13 -0500	[thread overview]
Message-ID: <1515379769-11553-1-git-send-email-yong.liu@intel.com> (raw)

This series of patches will support parallel multiple virtual machine
management function. Qemu default initialzation process will be enhanced
for parallel start. With new model, efficiency for VMs management can be
significantly improved.

In my environment, test suite can start and control 2 * 63 VMs in two
minutes with this new module.

Marvin Liu (16):
  framework: add external thread pool library
  framework/multiple_vm: add multiple VM management module
  framework/utils: support locks function in parallel model
  framework: add DUT index support
  framework/logger: optimize output format for child threads
  framework/dts: support multiple VMs module
  framework/debugger: support multiple VMs module
  framework/ssh_pexpect: support multiple VMs module
  framework/ssh_connection: support DUT index argument
  framework/settings: add parallel related settings
  framework/virt_resource: support multiple VMs module
  framework/virt_base: add attach/quick start/quit function for VM
    management
  framework/virt_dut: support multiple VMs module
  framework/qemu_kvm: support multiple VMs module
  conf/virt_global: add vm management related configuration
  doc: add descriptions for multiple virtual machine module

 conf/virt_global.cfg           |   2 +
 doc/dts_gsg/index.rst          |   1 +
 doc/dts_gsg/multiple_vm.rst    |  87 ++++++
 doc/dts_gsg/virtualization.rst |  40 +--
 extra_libs/threadpool.py       | 426 +++++++++++++++++++++++++++
 framework/crb.py               |  37 +--
 framework/debugger.py          |  24 +-
 framework/dts.py               |  26 +-
 framework/dut.py               |  46 ++-
 framework/logger.py            |  37 +--
 framework/multiple_vm.py       | 304 +++++++++++++++++++
 framework/project_dpdk.py      |   6 +-
 framework/qemu_kvm.py          | 641 ++++++++++++++++++++++++++++++++---------
 framework/settings.py          |   3 +
 framework/ssh_connection.py    |   6 +-
 framework/ssh_pexpect.py       |  82 ++++--
 framework/utils.py             | 107 +++++--
 framework/virt_base.py         | 108 +++++--
 framework/virt_dut.py          |  76 +++--
 framework/virt_resource.py     |  86 +++++-
 20 files changed, 1797 insertions(+), 348 deletions(-)
 create mode 100644 doc/dts_gsg/multiple_vm.rst
 create mode 100644 extra_libs/threadpool.py
 create mode 100644 framework/multiple_vm.py

-- 
1.9.3

             reply	other threads:[~2018-01-08  9:56 UTC|newest]

Thread overview: 34+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-01-08  2:49 Marvin Liu [this message]
2018-01-08  2:49 ` [dts] [PATCH v1 01/16] framework: add external thread pool library Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 02/16] framework/multiple_vm: add multiple VM management module Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 03/16] framework/utils: support locks function in parallel model Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 04/16] framework: add DUT index support Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 05/16] framework/logger: optimize output format for child threads Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 06/16] framework/dts: support multiple VMs module Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 07/16] framework/debugger: " Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 08/16] framework/ssh_pexpect: " Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 09/16] framework/ssh_connection: support DUT index argument Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 10/16] framework/settings: add parallel related settings Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 11/16] framework/virt_resource: support multiple VMs module Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 12/16] framework/virt_base: add attach/quick start/quit function for VM management Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 13/16] framework/virt_dut: support multiple VMs module Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 14/16] framework/qemu_kvm: " Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 15/16] conf/virt_global: add vm management related configuration Marvin Liu
2018-01-08  2:49 ` [dts] [PATCH v1 16/16] doc: add descriptions for multiple virtual machine module Marvin Liu
2018-01-10  0:10 ` [dts] [PATCH v2 00/16] Support parallel multiple virtual machines management Marvin Liu
2018-01-10  0:10   ` [dts] [PATCH v2 01/16] framework: add external thread pool library Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 02/16] framework/multiple_vm: add multiple VM management module Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 03/16] framework/utils: support locks for parallel model Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 04/16] framework: add DUT index support Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 05/16] framework/logger: optimize output format for threads Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 06/16] framework/dts: support multiple VMs module Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 07/16] framework/debugger: " Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH 08/16] framework/ssh_pexpect: " Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 09/16] framework/ssh_connection: " Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 10/16] framework/settings: add parallel related settings Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 11/16] framework/virt_resource: support multiple VMs module Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 12/16] framework/virt_base: add attach/quick start/quit function for VM management Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 13/16] framework/virt_dut: support multiple VMs module Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 14/16] framework/qemu_kvm: " Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 15/16] conf/virt_global: add vm management related configuration Marvin Liu
2018-01-10  0:11   ` [dts] [PATCH v2 16/16] doc: add descriptions for multiple virtual machines module Marvin Liu

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1515379769-11553-1-git-send-email-yong.liu@intel.com \
    --to=yong.liu@intel.com \
    --cc=dts@dpdk.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).