test suite reviews and discussions
 help / color / mirror / Atom feed
* [dts] [ds] [PATCH] power_negative: Test Suite
@ 2021-04-23 10:25 Zbigniew Sikora
  2021-05-06 11:03 ` Pattan, Reshma
  2021-05-26  8:34 ` Tu, Lijuan
  0 siblings, 2 replies; 3+ messages in thread
From: Zbigniew Sikora @ 2021-04-23 10:25 UTC (permalink / raw)
  To: dts, zbigniewx.sikora, reshma.pattan

Introducing a new Power Negative Test Plan.

Signed-off-by: Zbigniew Sikora <zbigniewx.sikora@intel.com>

diff --git a/conf/power_negative.cfg b/conf/power_negative.cfg
new file mode 100644
index 0000000..8512e1b
--- /dev/null
+++ b/conf/power_negative.cfg
@@ -0,0 +1,30 @@
+# libvirtd options:
+# [VM name] section value is the name for VM
+# cpu       # hard code type to host-passthrough
+#   number: number of vcpus
+#   cpupin: host cpu list
+# mem
+#   size: 4096
+# disk
+#   file: absolute path to disk image
+#   type: disk image format
+# login
+#   user: user name to login into VM
+#   password: passwork to login into VM
+# device
+#   pf_idx: pass-through device index of DUT ports
+#   guestpci: hardcode value of guest pci address
+# virtio_serial_channel
+#   path: virtio unix socket absolute path
+#   name: virtio serial name in VM
+
+# vm configuration for vm power management case
+[vm0]
+cpu =
+    number=8,cpupin=4 5 6 7 8 9 10 11;
+mem =
+    size=12196;
+disk =
+    file=/root/fedora27-1.img,opt_format=qcow2;
+login =
+    user=root,password=tester;
diff --git a/test_plans/power_negative_test_plan.rst b/test_plans/power_negative_test_plan.rst
new file mode 100644
index 0000000..b1de4d4
--- /dev/null
+++ b/test_plans/power_negative_test_plan.rst
@@ -0,0 +1,175 @@
+.. Copyright (c) <2010-2019>, Intel Corporation
+   All rights reserved.
+
+   Redistribution and use in source and binary forms, with or without
+   modification, are permitted provided that the following conditions
+   are met:
+
+   - Redistributions of source code must retain the above copyright
+     notice, this list of conditions and the following disclaimer.
+
+   - Redistributions in binary form must reproduce the above copyright
+     notice, this list of conditions and the following disclaimer in
+     the documentation and/or other materials provided with the
+     distribution.
+
+   - Neither the name of Intel Corporation nor the names of its
+     contributors may be used to endorse or promote products derived
+     from this software without specific prior written permission.
+
+   THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+   "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+   LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS
+   FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE
+   COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT,
+   INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES
+   (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR
+   SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION)
+   HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT,
+   STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE)
+   ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED
+   OF THE POSSIBILITY OF SUCH DAMAGE.
+
+========================
+Power Negative Test Plan
+========================
+
+Preparation work
+================
+1. Turn on Speedstep option in BIOS
+2. Turn on CPU C3 and C6
+3. Turn on Turbo in BIOS
+4. Disable intel_pstate in Linux kernel command: intel_pstate=disable
+5. modprobe msr module to let the application can get the CPU HW info
+6. Let user space can control the CPU frequency: cpupower frequency-set -g userspace
+
+
+Test Case1: Inject Malformed JSON Command file to fifo channel
+===============================================================
+Step 1. Create powermonitor fold for vm_power_manager sample::
+
+    mkdir /tmp/powermonitor
+    chmod 777 /tmp/powermonitor
+
+Step 2. Luanch VM power manager sample::
+
+    ./examples/vm_power_manager/build/vm_power_mgr -l 1-3 -n 4 --file-prefix=test1 --no-pci
+
+Step 3. Prepare policy in JSON format then send it to the fifo channel:
+    Prepare different command in JSON format then send it to the fifo channel
+    Modify "name", "resource_id", "command" to large character string to check if the vm_power_mgr sample will crash
+    For example::
+
+      {"policy": {
+        "name": "01234567890123445678901234567890123456789001234567890",
+        "command": "create",
+        "policy_type": "WORKLOAD",
+        "workload": "MEDIUM",
+      }}
+
+Step 4. Send Json format command to the fifo channel::
+
+  cat command.json > /tmp/powermonitor/fifo22
+
+Check point: no crash at the vm_power_mgr application side.
+
+Potential issue: no warning for the user for the name too long, now is char[32], but no crash as strlcpy is uesed
+
+Test Case2: Send invalid command through JSON channel
+======================================================
+Step 1. Create powermonitor fold for vm_power_manager sample::
+
+    mkdir /tmp/powermonitor
+    chmod 777 /tmp/powermonitor
+
+Step 2. Luanch VM power manager sample::
+
+    ./examples/vm_power_manager/build/vm_power_mgr -l 1-3 -n 4 --file-prefix=test1 --no-pci
+
+Step 3. Prepare policy in JSON format then send it to the fifo channel:
+
+Prepare invalid power command, for example, core list above the max core number. For example::
+
+    {"policy": {
+        "name": "Ubutnu",
+        "command": "create",
+        "policy_type": "WORKLOAD",
+        "workload": "MEDIUM_111",
+    }}
+
+    {"policy": {
+        "name": "Ubutnu",
+        "command": "create",
+        "policy_type": "WORKLOAD_111",
+        "workload": "MEDIUM",
+    }}
+
+Step 4. Send Json format command to the fifo channel::
+
+	cat command.json > /tmp/powermonitor/fifo22
+
+Test Case3: Check if host power APP have check point for the power policy sent from untrusted VM
+===================================================================================================
+Step 1. Launch VM by using libvirt, one NIC should be configured as PCI pass-throughput to the VM::
+
+    virsh start [VM name]
+
+Note: For the VM xml file which will be used for creating the VM, it can re-use the vm0.xml generated in the branch ratio DTS script
+
+Step 2. Luanch VM power manager sample on the host to monitor the channel from VM::
+
+    ./examples/vm_power_manager/build/vm_power_mgr -l 12-14 -n 4 --no-pci
+      >　add_vm [vm name]
+      >　add_channels [vm name] all
+      >　set_channel_status [vm name] all enabled
+      >　show_vm [vm name]
+
+   Check the invalid input command for vm_power_mgr sample::
+
+    > add_channels ubuntu 128
+    > add_channel ubuntu 10000000000000000
+
+Check point:　No crash should be occur at vm_power_mgr sample
+
+Step 3. In the VM, launch guest_vm_power_mgr to set and send the power manager policy to the host power sample::
+
+    ./examples/vm_power_manager/guest_cli/build/guest_vm_power_mgr -c 0xff -n 4 -m 1024 --no-pci --file-prefix=yaolei \
+      -- --vm-name=ubuntu --vcpu-list=0-7
+      > set_cpu_freq 128 down
+      > set_cpu_freq 1000000000000 down
+      > set_cpu_freq -1 down
+
+   also try other commands::
+
+     "<up|down|min|max|enable_turbo|disable_turbo>"
+
+
+Test Case4: TRAFFIC Policy Test based on JSON configure file with large integer number
+========================================================================================
+Step 1. Generate 1 VF under vfio-pci driver, launch vm_power_mgr sample with PF, for example::
+
+    echo 1 > /sys/bus/pci/drivers/vfio-pci/0000\:82\:00.0/max_vfs
+    ./examples/vm_power_manager/build/vm_power_mgr -l 1-4 -n 4 --socket-mem=1024,1024 --file-prefix=test1 -w 82:00.0 -- -p 0x01
+
+Step 2. Launch testpmd with VF::
+
+     ./x86_64-native-linuxapp-gcc/app/testpmd -l 5-6 -n 4 --socket-mem=1024,1024 --file-prefix=test2 -w 0000:82:02.0 -- -i
+       > set fwd macswap
+       > start
+
+Step 3. Prepare traffic policy in JSON format then send it to the power demon sample, put the VF MAC into the mac_list::
+
+      {"policy": {
+          "name": "ubuntu",
+          "command": "create",
+          "policy_type": "TRAFFIC",
+          "max_packet_thresh": 500000000000000000000000000000,
+          "avg_packet_thresh": 300000000000000000000000000000,
+          "mac_list":[ "E0:E0:E0:E0:F0:F0"]
+      }}
+
+Step 4. Send Json format command to the fifo channel::
+
+  cat traffic.json > /tmp/powermonitor/fifo6
+
+Check point:　No crash should be occur at vm_power_mgr sample
diff --git a/tests/TestSuite_power_negative.py b/tests/TestSuite_power_negative.py
new file mode 100644
index 0000000..46c2f3c
--- /dev/null
+++ b/tests/TestSuite_power_negative.py
@@ -0,0 +1,619 @@
+# BSD LICENSE
+#
+# Copyright(c) 2010-2020 Intel Corporation. All rights reserved.
+# All rights reserved.
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions
+# are met:
+#
+#   * Redistributions of source code must retain the above copyright
+#     notice, this list of conditions and the following disclaimer.
+#   * Redistributions in binary form must reproduce the above copyright
+#     notice, this list of conditions and the following disclaimer in
+#     the documentation and/or other materials provided with the
+#     distribution.
+#   * Neither the name of Intel Corporation nor the names of its
+#     contributors may be used to endorse or promote products derived
+#     from this software without specific prior written permission.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
+# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
+# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
+# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
+# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+
+"""
+DPDK Test suite.
+power negative test suite.
+"""
+
+import os
+import re
+import time
+import traceback
+
+from utils import create_mask as dts_create_mask
+from qemu_libvirt import LibvirtKvm
+from exception import VerifyFailure
+from test_case import TestCase
+
+
+class TestPowerNegative(TestCase):
+
+    @property
+    def target_dir(self):
+        # get absolute directory of target source code
+        target_dir = '/root' + self.dut.base_dir[1:] \
+                     if self.dut.base_dir.startswith('~') else \
+                     self.dut.base_dir
+        return target_dir
+
+    def prepare_binary(self, name, host_crb=None):
+        _host_crb = host_crb if host_crb else self.dut
+        example_dir = "examples/" + name
+        out = _host_crb.build_dpdk_apps('./' + example_dir)
+        return os.path.join(self.target_dir,
+                            _host_crb.apps_name[os.path.basename(name)])
+
+    def add_console(self, session):
+        self.ext_con[session.name] = [
+            session.send_expect,
+            session.session.get_output_all]
+
+    def get_console(self, name):
+        default_con_table = {
+            self.dut.session.name: [
+                self.dut.send_expect,
+                self.dut.get_session_output],
+            self.dut.alt_session.name: [
+                self.dut.alt_session.send_expect,
+                self.dut.alt_session.session.get_output_all]}
+        if name not in default_con_table:
+            return self.ext_con.get(name) or [None, None]
+        else:
+            return default_con_table.get(name)
+
+    def execute_cmds(self, cmds, name='dut'):
+        console, msg_pipe = self.get_console(name)
+        if len(cmds) == 0:
+            return
+        if isinstance(cmds, str):
+            cmds = [cmds, '# ', 5]
+        if not isinstance(cmds[0], list):
+            cmds = [cmds]
+        outputs = [] if len(cmds) > 1 else ''
+        for item in cmds:
+            expected_items = item[1]
+            if expected_items and isinstance(expected_items, (list, tuple)):
+                expected_str = expected_items[0] or '# '
+            else:
+                expected_str = expected_items or '# '
+
+            try:
+                if len(item) == 3:
+                    timeout = int(item[2])
+                    output = console(item[0], expected_str, timeout)
+                    output = msg_pipe() if not output else output
+                else:
+                    output = console(item[0], expected_str)
+                    output = msg_pipe() if not output else output
+            except Exception as e:
+                msg = "execute '{0}' timeout".format(item[0])
+                raise Exception(msg)
+            time.sleep(1)
+            if len(cmds) > 1:
+                outputs.append(output)
+            else:
+                outputs = output
+
+        return outputs
+
+    def d_con(self, cmds):
+        return self.execute_cmds(cmds, name=self.dut.session.name)
+
+    def d_a_con(self, cmds):
+        return self.execute_cmds(cmds, name=self.dut.alt_session.name)
+
+    def vm_con(self, cmds):
+        return self.execute_cmds(cmds, name=self.vm_dut.session.name)
+
+    def vm_g_con(self, cmds):
+        return self.execute_cmds(cmds, name=self.guest_con_name)
+
+    def get_sys_power_driver(self):
+        drv_file = "/sys/devices/system/cpu/cpu0/cpufreq/scaling_driver"
+        output = self.d_a_con('cat ' + drv_file)
+        if not output:
+            msg = 'unknown power driver'
+            self.verify(False, msg)
+        drv_name = output.splitlines()[0].strip()
+        return drv_name
+
+    @property
+    def is_support_pbf(self):
+        # check if cpu support bpf feature
+        cpu_attr = r'/sys/devices/system/cpu/cpu0/cpufreq/base_frequency'
+        cmd = "ls {0}".format(cpu_attr)
+        self.d_a_con(cmd)
+        cmd = "echo $?"
+        output = self.d_a_con(cmd)
+        ret = True if output == "0" else False
+        return ret
+
+    def get_all_cpu_attrs(self):
+        '''
+        get all cpus' base_frequency value, if not support pbf, set all to 0
+        '''
+        if not self.is_support_pbf:
+            cpu_topos = self.dut.get_all_cores()
+            _base_freqs_info = {}
+            for index, _ in enumerate(cpu_topos):
+                _base_freqs_info[index] = 0
+            return _base_freqs_info
+        # if cpu support high priority core
+        key_values = ['base_frequency',
+                      'cpuinfo_max_freq',
+                      'cpuinfo_min_freq']
+        freq = r'/sys/devices/system/cpu/cpu{0}/cpufreq/{1}'.format
+        # use dut alt session to get dut platform cpu base frequency attribute
+        cpu_topos = self.dut.get_all_cores()
+        cpu_info = {}
+        for cpu_topo in cpu_topos:
+            cpu_id = int(cpu_topo['thread'])
+            cpu_info[cpu_id] = {}
+            cpu_info[cpu_id]['socket'] = cpu_topo['socket']
+            cpu_info[cpu_id]['core'] = cpu_topo['core']
+
+        for key_value in key_values:
+            cmds = []
+            for cpu_id in sorted(cpu_info.keys()):
+                cmds.append('cat {0}'.format(freq(cpu_id, key_value)))
+            output = self.d_a_con(';'.join(cmds))
+            freqs = [int(item) for item in output.splitlines()]
+            for index, cpu_id in enumerate(sorted(cpu_info.keys())):
+                cpu_info[cpu_id][key_value] = freqs[index]
+
+        # get high priority core and normal core
+        base_freqs_info = {}
+        for core_index, value in cpu_info.items():
+            base_frequency = value.get('base_frequency')
+            base_freqs_info.setdefault(base_frequency, []).append(core_index)
+        base_freqs = list(base_freqs_info.keys())
+        # cpu should have high priority core and normal core
+        # high priority core frequency is higher than normal core frequency
+        if len(base_freqs) <= 1 or \
+           not all([len(value) for value in list(base_freqs_info.values())]):
+            msg = 'current cpu has no high priority core'
+            raise Exception(msg)
+
+        high_pri_freq = max(self.base_freqs_info.keys())
+        high_pri_cores = base_freqs_info[high_pri_freq]
+        _base_freqs_info = {}
+        for index, _ in enumerate(cpu_topos):
+            _base_freqs_info[index] = 1 if index in high_pri_cores else 0
+
+        return _base_freqs_info
+
+    def init_vms_params(self):
+        self.vm = self.vcpu_map = self.vcpu_lst = self.vm_dut = \
+            self.guest_session = self.is_guest_on = self.is_vm_on = None
+        # vm config
+        self.vm_name = 'vm0'
+        self.vm_max_ch = 8
+        self.vm_log_dir = '/tmp/powermonitor'
+        self.create_powermonitor_folder()
+
+    def create_powermonitor_folder(self):
+        # create temporary folder for power monitor
+        cmd = 'mkdir -p {0}; chmod 777 {0}'.format(self.vm_log_dir)
+        self.d_a_con(cmd)
+
+    def start_vm(self):
+        # set vm initialize parameters
+        self.init_vms_params()
+        # start vm
+        self.vm = LibvirtKvm(self.dut, self.vm_name, self.suite_name)
+        # pass pf to virtual machine
+        pci_addr = self.dut.get_port_pci(self.dut_ports[0])
+        # add channel
+        ch_name = 'virtio.serial.port.poweragent.{0}'
+        vm_path = os.path.join(self.vm_log_dir, '{0}.{1}')
+        for cnt in range(self.vm_max_ch):
+            channel = {
+                'path': vm_path.format(self.vm_name, cnt),
+                'name': ch_name.format(cnt)}
+            self.vm.add_vm_virtio_serial_channel(**channel)
+        # boot up vm
+        self.vm_dut = self.vm.start()
+        self.is_vm_on = True
+        self.verify(self.vm_dut, "create vm_dut fail !")
+        self.add_console(self.vm_dut.session)
+        # get virtual machine cpu cores
+        _vcpu_map = self.vm.get_vm_cpu()
+        self.vcpu_map = [int(item) for item in _vcpu_map]
+        self.vcpu_lst = [int(item['core']) for item in self.vm_dut.cores]
+
+    def close_vm(self):
+        # close vm
+        if self.is_vm_on:
+            if self.guest_session:
+                self.vm_dut.close_session(self.guest_session)
+                self.guest_session = None
+            self.vm.stop()
+            self.is_vm_on = False
+            self.vm = None
+            self.dut.virt_exit()
+            cmd_fmt = 'virsh {0} {1} > /dev/null 2>&1'.format
+            cmds = [
+                [cmd_fmt('shutdown', self.vm_name), '# '],
+                [cmd_fmt('undefine', self.vm_name), '# '], ]
+            self.d_a_con(cmds)
+
+    def init_testpmd(self):
+        self.testpmd = '/root/dpdk/x86_64-native-linuxapp-gcc/app/dpdk-testpmd'
+
+    def close_testpmd(self):
+        if not self.is_testpmd_on:
+            return
+        self.logger.info('closing testpmd ..')
+        self.d_con(['quit', '# ', 15])
+        self.is_testpmd_on = False
+
+    def init_vm_power_mgr(self):
+        self.vm_power_mgr = self.prepare_binary('vm_power_manager')
+
+    def close_vm_power_mgr(self):
+        if not self.is_mgr_on:
+            return
+        self.logger.info('closing vm_power_mgr ..')
+        self.d_con(['quit', '# ', 15])
+        self.is_mgr_on = False
+
+    def init_guest_mgr(self):
+        name = 'vm_power_manager/guest_cli'
+        self.guest_cli = self.prepare_binary(name, host_crb=self.vm_dut)
+        self.guest_con_name = \
+            '_'.join([self.vm_dut.NAME, name.replace('/', '-')])
+        self.guest_session = self.vm_dut.create_session(self.guest_con_name)
+        self.add_console(self.guest_session)
+
+    def close_guest_mgr(self):
+        if not self.is_guest_on:
+            return
+        self.logger.info('closing guest_mgr ..')
+        self.vm_g_con("quit")
+        self.is_guest_on = False
+
+    def check_cpupower_tool(self):
+        cmd = "whereis cpupower > /dev/null 2>&1; echo $?"
+        output = self.d_a_con(cmd)
+        status = True if output and output.strip() == "0" else False
+        msg = 'cpupower tool have not installed on DUT'
+        self.verify(status, msg)
+
+    def verify_power_driver(self):
+        expected_drv = 'acpi-cpufreq'
+        power_drv = self.get_sys_power_driver()
+        msg = "{0} should work with {1} driver on DUT".format(
+            self.suite_name, expected_drv)
+        self.verify(power_drv == expected_drv, msg)
+
+    def preset_test_environment(self):
+        self.is_mgr_on = None
+        self.ext_con = {}
+        # modprobe msr module to let the application can get the CPU HW info
+        self.d_a_con('modprobe msr')
+        self.d_a_con('cpupower frequency-set -g userspace')
+        self.dut.init_core_list_uncached_linux()
+        # check if cpu support bpf feature
+        self.base_freqs_info = self.get_all_cpu_attrs()
+        # boot up vm
+        self.start_vm()
+        # init binary
+        self.init_vm_power_mgr()
+        self.init_guest_mgr()
+        self.init_testpmd()
+
+
+    def verify_inject_malformed_json_to_fifo_channel(self):
+        # Test Case1: Inject Malformed JSON Command file to fifo channel
+        # 1. Create powermonitor fold for vm_power_manager sample::
+        #     mkdir /tmp/powermonitor
+        #     chmod 777 /tmp/powermonitor
+        # 2. Launch VM power manager sample::
+        #     ./examples/vm_power_manager/build/vm_power_mgr -l 1-3 -n 4 --file-prefix=test1 --no-pci
+        # 3. Prepare policy in JSON format then send it to the fifo channel:
+        #     Prepare different command in JSON format then send it to the fifo channel
+        #     Modify "name", "resource_id", "command" to large character string to check if the vm_power_mgr sample will crash
+        #     For example::
+        #       {"policy": {
+        #         "name": "01234567890123445678901234567890123456789001234567890",
+        #         "command": "create",
+        #         "policy_type": "WORKLOAD",
+        #         "workload": "MEDIUM",
+        #         "core_list":[ 22]
+        #       }}
+        # 4. Send Json format command to the fifo channel::
+        #     cat command.json >/tmp/powermonitor/fifo1
+
+        # start vm_power_mgr
+        option = ' -v -l 1-3 -n 4 --file-prefix=test1 --no-pci '
+        cmd = [' '.join([self.vm_power_mgr, option]), 'vmpower> ', 30]
+        self.d_con(cmd)
+        self.is_mgr_on = True
+
+        # prepare an send the json file to fifo
+        echo_json = (
+            'echo {\\"policy\\": {'
+            '  \\"name\\": \\"01234567890123445678901234567890123456789001234567890\\",'
+            '  \\"command\\": \\"create\\",'
+            '  \\"policy_type\\": \\"WORKLOAD\\",'
+            '  \\"workload\\": \\"MEDIUM\\"'
+            '}} > /tmp/command.json;')
+        cat_json = 'cat /tmp/command.json > /tmp/powermonitor/fifo1'
+        self.d_a_con([' '.join([echo_json, cat_json]), '# ', 10])
+
+        out = self.d_con(['show_cpu_freq 1', 'vmpower> ', 20])
+        self.verify('Core 1 frequency:' in out, 'vm_power_manager did not work as expected')
+
+
+    def verify_send_invalid_cmd_through_json_chn(self):
+        # Test Case2 : Send invalid command through JSON channel
+        # 1. Create powermonitor fold for vm_power_manager sample::
+        #     mkdir /tmp/powermonitor
+        #     chmod 777 /tmp/powermonitor
+        # 2. Launch VM power manager sample::
+        #     ./examples/vm_power_manager/build/vm_power_mgr -l 1-3 -n 4 --file-prefix=test1 --no-pci
+        # 3. Prepare policy in JSON format then send it to the fifo channel:
+        #     Prepare invalid power command, for example, core list above the max core number.
+        #     For example::
+        #       {"policy": {
+        #         "name": "Ubuntu",
+        #         "command": "create",
+        #         "policy_type": "WORKLOAD",
+        #         "workload": "MEDIUM_111"
+        #       }}
+        #       {"policy": {
+        #         "name": "Ubuntu",
+        #         "command": "create",
+        #         "policy_type": "WORKLOAD_111",
+        #         "workload": "MEDIUM"
+        #       }}
+        # 4. Send Json format command to the fifo channel::
+        # 	cat command.json >/tmp/powermonitor/fifo1
+
+        # start vm_power_mgr
+        option = ' -v -l 1-3 -n 4 --file-prefix=test1 --no-pci '
+        cmd = [' '.join([self.vm_power_mgr, option]), 'vmpower>', 30]
+        self.d_con(cmd)
+        self.is_mgr_on = True
+
+        # prepare an sen the json file to fifo
+        echo_json = (
+            'echo {\\"policy\\": {'
+            '  \\"name\\": \\"Ubuntu\\",'
+            '  \\"command\\": \\"create\\",'
+            '  \\"policy_type\\": \\"WORKLOAD\\",'
+            '  \\"workload\\": \\"MEDIUM_111\\"'
+            '}} > /tmp/command.json;')
+        cat_json = 'cat /tmp/command.json > /tmp/powermonitor/fifo1'
+        out = self.d_con(['show_cpu_freq 1', 'vmpower>', 20])
+        self.verify('Core 1 frequency:' in out, 'vm_power_manager did not work as expected')
+
+        self.d_a_con([' '.join([echo_json, cat_json]), '#', 10])
+        echo_json = (
+            'echo {\\"policy\\": {'
+            '  \\"name\\": \\"Ubuntu\\",'
+            '  \\"command\\": \\"create\\",'
+            '  \\"policy_type\\": \\"WORKLOAD_111\\",'
+            '  \\"workload\\": \\"MEDIUM\\"'
+            '}} > /tmp/command.json;')
+        cat_json = 'cat /tmp/command.json > /tmp/powermonitor/fifo1'
+        self.d_a_con([' '.join([echo_json, cat_json]), '#', 10])
+
+        out = self.d_con(['show_cpu_freq 1', 'vmpower>', 20])
+        self.verify('Core 1 frequency:' in out, 'vm_power_manager did not work as expected')
+
+
+    def verify_host_power_check_policy_from_untrusted_vm(self):
+        # Test Case3 : Send malformed command to host power daemon app
+        # 1. Launch VM by using libvirt, one NIC should be configured as PCI pass-throughput to the VM::
+        # virsh start [VM name]
+        # 2. Launch VM power manager sample on the host to monitor the channel from VM::
+        # ./examples/vm_power_manager/build/vm_power_mgr -l 12-14 -n 4 --no-pci
+        # >　add_vm [vm name]
+        # >　add_channels [vm name] all
+        # >　set_channel_status [vm name] all enabled
+        # >　show_vm [vm name]
+        # Check the invalid input command for vm_power_mgr sample::
+        # > add_channels ubuntu 128
+        # > add_channel ubuntu 10000000000000000
+        # 3. In the VM, launch guest_vm_power_mgr to set and send the power manager policy to the host power sample::
+        # ./examples/vm_power_manager/guest_cli/build/guest_vm_power_mgr -c 0xff -n 4 -m 1024 --no-pci --file-prefix=yaolei \
+        # -- --vm-name=ubuntu --vcpu-list=0-7
+        # > set_cpu_freq 128 down
+        # > set_cpu_freq 1000000000000 down
+        # > set_cpu_freq -1 down
+        # also try other commands::
+        # "<up|down|min|max|enable_turbo|disable_turbo>"
+        # Check point:　No crash should be occur at vm_power_mgr sample
+
+        # start vm_power_mgr
+        option = ' -v -l 1-3 -n 4 --file-prefix=test1 --no-pci '
+        cmd = [' '.join([self.vm_power_mgr, option]), 'vmpower>', 30]
+        self.d_con(cmd)
+        self.is_mgr_on = True
+
+        self.d_con(['add_vm {}'.format(self.vm_name), 'vmpower>', 5])
+        self.d_con(['add_channels {} all'.format(self.vm_name), 'vmpower>', 5])
+        self.d_con(['add_channels_status {} all'.format(self.vm_name), 'vmpower>', 5])
+        vm_info = self.d_con(['show_vm {}'.format(self.vm_name), 'vmpower>', 5])
+        self.verify('CONNECTED' in vm_info, 'vm_power_manager did not work as expected')
+
+        out = self.d_con(['add_channels ubuntu 128', 'vmpower>', 5])
+        self.verify("Segmentation fault" not in out and 'core dump' not in out,
+                    "Segmentation fault or core dumped happened")
+
+        out = self.d_con(['add_channel ubuntu 10000000000000000', 'vmpower>', 5])
+        self.verify("Segmentation fault" not in out and 'core dump' not in out,
+                    "Segmentation fault or core dumped happened")
+
+        # start vm_power_mgr
+        prompt = r"vmpower\(guest\)>"
+        vm_pwr_quest = self.guest_cli + ' -v -c 0xff -n 4 -m 1024 --no-pci --file-prefix=yaolei -- --vm-name=ubuntu --vcpu-list=0-7 '
+        self.vm_g_con([vm_pwr_quest, prompt, 120])
+        self.is_guest_on = True
+
+        commands = ['up', 'down', 'min', 'max', 'enable_turbo', 'disable_turbo']
+        numbers = ['128', '1000000000000', '-1']
+        for command in commands:
+            for number in numbers:
+                cmd_line = 'set_cpu_freq {} {}'.format(number, command)
+                out = self.vm_g_con([cmd_line, prompt, 10])
+                self.logger.info('vmpower(guest)> {} --> out: {}'.format(cmd_line, out))
+                self.verify("Segmentation fault" not in out and 'core dump' not in out,
+                            "Segmentation fault or core dumped happened")
+
+
+    def verify_traffic_policy_test_based_on_json(self):
+        # Test Case4 : TRAFFIC Policy Test based on JSON configure file with large integer number
+        # ========================================================================================
+        # Step1. Generate 1 VF under igb_uio driver, launch vm_power_mgr sample with PF, for example:
+        # 	echo 1 > /sys/bus/pci/drivers/igb_uio/0000\:82\:00.0/max_vfs
+        # 	./examples/vm_power_manager/build/vm_power_mgr -l 1-4 -n 4 --socket-mem=1024,1024 --file-prefix=test1 -w 82:00.0 -- -p 0x01
+        # Step 2. Launch testpmd with VF
+        # 	./x86_64-native-linuxapp-gcc/app/testpmd -l 5-6 -n 4 --socket-mem=1024,1024 --file-prefix=test2 -w 0000:82:02.0 -- -i
+        # 	>set fwd macswap
+        # 	>start
+        # Step 3. Prepare traffic policy in JSON format then send it to the power demon sample, put the VF MAC into the mac_list:
+        # 	{"policy": {
+        # 	  "name": "ubuntu",
+        # 	  "command": "create",
+        # 	  "policy_type": "TRAFFIC",
+        #     "max_packet_thresh": 500000000000000000000000000000,
+        # 	  "avg_packet_thresh": 300000000000000000000000000000,
+        # 	  "mac_list":[ "E0:E0:E0:E0:F0:F0"]
+        # 	}}
+        # 	cat traffic.json >/tmp/powermonitor/fifo3
+        # Check point:　No crash should be occur at vm_power_mgr sample
+
+        # self.d_con(['echo 1 > /sys/bus/pci/drivers/igb_uio/0000\:82\:00.0/max_vfs', '#', 10])
+        self.d_con([f'echo 1 > "/sys/bus/pci/drivers/vfio-pci/{self.port_pci}/sriov_numvfs"', '#', 10])
+
+        # start vm_power_mgr
+        cmd = f'{self.vm_power_mgr} -l 1-4 -n 4 --socket-mem=1024,1024 --file-prefix=test1 -w {self.port_pci} -- -p 0x01'
+        self.d_a_con([cmd, 'vmpower>', 30])
+        self.is_mgr_on = True
+
+        vm_info = self.d_a_con(['show_cpu_freq 1', 'vmpower>', 5])
+        self.logger.info(vm_info)
+
+        # Step 2.  Launch testpmd with VF
+        cmd = f'{self.testpmd} -l 5-6 -n 4 --socket-mem=1024,1024 --file-prefix=test2 -w {self.port_pci} -- -i'
+        self.d_con([cmd, 'testpmd>', 30])
+        self.is_testpmd_on = True
+
+        self.d_con(['set fwd macswap', 'testpmd>', 5])
+        self.d_con(['start', 'testpmd>', 5])
+        self.close_testpmd()
+
+        # prepare an sen the json file to fifo
+        echo_json = (
+            'echo {\\"policy\\": {'
+            '  \\"name\\": \\"ubuntu\\",'
+            '  \\"command\\": \\"create\\",'
+            '  \\"policy_type\\": \\"TRAFFIC\\",'
+            '  \\"max_packet_thresh\\": 500000000000000000000000000000,'
+            '  \\"avg_packet_thresh\\": 300000000000000000000000000000,'
+            '  \\"mac_list\\":[ \\"E0:E0:E0:E0:F0:F0\\"]'
+            '}} > /tmp/traffic.json;')
+        cat_json = 'cat /tmp/traffic.json > /tmp/powermonitor/fifo3'
+        self.d_con([' '.join([echo_json, cat_json]), '#', 10])
+
+        # Check point:　No crash should be occur at vm_power_mgr sample
+        out = self.d_a_con(['show_cpu_freq 1', 'vmpower>', 5])
+        self.d_a_con(['quit', '# ', 15])
+        self.is_mgr_on = False
+
+        self.verify("Segmentation fault" not in out and 'core dump' not in out,
+            "Segmentation fault or core dumped happened")
+
+
+    #################
+    #
+    # Test cases.
+    #
+    #################
+
+    def set_up_all(self):
+        """
+        Run at the start of each test suite.
+        """
+        self.dut_ports = self.dut.get_ports(self.nic)
+        self.verify(len(self.dut_ports) >= 1, "Not enough ports")
+        self.check_cpupower_tool()
+        self.verify_power_driver()
+        # prepare testing environment
+        self.preset_test_environment()
+        self.port_pci = self.dut.get_port_pci(self.dut_ports[0])
+
+
+    def tear_down_all(self):
+        """
+        Run after each test suite.
+        """
+        self.close_vm()
+
+
+    def set_up(self):
+        """
+        Run before each test case.
+        """
+        pass
+
+
+    def tear_down(self):
+        """
+        Run after each test case.
+        """
+        self.close_vm_power_mgr()
+        self.close_guest_mgr()
+        self.vm_dut.kill_all()
+        self.dut.kill_all()
+
+
+    def test_inject_malformed_json_to_fifo_channel(self):
+        """
+        Inject Malformed Json Command file to fifo channel
+        """
+        self.verify_inject_malformed_json_to_fifo_channel()
+
+
+    def test_send_invalid_cmd_through_json_chn(self):
+        """
+        Send invalid command through JSON channel
+        """
+        self.verify_send_invalid_cmd_through_json_chn()
+
+
+    def test_host_power_check_policy_from_untrusted_vm(self):
+        """
+        Check if host power APP have check point for the power policy sent from untrusted VM
+
+        """
+        self.verify_host_power_check_policy_from_untrusted_vm()
+
+
+    def test_traffic_policy_test_based_on_json(self):
+        """
+        TRAFFIC Policy Test based on JSON configure file with large integer number
+
+        """
+        self.verify_traffic_policy_test_based_on_json()
--
1.8.3.1

--------------------------------------------------------------
Intel Research and Development Ireland Limited
Registered in Ireland
Registered Office: Collinstown Industrial Park, Leixlip, County Kildare
Registered Number: 308263


This e-mail and any attachments may contain confidential material for the sole
use of the intended recipient(s). Any review or distribution by others is
strictly prohibited. If you are not the intended recipient, please contact the
sender and delete all copies.

^ permalink raw reply	[flat|nested] 3+ messages in thread
end of thread, other threads:[~2021-05-26  8:34 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-04-23 10:25 [dts] [ds] [PATCH] power_negative: Test Suite Zbigniew Sikora
2021-05-06 11:03 ` Pattan, Reshma
2021-05-26  8:34 ` Tu, Lijuan

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).