DPDK patches and discussions
 help / color / mirror / Atom feed
* [RFC PATCH v1 00/13] merge DTS conf files to DPDK
@ 2022-04-06 15:07 Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 01/13] dts: merge DTS conf/crbs.cfg " Juraj Linkeš
                   ` (12 more replies)
  0 siblings, 13 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

Various DTS framework configuration files.

Juraj Linkeš (13):
  dts: merge DTS conf/crbs.cfg to DPDK
  dts: merge DTS conf/pktgen.cfg to DPDK
  dts: merge DTS conf/ports.cfg to DPDK
  dts: merge DTS conf/suite_sample.cfg to DPDK
  dts: merge DTS conf/test_case_checklist.json to DPDK
  dts: merge DTS conf/test_case_supportlist.json to DPDK
  dts: merge DTS execution.cfg to DPDK
  dts: merge DTS executions/execution.cfg to DPDK
  dts: merge DTS executions/execution_FVL.cfg to DPDK
  dts: merge DTS executions/execution_fm10k.cfg to DPDK
  dts: merge DTS executions/execution_rxmode.cfg to DPDK
  dts: merge DTS executions/execution_smoke.cfg to DPDK
  dts: merge DTS framework/settings.py to DPDK

 dts/conf/crbs.cfg                   |   42 +
 dts/conf/pktgen.cfg                 |   59 +
 dts/conf/ports.cfg                  |   24 +
 dts/conf/suite_sample.cfg           |    8 +
 dts/conf/test_case_checklist.json   | 3781 +++++++++++++++++++++++++++
 dts/conf/test_case_supportlist.json | 2374 +++++++++++++++++
 dts/execution.cfg                   |   10 +
 dts/executions/execution.cfg        |   47 +
 dts/executions/execution_FVL.cfg    |   48 +
 dts/executions/execution_fm10k.cfg  |   29 +
 dts/executions/execution_rxmode.cfg |   66 +
 dts/executions/execution_smoke.cfg  |   32 +
 dts/framework/settings.py           |  391 +++
 13 files changed, 6911 insertions(+)
 create mode 100644 dts/conf/crbs.cfg
 create mode 100644 dts/conf/pktgen.cfg
 create mode 100644 dts/conf/ports.cfg
 create mode 100644 dts/conf/suite_sample.cfg
 create mode 100644 dts/conf/test_case_checklist.json
 create mode 100644 dts/conf/test_case_supportlist.json
 create mode 100644 dts/execution.cfg
 create mode 100644 dts/executions/execution.cfg
 create mode 100644 dts/executions/execution_FVL.cfg
 create mode 100644 dts/executions/execution_fm10k.cfg
 create mode 100644 dts/executions/execution_rxmode.cfg
 create mode 100644 dts/executions/execution_smoke.cfg
 create mode 100644 dts/framework/settings.py

-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 01/13] dts: merge DTS conf/crbs.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 02/13] dts: merge DTS conf/pktgen.cfg " Juraj Linkeš
                   ` (11 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/crbs.cfg | 42 ++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 42 insertions(+)
 create mode 100644 dts/conf/crbs.cfg

diff --git a/dts/conf/crbs.cfg b/dts/conf/crbs.cfg
new file mode 100644
index 0000000000..a12e60a4a1
--- /dev/null
+++ b/dts/conf/crbs.cfg
@@ -0,0 +1,42 @@
+#DUT crbs Configuration
+#[DUT IP]
+#  dut_ip: DUT ip address
+#  dut_user: Login DUT username
+#  dut_passwd: [INSECURE] Login DUT password, leaving this blank will force using SSH keys
+#  os: operation system type linux or freebsd
+#  tester_ip: Tester ip address
+#  tester_passwd: [INSECURE] Tester password, leaving this blank will force using SSH keys
+#  pktgen_group: packet generator group name: ixia/trex/ixia_network
+#  channels: Board channel number
+#  bypass_core0: Whether by pass core0
+#  dut_cores: DUT core list, eg: 1,2,3,4,5,18-22
+#  snapshot_load_side: tester/dut, specify the dpdk.tar.gz on side
+#       if value is dut, should combine the params --snapshot to use.
+#       eg: ./dts --snapshot /root/tester/dpdk.tar.gz
+[DUT IP1]
+dut_ip=xxx.xxx.xxx.xxx
+dut_user=root
+dut_passwd=
+os=linux
+dut_arch=
+tester_ip=xxx.xxx.xxx.xxx
+tester_passwd=
+ixia_group=
+pktgen_group=
+channels=4
+bypass_core0=True
+dut_cores=
+snapshot_load_side=tester
+[DUT IP2]
+dut_ip=yyy.yyy.yyy.yyy
+dut_user=root
+dut_passwd=
+os=linux
+dut_arch=
+tester_ip=yyy.yyy.yyy.yyy
+tester_passwd=
+pktgen_group=
+channels=4
+bypass_core0=True
+dut_cores=
+snapshot_load_side=tester
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 02/13] dts: merge DTS conf/pktgen.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 01/13] dts: merge DTS conf/crbs.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 03/13] dts: merge DTS conf/ports.cfg " Juraj Linkeš
                   ` (10 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/pktgen.cfg | 59 +++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 59 insertions(+)
 create mode 100644 dts/conf/pktgen.cfg

diff --git a/dts/conf/pktgen.cfg b/dts/conf/pktgen.cfg
new file mode 100644
index 0000000000..3176f49625
--- /dev/null
+++ b/dts/conf/pktgen.cfg
@@ -0,0 +1,59 @@
+#PkTGEN configuration
+#[PKTGEN DPDK]
+# trex_root_path: trex tar package decompression directory
+#    trex server binary file is under this directory.
+# trex_lib_path(optional): trex stateless client libs directory, it is optional.
+#    If it is not set, use a default relative directory.
+# coremask:
+#  1. a list of masks (one core mask per port), sort sequence as 
+#    <port 0 core mask>,<port 1 core mask>
+#     example:  core_mask=0x3,0x5
+#  2. CORE_MASK_PIN
+#     for each dual ports (a group that shares the same cores), the cores will
+#     be divided half pinned for each port.
+#     example:  core_mask=CORE_MASK_PIN
+# num -n: Number of memory channels
+# proc_type --proc-type: Type of this process
+# pci_blocklist --pci-blocklist, -b: Add a PCI device in block list.
+# pci_allowlist --pci-allowlist, -a: Add a PCI device in allow list.
+# file_prefix --file-prefix: Prefix for hugepage filenames
+# socket_memory --socket-mem: Memory to allocate on specific sockets
+# mapping_ports -m: Matrix for mapping ports to logical cores.
+# pcap_port_num -s P:file: The PCAP packet file to stream. P is the port number.
+# start_trex: Set to a nonempty value to start trex ourselves.
+[TREX]
+trex_root_path=/opt/trex-core-2.26
+trex_lib_path=/opt/trex/vx.xxx/automation/trex_control_plane/interactive
+config_file=/etc/trex_cfg.yaml
+server=10.67.111.143
+pcap_file=/opt/trex-core-2.26/scripts/stl/sample.pcap
+core_mask=0x3,0x5
+start_trex=yes
+
+# IXIA port Configuration
+# IxiaGroup: Group name for IXIA ports
+# Version  : IXIA TCL server version
+# IP       : IXIA server IP address
+# Ports    : [IXIA port list]
+# ixia_force100g: We need to set this to enable if we need IXIA port work in 100G mode.
+[IXIA]
+ixia_version=6.62
+ixia_ip=xxx.xxx.xxx.xxx
+ixia_ports=
+    card=1,port=1;
+    card=1,port=2;
+    card=1,port=3;
+    card=1,port=4;
+ixia_force100g=disable
+[IXIA_NETWORK]
+ixia_version=9.0
+ixia_ip=xxx.xxx.xxx.xxx
+# ixia network REST server ip address
+ixnet_api_server_ip=xxx.xxx.xxx.xxx
+# maximum re-run traffic times, default is 5 times. (optional)
+#max_retry=5
+ixia_ports=
+    card=1,port=1;
+    card=1,port=2;
+    card=1,port=3;
+    card=1,port=4;
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 03/13] dts: merge DTS conf/ports.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 01/13] dts: merge DTS conf/crbs.cfg " Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 02/13] dts: merge DTS conf/pktgen.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 04/13] dts: merge DTS conf/suite_sample.cfg " Juraj Linkeš
                   ` (9 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/ports.cfg | 24 ++++++++++++++++++++++++
 1 file changed, 24 insertions(+)
 create mode 100644 dts/conf/ports.cfg

diff --git a/dts/conf/ports.cfg b/dts/conf/ports.cfg
new file mode 100644
index 0000000000..1102375593
--- /dev/null
+++ b/dts/conf/ports.cfg
@@ -0,0 +1,24 @@
+# DUT Port Configuration
+# [DUT IP]
+# ports=
+#     pci=Pci BDF,intf=Kernel interface;
+#     pci=Pci BDF,mac=Mac address,peer=Tester Pci BDF,numa=Port Numa 
+#     pci=Pci BDF,peer=IXIA:card.port
+#     pci=Pci BDF,peer=TREX:port
+#     pci=Pci BDF,peer=Tester Pci BDF,tp_ip=$(IP),tp_path=$({PERL_PATH);
+#     pci=Pci BDF,peer=Tester Pci BDF,sec_port=yes,first_port=Pci BDF;
+# [VM NAME] virtual machine name; This section is for virutal scenario
+# ports =
+#     dev_idx=device index of ports info, peer=Tester Pci BDF
+[DUT IP]
+ports =
+    pci=XX:XX.X,intf=eth0;
+    pci=YY:YY.Y,mac=XX:XX:XX:XX:XX:XX,peer=ZZ:ZZ.Z,numa=0;
+    pci=ZZ:ZZ.Y,peer=IXIA:X.Y;
+    pci=ZZ:ZZ.Y,peer=TREX:X;
+    pci=0000:XX:XX.X,peer=0000:ZZ:ZZ.Z,tp_ip=127.0.0.1,tp_path=/home/libertyTrailTP_322291/perl;
+    pci=0000:YY:YY.Y,peer=0000:ZZ:ZZ.Z,sec_port=yes,first_port=XX:XX.X;
+[VM NAME]
+ports =
+    dev_idx=0,peer=0000:XX:XX.X;
+    dev_idx=1,peer=0000:YY:YY.Y;
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 04/13] dts: merge DTS conf/suite_sample.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (2 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 03/13] dts: merge DTS conf/ports.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 05/13] dts: merge DTS conf/test_case_checklist.json " Juraj Linkeš
                   ` (8 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/suite_sample.cfg | 8 ++++++++
 1 file changed, 8 insertions(+)
 create mode 100644 dts/conf/suite_sample.cfg

diff --git a/dts/conf/suite_sample.cfg b/dts/conf/suite_sample.cfg
new file mode 100644
index 0000000000..246721325a
--- /dev/null
+++ b/dts/conf/suite_sample.cfg
@@ -0,0 +1,8 @@
+# sample for suite configuration
+[suite]
+int_value=int(10)
+hex_value=int("0xff", 16)
+[case1]
+string="testpmd"
+packet_sizes=[64, 128, 256]
+protocals=["TCP", "UDP", "SCTP"]
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 05/13] dts: merge DTS conf/test_case_checklist.json to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (3 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 04/13] dts: merge DTS conf/suite_sample.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 06/13] dts: merge DTS conf/test_case_supportlist.json " Juraj Linkeš
                   ` (7 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/test_case_checklist.json | 3781 +++++++++++++++++++++++++++++
 1 file changed, 3781 insertions(+)
 create mode 100644 dts/conf/test_case_checklist.json

diff --git a/dts/conf/test_case_checklist.json b/dts/conf/test_case_checklist.json
new file mode 100644
index 0000000000..3caeb16b87
--- /dev/null
+++ b/dts/conf/test_case_checklist.json
@@ -0,0 +1,3781 @@
+{
+    "64_queues": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "bartonhills",
+                "powerville",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"columbiaville_25g",
+		"columbiaville_100g",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "sagepond",
+                "kawela_4",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support this test"
+        }
+    ],
+    "ethertype_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springville",
+                "ironpond",
+                "springfountain",
+                "cavium_a034",
+                "cavium_a011",
+                "twinpond",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "five_tuple_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "bartonhills",
+                "powerville",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "flex_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "kawela_4",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "jumbo_frame_size": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_25g",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "multiple_filters_10GB": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "kawela_4",
+                "bartonhills",
+                "powerville",
+                "fortville_25g",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "multiple_filters_1GB": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "priority_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "syn_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"columbiaville_100g",
+		"columbiaville_25g",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "twotuple_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "kawela_4",
+                "fortville_spirit_single",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_stripq_config": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "foxville",
+                "powerville",
+                "kawela_4",
+                "springville",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "cavium_a063",
+                "cavium_a064",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_tpid_config": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "cavium_a063",
+                "cavium_a064",
+                "carlsville",
+                "powerville",
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "springville",
+	        "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_QinQ_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "kawela_4",
+                "bartonhills",
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "link_stats": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "powerville",
+                "kawela_4",
+                "springville",
+                "sageville",
+                "ironpond",
+                "cavium_a034",
+                "cavium_0011",
+                "cavium_a064",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "stop_restart": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "ironpond",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "checksum_checking": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011",
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "flowctrl_off_pause_fwd_on": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "if set pasue, the packet type error when use kernel driver send packet"
+        }
+    ],
+    "flowctrl_on_pause_fwd_on": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "if set pasue, the packet type error when use kernel driver send packet"
+        }
+    ],
+    "pause_fwd_port_stop_start": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "if set pasue, the packet type error when use kernel driver send packet"
+        }
+    ],
+    "flowctrl_off_pause_fwd_off": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "flowctrl_on_pause_fwd_off": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_random_test": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "sagepond",
+                "sageville",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_synthetic_test": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "sagepond",
+                "sageville",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_flexword_drop_ipv4": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_a011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_flexword_drop_ipv6": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "niantic",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_flexword_fwd_ipv4": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_flexword_fwd_ipv6": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_0011",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_noflexword_drop_ipv4": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_noflexword_drop_ipv6": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "niantic",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_noflexword_fwd_ipv4": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_noflexword_fwd_ipv6": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the os not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "cavium_a034",
+                "cavium_0011",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_rss_bond_config": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "niantic",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case,(x722 know ND issue,DPDK-15118)"
+        }
+    ],
+    "pmdrss_reta": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case/not enough queue"
+        }
+    ],
+    "rss_key_size": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "cavium_a034",
+                "cavium_a011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case/not enough queue"
+        }
+    ],
+    "ifconfig": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "ping": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "ethtools": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "tcpdump": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "stress": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "statistics": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "multiprocess_simple_mpapplicationstartup": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit need manually run"
+        }
+    ],
+    "multiprocess_simple_mpbasicoperation": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit need manually run"
+        }
+    ],
+    "multiprocess_simple_mploadtest": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit need manually run"
+        }
+    ],
+    "multiprocess_simple_mpnoflag": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit need manually run"
+        }
+    ],
+    "ieee1588_enable": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springville",
+                "cavium_a034",
+                "cavium_0011",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "ethtool": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springfountain",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case,confirmed with developer"
+        }
+    ],
+    "power_acpi": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "depend on os and hw support"
+        }
+    ],
+    "pmd_burst": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "pmd_continues": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_spirit_single",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "sched": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        }
+    ],
+    "send_4K_frames_split_in_7_and_4K_maxflows": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        }
+    ],
+    "simple": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case/not enough queue"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "nic not support this case"
+        }
+    ],
+    "simple_symmetric": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "DPDK-8410",
+            "Comments": "DPDK-8410, won't fix; skip this case"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+	        "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "toeplitz": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case/not enough queue"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "toeplitz_symmetric": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case/not enough queue"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "all_cores_coremask": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "not enough cores for 32 bit"
+        }
+    ],
+    "alarm": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "interrupts": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "link_bonding": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "log_dump": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "kni": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "power": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the OS not support this case"
+        }
+    ],
+    "vf_pmdrss": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond",
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vf_pmdrss_reta": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "kawela_4",
+                "springville",
+                "ironpond",
+                "springfountain",
+                "twinpond"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dpdk_2pf_2vf_1vm": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+		"columbiaville_100g",
+		"columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dpdk_2pf_2vf_1vm_iplink_macfilter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+		"columbiaville_100g",
+		"columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dpdk_pf_vf_reset": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+		"columbiaville_100g",
+		"columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "check_specific_package_loading": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the case needs >=2 CVL NICs with different Serial Numbers"
+        }
+    ],
+    "kernel_2pf_2vf_1vm_mac_add_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vf_vlan_strip": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "rx_checksum_valid_flags": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_config_broadcast": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_config_disable_promiscuous": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_config_enable_promiscuous": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_config_default_mode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "dynamic_config_allmulticast": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "jumboframes_bigger_jumbo": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "jumboframes_jumbo_nojumbo": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "link_status_interrupt_port_available": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "arm64-thunderx-linuxapp-gcc"
+            ],
+            "Bug ID": "",
+            "Comments": "link_status_interrupt application assumes one certain CPU frequency, test fails on thunder boards"
+        },
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "arm64-thunderx-linuxapp-gcc"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+    "add_remove_mac_address": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "invalid_addresses": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a034",
+                "cavium_0011"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": ""
+        }
+    ],
+    "flags": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc",
+                "i686-native-linuxapp-clang"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit address space limited"
+        }
+    ],
+    "qinq_packet_filter_VF_queues": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc",
+                "i686-native-linuxapp-clang"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit address space limited"
+        }
+    ],
+    "multiprocess": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc",
+                "i686-native-linuxapp-clang"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bit not support this case"
+        }
+    ],
+    "fdir_ipv6_tc": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "fdir_ivlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "ipv4_tos_proto_ttl": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "port_mtu": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortpark_TLV_vf",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Know dpdk issue, DPDK-2513"
+        }
+    ],
+    "multicast_mode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "promisc_mode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "broadcast_mode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vf_mtu": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_tag": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "all_queues_drop": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville",
+		"fortpark_BASE-T"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vlan_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "rss": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "qinq_filter_with_diffierent_tpid": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "if update vlan tpid, kernel driver send packet with error packet type "
+        }
+    ],
+    "vlan_qinq_tpid": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "cavium_a034",
+                "cavium_a011",
+                "cavium_a063",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "cavium_a064",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "if update vlan tpid, kernel driver send packet with error packet type "
+        }
+    ],
+    "two_vms_add_multi_exact_mac_on_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville",
+                "twinpond"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Niantic not support this case"
+        }
+    ],
+    "two_vms_uplink_and_downlink_mirror": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortpark_BASE-T"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC X722 firmware doesn't support to add more than one mirror rule in one vsi"
+        }
+    ],
+    "two_vms_vlan_and_pool_and_uplink_and_downlink": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortpark_BASE-T"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC X722 firmware doesn't support to add more than one mirror rule in one vsi"
+        }
+    ],
+     "queue_region_with_rss_rule_api": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "powerville",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "queue_region_with_rss_rule_combination": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "powerville",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "queue_region_with_invalid_parameter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "powerville",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "retrieve_reg": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "cavium_a063",
+                "fortpark_TLV_vf",
+                "cavium_a064",
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+        "stats_show_clear": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "tso_tunneling": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "powerville",
+                "twinpond",
+                "twinville",
+                "sagepond",
+                "sageville",
+		"foxville",
+		"springville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "flow_director_rss_rule_combination": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "ring_dump": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "reconfigure_ports": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "vlan_change_tpid": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "set_promiscuousmode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "tunnel_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case: ice_dev_filter_ctrl(): Filter type (6) not supported"
+        }
+    ],
+     "tunnel_filter_invalid": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case: ice_dev_filter_ctrl(): Filter type (6) not supported"
+        }
+    ],
+     "GRE_packet_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case: ice_dev_filter_ctrl(): Filter type (6) not supported"
+        }
+    ],
+    "two_vms_pool_down_mirrors": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville",
+                "twinpond"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "retrieve_eeprom": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "enable_disablejumbo": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "power_acpi_cpufreq": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "power_cpufreq": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "nvgre_ipv4_checksum_offload": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "different_types_rss_queue_rule": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "disable_enable_rss": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "disable_rss_in_commandline": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "enable_ipv4_udp_rss": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+     "rss_queue_rule": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a063",
+                "cavium_a064"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "vf_vlan_rx": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "nic_multi_queues_interrupt_VF_vfio_pci": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+		        "sagepond",
+		        "sageville",
+                "twinpond",
+		"columbiaville_25g",
+		"columbiaville_100g",
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "nic_multi_queues_interrupt_VM_vfio_pci": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville",
+                "twinpond",
+		"columbiaville_25g",
+		"columbiaville_100g",
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "nic_interrupt_VF_vfio_pci": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "igbvf driver not support interrupt"
+        }
+    ],
+    "nic_interrupt_VM_vfio_pci": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "igbvf driver not support interrupt"
+        }
+    ],
+    "change_linkspeed": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "springville",
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only i40e and ixgbe driver support this case"
+        }
+    ],
+    "change_linkspeed_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "springville",
+                "columbiaville_25g",
+                "columbiaville_100g",
+		"foxville",
+                "fortville_eagle",
+                "fortville_spirit",
+	        "fortville_spirit_single",
+	        "fortpark",
+	        "fortpark_TLV",
+                "fortpark_BASE-T",
+	        "fortville_25g",
+	        "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only ixgbe driver support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "all"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "freebsd not support create vf"
+        }
+    ],
+    "hash_readwrite_perf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"ipv6_5tuple_hash_table": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+    "fdir_for_vlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"fdir_for_nvgre": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+	{
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"L2_tunnel_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"fdir_for_L2_payload": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"n_tuple_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"flexbytes_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+        "fdir_L2_mac_filter_negative": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "niantic",
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only support by i40e"
+        }
+    ],
+        "fdir_L2_mac_filter_basic_for_ipv4_other": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "niantic",
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only support by i40e"
+        }
+    ],
+       "fdir_L2_mac_filter_basic_for_ipv4_tcp": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "niantic",
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only support by i40e"
+        }
+    ],
+    "fdir_L2_mac_filter_complex": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "niantic",
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only support by i40e"
+        }
+    ],
+    "fdir_L2_mac_filter_basic_for_ipv4_udp": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "niantic",
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only support by i40e"
+        }
+    ],
+
+    "perf_pvp_split_ring_dequeue_zero_copy": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "niantic not support this case"
+        }
+    ],
+    "perf_pvp_packed_ring_dequeue_zero_copy": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "niantic not support this case"
+        }
+    ],
+    "check_double_VLAN_fields_in_RXD_8021ad": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "CVL_100G kennel not support double VLAN"
+        }
+    ],
+    "check_double_VLAN_fields_in_RXD_8021Q_2_VLAN_tag": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "only i40e and ixgbe driver support this case"
+        }
+	],
+    "tunnel_filter_nvgre": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"fdir_for_flexbytes": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"fdir_for_mac_vlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"tunnel_filter_vxlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"fdir_for_ipv4": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+       "fdir_for_ipv6": [
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"fdir_for_vxlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        },
+        {
+            "OS": [
+                "freebsd"
+            ],
+            "NIC": [
+                "fortville_eagle"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "testpmd not support socket-mem and file-prefix param in freebsd"
+        }
+    ],
+	"link_status_interrupt_change": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"load_balancer": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Feature will be ready in next stage(P3)"
+        }
+    ],
+	"multicast_forwarding": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Feature will be ready in next stage(P3)"
+        }
+    ],
+	"update_system": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Feature will be ready in next stage(P3)"
+        }
+    ],
+	"ptpclient": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Feature will be ready in next stage(P3)"
+        }
+    ],
+	"IPv4_L4": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+	"l2pkt_detect": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Feature will be ready in next stage(P3)"
+        }
+    ],
+    "dump_driver_info": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "DPDK-14025",
+            "Comments": "NIC not support this case"
+        }
+    ],
+    "queue_start_stop": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+		"springville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "GRE_ipv6_packet_detect": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "DPDK-18754",
+            "Comments": "CVL NIC doesn't support the VLAN in pkg ptype"
+        }
+    ],
+    "txoffload_port_all": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springville",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Nic not support this case"
+       }
+    ],
+    "rxoffload_port": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "springville not support this case"
+        }
+    ],
+    "txoffload_port_cmdline": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "springville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "springville not support this case"
+        }
+    ],
+    "rxoffload_port_all": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+    "rxoffload_port_cmdline": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NIC not support this case"
+        }
+    ],
+    "port_detach_attach_for_vhost_user_virtio_user": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "i686-native-linuxapp-gcc",
+                "i686-native-linuxapp-icc"
+            ],
+            "Bug ID": "",
+            "Comments": "32 bites not support this case(memoory not enough)."
+        }
+    ],
+    "VEB_switching_inter_vfs_and_pf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "CVL not support DPDK PF + DPDK VF"
+        }
+    ],
+    "txoffload_queue": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "the nic not support this case"
+        }
+    ],
+    "change_thresholds": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g",
+	        "fortville_eagle",
+		"fortville_spirit",
+		"fortpark_TLV",
+		"fortpark_BASE-T",
+		"fortville_25g",
+		"carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "DPDK-24129",
+            "Comments": "CVL and FVL not support this case"
+        }
+    ],
+    "mtu_checks_100": [
+         {
+             "OS": [
+                 "ALL"
+             ],
+             "NIC": [
+                 "niantic",
+                 "twinpond",
+                 "sageville",
+                 "sagepond",
+		 "springville",
+		 "powerville",
+                 "foxville"
+             ],
+             "Target": [
+                 "ALL"
+             ],
+             "Bug ID": "",
+             "Comments": "NIC not support this case"
+         }
+    ],
+    "create_same_rule_after_destroy": [
+         {
+             "OS": [
+                 "ALL"
+             ],
+             "NIC": [
+                 "sageville",
+                 "sagepond",
+                 "springville",
+                 "powerville",
+                 "foxville"
+             ],
+             "Target": [
+                 "ALL"
+             ],
+             "Bug ID": "",
+             "Comments": "NIC not support this case"
+         }
+    ],
+    "create_different_rule_after_destroy": [
+         {
+             "OS": [
+                 "ALL"
+             ],
+             "NIC": [
+                 "sageville",
+                 "sagepond",
+                 "springville",
+                 "powerville",
+                 "foxville"
+             ],
+             "Target": [
+                 "ALL"
+             ],
+             "Bug ID": "",
+             "Comments": "NIC not support this case"
+         }
+    ],
+"dual_vlan": [
+         {
+             "OS": [
+                 "ALL"
+             ],
+             "NIC": [
+                 "niantic",
+                 "foxville",
+		 "columbiaville_100g",
+		 "columbiaville_25g"
+             ],
+             "Target": [
+                 "ALL"
+             ],
+             "Bug ID": "",
+             "Comments": "NIC not support this case"
+         }
+    ]
+}
-- 
2.20.1



^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 06/13] dts: merge DTS conf/test_case_supportlist.json to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (4 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 05/13] dts: merge DTS conf/test_case_checklist.json " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 07/13] dts: merge DTS execution.cfg " Juraj Linkeš
                   ` (6 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/conf/test_case_supportlist.json | 2374 +++++++++++++++++++++++++++
 1 file changed, 2374 insertions(+)
 create mode 100644 dts/conf/test_case_supportlist.json

diff --git a/dts/conf/test_case_supportlist.json b/dts/conf/test_case_supportlist.json
new file mode 100644
index 0000000000..7fa1cf901e
--- /dev/null
+++ b/dts/conf/test_case_supportlist.json
@@ -0,0 +1,2374 @@
+{
+    "vf_vlan_tx": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on fortville"
+        }
+    ],
+    "dpdk_2pf_2vf_1vm_mac_add_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+		"fortville_spirit",
+		"fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on fortville"
+        }
+    ],
+    "two_vms_prevent_rx_broadcast_on_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "two_vms_enalbe_or_disable_one_uta_mac_on_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "two_vms_pause_tx_queuse": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "two_vms_pause_rx_queues": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "two_vms_add_multi_uta_mac_on_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "two_vms_add_or_remove_uta_mac_on_vf": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on niantic"
+        }
+    ],
+    "l2pkt_detect": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "foxville",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+	        "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "l2 packet detect only support on FVL"
+        }
+    ],
+    "IP_in_IPv4_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "IP_in_IPv4 tunnel packet detect only support on FVL"
+        }
+    ],
+    "IPv6_in_IPv4_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "powerville",
+                "niantic",
+                "fortville_25g",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "IPv6_in_IPv4 tunnel packet detect only support on Niantic/FVL/powerville/fortpark_TLV"
+        }
+    ],
+    "IP_in_IPv6_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "IP_in_IPv6 tunnel packet detect only support on FVL"
+        }
+    ],
+    "NVGRE_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NVGRE tunnel packet detect only support on FVL"
+        }
+    ],
+    "NVGRE_in_IPv6_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "NVGRE in ipv6 tunnel packet detect only support on FVL"
+        }
+    ],
+    "GRE_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "GRE tunnel packet detect only support on FVL"
+        }
+    ],
+    "Vxlan_tunnel": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "forrpark_TLV",
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville",
+                "columbiaville_25g",
+                "columbiaville_100g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "Vxlan  tunnel packet detect only support on FVL"
+        }
+    ],
+    "outer_dst_contrl_gtpcq": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "teid_contrl_gtpcq": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "teid_contrl_gtpu_ipv4q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "sport_contrl_gtpu_ipv4q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "dport_contrl_gtpu_ipv4q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "inner_src_contrl_gtpu_ipv4q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "inner_dst_contrl_gtpu_ipv4q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "teid_contrl_gtpu_ipv6q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "sport_contrl_gtpu_ipv6q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "dport_contrl_gtpu_ipv6q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "inner_src_contrl_gtpu_ipv6q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "inner_dst_contrl_gtpu_ipv6q": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+     "fdir_ipv6_tc": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "foxville",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "ipv4_tos_proto_ttl": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "foxville",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "fdir_ivlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "foxville",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "nsh": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortpark_TLV_vf",
+                "fvl10g_vf",
+		"carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e driver nic"
+        }
+    ],
+    "set_key_keylen": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "queue_region_with_rss_rule_api": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsvile"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "queue_region_with_rss_rule_combination": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "queue_region_with_invalid_parameter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "rxoffload_queue": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "twinpond",
+                "sagepond",
+                "sageville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on niantic"
+        }
+    ],
+    "txoffload_queue": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "foxville",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortville_25g",
+		"columbiaville_100g",
+		"columbiaville_25g",
+                "fortpark",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "tunnel_filter_vxlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "foxville",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "2_tuple_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "bartonhills",
+                "powerville",
+                "fortville_eagle",
+                "fortville_25g",
+		"columbiaville_100g",
+		"columbiaville_25g",
+                "fortville_spirit",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on bartonhills and powerville"
+        }
+    ],
+    "fdir_for_nvgre": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "twinville",
+                "sagepond",
+                "sageville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on twinville, sagepond and sageville"
+        }
+    ],
+    "fdir_for_mac_vlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "twinville",
+                "fortville_eagle",
+                "fortville_25g",
+		"columbiaville_25g",
+		"columbiaville_100g",
+                "fortville_spirit",
+                "sagepond",
+                "sageville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on twinville,sagepond and sageville"
+        }
+    ],
+    "n_tuple_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "kawela_4",
+                "kawela",
+                "twinville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on twinville,niantic,kawela_4 and kawela"
+        }
+    ],
+    "fdir_for_ipv4": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "foxville",
+                "twinville",
+                "sagepond",
+                "sageville",
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on niantic,twinville,sagepond,sageville and FVL"
+        }
+    ],
+    "fdir_for_L2_payload": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "fdir_for_ipv6": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "twinville",
+                "sagepond",
+                "sageville",
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "foxville",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on niantic,twinville,sagepond,sageville and FVL"
+        }
+    ],
+    "fdir_for_vxlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "twinville",
+                "sagepond",
+                "sageville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on twinville,sagepond and sageville"
+        }
+    ],
+    "fdir_for_vlan": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "ethertype_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "kawela_4",
+                "kawela",
+                "bartonhills",
+                "twinville",
+                "sagepond",
+                "sageville",
+                "powerville",
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on niantic,kawela_4,kawela,bartonhills,twinville,sagepond,sageville,powerville and FVL"
+        }
+    ],
+    "flexbytes_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "bartonhills",
+                "powerville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on bartonhills and powerville"
+        }
+    ],
+    "L2_tunnel_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sagepond",
+                "sageville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on sagepond and sageville"
+        }
+    ],
+    "fdir_for_flexbytes": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "twinville",
+                "sagepond",
+                "sageville",
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on niantic,twinville,sagepond,sageville and FVL"
+        }
+    ],
+    "tunnel_filter_nvgre": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "carlsville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support on FVL"
+        }
+    ],
+    "perf_eventdev_1ports_atq_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_1ports_atq_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_1ports_atq_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_1ports_queue_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_1ports_queue_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_1ports_queue_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_atq_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_atq_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_atq_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_queue_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_queue_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_2ports_queue_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_atq_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_atq_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_atq_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_queue_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_queue_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_4ports_queue_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_1ports_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_1ports_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_1ports_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_2ports_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_2ports_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_2ports_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_4ports_atomic_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_4ports_parallel_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "perf_eventdev_pipeline_4ports_order_performance": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 "
+        }
+    ],
+    "dcd_4tc_queue_map_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for i40e "
+        }
+    ],
+    "dcd_8tc_queue_map_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for i40e "
+        }
+    ],
+    "perf_shaping_for_port_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for i40e "
+        }
+    ],
+    "perf_shaping_1port_4tc_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for i40e "
+        }
+    ],
+    "perf_shaping_1port_8tc_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for i40e "
+        }
+    ],
+    "dcd_4tc_queue_map_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for ixgbe "
+        }
+    ],
+    "dcd_8tc_queue_map_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for ixgbe "
+        }
+    ],
+    "perf_shaping_1port_4tc_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for ixgbe "
+        }
+    ],
+    "perf_shaping_1port_8tc_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "sagepond",
+                "sageville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for ixgbe "
+        }
+    ],
+    "download_the_package_successfully": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for columbiaville"
+        }
+    ],
+    "download_the_package_failed": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for columbiaville"
+        }
+    ],
+    "perf_pvp_share_lib_of_fortville": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for fortville_eagle/spirit/25g "
+        }
+    ],
+    "perf_pvp_share_lib_of_niantic": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for niantic "
+        }
+    ],
+    "packet_checking_scalar_mode": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "cavium_a064",
+                "cavium_a063",
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for cavium_a063 and cavium_a064 "
+        }
+    ],
+    "dcb_4tc_queue_map_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on fortville"
+        }
+    ],
+    "dcb_8tc_queue_map_i40e": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on fortville"
+        }
+    ],
+    "dcb_4tc_queue_map_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for niantic"
+        }
+    ],
+    "dcb_8tc_queue_map_ixgbe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for niantic"
+        }
+    ],
+    "perf_kernel_pf_dpdk_iavf_perf_host_only": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "this case only support on fortville"
+        }
+    ],
+    "ixgbe_vf_jumboframe": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "sageville",
+		"twinpond"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case currently support for x550/x540"
+        }
+    ],
+    "fdir_L2_mac_filter_basic_for_ipv4_udp": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "fdir_L2_mac_filter_basic_for_ipv4_tcp": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "fdir_L2_mac_filter_negative": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "fdir_L2_mac_filter_basic_for_ipv4_other": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "fdir_L2_mac_filter_complex": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "queue_region_with_rte_flow_api": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "flow_director_rss_rule_combination": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g",
+                "carlsville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "set_rss_queues": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "set_rss_types_rss_queue": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "disable_rss_in_commandline": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "queue_region_in_rte_flow_with_invalid_parameter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "set_rss_types": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_spirit",
+                "carlsville",
+                "fortville_spirit_single",
+                "fortpark_TLV",
+                "fortpark_BASE-T",
+                "fortville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support i40e nic "
+        }
+    ],
+    "disable_rss_in_commandline_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+    "disable_enable_rss_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+    "rss_queue_rule_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+    "different_types_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+    "enable_ipv4_udp_rss_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+    "flow_director_rss_rule_combination_ixgbe_igb": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+		"foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic "
+        }
+    ],
+     "multicast_filter": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "niantic",
+                "ironpond",
+                "twinpond",
+                "twinville",
+                "sageville",
+                "sagepond",
+                "springville",
+                "powerville",
+                "foxville"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ixgbe and igb nic,The feature corresponding task ticket is DPDK-7884."
+        }
+    ],
+     "hardware_checksum_check_l4_rx": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ice"
+        }
+    ],
+     "hardware_checksum_check_l4_tx": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "fortville_eagle",
+                "fortville_25g",
+                "fortville_spirit",
+                "columbiaville_100g",
+                "columbiaville_25g"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only support ice"
+        }
+    ],
+    "lsc_event_between_vhost_user_and_virtio_user_with_packed_ring_and_cbdma_enabled": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "host_driver": [
+                "igb_uio"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only supports the igb_uio driver"
+        }
+    ],
+    "lsc_event_between_vhost_user_and_virtio_user_with_split_ring_and_cbdma_enabled": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "host_driver": [
+                "igb_uio"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only supports the igb_uio driver"
+        }
+    ],
+    "packed_ring_virtio_user_interrupt_test_with_vhost_user_as_backend_and_cbdma_enabled": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "host_driver": [
+                "igb_uio"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only supports the igb_uio driver"
+        }
+    ],
+    "split_ring_virtio_user_interrupt_test_with_vhost_user_as_backend_and_cbdma_enabled": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "host_driver": [
+                "igb_uio"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only supports the igb_uio driver"
+        }
+    ],
+    "nic_interrupt_PF_igb_uio": [
+        {
+            "OS": [
+                "ALL"
+            ],
+            "NIC": [
+                "ALL"
+            ],
+            "Target": [
+                "ALL"
+            ],
+            "host_driver": [
+                "igb_uio"
+            ],
+            "Bug ID": "",
+            "Comments": "This case only supports the igb_uio driver"
+        }
+    ]
+}
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 07/13] dts: merge DTS execution.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (5 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 06/13] dts: merge DTS conf/test_case_supportlist.json " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 08/13] dts: merge DTS executions/execution.cfg " Juraj Linkeš
                   ` (5 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/execution.cfg | 10 ++++++++++
 1 file changed, 10 insertions(+)
 create mode 100644 dts/execution.cfg

diff --git a/dts/execution.cfg b/dts/execution.cfg
new file mode 100644
index 0000000000..1507527c82
--- /dev/null
+++ b/dts/execution.cfg
@@ -0,0 +1,10 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=vfio-pci
+build_type=meson
+test_suites=
+    hello_world,
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 08/13] dts: merge DTS executions/execution.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (6 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 07/13] dts: merge DTS execution.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 09/13] dts: merge DTS executions/execution_FVL.cfg " Juraj Linkeš
                   ` (4 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/executions/execution.cfg | 47 ++++++++++++++++++++++++++++++++++++
 1 file changed, 47 insertions(+)
 create mode 100644 dts/executions/execution.cfg

diff --git a/dts/executions/execution.cfg b/dts/executions/execution.cfg
new file mode 100644
index 0000000000..73ff0be216
--- /dev/null
+++ b/dts/executions/execution.cfg
@@ -0,0 +1,47 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=<driver name igb_uio or vfio-pci or mlx5_core or uio_pci_generic>
+build_type=<meson>
+test_suites=
+    cmdline,
+    hello_world,
+    multiprocess,
+    timer,
+    blocklist,
+    mac_filter,
+    ieee1588,
+    checksum_offload,
+    jumboframes,
+    ipfrag,
+    link_flowctrl,
+    vlan,
+    ip_pipeline,
+    pmd_bonded,
+    dynamic_config,
+    generic_filter,
+    dual_vlan,
+    shutdown_api,
+    fdir,
+    ipv4_reassembly,
+    scatter,
+    pmdrssreta,
+    pmd,
+    l2fwd,
+    kni,
+    uni_pkt
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
+
+[Execution2]
+crbs=<Performance CRB IP Address>
+drivername=<driver name igb_uio or vfio-pci>
+build_type=<meson>
+test_suites=
+    l2fwd,
+    l3fwd,
+    pmd
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=niantic:perf=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 09/13] dts: merge DTS executions/execution_FVL.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (7 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 08/13] dts: merge DTS executions/execution.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 10/13] dts: merge DTS executions/execution_fm10k.cfg " Juraj Linkeš
                   ` (3 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/executions/execution_FVL.cfg | 48 ++++++++++++++++++++++++++++++++
 1 file changed, 48 insertions(+)
 create mode 100644 dts/executions/execution_FVL.cfg

diff --git a/dts/executions/execution_FVL.cfg b/dts/executions/execution_FVL.cfg
new file mode 100644
index 0000000000..8a71bbea23
--- /dev/null
+++ b/dts/executions/execution_FVL.cfg
@@ -0,0 +1,48 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=<driver name igb_uio or vfio-pci or mlx5_core or uio_pci_generic>
+build_type=<meson>
+test_suites=
+    checksum_offload,
+    dynamic_config,
+    generic_filter,
+    dual_vlan,
+    vlan,
+    shutdown_api,
+    queue_start_stop,
+    tso,
+    fdir,
+    nvgre,
+    vxlan,
+    vxlan_sample,
+    pmd,
+    ipfrag,
+    timer,
+    jumboframes,
+    multiprocess,
+    l2fwd,
+    mac_filter,
+    blocklist,
+    ipv4_reassembly,
+    scatter,
+    pmdrssreta,
+    pmdrss_hash,
+    ieee1588,
+    kni,
+    uni_pkt
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
+
+[Execution2]
+crbs=<Performance CRB IP Address>
+drivername=<driver name igb_uio or vfio-pci>
+build_type=<meson>
+test_suites=
+    l2fwd,
+    l3fwd,
+    pmd
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=niantic:perf=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 10/13] dts: merge DTS executions/execution_fm10k.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (8 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 09/13] dts: merge DTS executions/execution_FVL.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 11/13] dts: merge DTS executions/execution_rxmode.cfg " Juraj Linkeš
                   ` (2 subsequent siblings)
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/executions/execution_fm10k.cfg | 29 +++++++++++++++++++++++++++++
 1 file changed, 29 insertions(+)
 create mode 100644 dts/executions/execution_fm10k.cfg

diff --git a/dts/executions/execution_fm10k.cfg b/dts/executions/execution_fm10k.cfg
new file mode 100644
index 0000000000..b535d78f35
--- /dev/null
+++ b/dts/executions/execution_fm10k.cfg
@@ -0,0 +1,29 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=<driver name igb_uio or vfio-pci or uio_pci_generic>
+build_type=<meson>
+test_suites=
+    checksum_offload,
+    vlan,
+    shutdown_api,
+    queue_start_stop,
+    tso,
+    pmd,
+    jumboframes,
+    mac_filter,
+    scatter,
+    pmdrss_hash,
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
+
+[Execution2]
+crbs=<Performance CRB IP Address>
+drivername=<driver name igb_uio or vfio-pci>
+build_type=<meson>
+test_suites=
+    l3fwd,
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=niantic:perf=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 11/13] dts: merge DTS executions/execution_rxmode.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (9 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 10/13] dts: merge DTS executions/execution_fm10k.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 12/13] dts: merge DTS executions/execution_smoke.cfg " Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 13/13] dts: merge DTS framework/settings.py " Juraj Linkeš
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/executions/execution_rxmode.cfg | 66 +++++++++++++++++++++++++++++
 1 file changed, 66 insertions(+)
 create mode 100644 dts/executions/execution_rxmode.cfg

diff --git a/dts/executions/execution_rxmode.cfg b/dts/executions/execution_rxmode.cfg
new file mode 100644
index 0000000000..041755e2c4
--- /dev/null
+++ b/dts/executions/execution_rxmode.cfg
@@ -0,0 +1,66 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=igb_uio
+rx_mode=scalar
+build_type=<meson>
+test_suites=
+    fdir,
+    jumboframes,
+    scatter,
+    ieee1588,
+    checksum_offload,
+    link_flowctrl,
+    pmd,
+    vlan,
+    shutdown_api,
+    dual_vlan,
+    pmdrssreta,
+    generic_filter
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
+
+[Execution2]
+crbs=<CRB IP Address>
+drivername=igb_uio
+rx_mode=full
+build_type=<meson>
+test_suites=
+    fdir,
+    jumboframes,
+    scatter,
+    ieee1588,
+    checksum_offload,
+    link_flowctrl,
+    pmd,
+    vlan,
+    shutdown_api,
+    dual_vlan,
+    pmdrssreta,
+    generic_filter
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
+
+[Execution3]
+crbs=<CRB IP Address>
+drivername=igb_uio
+rx_mode=vector
+build_type=<meson>
+test_suites=
+    fdir,
+    jumboframes,
+    scatter,
+    ieee1588,
+    checksum_offload,
+    link_flowctrl,
+    pmd,
+    vlan,
+    shutdown_api,
+    dual_vlan,
+    pmdrssreta,
+    generic_filter
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=cfg:func=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 12/13] dts: merge DTS executions/execution_smoke.cfg to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (10 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 11/13] dts: merge DTS executions/execution_rxmode.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  2022-04-06 15:07 ` [RFC PATCH v1 13/13] dts: merge DTS framework/settings.py " Juraj Linkeš
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/executions/execution_smoke.cfg | 32 ++++++++++++++++++++++++++++++
 1 file changed, 32 insertions(+)
 create mode 100644 dts/executions/execution_smoke.cfg

diff --git a/dts/executions/execution_smoke.cfg b/dts/executions/execution_smoke.cfg
new file mode 100644
index 0000000000..6f35578db0
--- /dev/null
+++ b/dts/executions/execution_smoke.cfg
@@ -0,0 +1,32 @@
+[Execution1]
+crbs=<CRB IP Address>
+#using igb_uio please refer to doc/dts_gsg/support_igb_uio.rst
+drivername=<driver name igb_uio or vfio-pci or mlx5_core or uio_pci_generic>
+build_type=<meson>
+test_suites=
+    unit_tests_cmdline,
+    unit_tests_eal,
+    unit_tests_dump,
+    unit_tests_kni,
+    unit_tests_lpm,
+    unit_tests_mbuf,
+    unit_tests_mempool,
+    unit_tests_power,
+    unit_tests_pmd_perf,
+    unit_tests_qos,
+    unit_tests_ring,
+    unit_tests_ringpmd,
+    unit_tests_timer,
+    dynamic_config,
+    jumboframes,
+    scatter,
+    ieee1588,
+    multiprocess,
+    l2fwd,
+    pmd,
+    checksum_offload,
+    mac_filter,
+    blocklist
+targets=
+    x86_64-native-linuxapp-gcc
+parameters=nic_type=niantic:func=true
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

* [RFC PATCH v1 13/13] dts: merge DTS framework/settings.py to DPDK
  2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
                   ` (11 preceding siblings ...)
  2022-04-06 15:07 ` [RFC PATCH v1 12/13] dts: merge DTS executions/execution_smoke.cfg " Juraj Linkeš
@ 2022-04-06 15:07 ` Juraj Linkeš
  12 siblings, 0 replies; 14+ messages in thread
From: Juraj Linkeš @ 2022-04-06 15:07 UTC (permalink / raw)
  To: thomas, david.marchand, Honnappa.Nagarahalli, ohilyard, lijuan.tu
  Cc: dev, Juraj Linkeš

---
 dts/framework/settings.py | 391 ++++++++++++++++++++++++++++++++++++++
 1 file changed, 391 insertions(+)
 create mode 100644 dts/framework/settings.py

diff --git a/dts/framework/settings.py b/dts/framework/settings.py
new file mode 100644
index 0000000000..14aac9e01a
--- /dev/null
+++ b/dts/framework/settings.py
@@ -0,0 +1,391 @@
+# BSD LICENSE
+#
+# Copyright(c) 2010-2021 Intel Corporation. All rights reserved.
+# All rights reserved.
+#
+# Redistribution and use in source and binary forms, with or without
+# modification, are permitted provided that the following conditions
+# are met:
+#
+#   * Redistributions of source code must retain the above copyright
+#     notice, this list of conditions and the following disclaimer.
+#   * Redistributions in binary form must reproduce the above copyright
+#     notice, this list of conditions and the following disclaimer in
+#     the documentation and/or other materials provided with the
+#     distribution.
+#   * Neither the name of Intel Corporation nor the names of its
+#     contributors may be used to endorse or promote products derived
+#     from this software without specific prior written permission.
+#
+# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
+# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
+# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
+# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT
+# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL,
+# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT
+# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE,
+# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY
+# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT
+# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE
+# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.
+"""
+Folders for framework running environment.
+"""
+import os
+import re
+import socket
+import sys
+
+FOLDERS = {
+    "Framework": "framework",
+    "Testscripts": "tests",
+    "Configuration": "conf",
+    "Depends": "dep",
+    "Output": "output",
+    "NicDriver": "nics",
+}
+
+"""
+Nics and its identifiers supported by the framework.
+"""
+NICS = {
+    "kawela": "8086:10e8",
+    "kawela_2": "8086:10c9",
+    "kawela_4": "8086:1526",
+    "bartonhills": "8086:150e",
+    "powerville": "8086:1521",
+    "powerville_vf": "8086:1520",
+    "ophir": "8086:105e",
+    "niantic": "8086:10fb",
+    "niantic_vf": "8086:10ed",
+    "ironpond": "8086:151c",
+    "twinpond": "8086:1528",
+    "twinpond_vf": "8086:1515",
+    "twinville": "8086:1512",
+    "sageville": "8086:1563",
+    "sageville_vf": "8086:1565",
+    "sagepond": "8086:15ad",
+    "sagepond_vf": "8086:15a8",
+    "magnolia_park": "8086:15ce",
+    "hartwell": "8086:10d3",
+    "82545EM": "8086:100f",
+    "82540EM": "8086:100e",
+    "springville": "8086:1533",
+    "springfountain": "8086:154a",
+    "virtio": "1af4:1000",
+    "avoton": "8086:1f41",
+    "avoton2c5": "8086:1f45",
+    "I217V": "8086:153b",
+    "I217LM": "8086:153a",
+    "I218V": "8086:1559",
+    "I218LM": "8086:155a",
+    "fortville_eagle": "8086:1572",
+    "fortville_spirit": "8086:1583",
+    "fortville_spirit_single": "8086:1584",
+    "fortpark": "8086:374c",
+    "fortpark_1g": "8086:37d1",
+    "fortpark_TLV": "8086:37d0",
+    "fortpark_BASE-T": "8086:37d2",
+    "fortpark_TLV_vf": "8086:37cd",
+    "fvl10g_vf": "8086:154c",
+    "ConnectX3_MT4103": "15b3:1007",
+    "ConnectX4_MT4115": "15b3:1013",
+    "ConnectX4_LX_MT4117": "15b3:1015",
+    "ConnectX5_MT4119": "15b3:1017",
+    "ConnectX5_MT4121": "15b3:1019",
+    "fortville_25g": "8086:158b",
+    "cavium_a034": "177d:a034",
+    "cavium_0011": "177d:0011",
+    "fortvile_bdw_de": "8086:15ac",
+    "cavium_a063": "177d:a063",
+    "cavium_a064": "177d:a064",
+    "columbiaville_100g": "8086:1592",
+    "columbiaville_25g": "8086:1593",
+    "columbiaville_25gx2": "8086:159b",
+    "columbiaville_vf": "8086:1889",
+    "fastlinq_ql45000": "1077:1656",
+    "fastlinq_ql45000_vf": "1077:1664",
+    "fastlinq_ql41000": "1077:8070",
+    "fastlinq_ql41000_vf": "1077:8090",
+    "carlsville": "8086:15ff",
+    "hi1822": "19e5:1822",
+    "foxville": "8086:15f2",
+    "brcm_57414": "14e4:16d7",
+    "brcm_P2100G": "14e4:1750",
+}
+
+DRIVERS = {
+    "kawela": "igb",
+    "kawela_2": "igb",
+    "kawela_4": "igb",
+    "bartonhills": "igb",
+    "powerville": "igb",
+    "powerville_vf": "igbvf",
+    "ophir": "igb",
+    "niantic": "ixgbe",
+    "niantic_vf": "ixgbevf",
+    "ironpond": "ixgbe",
+    "twinpond": "ixgbe",
+    "twinpond_vf": "ixgbevf",
+    "twinville": "ixgbe",
+    "sageville": "ixgbe",
+    "sageville_vf": "ixgbevf",
+    "sagepond": "ixgbe",
+    "sagepond_vf": "ixgbevf",
+    "magnolia_park": "ixgbe",
+    "hartwell": "igb",
+    "82545EM": "igb",
+    "82540EM": "igb",
+    "springville": "igb",
+    "springfountain": "ixgbe",
+    "virtio": "virtio-pci",
+    "avoton": "igb",
+    "avoton2c5": "igb",
+    "I217V": "igb",
+    "I217LM": "igb",
+    "I218V": "igb",
+    "I218LM": "igb",
+    "fortville_eagle": "i40e",
+    "fortville_spirit": "i40e",
+    "fortville_spirit_single": "i40e",
+    "fortpark": "i40e",
+    "fortpark_1g": "i40e",
+    "fortpark_TLV": "i40e",
+    "fortpark_BASE-T": "i40e",
+    "fortpark_TLV_vf": "iavf",
+    "fvl10g_vf": "iavf",
+    "ConnectX3_MT4103": "mlx4_core",
+    "ConnectX4_MT4115": "mlx5_core",
+    "ConnectX4_LX_MT4117": "mlx5_core",
+    "ConnectX5_MT4119": "mlx5_core",
+    "ConnectX5_MT4121": "mlx5_core",
+    "fortville_25g": "i40e",
+    "cavium_a034": "thunder-nicvf",
+    "cavium_0011": "thunder-nicvf",
+    "fortvile_bdw_de": "ixgbe",
+    "cavium_a063": "octeontx2-nicpf",
+    "cavium_a064": "octeontx2-nicvf",
+    "columbiaville_100g": "ice",
+    "columbiaville_25g": "ice",
+    "columbiaville_25gx2": "ice",
+    "columbiaville_vf": "iavf",
+    "fastlinq_ql45000": "qede",
+    "fastlinq_ql41000": "qede",
+    "fastlinq_ql45000_vf": "qede",
+    "fastlinq_ql41000_vf": "qede",
+    "carlsville": "i40e",
+    "hi1822": "hinic",
+    "foxville": "igc",
+    "brcm_57414": "bnxt_en",
+    "brcm_P2100G": "bnxt_en",
+}
+
+"""
+List used to translate scapy packets into Ixia TCL commands.
+"""
+SCAPY2IXIA = ["Ether", "Dot1Q", "IP", "IPv6", "TCP", "UDP", "SCTP"]
+
+USERNAME = "root"
+
+# A user used to test functionality for a non-root user
+UNPRIVILEGED_USERNAME = "dtsunprivilegedtester"
+
+"""
+Helpful header sizes.
+"""
+HEADER_SIZE = {
+    "eth": 18,
+    "ip": 20,
+    "ipv6": 40,
+    "udp": 8,
+    "tcp": 20,
+    "vxlan": 8,
+}
+"""
+dpdk send protocol packet size.
+"""
+PROTOCOL_PACKET_SIZE = {
+    "lldp": [110, 100],
+}
+
+"""
+Default session timeout.
+"""
+TIMEOUT = 15
+
+
+"""
+Global macro for dts.
+"""
+PKTGEN = "pktgen"
+PKTGEN_DPDK = "dpdk"
+PKTGEN_TREX = "trex"
+PKTGEN_IXIA = "ixia"
+PKTGEN_IXIA_NETWORK = "ixia_network"
+PKTGEN_GRP = frozenset([PKTGEN_DPDK, PKTGEN_TREX, PKTGEN_IXIA, PKTGEN_IXIA_NETWORK])
+"""
+The log name seperater.
+"""
+LOG_NAME_SEP = "."
+
+"""
+Section name for suite level configuration
+"""
+SUITE_SECTION_NAME = "suite"
+
+"""
+DTS global environment variable
+"""
+DTS_ENV_PAT = r"DTS_*"
+PERF_SETTING = "DTS_PERF_ONLY"
+FUNC_SETTING = "DTS_FUNC_ONLY"
+HOST_DRIVER_SETTING = "DTS_HOST_DRIVER"
+HOST_DRIVER_MODE_SETTING = "DTS_HOST_DRIVER_MODE"
+HOST_NIC_SETTING = "DTS_HOST_NIC"
+HOST_SHARED_LIB_SETTING = "DTS_HOST_SHARED_LIB"
+HOST_SHARED_LIB_PATH = "DTS_HOST_SHARED_LIB_PATH"
+DEBUG_SETTING = "DTS_DEBUG_ENABLE"
+DEBUG_CASE_SETTING = "DTS_DEBUGCASE_ENABLE"
+DPDK_RXMODE_SETTING = "DTS_DPDK_RXMODE"
+DTS_ERROR_ENV = "DTS_RUNNING_ERROR"
+DTS_CFG_FOLDER = "DTS_CFG_FOLDER"
+DTS_PARALLEL_SETTING = "DTS_PARALLEL_ENABLE"
+UPDATE_EXPECTED = "DTS_UPDATE_EXPECTED_ENABLE"
+
+
+"""
+DTS global error table
+"""
+DTS_ERR_TBL = {
+    "GENERIC_ERR": 1,
+    "DPDK_BUILD_ERR": 2,
+    "DUT_SETUP_ERR": 3,
+    "TESTER_SETUP_ERR": 4,
+    "SUITE_SETUP_ERR": 5,
+    "SUITE_EXECUTE_ERR": 6,
+    "PARALLEL_EXECUTE_ERR": 7,
+}
+
+
+def get_nic_name(type):
+    """
+    strip nic code name by nic type
+    """
+    for name, nic_type in list(NICS.items()):
+        if nic_type == type:
+            return name
+    return "Unknown"
+
+
+def get_nic_driver(pci_id):
+    """
+    Return linux driver for specified pci device
+    """
+    try:
+        driver = DRIVERS[{NICS[key]: key for key in NICS}[pci_id]]
+    except Exception as e:
+        driver = None
+    return driver
+
+
+def get_netdev(crb, pci):
+    for port in crb.ports_info:
+        if pci == port["pci"]:
+            return port["port"]
+        if "vfs_port" in list(port.keys()):
+            for vf in port["vfs_port"]:
+                if pci == vf.pci:
+                    return vf
+
+    return None
+
+
+def get_host_ip(address):
+    ip_reg = r"\d{1,3}.\d{1,3}.\d{1,3}.\d{1,3}"
+    m = re.match(ip_reg, address)
+    if m:
+        return address
+    else:
+        try:
+            result = socket.gethostbyaddr(address)
+            return result[2][0]
+        except:
+            print("couldn't look up %s" % address)
+            return ""
+
+
+def save_global_setting(key, value):
+    """
+    Save DTS global setting
+    """
+    if re.match(DTS_ENV_PAT, key):
+        env_key = key
+    else:
+        env_key = "DTS_" + key
+
+    os.environ[env_key] = value
+
+
+def load_global_setting(key):
+    """
+    Load DTS global setting
+    """
+    if re.match(DTS_ENV_PAT, key):
+        env_key = key
+    else:
+        env_key = "DTS_" + key
+
+    if env_key in list(os.environ.keys()):
+        return os.environ[env_key]
+    else:
+        return ""
+
+
+def report_error(error):
+    """
+    Report error when error occurred
+    """
+    if error in list(DTS_ERR_TBL.keys()):
+        os.environ[DTS_ERROR_ENV] = error
+    else:
+        os.environ[DTS_ERROR_ENV] = "GENERIC_ERR"
+
+
+def exit_error():
+    """
+    Set system exit value when error occurred
+    """
+    if DTS_ERROR_ENV in list(os.environ.keys()):
+        ret_val = DTS_ERR_TBL[os.environ[DTS_ERROR_ENV]]
+        sys.exit(ret_val)
+    else:
+        sys.exit(0)
+
+
+def accepted_nic(pci_id):
+    """
+    Return True if the pci_id is a known NIC card in the settings file and if
+    it is selected in the execution file, otherwise it returns False.
+    """
+    nic = load_global_setting(HOST_NIC_SETTING)
+    if pci_id not in list(NICS.values()):
+        return False
+
+    if nic == "any":
+        return True
+
+    else:
+        if pci_id == NICS[nic]:
+            return True
+
+    return False
+
+
+"""
+The root path of framework configs.
+"""
+dts_cfg_folder = load_global_setting(DTS_CFG_FOLDER)
+if dts_cfg_folder != "":
+    CONFIG_ROOT_PATH = dts_cfg_folder
+else:
+    CONFIG_ROOT_PATH = "./conf"
-- 
2.20.1


^ permalink raw reply	[flat|nested] 14+ messages in thread

end of thread, other threads:[~2022-04-06 15:09 UTC | newest]

Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-04-06 15:07 [RFC PATCH v1 00/13] merge DTS conf files to DPDK Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 01/13] dts: merge DTS conf/crbs.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 02/13] dts: merge DTS conf/pktgen.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 03/13] dts: merge DTS conf/ports.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 04/13] dts: merge DTS conf/suite_sample.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 05/13] dts: merge DTS conf/test_case_checklist.json " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 06/13] dts: merge DTS conf/test_case_supportlist.json " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 07/13] dts: merge DTS execution.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 08/13] dts: merge DTS executions/execution.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 09/13] dts: merge DTS executions/execution_FVL.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 10/13] dts: merge DTS executions/execution_fm10k.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 11/13] dts: merge DTS executions/execution_rxmode.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 12/13] dts: merge DTS executions/execution_smoke.cfg " Juraj Linkeš
2022-04-06 15:07 ` [RFC PATCH v1 13/13] dts: merge DTS framework/settings.py " Juraj Linkeš

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).