From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 8D0E5A0551; Mon, 17 Feb 2020 08:46:38 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id E28A71BF7A; Mon, 17 Feb 2020 08:46:37 +0100 (CET) Received: from mga04.intel.com (mga04.intel.com [192.55.52.120]) by dpdk.org (Postfix) with ESMTP id 711DF1BF78 for ; Mon, 17 Feb 2020 08:46:34 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga104.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 16 Feb 2020 23:46:33 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.70,451,1574150400"; d="scan'208";a="348444835" Received: from unknown (HELO DPDK-zhaoyan-dev-34.sh.intel.com) ([10.67.118.34]) by fmsmga001.fm.intel.com with ESMTP; 16 Feb 2020 23:46:31 -0800 From: "Chen, Zhaoyan" To: dts@dpdk.org Cc: "Chen, Zhaoyan" , Chen@dpdk.org Date: Mon, 17 Feb 2020 15:41:19 +0800 Message-Id: <20200217074119.190619-1-zhaoyan.chen@intel.com> X-Mailer: git-send-email 2.22.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [dts] [PATCH V1] Add ABI stable test cases X-BeenThere: dts@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: test suite reviews and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dts-bounces@dpdk.org Sender: "dts" Define compiling steps and common test steps. Reuse exisiting test suites to cover ABI stable checking. Signed-off-by: Chen, Zhaoyan --- test_plans/ABI_stable_test.rst | 150 +++++++++++++++++++++++++++++++++ 1 file changed, 150 insertions(+) create mode 100644 test_plans/ABI_stable_test.rst diff --git a/test_plans/ABI_stable_test.rst b/test_plans/ABI_stable_test.rst new file mode 100644 index 0000000..bc8deb4 --- /dev/null +++ b/test_plans/ABI_stable_test.rst @@ -0,0 +1,150 @@ +.. Copyright (c) <2019-2020>, Intel Corporation + All rights reserved. + + Redistribution and use in source and binary forms, with or without + modification, are permitted provided that the following conditions + are met: + + - Redistributions of source code must retain the above copyright + notice, this list of conditions and the following disclaimer. + + - Redistributions in binary form must reproduce the above copyright + notice, this list of conditions and the following disclaimer in + the documentation and/or other materials provided with the + distribution. + + - Neither the name of Intel Corporation nor the names of its + contributors may be used to endorse or promote products derived + from this software without specific prior written permission. + + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS + FOR A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE + COPYRIGHT OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, + INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES + (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR + SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) + HOWEVER CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, + STRICT LIABILITY, OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) + ARISING IN ANY WAY OUT OF THE USE OF THIS SOFTWARE, EVEN IF ADVISED + OF THE POSSIBILITY OF SUCH DAMAGE. + +===================== +DPDK ABI Stable Tests +===================== + +Description +=========== + +This test suite includes both functional and performance test cases to +ensure that DPDK point releases (xx.02, xx.05, xx.08) are not only binary +compatible, but are also functionally and reasonably performance +compatibly with the previous vxx.11 release. + + +Compiling Steps +=============== + +Compile shared library/application from DPDK xx.11 release. +Change the option in config/common_base configuration file:: + + CONFIG_RTE_BUILD_SHARED_LIB=y + +And then, compile the DPDK:: + + make install -j T=x86_64-native-linuxapp-gcc + +Keep this DPDK folder as , e.g. . + +Compile shared library from DPDK point releasees (xx.02, xx.05, xx.08). +Command lines are same to above. +Keep this DPDK folder as . e.g. + +Setup library path in environment:: + + export LD_LIBRARY_PATH=$LD_LIBRARY_PATH, + + +Common Test Steps +================= + +Comparing to test static dpdk application, ABI stable checking use +dynamic dpdk application, and shared library. Launching dynamic dpdk +application steps are below, + +Go into directory, launch application with specific library:: + + testpmd -c 0xf -n 4 -d -- -i + +Expect the application could launch successfully. + +Then, execute test steps with the application. + +Reuse our existing test suites for ABI stable checking. + + +Execute Test Suites +=================== + + +===============================+========================+ + | Test Suites | Type | + +===============================+========================+ + | unit_tests_cmdline | functional | + +-------------------------------+------------------------+ + | unit_tests_crc | functional | + +-------------------------------+------------------------+ + | unit_tests_dump | functional | + +-------------------------------+------------------------+ + | unit_tests_eal | functional | + +-------------------------------+------------------------+ + | unit_tests_kni | functional | + +-------------------------------+------------------------+ + | unit_tests_loopback | functional | + +-------------------------------+------------------------+ + | unit_tests_lpm | functional | + +-------------------------------+------------------------+ + | unit_tests_mbuf | functional | + +-------------------------------+------------------------+ + | unit_tests_mempool | functional | + +-------------------------------+------------------------+ + | unit_tests_pmd_perf | functional | + +-------------------------------+------------------------+ + | unit_tests_power | functional | + +-------------------------------+------------------------+ + | unit_tests_qos | functional | + +-------------------------------+------------------------+ + | unit_tests_ringpmd | functional | + +-------------------------------+------------------------+ + | unit_tests_ring | functional | + +-------------------------------+------------------------+ + | unit_tests_timer | functional | + +-------------------------------+------------------------+ + | vhost_1024_ethports | functional | + +-------------------------------+------------------------+ + | vhost_dequeue_zero_copy | functional | + +-------------------------------+------------------------+ + | vhost_enqueue_interrupt | functional | + +-------------------------------+------------------------+ + | vhost_event_idx_interrupt | functional | + +-------------------------------+------------------------+ + | vhost_multi_queue_qemu | functional | + +-------------------------------+------------------------+ + | vhost_pmd_xstats | functional | + +-------------------------------+------------------------+ + | vhost_virtio_user_interrupt | functional | + +-------------------------------+------------------------+ + | vhost_user_live_migration | functional | + +-------------------------------+------------------------+ + | flow_classify | functional | + +-------------------------------+------------------------+ + | flow_classify_softnic | functional | + +-------------------------------+------------------------+ + | vhost_virtio_pmd_interrupt | functional | + +-------------------------------+------------------------+ + | l2fwd | performance | + +-------------------------------+------------------------+ + | nic_single_core_perf | performance | + +-------------------------------+------------------------+ + | l3fwd | performance | + +-------------------------------+------------------------+ -- 2.22.0