From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 810B0A04E0; Fri, 29 Nov 2019 09:25:41 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 67E243256; Fri, 29 Nov 2019 09:25:33 +0100 (CET) Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 739A791 for ; Fri, 29 Nov 2019 09:25:30 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 29 Nov 2019 00:23:22 -0800 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.69,256,1571727600"; d="scan'208";a="240967703" Received: from yexl-server.sh.intel.com ([10.67.117.17]) by fmsmga002.fm.intel.com with ESMTP; 29 Nov 2019 00:23:21 -0800 From: Xiaolong Ye To: John McNamara , Marko Kovacevic Cc: dev@dpdk.org, haiyue.wang@intel.com, Xiaolong Ye Date: Fri, 29 Nov 2019 16:19:11 +0800 Message-Id: <20191129081911.92988-1-xiaolong.ye@intel.com> X-Mailer: git-send-email 2.17.1 Subject: [dpdk-dev] [PATCH] doc: introduce openwrt how-to guide X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" This doc describes how to enable DPDK on openwrt in both virtual and physical x86 environment. Signed-off-by: Xiaolong Ye --- doc/guides/howto/index.rst | 1 + doc/guides/howto/openwrt.rst | 180 +++++++++++++++++++++++++++++++++++ 2 files changed, 181 insertions(+) create mode 100644 doc/guides/howto/openwrt.rst diff --git a/doc/guides/howto/index.rst b/doc/guides/howto/index.rst index a4c131652..5a97ea508 100644 --- a/doc/guides/howto/index.rst +++ b/doc/guides/howto/index.rst @@ -19,3 +19,4 @@ HowTo Guides packet_capture_framework telemetry debug_troubleshoot + openwrt diff --git a/doc/guides/howto/openwrt.rst b/doc/guides/howto/openwrt.rst new file mode 100644 index 000000000..62be3a031 --- /dev/null +++ b/doc/guides/howto/openwrt.rst @@ -0,0 +1,180 @@ +.. SPDX-License-Identifier: BSD-3-Clause + Copyright(c) 2019 Intel Corporation. + +Enable DPDK on openwrt +====================== + +This document describes how to enable Data Plane Development Kit(DPDK) on +Openwrt in both virtual and physical x86 environment. + +Introduction +------------ + +The OpenWrt project is a Linux operating system targeting embedded devices. +Instead of trying to create a single, static firmware, OpenWrt provides a fully +writable filesystem with package management. This frees user from the +application selection and configuration provided by the vendor and allows user +to customize the device through the use of packages to suit any application. For +developers, OpenWrt is the framework to build and application without having to +build a complete firmware around it, for users this means the ability for full +customization, to use the device in ways never envisioned. + +Pre-requisites +~~~~~~~~~~~~~~ + +You need gcc, binutils, bzip2, flex, python3.5+, perl, make, find, grep, diff, +unzip, gawk, getopt, subversion, libz-dev and libc headers installed. + +Build OpenWrt +------------- + +You can obtain OpenWrt image through https://downloads.openwrt.org/releases. To +fully customize your own OpenWrt, it is highly recommended to build it through +the source code, you can clone the OpenWrt source code by: + +.. code-block:: console + + git clone https://git.openwrt.org/openwrt/openwrt.git + +OpenWrt configuration +~~~~~~~~~~~~~~~~~~~~~ + +* Select ``x86`` in ``Target System`` +* Select ``x86_64`` in ``Subtarget`` +* Select ``Build the OpenWrt SDK`` for cross-compilation environment +* Select ``Use glibc`` in ``Advanced configuration options (for developers)`` + -> ``ToolChain Options`` + -> ``C Library implementation`` + +Kernel configuration +~~~~~~~~~~~~~~~~~~~~ + +Below configurations need to be enabled: + +* CONFIG_UIO=y +* CONFIG_HUGETLBFS=y +* CONFIG_HUGETLB_PAGE=y +* CONFIG_PAGE_MONITOR=y + +Build steps +~~~~~~~~~~~ + +1. Run ``./scripts/feeds update -a`` to obtain all the latest package definitions +defined in feeds.conf / feeds.conf.default + +2. Run ``./scripts/feeds install -a`` to install symlinks for all obtained +packages into package/feeds/ + +3. Run ``make menuconfig`` to select preferred configuration mentioned above for +the toolchain, target system & firmware packages. + +3. Run ``make kernel_menuconfig`` to select preferred kernel configurations. + +4. Run ``make`` to build your firmware. This will download all sources, build +the cross-compile toolchain and then cross-compile the Linux kernel & all +chosen applications for your target system. + +After build is done, you can find the images and sdk in ``/bin/targets/x86/64-glibc/``. + +DPDK Cross Compilation for OpenWrt +---------------------------------- + +Pre-requisites +~~~~~~~~~~~~~~ + +NUMA is required to run dpdk in x86. + +.. note:: + + For compiling the NUMA lib, run libtool --version to ensure the libtool version >= 2.2, + otherwise the compilation will fail with errors. + +.. code-block:: console + + git clone https://github.com/numactl/numactl.git + cd numactl + git checkout v2.0.13 -b v2.0.13 + ./autogen.sh + autoconf -i + export PATH=/glibc/openwrt-sdk-x86-64_gcc-8.3.0_glibc.Linux-x86_64/staging_dir/toolchain-x86_64_gcc-8.3.0_glibc/bin/:$PATH + ./configure CC=x86_64-openwrt-linux-gnu-gcc --prefix= + make install + +The numa header files and lib file is generated in the include and lib folder respectively under . + +Build DPDK +~~~~~~~~~~ + +.. code-block:: console + + export STAGING_DIR=/glibc/openwrt-sdk-x86-64_gcc-8.3.0_glibc.Linux-x86_64/staging_dir + export RTE_SDK=`pwd` + export RTE_KERNELDIR=/build_dir/target-x86_64_glibc/linux-x86_64/linux-4.19.81/ + make config T=x86_64-native-linuxapp-gcc + make -j 100 CROSS=x86_64-openwrt-linux-gnu- + +Running DPDK application on OpenWrt +----------------------------------- + +Virtual machine +~~~~~~~~~~~~~~~ + +* Extract boot image + +.. code-block:: console + + gzip -d openwrt-x86-64-combined-ext4.img.gz + +* Launch Qemu + +.. code-block:: console + + qemu-system-x86_64 \ + -cpu host \ + -smp 8 \ + -enable-kvm \ + -M q35 \ + -m 2048M \ + -object memory-backend-file,id=mem,size=2048M,mem-path=/tmp/hugepages,share=on \ + -drive file=/openwrt-x86-64-combined-ext4.img,id=d0,if=none,bus=0,unit=0 \ + -device ide-hd,drive=d0,bus=ide.0 \ + -net nic,vlan=0 \ + -net nic,vlan=1 \ + -net user,vlan=1 \ + -display none \ + + +Physical machine +~~~~~~~~~~~~~~~~ + +Installation + +If you are using Windows PC, you can use some free and opensource raw disk image writer program such as +``Win32 Disk Imager`` and ``Etcher`` to write OpenWrt image (openwrt-x86-64-combined-ext4.img) to a USB +flash driver or USB SDcard with SDcard or a Sata hard drivre or SSD from your PC. + +If you are using Linux, you can use old dd tool to write OpenWrt image to the drive you want to write the +image on. + +.. code-block:: console + + dd if=openwrt-18.06.1-x86-64-combined-squashfs.img of=/dev/sdX + +Where sdX is name of the drive. (You can find it though ``fdisk -l``) + +Running DPDK +~~~~~~~~~~~~ + +* Setup dpdk environment + + * Scp built numa libraries (including soft link) to /usr/lib64 + * Setup hugepages + * insmod igb_uio.ko (scp the built igb_uio.ko first) + * Bind the NIC to igb_uio.ko + +* Launch testpmd + + * scp built testpmd to qemu + * ./testpmd -c 0xf -- -i + + More detailed info about how to run a DPDK application refer to ``Running DPDK Applications`` section of :ref:`the DPDK documentation `. -- 2.17.1