From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga06.intel.com (mga06.intel.com [134.134.136.31]) by dpdk.org (Postfix) with ESMTP id DCE1D326D for ; Wed, 27 Mar 2019 10:04:57 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga006.jf.intel.com ([10.7.209.51]) by orsmga104.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 27 Mar 2019 02:04:56 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.60,276,1549958400"; d="scan'208";a="130554221" Received: from yexl-server.sh.intel.com ([10.67.110.206]) by orsmga006.jf.intel.com with ESMTP; 27 Mar 2019 02:04:53 -0700 From: Xiaolong Ye To: dev@dpdk.org, David Marchand , Andrew Rybchenko Cc: Qi Zhang , Karlsson Magnus , Topel Bjorn , Maxime Coquelin , Stephen Hemminger , Ferruh Yigit , Luca Boccassi , Bruce Richardson , Ananyev Konstantin , Xiaolong Ye Date: Wed, 27 Mar 2019 17:00:22 +0800 Message-Id: <20190327090027.72170-1-xiaolong.ye@intel.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20190301080947.91086-1-xiaolong.ye@intel.com> References: <20190301080947.91086-1-xiaolong.ye@intel.com> Subject: [dpdk-dev] [PATCH v7 0/5] Introduce AF_XDP PMD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Mar 2019 09:04:58 -0000 Overview ======== This patchset adds a new PMD driver for AF_XDP which is a proposed faster version of AF_PACKET interface in Linux, see below links [1] [2] for details of AF_XDP introduction: AF_XDP roadmap ============== - AF_XDP is included in upstream kernel since 4.18, and AF_XDP support in libbpf has been merged in v5.1-rc1. - Now i40e and ixgbe drivers have supported zero copy mode. Change logs =========== v7: - mention mtu limitation in af_xdp.rst - fix the vdev name in af_xdp.rst V6: - remove the newline in AF_XDP_LOG definition to avoid double new lines issue. - rename MEMPOOL_F_PAGE_ALIGN to MEMPOOL_CHUNK_F_PAGE_ALIGN. V5: - disable AF_XDP pmd by default due to it requires kernel more recent than minimum kernel version supported by DPDK - address other review comments of Maxime V4: - change vdev name to net_af_xdp - adopt dynamic log type for all logging - Fix other style issues raised by Stephen V3: - Fix all style issues pointed by Stephen, Mattias, David. - Drop the testpmd change as we'll adopt Jerin's suggestion to add a new mempool driver to handle the application use of AF_XDP's zero copy feature. V2: - Fix a NULL pointer reference crash issue - Fix txonly stop sending traffic in zc mode - Refactor rte_mbuf.c to avoid ABI breakage. - Fix multiple style issues pointed by Ferruh, David, Stephen, Luca. changes vs RFC sent by Qi last Aug: - Re-work base on AF_XDP's interface changes since the new libbpf has provided higher-level APIs that hide many of the details of the AP_XDP uapi. After the rework, it helps to reduce 300+ lines of code. - multi-queues is not supported due to current libbpf doesn't support multi-sockets on a single umem. - No extra steps to load xdp program manually, since the current behavior of libbpf would load a default xdp program when user calls xsk_socket__create. userspace application only needs to handle the cleanup. How to try ========== 1. take the kernel >= v5.1-rc1, build kernel and replace your host kernel with it. make sure you turn on XDP sockets when compiling Networking support --> Networking options --> [ * ] XDP sockets 2. build libbpf in tools/lib/bpf, and copy the libbpf.a and libbpf.so to /usr/lib64 cd tools/lib/bpf make 3. ethtool -L enp59s0f0 combined 1 4. extra step to build dpdk explicitly enable AF_XDP pmd by adding below line to config/common_linux CONFIG_RTE_LIBRTE_PMD_AF_XDP=y 5. start testpmd ./build/app/testpmd -c 0xc -n 4 --vdev net_af_xdp,iface=enp59s0f0,queue=0 -- -i --rxq=1 --txq=1 in this case, default xdp program will be loaded and linked to queue 0 of enp59s0f0, network traffics travel to queue 0 will be redirected to af_xdp socket. Xiaolong Ye (5): net/af_xdp: introduce AF XDP PMD driver lib/mbuf: introduce helper to create mempool with flags lib/mempool: allow page size aligned mempool net/af_xdp: use mbuf mempool for buffer management net/af_xdp: enable zero copy MAINTAINERS | 6 + config/common_base | 5 + doc/guides/nics/af_xdp.rst | 45 + doc/guides/nics/features/af_xdp.ini | 11 + doc/guides/nics/index.rst | 1 + doc/guides/rel_notes/release_19_05.rst | 7 + drivers/net/Makefile | 1 + drivers/net/af_xdp/Makefile | 32 + drivers/net/af_xdp/meson.build | 21 + drivers/net/af_xdp/rte_eth_af_xdp.c | 1020 +++++++++++++++++ drivers/net/af_xdp/rte_pmd_af_xdp_version.map | 3 + drivers/net/meson.build | 1 + lib/librte_mbuf/rte_mbuf.c | 29 +- lib/librte_mbuf/rte_mbuf.h | 45 + lib/librte_mbuf/rte_mbuf_version.map | 1 + lib/librte_mempool/rte_mempool.c | 3 + lib/librte_mempool/rte_mempool.h | 1 + mk/rte.app.mk | 1 + 18 files changed, 1228 insertions(+), 5 deletions(-) create mode 100644 doc/guides/nics/af_xdp.rst create mode 100644 doc/guides/nics/features/af_xdp.ini create mode 100644 drivers/net/af_xdp/Makefile create mode 100644 drivers/net/af_xdp/meson.build create mode 100644 drivers/net/af_xdp/rte_eth_af_xdp.c create mode 100644 drivers/net/af_xdp/rte_pmd_af_xdp_version.map -- 2.17.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 65FEEA05D3 for ; Wed, 27 Mar 2019 10:05:01 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 8B7494CC3; Wed, 27 Mar 2019 10:04:59 +0100 (CET) Received: from mga06.intel.com (mga06.intel.com [134.134.136.31]) by dpdk.org (Postfix) with ESMTP id DCE1D326D for ; Wed, 27 Mar 2019 10:04:57 +0100 (CET) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga006.jf.intel.com ([10.7.209.51]) by orsmga104.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 27 Mar 2019 02:04:56 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.60,276,1549958400"; d="scan'208";a="130554221" Received: from yexl-server.sh.intel.com ([10.67.110.206]) by orsmga006.jf.intel.com with ESMTP; 27 Mar 2019 02:04:53 -0700 From: Xiaolong Ye To: dev@dpdk.org, David Marchand , Andrew Rybchenko Cc: Qi Zhang , Karlsson Magnus , Topel Bjorn , Maxime Coquelin , Stephen Hemminger , Ferruh Yigit , Luca Boccassi , Bruce Richardson , Ananyev Konstantin , Xiaolong Ye Date: Wed, 27 Mar 2019 17:00:22 +0800 Message-Id: <20190327090027.72170-1-xiaolong.ye@intel.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20190301080947.91086-1-xiaolong.ye@intel.com> References: <20190301080947.91086-1-xiaolong.ye@intel.com> Subject: [dpdk-dev] [PATCH v7 0/5] Introduce AF_XDP PMD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Content-Type: text/plain; charset="UTF-8" Message-ID: <20190327090022.Kl8cewgSzQIU9px1AE71e5BoHKaoUGmRSaCMIhvkgNQ@z> Overview ======== This patchset adds a new PMD driver for AF_XDP which is a proposed faster version of AF_PACKET interface in Linux, see below links [1] [2] for details of AF_XDP introduction: AF_XDP roadmap ============== - AF_XDP is included in upstream kernel since 4.18, and AF_XDP support in libbpf has been merged in v5.1-rc1. - Now i40e and ixgbe drivers have supported zero copy mode. Change logs =========== v7: - mention mtu limitation in af_xdp.rst - fix the vdev name in af_xdp.rst V6: - remove the newline in AF_XDP_LOG definition to avoid double new lines issue. - rename MEMPOOL_F_PAGE_ALIGN to MEMPOOL_CHUNK_F_PAGE_ALIGN. V5: - disable AF_XDP pmd by default due to it requires kernel more recent than minimum kernel version supported by DPDK - address other review comments of Maxime V4: - change vdev name to net_af_xdp - adopt dynamic log type for all logging - Fix other style issues raised by Stephen V3: - Fix all style issues pointed by Stephen, Mattias, David. - Drop the testpmd change as we'll adopt Jerin's suggestion to add a new mempool driver to handle the application use of AF_XDP's zero copy feature. V2: - Fix a NULL pointer reference crash issue - Fix txonly stop sending traffic in zc mode - Refactor rte_mbuf.c to avoid ABI breakage. - Fix multiple style issues pointed by Ferruh, David, Stephen, Luca. changes vs RFC sent by Qi last Aug: - Re-work base on AF_XDP's interface changes since the new libbpf has provided higher-level APIs that hide many of the details of the AP_XDP uapi. After the rework, it helps to reduce 300+ lines of code. - multi-queues is not supported due to current libbpf doesn't support multi-sockets on a single umem. - No extra steps to load xdp program manually, since the current behavior of libbpf would load a default xdp program when user calls xsk_socket__create. userspace application only needs to handle the cleanup. How to try ========== 1. take the kernel >= v5.1-rc1, build kernel and replace your host kernel with it. make sure you turn on XDP sockets when compiling Networking support --> Networking options --> [ * ] XDP sockets 2. build libbpf in tools/lib/bpf, and copy the libbpf.a and libbpf.so to /usr/lib64 cd tools/lib/bpf make 3. ethtool -L enp59s0f0 combined 1 4. extra step to build dpdk explicitly enable AF_XDP pmd by adding below line to config/common_linux CONFIG_RTE_LIBRTE_PMD_AF_XDP=y 5. start testpmd ./build/app/testpmd -c 0xc -n 4 --vdev net_af_xdp,iface=enp59s0f0,queue=0 -- -i --rxq=1 --txq=1 in this case, default xdp program will be loaded and linked to queue 0 of enp59s0f0, network traffics travel to queue 0 will be redirected to af_xdp socket. Xiaolong Ye (5): net/af_xdp: introduce AF XDP PMD driver lib/mbuf: introduce helper to create mempool with flags lib/mempool: allow page size aligned mempool net/af_xdp: use mbuf mempool for buffer management net/af_xdp: enable zero copy MAINTAINERS | 6 + config/common_base | 5 + doc/guides/nics/af_xdp.rst | 45 + doc/guides/nics/features/af_xdp.ini | 11 + doc/guides/nics/index.rst | 1 + doc/guides/rel_notes/release_19_05.rst | 7 + drivers/net/Makefile | 1 + drivers/net/af_xdp/Makefile | 32 + drivers/net/af_xdp/meson.build | 21 + drivers/net/af_xdp/rte_eth_af_xdp.c | 1020 +++++++++++++++++ drivers/net/af_xdp/rte_pmd_af_xdp_version.map | 3 + drivers/net/meson.build | 1 + lib/librte_mbuf/rte_mbuf.c | 29 +- lib/librte_mbuf/rte_mbuf.h | 45 + lib/librte_mbuf/rte_mbuf_version.map | 1 + lib/librte_mempool/rte_mempool.c | 3 + lib/librte_mempool/rte_mempool.h | 1 + mk/rte.app.mk | 1 + 18 files changed, 1228 insertions(+), 5 deletions(-) create mode 100644 doc/guides/nics/af_xdp.rst create mode 100644 doc/guides/nics/features/af_xdp.ini create mode 100644 drivers/net/af_xdp/Makefile create mode 100644 drivers/net/af_xdp/meson.build create mode 100644 drivers/net/af_xdp/rte_eth_af_xdp.c create mode 100644 drivers/net/af_xdp/rte_pmd_af_xdp_version.map -- 2.17.1