From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by dpdk.org (Postfix) with ESMTP id C5DF3B39B for ; Fri, 11 Jul 2014 17:06:01 +0200 (CEST) Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga101.fm.intel.com with ESMTP; 11 Jul 2014 08:06:29 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.01,644,1400050800"; d="scan'208";a="568528756" Received: from irsmsx102.ger.corp.intel.com ([163.33.3.155]) by fmsmga002.fm.intel.com with ESMTP; 11 Jul 2014 08:06:27 -0700 Received: from irsmsx110.ger.corp.intel.com (163.33.3.25) by IRSMSX102.ger.corp.intel.com (163.33.3.155) with Microsoft SMTP Server (TLS) id 14.3.123.3; Fri, 11 Jul 2014 16:06:26 +0100 Received: from irsmsx103.ger.corp.intel.com ([169.254.3.62]) by IRSMSX110.ger.corp.intel.com ([163.33.3.25]) with mapi id 14.03.0123.003; Fri, 11 Jul 2014 16:06:26 +0100 From: "Richardson, Bruce" To: "John W. Linville" , Stephen Hemminger Thread-Topic: [dpdk-dev] [PATCH] librte_pmd_packet: add PMD for AF_PACKET-based virtual devices Thread-Index: AQHPnQnUuwBrDeTxbk6r8888BAhUc5ua47cAgAAU6nA= Date: Fri, 11 Jul 2014 15:06:25 +0000 Message-ID: <59AF69C657FD0841A61C55336867B5B0343ACD8B@IRSMSX103.ger.corp.intel.com> References: <1405024369-30058-1-git-send-email-linville@tuxdriver.com> <20140711061147.06c12136@samsung-9> <20140711144912.GA25478@tuxdriver.com> In-Reply-To: <20140711144912.GA25478@tuxdriver.com> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [163.33.239.180] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] [PATCH] librte_pmd_packet: add PMD for AF_PACKET-based virtual devices X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Jul 2014 15:06:02 -0000 > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of John W. Linville > Sent: Friday, July 11, 2014 7:49 AM > To: Stephen Hemminger > Cc: dev@dpdk.org > Subject: Re: [dpdk-dev] [PATCH] librte_pmd_packet: add PMD for AF_PACKET- > based virtual devices >=20 > On Fri, Jul 11, 2014 at 06:11:47AM -0700, Stephen Hemminger wrote: > > On Thu, 10 Jul 2014 16:32:49 -0400 > > "John W. Linville" wrote: > > > > > This is a Linux-specific virtual PMD driver backed by an AF_PACKET > > > socket. This implementation uses mmap'ed ring buffers to limit copyi= ng > > > and user/kernel transitions. The PACKET_FANOUT_HASH behavior of > > > AF_PACKET is used for frame reception. In the current implementation= , > > > Tx and Rx queues are always paired, and therefore are always equal > > > in number -- changing this would be a Simple Matter Of Programming. > > > > > > Interfaces of this type are created with a command line option like > > > "--vdev=3Deth_packet0,iface=3D...". There are a number of options av= ailabe > > > as arguments: > > > > > > - Interface is chosen by "iface" (required) > > > - Number of queue pairs set by "qpairs" (optional, default: 16) > > > - AF_PACKET MMAP block size set by "blocksz" (optional, default: 409= 6) > > > - AF_PACKET MMAP frame size set by "framesz" (optional, default: 204= 8) > > > - AF_PACKET MMAP frame count set by "framecnt" (optional, default: 5= 12) > > > > > > Signed-off-by: John W. Linville > > > --- > > > This PMD is intended to provide a means for using DPDK on a broad > > > range of hardware without hardware-specific PMDs and (hopefully) > > > with better performance than what PCAP offers in Linux. This might > > > be useful as a development platform for DPDK applications when > > > DPDK-supported hardware is expensive or unavailable. > > > > > > config/common_bsdapp | 5 + > > > config/common_linuxapp | 5 + > > > lib/Makefile | 1 + > > > lib/librte_eal/linuxapp/eal/Makefile | 1 + > > > lib/librte_pmd_packet/Makefile | 60 +++ > > > lib/librte_pmd_packet/rte_eth_packet.c | 826 > +++++++++++++++++++++++++++++++++ > > > lib/librte_pmd_packet/rte_eth_packet.h | 55 +++ > > > mk/rte.app.mk | 4 + > > > 8 files changed, 957 insertions(+) > > > create mode 100644 lib/librte_pmd_packet/Makefile > > > create mode 100644 lib/librte_pmd_packet/rte_eth_packet.c > > > create mode 100644 lib/librte_pmd_packet/rte_eth_packet.h > > > > > > diff --git a/config/common_bsdapp b/config/common_bsdapp > > > index 943dce8f1ede..c317f031278e 100644 > > > --- a/config/common_bsdapp > > > +++ b/config/common_bsdapp > > > @@ -226,6 +226,11 @@ CONFIG_RTE_LIBRTE_PMD_PCAP=3Dy > > > CONFIG_RTE_LIBRTE_PMD_BOND=3Dy > > > > > > # > > > +# Compile software PMD backed by AF_PACKET sockets (Linux only) > > > +# > > > +CONFIG_RTE_LIBRTE_PMD_PACKET=3Dn > > > + > > > +# > > > # Do prefetch of packet data within PMD driver receive function > > > # > > > CONFIG_RTE_PMD_PACKET_PREFETCH=3Dy > > > diff --git a/config/common_linuxapp b/config/common_linuxapp > > > index 7bf5d80d4e26..f9e7bc3015ec 100644 > > > --- a/config/common_linuxapp > > > +++ b/config/common_linuxapp > > > @@ -249,6 +249,11 @@ CONFIG_RTE_LIBRTE_PMD_PCAP=3Dn > > > CONFIG_RTE_LIBRTE_PMD_BOND=3Dy > > > > > > # > > > +# Compile software PMD backed by AF_PACKET sockets (Linux only) > > > +# > > > +CONFIG_RTE_LIBRTE_PMD_PACKET=3Dy > > > + > > > +# > > > # Compile Xen PMD > > > # > > > CONFIG_RTE_LIBRTE_PMD_XENVIRT=3Dn > > > diff --git a/lib/Makefile b/lib/Makefile > > > index 10c5bb3045bc..930fadf29898 100644 > > > --- a/lib/Makefile > > > +++ b/lib/Makefile > > > @@ -47,6 +47,7 @@ DIRS-$(CONFIG_RTE_LIBRTE_I40E_PMD) +=3D > librte_pmd_i40e > > > DIRS-$(CONFIG_RTE_LIBRTE_PMD_BOND) +=3D librte_pmd_bond > > > DIRS-$(CONFIG_RTE_LIBRTE_PMD_RING) +=3D librte_pmd_ring > > > DIRS-$(CONFIG_RTE_LIBRTE_PMD_PCAP) +=3D librte_pmd_pcap > > > +DIRS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D librte_pmd_packet > > > DIRS-$(CONFIG_RTE_LIBRTE_VIRTIO_PMD) +=3D librte_pmd_virtio > > > DIRS-$(CONFIG_RTE_LIBRTE_VMXNET3_PMD) +=3D librte_pmd_vmxnet3 > > > DIRS-$(CONFIG_RTE_LIBRTE_PMD_XENVIRT) +=3D librte_pmd_xenvirt > > > diff --git a/lib/librte_eal/linuxapp/eal/Makefile > b/lib/librte_eal/linuxapp/eal/Makefile > > > index 756d6b0c9301..feed24a63272 100644 > > > --- a/lib/librte_eal/linuxapp/eal/Makefile > > > +++ b/lib/librte_eal/linuxapp/eal/Makefile > > > @@ -44,6 +44,7 @@ CFLAGS +=3D -I$(RTE_SDK)/lib/librte_ether > > > CFLAGS +=3D -I$(RTE_SDK)/lib/librte_ivshmem > > > CFLAGS +=3D -I$(RTE_SDK)/lib/librte_pmd_ring > > > CFLAGS +=3D -I$(RTE_SDK)/lib/librte_pmd_pcap > > > +CFLAGS +=3D -I$(RTE_SDK)/lib/librte_pmd_packet > > > CFLAGS +=3D -I$(RTE_SDK)/lib/librte_pmd_xenvirt > > > CFLAGS +=3D $(WERROR_FLAGS) -O3 > > > > > > diff --git a/lib/librte_pmd_packet/Makefile > b/lib/librte_pmd_packet/Makefile > > > new file mode 100644 > > > index 000000000000..e1266fb992cd > > > --- /dev/null > > > +++ b/lib/librte_pmd_packet/Makefile > > > @@ -0,0 +1,60 @@ > > > +# BSD LICENSE > > > +# > > > +# Copyright(c) 2014 John W. Linville > > > +# Copyright(c) 2010-2014 Intel Corporation. All rights reserved. > > > +# Copyright(c) 2014 6WIND S.A. > > > +# All rights reserved. > > > +# > > > +# Redistribution and use in source and binary forms, with or witho= ut > > > +# modification, are permitted provided that the following conditio= ns > > > +# are met: > > > +# > > > +# * Redistributions of source code must retain the above copyrig= ht > > > +# notice, this list of conditions and the following disclaimer= . > > > +# * Redistributions in binary form must reproduce the above copy= right > > > +# notice, this list of conditions and the following disclaimer= in > > > +# the documentation and/or other materials provided with the > > > +# distribution. > > > +# * Neither the name of Intel Corporation nor the names of its > > > +# contributors may be used to endorse or promote products deri= ved > > > +# from this software without specific prior written permission= . > > > +# > > > +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > > > +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > > > +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > > > +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > > > +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > > > +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT > NOT > > > +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; > LOSS OF USE, > > > +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > > > +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR > TORT > > > +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT > OF THE USE > > > +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > > > + > > > +include $(RTE_SDK)/mk/rte.vars.mk > > > + > > > +# > > > +# library name > > > +# > > > +LIB =3D librte_pmd_packet.a > > > + > > > +CFLAGS +=3D -O3 > > > +CFLAGS +=3D $(WERROR_FLAGS) > > > + > > > +# > > > +# all source are stored in SRCS-y > > > +# > > > +SRCS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D rte_eth_packet.c > > > + > > > +# > > > +# Export include files > > > +# > > > +SYMLINK-y-include +=3D rte_eth_packet.h > > > + > > > +# this lib depends upon: > > > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D lib/librte_mbuf > > > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D lib/librte_ether > > > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D lib/librte_malloc > > > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_PACKET) +=3D lib/librte_kvargs > > > + > > > +include $(RTE_SDK)/mk/rte.lib.mk > > > diff --git a/lib/librte_pmd_packet/rte_eth_packet.c > b/lib/librte_pmd_packet/rte_eth_packet.c > > > new file mode 100644 > > > index 000000000000..fceb6258aad6 > > > --- /dev/null > > > +++ b/lib/librte_pmd_packet/rte_eth_packet.c > > > @@ -0,0 +1,826 @@ > > > +/*- > > > + * BSD LICENSE > > > + * > > > + * Copyright(c) 2014 John W. Linville > > > + * > > > + * Originally based upon librte_pmd_pcap code: > > > + * > > > + * Copyright(c) 2010-2014 Intel Corporation. All rights reserved. > > > + * Copyright(c) 2014 6WIND S.A. > > > + * All rights reserved. > > > + * > > > + * Redistribution and use in source and binary forms, with or with= out > > > + * modification, are permitted provided that the following conditi= ons > > > + * are met: > > > + * > > > + * * Redistributions of source code must retain the above copyri= ght > > > + * notice, this list of conditions and the following disclaime= r. > > > + * * Redistributions in binary form must reproduce the above cop= yright > > > + * notice, this list of conditions and the following disclaime= r in > > > + * the documentation and/or other materials provided with the > > > + * distribution. > > > + * * Neither the name of Intel Corporation nor the names of its > > > + * contributors may be used to endorse or promote products der= ived > > > + * from this software without specific prior written permissio= n. > > > + * > > > + * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > > > + * "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > > > + * LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > > > + * A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > > > + * OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > > > + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, > BUT NOT > > > + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; > LOSS OF USE, > > > + * DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > > > + * THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR > TORT > > > + * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT > OF THE USE > > > + * OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > > > + */ > > > + > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > + > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > +#include > > > + > > > +#include "rte_eth_packet.h" > > > + > > > +#define ETH_PACKET_IFACE_ARG "iface" > > > +#define ETH_PACKET_NUM_Q_ARG "qpairs" > > > +#define ETH_PACKET_BLOCKSIZE_ARG "blocksz" > > > +#define ETH_PACKET_FRAMESIZE_ARG "framesz" > > > +#define ETH_PACKET_FRAMECOUNT_ARG "framecnt" > > > + > > > +#define DFLT_BLOCK_SIZE (1 << 12) > > > +#define DFLT_FRAME_SIZE (1 << 11) > > > +#define DFLT_FRAME_COUNT (1 << 9) > > > + > > > +struct pkt_rx_queue { > > > + int sockfd; > > > + > > > + struct iovec *rd; > > > + uint8_t *map; > > > + unsigned int framecount; > > > + unsigned int framenum; > > > + > > > + struct rte_mempool *mb_pool; > > > + > > > + volatile unsigned long rx_pkts; > > > + volatile unsigned long err_pkts; > > > > Use of volatile will generate slow code, don't think > > it is necessary, especially when only one CPU can use a queue > > at a time. >=20 > That is a good point, worth checking out. FWIW, those lines are > boilerplate originally copied from the pcap PMD. :-) >=20 Yes, I agree it's worth checking out if there is a performance impact, but = if we assume that the stats for RX/TX are possibly going to be read by anot= her core, they really should be volatile for correctness.