From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by dpdk.org (Postfix) with ESMTP id 2F2522BA6 for ; Mon, 21 Mar 2016 16:40:14 +0100 (CET) Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by fmsmga102.fm.intel.com with ESMTP; 21 Mar 2016 08:40:12 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.24,372,1455004800"; d="scan'208";a="928672746" Received: from irsmsx151.ger.corp.intel.com ([163.33.192.59]) by fmsmga001.fm.intel.com with ESMTP; 21 Mar 2016 08:40:10 -0700 Received: from irsmsx106.ger.corp.intel.com ([169.254.8.172]) by IRSMSX151.ger.corp.intel.com ([169.254.4.72]) with mapi id 14.03.0248.002; Mon, 21 Mar 2016 15:40:08 +0000 From: "Loftus, Ciara" To: Tetsuya Mukawa , "dev@dpdk.org" CC: "Richardson, Bruce" , "ann.zhuangyanying@huawei.com" , "thomas.monjalon@6wind.com" Thread-Topic: [dpdk-dev] [PATCH v13 2/2] vhost: Add VHOST PMD Thread-Index: AQHRgzT9Aj3Q6EJvQUG1+t8Gi263BZ9kAaZQ Date: Mon, 21 Mar 2016 15:40:07 +0000 Message-ID: <74F120C019F4A64C9B78E802F6AD4CC24F84543E@IRSMSX106.ger.corp.intel.com> References: <1458030701-11487-3-git-send-email-mukawa@igel.co.jp> <1458539108-15686-3-git-send-email-mukawa@igel.co.jp> In-Reply-To: <1458539108-15686-3-git-send-email-mukawa@igel.co.jp> Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiYzdmMDQ3NDEtMDBmZi00ZDdkLTgxZTgtOWE1MjgyNDIyMjcyIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX0lDIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE1LjkuNi42IiwiVHJ1c3RlZExhYmVsSGFzaCI6Inl5YURyd1QxU3VXZURESWkwbDg1YWF4XC9KRHJmbDViR0tXOVg4NkZGYUVBPSJ9 x-ctpclassification: CTP_IC x-originating-ip: [163.33.239.182] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dpdk-dev] [PATCH v13 2/2] vhost: Add VHOST PMD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 21 Mar 2016 15:40:15 -0000 Hi Tetsuya, Thanks for the patches. Just one query below re max queue numbers. Thanks, Ciara > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Tetsuya Mukawa > Sent: Monday, March 21, 2016 5:45 AM > To: dev@dpdk.org > Cc: Richardson, Bruce ; > ann.zhuangyanying@huawei.com; thomas.monjalon@6wind.com; Tetsuya > Mukawa > Subject: [dpdk-dev] [PATCH v13 2/2] vhost: Add VHOST PMD >=20 > The patch introduces a new PMD. This PMD is implemented as thin wrapper > of librte_vhost. It means librte_vhost is also needed to compile the PMD. > The vhost messages will be handled only when a port is started. So start > a port first, then invoke QEMU. >=20 > The PMD has 2 parameters. > - iface: The parameter is used to specify a path to connect to a > virtio-net device. > - queues: The parameter is used to specify the number of the queues > virtio-net device has. > (Default: 1) >=20 > Here is an example. > $ ./testpmd -c f -n 4 --vdev 'eth_vhost0,iface=3D/tmp/sock0,queues=3D1' -= - -i >=20 > To connect above testpmd, here is qemu command example. >=20 > $ qemu-system-x86_64 \ > > -chardev socket,id=3Dchr0,path=3D/tmp/sock0 \ > -netdev vhost-user,id=3Dnet0,chardev=3Dchr0,vhostforce,queues=3D1= \ > -device virtio-net-pci,netdev=3Dnet0,mq=3Don >=20 > Signed-off-by: Tetsuya Mukawa > Acked-by: Ferruh Yigit > Acked-by: Yuanhan Liu > Acked-by: Rich Lane > Tested-by: Rich Lane > --- > MAINTAINERS | 5 + > config/common_base | 6 + > config/common_linuxapp | 1 + > doc/guides/nics/index.rst | 1 + > doc/guides/nics/overview.rst | 37 +- > doc/guides/nics/vhost.rst | 110 ++++ > doc/guides/rel_notes/release_16_04.rst | 4 + > drivers/net/Makefile | 4 + > drivers/net/vhost/Makefile | 62 ++ > drivers/net/vhost/rte_eth_vhost.c | 917 > ++++++++++++++++++++++++++++ > drivers/net/vhost/rte_eth_vhost.h | 109 ++++ > drivers/net/vhost/rte_pmd_vhost_version.map | 10 + > mk/rte.app.mk | 6 + > 13 files changed, 1254 insertions(+), 18 deletions(-) > create mode 100644 doc/guides/nics/vhost.rst > create mode 100644 drivers/net/vhost/Makefile > create mode 100644 drivers/net/vhost/rte_eth_vhost.c > create mode 100644 drivers/net/vhost/rte_eth_vhost.h > create mode 100644 drivers/net/vhost/rte_pmd_vhost_version.map >=20 > diff --git a/MAINTAINERS b/MAINTAINERS > index 8b21979..7a47fc0 100644 > --- a/MAINTAINERS > +++ b/MAINTAINERS > @@ -352,6 +352,11 @@ Null PMD > M: Tetsuya Mukawa > F: drivers/net/null/ >=20 > +Vhost PMD > +M: Tetsuya Mukawa > +M: Yuanhan Liu > +F: drivers/net/vhost/ > + > Intel AES-NI GCM PMD > M: Declan Doherty > F: drivers/crypto/aesni_gcm/ > diff --git a/config/common_base b/config/common_base > index dbd405b..5efee07 100644 > --- a/config/common_base > +++ b/config/common_base > @@ -514,6 +514,12 @@ CONFIG_RTE_LIBRTE_VHOST_NUMA=3Dn > CONFIG_RTE_LIBRTE_VHOST_DEBUG=3Dn >=20 > # > +# Compile vhost PMD > +# To compile, CONFIG_RTE_LIBRTE_VHOST should be enabled. > +# > +CONFIG_RTE_LIBRTE_PMD_VHOST=3Dn > + > +# > #Compile Xen domain0 support > # > CONFIG_RTE_LIBRTE_XEN_DOM0=3Dn > diff --git a/config/common_linuxapp b/config/common_linuxapp > index ffbe260..7e698e2 100644 > --- a/config/common_linuxapp > +++ b/config/common_linuxapp > @@ -40,5 +40,6 @@ CONFIG_RTE_EAL_VFIO=3Dy > CONFIG_RTE_KNI_KMOD=3Dy > CONFIG_RTE_LIBRTE_KNI=3Dy > CONFIG_RTE_LIBRTE_VHOST=3Dy > +CONFIG_RTE_LIBRTE_PMD_VHOST=3Dy > CONFIG_RTE_LIBRTE_PMD_AF_PACKET=3Dy > CONFIG_RTE_LIBRTE_POWER=3Dy > diff --git a/doc/guides/nics/index.rst b/doc/guides/nics/index.rst > index 0b353a8..d53b0c7 100644 > --- a/doc/guides/nics/index.rst > +++ b/doc/guides/nics/index.rst > @@ -49,6 +49,7 @@ Network Interface Controller Drivers > nfp > szedata2 > virtio > + vhost > vmxnet3 > pcap_ring >=20 > diff --git a/doc/guides/nics/overview.rst b/doc/guides/nics/overview.rst > index 2d4f014..40ca5ec 100644 > --- a/doc/guides/nics/overview.rst > +++ b/doc/guides/nics/overview.rst > @@ -74,20 +74,21 @@ Most of these differences are summarized below. >=20 > .. table:: Features availability in networking drivers >=20 > - =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D > - Feature a b b b c e e i i i i i i i i i i f f m m m n n = p r s v v v x > - f n n o x 1 n 4 4 4 4 g g x x x x m m l l p f u = c i z i i m e > - p x x n g 0 i 0 0 0 0 b b g g g g 1 1 x x i p l = a n e r r x n > - a 2 2 d b 0 c e e e e v b b b b 0 0 4 5 p l = p g d t t n v > - c x x i e 0 . v v f e e e e k k e = a i i e i > - k v n . f f . v v . = t o o t r > - e f g . . . f f . = a . 3 t > - t v v v v v = 2 v > - e e e e e = e > - c c c c c = c > - =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D > - link status X X X = X > - link status event X X > + =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D =3D > + Feature a b b b c e e i i i i i i i i i i f f m m m n n = p r s v v v v x > + f n n o x 1 n 4 4 4 4 g g x x x x m m l l p f u = c i z h i i m e > + p x x n g 0 i 0 0 0 0 b b g g g g 1 1 x x i p l = a n e o r r x n > + a 2 2 d b 0 c e e e e v b b b b 0 0 4 5 p l = p g d s t t n v > + c x x i e 0 . v v f e e e e k k e = a t i i e i > + k v n . f f . v v . = t o o t r > + e f g . . . f f . = a . 3 t > + t v v v v v = 2 v > + e e e e e = e > + c c c c c = c > + =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D =3D > + link status X X X = X X > + link status event X X = X > + queue status event = X > Rx interrupt X X X X > queue start/stop X X X X X = X > MTU update X > @@ -125,7 +126,7 @@ Most of these differences are summarized below. > inner L4 checksum X X > packet type parsing X X X > timesync X X > - basic stats X X X X X = X > + basic stats X X X X X = X X > extended stats X X X X > stats per queue X = X > EEPROM dump > @@ -139,9 +140,9 @@ Most of these differences are summarized below. > ARMv8 > Power8 > TILE-Gx > - x86-32 X X X X X > - x86-64 X X X X X = X > + x86-32 X X X X X = X > + x86-64 X X X X X = X X > usage doc X = X > design doc > perf doc > - =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D > + =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =3D =3D = =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D =3D= =3D =3D =3D =3D =3D > =3D =3D =3D =3D =3D =3D > diff --git a/doc/guides/nics/vhost.rst b/doc/guides/nics/vhost.rst > new file mode 100644 > index 0000000..50e8a3a > --- /dev/null > +++ b/doc/guides/nics/vhost.rst > @@ -0,0 +1,110 @@ > +.. BSD LICENSE > + Copyright(c) 2016 IGEL Co., Ltd.. All rights reserved. > + All rights reserved. > + > + Redistribution and use in source and binary forms, with or without > + modification, are permitted provided that the following conditions > + are met: > + > + * Redistributions of source code must retain the above copyright > + notice, this list of conditions and the following disclaimer. > + * Redistributions in binary form must reproduce the above copyright > + notice, this list of conditions and the following disclaimer in > + the documentation and/or other materials provided with the > + distribution. > + * Neither the name of IGEL Co., Ltd. nor the names of its > + contributors may be used to endorse or promote products derived > + from this software without specific prior written permission. > + > + THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > + "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > + LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > + A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > + OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > + SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT > NOT > + LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS > OF USE, > + DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > + THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT > + (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF > THE USE > + OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > + > +Poll Mode Driver that wraps vhost library > +=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > + > +This PMD is a thin wrapper of the DPDK vhost library. > +The user can handle virtqueues as one of normal DPDK port. > + > +Vhost Implementation in DPDK > +---------------------------- > + > +Please refer to Chapter "Vhost Library" of *DPDK Programmer's Guide* to > know detail of vhost. > + > +Features and Limitations of vhost PMD > +------------------------------------- > + > +Currently, the vhost PMD provides the basic functionality of packet > reception, transmission and event handling. > + > +* It has multiple queues support. > + > +* It supports ``RTE_ETH_EVENT_INTR_LSC`` and > ``RTE_ETH_EVENT_QUEUE_STATE_CHANGE`` events. > + > +* It supports Port Hotplug functionality. > + > +* Don't need to stop RX/TX, when the user wants to stop a guest or a > virtio-net driver on guest. > + > +Vhost PMD arguments > +------------------- > + > +The user can specify below arguments in `--vdev` option. > + > +#. ``iface``: > + > + It is used to specify a path to connect to a QEMU virtio-net device. > + > +#. ``queues``: > + > + It is used to specify the number of queues virtio-net device has. > + (Default: 1) > + > +Vhost PMD event handling > +------------------------ > + > +This section describes how to handle vhost PMD events. > + > +The user can register an event callback handler with > ``rte_eth_dev_callback_register()``. > +The registered callback handler will be invoked with one of below event > types. > + > +#. ``RTE_ETH_EVENT_INTR_LSC``: > + > + It means link status of the port was changed. > + > +#. ``RTE_ETH_EVENT_QUEUE_STATE_CHANGE``: > + > + It means some of queue statuses were changed. Call > ``rte_eth_vhost_get_queue_event()`` in the callback handler. > + Because changing multiple statuses may occur only one event, call th= e > function repeatedly as long as it doesn't return negative value. > + > +Vhost PMD with testpmd application > +---------------------------------- > + > +This section demonstrates vhost PMD with testpmd DPDK sample > application. > + > +#. Launch the testpmd with vhost PMD: > + > + .. code-block:: console > + > + ./testpmd -c f -n 4 --vdev 'eth_vhost0,iface=3D/tmp/sock0,queues= =3D1' -- -i > + > + Other basic DPDK preparations like hugepage enabling here. > + Please refer to the *DPDK Getting Started Guide* for detailed > instructions. > + > +#. Launch the QEMU: > + > + .. code-block:: console > + > + qemu-system-x86_64 > + -chardev socket,id=3Dchr0,path=3D/tmp/sock0 \ > + -netdev vhost-user,id=3Dnet0,chardev=3Dchr0,vhostforc= e,queues=3D1 \ > + -device virtio-net-pci,netdev=3Dnet0 > + > + This command attaches one virtio-net device to QEMU guest. > + After initialization processes between QEMU and DPDK vhost library a= re > done, status of the port will be linked up. > diff --git a/doc/guides/rel_notes/release_16_04.rst > b/doc/guides/rel_notes/release_16_04.rst > index 2785b29..2e4bbb3 100644 > --- a/doc/guides/rel_notes/release_16_04.rst > +++ b/doc/guides/rel_notes/release_16_04.rst > @@ -248,6 +248,10 @@ This section should contain new features added in > this release. Sample format: >=20 > New application implementing an IPsec Security Gateway. >=20 > +* **Added vhost PMD.** > + > + Added virtual PMD that wraps librte_vhost. > + >=20 > Resolved Issues > --------------- > diff --git a/drivers/net/Makefile b/drivers/net/Makefile > index 0c3393f..8ba37fb 100644 > --- a/drivers/net/Makefile > +++ b/drivers/net/Makefile > @@ -52,4 +52,8 @@ DIRS-$(CONFIG_RTE_LIBRTE_VIRTIO_PMD) +=3D virtio > DIRS-$(CONFIG_RTE_LIBRTE_VMXNET3_PMD) +=3D vmxnet3 > DIRS-$(CONFIG_RTE_LIBRTE_PMD_XENVIRT) +=3D xenvirt >=20 > +ifeq ($(CONFIG_RTE_LIBRTE_VHOST),y) > +DIRS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D vhost > +endif # $(CONFIG_RTE_LIBRTE_VHOST) > + > include $(RTE_SDK)/mk/rte.subdir.mk > diff --git a/drivers/net/vhost/Makefile b/drivers/net/vhost/Makefile > new file mode 100644 > index 0000000..f49a69b > --- /dev/null > +++ b/drivers/net/vhost/Makefile > @@ -0,0 +1,62 @@ > +# BSD LICENSE > +# > +# Copyright (c) 2010-2016 Intel Corporation. > +# All rights reserved. > +# > +# Redistribution and use in source and binary forms, with or without > +# modification, are permitted provided that the following conditions > +# are met: > +# > +# * Redistributions of source code must retain the above copyright > +# notice, this list of conditions and the following disclaimer. > +# * Redistributions in binary form must reproduce the above copyrigh= t > +# notice, this list of conditions and the following disclaimer in > +# the documentation and/or other materials provided with the > +# distribution. > +# * Neither the name of Intel corporation nor the names of its > +# contributors may be used to endorse or promote products derived > +# from this software without specific prior written permission. > +# > +# THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > +# "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > +# LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > +# A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > +# OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > +# SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT > NOT > +# LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS > OF USE, > +# DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > +# THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR > TORT > +# (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF > THE USE > +# OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > + > +include $(RTE_SDK)/mk/rte.vars.mk > + > +# > +# library name > +# > +LIB =3D librte_pmd_vhost.a > + > +CFLAGS +=3D -O3 > +CFLAGS +=3D $(WERROR_FLAGS) > + > +EXPORT_MAP :=3D rte_pmd_vhost_version.map > + > +LIBABIVER :=3D 1 > + > +# > +# all source are stored in SRCS-y > +# > +SRCS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D rte_eth_vhost.c > + > +# > +# Export include files > +# > +SYMLINK-y-include +=3D rte_eth_vhost.h > + > +# this lib depends upon: > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D lib/librte_mbuf > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D lib/librte_ether > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D lib/librte_kvargs > +DEPDIRS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D lib/librte_vhost > + > +include $(RTE_SDK)/mk/rte.lib.mk > diff --git a/drivers/net/vhost/rte_eth_vhost.c > b/drivers/net/vhost/rte_eth_vhost.c > new file mode 100644 > index 0000000..6b9d287 > --- /dev/null > +++ b/drivers/net/vhost/rte_eth_vhost.c > @@ -0,0 +1,917 @@ > +/*- > + * BSD LICENSE > + * > + * Copyright (c) 2016 IGEL Co., Ltd. > + * All rights reserved. > + * > + * Redistribution and use in source and binary forms, with or without > + * modification, are permitted provided that the following conditions > + * are met: > + * > + * * Redistributions of source code must retain the above copyright > + * notice, this list of conditions and the following disclaimer. > + * * Redistributions in binary form must reproduce the above copyrig= ht > + * notice, this list of conditions and the following disclaimer in > + * the documentation and/or other materials provided with the > + * distribution. > + * * Neither the name of IGEL Co.,Ltd. nor the names of its > + * contributors may be used to endorse or promote products derived > + * from this software without specific prior written permission. > + * > + * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > + * "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > + * LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > + * A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > + * OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT > NOT > + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS > OF USE, > + * DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > + * THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR > TORT > + * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF > THE USE > + * OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > + */ > +#include > +#include > +#include > +#ifdef RTE_LIBRTE_VHOST_NUMA > +#include > +#endif > + > +#include > +#include > +#include > +#include > +#include > +#include > +#include > +#include > + > +#include "rte_eth_vhost.h" > + > +#define ETH_VHOST_IFACE_ARG "iface" > +#define ETH_VHOST_QUEUES_ARG "queues" > + > +static const char *drivername =3D "VHOST PMD"; > + > +static const char *valid_arguments[] =3D { > + ETH_VHOST_IFACE_ARG, > + ETH_VHOST_QUEUES_ARG, > + NULL > +}; > + > +static struct ether_addr base_eth_addr =3D { > + .addr_bytes =3D { > + 0x56 /* V */, > + 0x48 /* H */, > + 0x4F /* O */, > + 0x53 /* S */, > + 0x54 /* T */, > + 0x00 > + } > +}; > + > +struct vhost_queue { > + rte_atomic32_t allow_queuing; > + rte_atomic32_t while_queuing; > + struct virtio_net *device; > + struct pmd_internal *internal; > + struct rte_mempool *mb_pool; > + uint8_t port; > + uint16_t virtqueue_id; > + uint64_t rx_pkts; > + uint64_t tx_pkts; > + uint64_t missed_pkts; > + uint64_t rx_bytes; > + uint64_t tx_bytes; > +}; > + > +struct pmd_internal { > + char *dev_name; > + char *iface_name; > + > + volatile uint16_t once; > +}; > + > +struct internal_list { > + TAILQ_ENTRY(internal_list) next; > + struct rte_eth_dev *eth_dev; > +}; > + > +TAILQ_HEAD(internal_list_head, internal_list); > +static struct internal_list_head internal_list =3D > + TAILQ_HEAD_INITIALIZER(internal_list); > + > +static pthread_mutex_t internal_list_lock =3D PTHREAD_MUTEX_INITIALIZER; > + > +static rte_atomic16_t nb_started_ports; > +static pthread_t session_th; > + > +static struct rte_eth_link pmd_link =3D { > + .link_speed =3D 10000, > + .link_duplex =3D ETH_LINK_FULL_DUPLEX, > + .link_status =3D 0 > +}; > + > +struct rte_vhost_vring_state { > + rte_spinlock_t lock; > + > + bool cur[RTE_MAX_QUEUES_PER_PORT * 2]; > + bool seen[RTE_MAX_QUEUES_PER_PORT * 2]; > + unsigned int index; > + unsigned int max_vring; > +}; > + > +static struct rte_vhost_vring_state *vring_states[RTE_MAX_ETHPORTS]; > + > +static uint16_t > +eth_vhost_rx(void *q, struct rte_mbuf **bufs, uint16_t nb_bufs) > +{ > + struct vhost_queue *r =3D q; > + uint16_t i, nb_rx =3D 0; > + > + if (unlikely(rte_atomic32_read(&r->allow_queuing) =3D=3D 0)) > + return 0; > + > + rte_atomic32_set(&r->while_queuing, 1); > + > + if (unlikely(rte_atomic32_read(&r->allow_queuing) =3D=3D 0)) > + goto out; > + > + /* Dequeue packets from guest TX queue */ > + nb_rx =3D rte_vhost_dequeue_burst(r->device, > + r->virtqueue_id, r->mb_pool, bufs, nb_bufs); > + > + r->rx_pkts +=3D nb_rx; > + > + for (i =3D 0; likely(i < nb_rx); i++) { > + bufs[i]->port =3D r->port; > + r->rx_bytes +=3D bufs[i]->pkt_len; > + } > + > +out: > + rte_atomic32_set(&r->while_queuing, 0); > + > + return nb_rx; > +} > + > +static uint16_t > +eth_vhost_tx(void *q, struct rte_mbuf **bufs, uint16_t nb_bufs) > +{ > + struct vhost_queue *r =3D q; > + uint16_t i, nb_tx =3D 0; > + > + if (unlikely(rte_atomic32_read(&r->allow_queuing) =3D=3D 0)) > + return 0; > + > + rte_atomic32_set(&r->while_queuing, 1); > + > + if (unlikely(rte_atomic32_read(&r->allow_queuing) =3D=3D 0)) > + goto out; > + > + /* Enqueue packets to guest RX queue */ > + nb_tx =3D rte_vhost_enqueue_burst(r->device, > + r->virtqueue_id, bufs, nb_bufs); > + > + r->tx_pkts +=3D nb_tx; > + r->missed_pkts +=3D nb_bufs - nb_tx; > + > + for (i =3D 0; likely(i < nb_tx); i++) > + r->tx_bytes +=3D bufs[i]->pkt_len; > + > + for (i =3D 0; likely(i < nb_tx); i++) > + rte_pktmbuf_free(bufs[i]); > +out: > + rte_atomic32_set(&r->while_queuing, 0); > + > + return nb_tx; > +} > + > +static int > +eth_dev_configure(struct rte_eth_dev *dev __rte_unused) > +{ > + return 0; > +} > + > +static inline struct internal_list * > +find_internal_resource(char *ifname) > +{ > + int found =3D 0; > + struct internal_list *list; > + struct pmd_internal *internal; > + > + if (ifname =3D=3D NULL) > + return NULL; > + > + pthread_mutex_lock(&internal_list_lock); > + > + TAILQ_FOREACH(list, &internal_list, next) { > + internal =3D list->eth_dev->data->dev_private; > + if (!strcmp(internal->iface_name, ifname)) { > + found =3D 1; > + break; > + } > + } > + > + pthread_mutex_unlock(&internal_list_lock); > + > + if (!found) > + return NULL; > + > + return list; > +} > + > +static int > +new_device(struct virtio_net *dev) > +{ > + struct rte_eth_dev *eth_dev; > + struct internal_list *list; > + struct pmd_internal *internal; > + struct vhost_queue *vq; > + unsigned i; > + > + if (dev =3D=3D NULL) { > + RTE_LOG(INFO, PMD, "Invalid argument\n"); > + return -1; > + } > + > + list =3D find_internal_resource(dev->ifname); > + if (list =3D=3D NULL) { > + RTE_LOG(INFO, PMD, "Invalid device name\n"); > + return -1; > + } > + > + eth_dev =3D list->eth_dev; > + internal =3D eth_dev->data->dev_private; > + > + for (i =3D 0; i < eth_dev->data->nb_rx_queues; i++) { > + vq =3D eth_dev->data->rx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + vq->device =3D dev; > + vq->internal =3D internal; > + vq->port =3D eth_dev->data->port_id; > + rte_vhost_enable_guest_notification(dev, vq- > >virtqueue_id, 0); > + } > + for (i =3D 0; i < eth_dev->data->nb_tx_queues; i++) { > + vq =3D eth_dev->data->tx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + vq->device =3D dev; > + vq->internal =3D internal; > + vq->port =3D eth_dev->data->port_id; > + rte_vhost_enable_guest_notification(dev, vq- > >virtqueue_id, 0); > + } > + > + dev->flags |=3D VIRTIO_DEV_RUNNING; > + dev->priv =3D eth_dev; > + eth_dev->data->dev_link.link_status =3D 1; > + > + for (i =3D 0; i < eth_dev->data->nb_rx_queues; i++) { > + vq =3D eth_dev->data->rx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + rte_atomic32_set(&vq->allow_queuing, 1); > + } > + for (i =3D 0; i < eth_dev->data->nb_tx_queues; i++) { > + vq =3D eth_dev->data->tx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + rte_atomic32_set(&vq->allow_queuing, 1); > + } > + > + RTE_LOG(INFO, PMD, "New connection established\n"); > + > + _rte_eth_dev_callback_process(eth_dev, > RTE_ETH_EVENT_INTR_LSC); > + > + return 0; > +} > + > +static void > +destroy_device(volatile struct virtio_net *dev) > +{ > + struct rte_eth_dev *eth_dev; > + struct vhost_queue *vq; > + unsigned i; > + > + if (dev =3D=3D NULL) { > + RTE_LOG(INFO, PMD, "Invalid argument\n"); > + return; > + } > + > + eth_dev =3D (struct rte_eth_dev *)dev->priv; > + if (eth_dev =3D=3D NULL) { > + RTE_LOG(INFO, PMD, "Failed to find a ethdev\n"); > + return; > + } > + > + /* Wait until rx/tx_pkt_burst stops accessing vhost device */ > + for (i =3D 0; i < eth_dev->data->nb_rx_queues; i++) { > + vq =3D eth_dev->data->rx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + rte_atomic32_set(&vq->allow_queuing, 0); > + while (rte_atomic32_read(&vq->while_queuing)) > + rte_pause(); > + } > + for (i =3D 0; i < eth_dev->data->nb_tx_queues; i++) { > + vq =3D eth_dev->data->tx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + rte_atomic32_set(&vq->allow_queuing, 0); > + while (rte_atomic32_read(&vq->while_queuing)) > + rte_pause(); > + } > + > + eth_dev->data->dev_link.link_status =3D 0; > + > + dev->priv =3D NULL; > + dev->flags &=3D ~VIRTIO_DEV_RUNNING; > + > + for (i =3D 0; i < eth_dev->data->nb_rx_queues; i++) { > + vq =3D eth_dev->data->rx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + vq->device =3D NULL; > + } > + for (i =3D 0; i < eth_dev->data->nb_tx_queues; i++) { > + vq =3D eth_dev->data->tx_queues[i]; > + if (vq =3D=3D NULL) > + continue; > + vq->device =3D NULL; > + } > + > + RTE_LOG(INFO, PMD, "Connection closed\n"); > + > + _rte_eth_dev_callback_process(eth_dev, > RTE_ETH_EVENT_INTR_LSC); > +} > + > +static int > +vring_state_changed(struct virtio_net *dev, uint16_t vring, int enable) > +{ > + struct rte_vhost_vring_state *state; > + struct rte_eth_dev *eth_dev; > + struct internal_list *list; > +#ifdef RTE_LIBRTE_VHOST_NUMA > + int newnode, ret; > +#endif > + > + if (dev =3D=3D NULL) { > + RTE_LOG(ERR, PMD, "Invalid argument\n"); > + return -1; > + } > + > + list =3D find_internal_resource(dev->ifname); > + if (list =3D=3D NULL) { > + RTE_LOG(ERR, PMD, "Invalid interface name: %s\n", dev- > >ifname); > + return -1; > + } > + > + eth_dev =3D list->eth_dev; > + /* won't be NULL */ > + state =3D vring_states[eth_dev->data->port_id]; > + > +#ifdef RTE_LIBRTE_VHOST_NUMA > + ret =3D get_mempolicy(&newnode, NULL, 0, dev, > + MPOL_F_NODE | MPOL_F_ADDR); > + if (ret < 0) { > + RTE_LOG(ERR, PMD, "Unknown numa node\n"); > + return -1; > + } > + > + eth_dev->data->numa_node =3D newnode; > +#endif > + rte_spinlock_lock(&state->lock); > + state->cur[vring] =3D enable; > + state->max_vring =3D RTE_MAX(vring, state->max_vring); > + rte_spinlock_unlock(&state->lock); > + > + RTE_LOG(INFO, PMD, "vring%u is %s\n", > + vring, enable ? "enabled" : "disabled"); > + > + _rte_eth_dev_callback_process(eth_dev, > + RTE_ETH_EVENT_QUEUE_STATE_CHANGE); > + > + return 0; > +} > + > +int > +rte_eth_vhost_get_queue_event(uint8_t port_id, > + struct rte_eth_vhost_queue_event *event) > +{ > + struct rte_vhost_vring_state *state; > + unsigned int i; > + int idx; > + > + if (port_id >=3D RTE_MAX_ETHPORTS) { > + RTE_LOG(ERR, PMD, "Invalid port id\n"); > + return -1; > + } > + > + state =3D vring_states[port_id]; > + if (!state) { > + RTE_LOG(ERR, PMD, "Unused port\n"); > + return -1; > + } > + > + rte_spinlock_lock(&state->lock); > + for (i =3D 0; i <=3D state->max_vring; i++) { > + idx =3D state->index++ % (state->max_vring + 1); > + > + if (state->cur[idx] !=3D state->seen[idx]) { > + state->seen[idx] =3D state->cur[idx]; > + event->queue_id =3D idx / 2; > + event->rx =3D idx & 1; > + event->enable =3D state->cur[idx]; > + rte_spinlock_unlock(&state->lock); > + return 0; > + } > + } > + rte_spinlock_unlock(&state->lock); > + > + return -1; > +} > + > +static void * > +vhost_driver_session(void *param __rte_unused) > +{ > + static struct virtio_net_device_ops vhost_ops; > + > + /* set vhost arguments */ > + vhost_ops.new_device =3D new_device; > + vhost_ops.destroy_device =3D destroy_device; > + vhost_ops.vring_state_changed =3D vring_state_changed; > + if (rte_vhost_driver_callback_register(&vhost_ops) < 0) > + RTE_LOG(ERR, PMD, "Can't register callbacks\n"); > + > + /* start event handling */ > + rte_vhost_driver_session_start(); > + > + return NULL; > +} > + > +static int > +vhost_driver_session_start(void) > +{ > + int ret; > + > + ret =3D pthread_create(&session_th, > + NULL, vhost_driver_session, NULL); > + if (ret) > + RTE_LOG(ERR, PMD, "Can't create a thread\n"); > + > + return ret; > +} > + > +static void > +vhost_driver_session_stop(void) > +{ > + int ret; > + > + ret =3D pthread_cancel(session_th); > + if (ret) > + RTE_LOG(ERR, PMD, "Can't cancel the thread\n"); > + > + ret =3D pthread_join(session_th, NULL); > + if (ret) > + RTE_LOG(ERR, PMD, "Can't join the thread\n"); > +} > + > +static int > +eth_dev_start(struct rte_eth_dev *dev) > +{ > + struct pmd_internal *internal =3D dev->data->dev_private; > + int ret =3D 0; > + > + if (rte_atomic16_cmpset(&internal->once, 0, 1)) { > + ret =3D rte_vhost_driver_register(internal->iface_name); > + if (ret) > + return ret; > + } > + > + /* We need only one message handling thread */ > + if (rte_atomic16_add_return(&nb_started_ports, 1) =3D=3D 1) > + ret =3D vhost_driver_session_start(); > + > + return ret; > +} > + > +static void > +eth_dev_stop(struct rte_eth_dev *dev) > +{ > + struct pmd_internal *internal =3D dev->data->dev_private; > + > + if (rte_atomic16_cmpset(&internal->once, 1, 0)) > + rte_vhost_driver_unregister(internal->iface_name); > + > + if (rte_atomic16_sub_return(&nb_started_ports, 1) =3D=3D 0) > + vhost_driver_session_stop(); > +} > + > +static int > +eth_rx_queue_setup(struct rte_eth_dev *dev, uint16_t rx_queue_id, > + uint16_t nb_rx_desc __rte_unused, > + unsigned int socket_id, > + const struct rte_eth_rxconf *rx_conf __rte_unused, > + struct rte_mempool *mb_pool) > +{ > + struct vhost_queue *vq; > + > + vq =3D rte_zmalloc_socket(NULL, sizeof(struct vhost_queue), > + RTE_CACHE_LINE_SIZE, socket_id); > + if (vq =3D=3D NULL) { > + RTE_LOG(ERR, PMD, "Failed to allocate memory for rx > queue\n"); > + return -ENOMEM; > + } > + > + vq->mb_pool =3D mb_pool; > + vq->virtqueue_id =3D rx_queue_id * VIRTIO_QNUM + VIRTIO_TXQ; > + dev->data->rx_queues[rx_queue_id] =3D vq; > + > + return 0; > +} > + > +static int > +eth_tx_queue_setup(struct rte_eth_dev *dev, uint16_t tx_queue_id, > + uint16_t nb_tx_desc __rte_unused, > + unsigned int socket_id, > + const struct rte_eth_txconf *tx_conf __rte_unused) > +{ > + struct vhost_queue *vq; > + > + vq =3D rte_zmalloc_socket(NULL, sizeof(struct vhost_queue), > + RTE_CACHE_LINE_SIZE, socket_id); > + if (vq =3D=3D NULL) { > + RTE_LOG(ERR, PMD, "Failed to allocate memory for tx > queue\n"); > + return -ENOMEM; > + } > + > + vq->virtqueue_id =3D tx_queue_id * VIRTIO_QNUM + VIRTIO_RXQ; > + dev->data->tx_queues[tx_queue_id] =3D vq; > + > + return 0; > +} > + > +static void > +eth_dev_info(struct rte_eth_dev *dev, > + struct rte_eth_dev_info *dev_info) > +{ > + dev_info->driver_name =3D drivername; > + dev_info->max_mac_addrs =3D 1; > + dev_info->max_rx_pktlen =3D (uint32_t)-1; > + dev_info->max_rx_queues =3D dev->data->nb_rx_queues; > + dev_info->max_tx_queues =3D dev->data->nb_tx_queues; I'm not entirely familiar with eth driver code so please correct me if I am= wrong. I'm wondering if assigning the max queue values to dev->data->nb_*x_queues = is correct. A user could change the value of nb_*x_queues with a call to rte_eth_dev_co= nfigure(n_queues) which in turn calls rte_eth_dev_*x_queue_config(n_queues)= which will set dev->data->nb_*x_queues to the value of n_queues which can = be arbitrary and decided by the user. If this is the case, dev->data->nb_*x= _queues will no longer reflect the max, rather the value the user chose in = the call to rte_eth_dev_configure. And the max could potentially change wit= h multiple calls to configure. Is this intended behaviour? > + dev_info->min_rx_bufsize =3D 0; > +} > + > +static void > +eth_stats_get(struct rte_eth_dev *dev, struct rte_eth_stats *stats) > +{ > + unsigned i; > + unsigned long rx_total =3D 0, tx_total =3D 0, tx_missed_total =3D 0; > + unsigned long rx_total_bytes =3D 0, tx_total_bytes =3D 0; > + struct vhost_queue *vq; > + > + for (i =3D 0; i < RTE_ETHDEV_QUEUE_STAT_CNTRS && > + i < dev->data->nb_rx_queues; i++) { > + if (dev->data->rx_queues[i] =3D=3D NULL) > + continue; > + vq =3D dev->data->rx_queues[i]; > + stats->q_ipackets[i] =3D vq->rx_pkts; > + rx_total +=3D stats->q_ipackets[i]; > + > + stats->q_ibytes[i] =3D vq->rx_bytes; > + rx_total_bytes +=3D stats->q_ibytes[i]; > + } > + > + for (i =3D 0; i < RTE_ETHDEV_QUEUE_STAT_CNTRS && > + i < dev->data->nb_tx_queues; i++) { > + if (dev->data->tx_queues[i] =3D=3D NULL) > + continue; > + vq =3D dev->data->tx_queues[i]; > + stats->q_opackets[i] =3D vq->tx_pkts; > + tx_missed_total +=3D vq->missed_pkts; > + tx_total +=3D stats->q_opackets[i]; > + > + stats->q_obytes[i] =3D vq->tx_bytes; > + tx_total_bytes +=3D stats->q_obytes[i]; > + } > + > + stats->ipackets =3D rx_total; > + stats->opackets =3D tx_total; > + stats->imissed =3D tx_missed_total; > + stats->ibytes =3D rx_total_bytes; > + stats->obytes =3D tx_total_bytes; > +} > + > +static void > +eth_stats_reset(struct rte_eth_dev *dev) > +{ > + struct vhost_queue *vq; > + unsigned i; > + > + for (i =3D 0; i < dev->data->nb_rx_queues; i++) { > + if (dev->data->rx_queues[i] =3D=3D NULL) > + continue; > + vq =3D dev->data->rx_queues[i]; > + vq->rx_pkts =3D 0; > + vq->rx_bytes =3D 0; > + } > + for (i =3D 0; i < dev->data->nb_tx_queues; i++) { > + if (dev->data->tx_queues[i] =3D=3D NULL) > + continue; > + vq =3D dev->data->tx_queues[i]; > + vq->tx_pkts =3D 0; > + vq->tx_bytes =3D 0; > + vq->missed_pkts =3D 0; > + } > +} > + > +static void > +eth_queue_release(void *q) > +{ > + rte_free(q); > +} > + > +static int > +eth_link_update(struct rte_eth_dev *dev __rte_unused, > + int wait_to_complete __rte_unused) > +{ > + return 0; > +} > + > +/** > + * Disable features in feature_mask. Returns 0 on success. > + */ > +int > +rte_eth_vhost_feature_disable(uint64_t feature_mask) > +{ > + return rte_vhost_feature_disable(feature_mask); > +} > + > +/** > + * Enable features in feature_mask. Returns 0 on success. > + */ > +int > +rte_eth_vhost_feature_enable(uint64_t feature_mask) > +{ > + return rte_vhost_feature_enable(feature_mask); > +} > + > +/* Returns currently supported vhost features */ > +uint64_t > +rte_eth_vhost_feature_get(void) > +{ > + return rte_vhost_feature_get(); > +} > + > +static const struct eth_dev_ops ops =3D { > + .dev_start =3D eth_dev_start, > + .dev_stop =3D eth_dev_stop, > + .dev_configure =3D eth_dev_configure, > + .dev_infos_get =3D eth_dev_info, > + .rx_queue_setup =3D eth_rx_queue_setup, > + .tx_queue_setup =3D eth_tx_queue_setup, > + .rx_queue_release =3D eth_queue_release, > + .tx_queue_release =3D eth_queue_release, > + .link_update =3D eth_link_update, > + .stats_get =3D eth_stats_get, > + .stats_reset =3D eth_stats_reset, > +}; > + > +static int > +eth_dev_vhost_create(const char *name, char *iface_name, int16_t > queues, > + const unsigned numa_node) > +{ > + struct rte_eth_dev_data *data =3D NULL; > + struct pmd_internal *internal =3D NULL; > + struct rte_eth_dev *eth_dev =3D NULL; > + struct ether_addr *eth_addr =3D NULL; > + struct rte_vhost_vring_state *vring_state =3D NULL; > + struct internal_list *list =3D NULL; > + > + RTE_LOG(INFO, PMD, "Creating VHOST-USER backend on numa > socket %u\n", > + numa_node); > + > + /* now do all data allocation - for eth_dev structure, dummy pci > driver > + * and internal (private) data > + */ > + data =3D rte_zmalloc_socket(name, sizeof(*data), 0, numa_node); > + if (data =3D=3D NULL) > + goto error; > + > + internal =3D rte_zmalloc_socket(name, sizeof(*internal), 0, > numa_node); > + if (internal =3D=3D NULL) > + goto error; > + > + list =3D rte_zmalloc_socket(name, sizeof(*list), 0, numa_node); > + if (list =3D=3D NULL) > + goto error; > + > + /* reserve an ethdev entry */ > + eth_dev =3D rte_eth_dev_allocate(name, RTE_ETH_DEV_VIRTUAL); > + if (eth_dev =3D=3D NULL) > + goto error; > + > + eth_addr =3D rte_zmalloc_socket(name, sizeof(*eth_addr), 0, > numa_node); > + if (eth_addr =3D=3D NULL) > + goto error; > + *eth_addr =3D base_eth_addr; > + eth_addr->addr_bytes[5] =3D eth_dev->data->port_id; > + > + vring_state =3D rte_zmalloc_socket(name, > + sizeof(*vring_state), 0, numa_node); > + if (vring_state =3D=3D NULL) > + goto error; > + > + TAILQ_INIT(ð_dev->link_intr_cbs); > + > + /* now put it all together > + * - store queue data in internal, > + * - store numa_node info in ethdev data > + * - point eth_dev_data to internals > + * - and point eth_dev structure to new eth_dev_data structure > + */ > + internal->dev_name =3D strdup(name); > + if (internal->dev_name =3D=3D NULL) > + goto error; > + internal->iface_name =3D strdup(iface_name); > + if (internal->iface_name =3D=3D NULL) > + goto error; > + > + list->eth_dev =3D eth_dev; > + pthread_mutex_lock(&internal_list_lock); > + TAILQ_INSERT_TAIL(&internal_list, list, next); > + pthread_mutex_unlock(&internal_list_lock); > + > + rte_spinlock_init(&vring_state->lock); > + vring_states[eth_dev->data->port_id] =3D vring_state; > + > + data->dev_private =3D internal; > + data->port_id =3D eth_dev->data->port_id; > + memmove(data->name, eth_dev->data->name, sizeof(data- > >name)); > + data->nb_rx_queues =3D queues; > + data->nb_tx_queues =3D queues; > + data->dev_link =3D pmd_link; > + data->mac_addrs =3D eth_addr; > + > + /* We'll replace the 'data' originally allocated by eth_dev. So the > + * vhost PMD resources won't be shared between multi processes. > + */ > + eth_dev->data =3D data; > + eth_dev->dev_ops =3D &ops; > + eth_dev->driver =3D NULL; > + data->dev_flags =3D > + RTE_ETH_DEV_DETACHABLE | RTE_ETH_DEV_INTR_LSC; > + data->kdrv =3D RTE_KDRV_NONE; > + data->drv_name =3D internal->dev_name; > + data->numa_node =3D numa_node; > + > + /* finally assign rx and tx ops */ > + eth_dev->rx_pkt_burst =3D eth_vhost_rx; > + eth_dev->tx_pkt_burst =3D eth_vhost_tx; > + > + return data->port_id; > + > +error: > + if (internal) > + free(internal->dev_name); > + rte_free(vring_state); > + rte_free(eth_addr); > + if (eth_dev) > + rte_eth_dev_release_port(eth_dev); > + rte_free(internal); > + rte_free(list); > + rte_free(data); > + > + return -1; > +} > + > +static inline int > +open_iface(const char *key __rte_unused, const char *value, void > *extra_args) > +{ > + const char **iface_name =3D extra_args; > + > + if (value =3D=3D NULL) > + return -1; > + > + *iface_name =3D value; > + > + return 0; > +} > + > +static inline int > +open_queues(const char *key __rte_unused, const char *value, void > *extra_args) > +{ > + uint16_t *q =3D extra_args; > + > + if (value =3D=3D NULL || extra_args =3D=3D NULL) > + return -EINVAL; > + > + *q =3D (uint16_t)strtoul(value, NULL, 0); > + if (*q =3D=3D USHRT_MAX && errno =3D=3D ERANGE) > + return -1; > + > + if (*q > RTE_MAX_QUEUES_PER_PORT) > + return -1; > + > + return 0; > +} > + > +static int > +rte_pmd_vhost_devinit(const char *name, const char *params) > +{ > + struct rte_kvargs *kvlist =3D NULL; > + int ret =3D 0; > + char *iface_name; > + uint16_t queues; > + > + RTE_LOG(INFO, PMD, "Initializing pmd_vhost for %s\n", name); > + > + kvlist =3D rte_kvargs_parse(params, valid_arguments); > + if (kvlist =3D=3D NULL) > + return -1; > + > + if (rte_kvargs_count(kvlist, ETH_VHOST_IFACE_ARG) =3D=3D 1) { > + ret =3D rte_kvargs_process(kvlist, ETH_VHOST_IFACE_ARG, > + &open_iface, &iface_name); > + if (ret < 0) > + goto out_free; > + } else { > + ret =3D -1; > + goto out_free; > + } > + > + if (rte_kvargs_count(kvlist, ETH_VHOST_QUEUES_ARG) =3D=3D 1) { > + ret =3D rte_kvargs_process(kvlist, ETH_VHOST_QUEUES_ARG, > + &open_queues, &queues); > + if (ret < 0) > + goto out_free; > + > + } else > + queues =3D 1; > + > + eth_dev_vhost_create(name, iface_name, queues, > rte_socket_id()); > + > +out_free: > + rte_kvargs_free(kvlist); > + return ret; > +} > + > +static int > +rte_pmd_vhost_devuninit(const char *name) > +{ > + struct rte_eth_dev *eth_dev =3D NULL; > + struct pmd_internal *internal; > + struct internal_list *list; > + unsigned int i; > + > + RTE_LOG(INFO, PMD, "Un-Initializing pmd_vhost for %s\n", name); > + > + /* find an ethdev entry */ > + eth_dev =3D rte_eth_dev_allocated(name); > + if (eth_dev =3D=3D NULL) > + return -ENODEV; > + > + internal =3D eth_dev->data->dev_private; > + if (internal =3D=3D NULL) > + return -ENODEV; > + > + list =3D find_internal_resource(internal->iface_name); > + if (list =3D=3D NULL) > + return -ENODEV; > + > + pthread_mutex_lock(&internal_list_lock); > + TAILQ_REMOVE(&internal_list, list, next); > + pthread_mutex_unlock(&internal_list_lock); > + rte_free(list); > + > + eth_dev_stop(eth_dev); > + > + rte_free(vring_states[eth_dev->data->port_id]); > + vring_states[eth_dev->data->port_id] =3D NULL; > + > + free(internal->dev_name); > + free(internal->iface_name); > + > + for (i =3D 0; i < eth_dev->data->nb_rx_queues; i++) > + rte_free(eth_dev->data->rx_queues[i]); > + for (i =3D 0; i < eth_dev->data->nb_tx_queues; i++) > + rte_free(eth_dev->data->tx_queues[i]); > + > + rte_free(eth_dev->data->mac_addrs); > + rte_free(eth_dev->data); > + rte_free(internal); > + > + rte_eth_dev_release_port(eth_dev); > + > + return 0; > +} > + > +static struct rte_driver pmd_vhost_drv =3D { > + .name =3D "eth_vhost", > + .type =3D PMD_VDEV, > + .init =3D rte_pmd_vhost_devinit, > + .uninit =3D rte_pmd_vhost_devuninit, > +}; > + > +PMD_REGISTER_DRIVER(pmd_vhost_drv); > diff --git a/drivers/net/vhost/rte_eth_vhost.h > b/drivers/net/vhost/rte_eth_vhost.h > new file mode 100644 > index 0000000..e78cb74 > --- /dev/null > +++ b/drivers/net/vhost/rte_eth_vhost.h > @@ -0,0 +1,109 @@ > +/*- > + * BSD LICENSE > + * > + * Copyright(c) 2016 IGEL Co., Ltd. > + * All rights reserved. > + * > + * Redistribution and use in source and binary forms, with or without > + * modification, are permitted provided that the following conditions > + * are met: > + * > + * * Redistributions of source code must retain the above copyright > + * notice, this list of conditions and the following disclaimer. > + * * Redistributions in binary form must reproduce the above copyrig= ht > + * notice, this list of conditions and the following disclaimer in > + * the documentation and/or other materials provided with the > + * distribution. > + * * Neither the name of IGEL Co., Ltd. nor the names of its > + * contributors may be used to endorse or promote products derived > + * from this software without specific prior written permission. > + * > + * THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND > CONTRIBUTORS > + * "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT > NOT > + * LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND > FITNESS FOR > + * A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE > COPYRIGHT > + * OWNER OR CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, > INCIDENTAL, > + * SPECIAL, EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT > NOT > + * LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS > OF USE, > + * DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED > AND ON ANY > + * THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR > TORT > + * (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF > THE USE > + * OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH > DAMAGE. > + */ > + > +#ifndef _RTE_ETH_VHOST_H_ > +#define _RTE_ETH_VHOST_H_ > + > +#ifdef __cplusplus > +extern "C" { > +#endif > + > +#include > +#include > + > +#include > + > +/** > + * Disable features in feature_mask. > + * > + * @param feature_mask > + * Vhost features defined in "linux/virtio_net.h". > + * @return > + * - On success, zero. > + * - On failure, a negative value. > + */ > +int rte_eth_vhost_feature_disable(uint64_t feature_mask); > + > +/** > + * Enable features in feature_mask. > + * > + * @param feature_mask > + * Vhost features defined in "linux/virtio_net.h". > + * @return > + * - On success, zero. > + * - On failure, a negative value. > + */ > +int rte_eth_vhost_feature_enable(uint64_t feature_mask); > + > +/** > + * Returns currently supported vhost features. > + * > + * @return > + * Vhost features defined in "linux/virtio_net.h". > + */ > +uint64_t rte_eth_vhost_feature_get(void); > + > +/* > + * Event description. > + */ > +struct rte_eth_vhost_queue_event { > + uint16_t queue_id; > + bool rx; > + bool enable; > +}; > + > +/** > + * Get queue events from specified port. > + * If a callback for below event is registered by > + * rte_eth_dev_callback_register(), this function will describe what was > + * changed. > + * - RTE_ETH_EVENT_QUEUE_STATE_CHANGE > + * Multiple events may cause only one callback kicking, so call this fun= ction > + * while returning 0. > + * > + * @param port_id > + * Port id. > + * @param event > + * Pointer to a rte_eth_vhost_queue_event structure. > + * @return > + * - On success, zero. > + * - On failure, a negative value. > + */ > +int rte_eth_vhost_get_queue_event(uint8_t port_id, > + struct rte_eth_vhost_queue_event *event); > + > +#ifdef __cplusplus > +} > +#endif > + > +#endif > diff --git a/drivers/net/vhost/rte_pmd_vhost_version.map > b/drivers/net/vhost/rte_pmd_vhost_version.map > new file mode 100644 > index 0000000..65bf3a8 > --- /dev/null > +++ b/drivers/net/vhost/rte_pmd_vhost_version.map > @@ -0,0 +1,10 @@ > +DPDK_16.04 { > + global: > + > + rte_eth_vhost_feature_disable; > + rte_eth_vhost_feature_enable; > + rte_eth_vhost_feature_get; > + rte_eth_vhost_get_queue_event; > + > + local: *; > +}; > diff --git a/mk/rte.app.mk b/mk/rte.app.mk > index a1cd9a3..bd973e8 100644 > --- a/mk/rte.app.mk > +++ b/mk/rte.app.mk > @@ -166,6 +166,12 @@ _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_SNOW3G) > +=3D -lrte_pmd_snow3g > _LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_SNOW3G) +=3D - > L$(LIBSSO_PATH)/build -lsso > endif # CONFIG_RTE_LIBRTE_CRYPTODEV >=20 > +ifeq ($(CONFIG_RTE_LIBRTE_VHOST),y) > + > +_LDLIBS-$(CONFIG_RTE_LIBRTE_PMD_VHOST) +=3D -lrte_pmd_vhost > + > +endif # $(CONFIG_RTE_LIBRTE_VHOST) > + > endif # ! $(CONFIG_RTE_BUILD_SHARED_LIB) >=20 > _LDLIBS-y +=3D $(EXECENV_LDLIBS) > -- > 2.1.4