From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 9398A11A4 for ; Mon, 10 Sep 2018 05:20:25 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga004.jf.intel.com ([10.7.209.38]) by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 09 Sep 2018 20:20:24 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.53,354,1531810800"; d="scan'208";a="231529933" Received: from fmsmsx106.amr.corp.intel.com ([10.18.124.204]) by orsmga004.jf.intel.com with ESMTP; 09 Sep 2018 20:19:13 -0700 Received: from fmsmsx114.amr.corp.intel.com (10.18.116.8) by FMSMSX106.amr.corp.intel.com (10.18.124.204) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 9 Sep 2018 20:19:13 -0700 Received: from shsmsx104.ccr.corp.intel.com (10.239.4.70) by FMSMSX114.amr.corp.intel.com (10.18.116.8) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 9 Sep 2018 20:19:12 -0700 Received: from shsmsx101.ccr.corp.intel.com ([169.254.1.205]) by SHSMSX104.ccr.corp.intel.com ([169.254.5.143]) with mapi id 14.03.0319.002; Mon, 10 Sep 2018 11:19:10 +0800 From: "Wang, Haiyue" To: "Ye, Xiaolong" , "dev@dpdk.org" , Maxime Coquelin , "Bie, Tiwei" , "Wang, Zhihong" CC: "Wang, Xiao W" , "Ye, Xiaolong" Thread-Topic: [dpdk-dev] [PATCH v1 2/2] examples/vdpa: add a new sample for vdpa Thread-Index: AQHURasMj1fhqzbpA0WCiRWiuubLyaTo3UEA Date: Mon, 10 Sep 2018 03:19:09 +0000 Message-ID: References: <20180906131653.10752-1-xiaolong.ye@intel.com> <20180906131653.10752-2-xiaolong.ye@intel.com> In-Reply-To: <20180906131653.10752-2-xiaolong.ye@intel.com> Accept-Language: zh-CN, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiZmU2YWJlZjUtYmRkMS00NThiLTg4YTAtNmFhZWE3NWQyYmE4IiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiTFZlTmQyRWNiYmFtNFJPQUFVM2hBdmhVYWFOeGdGYUd5Y2dNNk56VENCdVB5XC9pMG53SWtLT3grcERyM2J3UmQifQ== x-ctpclassification: CTP_NT dlp-product: dlpe-windows dlp-version: 11.0.400.15 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dpdk-dev] [PATCH v1 2/2] examples/vdpa: add a new sample for vdpa X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Sep 2018 03:20:26 -0000 Can we add options to support 'int rte_vdpa_find_device_id(struct rte_vdpa_= dev_addr *addr)' API calling to get the device id ? Not just hard code 0 ~ num ? Like choosing one of = vDPA engines explicitly by BDF:=20 -w 0000:06:00.2,vdpa=3D1 -w 0000:06:00.3,vdpa=3D1 BR, Haiyue > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Xiaolong Ye > Sent: Thursday, September 6, 2018 21:17 > To: dev@dpdk.org; Maxime Coquelin ; Bie, > Tiwei ; Wang, Zhihong > Cc: Wang, Xiao W ; Ye, Xiaolong > > Subject: [dpdk-dev] [PATCH v1 2/2] examples/vdpa: add a new sample for vd= pa >=20 > From: Xiao Wang >=20 > This patch adds a sample which creates vhost-user socket based on vdpa dr= iver. > vdpa driver can help to set up vhost datapath so this app doesn't need to= spend a > dedicated worker thread on vhost enqueue/dequeue operations. >=20 > Below are setup steps for your reference (using IFC driver): >=20 > 1. Make sure your kernnel vhost module and QEMU support vhost-user. > - OS: CentOS 7.4 > - QEMU: 2.10.1 > - Guest OS: CentOS 7.2 >=20 > 2. Bind VFIO-pci to VF > a) modprobe vfio-pci > d) ./usertools/dpdk-devbind.py -b vfio-pci 06:00.2 06:00.3 >=20 > 3. Start vdpa sample > ./examples/vdpa/build/vdpa --log-level=3D9 -c 0x10 -n 4 --socket-mem > 1024,1024 -w 0000:06:00.2,vdpa=3D1 -w 0000:06:00.3,vdpa=3D1 -- > --iface /tmp/vhost-user- (or use interactive mode to create vdpa > ports) >=20 > 4. Start two VMs > ./qemu-2.10.1/x86_64-softmmu/qemu-system-x86_64 -cpu host -enable-kvm > \ > > -mem-prealloc \ > -chardev socket,id=3Dchar0,path=3D/tmp/vhost-user-0 \ > -netdev type=3Dvhost-user,id=3Dvdpa,chardev=3Dchar0,vhostforce \ > -device virtio-net-pci,netdev=3Dvdpa,mac=3D00:aa:bb:cc:dd:ee \ >=20 > ./qemu-2.10.1/x86_64-softmmu/qemu-system-x86_64 -cpu host -enable-kvm > \ > > -mem-prealloc \ > -chardev socket,id=3Dchar0,path=3D/tmp/vhost-user-1 \ > -netdev type=3Dvhost-user,id=3Dvdpa,chardev=3Dchar0,vhostforce \ > -device virtio-net-pci,netdev=3Dvdpa,mac=3D00:aa:bb:cc:dd:ff \ >=20 > 5. Login two VMs and configure the ip, verify the network connection via > ping. >=20 > Signed-off-by: Xiao Wang > Signed-off-by: Xiaolong Ye > --- > examples/vdpa/Makefile | 32 ++++ > examples/vdpa/main.c | 327 ++++++++++++++++++++++++++++++++++++++ > examples/vdpa/meson.build | 11 ++ > 3 files changed, 370 insertions(+) > create mode 100644 examples/vdpa/Makefile create mode 100644 > examples/vdpa/main.c create mode 100644 examples/vdpa/meson.build >=20 > diff --git a/examples/vdpa/Makefile b/examples/vdpa/Makefile new file mod= e > 100644 index 000000000..42672a2bc > --- /dev/null > +++ b/examples/vdpa/Makefile > @@ -0,0 +1,32 @@ > +# SPDX-License-Identifier: BSD-3-Clause # Copyright(c) 2018 Intel > +Corporation > + > +ifeq ($(RTE_SDK),) > +$(error "Please define RTE_SDK environment variable") endif > + > +# Default target, can be overridden by command line or environment > +RTE_TARGET ?=3D x86_64-native-linuxapp-gcc > + > +include $(RTE_SDK)/mk/rte.vars.mk > + > +ifneq ($(CONFIG_RTE_EXEC_ENV),"linuxapp") > +$(info This application can only operate in a linuxapp environment, \ > +please change the definition of the RTE_TARGET environment variable) > +all: > +else > + > +# binary name > +APP =3D vdpa > + > +# all source are stored in SRCS-y > +SRCS-y :=3D main.c > + > +CFLAGS +=3D -O2 -D_FILE_OFFSET_BITS=3D64 > +CFLAGS +=3D $(WERROR_FLAGS) > +CFLAGS +=3D -D_GNU_SOURCE > +CFLAGS +=3D -DALLOW_EXPERIMENTAL_API > + > +include $(RTE_SDK)/mk/rte.extapp.mk > + > +endif > diff --git a/examples/vdpa/main.c b/examples/vdpa/main.c new file mode > 100644 index 000000000..b19d7a217 > --- /dev/null > +++ b/examples/vdpa/main.c > @@ -0,0 +1,327 @@ > +/* SPDX-License-Identifier: BSD-3-Clause > + * Copyright(c) 2018 Intel Corporation > + */ > + > +#include > +#include > +#include > +#include > +#include > + > +#include > +#include > +#include > +#include > + > +#include > +#include > +#include > +#include > + > +#define MAX_PATH_LEN 128 > +#define MAX_VDPA_SAMPLE_PORTS 1024 > + > +struct vdpa_port { > + char ifname[MAX_PATH_LEN]; > + int did; > + int vid; > +}; > + > +struct vdpa_port vports[MAX_VDPA_SAMPLE_PORTS]; > + > +char iface[MAX_PATH_LEN]; > +int devcnt; > +int dev_id; > +uint8_t interactive; > + > +/* display usage */ > +static void > +vdpa_usage(const char *prgname) > +{ > + printf("Usage: %s [EAL options] -- " > + "[--interactive|-i] " > + "[--iface PATH]\n" > + " --interactive: run in interactive > mode.\n" > + " --iface : specify the path prefix > of the socket files, e.g. /tmp/vhost-user-\n", > + prgname); > +} > + > +static int > +parse_args(int argc, char **argv) > +{ > + static const char *short_option =3D "i"; > + static struct option long_option[] =3D { > + {"iface", required_argument, NULL, 0}, > + {"interactive", 0, 0, 0}, > + {NULL, 0, 0, 0}, > + }; > + int opt, idx; > + char *prgname =3D argv[0]; > + > + while ((opt =3D getopt_long(argc, argv, short_option, long_option, &idx= )) > + !=3D EOF) { > + switch (opt) { > + case 'i': > + printf("Interactive-mode selected\n"); > + interactive =3D 1; > + break; > + /* long options */ > + case 0: > + if (strncmp(long_option[idx].name, "iface", > + MAX_PATH_LEN) =3D=3D 0) { > + strncpy(iface, optarg, MAX_PATH_LEN); > + printf("iface %s\n", iface); > + } > + if (!strcmp(long_option[idx].name, "interactive")) { > + printf("Interactive-mode selected\n"); > + interactive =3D 1; > + } > + break; > + > + default: > + vdpa_usage(prgname); > + return -1; > + } > + } > + > + if (*iface =3D=3D '\0' && interactive =3D=3D 0) { > + vdpa_usage(prgname); > + return -1; > + } > + > + return 0; > +} > + > +static int > +data_init(void) > +{ > + devcnt =3D rte_vdpa_get_device_num(); > + if (devcnt <=3D 0) { > + printf("No available vdpa device found\n"); > + return -1; > + } > + dev_id =3D 0; > + interactive =3D 0; > + memset(iface, 0, MAX_PATH_LEN * sizeof(iface[0])); > + memset(vports, 0, MAX_VDPA_SAMPLE_PORTS * sizeof(vports[0])); > + return 0; > +} > + > +static void > +signal_handler(int signum) > +{ > + if (signum =3D=3D SIGINT || signum =3D=3D SIGTERM) { > + printf("\nSignal %d received, preparing to exit...\n", > + signum); > + exit(0); > + } > +} > + > +static int > +new_device(int vid) > +{ > + char ifname[MAX_PATH_LEN]; > + int i; > + > + rte_vhost_get_ifname(vid, ifname, sizeof(ifname)); > + for (i =3D 0; i < MAX_VDPA_SAMPLE_PORTS; i++) { > + if (strncmp(ifname, vports[i].ifname, MAX_PATH_LEN) =3D=3D 0) { > + printf("\nnew port %s, did: %d\n", > + ifname, vports[i].did); > + vports[i].vid =3D vid; > + break; > + } > + } > + > + if (i >=3D MAX_VDPA_SAMPLE_PORTS) > + return -1; > + > + return 0; > +} > + > +static void > +destroy_device(int vid) > +{ > + char ifname[MAX_PATH_LEN]; > + int i; > + > + rte_vhost_get_ifname(vid, ifname, sizeof(ifname)); > + for (i =3D 0; i < MAX_VDPA_SAMPLE_PORTS; i++) { > + if (strcmp(ifname, vports[i].ifname) =3D=3D 0) { > + printf("\ndestroy port %s, did: %d\n", > + ifname, vports[i].did); > + break; > + } > + } > +} > + > +static const struct vhost_device_ops vdpa_sample_devops =3D { > + .new_device =3D new_device, > + .destroy_device =3D destroy_device, > + .vring_state_changed =3D NULL, > + .features_changed =3D NULL, > + .new_connection =3D NULL, > + .destroy_connection =3D NULL, > +}; > + > +static void > +start_vdpa(const char *socket_path, int did, uint64_t flags) { > + int ret; > + ret =3D rte_vhost_driver_register(socket_path, flags); > + if (ret !=3D 0) > + rte_exit(EXIT_FAILURE, > + "register driver failed: %s\n", > + socket_path); > + > + ret =3D rte_vhost_driver_callback_register(socket_path, > + &vdpa_sample_devops); > + if (ret !=3D 0) > + rte_exit(EXIT_FAILURE, > + "register driver ops failed: %s\n", > + socket_path); > + > + ret =3D rte_vhost_driver_attach_vdpa_device(socket_path, did); > + if (ret !=3D 0) > + rte_exit(EXIT_FAILURE, > + "attach vdpa device failed: %s\n", > + socket_path); > + > + if (rte_vhost_driver_start(socket_path) < 0) > + rte_exit(EXIT_FAILURE, > + "start vhost driver failed: %s\n", > + socket_path); > +} > + > +/* interactive cmds */ > + > +/* *** Help command with introduction. *** */ struct cmd_help_result { > + cmdline_fixed_string_t help; > +}; > + > +static void cmd_help_parsed(__attribute__((unused)) void *parsed_result, > + struct cmdline *cl, > + __attribute__((unused)) void *data) { > + cmdline_printf( > + cl, > + "\n" > + "The following commands are currently available:\n\n" > + "Control:\n" > + " help : Show interactive inst= ructions.\n" > + " create : Create a new vdpa > port.\n\n" > + ); > +} > + > +cmdline_parse_token_string_t cmd_help_help =3D > + TOKEN_STRING_INITIALIZER(struct cmd_help_result, help, "help"); > + > +cmdline_parse_inst_t cmd_help =3D { > + .f =3D cmd_help_parsed, > + .data =3D NULL, > + .help_str =3D "show help", > + .tokens =3D { > + (void *)&cmd_help_help, > + NULL, > + }, > +}; > + > +/* *** Create new vdpa port *** */ > +struct cmd_create_result { > + cmdline_fixed_string_t action; > + cmdline_fixed_string_t socket_path; > +}; > + > +static void cmd_create_vdpa_port_parsed(void *parsed_result, > + struct cmdline *cl, > + __attribute__((unused)) void *data) { > + struct cmd_create_result *res =3D parsed_result; > + char ifname[MAX_PATH_LEN]; > + uint64_t flags =3D 0; > + > + strncpy(ifname, res->socket_path, MAX_PATH_LEN); > + if (dev_id < devcnt) > + start_vdpa(ifname, dev_id++, flags); > + else > + cmdline_printf(cl, "No available vdpa devices.\n"); } > + > +cmdline_parse_token_string_t cmd_action_create =3D > + TOKEN_STRING_INITIALIZER(struct cmd_create_result, action, "create"); > +cmdline_parse_token_string_t cmd_socket_path =3D > + TOKEN_STRING_INITIALIZER(struct cmd_create_result, socket_path, > NULL); > + > +cmdline_parse_inst_t cmd_create_vdpa_port =3D { > + .f =3D cmd_create_vdpa_port_parsed, /* function to call */ > + .data =3D NULL, /* 2nd arg of func */ > + .help_str =3D "Create an new vdpa port", > + .tokens =3D { /* token list, NULL terminated */ > + (void *)&cmd_action_create, > + (void *)&cmd_socket_path, > + NULL, > + }, > +}; > + > +cmdline_parse_ctx_t main_ctx[] =3D { > + (cmdline_parse_inst_t *)&cmd_help, > + (cmdline_parse_inst_t *)&cmd_create_vdpa_port, > + NULL, > +}; > + > +int > +main(int argc, char *argv[]) > +{ > + char ifname[MAX_PATH_LEN]; > + char ch; > + int i, did; > + int ret; > + uint64_t flags =3D 0; > + struct cmdline *cl; > + > + ret =3D rte_eal_init(argc, argv); > + if (ret < 0) > + rte_exit(EXIT_FAILURE, "eal init failed\n"); > + argc -=3D ret; > + argv +=3D ret; > + > + signal(SIGINT, signal_handler); > + signal(SIGTERM, signal_handler); > + > + data_init(); > + > + ret =3D parse_args(argc, argv); > + if (ret < 0) > + rte_exit(EXIT_FAILURE, "invalid argument\n"); > + > + if (interactive =3D=3D 1) { > + cl =3D cmdline_stdin_new(main_ctx, "vdpa> "); > + if (cl =3D=3D NULL) > + rte_panic("Cannot create cmdline instance\n"); > + cmdline_interact(cl); > + cmdline_stdin_exit(cl); > + } else { > + for (i =3D 0; i < RTE_MIN(MAX_VDPA_SAMPLE_PORTS, devcnt); > i++) { > + did =3D i; > + snprintf(ifname, sizeof(ifname), "%s%d", iface, i); > + vports[i].did =3D did; > + strncpy(vports[i].ifname, ifname, MAX_PATH_LEN); > + > + start_vdpa(ifname, did, flags); > + > + did++; > + } > + > + printf("enter \'q\' to quit\n"); > + while (scanf("%c", &ch)) { > + if (ch =3D=3D 'q') > + break; > + while (ch !=3D '\n') > + scanf("%c", &ch); > + printf("enter \'q\' to quit\n"); > + } > + } > + > + return 0; > +} > diff --git a/examples/vdpa/meson.build b/examples/vdpa/meson.build new fi= le > mode 100644 index 000000000..e85d84a76 > --- /dev/null > +++ b/examples/vdpa/meson.build > @@ -0,0 +1,11 @@ > +# SPDX-License-Identifier: BSD-3-Clause # Copyright(c) 2018 Intel > +Corporation > + > +# meson file, for building this example as part of a main DPDK build. > +# > +# To build this example as a standalone application with an > +already-installed # DPDK instance, use 'make' > + > +sources =3D files( > + 'main.c' > +) > -- > 2.18.0.rc1.1.g6f333ff2f