From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 26816A034F; Fri, 8 Oct 2021 12:56:54 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6CA074115F; Fri, 8 Oct 2021 12:56:08 +0200 (CEST) Received: from mail-pg1-f182.google.com (mail-pg1-f182.google.com [209.85.215.182]) by mails.dpdk.org (Postfix) with ESMTP id 13F27411E0 for ; Thu, 7 Oct 2021 20:44:41 +0200 (CEST) Received: by mail-pg1-f182.google.com with SMTP id s75so652451pgs.5 for ; Thu, 07 Oct 2021 11:44:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oneconvergence.com; s=google; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=yIejI0MtrgjFXIVeGJ+hPZwwtTwbMIY31H+ZhfzUP5A=; b=bqveofUcT55fahTkiuBl/vQF1bWGi07igBqPpyBZmUxSyMMIPkXw9FCtVPATAMkm5s a+qDyz0rSsvcjdbrcPtQXmrySQajXixB4JLvR6YH1T8z0rsjtD7XXVTYLGXlmq93aJGT kLLq5VR/R3DXKAE3++MqpCUbjTAn9KEffVvgY= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=yIejI0MtrgjFXIVeGJ+hPZwwtTwbMIY31H+ZhfzUP5A=; b=UmcjsnWG7Aj1rVnSUq+HacMEZQeAY+awMWme5III9yKbElx8hs++M5kCxt+cT40bsv ryGzNwnX8gKSCr4edKiaTS9X0BZTR6UaMBxd2oUmxMpeSKL0XV75L4fADnXwLoc2UK/f V32j/OLyCkJGq6XYVBxDFktLTPMF3romNHmc4Z7cwz0a6R7JG3A7AIPyxI9fMTMHCIQ8 CJvAkWUTS7hWur+5BqJMCToM5YWIGOMZUtWyd39Ie0vgCAQWKIzMvqC9ovPltpwjCmzA L88Rdf+T56rxll0HU2JPhQeYn1fncsssDzDQ5LQN2Id/jMxok6AIC9IblpkYsWY1KEX3 BIpA== X-Gm-Message-State: AOAM533APdLhXR9JPNB8IPeR4QLHCVcTxBHkLdJthnAO1DYZcIJVrsff SxpRsxdszAEK/gylTkzwUCnaaQ== X-Google-Smtp-Source: ABdhPJzDNV4FuKpBJszfAygSPquXR/3DG/CprzZ5zDgg4mXzwg2XMIFpn2pzINX+3lSOxAp/ykkZVw== X-Received: by 2002:a63:ec0f:: with SMTP id j15mr989361pgh.476.1633632280162; Thu, 07 Oct 2021 11:44:40 -0700 (PDT) Received: from srikanth-ThinkPad-T450.domain.name ([136.185.113.102]) by smtp.gmail.com with ESMTPSA id c11sm3311586pji.38.2021.10.07.11.44.37 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 07 Oct 2021 11:44:39 -0700 (PDT) From: Srikanth Kaka To: Matan Azrad , Viacheslav Ovsiienko Cc: dev@dpdk.org, Vag Singh , Anand Thulasiram , Srikanth Kaka Date: Fri, 8 Oct 2021 00:13:19 +0530 Message-Id: <20211007184350.73858-11-srikanth.k@oneconvergence.com> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20211007184350.73858-1-srikanth.k@oneconvergence.com> References: <20211007184350.73858-1-srikanth.k@oneconvergence.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Mailman-Approved-At: Fri, 08 Oct 2021 12:55:54 +0200 Subject: [dpdk-dev] [PATCH v2 10/41] net/mlx5: socket for inter-process communication X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Initialise the socket to communicate with the secondary process mlx5_os.h and mlx5_socket.c are equivalent to Linux files of the same name Signed-off-by: Srikanth Kaka Signed-off-by: Vag Singh Signed-off-by: Anand Thulasiram --- drivers/net/mlx5/freebsd/mlx5_os.h | 22 +++ drivers/net/mlx5/freebsd/mlx5_socket.c | 249 +++++++++++++++++++++++++ 2 files changed, 271 insertions(+) create mode 100644 drivers/net/mlx5/freebsd/mlx5_os.h create mode 100644 drivers/net/mlx5/freebsd/mlx5_socket.c diff --git a/drivers/net/mlx5/freebsd/mlx5_os.h b/drivers/net/mlx5/freebsd/mlx5_os.h new file mode 100644 index 0000000000..af7cbeb418 --- /dev/null +++ b/drivers/net/mlx5/freebsd/mlx5_os.h @@ -0,0 +1,22 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright 2015 6WIND S.A. + * Copyright 2020 Mellanox Technologies, Ltd + */ + +#ifndef RTE_PMD_MLX5_OS_H_ +#define RTE_PMD_MLX5_OS_H_ + +#include + +/* verb enumerations translations to local enums. */ +enum { + MLX5_FS_NAME_MAX = IBV_SYSFS_NAME_MAX + 1, + MLX5_FS_PATH_MAX = IBV_SYSFS_PATH_MAX + 1 +}; + +/* Maximal data of sendmsg message(in bytes). */ +#define MLX5_SENDMSG_MAX 64 + +#define MLX5_NAMESIZE IF_NAMESIZE + +#endif /* RTE_PMD_MLX5_OS_H_ */ diff --git a/drivers/net/mlx5/freebsd/mlx5_socket.c b/drivers/net/mlx5/freebsd/mlx5_socket.c new file mode 100644 index 0000000000..6356b66dc4 --- /dev/null +++ b/drivers/net/mlx5/freebsd/mlx5_socket.c @@ -0,0 +1,249 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright 2019 Mellanox Technologies, Ltd + */ + +#ifndef _GNU_SOURCE +#define _GNU_SOURCE +#endif + +#include +#include +#include +#include +#include +#include +#include + +#include "rte_eal.h" +#include "mlx5_utils.h" +#include "mlx5.h" + +/* PMD socket service for tools. */ + +#define MLX5_SOCKET_PATH "/var/tmp/dpdk_net_mlx5_%d" + +int server_socket; /* Unix socket for primary process. */ +struct rte_intr_handle server_intr_handle; /* Interrupt handler. */ + +/** + * Handle server pmd socket interrupts. + */ +static void +mlx5_pmd_socket_handle(void *cb __rte_unused) +{ + int conn_sock; + int ret; + struct cmsghdr *cmsg = NULL; + uint32_t data[MLX5_SENDMSG_MAX / sizeof(uint32_t)]; + uint64_t flow_ptr = 0; + uint8_t buf[CMSG_SPACE(sizeof(int))] = { 0 }; + struct iovec io = { + .iov_base = data, + .iov_len = sizeof(data), + }; + struct msghdr msg = { + .msg_iov = &io, + .msg_iovlen = 1, + .msg_control = buf, + .msg_controllen = sizeof(buf), + }; + + uint32_t port_id; + int fd; + FILE *file = NULL; + struct rte_eth_dev *dev; + struct rte_flow_error err; + struct mlx5_flow_dump_req *dump_req; + struct mlx5_flow_dump_ack *dump_ack; + + memset(data, 0, sizeof(data)); + /* Accept the connection from the client. */ + conn_sock = accept(server_socket, NULL, NULL); + if (conn_sock < 0) { + DRV_LOG(WARNING, "connection failed: %s", strerror(errno)); + return; + } + ret = recvmsg(conn_sock, &msg, MSG_WAITALL); + if (ret != sizeof(struct mlx5_flow_dump_req)) { + DRV_LOG(WARNING, "wrong message received: %s", + strerror(errno)); + goto error; + } + + /* Receive file descriptor. */ + cmsg = CMSG_FIRSTHDR(&msg); + if (cmsg == NULL || cmsg->cmsg_type != SCM_RIGHTS || + cmsg->cmsg_len < sizeof(int)) { + DRV_LOG(WARNING, "invalid file descriptor message"); + goto error; + } + memcpy(&fd, CMSG_DATA(cmsg), sizeof(fd)); + file = fdopen(fd, "w"); + if (!file) { + DRV_LOG(WARNING, "Failed to open file"); + goto error; + } + /* Receive port number. */ + if (msg.msg_iovlen != 1 || msg.msg_iov->iov_len < sizeof(uint16_t)) { + DRV_LOG(WARNING, "wrong port number message"); + goto error; + } + + dump_req = (struct mlx5_flow_dump_req *)msg.msg_iov->iov_base; + if (dump_req) { + port_id = dump_req->port_id; + flow_ptr = dump_req->flow_id; + } else { + DRV_LOG(WARNING, "Invalid message"); + goto error; + } + + if (!rte_eth_dev_is_valid_port(port_id)) { + DRV_LOG(WARNING, "Invalid port %u", port_id); + goto error; + } + + /* Dump flow. */ + dev = &rte_eth_devices[port_id]; + if (flow_ptr == 0) + ret = mlx5_flow_dev_dump(dev, NULL, file, NULL); + else + ret = mlx5_flow_dev_dump(dev, + (struct rte_flow *)((uintptr_t)flow_ptr), file, &err); + + /* Set-up the ancillary data and reply. */ + msg.msg_controllen = 0; + msg.msg_control = NULL; + msg.msg_iovlen = 1; + msg.msg_iov = &io; + dump_ack = (struct mlx5_flow_dump_ack *)data; + dump_ack->rc = -ret; + io.iov_len = sizeof(struct mlx5_flow_dump_ack); + io.iov_base = dump_ack; + do { + ret = sendmsg(conn_sock, &msg, 0); + } while (ret < 0 && errno == EINTR); + if (ret < 0) + DRV_LOG(WARNING, "failed to send response %s", + strerror(errno)); +error: + if (conn_sock >= 0) + close(conn_sock); + if (file) + fclose(file); +} + +/** + * Install interrupt handler. + * + * @param dev + * Pointer to Ethernet device. + * @return + * 0 on success, a negative errno value otherwise. + */ +static int +mlx5_pmd_interrupt_handler_install(void) +{ + MLX5_ASSERT(server_socket); + server_intr_handle.fd = server_socket; + server_intr_handle.type = RTE_INTR_HANDLE_EXT; + return rte_intr_callback_register(&server_intr_handle, + mlx5_pmd_socket_handle, NULL); +} + +/** + * Uninstall interrupt handler. + */ +static void +mlx5_pmd_interrupt_handler_uninstall(void) +{ + if (server_socket) { + mlx5_intr_callback_unregister(&server_intr_handle, + mlx5_pmd_socket_handle, + NULL); + } + server_intr_handle.fd = 0; + server_intr_handle.type = RTE_INTR_HANDLE_UNKNOWN; +} + +/** + * Initialise the socket to communicate with the secondary process + * + * @param[in] dev + * Pointer to Ethernet device. + * + * @return + * 0 on success, a negative value otherwise. + */ +int +mlx5_pmd_socket_init(void) +{ + struct sockaddr_un sun = { + .sun_family = AF_UNIX, + }; + int ret; + int flags; + + MLX5_ASSERT(rte_eal_process_type() == RTE_PROC_PRIMARY); + if (server_socket) + return 0; + /* + * Initialize the socket to communicate with the secondary + * process. + */ + ret = socket(AF_UNIX, SOCK_STREAM, 0); + if (ret < 0) { + DRV_LOG(WARNING, "Failed to open mlx5 socket: %s", + strerror(errno)); + goto error; + } + server_socket = ret; + flags = fcntl(server_socket, F_GETFL, 0); + if (flags == -1) + goto error; + ret = fcntl(server_socket, F_SETFL, flags | O_NONBLOCK); + if (ret < 0) + goto error; + snprintf(sun.sun_path, sizeof(sun.sun_path), MLX5_SOCKET_PATH, + getpid()); + remove(sun.sun_path); + ret = bind(server_socket, (const struct sockaddr *)&sun, sizeof(sun)); + if (ret < 0) { + DRV_LOG(WARNING, + "cannot bind mlx5 socket: %s", strerror(errno)); + goto close; + } + ret = listen(server_socket, 0); + if (ret < 0) { + DRV_LOG(WARNING, "cannot listen on mlx5 socket: %s", + strerror(errno)); + goto close; + } + if (mlx5_pmd_interrupt_handler_install()) { + DRV_LOG(WARNING, "cannot register interrupt handler for mlx5 socket: %s", + strerror(errno)); + goto close; + } + return 0; +close: + remove(sun.sun_path); +error: + claim_zero(close(server_socket)); + server_socket = 0; + DRV_LOG(ERR, "Cannot initialize socket: %s", strerror(errno)); + return -errno; +} + +/** + * Un-Initialize the pmd socket + */ +RTE_FINI(mlx5_pmd_socket_uninit) +{ + if (!server_socket) + return; + mlx5_pmd_interrupt_handler_uninstall(); + claim_zero(close(server_socket)); + server_socket = 0; + MKSTR(path, MLX5_SOCKET_PATH, getpid()); + claim_zero(remove(path)); +} -- 2.30.2