From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 11197A0C4E; Mon, 25 Oct 2021 16:29:22 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3CCD441166; Mon, 25 Oct 2021 16:29:04 +0200 (CEST) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by mails.dpdk.org (Postfix) with ESMTP id D278841166 for ; Mon, 25 Oct 2021 16:29:01 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1635172141; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qW6S20w3InuJtzeN0fFaDBdoYernlE8kiFVR9lByLuA=; b=Rt+oWYiCISGXPAOO2ny5q+LEWjo2zfnvtjv8LbebQi4tdHljm9few6ekljKTMYfqCM/dSF k0WK5/8yN+GNVJudduDtLEopAkZ8939k87Hr3MELYaQZjz2vyMftGEz0Lel+wEP32sSnVM bInNUEv7JRs7qJ7ycvReWcoNCWiSGp8= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-539-x7iHAigaMsGUsq_H4noohw-1; Mon, 25 Oct 2021 10:28:57 -0400 X-MC-Unique: x7iHAigaMsGUsq_H4noohw-1 Received: from smtp.corp.redhat.com (int-mx08.intmail.prod.int.phx2.redhat.com [10.5.11.23]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id E24709F92D; Mon, 25 Oct 2021 14:28:55 +0000 (UTC) Received: from dmarchan.remote.csb (unknown [10.40.192.64]) by smtp.corp.redhat.com (Postfix) with ESMTP id 165A119C79; Mon, 25 Oct 2021 14:28:51 +0000 (UTC) From: David Marchand To: hkalra@marvell.com, dev@dpdk.org Cc: dmitry.kozliuk@gmail.com, rasland@nvidia.com, thomas@monjalon.net, Anatoly Burakov , Nithin Dabilpuram , Kiran Kumar K , Sunil Kumar Kori , Satha Rao Date: Mon, 25 Oct 2021 16:27:12 +0200 Message-Id: <20211025142712.1273-10-david.marchand@redhat.com> In-Reply-To: <20211025142712.1273-1-david.marchand@redhat.com> References: <20211022204934.132186-1-hkalra@marvell.com> <20211025142712.1273-1-david.marchand@redhat.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 2.84 on 10.5.11.23 Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=david.marchand@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset="US-ASCII" Subject: [dpdk-dev] [PATCH v8 9/9] interrupts: extend event list X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" From: Harman Kalra Dynamically allocating the efds and elist array of intr_handle structure, based on size provided by user. Eg size can be MSIX interrupts supported by a PCI device. Signed-off-by: Harman Kalra Signed-off-by: David Marchand Acked-by: Dmitry Kozlyuk --- Changes since v6: - removed unneeded checks on elist/efds array initialisation, Changes since v5: - split from patch5, --- drivers/bus/pci/linux/pci_vfio.c | 6 ++ drivers/common/cnxk/roc_platform.h | 1 + lib/eal/common/eal_common_interrupts.c | 95 +++++++++++++++++++++++++- lib/eal/common/eal_interrupts.h | 5 +- 4 files changed, 102 insertions(+), 5 deletions(-) diff --git a/drivers/bus/pci/linux/pci_vfio.c b/drivers/bus/pci/linux/pci_vfio.c index 7b2f8296c5..f622e7f8e6 100644 --- a/drivers/bus/pci/linux/pci_vfio.c +++ b/drivers/bus/pci/linux/pci_vfio.c @@ -266,6 +266,12 @@ pci_vfio_setup_interrupts(struct rte_pci_device *dev, int vfio_dev_fd) return -1; } + /* Reallocate the efds and elist fields of intr_handle based + * on PCI device MSIX size. + */ + if (rte_intr_event_list_update(dev->intr_handle, irq.count)) + return -1; + /* if this vector cannot be used with eventfd, fail if we explicitly * specified interrupt type, otherwise continue */ if ((irq.flags & VFIO_IRQ_INFO_EVENTFD) == 0) { diff --git a/drivers/common/cnxk/roc_platform.h b/drivers/common/cnxk/roc_platform.h index 60227b72d0..5da23fe5f8 100644 --- a/drivers/common/cnxk/roc_platform.h +++ b/drivers/common/cnxk/roc_platform.h @@ -121,6 +121,7 @@ #define plt_intr_instance_alloc rte_intr_instance_alloc #define plt_intr_instance_dup rte_intr_instance_dup #define plt_intr_instance_free rte_intr_instance_free +#define plt_intr_event_list_update rte_intr_event_list_update #define plt_intr_max_intr_get rte_intr_max_intr_get #define plt_intr_max_intr_set rte_intr_max_intr_set #define plt_intr_nb_efd_get rte_intr_nb_efd_get diff --git a/lib/eal/common/eal_common_interrupts.c b/lib/eal/common/eal_common_interrupts.c index 2146b933bb..da3ab006b8 100644 --- a/lib/eal/common/eal_common_interrupts.c +++ b/lib/eal/common/eal_common_interrupts.c @@ -53,10 +53,46 @@ struct rte_intr_handle *rte_intr_instance_alloc(uint32_t flags) return NULL; } + if (uses_rte_memory) { + intr_handle->efds = rte_zmalloc(NULL, + RTE_MAX_RXTX_INTR_VEC_ID * sizeof(int), 0); + } else { + intr_handle->efds = calloc(RTE_MAX_RXTX_INTR_VEC_ID, + sizeof(int)); + } + if (intr_handle->efds == NULL) { + RTE_LOG(ERR, EAL, "Fail to allocate event fd list\n"); + rte_errno = ENOMEM; + goto fail; + } + + if (uses_rte_memory) { + intr_handle->elist = rte_zmalloc(NULL, + RTE_MAX_RXTX_INTR_VEC_ID * sizeof(struct rte_epoll_event), + 0); + } else { + intr_handle->elist = calloc(RTE_MAX_RXTX_INTR_VEC_ID, + sizeof(struct rte_epoll_event)); + } + if (intr_handle->elist == NULL) { + RTE_LOG(ERR, EAL, "fail to allocate event fd list\n"); + rte_errno = ENOMEM; + goto fail; + } + intr_handle->alloc_flags = flags; intr_handle->nb_intr = RTE_MAX_RXTX_INTR_VEC_ID; return intr_handle; +fail: + if (uses_rte_memory) { + rte_free(intr_handle->efds); + rte_free(intr_handle); + } else { + free(intr_handle->efds); + free(intr_handle); + } + return NULL; } struct rte_intr_handle *rte_intr_instance_dup(const struct rte_intr_handle *src) @@ -83,14 +119,69 @@ struct rte_intr_handle *rte_intr_instance_dup(const struct rte_intr_handle *src) return intr_handle; } +int rte_intr_event_list_update(struct rte_intr_handle *intr_handle, int size) +{ + struct rte_epoll_event *tmp_elist; + bool uses_rte_memory; + int *tmp_efds; + + CHECK_VALID_INTR_HANDLE(intr_handle); + + if (size == 0) { + RTE_LOG(DEBUG, EAL, "Size can't be zero\n"); + rte_errno = EINVAL; + goto fail; + } + + uses_rte_memory = + RTE_INTR_INSTANCE_USES_RTE_MEMORY(intr_handle->alloc_flags); + if (uses_rte_memory) { + tmp_efds = rte_realloc(intr_handle->efds, size * sizeof(int), + 0); + } else { + tmp_efds = realloc(intr_handle->efds, size * sizeof(int)); + } + if (tmp_efds == NULL) { + RTE_LOG(ERR, EAL, "Failed to realloc the efds list\n"); + rte_errno = ENOMEM; + goto fail; + } + intr_handle->efds = tmp_efds; + + if (uses_rte_memory) { + tmp_elist = rte_realloc(intr_handle->elist, + size * sizeof(struct rte_epoll_event), 0); + } else { + tmp_elist = realloc(intr_handle->elist, + size * sizeof(struct rte_epoll_event)); + } + if (tmp_elist == NULL) { + RTE_LOG(ERR, EAL, "Failed to realloc the event list\n"); + rte_errno = ENOMEM; + goto fail; + } + intr_handle->elist = tmp_elist; + + intr_handle->nb_intr = size; + + return 0; +fail: + return -rte_errno; +} + void rte_intr_instance_free(struct rte_intr_handle *intr_handle) { if (intr_handle == NULL) return; - if (RTE_INTR_INSTANCE_USES_RTE_MEMORY(intr_handle->alloc_flags)) + if (RTE_INTR_INSTANCE_USES_RTE_MEMORY(intr_handle->alloc_flags)) { + rte_free(intr_handle->efds); + rte_free(intr_handle->elist); rte_free(intr_handle); - else + } else { + free(intr_handle->efds); + free(intr_handle->elist); free(intr_handle); + } } int rte_intr_fd_set(struct rte_intr_handle *intr_handle, int fd) diff --git a/lib/eal/common/eal_interrupts.h b/lib/eal/common/eal_interrupts.h index 1a4e5573b2..482781b862 100644 --- a/lib/eal/common/eal_interrupts.h +++ b/lib/eal/common/eal_interrupts.h @@ -21,9 +21,8 @@ struct rte_intr_handle { uint8_t efd_counter_size; /**< size of efd counter, used for vdev */ uint16_t nb_intr; /**< Max vector count, default RTE_MAX_RXTX_INTR_VEC_ID */ - int efds[RTE_MAX_RXTX_INTR_VEC_ID]; /**< intr vectors/efds mapping */ - struct rte_epoll_event elist[RTE_MAX_RXTX_INTR_VEC_ID]; - /**< intr vector epoll event */ + int *efds; /**< intr vectors/efds mapping */ + struct rte_epoll_event *elist; /**< intr vector epoll event */ uint16_t vec_list_size; int *intr_vec; /**< intr vector number array */ }; -- 2.23.0