From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4E8C9A0A05; Tue, 19 Jan 2021 12:57:26 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 244D2140D94; Tue, 19 Jan 2021 12:57:21 +0100 (CET) Received: from mail-ej1-f54.google.com (mail-ej1-f54.google.com [209.85.218.54]) by mails.dpdk.org (Postfix) with ESMTP id 8AB65140DA5 for ; Tue, 19 Jan 2021 12:57:19 +0100 (CET) Received: by mail-ej1-f54.google.com with SMTP id hs11so25773088ejc.1 for ; Tue, 19 Jan 2021 03:57:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netronome-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=dYh5zA6mfDKxUZ6+iSuzC93WGzYMzqo4Fc7JQXkjqD4=; b=y/ZzWJ3OOi3jeFOR7Z0+9Sn5Ew9xYdSRR58Fm/G4cxTNSIf3ZynOtEkLTWMoH7aJnx 4je+NXQDVorYWybyPLgOGkDUe+IhmxP7rU2kxJSXpXqLIIP/lNE64ei8hDaqQrs2SBn6 kbcKnfB8eZ/7cVpqAwymtmwyUEk9TqvP5xQvD1oMKH/X/UZqEb9iPYBUP0Z976k0kR+4 AJO1H5oBL8TaN3/Ruz614wQ9eSQuRf+rVYA6MGGPPBlij1Tgic6QcNA3BCcm+eSjKVDu f35sO+H3oLd3Z1uCnh8nco6iavUMlblGRN9uB/z/i4PaEdF+k3Su3m81+Bmku3iyyqT5 X8OQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=dYh5zA6mfDKxUZ6+iSuzC93WGzYMzqo4Fc7JQXkjqD4=; b=erc51WjnrsMj/iCPya7TYVDdtlwv3dlm+o7nJNQRVvMoF1e+OWUj20V0F741Pk5hK3 5WXRoe576MaHc8E4BkdfteDz5aziem1YHpCQN1IEnXo9HpFP58ze90mUDBUhh0ZGhry3 AQfOBp+TUN1bfmC6ovYVwMLRSQ3B0+5aXPEcMKOleumfeUl3QfzmnVHlpLik1G0NbKul eIViEhZqfHuCDDdjDyLNFIXaXHGVkOGtBH2aMewH1ldrGMIcbKawxU5tgn2rFo3GT3dp JypBvFI3tQ1tU7cettj4HbaOSU0wjeo4Dc3P/DMbchnScRfVbFGgG2eH/bgNG4mI+yKy Mqdg== X-Gm-Message-State: AOAM531Lu/lkzjbvDivY8auS6yUErbQ4cPtNs/hQizAwnl5StH1ctA28 WWvfprMmDDx5xwELeObXSmyZ0FAkfmRbbSy3ceEngLRWZmS9RDPs/74XXRAYCPx+29OzPrWzIGN zeJ5Q8JXing5NU2WOpUGLvi6VTpe/mapS5zCjVBFWNPTa9h75lod4ILknUsxGoQdQGyQ= X-Google-Smtp-Source: ABdhPJxJOJ2jELmLXuOdDY4qL62hRX+fTwSvLAnXDC+RT92QW4MxyG8VH5EIipbITaFMQnch6/igBQ== X-Received: by 2002:a17:906:68d0:: with SMTP id y16mr2949804ejr.128.1611057439141; Tue, 19 Jan 2021 03:57:19 -0800 (PST) Received: from localhost.localdomain (dsl-197-245-67-23.voxdsl.co.za. [197.245.67.23]) by smtp.gmail.com with ESMTPSA id b17sm2406467ejj.83.2021.01.19.03.57.17 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 19 Jan 2021 03:57:18 -0800 (PST) From: Heinrich Kuhn To: dev@dpdk.org Cc: Heinrich Kuhn , Louis Peens , Simon Horman Date: Tue, 19 Jan 2021 13:56:17 +0200 Message-Id: <20210119115616.1807-3-heinrich.kuhn@netronome.com> X-Mailer: git-send-email 2.30.0 In-Reply-To: <20210119115616.1807-1-heinrich.kuhn@netronome.com> References: <20210119115616.1807-1-heinrich.kuhn@netronome.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Subject: [dpdk-dev] [PATCH 2/2] net/nfp: free port private data in dev close callback X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Free the private data of a port when the .dev_close() callback is invoked. For NFP6000/4000 devices multiple ports may exist under a single PF device. In this situation the PF resources will only be freed when all the ports associated with the PF has been freed too. PF hot plugging isn't explicitly supported for NFP6000/4000 devices but all the private data of all the ports under the PF in question will be freed upon device removal. Signed-off-by: Heinrich Kuhn Reviewed-by: Louis Peens Signed-off-by: Simon Horman --- drivers/net/nfp/nfp_net.c | 63 ++++++++++++++++++++++++++++++++------- 1 file changed, 52 insertions(+), 11 deletions(-) diff --git a/drivers/net/nfp/nfp_net.c b/drivers/net/nfp/nfp_net.c index 9b9bd9e3d..b2cebf3e7 100644 --- a/drivers/net/nfp/nfp_net.c +++ b/drivers/net/nfp/nfp_net.c @@ -59,6 +59,7 @@ static int nfp_net_infos_get(struct rte_eth_dev *dev, struct rte_eth_dev_info *dev_info); static int nfp_net_init(struct rte_eth_dev *eth_dev); static int nfp_pf_init(struct rte_eth_dev *eth_dev); +static int nfp_pci_uninit(struct rte_eth_dev *eth_dev); static int nfp_init_phyports(struct nfp_pf_dev *pf_dev); static int nfp_net_link_update(struct rte_eth_dev *dev, int wait_to_complete); static int nfp_net_promisc_enable(struct rte_eth_dev *dev); @@ -909,8 +910,34 @@ nfp_net_close(struct rte_eth_dev *dev) (struct nfp_net_rxq *)dev->data->rx_queues[i]); } + /* Only free PF resources after all physical ports have been closed */ + if (pci_dev->id.device_id == PCI_DEVICE_ID_NFP4000_PF_NIC || + pci_dev->id.device_id == PCI_DEVICE_ID_NFP6000_PF_NIC) { + struct nfp_pf_dev *pf_dev; + pf_dev = NFP_NET_DEV_PRIVATE_TO_PF(dev->data->dev_private); + + /* Mark this port as unused and free device priv resources*/ + nn_cfg_writeb(hw, NFP_NET_CFG_LSC, 0xff); + pf_dev->ports[hw->idx] = NULL; + rte_eth_dev_release_port(dev); + + for (i = 0; i < pf_dev->total_phyports; i++) { + /* Check to see if ports are still in use */ + if (pf_dev->ports[i]) + return 0; + } + + /* Now it is safe to free all PF resources */ + PMD_INIT_LOG(INFO, "Freeing PF resources"); + nfp_cpp_area_free(pf_dev->ctrl_area); + nfp_cpp_area_free(pf_dev->hwqueues_area); + free(pf_dev->hwinfo); + free(pf_dev->sym_tbl); + nfp_cpp_free(pf_dev->cpp); + rte_free(pf_dev); + } + rte_intr_disable(&pci_dev->intr_handle); - nn_cfg_writeb(hw, NFP_NET_CFG_LSC, 0xff); /* unregister callback func from eal lib */ rte_intr_callback_unregister(&pci_dev->intr_handle, @@ -3765,6 +3792,29 @@ static const struct rte_pci_id pci_id_nfp_vf_net_map[] = { }, }; +static int nfp_pci_uninit(struct rte_eth_dev *eth_dev) +{ + struct rte_pci_device *pci_dev; + uint16_t port_id; + + pci_dev = RTE_ETH_DEV_TO_PCI(eth_dev); + + if (pci_dev->id.device_id == PCI_DEVICE_ID_NFP4000_PF_NIC || + pci_dev->id.device_id == PCI_DEVICE_ID_NFP6000_PF_NIC) { + /* Free up all physical ports under PF */ + RTE_ETH_FOREACH_DEV_OF(port_id, &pci_dev->device) + rte_eth_dev_close(port_id); + /* + * Ports can be closed and freed but hotplugging is not + * currently supported + */ + return -ENOTSUP; + } + + /* VF cleanup, just free private port data */ + return nfp_net_close(eth_dev); +} + static int eth_nfp_pci_probe(struct rte_pci_driver *pci_drv __rte_unused, struct rte_pci_device *pci_dev) { @@ -3774,16 +3824,7 @@ static int eth_nfp_pci_probe(struct rte_pci_driver *pci_drv __rte_unused, static int eth_nfp_pci_remove(struct rte_pci_device *pci_dev) { - struct rte_eth_dev *eth_dev; - - eth_dev = rte_eth_dev_allocated(pci_dev->device.name); - if (eth_dev == NULL) - return 0; /* port already released */ - if ((pci_dev->id.device_id == PCI_DEVICE_ID_NFP4000_PF_NIC) || - (pci_dev->id.device_id == PCI_DEVICE_ID_NFP6000_PF_NIC)) - return -ENOTSUP; - - return rte_eth_dev_pci_generic_remove(pci_dev, NULL); + return rte_eth_dev_pci_generic_remove(pci_dev, nfp_pci_uninit); } static struct rte_pci_driver rte_nfp_net_pf_pmd = { -- 2.30.0