From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pf0-f178.google.com (mail-pf0-f178.google.com [209.85.192.178]) by dpdk.org (Postfix) with ESMTP id 21C74567A for ; Sun, 17 Jan 2016 20:57:40 +0100 (CET) Received: by mail-pf0-f178.google.com with SMTP id e65so146125363pfe.0 for ; Sun, 17 Jan 2016 11:57:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bigswitch-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:subject:date:message-id:in-reply-to:references; bh=bq2M0FPHH49uY+JrqQbBQYKCYMb6tVA0QxdtLIwTq5M=; b=Wxhrih+1TSUCCyHKe3S/66DYRPdZLxl7c72DEM0twzsCoF9/bP4+6f2eHZkpybgwGS W5ebCUt3Pmg/T2fsoehgs3K/TdIsSkXtwqMPfEzhb/fx/CXmzYxQmu0HdKPy7Wt1qsTS 9IoJLPC/4yqkWDCj7iQHuBpaXlgkQDDFzmnx9pYALbzqRNnz5H7YbW3bc9Q47+pxaoYZ iwmRhvKrs0LrA6SJwD8BiI7RUKCqHS+nyCHBSwy/OO6TY+VjTr8uBAYSuvkjRs857HKv 0fB77P10h7+s6r6hTQZaFADp9YjOOHyh9gMv2VWuywkD5WYXMvS1TM6Uqr1QaZM2+e3+ /slQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to :references; bh=bq2M0FPHH49uY+JrqQbBQYKCYMb6tVA0QxdtLIwTq5M=; b=QMJbtKy5y6gFKxE+RKWdSxUf+Vgvb9rTPk9A3WkxFy4rvreEc4x3+4k/Xq2FgdYV5Q jE3saMFpAZkSc4ifB6umEXq9crh28bB1iEfKTjpbunsR6d+gcv+qli3sb4QnAcIIsd9U IxCa3EBK/OcCgo81sbTr6dQ+q372IJM2jg3AGmkv3LBNXHWdZLjcpQQ/M22AvcUBuLTa FqowxbMy/uYdqh8b58D3xsJSg1emYq49SoGN7PBZUnAJEx/+qPgw8JDFHrKynIlsR+0O GpxsUJHQMaAAkutgXfF4ykEDLxzMT7dCnikDttofOx0SNENa2M+FNdrAN0up0EQzXTh8 oOjw== X-Gm-Message-State: ALoCoQm2WacFNMaRa9oid3OYdI5IvjCyd0DWAnfqu253IKv77Gpo4pw9g/k7XF9WxOHVB+XX/bTr583aqMw4YnHEtKPp5QQRpg== X-Received: by 10.98.79.4 with SMTP id d4mr30932688pfb.46.1453060659198; Sun, 17 Jan 2016 11:57:39 -0800 (PST) Received: from rlane-work.eng.bigswitch.com (c-67-188-28-208.hsd1.ca.comcast.net. [67.188.28.208]) by smtp.gmail.com with ESMTPSA id z15sm28715601pfa.71.2016.01.17.11.57.37 (version=TLS1_2 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Sun, 17 Jan 2016 11:57:38 -0800 (PST) From: Rich Lane X-Google-Original-From: Rich Lane To: dev@dpdk.org Date: Sun, 17 Jan 2016 11:57:18 -0800 Message-Id: <1453060638-58510-1-git-send-email-rlane@bigswitch.com> X-Mailer: git-send-email 1.9.1 In-Reply-To: <1452032049-94324-1-git-send-email-rlane@bigswitch.com> References: <1452032049-94324-1-git-send-email-rlane@bigswitch.com> Subject: [dpdk-dev] [PATCH v2 1/1] vhost: fix leak of fds and mmaps X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 Jan 2016 19:57:40 -0000 The common vhost code only supported a single mmap per device. vhost-user worked around this by saving the address/length/fd of each mmap after the end of the rte_virtio_memory struct. This only works if the vhost-user code frees dev->mem, since the common code is unaware of the extra info. The VHOST_USER_RESET_OWNER message is one situation where the common code frees dev->mem and leaks the fds and mappings. This happens every time I shut down a VM. The new code calls back into the implementation (vhost-user or vhost-cuse) to clean up these resources. The vhost-cuse changes are only compile tested. Signed-off-by: Rich Lane --- v1->v2: - Call into vhost-user/vhost-cuse to free mmaps. lib/librte_vhost/vhost-net.h | 6 ++++++ lib/librte_vhost/vhost_cuse/virtio-net-cdev.c | 12 ++++++++++++ lib/librte_vhost/vhost_user/vhost-net-user.c | 1 - lib/librte_vhost/vhost_user/virtio-net-user.c | 25 ++++++++++--------------- lib/librte_vhost/vhost_user/virtio-net-user.h | 1 - lib/librte_vhost/virtio-net.c | 8 +------- 6 files changed, 29 insertions(+), 24 deletions(-) diff --git a/lib/librte_vhost/vhost-net.h b/lib/librte_vhost/vhost-net.h index c69b60b..e8d7477 100644 --- a/lib/librte_vhost/vhost-net.h +++ b/lib/librte_vhost/vhost-net.h @@ -115,4 +115,10 @@ struct vhost_net_device_ops { struct vhost_net_device_ops const *get_virtio_net_callbacks(void); + +/* + * Implementation-specific cleanup. Defined by vhost-cuse and vhost-user. + */ +void vhost_impl_cleanup(struct virtio_net *dev); + #endif /* _VHOST_NET_CDEV_H_ */ diff --git a/lib/librte_vhost/vhost_cuse/virtio-net-cdev.c b/lib/librte_vhost/vhost_cuse/virtio-net-cdev.c index ae2c3fa..06bfd5f 100644 --- a/lib/librte_vhost/vhost_cuse/virtio-net-cdev.c +++ b/lib/librte_vhost/vhost_cuse/virtio-net-cdev.c @@ -421,3 +421,15 @@ int cuse_set_backend(struct vhost_device_ctx ctx, struct vhost_vring_file *file) return ops->set_backend(ctx, file); } + +void +vhost_impl_cleanup(struct virtio_net *dev) +{ + /* Unmap QEMU memory file if mapped. */ + if (dev->mem) { + munmap((void *)(uintptr_t)dev->mem->mapped_address, + (size_t)dev->mem->mapped_size); + free(dev->mem); + dev->mem = NULL; + } +} diff --git a/lib/librte_vhost/vhost_user/vhost-net-user.c b/lib/librte_vhost/vhost_user/vhost-net-user.c index 8b7a448..336efba 100644 --- a/lib/librte_vhost/vhost_user/vhost-net-user.c +++ b/lib/librte_vhost/vhost_user/vhost-net-user.c @@ -347,7 +347,6 @@ vserver_message_handler(int connfd, void *dat, int *remove) close(connfd); *remove = 1; free(cfd_ctx); - user_destroy_device(ctx); ops->destroy_device(ctx); return; diff --git a/lib/librte_vhost/vhost_user/virtio-net-user.c b/lib/librte_vhost/vhost_user/virtio-net-user.c index 2934d1c..190679f 100644 --- a/lib/librte_vhost/vhost_user/virtio-net-user.c +++ b/lib/librte_vhost/vhost_user/virtio-net-user.c @@ -339,21 +339,6 @@ user_set_vring_enable(struct vhost_device_ctx ctx, } void -user_destroy_device(struct vhost_device_ctx ctx) -{ - struct virtio_net *dev = get_device(ctx); - - if (dev && (dev->flags & VIRTIO_DEV_RUNNING)) - notify_ops->destroy_device(dev); - - if (dev && dev->mem) { - free_mem_region(dev); - free(dev->mem); - dev->mem = NULL; - } -} - -void user_set_protocol_features(struct vhost_device_ctx ctx, uint64_t protocol_features) { @@ -365,3 +350,13 @@ user_set_protocol_features(struct vhost_device_ctx ctx, dev->protocol_features = protocol_features; } + +void +vhost_impl_cleanup(struct virtio_net *dev) +{ + if (dev->mem) { + free_mem_region(dev); + free(dev->mem); + dev->mem = NULL; + } +} diff --git a/lib/librte_vhost/vhost_user/virtio-net-user.h b/lib/librte_vhost/vhost_user/virtio-net-user.h index b82108d..1140ee1 100644 --- a/lib/librte_vhost/vhost_user/virtio-net-user.h +++ b/lib/librte_vhost/vhost_user/virtio-net-user.h @@ -55,5 +55,4 @@ int user_get_vring_base(struct vhost_device_ctx, struct vhost_vring_state *); int user_set_vring_enable(struct vhost_device_ctx ctx, struct vhost_vring_state *state); -void user_destroy_device(struct vhost_device_ctx); #endif diff --git a/lib/librte_vhost/virtio-net.c b/lib/librte_vhost/virtio-net.c index de78a0f..50fc68c 100644 --- a/lib/librte_vhost/virtio-net.c +++ b/lib/librte_vhost/virtio-net.c @@ -199,13 +199,7 @@ cleanup_device(struct virtio_net *dev, int destroy) { uint32_t i; - /* Unmap QEMU memory file if mapped. */ - if (dev->mem) { - munmap((void *)(uintptr_t)dev->mem->mapped_address, - (size_t)dev->mem->mapped_size); - free(dev->mem); - dev->mem = NULL; - } + vhost_impl_cleanup(dev); for (i = 0; i < dev->virt_qp_nb; i++) { cleanup_vq(dev->virtqueue[i * VIRTIO_QNUM + VIRTIO_RXQ], destroy); -- 1.9.1