From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mailout4.w1.samsung.com (mailout4.w1.samsung.com [210.118.77.14]) by dpdk.org (Postfix) with ESMTP id 4F1743195 for ; Tue, 12 Jan 2016 09:39:22 +0100 (CET) Received: from eucpsbgm2.samsung.com (unknown [203.254.199.245]) by mailout4.w1.samsung.com (Oracle Communications Messaging Server 7.0.5.31.0 64bit (built May 5 2014)) with ESMTP id <0O0U0099301KFS50@mailout4.w1.samsung.com> for dev@dpdk.org; Tue, 12 Jan 2016 08:39:20 +0000 (GMT) X-AuditID: cbfec7f5-f79b16d000005389-73-5694bbb84823 Received: from eusync3.samsung.com ( [203.254.199.213]) by eucpsbgm2.samsung.com (EUCPMTA) with SMTP id B7.52.21385.8BBB4965; Tue, 12 Jan 2016 08:39:20 +0000 (GMT) Received: from fedinw7x64 ([106.109.131.169]) by eusync3.samsung.com (Oracle Communications Messaging Server 7.0.5.31.0 64bit (built May 5 2014)) with ESMTPA id <0O0U00IOK01I5O70@eusync3.samsung.com>; Tue, 12 Jan 2016 08:39:20 +0000 (GMT) From: Pavel Fedin To: 'Rich Lane' References: <1446748276-132087-1-git-send-email-jianfeng.tan@intel.com> <1452426182-86851-1-git-send-email-jianfeng.tan@intel.com> <058a01d14c7b$5cdc60d0$16952270$@samsung.com> <5693CFE4.4060405@intel.com> <009a01d14d0c$3ab6cd60$b0246820$@samsung.com> In-reply-to: Date: Tue, 12 Jan 2016 11:39:18 +0300 Message-id: <00b101d14d14$bab82510$30286f30$@samsung.com> MIME-version: 1.0 Content-type: text/plain; charset=utf-8 Content-transfer-encoding: quoted-printable X-Mailer: Microsoft Outlook 14.0 Thread-index: AQLOfZuJ4skKn5NxqR5aD7duH+7e0wGBr/PNAeo3hAkCmaBQ8QL0azowAiKt1OWcpEeuoA== Content-language: ru X-Brightmail-Tracker: H4sIAAAAAAAAA+NgFprDIsWRmVeSWpSXmKPExsVy+t/xq7o7dk8JM/j5lNNi7ssfTBbvPm1n smifeZbJonv2FzaLv7NbWS3+/3rFanGs5xOrxaFDhxktNr2bxGpxfcIFVgcujweXbzJ5/Fqw lNWj5chbVo/G5xIei/e8ZPJofvGcxWPeyUCP9/uusgVwRHHZpKTmZJalFunbJXBlLP+3hqXg YXzF0Qu3GBsYrwV3MXJySAiYSPy+eIUNwhaTuHBvPZDNxSEksJRRomXPPxYI5zujxPGJm5hB qtgE1CVOf/3AAmKLCGhK3J7ZxwhSxCywj0nix4w37BAdJ5gkFu59zA5SxSkQLLF03k6gDg4O YQFTiY8LhEHCLAKqEnfa3rGC2LwClhL9D1czQtiCEj8m3wMrZwZaNmVKLkiYWUBb4sm7C6wQ lypI7Dj7mhHihgiJ9omrmSBqRCSm/bvHPIFRaBaSSbMQJs1CMmkWko4FjCyrGEVTS5MLipPS c430ihNzi0vz0vWS83M3MULi7OsOxqXHrA4xCnAwKvHwZrBPCRNiTSwrrsw9xCjBwawkwmu3 BSjEm5JYWZValB9fVJqTWnyIUZqDRUmcd+au9yFCAumJJanZqakFqUUwWSYOTqkGRrGFHq7h Uxt17X0aLWUW1DCs+x+wMZnzmrjkyX71idlnjwntcGzfOiNgybe5qU7umyuDj8edZfJZn6oq 7s7rtEvmisROve+hT8XP8LdM/KetoHc5wv/5xw9bGq2fN7svmh/y+9SV86qbj6193LAk/XNe xiK7FR7LO9kkps7NN5afW8SU1pb9QomlOCPRUIu5qDgRAOFjGtevAgAA Cc: nakajima.yoshihiro@lab.ntt.co.jp, "'Michael S. Tsirkin'" , dev@dpdk.org, ann.zhuangyanying@huawei.com Subject: Re: [dpdk-dev] [PATCH 0/4] virtio support for container X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 Jan 2016 08:39:22 -0000 Hello! > See my reply to "mem: add API to obstain memory-backed file info" for = a workaround. With fixes for that and the TUNSETVNETHDRSZ issue I was = able to > get traffic running over vhost-user. With ovs or test apps? I still have problems with ovs after this. = Packets go from host to container, but not back. Here is host-side log = (i added also GPA display in order to debug the problem you pointed at): --- cut --- Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: new = virtio connection is 38 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: new = device, handle is 0 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_OWNER Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_GET_FEATURES Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_FEATURES Jan 12 11:23:32 nfv_test_x86_64 kernel: device ovs-netdev entered = promiscuous mode Jan 12 11:23:32 nfv_test_x86_64 kernel: device ovs0 entered promiscuous = mode Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_MEM_TABLE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: mapped = region 0 fd:39 to:0x7f0ddea00000 sz:0x20000000 off:0x0 = GPA:0x7f7159000000 align:0x200000 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:0 file:49 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:0 file:50 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:1 file:51 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:1 file:52 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is now ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_FEATURES Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_MEM_TABLE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: mapped = region 0 fd:53 to:0x7f0ddea00000 sz:0x20000000 off:0x0 = GPA:0x7f7159000000 align:0x200000 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:0 file:39 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:0 file:49 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is now ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:1 file:50 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:1 file:51 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is now ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:3 file:52 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:3 file:56 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:5 file:57 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:5 file:58 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:7 file:59 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:7 file:60 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:9 file:61 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:9 file:62 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:11 file:63 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:11 file:64 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:13 file:65 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:13 file:66 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:15 file:67 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:15 file:68 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_CALL Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = call idx:17 file:69 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_NUM Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_BASE Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_ADDR Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_VRING_KICK Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: vring = kick idx:17 file:70 Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: virtio = is not ready for processing. Jan 12 11:23:32 nfv_test_x86_64 ovs-vswitchd[3461]: VHOST_CONFIG: read = message VHOST_USER_SET_FEATURES --- cut --- Note that during multiqueue setup host state reverts back from "now = ready for processing" to "not ready for processing". I guess this is the = reason for the problem. Kind regards, Pavel Fedin Expert Engineer Samsung Electronics Research center Russia