From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: <nelio.laranjeiro@6wind.com> Received: from mail-wm0-f43.google.com (mail-wm0-f43.google.com [74.125.82.43]) by dpdk.org (Postfix) with ESMTP id 66A667CAA for <users@dpdk.org>; Mon, 4 Sep 2017 19:12:39 +0200 (CEST) Received: by mail-wm0-f43.google.com with SMTP id v2so8270066wmf.0 for <users@dpdk.org>; Mon, 04 Sep 2017 10:12:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=0Gwmu9vm/EeTDa0YXXboeollHbY4yuXLGwHGSZ5E9CY=; b=Cf3n8CuevKsh2aLbGkoHA6EOID1H4pd1rWoSUvkDhR+LC9sSNrrgwWukEotPKPktyr BcfY5KxA+bo/OdeVJ7hoYVnHFd4jhtNqon4gnf/VozgATDIxLvcylvhaWmXMRJ1bA0QS hfj4ysZDoWMXxqkTK2NPc+LAI/fhfx5fmlmKsLQ5sxz8Y9JMShPLZQdks2rK3GdgC59v AFlAK1Nqsj5RLl0Gz8bBIUV1f+9AFVqBhJ3hNxBAZZVRCbe5/NtTkzjCFWCiQCfx3bNN eQSDAQ1JE704thn4h9vqMMijhFeFqXhfk+jCvJTHvO35xNndYSCIPIRJ+INd5R0qUMsf 8Rzg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=0Gwmu9vm/EeTDa0YXXboeollHbY4yuXLGwHGSZ5E9CY=; b=QADrR4ODdD+GtUtJNeRzoogflbE3abZ95vQIMnyLMZKUiQqsqFxGaemiUz7jMoUHJP aCrnTzZHGXAqUwnAHEtPeGe1J6jU1yQvDdGJgucpciw+K32vn6j4ATb8+n1BB5LUUwGZ 8EcsKHsf92fMBCzNTpbqPrAwJrTNyYojjv7WYX43dxeZ9cIta7nKVtw2ZYYJPKjn5OS3 15NefcIOiis6rr95gF+HYoCERXJ+1OCgqbUd7zPkYmux9OiBxlTHxjt6vFTY9LMtzSyB xIQtZAdLEwsdz+OgfbUNRucZBpcl2fo8VZwhYcc5NUdWuAqetehj7TBchRmHC+THKvX1 +xNA== X-Gm-Message-State: AHPjjUjnpi1mr/mivZDdTXaDRjlRvaakEwwF0oMNNdrR73MV3g1tHRBa ys39o2wkyiDxVegq X-Google-Smtp-Source: ADKCNb4QfGM5wV8RI+gR7eoisF+TD7Xb6y8us1b/x8jREG9wXxBJx0sYc8kh0fU+Gush+kZE9ShuWg== X-Received: by 10.28.217.85 with SMTP id q82mr829721wmg.89.1504545159022; Mon, 04 Sep 2017 10:12:39 -0700 (PDT) Received: from localhost (lan31-h07-89-80-147-20.dsl.sta.abo.bbox.fr. [89.80.147.20]) by smtp.gmail.com with ESMTPSA id c56sm4849492wrc.7.2017.09.04.10.12.38 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Mon, 04 Sep 2017 10:12:38 -0700 (PDT) Date: Mon, 4 Sep 2017 19:12:25 +0200 From: =?iso-8859-1?Q?N=E9lio?= Laranjeiro <nelio.laranjeiro@6wind.com> To: Adrien Mazarguil <adrien.mazarguil@6wind.com> Cc: Arjun Roy <arroy@eng.ucsd.edu>, Shahaf Shuler <shahafs@mellanox.com>, "users@dpdk.org" <users@dpdk.org> Message-ID: <20170904171224.lmrzuvo7ujfugnok@localhost> References: <CAE8+G=FqBd7j1y7d3hvOiB+zTMZRp1iENpKeux=6-Xyi14yjjA@mail.gmail.com> <VI1PR05MB3149F11F671A477F2CA7254BC3D20@VI1PR05MB3149.eurprd05.prod.outlook.com> <20170904155252.GZ4301@6wind.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20170904155252.GZ4301@6wind.com> User-Agent: NeoMutt/20170113 (1.7.2) Subject: Re: [dpdk-users] Mellanox ConnectX-4, DPDK and extreme latency issues X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions <users.dpdk.org> List-Unsubscribe: <http://dpdk.org/ml/options/users>, <mailto:users-request@dpdk.org?subject=unsubscribe> List-Archive: <http://dpdk.org/ml/archives/users/> List-Post: <mailto:users@dpdk.org> List-Help: <mailto:users-request@dpdk.org?subject=help> List-Subscribe: <http://dpdk.org/ml/listinfo/users>, <mailto:users-request@dpdk.org?subject=subscribe> X-List-Received-Date: Mon, 04 Sep 2017 17:12:39 -0000 On Mon, Sep 04, 2017 at 05:52:52PM +0200, Adrien Mazarguil wrote: > Arjun, > > On Thu, Jun 29, 2017 at 05:26:02AM +0000, Shahaf Shuler wrote: > > Hi Arjun, > > > > Thursday, June 22, 2017 9:40 PM, Arjun Roy, > > > > > > Greetings all. > > > > > > I have a weird issue regarding excessive latency using Mellanox ConnectX-4 > > > 100Gbe cards, DPDK and packet forwarding. Specifically: running the l3fwd > > > and basicfwd DPDK example programs yields ping latencies of several (5-8) > > > milliseconds. I tried the same test using an Intel X-540 AT2 card on the same > > > systems and the latency was on the order of 4-5 microseconds. > > > > Thanks for reporting. > > This is the first time we hit such scenario, we will check it internally and will get back to you with answers. > > Back to this topic, could it be the same issue as reported by Sagi, > "mlx5 high latency observed on send operations" [1]? > > The related patches have been submitted and are on track for DPDK 17.11. > While they are not yet on the master tree, you can find them on > dpdk-next-net. > > [1] http://dpdk.org/ml/archives/dev/2017-August/073081.html Note this patches are not enough, there is also an issue on Verbs side, the fixes there should be part of the next MLNX_OFED 4.2, otherwise it is already fixed in rdma-core but for that it will need the PMD support for that [1]. Regards, [1] http://dpdk.org/ml/archives/dev/2017-September/074278.html -- Nélio Laranjeiro 6WIND