From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <nelio.laranjeiro@6wind.com>
Received: from mail-wm0-f46.google.com (mail-wm0-f46.google.com [74.125.82.46])
 by dpdk.org (Postfix) with ESMTP id 064E46883
 for <dev@dpdk.org>; Tue, 14 Jun 2016 08:58:02 +0200 (CEST)
Received: by mail-wm0-f46.google.com with SMTP id n184so107047923wmn.1
 for <dev@dpdk.org>; Mon, 13 Jun 2016 23:58:02 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=6wind-com.20150623.gappssmtp.com; s=20150623;
 h=date:from:to:cc:subject:message-id:references:mime-version
 :content-disposition:content-transfer-encoding:in-reply-to
 :user-agent; bh=1SYbZtfRRxWoO4iTUQM2o4sWvFuQL2VNflYRzRALhx0=;
 b=q2TzNcX+DlgczQY45XOxByp4e6RrCQmzjbbWkuyKtlg7MS9L2T4ON2AuIawkEljbJQ
 G3vc8jh5LcL5PjPkH+Y6+whN45Xyf/URQXTL/YSEPn5o/cyIj8krv7To8wj5OESkG3P9
 es+UBnptL4YJzepuswyRITRtYfdoJ/Bw0BA196hjoTzJFUG6NXZjftw90ie5RYoSRiQd
 jZWM+CEOgN2NiI21VZzqsB6k4L8oilSa8ZBbD7TFf/5rAfAFKSDsoZAxcUt/v6TaISJY
 TTUXHYjJU0eyJ3D5Ybj8UOIALI1gbiJIWuIJxP5/B2CjjXWNa4H4gVJkTGlyPJfwCkNb
 CK6g==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20130820;
 h=x-gm-message-state:date:from:to:cc:subject:message-id:references
 :mime-version:content-disposition:content-transfer-encoding
 :in-reply-to:user-agent;
 bh=1SYbZtfRRxWoO4iTUQM2o4sWvFuQL2VNflYRzRALhx0=;
 b=BPxZKWihZQroxsrDOyw93PXJ0171Y15A48FtELp8mn3utzym37dFRHbcZ9bkUzhxMe
 rhC81bCjKyMnkQjmxtxVjcKbDXZwh+pLJs0i1NYDx74aJQH5CzyNiFtcXLPVs45H3r+c
 jboHbHVNNEmLRDGfeH314mjCws+cjaLB55UM8Km3tJ+93aru9UqYHJIoeN1N8TAjMQre
 SW5zAa8Vrok1beXdjaXLLoQUc5D1ZKhH0fycT2j8G/SFM+DZjtSBKmbREArPs8F56qGZ
 yHF4XHk6s8rOVG4w6N/iH5fj6bVn1irwFRDDGzk3yUTe1GYghX5OyfibGjHe9nkBCnw6
 dyfg==
X-Gm-Message-State: ALyK8tIOHYbXiUHrp4kI7ctxOOB437aLlAsha6ICmYQ/YxE0wGgk61GOJHb4vcAbc22GDcOF
X-Received: by 10.28.85.69 with SMTP id j66mr4677435wmb.91.1465887475339;
 Mon, 13 Jun 2016 23:57:55 -0700 (PDT)
Received: from autoinstall.dev.6wind.com
 (guy78-3-82-239-227-177.fbx.proxad.net. [82.239.227.177])
 by smtp.gmail.com with ESMTPSA id dj4sm31256162wjc.13.2016.06.13.23.57.53
 (version=TLSv1/SSLv3 cipher=OTHER);
 Mon, 13 Jun 2016 23:57:54 -0700 (PDT)
Date: Tue, 14 Jun 2016 08:57:52 +0200
From: =?iso-8859-1?Q?N=E9lio?= Laranjeiro <nelio.laranjeiro@6wind.com>
To: Javier Blazquez <jblazquez@riotgames.com>
Cc: dev@dpdk.org
Message-ID: <20160614065752.GB29741@autoinstall.dev.6wind.com>
References: <1465379291-25310-1-git-send-email-nelio.laranjeiro@6wind.com>
 <CAND4PZxHSv7b-aPSe8N1yZkL7A9uz=0E7pk4gFw4D0aqJBuM+A@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=iso-8859-1
Content-Disposition: inline
Content-Transfer-Encoding: 8bit
In-Reply-To: <CAND4PZxHSv7b-aPSe8N1yZkL7A9uz=0E7pk4gFw4D0aqJBuM+A@mail.gmail.com>
User-Agent: Mutt/1.5.23 (2014-03-12)
Subject: Re: [dpdk-dev] [PATCH 00/24] Refactor mlx5 to improve performance
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: patches and discussions about DPDK <dev.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Tue, 14 Jun 2016 06:58:02 -0000

On Mon, Jun 13, 2016 at 11:50:48AM -0700, Javier Blazquez wrote:
>[...] 
> This is a very exciting patch. I applied it and reran some microbenchmarks
> of mine that test the TX and RX paths separately. These are the results I
> got:
> 
> TX path (burst = 64 packets)
> 
> 1 thread - 2 ports - 4 queues per port: 39Mpps => 48Mpps
> 2 threads - 2 ports - 2 queues per port: 60Mpps => 60Mpps (hardware
> limitation?)

To be able to reach higher values you will need to configure the inline
feature with the device argument txq_inline, and only activate it with
more than 1 queue, this can be done with the txq_min_inline argument.

This feature helps the NIC by reducing the PCI back-pressure, in
counterpart it will consume more CPU cycles.

You can take a look to the NIC documentation (doc/guides/nics/mlx5.rst)
updated in this path-set which explains both txq_inline and
txqs_min_inline device arguments.

> RX path (burst = 32 packets)
> 
> 1 thread - 2 ports - 4 queues per port: 38Mpps => 46Mpps
> 2 threads - 2 ports - 2 queues per port: 43Mpps => 50Mpps
> 
> The tests were run on the following hardware, using DPDK master with this
> patch and the "Miscellaneous fixes for mlx4 and mlx5" patch applied:
> 
> 2x Intel Xeon E5-2680 v3 2.5GHz
> 64GB DDR4-2133
> 1x Mellanox ConnectX-4 EN, 40/56GbE dual-port, PCIe3.0 x8 (MCX414A-BCAT)
> 
> I haven't test it extensively outside of these microbenchmarks, but so far
> this patch has been working great on my end, so:
> 
> tested-by: Javier Blazquez <jblazquez@riotgames.com>

Regards,

-- 
Nélio Laranjeiro
6WIND