[dpdk-users] OpenSSL integration with dpdk

[dpdk-users] OpenSSL integration with dpdk

[Waqar Chaudhry]

I am new to OpenSSL. Does anyone have any information on how to integrate OpenSSL 1.1.x with DPDK?  Intel has a video on OpenSSL 1.1.x integration using QAT_engine but nothing on OpenSSL using DPDK.  Has anyone done this or point me to something? 

Thanks, 
From vhuertas@gmail.com  Thu Aug 30 09:16:20 2018
Return-Path: <vhuertas@gmail.com>
Received: from mail-oi0-f41.google.com (mail-oi0-f41.google.com
 [209.85.218.41]) by dpdk.org (Postfix) with ESMTP id 792852BF7
 for <users@dpdk.org>; Thu, 30 Aug 2018 09:16:20 +0200 (CEST)
Received: by mail-oi0-f41.google.com with SMTP id l82-v6so13684406oih.11
 for <users@dpdk.org>; Thu, 30 Aug 2018 00:16:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s 161025;
 h=mime-version:from:date:message-id:subject:to;
 bh=SDo4qxsXepbLCqnmTFUKJTQMjrUn3ylciKj2wm9S6QU=;
 b=BOgw76u4eNsJaQ0NGkDmBecEZv2Y+mPVwE3pRDExlhgaG5devx2M69hlpS7KenS3Cu
 9awcBBisc2XPytn9yMyhoE97+e6jSmYVvEJkb/m8MqcJcxbkdmGXtGYlpw/05Kbf5PNO
 ioloxMeT8BKpbAuH0DfkoheIv7Tj2uziwt8IOX15SFHWGAWSkqjEJ2ksbCe92chNuikx
 P46Q7uFYjBBGV7fm94ansYk/5i1REyvmdjrBPgfTLaCPB1beFunZdXU3TouaKZffUAax
 DR4Bz+UTjQ1m9q/aAsAwUK1DXOOuwAWos4960sW4IHXvGbcIhjydpU6BT70ZBo+jbZIi
 hvbA=X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d\x1e100.net; s 161025;
 h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
 bh=SDo4qxsXepbLCqnmTFUKJTQMjrUn3ylciKj2wm9S6QU=;
 b=nwaCF3eOQLaWFpdKpEiQElrLSMHif3m6QwH88vICxHRSNJNe0xhmv19oo5FWhm/VBx
 hseHGqS6p71FL8nijlFLqE/wiStvk3cXIHvVJi/0LdPUchPt+9HQDWVusKrXMvcwlDK4
 LNGRm8Gx2dyhBoU2nB9Fd+/HXEzc6260HEnnDmtfKv1Si1h3520VZvINEeGb1miWiDD3
 b5rPYgeCBquohBNcJWSdBdnLut15hufWT0/dkOoztq4mi5ZD5abImssgrDIJpMuwHJ3S
 A1HFy3H/GQQmt6+KLFnaw9pyRLQkaVdGxCPey8z0CJV7se9PW0FgiR4x+XFRAVvQXrMu
 U0KQ=X-Gm-Message-State: APzg51DkXu5/IYGhY8gbYyEkE9wC9TE3ylzB8Xr2Bs53jOoJX7/O6eh7
 ULvInd7F+vn0o1reyCwW5LQVXifZM6Hb6wvrVQuzdXZL
X-Google-Smtp-Source: ANB0VdacH6R1HA8XDQ4ne8scghU1hjDR/UJnH6lKbMNOVTtifQc6DKzhERZugDaWIY0aMilIeVdd+1hXFWY2HjNbCPEX-Received: by 2002:aca:e6d4:: with SMTP id
 d203-v6mr1314410oih.311.1535613379441;
 Thu, 30 Aug 2018 00:16:19 -0700 (PDT)
MIME-Version: 1.0
From: Victor Huertas <vhuertas@gmail.com>
Date: Thu, 30 Aug 2018 09:16:08 +0200
Message-ID: <CAGxG5chR9-VXx3BFViihZMU5Fxsu5mYuFsyV4ySCk9bM8fLSFA@mail.gmail.com>
To: users@dpdk.org
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: [dpdk-users] DPDK pipeline example behaviour: packet lost and
	disordered
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Thu, 30 Aug 2018 07:16:20 -0000

Hi all,

I have developed a variation of the pipeline example. I am just using the
ROUTING pipeline along with a new pipeline that I have developed on purpose
for the ARP handing.


   - The ROUTING pipeline just creates one tx and rx queue on each
   interface where it captures everything (promiscuous mode) and performs
   pipeline LPM table (table 0) classification and next-hop setting on the
   headroom. Subsequently it applies the ARP table (table 1) where the dest
   and src MAC addresses are set on the outgoing packet header previuos to the
   tx of the packet to the corresponding tx queue.
   - The ARP pipeline also creates a separate tx and rx queue on the same
   interfaces with the particularity that a filter is also set on the rx
   queues (just capture the ARP frames on that queue). Then it processes the
   ARP requests and provides the IP-MAC address translations to the ROUTING
   pipeline via the MASTER pipeline (sending IP-MAC translation events). It is
   as simple as this.
   - There is also a MASTER pipeline (executed in the logical core 0) which
   sends messages and receives events (new feature developed by us) from each
   pipeline.

The thing is that, as the pipeline example allows it, I can assign which
core I want each pipeline to be executed. When ROUTING pipeline is executed
in core 1 and ARP pipeline executed in core 2 everything goes perfect as
maximum throughput is reached in my environment (1 Gbps for a single TCP
flow). No pàcket loss at all.

However when I assign both ROUTING and ARP pipelines the same core (logical
core 1) the behaviour degrades considerably. Packets loss and disorder are
detected (and confirmed by Wireshark captures). This causes that the same
TCP flow cannot reach a constant rate due to retries and packet loss
detection.

Both ROUTING and ARP pipelines, when capturing packets or ARP frames use
the same mempool.

One thing to take into account is that the ethernet interface statistics
reveals no missing packets at all in both cases. So the thread executing
both pipelines in the same logical core is not slow enough while packet
processing to provoke packets misses that could cause this TCP degradation.

My question is: If the code is exactly the same, why the behaviour is so
different when I decide to execute them on the same core? It seems to me
that the issue comes from the fact that I am rx and tx packets from the
same thread to more than one queue in each interface. All the examples I
have seen in DPDK web page directly maps each thread to one hw queue per
interface and this is the differing point with respect to the case I have
explained to you.

What do you think about it? It is not possible to receive packets from
several hw queues of the same interface in the same thread? Could it be the
cause of this packet loss/disordering due to slow memory access?

Thanks for your attention,

-- 
Victor