From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <dev-bounces@dpdk.org>
Received: from dpdk.org (dpdk.org [92.243.14.124])
by inbox.dpdk.org (Postfix) with ESMTP id F062CA04F6;
Tue, 7 Jan 2020 15:31:05 +0100 (CET)
Received: from [92.243.14.124] (localhost [127.0.0.1])
by dpdk.org (Postfix) with ESMTP id 8EDF01D57F;
Tue, 7 Jan 2020 15:31:05 +0100 (CET)
Received: from mga07.intel.com (mga07.intel.com [134.134.136.100])
by dpdk.org (Postfix) with ESMTP id 37F051D14B
for <dev@dpdk.org>; Tue, 7 Jan 2020 15:31:03 +0100 (CET)
X-Amp-Result: SKIPPED(no attachment in message)
X-Amp-File-Uploaded: False
Received: from orsmga007.jf.intel.com ([10.7.209.58])
by orsmga105.jf.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384;
07 Jan 2020 06:31:02 -0800
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.69,406,1571727600"; d="scan'208";a="211161755"
Received: from fmsmsx108.amr.corp.intel.com ([10.18.124.206])
by orsmga007.jf.intel.com with ESMTP; 07 Jan 2020 06:31:02 -0800
Received: from fmsmsx609.amr.corp.intel.com (10.18.126.89) by
FMSMSX108.amr.corp.intel.com (10.18.124.206) with Microsoft SMTP Server (TLS)
id 14.3.439.0; Tue, 7 Jan 2020 06:31:01 -0800
Received: from fmsmsx609.amr.corp.intel.com (10.18.126.89) by
fmsmsx609.amr.corp.intel.com (10.18.126.89) with Microsoft SMTP Server
(version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id
15.1.1713.5; Tue, 7 Jan 2020 06:31:01 -0800
Received: from FMSEDG002.ED.cps.intel.com (10.1.192.134) by
fmsmsx609.amr.corp.intel.com (10.18.126.89) with Microsoft SMTP Server
(version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1713.5
via Frontend Transport; Tue, 7 Jan 2020 06:31:01 -0800
Received: from NAM10-BN7-obe.outbound.protection.outlook.com (104.47.70.106)
by edgegateway.intel.com (192.55.55.69) with Microsoft SMTP Server (TLS) id
14.3.439.0; Tue, 7 Jan 2020 06:31:01 -0800
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
b=WzlBTGqRZISdxdc5E2HjTUqQd298a0v9Y3IhgnD403aoQZqG6sXWtc1bMQHrpHDQ9tpClUuCa5WjRGavnNMDdIsM1m1Yv6IYf+Oo3bx6VSFR0LnqgKAUh0eYBWZffqU9792NYXg6mSQi2nwj9JdUhI7LFKHOfE7YkVIx2MKphyiRtkmkI1AYO1McZXn8NMYs0gTl+8Ulk36eAEZpMqrKm9lnMNhknsQuijpJjzc5m5VweT0IKF4QABzjLBim2ulXgFsyUEx4UrjxBp01uzWdQHT9Y8iL3gLDdyqMxYOLDAZtnHfj3QvLuWlD3OWneX9OlhFB5zuUzxvuK3/9VLruXw==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
s=arcselector9901;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=n5+myQ+QOAB88Pq14QTnB/KuOU5VDlcRmlFcM3ZU/x8=;
b=lwqBJAOelcKUUjFbjXTFPLpI7CAqaHfMVEt/Yzh1j/VnMHhW188CDjW3Exu0oG653q3wAwONiIDORcS89/UfYwnH3lSGdHOhwa7EEDReC0CaHORnrs4D3ytFP5cQ1fT5CnbVazS6IKgjOfwW6ygvXrAc8uva1IgualHl8LCgZyJC6fYjjsUREY2GS1C3g0QqLKZ9QonSSenToxJvrX1MRPF1qD+ZxSGnwB/9ZJ4Ssk2jtc7YNJD7+mkznUKkSxtq5wXH9m1qH6+arnLcEq9M0aumqYSh/QHz2EQ9CFu3LpVH3rAWub0AsmgVZAKG4SiJKOkks+mKmPD3hb/u/MhiHg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com;
dkim=pass header.d=intel.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com;
s=selector2-intel-onmicrosoft-com;
h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=n5+myQ+QOAB88Pq14QTnB/KuOU5VDlcRmlFcM3ZU/x8=;
b=f8eTWsN36YMoRqWLDh+MsYBWNtrpz9ySCYUDCxuWiWBxj2QlE5XD0u2cfymD06yovVjCp6AwmZm2o6y16eRDxpm4wUYcBKcaY/5gfpzI+rbm8c5ewN/T3fZOhxDt7zEZpe2vOZWwlV/GKy0s/ShitfSJmALPt9+YKi+X+ibegC8=
Received: from SN6PR11MB2558.namprd11.prod.outlook.com (52.135.94.19) by
SN6PR11MB2893.namprd11.prod.outlook.com (20.176.241.151) with Microsoft SMTP
Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
15.20.2602.15; Tue, 7 Jan 2020 14:30:56 +0000
Received: from SN6PR11MB2558.namprd11.prod.outlook.com
([fe80::4d86:362a:13c3:8386]) by SN6PR11MB2558.namprd11.prod.outlook.com
([fe80::4d86:362a:13c3:8386%7]) with mapi id 15.20.2623.008; Tue, 7 Jan 2020
14:30:56 +0000
From: "Ananyev, Konstantin" <konstantin.ananyev@intel.com>
To: Anoob Joseph <anoobj@marvell.com>, Akhil Goyal <akhil.goyal@nxp.com>,
"Nicolau, Radu" <radu.nicolau@intel.com>, Thomas Monjalon
<thomas@monjalon.net>
CC: Ankur Dwivedi <adwivedi@marvell.com>, Jerin Jacob Kollanukkaran
<jerinj@marvell.com>, Narayana Prasad Raju Athreya <pathreya@marvell.com>,
Archana Muniganti <marchana@marvell.com>, Tejasree Kondoj
<ktejasree@marvell.com>, Vamsi Krishna Attunuru <vattunuru@marvell.com>,
Lukas Bartosik <lbartosik@marvell.com>, "dev@dpdk.org" <dev@dpdk.org>
Thread-Topic: [dpdk-dev] [PATCH 12/14] examples/ipsec-secgw: add driver
outbound worker
Thread-Index: AQHVxROCJTXj5cLLs0ucYqmdjlaJzaffQOfA
Date: Tue, 7 Jan 2020 14:30:56 +0000
Message-ID: <SN6PR11MB2558FB15447F335EF60459029A3F0@SN6PR11MB2558.namprd11.prod.outlook.com>
References: <1575808249-31135-1-git-send-email-anoobj@marvell.com>
<1575808249-31135-13-git-send-email-anoobj@marvell.com>
<SN6PR11MB2558FE2A49BF2F0CFD9F5E509A2E0@SN6PR11MB2558.namprd11.prod.outlook.com>
<MN2PR18MB28774B88B7A9ABC40B23206CDF220@MN2PR18MB2877.namprd18.prod.outlook.com>
<SN6PR11MB25580A93E4AE683CA2FE26939A3C0@SN6PR11MB2558.namprd11.prod.outlook.com>
<MN2PR18MB28777D25CB55BE98D5B85B15DF3F0@MN2PR18MB2877.namprd18.prod.outlook.com>
In-Reply-To: <MN2PR18MB28777D25CB55BE98D5B85B15DF3F0@MN2PR18MB2877.namprd18.prod.outlook.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiMzE4MTBiNzItYmViOC00ZWZiLWEzYzUtNmQwYmJlYTgwMTBmIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX05UIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE3LjEwLjE4MDQuNDkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiUVJzVTBWeXFyanZyNE5mcTBuWXpvaVBhUXJFY1IwTVA4c3VscFlBZzNiekg1bzJUc2UwOFZOdGxIXC9FNWxUeGQifQ==
dlp-product: dlpe-windows
dlp-reaction: no-action
dlp-version: 11.2.0.6
x-ctpclassification: CTP_NT
authentication-results: spf=none (sender IP is )
smtp.mailfrom=konstantin.ananyev@intel.com;
x-originating-ip: [192.198.151.179]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 937656f8-d6e0-49c9-7ac4-08d7937e3534
x-ms-traffictypediagnostic: SN6PR11MB2893:
x-ld-processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr
x-ms-exchange-transport-forked: True
x-microsoft-antispam-prvs: <SN6PR11MB2893C45799F82F421FB87BDB9A3F0@SN6PR11MB2893.namprd11.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8273;
x-forefront-prvs: 027578BB13
x-forefront-antispam-report: SFV:NSPM;
SFS:(10019020)(366004)(396003)(136003)(376002)(346002)(39860400002)(189003)(199004)(66476007)(66446008)(64756008)(66946007)(6506007)(186003)(2906002)(71200400001)(81156014)(81166006)(7696005)(26005)(55016002)(316002)(86362001)(9686003)(66556008)(478600001)(4326008)(52536014)(7416002)(54906003)(33656002)(8936002)(30864003)(5660300002)(76116006)(110136005);
DIR:OUT; SFP:1102; SCL:1; SRVR:SN6PR11MB2893;
H:SN6PR11MB2558.namprd11.prod.outlook.com; FPR:; SPF:None; LANG:en;
PTR:InfoNoRecords; MX:1; A:1;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: pgXRWy8CooNb4ELPR/wSMSVhn1LlsQhDTey/Oqc5IHdlJ0qp7uYfW9/3CgcrmVIBHGPFy4XzQ6+v9+jKguJAXtjY3JDqW9Y3NNtOL7qHv8dY0qFGIRl+PH7Ophpxr7uooFIU36iwj/KkwhuqVTtxW9TmfSGJYiN7PskGy0Z5xK61JDu/6LFxDN2LSMjl+r4pt/iuVozTr2hZ6HW5N0LZe1MwJ21WbPoYNpniYlJtTkwDfUH3Q9dDohRT4Q6087PF+qzjBcj5S29Tb91ZSVib4CkGySBKrQ2PfILDR192XKsuVllrf8iDNK25jAQyJNYT4lqGwVWEA0lf/LseBFqWa8w6jsf+0Nigna1OqLp47pm37CWy043VoP42ca1mJUzMkRMg1YzQAEdAheuvL2/9BKfGSMzNBUbgMiNxeIASwmgp/rRjK9AVX7eldBKolqxl
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-Network-Message-Id: 937656f8-d6e0-49c9-7ac4-08d7937e3534
X-MS-Exchange-CrossTenant-originalarrivaltime: 07 Jan 2020 14:30:56.2719 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: aOeIUFbLOFV3ex4XENuYzANFxhtCmL+n2Ba7YgGS5s0toycIMUj8wRUQIud1U3PCv1w/gyrvcHlgGe//vgC7LqvjMb0BT5eMpfDv0h5B9YU=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN6PR11MB2893
X-OriginatorOrg: intel.com
Subject: Re: [dpdk-dev] [PATCH 12/14] examples/ipsec-secgw: add
driver outbound worker
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK patches and discussions <dev.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/dev>,
<mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/dev>,
<mailto:dev-request@dpdk.org?subject=subscribe>
Errors-To: dev-bounces@dpdk.org
Sender: "dev" <dev-bounces@dpdk.org>
> > > > > This patch adds the driver outbound worker thread for ipsec-secgw=
.
> > > > > In this mode the security session is a fixed one and sa update is
> > > > > not done.
> > > > >
> > > > > Signed-off-by: Ankur Dwivedi <adwivedi@marvell.com>
> > > > > Signed-off-by: Anoob Joseph <anoobj@marvell.com>
> > > > > Signed-off-by: Lukasz Bartosik <lbartosik@marvell.com>
> > > > > ---
> > > > > examples/ipsec-secgw/ipsec-secgw.c | 12 +++++
> > > > > examples/ipsec-secgw/ipsec.c | 9 ++++
> > > > > examples/ipsec-secgw/ipsec_worker.c | 90
> > > > > ++++++++++++++++++++++++++++++++++++-
> > > > > 3 files changed, 110 insertions(+), 1 deletion(-)
> > > > >
> > > > > diff --git a/examples/ipsec-secgw/ipsec-secgw.c
> > > > > b/examples/ipsec-secgw/ipsec-secgw.c
> > > > > index 2e7d4d8..76719f2 100644
> > > > > --- a/examples/ipsec-secgw/ipsec-secgw.c
> > > > > +++ b/examples/ipsec-secgw/ipsec-secgw.c
> > > > > @@ -2011,6 +2011,18 @@ cryptodevs_init(void)
> > > > > i++;
> > > > > }
> > > > >
> > > > > + /*
> > > > > + * Set the queue pair to at least the number of ethernet
> > > > > + * devices for inline outbound.
> > > > > + */
> > > > > + qp =3D RTE_MAX(rte_eth_dev_count_avail(), qp);
> > > >
> > > >
> > > > Not sure, what for?
> > > > Why we can't process packets from several eth devs on the same
> > > > crypto-dev queue?
> > >
> > > [Anoob] This is because of a limitation in our hardware. In our
> > > hardware, it's the crypto queue pair which would be submitting to the
> > > ethernet queue for Tx. But in DPDK spec, the security processing is
> > > done by the ethernet PMD Tx routine alone. We manage to do this by sh=
aring
> > the crypto queue internally. The crypto queues initialized during
> > crypto_configure() gets mapped to various ethernet ports. Because of th=
is, we
> > need to have atleast as many crypto queues as the number of eth ports.
> >
> > Ok, but that breaks current behavior.
> > Right now in poll-mode it is possible to map traffic from N eth-devs to=
M crypto-
> > devs (N>=3D M, by using M lcores).
> > Would prefer to keep this functionality in place.
>=20
> [Anoob] Understood. I don't think that functionality is broken. If the nu=
mber of qps available is lower than the number of eth devs,
> then only the ones available would be enabled. Inline protocol session fo=
r the other eth devs would fail for us.
>=20
> Currently, the app assumes that for one core, it needs only one qp (and f=
or M core, M qp). Is there any harm in enabling all qps
> available? If such a change can be done, that would also work for us.
Hmm, I suppose it could cause some problems with some corner-cases:
if we'll have crypto-dev with really big number of max_queues.
In that case it might require a lot of extra memory for cryptodev_configure=
/queue_pair_setup.
Probably the easiest way to deal with it:
- add req_queue_num parameter for cryptodevs_init()
And then do: qp =3DRTE_MIN(max_nb_qps, RTE_MAX(req_queue_num, qp));
- for poll mode we'll call cryptodevs_init(0), for your case it could be
cryptodevs_init(rte_eth_dev_count_avail()).
Would it work for your case?
> >
> > >
> > > The above change is required because here we limit the number of
> > > crypto qps based on the number of cores etc. So when tried on single =
core, the
> > qps get limited to 1, which causes session_create() to fail for all por=
ts other than
> > the first one.
> > >
> > > >
> > > > > +
> > > > > + /*
> > > > > + * The requested number of queues should never exceed
> > > > > + * the max available
> > > > > + */
> > > > > + qp =3D RTE_MIN(qp, max_nb_qps);
> > > > > +
> > > > > if (qp =3D=3D 0)
> > > > > continue;
> > > > >
> > > > > diff --git a/examples/ipsec-secgw/ipsec.c
> > > > > b/examples/ipsec-secgw/ipsec.c index e529f68..9ff8a63 100644
> > > > > --- a/examples/ipsec-secgw/ipsec.c
> > > > > +++ b/examples/ipsec-secgw/ipsec.c
> > > > > @@ -141,6 +141,10 @@ create_lookaside_session(struct ipsec_ctx
> > > > *ipsec_ctx, struct ipsec_sa *sa,
> > > > > return 0;
> > > > > }
> > > > >
> > > > > +uint16_t sa_no;
> > > > > +#define MAX_FIXED_SESSIONS 10
> > > > > +struct rte_security_session
> > > > > +*sec_session_fixed[MAX_FIXED_SESSIONS];
> > > > > +
> > > > > int
> > > > > create_inline_session(struct socket_ctx *skt_ctx, struct ipsec_s=
a *sa,
> > > > > struct rte_ipsec_session *ips)
> > > > > @@ -401,6 +405,11 @@ create_inline_session(struct socket_ctx
> > > > > *skt_ctx, struct ipsec_sa *sa,
> > > > >
> > > > > ips->security.ol_flags =3D sec_cap->ol_flags;
> > > > > ips->security.ctx =3D sec_ctx;
> > > > > + if (sa_no < MAX_FIXED_SESSIONS) {
> > > > > + sec_session_fixed[sa_no] =3D
> > > > > + ipsec_get_primary_session(sa)-
> > > > >security.ses;
> > > > > + sa_no++;
> > > > > + }
> > > > > }
> > > >
> > > > Totally lost what is the purpose of these changes...
> > > > Why first 10 inline-proto are special and need to be saved inside
> > > > global array (sec_session_fixed)?
> > > > Why later, in ipsec_worker.c this array is referenced by eth port_i=
d?
> > > > What would happen if number of inline-proto sessions is less than
> > > > number of eth ports?
> > >
> > > [Anoob] This is required for the outbound driver mode. The 'driver
> > > mode' is more like 'single_sa' mode of the existing application. The
> > > idea is to skip all the lookups etc done in the s/w and perform ipsec
> > > processing fully in h/w. In outbound, following is roughly what we
> > > should do for driver mode,
> > >
> > > pkt =3D rx_burst();
> > >
> > > /* set_pkt_metadata() */
> > > pkt-> udata64 =3D session;
> > >
> > > tx_burst(pkt);
> > >
> > > The session is created on eth ports. And so, if we have single SA,
> > > then the entire traffic will have to be forwarded on the same port. T=
he above
> > change is to make sure we could send traffic on all ports.
> > >
> > > Currently we just use the first 10 SAs and save it in the array. So
> > > the user has to set the conf properly and make sure the SAs are
> > > distributed such. Will update this to save the first parsed outbound =
SA for a
> > port in the array. That way the size of the array will be RTE_MAX_ETHPO=
RTS.
> >
> > Ok, then if it is for specific case (event-mode + sing-sa mode) then in
> > create_inline_session we probably shouldn't do it always, but only when=
this
> > mode is selected.
>=20
> [Anoob] Will make that change.
>=20
> > Also wouldn't it better to reuse current single-sa cmd-line option and=
logic?
> > I.E. whe event-mode and single-sa is selected, go though all eth-devs a=
nd for
> > each do create_inline_session() with for sa that corresponds to sing_sa=
_idx?
> > Then, I think create_inline_session() can be kept intact.
>=20
> [Anoob] No disagreement. Current single_sa uses single_sa universally. Th=
e driver mode intends to use single_sa per port.
> Technically, just single_sa (universally) will result in the eth port bei=
ng the bottleneck. So I can fix the single sa and we can use
> single_sa option in eventmode as you have described.
>=20
> >
> > >
> > > Is the above approach fine?
> > >
> > > >
> > > > > set_cdev_id:
> > > > > diff --git a/examples/ipsec-secgw/ipsec_worker.c
> > > > > b/examples/ipsec-secgw/ipsec_worker.c
> > > > > index 2af9475..e202277 100644
> > > > > --- a/examples/ipsec-secgw/ipsec_worker.c
> > > > > +++ b/examples/ipsec-secgw/ipsec_worker.c
> > > > > @@ -263,7 +263,7 @@ process_ipsec_ev_inbound(struct ipsec_ctx
> > > > > *ctx,
> > > > struct route_table *rt,
> > > > > */
> > > > >
> > > > > /* Workers registered */
> > > > > -#define IPSEC_EVENTMODE_WORKERS 2
> > > > > +#define IPSEC_EVENTMODE_WORKERS 3
> > > > >
> > > > > /*
> > > > > * Event mode worker
> > > > > @@ -423,6 +423,84 @@
> > > > ipsec_wrkr_non_burst_int_port_app_mode_inb(struct eh_event_link_inf=
o
> > > > *links,
> > > > > return;
> > > > > }
> > > > >
> > > > > +/*
> > > > > + * Event mode worker
> > > > > + * Operating parameters : non-burst - Tx internal port - driver
> > > > > +mode
> > > > > +- outbound */ extern struct rte_security_session
> > > > > +*sec_session_fixed[]; static void
> > > > > +ipsec_wrkr_non_burst_int_port_drvr_mode_outb(struct
> > > > eh_event_link_info *links,
> > > > > + uint8_t nb_links)
> > > > > +{
> > > > > + unsigned int nb_rx =3D 0;
> > > > > + struct rte_mbuf *pkt;
> > > > > + unsigned int port_id;
> > > > > + struct rte_event ev;
> > > > > + uint32_t lcore_id;
> > > > > +
> > > > > + /* Check if we have links registered for this lcore */
> > > > > + if (nb_links =3D=3D 0) {
> > > > > + /* No links registered - exit */
> > > > > + goto exit;
> > > > > + }
> > > > > +
> > > > > + /* Get core ID */
> > > > > + lcore_id =3D rte_lcore_id();
> > > > > +
> > > > > + RTE_LOG(INFO, IPSEC,
> > > > > + "Launching event mode worker (non-burst - Tx internal port -
> > > > "
> > > > > + "driver mode - outbound) on lcore %d\n", lcore_id);
> > > > > +
> > > > > + /* We have valid links */
> > > > > +
> > > > > + /* Check if it's single link */
> > > > > + if (nb_links !=3D 1) {
> > > > > + RTE_LOG(INFO, IPSEC,
> > > > > + "Multiple links not supported. Using first link\n");
> > > > > + }
> > > > > +
> > > > > + RTE_LOG(INFO, IPSEC, " -- lcoreid=3D%u event_port_id=3D%u\n",
> > > > lcore_id,
> > > > > + links[0].event_port_id);
> > > > > + while (!force_quit) {
> > > > > + /* Read packet from event queues */
> > > > > + nb_rx =3D rte_event_dequeue_burst(links[0].eventdev_id,
> > > > > + links[0].event_port_id,
> > > > > + &ev, /* events */
> > > > > + 1, /* nb_events */
> > > > > + 0 /* timeout_ticks */);
> > > > > +
> > > > > + if (nb_rx =3D=3D 0)
> > > > > + continue;
> > > > > +
> > > > > + port_id =3D ev.queue_id;
> > > > > + pkt =3D ev.mbuf;
> > > > > +
> > > > > + rte_prefetch0(rte_pktmbuf_mtod(pkt, void *));
> > > > > +
> > > > > + /* Process packet */
> > > > > + ipsec_event_pre_forward(pkt, port_id);
> > > > > +
> > > > > + pkt->udata64 =3D (uint64_t) sec_session_fixed[port_id];
> > > > > +
> > > > > + /* Mark the packet for Tx security offload */
> > > > > + pkt->ol_flags |=3D PKT_TX_SEC_OFFLOAD;
> > > > > +
> > > > > + /*
> > > > > + * Since tx internal port is available, events can be
> > > > > + * directly enqueued to the adapter and it would be
> > > > > + * internally submitted to the eth device.
> > > > > + */
> > > > > + rte_event_eth_tx_adapter_enqueue(links[0].eventdev_id,
> > > > > + links[0].event_port_id,
> > > > > + &ev, /* events */
> > > > > + 1, /* nb_events */
> > > > > + 0 /* flags */);
> > > > > + }
> > > > > +
> > > > > +exit:
> > > > > + return;
> > > > > +}
> > > > > +
> > > > > static uint8_t
> > > > > ipsec_eventmode_populate_wrkr_params(struct
> > > > eh_app_worker_params
> > > > > *wrkrs) { @@ -449,6 +527,16 @@
> > > > > ipsec_eventmode_populate_wrkr_params(struct eh_app_worker_params
> > > > *wrkrs)
> > > > > wrkr->cap.ipsec_dir =3D EH_IPSEC_DIR_TYPE_INBOUND;
> > > > > wrkr->worker_thread =3D
> > > > ipsec_wrkr_non_burst_int_port_app_mode_inb;
> > > > >
> > > > > + wrkr++;
> > > > > + nb_wrkr_param++;
> > > > > +
> > > > > + /* Non-burst - Tx internal port - driver mode - outbound */
> > > > > + wrkr->cap.burst =3D EH_RX_TYPE_NON_BURST;
> > > > > + wrkr->cap.tx_internal_port =3D EH_TX_TYPE_INTERNAL_PORT;
> > > > > + wrkr->cap.ipsec_mode =3D EH_IPSEC_MODE_TYPE_DRIVER;
> > > > > + wrkr->cap.ipsec_dir =3D EH_IPSEC_DIR_TYPE_OUTBOUND;
> > > > > + wrkr->worker_thread =3D
> > > > ipsec_wrkr_non_burst_int_port_drvr_mode_outb;
> > > > > +
> > > > > nb_wrkr_param++;
> > > > > return nb_wrkr_param;
> > > > > }
> > > > > --
> > > > > 2.7.4