From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-CO1-obe.outbound.protection.outlook.com (mail-co1nam03on0067.outbound.protection.outlook.com [104.47.40.67]) by dpdk.org (Postfix) with ESMTP id C5D2B1B282 for ; Mon, 30 Oct 2017 18:38:25 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=3KXvJX/vKnNrAVJU5RNY1fK/RePAmw73/dSpoBBC02Q=; b=fWJDTtTOx5MhBTd70hllCIVRLITh0Ou/CRkQH+JXqE13vNnBhlnbIq8h/W+pHiXyVbfxoTZ3fE7j9Iv9MV//wsQ5Icit46OgJhP1QDFKXNvKLcWKWOKa+OqQ8+9L4YaKorfsdNix0yh19sSJ+ZI7yRPLBdbKaov780pomp6YL9Q= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jerin.JacobKollanukkaran@cavium.com; Received: from jerin (106.200.226.32) by BN3PR07MB2513.namprd07.prod.outlook.com (10.167.4.138) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.178.6; Mon, 30 Oct 2017 17:38:20 +0000 Date: Mon, 30 Oct 2017 23:08:05 +0530 From: Jerin Jacob To: "Eads, Gage" Cc: "dev@dpdk.org" , "Richardson, Bruce" , "Van Haaren, Harry" , Hemant Agrawal , Nipun Gupta , "Rao, Nikhil" , Pavan Nikhilesh , Thomas Monjalon Message-ID: <20171030173803.GA9123@jerin> References: <20171016103255.16322-1-jerin.jacob@caviumnetworks.com> <9184057F7FC11744A2107296B6B8EB1E1400BE33@FMSMSX108.amr.corp.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9184057F7FC11744A2107296B6B8EB1E1400BE33@FMSMSX108.amr.corp.intel.com> User-Agent: Mutt/1.9.1 (2017-09-22) X-Originating-IP: [106.200.226.32] X-ClientProxiedBy: PN1PR0101CA0030.INDPRD01.PROD.OUTLOOK.COM (10.174.150.16) To BN3PR07MB2513.namprd07.prod.outlook.com (10.167.4.138) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: b9c80cd1-0c52-41e3-48d7-08d51fbd053e X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(4534020)(4602075)(2017052603199); SRVR:BN3PR07MB2513; X-Microsoft-Exchange-Diagnostics: 1; BN3PR07MB2513; 3:bdQG5L67rVWkTNX0wiwVo3wNHDNS1RFxpVn+29bUtuK5S0PkreCCt4mSDqqL1ApFg5qnNDj0jz8aMpbCVvk4v3eL09uXUV6iRw//NTDe9diOgcAkoZ0fXROkKXn58ZL5EuWhkYYbqmjemLwAWbkaZG9bstqHYy7pKMxJ1w7UYStXrkRrxmZS1SSmIrQ1JkFlwJQymfEXcmAGrrBSH4sL1UMhcBXDyLW+6vrVfe1ot4sB6/LFjTrX+jQpoTlB9S00; 25:2vEt21ZhNKibyGzbGaqTdniwjCm0aaH5cBJLgIYr95fz+Gp4sK4ViNkYHqGABuv5cXM9qZH4DfbqtEBkVdRzbcQVsV7sDictPLdnnvhtcQZPa9tqretF9k6Gd7OafKimkgka+RlTMc2ifYZuP+KCOLYzmp760pgT00dA9QySvxIO+F5V8EyvcPyuPVBoTrXMjnv7zb9LPrwFdMhhm4bYBu1DgjtGZGWEpBdKU70pdHzL1A7oLa4zwDyzd87ODBhal3vJvBp4KeLSK4/iEnzaSIjkcqmQClSZUSkW71/es9bJbyD4ac+InQzZ6t/2DJS4XdvRq+W4FhsOkCFiQUx0ig==; 31:9Gh6okczTYfvS90masDfql611oISXVU8G67mCgOx0wCy9j8VXC3k4RnKPjKYeFvwWhG/QRfhKqBhFPpoLUlWjX7tsqSNmbPyAEm2DvH2SPQrKnLVbDK/qhVBmskvyY/usCX+C5Dn6XjdgiH3vuMBekXs+4EcdWyZRglpzRtozAnnxlCiamK3jlQG5jBpG8FW5g+JAmGNorkM3Cm+WhkzfUxrmPgb3kPloSreEmf4GgU= X-MS-TrafficTypeDiagnostic: BN3PR07MB2513: X-Microsoft-Exchange-Diagnostics: 1; BN3PR07MB2513; 20:IK9nxwaxwuAXPBhy/h0ehFeSpGQEla2dTZWV8mtueJc3Qxmtlg/8HPBZdgW+enCcJZrDqWpoNriH6Tp58HFJgSRiRWNZrOc5APr5aGFlEv2IGtkNCJazymW1LzVSAmurAJjUlXbS+LeCTV5JQDPsqUnykQrjb9Q5Nn0ua+LzOP+ZSPD9LyrxZEwAxAAMm8kAw7AbC1BCz0vhQgGVDfeOJy1kmfPGasjl4OCVXQcsJuD/xGekrsv9oBLnx45/EB4xBOsbYGR/se2P/3xkrEXnQKAYWR0tY33Snu1/MjZx+8g8GxNAX/yjAGn+pK3Gv2ak2UP7Z+exZPBHvTSI4XjdBEAYfB7mD1QSaTfwvfRn4T8rzgANVmcMYilvGq2AwQdZSA+B5nyvum2OkFcNY9pnOzHXKfSJU2hJby9hFQ8jK5MTORa+jh4CsSq/FhjhwiMIQyg40GKoU5Mj8Mv8tCTWlLbz0DRMapkBL4dizQBYFeIcl9jEle4ZrBcUsm9+KA7zL9BdMDjc+UIJHIZIEsldg5KQagMXnmm3VqB412HNVS5Ew8hoUT3FMz9WbHAaDB8Xu5RLGFFDFNo0BCVm/xB2OfplnUKjKWuo0/yn0NBT6Ek= X-Exchange-Antispam-Report-Test: UriScan:(185117386973197)(228905959029699); X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(2401047)(5005006)(8121501046)(100000703101)(100105400095)(10201501046)(3231020)(93006095)(3002001)(6041248)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123560025)(20161123558100)(20161123555025)(20161123564025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:BN3PR07MB2513; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:BN3PR07MB2513; X-Microsoft-Exchange-Diagnostics: 1; BN3PR07MB2513; 4:1DAQF5j8urQlmWA5ClA6i7WsQLO9PJBjY5e7XNz72iWtKGvs977Xj7yDioO189tKqcyM7Eo1yKRaaEwbil/h4K4Pd2aNJ6acuMOYNMUDnvDv3O0UtWqWU0BXBfRD3roQ5nWahmctq6+tHznuuq7fN6WLR5QJbKMsPhdrO3Dkf/xBrhIH4K+JwzHZrHbHO1Huzaja0Nb4AYMH/5Kw5mDup9HToVJ4FxmRr8h0lClr3URKeZn9lv63KPFxCcbolyl2R9DdcWIZIeMSX7E+uz+EzsM93kVlXCvIWsLFMDj5mWyNjLpkP5RXiore54Z2RJrQVKkNWsfcN7aIxvbCMX+ahrVQwZERXeUb8qkBHDYIpys= X-Forefront-PRVS: 0476D4AB88 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(6009001)(346002)(376002)(199003)(13464003)(189002)(33656002)(229853002)(58126008)(105586002)(8676002)(305945005)(106356001)(5009440100003)(68736007)(54356999)(8936002)(1076002)(23726003)(50986999)(81166006)(25786009)(53546010)(7736002)(54906003)(6116002)(3846002)(101416001)(72206003)(8656006)(53936002)(50466002)(189998001)(966005)(6306002)(6666003)(55016002)(478600001)(66066001)(6496005)(2950100002)(9686003)(53376002)(83506002)(76176999)(42882006)(81156014)(6246003)(16526018)(97736004)(47776003)(5660300001)(6916009)(316002)(4326008)(33716001)(16586007)(2906002)(18370500001); DIR:OUT; SFP:1101; SCL:1; SRVR:BN3PR07MB2513; H:jerin; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BN3PR07MB2513; 23:9yV3303KzHQQ2UaT966BaWp1YNwLpzZxgmuyfMUr7?= =?us-ascii?Q?iOrGdqUVqsrQIftzepze+ZS+6SFE2fm41US9czcyh+jjitsVIWQSr6mYrZRJ?= =?us-ascii?Q?VLEbuq+qkjVJph3H0hQLBnclYwtSkYZ4/UB1Vq5nA6ylXxzEFqO+Nz66EFs9?= =?us-ascii?Q?/GpEqe/Osav1NYyeYzuGhwxq6L37FFiut0aEHEIfNrvgTmToU/dgWT6vPrXS?= =?us-ascii?Q?+rru1O2tTZQcP927JxipdA27JTO3CH5hL2NU1aXF/0nw7PhHThuVZS+8Hb2N?= =?us-ascii?Q?1YGpEDFXd7z0+Pr2cUewIAyfsPhE/EybnwYVY4Fb6GgLuo1icDazn9lv+Rjx?= =?us-ascii?Q?fa4mPbOtP38lGVL1qf1N3ZEQXNg/YcmDM44PtraEkZaV74gX2hpAl+jmsZx5?= =?us-ascii?Q?ElMAS2M7E0bJiC2QT4ve/uKrsevczbJt2hL4S2ROPUsw0riRKVnVJ2MWA0HX?= =?us-ascii?Q?wN+geF9/60q2Sns1C6sO+yF2U4XYeGa607Rfi38nDnQEtJlPRHxkEiXalckN?= =?us-ascii?Q?HTJO0bk86GuHxNzUh+SDA9nCNpdPI0nPVPo3T2XSpDQucC6j39JhK8Qvj6Es?= =?us-ascii?Q?VdW3BKK5lAWl2r57VxfyJCbLhZ1NYdVC2fHiFYD7LOXoVEcIw67S3QHo4Kv0?= =?us-ascii?Q?9GTEWhaAMS+g3DQeokgOYoSSCFvgw6z8IUzJ08cp5ZYdkMFrjFHKWTyvUe/U?= =?us-ascii?Q?ELF7i09CrCnFtjILbm4tR6uTT2NvPDv/rD7Y2LPiIGXUxtZ9vr8qZaQ8poel?= =?us-ascii?Q?/A7G/P9+NQFpJ0/FaibALyZ0ntB6ZPr+u8oEydjudNwHa4MhVdQ1P4iIuMKi?= =?us-ascii?Q?gRbLe87F2sHF7AM+NnQeZvpjznTLDhgzgzTqiGtLmt2HYCdQ5373k5iNvFLd?= =?us-ascii?Q?HGEPHnhGY8RkE2+BQU+auFop5L+PzvVMpwbr6+KPdlGwN9MRL/yTaJOhSXDT?= =?us-ascii?Q?xY2v0IuBsHHYWLQEtE6iwkh7Rw0QOYVen9kv0czKz+dKnlvLENnICvleGt4q?= =?us-ascii?Q?NqqNIu2Py1ZLPT3hVCz3jz5fTVObkaEFe8/A91QEsVPhJdXGVB4ditE9D3ty?= =?us-ascii?Q?QW+qOo5KMGP8uROHZwLmhmjfhkml6ktE4EVS25BAVhopcBIUfRiQkGBiiGgv?= =?us-ascii?Q?mYIwrv3mulC5BPZ7aZ2EZbSP7OxsRr2jTPATwq1gvIj65wzg3oLoKWc6SOFS?= =?us-ascii?Q?phe583Hjnm2EtD4L58DSf9I2Q3+Q8EZnXc2cq+2TaaAzRs9u8TmCtm5wNSfN?= =?us-ascii?Q?fP78xZEnJriOcjesvidcfG8V0WRvT/gW/YdkQRvZ5l8ELzjfmD9KMx4uqDj0?= =?us-ascii?Q?hbvC6Z0LYuYdkTmL3rEM9s5tocEJk33NnITEYKi6itTeS4V49y+PfDQ31iQo?= =?us-ascii?Q?Oyr+w=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; BN3PR07MB2513; 6:MMPOHgVHmVyA6Kj+O5oEzH1tOqqouCz6CYuTNmzJWfyOi7lb5xHghXAoIjsA7b8t6Bttlp2DXyb/N7LDIl3KTthzioSkxUwB5TgWOB9GRL1m9ulUYaCsNvvHi3ethePC6SQZoN4I56L2bxu9Qz0WddhJknFsneOx1xenU1G8TGXFsACNWR8wHoTJrWy6PPoLSDq761j+bF1SIYVcruK39Fr4xiSfiYWQ2ZL0KJ8eYbfJYNjfea4jyBgc1qdzog75eu1ZQuadVO2POp+nR0zkfLvt7jDsIV0GNBibRzVmetR8G0vt++emWbT/2q33cBGIJV4SoBDviikSAXzZSQc8eBNryrAfDTLcYPBoMakdabM=; 5:IPptR7bMA7guOTnH08p4DLPH2ZitzttabofIbJxA7q4zIG4DSMHn3DLvm3bgQXuW1LzIx/tOsmn73IKUvT3y25jGtGefPRgt/T3au2sBvN2W1syS/wZjMuWWyewWi9yDfnmvXUkFVKrDs9l6FIp+RCDb9ByWKEy84OdecES9Zl0=; 24:CkF9iAjihUxRT+mBaX36q661ALlRv/dtE/Yx0MBeS9hLtXfbSps1lNYR1ld3xySG9sa25hkPqndj0hT2FNFp+hEtWaN9obFIhKNM8dFIaqk=; 7:jbUH3GcQnNTsZqO1yuGlGwBexqub0PPglDulwvxsZTUgkTkZqwfoNqoXqznPhnwL0wtud5ZO0/x1rcq/QO3C6JWJJ2zMyxqKstkJqnPmUfLaQ4kCmbbNVJ8nvurcDYUfJ2K10V5ROmcRMCrVN4ekH8lalf0/AW0y4+AUL5x8TJmT0JCeE/WWmTS/nqUYkDYcFPDLxJZ12ntl4VdZ/PUDqmMRKvjjGDkJmc0POos8X1gGHIIujEqfqudHnPkKLwTr SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Oct 2017 17:38:20.4884 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: b9c80cd1-0c52-41e3-48d7-08d51fbd053e X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 711e4ccf-2e9b-4bcf-a551-4094005b6194 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN3PR07MB2513 Subject: Re: [dpdk-dev] [PATCH] eventdev: remove experimental label X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 30 Oct 2017 17:38:26 -0000 -----Original Message----- > Date: Mon, 23 Oct 2017 18:27:52 +0000 > From: "Eads, Gage" > To: Jerin Jacob , "dev@dpdk.org" > > CC: "Richardson, Bruce" , "Van Haaren, Harry" > , Hemant Agrawal , > Nipun Gupta , "Rao, Nikhil" , > Pavan Nikhilesh , Thomas Monjalon > > Subject: RE: [dpdk-dev] [PATCH] eventdev: remove experimental label > > Hi Jerin, Hi Gage, > > I have one concern with the API that may delay changing the label. > > The implicit release that in rte_event_dequeue_burst() is a problem when using asynchronous/look-aside hardware, like a cryptodev. For instance, let's say in pipeline stage N the worker takes the event's mbuf and places it in a per-worker crypto request queue. When the worker next calls rte_event_dequeue_burst(), that function will release the previous event which could cause the flow to migrate to another worker, and this could result in packet reordering. > > To prevent this, the worker can't call dequeue until the look-aside operation completes...in effect treating the asynchronous/look-aside hardware as synchronous. Another option is to feed stage N's queue to a single port to avoid the flow migration, but that port may become a bottleneck. > > We could remove the implicit release functionality or add a port configuration flag to disable it, so the default behavior is unchanged. Removing it will completely will likely require changes in existing code, but it simplifies the usage model (all dequeued events must be either forwarded or released) and the PMD's dequeue code. This functionality could be removed from the software eventdev fairly easily, but I haven't looked into the hardware PMDs. The HW implementations, I know, it does the implicit release. Otherwise it will result in deadlock because it cannot hold reordering metadata for the longtime(SRAM is limited etc) Coming back to cryptodev use case, if I understand it correctly, before application enqueues to crypto queue, the application will change the tag and submit to ATOMIC queue. So as long as crypto queue competes for the crypto work in order then the order will be maintained. In typical outbound IPSec use case, - Stage 1 will be processed in ORDERED where application does the SA lookup - Once SA found, application enqueue to ATOMIC stage with SA as flow_id. - When the event comes from the ATOMIC queue, it in ingress order and then it submits to the crypto queue - Crypto queue maintains the FIFO order. - On IPSec crypto work competition, packets will come in Stage 3. - So at Stage 3, packets are in ingress order for the given SA flow id. ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Having said that, If SW implementation needs to do differently for performance reasons then we will end up in capability as HW implementation works in the implicit release. May we can sort out through capability or separate adapter for crypto case. But I think, those will be new additions to the API.So removing the experimental tags may be OK. But if you have strong opinion on keeping the experimental tag till we address the crypto use case then I am fine with that. Thoughts? Jerin > > Thanks, > Gage > > > -----Original Message----- > > From: Jerin Jacob [mailto:jerin.jacob@caviumnetworks.com] > > Sent: Monday, October 16, 2017 5:33 AM > > To: dev@dpdk.org > > Cc: Jerin Jacob ; Richardson, Bruce > > ; Van Haaren, Harry > > ; Eads, Gage ; Hemant > > Agrawal ; Nipun Gupta ; > > Rao, Nikhil ; Pavan Nikhilesh > > ; Thomas Monjalon > > > > Subject: [dpdk-dev] [PATCH] eventdev: remove experimental label > > > > The eventdev API was introduced in DPDK 17.05 release. > > Since then it > > - has been reviewed and iterated for 17.08, 17.11 releases > > - three drivers were implemented using the API. > > - introduced another subsystem like service core and ethdev-eventdev Rx > > adapter APIs to abstract the difference between HW and SW eventdev > > implementations in a transparent way. > > - had extensive use by the app/test-eventdev/ and > > examples/eventdev_pipeline_sw_pmd/ > > > > I believe the API is now stable and the EXPERIMENTAL label should be removed. > > > > CC: Bruce Richardson > > CC: Harry van Haaren > > CC: Gage Eads > > CC: Hemant Agrawal > > CC: Nipun Gupta > > CC: Nikhil Rao > > CC: Pavan Nikhilesh > > CC: Thomas Monjalon > > Signed-off-by: Jerin Jacob > > --- > > > > There are two more outstanding eventdev API changes. Please find below. > > Please express if you have any concern in changing those APIs. I would > > like to fix this API issue and remove experimental tag in v17.11, > > if we all agree. > > > > - evendev: fix inconsistency in event queue config > > http://dpdk.org/dev/patchwork/patch/30293/ > > - remove rte_event_schedule() API and use service core infrastructure > > http://dpdk.org/dev/patchwork/patch/30375/ > > > > --- > > MAINTAINERS | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/MAINTAINERS b/MAINTAINERS > > index 2a58378b7..4a4be3a54 100644 > > --- a/MAINTAINERS > > +++ b/MAINTAINERS > > @@ -262,7 +262,7 @@ F: lib/librte_cryptodev/ > > F: test/test/test_cryptodev* > > F: examples/l2fwd-crypto/ > > > > -Eventdev API - EXPERIMENTAL > > +Eventdev API > > M: Jerin Jacob > > T: git://dpdk.org/next/dpdk-next-eventdev > > F: lib/librte_eventdev/ > > -- > > 2.14.2 >