From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-DM3-obe.outbound.protection.outlook.com (mail-dm3nam03on0077.outbound.protection.outlook.com [104.47.41.77]) by dpdk.org (Postfix) with ESMTP id AAF036CD8 for ; Wed, 5 Oct 2016 09:25:14 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=Jy3+BtvHVXpldKBTkjAdfj80S1fe+EKYtEIQRsxrUZQ=; b=NH/AW4oepStQUPYZwXjcJ/0gYeALDAiOUkQPd0em6VDTiktvmQCHHg1HsoCk5Uvv/ipFCI7L5qtPaunFdBk+YDdi9ExVMqn9uiHhmi+4tDjDYHOBER6rDGYY7eDE4QdIny8HpluYPSL6o/vU+1LhvpjnEle4nN+9G+p8K29/VqM= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jerin.Jacob@cavium.com; Received: from localhost.localdomain (111.92.120.53) by BY1PR0701MB1723.namprd07.prod.outlook.com (10.162.111.142) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.649.16; Wed, 5 Oct 2016 07:25:11 +0000 Date: Wed, 5 Oct 2016 12:54:52 +0530 From: Jerin Jacob To: "Vangati, Narender" CC: "dev@dpdk.org" Message-ID: <20161005072451.GA2358@localhost.localdomain> References: <3B5C8B5D2B969C4CBE78502867F1AD9A0134149F@FMSMSX108.amr.corp.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: <3B5C8B5D2B969C4CBE78502867F1AD9A0134149F@FMSMSX108.amr.corp.intel.com> User-Agent: Mutt/1.6.2 (2016-07-01) X-Originating-IP: [111.92.120.53] X-ClientProxiedBy: BM1PR01CA0008.INDPRD01.PROD.OUTLOOK.COM (10.163.198.143) To BY1PR0701MB1723.namprd07.prod.outlook.com (10.162.111.142) X-MS-Office365-Filtering-Correlation-Id: 716da2e8-a685-4626-5bd5-08d3ecf0beed X-Microsoft-Exchange-Diagnostics: 1; BY1PR0701MB1723; 2:T/QZA9P8oBBF3nqyYSEvS4zAzlOJTWwBWGL9btaIL8OVOhiyjOWMbRULkSqkSGNx4JVObAzPtHMl6Qauv39NO2u2TuJlCK2hkkWAa+CItQOBAawXEApjU1FUQdatjh9slOYzT78D4KkGRh68nku630oKpspj+LzeYs70kllj+ZtESmzOMNvvuGj+D3XofjP++0FRPa5AC0nIyIaYFAVgCQ==; 3:sWT3WZ9r6aJvpsbxFFrAjtVlPpNPcL9LYV9t73BnusmA3E0gIQu9uCVaASMxQFpgLnk6Wxf56g87tsVz8+gXwzGUBs/nfnuGb/g5codq/EXAojnVXdFm6T41OyuEwh+Q4ediKmFbp2Ko16SqCr0W5A==; 25:euxnRTrH5mrDIpfqDQq4liq9xM+jcaneIe+LWiueCRj1yhDtEpOKoP7mZatA0lgdzL1T2I7ZVlWdNU1efZ/8qoA14onYUv8P8waMHzrudTC/GnVBjfV99ESps6mbzTtPFy8GXKW+RAA+SIHL3VupCcqRNeSZmXV+7vWj9hDg9mFhVNlPGiJv/pLmgarafnNqze1SLam6DBna+5CbdZiWiwNNyDoBV+rcmq4PE9XgZsyBzM66M7GD1Lif/dH26do0UyBCw1phFOa5wYG7+edxnyr4LgJmd0DEjonfCpSRnyTFBpsLpLBAebbjpeEiD9ekoXGyOkGozIQ0xRo5bgky9CC15Ss64wMIBskhHvFhevFwr/w1ho3OBRxwQ/7HHYchyQMUdmvhzYa8SVSBgLj60BmKS8Ms2yBT4zict/Py6UZ5iHopcIgEJJ43irVWkjo0 X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY1PR0701MB1723; X-Microsoft-Exchange-Diagnostics: 1; BY1PR0701MB1723; 31:dFpmXpgasp5wJ0l/Isk/SycFC+LDgqmF7LzeBL6N27PhC8skJx1RLxvjoteRGR2RE6wfOxD7BuBLgkuzK5KJyRmWbufLvHee3+QwlJUsNtnNwPX5mSDWy/H0XJNItiw1MC9DWngnKd4AFaFpsubHxSUftkV3R4hD1cv5n32Gr7OQuiRd0Z6B7zEOOySm92/Zk0C6vDP/JYxdB7b6QlRkfRHOvuRx2jKgb22PfXOhQ5GAd/VsmCfh/3xz5i6EoU0n; 20:951yPjG01u6yB3sINn+qG6xhwPM2VU7A0wsVs/P7KRUuU8a6qQfKnOBUCRDlwDT1e9jNBlFTw6hZXJ/VMlXXCb5x4zNDXT9jZTneHusthnBBCQxB6bOu+8LDtT0jFHKbXcgo3RCIaZj886goLTljMBv5EN3U0JvOr4Xe6Az0r4jehlryr7+HzFCVnKCe5+zmOqcqO5zxlg0zSuiJmRp0rndQ7dMP3pPdXN2IBHvJgrKIh22doMDjBxvAj4IKy4DrDtAaU59iLAgJn+I+Ce3H93dbmkWtA6WrFS6kmsQ500JvNZUN8VU5PBNi1bZmgO59zV1Ra+yNKper66x+om58he6zqdT5z7P1rIUiQXw6ERoRuIPfTBZvBWNAT2sxNa0kXticf7NYs2w7I9elZqZFo8yS3jqUCPAfK5T52BuAgFB0Q6rfK9xdqLFWXshqwrA4f7N2UScXS2upl822NSXCPMWeXo+JKHIg1TrTlcloFG1Ktg+UNz192fUDLMT3S2YmUwjSLUCQm1WjbzTDTAam69fuVwghsdfNfWfaLWlg3mYJ/UvaDYq7ChhpbCkx0a+ec2bJuerX2qzfWYJzp143zPg9BFSvA5Zj3yk6VRrlb1k= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(271806183753584)(21532816269658); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001); SRVR:BY1PR0701MB1723; BCL:0; PCL:0; RULEID:; SRVR:BY1PR0701MB1723; X-Microsoft-Exchange-Diagnostics: 1; BY1PR0701MB1723; 4:9YVGX5rL2A9YdF3WaBFqabRAmt+Apy4GBXl3v2XmT0KPD5HB+1coZoZPCSz+h4MHchHWglQ7ioQ/5jPcySKWuJI/G5pOFPHLe9MO2r8fqCiYIkpmxiA6hgHFmuaYjyoFljPcvYHOCjq9xw+qdlTOWTgV+1f28B6YZ8XSVbfyBFBPEMxzjNbJeAdYb2yFoDCSgO13IOoSnUcNE5qYaVkLc7uX3eYqO6H4KmwkjvH2qsghH2taqyH22P2QcirrFGTva7SsSBa5sxUdIBb9s3dB2DKtv/oVCATSEmhG1DOGgIdokkG+3OHe9Jta+AQIbeV+2gZX+Gb3XMqjQGKQ+ShGilXymUbP+qHbaIQDVEwWg8zXH26AwwQYQb4mcN9qgQgv5Ps/MmKvpbSpOKtiBPXgt97WIAhPDmRKES2YQiDXHgcUzG1J4P+PTfYZkeN3Qrk50lJCafLac/JZlt2QTN5oTKO/YSCLQkIH6HJt58Nqjzw= X-Forefront-PRVS: 008663486A X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6069001)(6009001)(7916002)(24454002)(199003)(51914003)(189002)(2906002)(5009440100003)(101416001)(23726003)(50986999)(561944003)(76176999)(42186005)(50466002)(2950100002)(46406003)(1076002)(8676002)(81156014)(97736004)(4001350100001)(5660300001)(54356999)(81166006)(6916009)(42882006)(105586002)(4326007)(189998001)(106356001)(92566002)(77096005)(9686002)(586003)(61506002)(47776003)(3846002)(110136003)(6116002)(83506001)(68736007)(7846002)(66066001)(305945005)(97756001)(6666003)(7736002)(33656002)(18370500001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY1PR0701MB1723; H:localhost.localdomain; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BY1PR0701MB1723; 23:8ffA7ZzIBnMlxlXGbJ5LGcqIT6Y77h9anNyqnIV?= =?us-ascii?Q?YXgxFNtpQ7GJlqY8nvL/AvOHnjVsEua5/AsZ3xLcqwoGH3o8yOwy18tR7fHr?= =?us-ascii?Q?jVteiDc+lCqwALBAgAqS9/Sjj/yUGZNWwDgkGRL/myDiAXZQrQD1BOOpNaSL?= =?us-ascii?Q?pgvuZxCD1N5o5XCZoktlj7xsctwl4MUY34Xhlto9m733C+lXVP0vh70SX0dQ?= =?us-ascii?Q?VzOdoyoD9sc7+ioVWokFFJScIk6suEZzCGc+z6vOdUg+0FaH/EmkgLXip4SH?= =?us-ascii?Q?/EOVvH7OHOu24bjnrFlMbYCk+A+LL/mTjRYBFzSTU2HcOvXr2+EwRMWkGnEo?= =?us-ascii?Q?LCR55DaaqgSpUXtmmnffsmdSIHaor3dBDDvR+VvrEpd6gXentmz6xIijsefv?= =?us-ascii?Q?29P0P0/vw/mWpZ+WukTswAz+80JL3UWL/QdcekEi3s2IKZpeoCB93Z57perD?= =?us-ascii?Q?ByNzI2E1OaRvqUJqUmZwvyknsI6E3SQM7gHbb9V7llVKdZGKrN2npBSvMOLx?= =?us-ascii?Q?VmaaylydyD9JeFSyxY4kAa+Og6ECyEapOXIIx/UUZ2n+eUmMevj7AxUEZltL?= =?us-ascii?Q?cvBvMQry6AYIP8Zn6mrJzXsyvMCOeOi5dKDUgzDbFUjPXKU5BwpxAkZYp7ix?= =?us-ascii?Q?ked/VLtq3z77RSCu/NlJGH6IKzBKdk3W+QZiwgLqEqGVGNsL1b9qwH/BS7hq?= =?us-ascii?Q?surXm6JvUfPvnGRkRktSQrSO6gYEj1MNe9HAxAwyOxoXn6Kmc6tDbTfuKLz/?= =?us-ascii?Q?CZA8iHDb+cBT6sQjjNG2tBWPMeg4OJsktck05YwTEzbfOYp/a3NIYx7axwlG?= =?us-ascii?Q?h4WQ25U2+QgwHcOrZjtVeCy82SkZrH/sM5llKZIwScv2bRd2Xlorp8pddEk7?= =?us-ascii?Q?PUJBOwgzqkXp8a3QvtdcGN0J5P5yUkQPZp+Od8u5fu8vKSXQa3YiKBKWqi8A?= =?us-ascii?Q?ddRMeprrtL2UcAM8wA1iYXZ47iWsLxLK4BCoxTXEZV2hsLS3axB/eya4GGZ9?= =?us-ascii?Q?PhIAj7TMaI3rFB/nWqsjvtoEtiopIO6Anr+2nssLCNYkSdg+ru6ZRLGhO29c?= =?us-ascii?Q?YWJiyWyJWn0dLPpfIn4lmbPJbNFgjPEvHfu0/sfaaNsv6l1zOt6z+sex4YJK?= =?us-ascii?Q?ubatcK7QdIC0Rxlssej/OPAjY+kZGq+X48I1NW5RHfpRMS74KcPR27ckBUzD?= =?us-ascii?Q?2zkb8mvINpGMMSzQ7GWhJS+VwDUVDLiMIEhWD081onsTfLpmc+MwFk+GG7g+?= =?us-ascii?Q?MHNh1gMJ6WClQVZAXMu5/lbH3U8XPaLG+G5jH97HBVmNf2+g3mfkLmdOBN6m?= =?us-ascii?Q?9Kw=3D=3D?= X-Microsoft-Exchange-Diagnostics: 1; BY1PR0701MB1723; 6:Ja0SrFL+n1aNSjKYNLeuM4Rq/kdNQCa6EoN6iAE+GzSH/lt4kPkF06T58zTwdvX1LMnodW6sgv5oIJTTSctAt2Nnh7sT7ajPKWtuZw6wBAQUFJyW6c96FdtMAvQu8brLP0Uarx/CrjmkisFl9quj2yRaw54Zl59QEUzvY8VPdHDPHL1l0EfkYaA2k88xMVmBkHUYpQyW/x34/7owgt7gt3G8VV3W4lRB8Pz9gzVrrlKSlrHMdjEhiCxUXkPepuCF9TDcdeOYTEDd2e1xBrHncAX4i3iEsCUSzHMrXcwvCqibDKg+hRlDj8RQb8Jsj92q; 5:jJOydjmA3Xi4W7yzulw17d19AlOZVlFftNnnI/qXB4E9C+lJFcMuRhODdnYvnC3baCjmu50Q2D3wfKSfuAjmazK/7u2aWkSYWr+3wUAbfMHtoPgnEaTGX4wYe8FCqOb+44r9gQi5VHpjRwLDPA6gx6PH1/sXY6EHmKdyKlNAx14=; 24:hB86rRYdTatHtnl5byei9l6BuuyEzO7nkFZlU1K/hRAJwifX6MO0jU8pFCvAPlgJKvbHpMzHcyVIK5c5+hBoKlJvOoAHpZD9g72CNHVLG8A=; 7:nkKafFjdQKr0HQ8zCWHX8UzOLBMaItegNk2RlRi1zff1JgHOe4Slfwcc+9Nm9yeQ+//6LUZQQ+upI325nej+FWSegWklv95k82EGYj4bpa3rlX85vA6ma+Aeehwbalo+S454h8kV0LFHIIg0wTswzgM5TBMlrL68y7+X04e3v3aa6/ZQQdAMabFOXZWgbdXATUmJb+tqKpsRvVKhWJErKVrl5xnZFHyIHXHbKst+2yZSv4/xhEYbAH/Iewn789xy/EOlpoKw2kEHM7AqS7zZpgSVsvK+ObD5j81fAGWZZgUxs7df4tqbuZEDJqVNu5iMz9LSPfNbR1aYHe6HA7KXpA== SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Oct 2016 07:25:11.4912 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY1PR0701MB1723 Subject: Re: [dpdk-dev] [RFC] libeventdev: event driven programming model framework for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Oct 2016 07:25:15 -0000 On Tue, Oct 04, 2016 at 09:49:52PM +0000, Vangati, Narender wrote: > Hi Jerin, Hi Narender, Thanks for the comments.I agree with proposed changes; I will address these comments in v2. /Jerin > > > > Here are some comments on the libeventdev RFC. > > These are collated thoughts after discussions with you & others to understand the concepts and rationale for the current proposal. > > > > 1. Concept of flow queues. This is better abstracted as flow ids and not as flow queues which implies there is a queueing structure per flow. A s/w implementation can do atomic load balancing on multiple flow ids more efficiently than maintaining each event in a specific flow queue. > > > > 2. Scheduling group. A scheduling group is more a steam of events, so an event queue might be a better abstraction. > > > > 3. An event queue should support the concept of max active atomic flows (maximum number of active flows this queue can track at any given time) and max active ordered sequences (maximum number of outstanding events waiting to be egress reordered by this queue). This allows a scheduler implementation to dimension/partition its resources among event queues. > > > > 4. An event queue should support concept of a single consumer. In an application, a stream of events may need to be brought together to a single core for some stages of processing, e.g. for TX at the end of the pipeline to avoid NIC reordering of the packets. Having a 'single consumer' event queue for that stage allows the intensive scheduling logic to be short circuited and can improve throughput for s/w implementations. > > > > 5. Instead of tying eventdev access to an lcore, a higher level of abstraction called event port is needed which is the application i/f to the eventdev. Event ports are connected to event queues and is the object the application uses to dequeue and enqueue events. There can be more than one event port per lcore allowing multiple lightweight threads to have their own i/f into eventdev, if the implementation supports it. An event port abstraction also encapsulates dequeue depth and enqueue depth for a scheduler implementations which can schedule multiple events at a time and output events that can be buffered. > > > > 6. An event should support priority. Per event priority is useful for segregating high priority (control messages) traffic from low priority within the same flow. This needs to be part of the event definition for implementations which support it. > > > > 7. Event port to event queue servicing priority. This allows two event ports to connect to the same event queue with different priorities. For implementations which support it, this allows a worker core to participate in two different workflows with different priorities (workflow 1 needing 3.5 cores, workflow 2 needing 2.5 cores, and so on). > > > > 8. Define the workflow as schedule/dequeue/enqueue. An implementation is free to define schedule as NOOP. A distributed s/w scheduler can use this to schedule events; also a centralized s/w scheduler can make this a NOOP on non-scheduler cores. > > > > 9. The schedule_from_group API does not fit the workflow. > > > > 10. The ctxt_update/ctxt_wait breaks the normal workflow. If the normal workflow is a dequeue -> do work based on event type -> enqueue, a pin_event argument to enqueue (where the pinned event is returned through the normal dequeue) allows application workflow to remain the same whether or not an implementation supports it. > > > > 11. Burst dequeue/enqueue needed. > > > > 12. Definition of a closed/open system - where open system is memory backed and closed system eventdev has limited capacity. In such systems, it is also useful to denote per event port how many packets can be active in the system. This can serve as a threshold for ethdev like devices so they don't overwhelm core to core events. > > > > 13. There should be sort of device capabilities definition to address different implementations. > > > > > vnr > --- >