From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-CO1-obe.outbound.protection.outlook.com (mail-co1nam03on0041.outbound.protection.outlook.com [104.47.40.41]) by dpdk.org (Postfix) with ESMTP id 227AC2B8A for ; Wed, 2 Nov 2016 09:06:58 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=DZi74s9z+upNN15HwgQpdQ/2aAMKqtPledo4bHKQZIk=; b=M0pXduE9VBVTjRqN3Qz/x15Xp517FHgvjQIViLF4MGtg92ofVIwjb3dW9UptJgBWyK1W3dGoeEenyHNu2M7rqk+szAX7utnU1W9jcA5ZiC44vL9m/j6EoowBL9K/K9nK4vnMcYOwAu5Hazz4Kk35gtb4Gppsy1H9wkiWwDbjruc= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Jerin.Jacob@cavium.com; Received: from localhost.localdomain (122.167.46.37) by BLUPR0701MB1714.namprd07.prod.outlook.com (10.163.85.140) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.679.12; Wed, 2 Nov 2016 08:06:53 +0000 Date: Wed, 2 Nov 2016 13:36:34 +0530 From: Jerin Jacob To: "Van Haaren, Harry" Message-ID: <20161102080632.GA21820@localhost.localdomain> References: <20161005072451.GA2358@localhost.localdomain> <1476214216-31982-1-git-send-email-jerin.jacob@caviumnetworks.com> <20161025174904.GA18333@localhost.localdomain> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.7.1 (2016-10-04) X-Originating-IP: [122.167.46.37] X-ClientProxiedBy: MA1PR01CA0040.INDPRD01.PROD.OUTLOOK.COM (10.164.116.140) To BLUPR0701MB1714.namprd07.prod.outlook.com (10.163.85.140) X-MS-Office365-Filtering-Correlation-Id: 2b168582-da99-4030-37c3-08d402f736ad X-Microsoft-Exchange-Diagnostics: 1; BLUPR0701MB1714; 2:Fxhq+LM+uKhvlxb8FvEeRAySnQyr5mTv8IA9oMRWyKnzGDxz9Ta+xbyf/y2zMjt7661ABUldtbP5nsJIGnaR5ZQoI2X5aK7Qib2uCuE47h6eAazfRG8wEZgeoGnsSKzf72V5SsuNeIrKBQ6xmmt0fbFlrcrLD1giLn9Ai89cDjohfwThDOeMs6i0GQoyrX1ZPaKoFNAOSd1zHvY3fwouag==; 3:UjINjuAbZwunrlJ7iYy8nHoXK0Spc79GwZ6T23BfsaXjnZYM/yg+y1VNVIjIUS4L/lgbpCDs0nH3psaKJS261LSJXe3+D6/InyNr2HRHH1lKPTS4WkTaaYJd5X5g+MFIbekkgBfZLnB2jN/Pyf47Mw==; 25:8VqpfxR3+3UQhfyHB8THsAc6/47zvh+JmRfiTZpOBNwkrcQXw6z0jM4Ye9kAheW53wCnDV52ieLOoiHEn2blQTBvytGI4kaBzf2K3Hx1hOH7ObqW8E/ImSZTTnKRvB7J2BpSOeeqCu0sIHJ8PoNJ4Pkc2IQTvnFhxLGW7JD6yvCJwi2B7NGCjxsJiS0f80nWoTUqDsH5YhftEoSt/XfvWXqhohYKnnRy4CnCsAhKJPIFg0G/2VeU4T9bwqIlpIIWho55ZkbS9970Q6GgdcWv7GmU18z/clvPNLFYWRfbnFK3xiWfuRNzUn1u9p5IPm1FuXENsKO+AH+Pfny0keDpCGy9zXGxGtcR1F6rlOy2R5JLuaXbcP22ckvPa4B1+vSU/zAhdeRJt0q5TawxQXa6h8RCwN/o2c4t0cn2gRnFX720igmrll2XDXm9U6bfoi9S X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR0701MB1714; X-Microsoft-Exchange-Diagnostics: 1; BLUPR0701MB1714; 31:qQ65jnRg8Mc6bje8eiDPh5el0WLFk4qtOAKNZ3NYhwhDkmePWRTyIsYVuBpmBOwsedYJ5IpRarGviJHadayqkpF56L4YuMSD+eEBfvOwyslJK9xDdGLp5BguWKTWTVAoEaB+9HsoDiH1hmrx2ZdAqu3XeoFs3Nlvc5sZKevO8vjQM3q3+NOhfQ94dM535PFQzpTlvk6iC/UjW9ECqL4nxRvyS3L5OK5GjgCb3CHkF+6hykWcMTnr7v2xzGZ2e/01; 20:mYNWhLUgZ5gxy/PdYmIYSrnh0uJrE8zaCRIaUdaP5RuvRT+LwRkZdTfc22rcRFThIwc9a8VJ7awri4GjH4h2ovcYF+Z/48g4AZieTCs4WmEvX+v++ZHb0PCWx6wzhpOQoorKvyuIun5YRI1rRtQckw/KirZjC0pkhIf4Mj99i7xjrwU4qPJ/Y9PYoqGtRU27YYu9t+eQ5bGx/W5zuQwunT6sBcc8TN9BKiNRdOb/5fERLCcgGFUfytGp8QZ/92VzWDRKy3eqRskjj9c87no2ZYVnK02Mbj/UD4fgACi57Krm25+fQ1/czLX4lXWHUJCnt+T3qxbmN/B3Ch1QPHvn/9Trr/Kf9nuU8OQCWjbwLu919Nu75LVLISYCSjxQvq9vrbRJmlVmguj4CGhj3SzAMuqsPI8Bck3zhNmWWMNbah7X+/QkfcdmpNspEHNqTsIqJi2CLB4IYuHWIsNBZrqfQhTAHV9MM2XBym7AVc976Ca9dQg4CHqd+AjK7cjcEvp/0Zz2Ux3cZR1iHsMbltPbT2L4LVKMgJbKalp8rRRYYZCBUSvQemJMfc8xLnhadEBaaOXPrR3C0NSIBQh8qgiLL3heSkw+JgD+JKJwmEcytME= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046); SRVR:BLUPR0701MB1714; BCL:0; PCL:0; RULEID:; SRVR:BLUPR0701MB1714; X-Microsoft-Exchange-Diagnostics: 1; BLUPR0701MB1714; 4:FEcG++tlEDvvpUzuGvcZnaEPO57MYuARBweNGn1Py0xIkFSo8vFbY0Qfwfz9phGnMSTsYuPfvcZpiUhyfJC1S680z+mnNXeJK27d7Adxh/99w0KiDrO+PhI/OroM0f6Wy21I3G00DCQau6IhB/ziDzKg4N34B1/3Abk9OYK6hUQZ5bN2JRKTwbQC4SaRcPvjZisepUIbq1bQmbviSELS/f3nEqHGwnDBtq55wIDSywbjxW9ydqFjwSnYm80EN30EOesiK0krfX+8f1DBkjIMmv3HWjGAitmqoaHKMgeG0ukJ3Xra0yb078biQeJ/bH+FWHEyr4sT9M61bns9BLmlRDQ4EHiSjYRnfdtn6fnu7sQXNpoQt5VDJUOkNW3AhvvHyZf+GFnHaTOyo4U65t2xlA== X-Forefront-PRVS: 0114FF88F6 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(6069001)(7916002)(53754006)(377454003)(189002)(24454002)(13464003)(199003)(19580405001)(19580395003)(42186005)(68736007)(92566002)(66066001)(106356001)(105586002)(110136003)(97756001)(2906002)(5660300001)(6916009)(83506001)(2950100002)(42882006)(4326007)(81166006)(586003)(6116002)(3846002)(23726003)(1076002)(93886004)(6666003)(46406003)(50466002)(305945005)(9686002)(7846002)(7736002)(47776003)(61506002)(8666005)(77096005)(81156014)(101416001)(4001350100001)(8676002)(33656002)(97736004)(189998001)(54356999)(76176999)(50986999)(7099028)(18370500001)(7059030); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR0701MB1714; H:localhost.localdomain; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; BLUPR0701MB1714; 23:0Lp5qnFbIEiun6u1uAHd+Hv1eI9Qr5zxjoL6g2C?= =?us-ascii?Q?Xi7CA//0jMZQjePe4yvkZa706d6ysMcB+MNjZqJbyE0LCzdJr/z2R433ddJD?= =?us-ascii?Q?XMog4Dk4BUZ8RABpj4wlr+Z9+bBpF0fVGUq49pjZHK53vKYMRyMGdoAw/Zk8?= =?us-ascii?Q?koKkZcIN0nPMFjxg852K9vjBzsnwnXsg9yccRRTq100H6vomInO8ncWdVX2o?= =?us-ascii?Q?BAv4QRgF4e9WwM3vEDGECFdhk32D7h0+lf1Fkd29RqQODE1jDjrdksjdmco/?= =?us-ascii?Q?M7LW9yg1ZtmnkPYk6dk5BTZDMzKIbep2GPwUmaf3vDj7YCLfqMr7j22MpTb/?= =?us-ascii?Q?dE/9SK82kNuleed3+7xxhwQIT3helCdiFpFRq2lmtUB6rSjnjj0gASvqZuaR?= =?us-ascii?Q?DNqaOP6jmQhOhQZcgjlmCjzAQMSfbB7qELrKsUDyWNJfSNLiopJqVdjIfTRO?= =?us-ascii?Q?QsWeOq+luYOsF36Ck6A9t+u0WP9/8fXoCZx6JhZrfD2oxMgHqWkXsR2z8XsA?= =?us-ascii?Q?lMWydweXqLK+haOeOPOyhhdpuaMB49PR8ny7AW5u6dC9sDZM8fy3Y2pbpxTK?= =?us-ascii?Q?WQyGNqGZmIkcTkEBn5islvodPKUy3CSWQf2eq+FOi8m/jxCQNUAOSSc1tFxn?= =?us-ascii?Q?EVXaOuroLIQJXGedcYnypYa0lJ/cOE5jhy97TO6OlvVj3zznYEw6nA9GKfkN?= =?us-ascii?Q?F3yZcRkHY+a6g+wmAw7NRLlKbSAs5re1NUNuM/WjtEEpPJrlsnse/RndJmAL?= =?us-ascii?Q?DqbSsLbjKucdXjmh+24da7+KcUz6TRZ7GlQOaBk3FexrqT6BNLV0moHkuO3A?= =?us-ascii?Q?dcPf8ZZt1nYnmj9WNrnsdaA6Y248SJqGso/aEXpx9on4JChT5SX4l7u9f1uf?= =?us-ascii?Q?AtfcP1wmz+iKjXtax3Ml7JUZpbYKsYzOz1Qd8Aw2FAwaB0g2Psb0WPG1TAvP?= =?us-ascii?Q?+efuHaqGk2MRUdUk2PJ5nyDNEkvvlXIloYKhcA9fZbnXpb20Uj0R4bpzOT9W?= =?us-ascii?Q?kWGuHRB8tg2BWWerVomQYOpIymgy8HEJbnDOap3/2rWjCl8c65GXCgeBM0KP?= =?us-ascii?Q?PHjWp3v4BPtj7Keq2XEAd2XKRZ1hJIHhkSiOKCAlUxYZO74FgGHo3op+iiae?= =?us-ascii?Q?g7m623c/jr31ntQmL3gtcC5wJTlaVZBQWAV9u7ZMS6spL4YqaEdzlkgJ63BI?= =?us-ascii?Q?elDXQn0OX0LxubZ1kxXqLn5//ZZ5ymGjXtmgYcdIDcEXmWYBQe/mMnAWlZAl?= =?us-ascii?Q?dmfn2Ac/D6d7ZL8pVp2neEDZtbC4rmTnwHLImI5oY6RV01tCjP6uFEAB/jgG?= =?us-ascii?Q?i4eY/V8HXMCCH5XZg/WWzUbLlfaIABErIFRAAiF5u+oA/87fC9VLg2bAr2rz?= =?us-ascii?Q?JkHxGYgCXMUlawfUPnRTZ0BY4saR9Ubbz9RZqBMf/L2EUVKZO?= X-Microsoft-Exchange-Diagnostics: 1; BLUPR0701MB1714; 6:W7cBIGCBa9AJMcpVaLpl3ATrFlgpdaPq87qj8G6tmIMrs7UpsXtpHbmUbyDiShtK39zu4F43nmkGB2g9/8bqlnf9d7c4XXkbBRB2dPbU9T92yYOj8V4Uib4yS1+APwUtRlQIP9dbJ+MeBSimuePRWsikyPjtNJmXLcBbpLkU0zPY1ui3i9yN6NRY9QAb0Ew5XN6VLJf6jr6cea7JNx40qtlWV7LytbvA6aGPc3jciY4wWPTxX5YLZkWbaI+Irbltx5uyYgYxcPffw8CbWsudJZ3GlkC8OHEHcWNRrH7zL/Ny3KK96gKYzsM9KkBDVJMQ; 5:VMK0sOlTOn473Pj6f1o7om9b3oQdtt3YCpjBUtDRwF0W5r6U3g/s/XXnlYLxl3ZQRxXlOZpanwzv+exTsVeE29YaFythD1VKxeMgu3bXTNZPx0ShB2GKrpEwPkqD0TnffcxbbDPLJyASlFDZuFyAMg==; 24:UoRTNYib4RuYOOysSFGYT6nBq7h1L250r0uTQl8bHvx+boFhrmPV+XX+Q2Bm3TXJSkDZj8bOS7F55DDmlt9SpUP0EP741Q3MKGHFX9cLe/Y= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; BLUPR0701MB1714; 7:NCild+l/O2ZJmI9G+LNRKY8i/inpW5awSCZRorUXlnrTSyExsGUPT5ungY9HPJaoSntc5XOkkM0sdiKYsx3nSHeNcChTcZqCgvgHu5kvvao59pODTWFM4cBKZaRNKuCFUPkFaBMoeTmS9A8OpEQXTPFF9sYEz7zBrtyA/hGj7Qf2eXVEt9pUbtADtyhICHpKJicCs57dbnocxgAkh99zi3sQduFvQ4tiISPxaqjuCEggzIIO3V/4Fr+5/CrlsMt2VOOAaOs8M3hkDeRxJ84G7jyopjLZskpjeCoohKV8yQQg6ejsooUeMjMBSYR8Lh6PbWk4M/e2RcO6ttsfo0jCKFSl1JAr1c0gnq4T7xsSYU0= X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Nov 2016 08:06:53.3736 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR0701MB1714 Cc: "Vangati, Narender" , "dev@dpdk.org" , "Eads, Gage" Subject: Re: [dpdk-dev] [RFC] [PATCH v2] libeventdev: event driven programming model framework for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Nov 2016 08:06:58 -0000 On Fri, Oct 28, 2016 at 01:48:57PM +0000, Van Haaren, Harry wrote: > > -----Original Message----- > > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Jerin Jacob > > Sent: Tuesday, October 25, 2016 6:49 PM > > > > > Hi Community, > > > > So far, I have received constructive feedback from Intel, NXP and Linaro folks. > > Let me know, if anyone else interested in contributing to the definition of eventdev? > > > > If there are no major issues in proposed spec, then Cavium would like work on > > implementing and up-streaming the common code(lib/librte_eventdev/) and > > an associated HW driver.(Requested minor changes of v2 will be addressed > > in next version). > > > Hi All, > > I've been looking at the eventdev API from a use-case point of view, and I'm unclear on a how the API caters for two uses. I have simplified these as much as possible, think of them as a theoretical unit-test for the API :) > > > Fragmentation: > 1. Dequeue 8 packets > 2. Process 2 packets > 3. Processing 3rd, this packet needs fragmentation into two packets > 4. Process remaining 5 packets as normal > > What function calls does the application make to achieve this? > In particular, I'm referring to how can the scheduler know that the 3rd packet is the one being fragmented, and how to keep packet order valid. > OK. I will try to share my views on IP fragmentation on event _HW_ models(at least on Cavium HW) then we can see, how we can converge. First, The fragmentation specific logic should be decoupled from the event model as it specific to packet and L3 layer(Not specific to generic event) Now, let us consider the fragmentation handling with non-burst case and single flow. The following text outlines the event flow a)Setup an event device with single event queue b)Link multiple ports to single event queue c)Event producer enqueues p0..p7 packets to event queue with ORDERED type.(let's assume p2 packet needs to be fragmented i.e application needs to create p2.0 and p2.1 from p2) d)Since it is an ORDERED type, p0 to p7 packets are distributed to multiple ports in parallel(assigned to each lcore or lightweight thread) e) each lcore/lightweight thread get the packet from designated event port and process them in parallel and enqueue back to ATOMIC type to maintain ordering f)The one lcore dequeues the p2 packet, understands it needs to be fragmented due to MTU size etc. So it calls rte_ipv4_fragment_packet() and store the fragmented packet p2.0 and p2.1 in private area of p2 mbuf. and as usual like other workers, it enqueues p2 to atomic queue for maintaining the order. g)On the atomic flow, when lcore dequeues packets, then it comes in order p0..p7. The application sends p0 to p7 on the wire. When application checks the p2 mbuf private area it understands it is fragmented and then sends p2.0 and p2.1 on the wire. OR skip the fragmentation step in (f) and in step (g), while processing the p2, run over rte_ipv4_fragment_packet() and split the packet and transmit the packets(in case application don't want to deal with mbuf private area) Now, When it comes to BURST scheme. We are planning to create a SW structure as a virtual event port and associate N (N=rte_event_port_dequeue_depth()) physical HW event ports to the virtual port. That way, it just come as an extension to non burst API and on the release call have explicit "index" and identify the physical event port associated with the virtual port. /Jerin > > Dropping packets: > 1. Dequeue 8 packets > 2. Process 2 packets > 3. Processing 3rd, this packet needs to be dropped > 4. Process remaining 5 packets as normal > > What function calls does the application make to achieve this? > Again, in particular how does the scheduler know that the 3rd packet is being dropped. rte_event_release(..,..,3)?? > > > Regards, -Harry