From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 84D4AA056D; Tue, 3 Mar 2020 08:55:17 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 563F41BFF2; Tue, 3 Mar 2020 08:55:16 +0100 (CET) Received: from mail-io1-f67.google.com (mail-io1-f67.google.com [209.85.166.67]) by dpdk.org (Postfix) with ESMTP id 30F431BFF0 for ; Tue, 3 Mar 2020 08:55:14 +0100 (CET) Received: by mail-io1-f67.google.com with SMTP id r15so2577086iog.0 for ; Mon, 02 Mar 2020 23:55:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=nEABt1uwZMWkcZPl5THMU1Rclc9J6ir/KuCcCo8eK2Y=; b=Bzj3YKEbNmTmDTHID2TnzjYmT7+8M/9+B/7Ys1FOKPVrOSFVKlybpBuZBNTzKwQW3t DEqs9gChTUiiGV202XnJHEFIPNYTaT9LFY+hM4u7EgDI3X07fWJtVph/OtRmZmqkcGOE T9MkZ2f/Q0RTIDfIEahEglKRJIgvfnAjFeHo+YIlGGUEey+WQ66tXnNYrg3MMWGwfUoj iPynFquwsvx42aDBoi+qsvQmVCAyxdL+eE6PWc707YPXNeFf/F1M/JDY4MDqvJT6spdf PubwuPYtMQjTo/3mPqAw0yStJso3539jVxADjHUnOfHg0zpyvTQCYC1/pb86lONjgee2 AjIw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=nEABt1uwZMWkcZPl5THMU1Rclc9J6ir/KuCcCo8eK2Y=; b=JUD/+Nht53fGtm5rD+uFvqAJ8Qqg7xX8NpK2tDk+Fv5O7nzKAKaylO3Un5xO6kKz9l su1Ldq7DO+9dmOP1m9t9PmCiMKJ8pIKEYqqYfdqmjyqOfS6JbPCL3p9YBnn04ZcP3ksG o6Mk+UpRfFiQKh3iV1d1AyUG6mcjlHdiP8c4ifcINa2ODWMMmkKew7ZQsuzRU8nOW4W+ cTuvMsPBZ+jL6v+qNYBd2VN43nTV3Z56EfLKbLGbFxd6DAGUR8OKL+03r2X7uiu5aF8v h/lob/sgFWvhPBBzy6VyLU6PLa6c3PuLAl22PXonjJobMkg3tz/4I5fl06V2ZNKq49tj /TvA== X-Gm-Message-State: ANhLgQ31CNZYgjmN1KI80CXQ8BgAx+sufuAph86GVJeeUgAEOB/oRjri 8rMpD6WhBHdYRA5DiqVCHV5ccf56NX1nk+WwZys= X-Google-Smtp-Source: ADFU+vslkvTkFakR4o6GpOogbqM2OftnLb7lAUiV76gqjUP6vh4wqE4l9GCfhRwn+/55NrdRu2YorI5M3VYzLwjkUNA= X-Received: by 2002:a05:6602:95:: with SMTP id h21mr2886249iob.271.1583222113356; Mon, 02 Mar 2020 23:55:13 -0800 (PST) MIME-Version: 1.0 References: <20190627155036.56940-1-jerinj@marvell.com> <1582816115-95871-1-git-send-email-orika@mellanox.com> <20200302070500.GA31870@hyperscan> In-Reply-To: From: Jerin Jacob Date: Tue, 3 Mar 2020 13:24:56 +0530 Message-ID: To: Ori Kam Cc: Wang Xiang , "jerinj@marvell.com" , "dev@dpdk.org" , "pbhagavatula@marvell.com" , Shahaf Shuler , "hemant.agrawal@nxp.com" , Opher Reviv , Alex Rosenbaum , "dovrat@marvell.com" , "pkapoor@marvell.com" , "nipun.gupta@nxp.com" , "bruce.richardson@intel.com" , "yang.a.hong@intel.com" , "harry.chang@intel.com" , "gu.jian1@zte.com.cn" , "shanjiangh@chinatelecom.cn" , "zhangy.yun@chinatelecom.cn" , "lixingfu@huachentel.com" , "wushuai@inspur.com" , "yuyingxia@yxlink.com" , "fanchenggang@sunyainfo.com" , "davidfgao@tencent.com" , "liuzhong1@chinaunicom.cn" , "zhaoyong11@huawei.com" , "oc@yunify.com" , "jim@netgate.com" , "hongjun.ni@intel.com" , "j.bromhead@titan-ic.com" , "deri@ntop.org" , "fc@napatech.com" , "arthur.su@lionic.com" , Thomas Monjalon Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-dev] [RFC v5] regexdev: introduce regexdev subsystem X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Tue, Mar 3, 2020 at 1:14 PM Ori Kam wrote: > > Hi Xiang, > > May I ask when do you plan to add the Hyperscan code to the DPDK? > > > -----Original Message----- > > From: dev On Behalf Of Wang Xiang > > Sent: Monday, March 2, 2020 9:05 AM > > To: Ori Kam > > Cc: jerinj@marvell.com; dev@dpdk.org; pbhagavatula@marvell.com; Shahaf > > Shuler ; hemant.agrawal@nxp.com; Opher Reviv > > ; Alex Rosenbaum ; > > dovrat@marvell.com; pkapoor@marvell.com; nipun.gupta@nxp.com; > > bruce.richardson@intel.com; yang.a.hong@intel.com; harry.chang@intel.com; > > gu.jian1@zte.com.cn; shanjiangh@chinatelecom.cn; > > zhangy.yun@chinatelecom.cn; lixingfu@huachentel.com; wushuai@inspur.com; > > yuyingxia@yxlink.com; fanchenggang@sunyainfo.com; > > davidfgao@tencent.com; liuzhong1@chinaunicom.cn; > > zhaoyong11@huawei.com; oc@yunify.com; jim@netgate.com; > > hongjun.ni@intel.com; j.bromhead@titan-ic.com; deri@ntop.org; > > fc@napatech.com; arthur.su@lionic.com; Thomas Monjalon > > > > Subject: Re: [dpdk-dev] [RFC v5] regexdev: introduce regexdev subsystem > > > > Hi Ori, > > > > Comments below. > > > > Thanks, > > Xiang > > > > On Thu, Feb 27, 2020 at 03:08:35PM +0000, Ori Kam wrote: > > > From: Jerin Jacob > > > > > > Even though there are some vendors which offer Regex HW offload, due to > > > lack of standard API, It is diffcult for DPDK consumer to use them > > > in a portable way. > > > > > > This _RFC_ attempts to standardize the RegEx/DPI offload APIs for DPDK. > > > > > > This RFC crafted based on SW Regex API frameworks such as libpcre and > > > hyperscan and a few of the RegEx HW IPs which I am aware of. > > > > > > RegEx pattern matching applications: > > > * Next Generation Firewalls (NGFW) > > > * Deep Packet and Flow Inspection (DPI) > > > * Intrusion Prevention Systems (IPS) > > > * DDoS Mitigation > > > * Network Monitoring > > > * Data Loss Prevention (DLP) > > > * Smart NICs > > > * Grammar based content processing > > > * URL, spam and adware filtering > > > * Advanced auditing and policing of user/application security policies > > > * Financial data mining - parsing of streamed financial feeds > > > * Application recognition. > > > * Dmemory introspection. > > > * Natural Language Processing (NLP) > > > * Sentiment Analysis. > > > * Big data databse acceleration. > > > * Computational storage. > > > > > > Request to review from HW and SW RegEx vendors and RegEx application > > > users to have portable DPDK API for RegEx. > > > > > > The API schematics are based cryptodev, eventdev and ethdev existing > > > device API. > > > > > > Signed-off-by: Jerin Jacob > > > Signed-off-by: Pavan Nikhilesh > > > Signed-off-by: Ori Kam > > > --- > > > V5: > > > * Remove unused iov struct. > > > V4: > > > * Replace iov with mbuf. > > > * Small ML comments. > > > V3: > > > * Change subject title. > > > V2: > > > * Address ML comments. > > > --- > > > + > > > +#define RTE_REGEX_DEV_SUPP_PCRE_GREEDY_F (1ULL << 6) > > > +/**< RegEx device support PCRE Greedy mode. > > > + * For example if the RegEx is 'AB\d*?' then '*?' represents zero or > > unlimited > > > + * matches. In greedy mode the pattern 'AB12345' will be matched > > completely > > > + * where as the ungreedy mode 'AB' will be returned as the match. > > > + * @see struct rte_regex_dev_info::regex_dev_capa > > > + */ > > > + > > > > Hyperscan actually supports "match all" semantic, neither greedy nor > > ungreedy, > > which is different from PCRE. In the case above, AB, AB1, ..., AB12345 will all > > be returned as matches. Do HW solutions support this? > > No our HW doesn't support this. > Jerin, does Marvell HW support this? No. It does not support it.