From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id C1870A0471 for ; Fri, 16 Aug 2019 08:24:31 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id EFB8E1BEE3; Fri, 16 Aug 2019 08:24:30 +0200 (CEST) Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-eopbgr80054.outbound.protection.outlook.com [40.107.8.54]) by dpdk.org (Postfix) with ESMTP id 4F2EA1BEE1 for ; Fri, 16 Aug 2019 08:24:30 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=C4Gb+abuYSCLBWhTceVP7wqejYkDwy4JR7Bp4vI6Ryo=; b=GxSaSQLYPQb/uyuTtrFLLEhchjnV92Wc9/Wy8aBcz+rS0LVLOMmspIcr7kuzPK8PHTVg6xqKFmjrYdp2BqWwrzL/KKTMF2P44Ue8h7D3gn+5JK1ePwJHlKzNwBI7aWk5Xz4rnsUGTT/QYsFhZeN18WVgtMF6g2dsgkS+SS0FkQw= Received: from DB6PR0802CA0042.eurprd08.prod.outlook.com (2603:10a6:4:a3::28) by AM0PR08MB4947.eurprd08.prod.outlook.com (2603:10a6:208:158::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2157.14; Fri, 16 Aug 2019 06:24:27 +0000 Received: from AM5EUR03FT044.eop-EUR03.prod.protection.outlook.com (2a01:111:f400:7e08::208) by DB6PR0802CA0042.outlook.office365.com (2603:10a6:4:a3::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.2157.18 via Frontend Transport; Fri, 16 Aug 2019 06:24:27 +0000 Authentication-Results: spf=temperror (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=temperror action=none header.from=arm.com; Received-SPF: TempError (protection.outlook.com: error in processing during lookup of arm.com: DNS Timeout) Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by AM5EUR03FT044.mail.protection.outlook.com (10.152.17.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.20.2178.16 via Frontend Transport; Fri, 16 Aug 2019 06:24:25 +0000 Received: ("Tessian outbound cc8a947d4660:v26"); Fri, 16 Aug 2019 06:24:23 +0000 X-CR-MTA-TID: 64aa7808 Received: from 7f8d8cbaab52.1 (cr-mta-lb-1.cr-mta-net [104.47.10.50]) by 64aa7808-outbound-1.mta.getcheckrecipient.com id 79337F36-5E76-4D4C-8410-2C3328714F76.1; Fri, 16 Aug 2019 06:24:18 +0000 Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-db5eur03lp2050.outbound.protection.outlook.com [104.47.10.50]) by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 7f8d8cbaab52.1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-SHA384); Fri, 16 Aug 2019 06:24:18 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UTnXD1BEE1hzbLRExkiEcgGVN6G8P20cuY4oGszZ91yARXwTJtEiOsHthc9ONvam+MyI0lBcZ3um/lan/zW4JQMw9CbCjJOTmM+wsIubDRWeKIbgwmV77TyOmdj/VNc1U9hqL7bcFaaSnw2Xp6H3V/ZxYKs7YVazu38D1NhZjosW3JDPm3iOALTJ0+DgAKF56R2u7jXn+fIjRnVtV9dyqGg6EAWONFDzzGNCYWaVC6tKTjyLAouLonCGojKB502Dh2HEi/K+Vq1h2bp+ZT+CWbxMjaia0EYZCa1jMN5dnaH8MwYMUjKSCiJtEUFCbjjJPLd/SCeeilPR7AXOlpzymA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Cd0imRKLM8iLi7WkM0H/Y7uF/LGe+8ZWvpNzFfD6CqU=; b=agl0bfMB1Nr5nTSmVyXwZ+bTQf3JgPbqt8pAMUILMXil1oaSpMu6LiCkyqJiXaEWXU3Jd5fYShNAXQiQTre5IUF4/RJULBt2yx0VHFSRcA5Dy5SNUbJq9xnPpmA1JdOtD/7lUWc8fld8qGmk6yiwmGEEzZ/0Js16vh6DjGXRHhKxHTx9LHFPl8xLRBh0yso97Pb+uShKfc0VOVegdNzzbZ1D1AQblI6BBk98Y+n31W6RkZ0ooRg9QN62xA3YdximlQBhA0bt8c+dUHuWOnTF53mb/B5ZD/c3XiD+B59ifcWbrZAY6o2oHquUTzoxqfJ2B9QjTha53yYxdZ3BAtNdEg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Cd0imRKLM8iLi7WkM0H/Y7uF/LGe+8ZWvpNzFfD6CqU=; b=pmrLmH4mqslgfgidYnPqRS28BPC75rUZUvARbPpdZ6hS+vZ4Q/3NBoTpI2OIoerQvMwPQf5PZDrT3+heLWfkSlW3P6g/YvMXTaxTjEuTnXVwmyEDx9yHKPQjBs8GE/Ql782ATCz4xPi6g48KpR4HIAd4CtG4cZTcC//tdkgUH/s= Received: from VI1PR08MB5376.eurprd08.prod.outlook.com (52.133.244.200) by VI1PR08MB3759.eurprd08.prod.outlook.com (20.178.14.90) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2157.20; Fri, 16 Aug 2019 06:24:16 +0000 Received: from VI1PR08MB5376.eurprd08.prod.outlook.com ([fe80::8130:867e:2371:9c0]) by VI1PR08MB5376.eurprd08.prod.outlook.com ([fe80::8130:867e:2371:9c0%2]) with mapi id 15.20.2178.016; Fri, 16 Aug 2019 06:24:16 +0000 From: "Gavin Hu (Arm Technology China)" To: "Zhang, Qi Z" , "Ye, Xiaolong" CC: "Richardson, Bruce" , "Ananyev, Konstantin" , "users@dpdk.org" , Honnappa Nagarahalli , "Phil Yang (Arm Technology China)" , "Ruifeng Wang (Arm Technology China)" Thread-Topic: i40e vPMD fix out of order Rx read issue Thread-Index: AdVCzJhDNbgBl9FATkWplfpJPawhKgAEGCLwAC59RaAAIKjSIAOMKbFQAAGo47AAYyTYgAAB238AAAPK6OA= Date: Fri, 16 Aug 2019 06:24:15 +0000 Message-ID: References: <039ED4275CED7440929022BC67E7061153D71548@SHSMSX105.ccr.corp.intel.com> <039ED4275CED7440929022BC67E7061153D7485E@SHSMSX105.ccr.corp.intel.com> <039ED4275CED7440929022BC67E7061153D7D657@SHSMSX105.ccr.corp.intel.com> <20190816025058.GA53345@intel.com> <039ED4275CED7440929022BC67E7061153D7E363@SHSMSX105.ccr.corp.intel.com> In-Reply-To: <039ED4275CED7440929022BC67E7061153D7E363@SHSMSX105.ccr.corp.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: f3972558-8946-4785-bc65-70cb0c140a12.0 x-checkrecipientchecked: true Authentication-Results-Original: spf=none (sender IP is ) smtp.mailfrom=Gavin.Hu@arm.com; x-originating-ip: [113.29.88.7] x-ms-publictraffictype: Email X-MS-Office365-Filtering-Correlation-Id: 2a5f0d94-4664-45ce-90e3-08d7221262cf X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam-Untrusted: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(7168020)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(711020)(4605104)(1401327)(4618075)(2017052603328)(7193020); SRVR:VI1PR08MB3759; X-MS-TrafficTypeDiagnostic: VI1PR08MB3759:|AM0PR08MB4947: X-MS-Exchange-PUrlCount: 5 x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true x-ms-oob-tlc-oobclassifiers: OLM:9508;OLM:9508; x-forefront-prvs: 0131D22242 X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(10009020)(4636009)(346002)(136003)(396003)(39850400004)(376002)(366004)(13464003)(199004)(189003)(305945005)(478600001)(14454004)(7736002)(8936002)(74316002)(2906002)(52536014)(446003)(66066001)(81156014)(8676002)(486006)(966005)(86362001)(81166006)(476003)(25786009)(11346002)(53936002)(76176011)(71190400001)(71200400001)(6116002)(64756008)(66446008)(99286004)(256004)(33656002)(9686003)(4326008)(5660300002)(66946007)(102836004)(76116006)(26005)(186003)(66556008)(7696005)(6306002)(54906003)(55236004)(53546011)(6506007)(110136005)(316002)(55016002)(5024004)(3846002)(6436002)(14444005)(6246003)(66476007)(229853002); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR08MB3759; H:VI1PR08MB5376.eurprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: arm.com does not designate permitted sender hosts) X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Message-Info-Original: MG1ABmjZzQYNB6UtZgT2KBKIrcBBkAmO8u0HWztXtiLTwFWZObF+dzGdoB9Zr5aGFBiukyIFdQs55jPJ9EUiUT6006rM631rSMOk1gAIstsWWjbpf4uL/BX3BhxyG4iPp3m6t4YV7Ifcl8DZL1+k6K8Yg+2YTSVlenPoHvCdnReY72w91GUHbbnqwwD0L7QbTqZdQanXgJthkov9LTqOFdTjnNmcGvDdFAKV/jRof6Xh2bzkPtJSCQBTeWQyy9o1XHsdkwHSGm82fI7xe7nME/ZttddiRor6Jkp0thJslQDUmDNOB+8i+NyPpzwDXlVU3xbQmBbr4wFKqSPH4aL3UJ2Wgs4hz48vZ2Ud6uqxjqwySTKtEcZVqoAWiljEdFyOuJ3lgGIUuk0hXiDc3ekf+xJ0oKHoxLYiuoLeAsxhl8Q= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR08MB3759 Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Gavin.Hu@arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: AM5EUR03FT044.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; IPV:CAL; SCL:-1; CTRY:IE; EFV:NLI; SFV:NSPM; SFS:(10009020)(4636009)(396003)(39850400004)(376002)(346002)(136003)(2980300002)(13464003)(199004)(189003)(40434004)(3846002)(5024004)(8936002)(63350400001)(70206006)(9686003)(50466002)(81166006)(81156014)(110136005)(478600001)(70586007)(99286004)(36906005)(97756001)(316002)(6306002)(8746002)(5660300002)(54906003)(6246003)(356004)(55016002)(52536014)(86362001)(46406003)(2906002)(26005)(305945005)(4326008)(486006)(66066001)(186003)(14444005)(47776003)(7736002)(102836004)(33656002)(336012)(26826003)(14454004)(76130400001)(63370400001)(126002)(74316002)(8676002)(446003)(476003)(229853002)(966005)(23726003)(6506007)(25786009)(22756006)(6116002)(7696005)(76176011)(53546011)(11346002); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR08MB4947; H:64aa7808-outbound-1.mta.getcheckrecipient.com; FPR:; SPF:TempError; LANG:en; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; A:1; MX:1; X-MS-Office365-Filtering-Correlation-Id-Prvs: 9cb7c649-9fe9-43be-de82-08d722125d00 X-Microsoft-Antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600148)(710020)(711020)(4605104)(1401327)(2017052603328)(7193020); SRVR:AM0PR08MB4947; X-Forefront-PRVS: 0131D22242 X-Microsoft-Antispam-Message-Info: 1BFfu3CdWi4eXEvLZE9q+uUjT2hVvrY/dIYlzC0x8Rwg0x9v7ySS9CrTOfmhqCGR59dJXmtwBK+p7POG4xywoau9PzQFeORwtTUYutShQTc2idV+6PQIFoenh66k8quJ7pSNF7XYgIdPYK21QyYYnUuAD/5lx1FYlZxyBYqI82Ssuq1JnpC8nTeVELbwFCKN3eTIOyZxr/dpzZQfkB0h6iJoZafKTRAnctcFU+9Z13+381lKxqPzQaFni9/j4uLJAkV0Bi9RH7JDT8WcO9dJzO4wR5Gci4MllyjXoQgTTTeslIhmbenVSH8rfZFZI/FKsD4fapT0qVfWa2PIMUJNbKLhiIGFZPUSr31uH045VpYufjYivIEMO6Eg9Hj16bCb0YZ1vSOcvxmug/sWQZ2DkpsBsp4keXbR4oDzEn/6ed0= X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 16 Aug 2019 06:24:25.7819 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 2a5f0d94-4664-45ce-90e3-08d7221262cf X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB4947 Subject: Re: [dpdk-users] i40e vPMD fix out of order Rx read issue X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Thanks Qi and Xiaolong, Yes, it applies to Arm platforms only, we already discussed with Qi about t= he NIC behavior and we believe the patches are safe, but if Qi can further = review, that would be better. Best regards, Gavin > -----Original Message----- > From: Zhang, Qi Z > Sent: Friday, August 16, 2019 11:44 AM > To: Ye, Xiaolong > Cc: Gavin Hu (Arm Technology China) ; Richardson, > Bruce ; Ananyev, Konstantin > ; users@dpdk.org; Honnappa Nagarahalli > ; Phil Yang (Arm Technology China) > ; Ruifeng Wang (Arm Technology China) > > Subject: RE: i40e vPMD fix out of order Rx read issue > > > > > -----Original Message----- > > From: Ye, Xiaolong > > Sent: Friday, August 16, 2019 10:51 AM > > To: Zhang, Qi Z > > Cc: Gavin Hu (Arm Technology China) ; Richardson, > > Bruce ; Ananyev, Konstantin > > ; users@dpdk.org; Honnappa > Nagarahalli > > ; Phil Yang (Arm Technology China) > > ; Ruifeng Wang (Arm Technology China) > > > > Subject: Re: i40e vPMD fix out of order Rx read issue > > > > On 08/14, Zhang, Qi Z wrote: > > >+ Xiaolong > > > > > >I think we can merge them to dpdk-next-net-intel early since 19.11 cyc= le > is > > started. > > > > Ok, could you help to ack these patches? > > I'm not expert on arm, the patch is only impact on the arm platform and i= t is > reviewed by peoples that works on arm already, I think we can just apply = it. > > > > > > Thanks, > > Xiaolong > > > > > >> -----Original Message----- > > >> From: Gavin Hu (Arm Technology China) [mailto:Gavin.Hu@arm.com] > > >> Sent: Wednesday, August 14, 2019 11:20 AM > > >> To: Zhang, Qi Z ; Richardson, Bruce > > >> ; Ananyev, Konstantin > > >> > > >> Cc: users@dpdk.org; Honnappa Nagarahalli > > >> ; Phil Yang (Arm Technology China) > > >> ; Ruifeng Wang (Arm Technology China) > > >> > > >> Subject: RE: i40e vPMD fix out of order Rx read issue > > >> > > >> Hi Qi, > > >> > > >> > -----Original Message----- > > >> > From: Zhang, Qi Z > > >> > Sent: Saturday, July 27, 2019 9:33 AM > > >> > To: Gavin Hu (Arm Technology China) ; > Richardson, > > >> > Bruce ; Ananyev, Konstantin > > >> > > > >> > Cc: users@dpdk.org; Honnappa Nagarahalli > > >> > ; Phil Yang (Arm Technology > China) > > >> > ; Ruifeng Wang (Arm Technology China) > > >> > > > >> > Subject: RE: i40e vPMD fix out of order Rx read issue > > >> > > > >> > > > >> > > > >> > > -----Original Message----- > > >> > > From: Gavin Hu (Arm Technology China) > [mailto:Gavin.Hu@arm.com] > > >> > > Sent: Friday, July 26, 2019 6:01 PM > > >> > > To: Zhang, Qi Z ; Richardson, Bruce > > >> > > ; Ananyev, Konstantin > > >> > > > > >> > > Cc: users@dpdk.org; Honnappa Nagarahalli > > >> > > ; Phil Yang (Arm Technology > China) > > >> > > ; Ruifeng Wang (Arm Technology China) > > >> > > > > >> > > Subject: RE: i40e vPMD fix out of order Rx read issue > > >> > > > > >> > > Hi Qi, > > >> > > > > >> > > Thanks for your explanation! > > >> > > I did some testing and found the barriers caused a big drop in > > >> > > RFC2544 NDR performance on aarch64, how about it on X86? > > >> > For x86, I think we don't have performance drop, the memory barrie= r > > >> > just change the compiler's behavior to avoid generate out of order > > >> > read instructions, and x86 guarantee no out of read execution, so > > >> > it does not add new instructions that cost CPU cycles. > > >> > > > >> > > Is it possible to count DD bits in a way of surviving across the > > >> > > out-of-order descriptors reading? > > >> > > > >> > I think it is possible, but this will impact performance on x86, > > >> > but for aarch64, you can try out to see if that benefit and do > > >> > proper optimization on related vPMD implementation. > > >> The patches for aarch64 are in community review, and performances > > >> gain were measured both for ixgbe and i40e vPMD. Very appreciate if > > >> you can further review and comment. > > >> Here are the patch links: > > >> IXGBE vPMD: > > >> http://patches.dpdk.org/patch/57649/ > > >> http://patches.dpdk.org/patch/57650/ > > >> I40e vPMD: > > >> http://patches.dpdk.org/cover/57651/ > > >> http://patches.dpdk.org/patch/57652/ > > > > > > > > > > > >> > > > > >> > > Best Regards, > > >> > > Gavin > > >> > > > > >> > > > -----Original Message----- > > >> > > > From: Zhang, Qi Z > > >> > > > Sent: Thursday, July 25, 2019 8:11 PM > > >> > > > To: Gavin Hu (Arm Technology China) ; > > >> > > > Richardson, Bruce ; Ananyev, > > >> > > > Konstantin > > >> > > > Cc: users@dpdk.org; Honnappa Nagarahalli > > >> > > > ; Phil Yang (Arm Technology > > >> > > > China) > > >> > > > Subject: RE: i40e vPMD fix out of order Rx read issue > > >> > > > > > >> > > > Hi Gavin: > > >> > > > > > >> > > > in vPMD, we read 4 or 8 packets as batch, we count DD bits for > > >> > > > packet received, but not check the if they are continues or > > >> > > > not, we assume it should always be 1000, 1100, 1110, 1111 > > >> > > > ....(take batch size is 4 as > > >> > > > example) while the out of order read instruction generated by > > >> > > > compiler will cause driver to get un-continues DD bits, like > > >> > > > 1011, the descriptor on the hole actually is invalid since whe= n > > >> > > > it is read , descriptor is not write back yet, but we still > > >> > > > process this as 1110, it cause > > >> > an > > >> > > corrupted mbuf returned. > > >> > > > > > >> > > > hope this is helpful. > > >> > > > > > >> > > > Regards > > >> > > > Qi > > >> > > > > > >> > > > > -----Original Message----- > > >> > > > > From: Gavin Hu (Arm Technology China) > > >> > > > > [mailto:Gavin.Hu@arm.com] > > >> > > > > Sent: Thursday, July 25, 2019 5:57 PM > > >> > > > > To: Zhang, Qi Z ; Richardson, Bruce > > >> > > > > ; Ananyev, Konstantin > > >> > > > > > > >> > > > > Cc: users@dpdk.org; Honnappa Nagarahalli > > >> > > > > ; Phil Yang (Arm Technology > > >> > > > > China) > > >> > > > > Subject: i40e vPMD fix out of order Rx read issue > > >> > > > > > > >> > > > > Hi Qi, > > >> > > > > > > >> > > > > I am working on optimizing the i40e vPMD on aarch64 and I se= e > > >> > > > > this patch relevant. > > >> > > > > Could you illuminate what issue this patch was fixing? > > >> > > > > I understand the PMD works at the driver layer, for delivery > > >> > > > > of > > >> > > > > L2 > > >> > packets. > > >> > > > > It does not own the responsibility to keep order(the > > >> > > > > responsibility lies with > > >> > > > the > > >> > > > > protocol stack, like TCP)? > > >> > > > > > > >> > > > > http://patches.dpdk.org/patch/16665/ > > >> > > > > > > >> > > > > Best regards, > > >> > > > > Gavin > > >> > > > > > > >> > > > > IMPORTANT NOTICE: The contents of this email and any > > >> > > > > attachments are confidential and may also be privileged. If > > >> > > > > you are not the intended recipient, please notify the sender > > >> > > > > immediately and do not disclose the contents to any other > > >> > > > > person, use it for any purpose, or store or copy the informa= tion > in > > any medium. Thank you. > > >> > > IMPORTANT NOTICE: The contents of this email and any > attachments > > >> > > are confidential and may also be privileged. If you are not the > > >> > > intended > > >> > recipient, > > >> > > please notify the sender immediately and do not disclose the > > >> > > contents to > > >> > any > > >> > > other person, use it for any purpose, or store or copy the > > >> > > information in any medium. Thank you. > > >> IMPORTANT NOTICE: The contents of this email and any attachments > are > > >> confidential and may also be privileged. If you are not the intended > > >> recipient, please notify the sender immediately and do not disclose > > >> the contents to any other person, use it for any purpose, or store o= r > > >> copy the information in any medium. Thank you. IMPORTANT NOTICE: The contents of this email and any attachments are confid= ential and may also be privileged. If you are not the intended recipient, p= lease notify the sender immediately and do not disclose the contents to any= other person, use it for any purpose, or store or copy the information in = any medium. Thank you.