From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5D9FEA327F for ; Mon, 21 Oct 2019 18:02:31 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 9017A1BEDB; Mon, 21 Oct 2019 18:02:30 +0200 (CEST) Received: from mga05.intel.com (mga05.intel.com [192.55.52.43]) by dpdk.org (Postfix) with ESMTP id 393DB1BED4 for ; Mon, 21 Oct 2019 18:02:28 +0200 (CEST) X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from orsmga002.jf.intel.com ([10.7.209.21]) by fmsmga105.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 21 Oct 2019 09:02:27 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.67,324,1566889200"; d="scan'208";a="209381750" Received: from fyigit-mobl.ger.corp.intel.com (HELO [10.237.221.10]) ([10.237.221.10]) by orsmga002.jf.intel.com with ESMTP; 21 Oct 2019 09:02:25 -0700 To: Bruce Richardson Cc: "Loftus, Ciara" , Stephen Hemminger , "dev@dpdk.org" , "Ye, Xiaolong" , "Laatz, Kevin" , arybchenko@solarflare.com References: <20190930164205.19419-1-ciara.loftus@intel.com> <20190930164205.19419-3-ciara.loftus@intel.com> <20190930101137.4919f93e@hermes.lan> <74F120C019F4A64C9B78E802F6AD4CC279226C6C@IRSMSX106.ger.corp.intel.com> <20191014144308.GA1394@bricha3-MOBL.ger.corp.intel.com> <20191021155401.GF942@bricha3-MOBL.ger.corp.intel.com> From: Ferruh Yigit Openpgp: preference=signencrypt Autocrypt: addr=ferruh.yigit@intel.com; prefer-encrypt=mutual; keydata= mQINBFXZCFABEADCujshBOAaqPZpwShdkzkyGpJ15lmxiSr3jVMqOtQS/sB3FYLT0/d3+bvy qbL9YnlbPyRvZfnP3pXiKwkRoR1RJwEo2BOf6hxdzTmLRtGtwWzI9MwrUPj6n/ldiD58VAGQ +iR1I/z9UBUN/ZMksElA2D7Jgg7vZ78iKwNnd+vLBD6I61kVrZ45Vjo3r+pPOByUBXOUlxp9 GWEKKIrJ4eogqkVNSixN16VYK7xR+5OUkBYUO+sE6etSxCr7BahMPKxH+XPlZZjKrxciaWQb +dElz3Ab4Opl+ZT/bK2huX+W+NJBEBVzjTkhjSTjcyRdxvS1gwWRuXqAml/sh+KQjPV1PPHF YK5LcqLkle+OKTCa82OvUb7cr+ALxATIZXQkgmn+zFT8UzSS3aiBBohg3BtbTIWy51jNlYdy ezUZ4UxKSsFuUTPt+JjHQBvF7WKbmNGS3fCid5Iag4tWOfZoqiCNzxApkVugltxoc6rG2TyX CmI2rP0mQ0GOsGXA3+3c1MCdQFzdIn/5tLBZyKy4F54UFo35eOX8/g7OaE+xrgY/4bZjpxC1 1pd66AAtKb3aNXpHvIfkVV6NYloo52H+FUE5ZDPNCGD0/btFGPWmWRmkPybzColTy7fmPaGz cBcEEqHK4T0aY4UJmE7Ylvg255Kz7s6wGZe6IR3N0cKNv++O7QARAQABtCVGZXJydWggWWln aXQgPGZlcnJ1aC55aWdpdEBpbnRlbC5jb20+iQJUBBMBCgA+AhsDAh4BAheABQsJCAcDBRUK CQgLBRYCAwEAFiEE0jZTh0IuwoTjmYHH+TPrQ98TYR8FAl1meboFCQlupOoACgkQ+TPrQ98T YR9ACBAAv2tomhyxY0Tp9Up7mNGLfEdBu/7joB/vIdqMRv63ojkwr9orQq5V16V/25+JEAD0 60cKodBDM6HdUvqLHatS8fooWRueSXHKYwJ3vxyB2tWDyZrLzLI1jxEvunGodoIzUOtum0Ce gPynnfQCelXBja0BwLXJMplM6TY1wXX22ap0ZViC0m714U5U4LQpzjabtFtjT8qOUR6L7hfy YQ72PBuktGb00UR/N5UrR6GqB0x4W41aZBHXfUQnvWIMmmCrRUJX36hOTYBzh+x86ULgg7H2 1499tA4o6rvE13FiGccplBNWCAIroAe/G11rdoN5NBgYVXu++38gTa/MBmIt6zRi6ch15oLA Ln2vHOdqhrgDuxjhMpG2bpNE36DG/V9WWyWdIRlz3NYPCDM/S3anbHlhjStXHOz1uHOnerXM 1jEjcsvmj1vSyYoQMyRcRJmBZLrekvgZeh7nJzbPHxtth8M7AoqiZ/o/BpYU+0xZ+J5/szWZ aYxxmIRu5ejFf+Wn9s5eXNHmyqxBidpCWvcbKYDBnkw2+Y9E5YTpL0mS0dCCOlrO7gca27ux ybtbj84aaW1g0CfIlUnOtHgMCmz6zPXThb+A8H8j3O6qmPoVqT3qnq3Uhy6GOoH8Fdu2Vchh TWiF5yo+pvUagQP6LpslffufSnu+RKAagkj7/RSuZV25Ag0EV9ZMvgEQAKc0Db17xNqtSwEv mfp4tkddwW9XA0tWWKtY4KUdd/jijYqc3fDD54ESYpV8QWj0xK4YM0dLxnDU2IYxjEshSB1T qAatVWz9WtBYvzalsyTqMKP3w34FciuL7orXP4AibPtrHuIXWQOBECcVZTTOdZYGAzaYzxiA ONzF9eTiwIqe9/oaOjTwTLnOarHt16QApTYQSnxDUQljeNvKYt1lZE/gAUUxNLWsYyTT+22/ vU0GDUahsJxs1+f1yEr+OGrFiEAmqrzpF0lCS3f/3HVTU6rS9cK3glVUeaTF4+1SK5ZNO35p iVQCwphmxa+dwTG/DvvHYCtgOZorTJ+OHfvCnSVjsM4kcXGjJPy3JZmUtyL9UxEbYlrffGPQ I3gLXIGD5AN5XdAXFCjjaID/KR1c9RHd7Oaw0Pdcq9UtMLgM1vdX8RlDuMGPrj5sQrRVbgYH fVU/TQCk1C9KhzOwg4Ap2T3tE1umY/DqrXQgsgH71PXFucVjOyHMYXXugLT8YQ0gcBPHy9mZ qw5mgOI5lCl6d4uCcUT0l/OEtPG/rA1lxz8ctdFBVOQOxCvwRG2QCgcJ/UTn5vlivul+cThi 6ERPvjqjblLncQtRg8izj2qgmwQkvfj+h7Ex88bI8iWtu5+I3K3LmNz/UxHBSWEmUnkg4fJl Rr7oItHsZ0ia6wWQ8lQnABEBAAGJAjwEGAEKACYCGwwWIQTSNlOHQi7ChOOZgcf5M+tD3xNh HwUCXWZ5wAUJB3FgggAKCRD5M+tD3xNhH2O+D/9OEz62YuJQLuIuOfL67eFTIB5/1+0j8Tsu o2psca1PUQ61SZJZOMl6VwNxpdvEaolVdrpnSxUF31kPEvR0Igy8HysQ11pj8AcgH0a9FrvU /8k2Roccd2ZIdpNLkirGFZR7LtRw41Kt1Jg+lafI0efkiHKMT/6D/P1EUp1RxOBNtWGV2hrd 0Yg9ds+VMphHHU69fDH02SwgpvXwG8Qm14Zi5WQ66R4CtTkHuYtA63sS17vMl8fDuTCtvfPF HzvdJLIhDYN3Mm1oMjKLlq4PUdYh68Fiwm+boJoBUFGuregJFlO3hM7uHBDhSEnXQr5mqpPM 6R/7Q5BjAxrwVBisH0yQGjsWlnysRWNfExAE2sRePSl0or9q19ddkRYltl6X4FDUXy2DTXa9 a+Fw4e1EvmcF3PjmTYs9IE3Vc64CRQXkhujcN4ZZh5lvOpU8WgyDxFq7bavFnSS6kx7Tk29/ wNJBp+cf9qsQxLbqhW5kfORuZGecus0TLcmpZEFKKjTJBK9gELRBB/zoN3j41hlEl7uTUXTI JQFLhpsFlEdKLujyvT/aCwP3XWT+B2uZDKrMAElF6ltpTxI53JYi22WO7NH7MR16Fhi4R6vh FHNBOkiAhUpoXRZXaCR6+X4qwA8CwHGqHRBfYFSU/Ulq1ZLR+S3hNj2mbnSx0lBs1eEqe2vh cA== Message-ID: <317e6b4d-734c-ddbe-dc7f-86b0ed38ca11@intel.com> Date: Mon, 21 Oct 2019 17:02:25 +0100 MIME-Version: 1.0 In-Reply-To: <20191021155401.GF942@bricha3-MOBL.ger.corp.intel.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 8bit Subject: Re: [dpdk-dev] [PATCH v2 2/3] net/af_xdp: support pinning of IRQs X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On 10/21/2019 4:54 PM, Bruce Richardson wrote: > On Mon, Oct 21, 2019 at 04:24:26PM +0100, Ferruh Yigit wrote: >> On 10/14/2019 3:43 PM, Bruce Richardson wrote: >>> On Thu, Oct 03, 2019 at 02:23:07PM +0100, Loftus, Ciara wrote: >>>> >>>> >>>>> -----Original Message----- From: Stephen Hemminger >>>>> Sent: Monday 30 September 2019 18:12 To: >>>>> Loftus, Ciara Cc: dev@dpdk.org; Ye, Xiaolong >>>>> ; Laatz, Kevin ; >>>>> Richardson, Bruce Subject: Re: [dpdk-dev] >>>>> [PATCH v2 2/3] net/af_xdp: support pinning of IRQs >>>>> >>>>> On Mon, 30 Sep 2019 16:42:04 +0000 Ciara Loftus >>>>> wrote: >>>>> >>>>>> +/* drivers supported for the queue_irq option */ +enum >>>>>> supported_drivers { + I40E_DRIVER, + IXGBE_DRIVER, + >>>>>> MLX5_DRIVER, + NUM_DRIVERS +}; >>>>> >>>>> Anything device specific like this raises a red flag to me. >>>>> >>>>> This regex etc, seems like a huge hack. Is there a better way using >>>>> irqbalance and smp_affinity in kernel drivers? >>>>> >>>>> NACK >>>> >>>> Hi Stephen, >>>> >>>> Thanks for looking at the patch. I understand your concern however >>>> unfortunately I haven't been able to identify a way to achieve the >>>> desired outcome by using your suggestions of irqbalance and smp_affinity. >>>> Did you have something specific in mind or are aware of any generic way >>>> of retrieving interrupt numbers for NICs regardless of vendor or range? >>>> >>>> I think this feature is really important for the usability of this PMD. >>>> Without it, to configure the IRQs the user has to open up >>>> /proc/interrupts, trawl through it and identify the correct IRQ number >>>> for their given NIC and qid (the format for which is unlikely to be known >>>> off-hand), and manually pin them by writing the appropriate values in the >>>> appropriate format to the appropriate file - prone to error if not >>>> automated IMO. If the user fails to set the affinity it's probably fine >>>> for a single pmd, however with multiple pmds all irqs will by default >>>> land on core 0 and lead to terrible performance. >>>> >>>> It should be possible to rework the code to remove the regexes and use a >>>> direct string compare. Would that make the solution more palatable? >>>> >>> >>> Hi Ciara, Stephen, >>> >>> is there any way forward on this patch? >>> >>> From my experience with using AF_XDP the pinning of interrupts is both >>> necessary for performance and sadly rather awkward to implement in >>> practice. If we can't find a better way to do this, I think merging this >>> patch is the best thing to do. It may be a bit messy, but the overall user >>> experience should be far improved over not having it. >>> >> >> Can we have this external to the PMD, like a helper script that run after you >> start the DPDK app? > > It could be, but the main objection here seems to be with the method used > to find the interrupts, which would not change based on a script version, > not to mention the fact that the usability would be far less in that case. > For ease of use, this needs to be part of the driver, and the current > implementation is the best we can do right now, and nobody has suggested a > concrete alternative to it. > The method used to find interrupts can be same but it being embedded into a specific PMD with the list of supported driver hardcoded versus putting this information into a script differs I think. I tend to agree that this looks hack for the PMD. And not sure if the usability will be far less, instead of providing parameters to the PMD, you will provide to the script. And script becomes something more generic.