From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM03-CO1-obe.outbound.protection.outlook.com (mail-co1nam03on0040.outbound.protection.outlook.com [104.47.40.40]) by dpdk.org (Postfix) with ESMTP id B1D685A36 for ; Fri, 26 Aug 2016 18:54:55 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=dn9B8nRvFMe0maRuUaS1pnHgk+Dei2HCFCREGkWhVic=; b=o1S06+Lv/1CuA4ku7gOgbupmLxKvz5FJipCc68cwOWN7/c78dz1eO7OqFTs9sCVplWyBIWnPOOCpCuqrU2T6CWHZ8mj/B+Xc1v60n7FmbbBmitdGoofP46y+ZYlfXAMC9Vv3FRw+GiI36s4CHLXf/vM9orQb83LB8OehpV3Sd6A= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Kamil.Rytarowski@cavium.com; Received: from cavium1.semihalf.local (31.172.191.173) by CY4PR07MB3064.namprd07.prod.outlook.com (10.172.116.145) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.549.15; Fri, 26 Aug 2016 16:54:49 +0000 From: Kamil Rytarowski To: CC: , , , , , Kamil Rytarowski Date: Fri, 26 Aug 2016 18:53:55 +0200 Message-ID: <1472230448-17490-1-git-send-email-krytarowski@caviumnetworks.com> X-Mailer: git-send-email 1.9.1 MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [31.172.191.173] X-ClientProxiedBy: HE1PR0201CA0008.eurprd02.prod.outlook.com (10.165.229.18) To CY4PR07MB3064.namprd07.prod.outlook.com (10.172.116.145) X-MS-Office365-Filtering-Correlation-Id: 118ad944-859c-4916-b013-08d3cdd1b246 X-Microsoft-Exchange-Diagnostics: 1; CY4PR07MB3064; 2:mr7OxR7mT9uyJik1tWoOfZdpeWs783WarijGwJEKzYOya7FgpduiOKey9MwmEpIg/B6aC+zT7uYnKliPVGw8iGAVZmUSO+FZjaI6kXkqTS4l7lZiVZid6pWCjLilhGNQqZofX4zbixi9yNa0F2V+8pVp67b/PqZFv1TTHfSHLH4mYn0Z/pQ2Zc0wdnBgBllI; 3:Qd+N/bjE5tUtn/sM8oWfDhZcr40oHrl65utagdZMHyQ2QTxeBxXkkWPZbkXMsoak7xOiX+zdAwicjPoCDhKwHXFKjktEL5ZR0oBOtgI6KX3duJyyTL3YzxVaTCKwzEgj; 25:w1+TtACVmZnwlshL/YZ4cS3UI4NS4vsf9g0+EZdA9P7NeicCT1pchlbgVGNhVEmMWtfaw18PH98jvXiISEjq8p5GUm7UNADRHL4m29M8UFo5Korz6gYqjpr9STh8BDBME9WZzr5RFl9v0mflyVv2aTLUD6W0hwI9S50wm00QJFc6/mu2SZ5JV31LLGAmNs/8GPp4qOa77TUs3/MU9I7+UaEgcA7ZCjocKJtzAeZ6q/G7YJ9f1YiugD5s7sTl2K6WQjcexYkVFO/sLGPnECkyGzVUXLXZivBfaEFlD+R8wir7/4j4yYH4+X7nXB8AK32vN4e6hkKkglgQMzWrzqyFOe7zLv8e+5HCUyqzr26cfwBZCp50GDvmMy2Pb9RkBzL1mhDYwD/5kp3IrBU3MgGEnJx5frz/abyfZ6FHMQz0K4Y= X-Microsoft-Antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:CY4PR07MB3064; X-Microsoft-Exchange-Diagnostics: 1; CY4PR07MB3064; 31:3N+deiWuhFHA9wGxwrC7tC2/fjEVfnQv0l+D7mEQxvQvp0YWdxqkHvKs/X8NYqr11PcbAQQ+8FmMRos8xcbFuVphp8Y7shfmISEqQQme//jq44Nj+Bs7dvmzJwfvyVBVcz0j+CqLNfrxvpgMoqbxJFcWNsg6467ls8+3Si9H3Kan3roFpGYoJGpEXIC5hRAqqYe0c5Sdn9s5eWj46akkXp3viP57j87kGPNBff0yAk4=; 20:juZBf375Q+4zK2Q+kgTExQobJ6Av5CSDo/l+eduS9+yEiynHYB+fthwogK3tntGoL4jM6EIj0y/kpmRJ/3SD4qMRRuq0RmNCUfcr81dwcZd2bHEZ5Mtafxe82jYUwGx8FIMpY/q6+ZpWdvi8pIWuho2KPSCARTCqbBlz+Rh/P7SWrFKMgB8LNoee5X0pI27hCs9ei0LvFAn2yTFwwhQ7xJHO4BdoQ2Uf63qiD6aNPTF7ien+TeuyAMs1yCmjgrGC06K3ijpnkA3n4ibZ1pSMiyrLxMl1D8oSI+vn33ar8fBZXfskaP6Dq1bMyTRboVzXzxJ7Skn8pssasWIAeEVkocHOebFzMgQak+lwiMUtO3V3dfNFS7l4Bka9z359lCLVjWNc6ItzOTQOHq3KWXq5f87r3BgmgC1i/9X5DjMqvQoHf+uKIsPZAkFUE0veysxpjhoySKOtck000vVfCyJzLq5w89maFDjVx9+/rUb4j9ckhhvLT8qydW2NdNIK7FuDuSe48ofaJtoe7xxBTtT3rZrD76pjr+6HMyivKGcjOZVTm81uBSmRnhHEwl5LlXak/Wv9+mhYQHyR0c4MT13dCQ3jYR4VIEZGFHCmO+0OfVU= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:; X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(6040176)(601004)(2401047)(8121501046)(5005006)(10201501046)(3002001); SRVR:CY4PR07MB3064; BCL:0; PCL:0; RULEID:; SRVR:CY4PR07MB3064; X-Microsoft-Exchange-Diagnostics: 1; CY4PR07MB3064; 4:pabrtOkdooKwKbEgAFKOBrJjKjfM8IGz7XPacqqa2k6fkFgFVHRuL3hWzsFKEyf1fEMw1/zUQgHJA2+MuDib8ag6z7eIh9dySmAlW3gjE34SwsJZVCyZfwscp1iDc64YoRBL4gm25G7B6vNz2Q4c62WnS5Vf4AIflDpKWcLykwP90lNLlQgnzw1YaPkv10DufDVyoFmq4EE5SyI7VNjNgliX9Ysotj2oCLGmyM7lrb4wdarToX4OOD+ISquS+HUEbqOBPWMrUXCB3GzepA9ZZG5QSwcW/NAUV/FIUMFYLICpHWEsGRfwOt/J7HMKUxFgiN9vBpdxWC9oBxfvmZTwC8x51RpMCXdvpKRqp5614/08kbL8MO7YqjG1kmxeWiDEYtR9w1TsuwhGKdv3+LzACQ== X-Forefront-PRVS: 00462943DE X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6009001)(7916002)(189002)(199003)(81156014)(15975445007)(36756003)(77096005)(189998001)(2906002)(229853001)(2351001)(105586002)(8676002)(101416001)(92566002)(5660300001)(81166006)(6116002)(4001430100002)(7736002)(47776003)(4326007)(66066001)(586003)(50466002)(106356001)(50226002)(5003940100001)(19580395003)(15395725005)(305945005)(50986999)(110136002)(7846002)(48376002)(68736007)(42186005)(5890100001)(3846002)(107886002)(33646002)(97736004); DIR:OUT; SFP:1101; SCL:1; SRVR:CY4PR07MB3064; H:cavium1.semihalf.local; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; Received-SPF: None (protection.outlook.com: cavium.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; CY4PR07MB3064; 23:JDMCrnAooy/bDosY1vWGCtls675X5DkjTzVhnOY2J?= =?us-ascii?Q?uZ+bhusgNDjghHyEE3hS+X0x5DdcPhzjM6rymNswXKvd3cfv+uTFgdeBq9Ju?= =?us-ascii?Q?4mzuFCjPyPc1gSuHmFp6wPdZUI045LCe4mnYgztWz7ALFVtLHLe7x3N8ym1r?= =?us-ascii?Q?xP6ky9hIlCNVkT2p4ruZ0W9RcIfepqEjE1LmRuFKpPcPIOI/PgnEIvzhRkz1?= =?us-ascii?Q?oFsAiPn8pOPSp3Yy+duOv1abdjYrmYkPQxfMaoKR1ZeFhw0rdJk1kyhmohOg?= =?us-ascii?Q?SI6pJUwGsnervaesrSe+G/qdyMTxlaAYKZL2KlqHndneGSXbP7V/hWIZaPPe?= =?us-ascii?Q?kHBXVxEPG9Zbf1txjmM43uYJL9WFgPfzeZPZch+RVLzvj/xfxnppMPvJKPsb?= =?us-ascii?Q?CoObFNR1C34az36aiR5JYqIiZIBa5+9/tMWlLDAfZTamZUuOAvYTZY9TteK1?= =?us-ascii?Q?KikZ0Y5+fxh0fW7Y+vn6/S4+GviDRaHiu6tvz7k8vF0YIrzwpwXHKROqVWM2?= =?us-ascii?Q?ZfYuYz8YWBA/bPBnSWvXEFouFM1zoIzqC3hupNsONrlmSzX5apAbl23mFjgb?= =?us-ascii?Q?r0lf1TEtqgq7RQOxUlbdMnU2NzGlMVEaVJI6/yYi/ME3ViNSTWyQN84854b1?= =?us-ascii?Q?CpisYM8fm+EqrRfFfSATNk67HOgM0yQsab27L+Adf5fs28RpcqOTdMgiIayT?= =?us-ascii?Q?ECuKNvE1+MnnfEJl12w44AM0yQQE8JZSU97H6Gjh8MJtQnlttrPsjYcMG7UC?= =?us-ascii?Q?y5QUzq+9KihqYbd6ZHMfSKFH8ojlKAnZny7002R2HhQlUfx4M1H2mJX0hTi4?= =?us-ascii?Q?mCfKudgCCS+gEb46g284Rr68sJHloJKERXtjBwxn2iRCtpfg8N0xhQYEtteu?= =?us-ascii?Q?26omCivj1BVDC+u+FGAOamFwTPgOzpKBXctvcJc4RUyttBm9XI7jKuA+M+ZI?= =?us-ascii?Q?P/5AbodwXjinN19JtUFNCHPIm+cKDFnU+NSi2jEkjHlHe9B2jJeW+cq2kprW?= =?us-ascii?Q?r/FQ+OyrY7r2w7KN6tw1uZ6T8uB47ziCSomVYuRBCWOCP2mPaQ7MIXROTgV1?= =?us-ascii?Q?ZsTkKqXqXQrR2dw8Wx6npFrx/KrN53fVKpWociqf/e977nBrYnkfNl1BwocZ?= =?us-ascii?Q?QMGXtUk+3Bo/WgqDiraOuiqgzhhm1Sv?= X-Microsoft-Exchange-Diagnostics: 1; CY4PR07MB3064; 6:ZP262pv7zZGgXaBwoQyKEwxtYr57Pt09P8BewWHtuAg52d2h1iN2mKe6trL2fTwvQwerYtFSmR2qjmPD+V7Q8xJUiJ+6p3bNnzvbi3gHEayWI9aI0zdCPnibbbVScboeBOLFbHlTdB7cRVNxf+RaoDXFzFei0uSMGdd/2I4/c1ewXVt4C3eF/Dv+P3QkcvLxKq0rBD5jDtwschV3Ek8vjxg5bWQtB8nBR+My8RffO0lmC39CAsBkyjSMp8sP3PZ/6VtMdeHZpPZ865BVuAIElR10uRlCIaeBTm41BXHzyR0=; 5:uXKUPA2YMoBtMqWNrC7fkIJSxLNTVpP/7G7/vevrqoNVKW1yXLHF2W+VEvDJZqCrxGjglxQXt9+C+H0N1izORVfBWfXoE7erZg2M61Me1WdNQW3DCMCOnB4wFjbgCZcBbew2ThN1pE6nYMRMLF0asA==; 24:u3yN9Ibc3oGXyCZUsQlF6SkgV73qZVe7wHXElauT13erFtQlcvkpZJ8ocqvl/sLRVWY3qOKUxXQ/WTJH+wpCLuWAoImWknJ7Qb6sm5E4oSI=; 7:IoAtLC2vX016B/om1XfMEBM2XY4Pe/ngfm5m9ym785B/8lr6IRJ8g1/acfV/u84ZidkXLAi1btDjWPtJnFKfFwSTwFyeywx0yaOLwcin4T761OFNtf/VvHnAVzyOZewO7epOUmhEtlU+9so13RhfgcpzMw/tN3UZtdd71F86PoTsKi5MO6sQs2fYZI0mudat4nSdCC51LCIzwnDYLfs0kacjPkVE6vH0u4iJfpFN9GgvIgDbuETIj5idwyGmfjuy SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 26 Aug 2016 16:54:49.4122 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR07MB3064 Subject: [dpdk-dev] [PATCH 00/13] Add support for secondary queue set in nicvf thunderx driver X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Aug 2016 16:54:56 -0000 This series of patches adds support for secondary queue set in nicvf thunderx driver There are two types of VFs: - Primary VF - Secondary VF Each port consist of a primary VF and n secondary VF(s). Each VF provides 8 Tx/Rx queues to a port. In case port is configured to use more than 8 queues, then it requires one (or more) secondary VF. Each secondary VF adds additional 8 queues to the queue set. During PMD driver initialization, the primary VF's are enumerated by checking the specific flag (see READY message). They are at the beginning of VF list (the remain ones are secondary VF's). The primary VFs are used as master queue sets. Secondary VFs provide additional queue sets for primary ones. If a port is configured for more then 8 queues then it will request for additional queues from secondary VFs. Secondary VFs cannot be shared between primary VFs. Primary VFs are present on the tail of the 'Network devices using kernel driver' list, secondary VFs are on the remaining tail of the list. The VNIC driver in the multiqueue setup works differently than other drivers like `ixgbe`. We need to bind separately each specific queue set device with the ``tools/dpdk-devbind.py`` utility. Depending on the hardware used, the kernel driver sets a threshold ``vf_id``. VFs that try to attach with an id below or equal to this boundary are considered primary VFs. VFs that try to attach with an id above this boundary are considered secondary VFs. This patchset also contains other cleanups and improvements like fixing erroneous checksum calculation and preparing the thunderx driver for the multi queue set feature support. These changes base on the following pending patches: [dpdk-dev,1/3] net/thunderx: remove generic passx references from the driver http://dpdk.org/dev/patchwork/patch/14963/ [dpdk-dev,2/3] net/thunderx: introduce cqe_rx2 HW capability flag http://dpdk.org/dev/patchwork/patch/14964/ [dpdk-dev,3/3] net/thunderx: add 81xx SoC support http://dpdk.org/dev/patchwork/patch/14965/ Kamil Rytarowski (13): net/thunderx: cleanup the driver before adding new features net/thunderx: correct transmit checksum handling net/thunderx/base: add family of functions to store qsets net/thunderx/base: add secondary queue set support net/thunderx: add family of functions to store DPDK qsets net/thunderx: add secondary queue set in interrupt functions net/thunderx: fix multiprocess support in stats net/thunderx: add helper utils for secondary qset support net/thunderx: add secondary qset support in dev stop/close net/thunderx: add secondary qset support in device start net/thunderx: add secondary qset support in device configure net/thunderx: add final bits for secondary queue support net/thunderx: document secondary queue set support doc/guides/nics/thunderx.rst | 114 ++++- drivers/net/thunderx/Makefile | 2 + drivers/net/thunderx/base/nicvf_bsvf.c | 72 +++ drivers/net/thunderx/base/nicvf_bsvf.h | 76 +++ drivers/net/thunderx/base/nicvf_hw.c | 10 +- drivers/net/thunderx/base/nicvf_hw.h | 6 +- drivers/net/thunderx/base/nicvf_hw_defs.h | 1 + drivers/net/thunderx/base/nicvf_mbox.c | 34 +- drivers/net/thunderx/base/nicvf_mbox.h | 21 +- drivers/net/thunderx/nicvf_ethdev.c | 753 +++++++++++++++++++++--------- drivers/net/thunderx/nicvf_ethdev.h | 39 ++ drivers/net/thunderx/nicvf_rxtx.c | 14 +- drivers/net/thunderx/nicvf_struct.h | 6 +- drivers/net/thunderx/nicvf_svf.c | 78 ++++ drivers/net/thunderx/nicvf_svf.h | 66 +++ 15 files changed, 1046 insertions(+), 246 deletions(-) create mode 100644 drivers/net/thunderx/base/nicvf_bsvf.c create mode 100644 drivers/net/thunderx/base/nicvf_bsvf.h create mode 100644 drivers/net/thunderx/nicvf_svf.c create mode 100644 drivers/net/thunderx/nicvf_svf.h -- 1.9.1