From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150059.outbound.protection.outlook.com [40.107.15.59]) by dpdk.org (Postfix) with ESMTP id A9D3C7D52 for ; Thu, 28 Mar 2019 10:21:31 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pnXfWzDgBZ9B1NrraGz0yO+gyYFsxdZmmzXc8brg4gA=; b=sIxVflK/uXexEevr8qPoYfmcjPX3hx7rgS1XTPBuq83SJqA/rdvvcuzKTsSyF8qsd9CleAaRFmVENNZ3rwbddrRz+bAViYLavf/e+ZBSumPfhdMoIILPrSqGEu50pVJpCi37KNEu2AU1qAzMoUPm9T8Yu3qPCw88uymwFM+V/sg= Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com (52.133.45.150) by AM0PR0502MB4081.eurprd05.prod.outlook.com (52.133.40.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1750.17; Thu, 28 Mar 2019 09:21:30 +0000 Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003]) by AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003%2]) with mapi id 15.20.1750.014; Thu, 28 Mar 2019 09:21:30 +0000 From: Shahaf Shuler To: Slava Ovsiienko , "dev@dpdk.org" Thread-Topic: [PATCH v4 00/14] net/mlx5: add support for multiport IB devices Thread-Index: AQHU5J9Kz04/u3fgmUSJf36mBrVK9aYgxdUQ Date: Thu, 28 Mar 2019 09:21:30 +0000 Message-ID: References: <1553614522-12151-1-git-send-email-viacheslavo@mellanox.com> <1553692547-16695-1-git-send-email-viacheslavo@mellanox.com> In-Reply-To: <1553692547-16695-1-git-send-email-viacheslavo@mellanox.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; x-originating-ip: [193.47.165.251] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 948f32d6-3fa2-4e0b-7636-08d6b35ec338 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7153060)(7193020); SRVR:AM0PR0502MB4081; x-ms-traffictypediagnostic: AM0PR0502MB4081: x-ms-exchange-purlcount: 4 x-microsoft-antispam-prvs: x-forefront-prvs: 0990C54589 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(136003)(396003)(39850400004)(366004)(376002)(346002)(189003)(199004)(6436002)(5024004)(68736007)(256004)(14444005)(97736004)(6506007)(66066001)(2501003)(14454004)(110136005)(71190400001)(71200400001)(229853002)(316002)(966005)(478600001)(55016002)(9686003)(74316002)(106356001)(53936002)(8676002)(105586002)(81166006)(86362001)(8936002)(81156014)(305945005)(6246003)(7696005)(76176011)(5660300002)(7736002)(26005)(6116002)(25786009)(3846002)(102836004)(11346002)(186003)(476003)(446003)(2906002)(6306002)(486006)(99286004)(33656002)(52536014); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR0502MB4081; H:AM0PR0502MB3795.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: nUe+cJyuFpD3y/vgR42qB06i9G27ptaopSAmXK9LYBm4xM/IFumvu9M+6ujEOVfFzSqk6tp6P9+Z1UFOhJuY9Pmn6bNJ++HlOUOIYlf2bSnodRk0WxVMwGWnw/e4RRtb2QmSP+TRQMHaDI5gGeesFjc/YNLS7KKu0hniYBH7QhHu5OEAV/9werKTBRytIfAQr2CA3k386Fnpo83HwhbW01liEgmNEKm/16rgEDxdeYuY1nwBjFPIIZfbjSHI7u4tAWLspe99DjVN2emTTdbqjBYzcCf0dLDkLvm9hIoqjWvVFZXvdBNRIIoU/jgowoSLSKfR2BYZjhkLr0aCNLgfulxHYuPk0VEA29EA2Ai9zmUo/vblcSTE1X8cy1oLjEjOH6/XPofi1+HNx2N4QrVQjzlG/7PCwGnZeyfFYCOYdi0= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 948f32d6-3fa2-4e0b-7636-08d6b35ec338 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Mar 2019 09:21:30.1507 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR0502MB4081 Subject: Re: [dpdk-dev] [PATCH v4 00/14] net/mlx5: add support for multiport IB devices X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Mar 2019 09:21:31 -0000 Wednesday, March 27, 2019 3:16 PM, Viacheslav Ovsiienko: > Subject: [PATCH v4 00/14] net/mlx5: add support for multiport IB devices >=20 > The Mellanox NICs support SR-IOV and have E-Switch feature. > When SR-IOV is set up in switchdev mode and E-Switch is enabled we have > so called VF representors in the system. All representors belonging to th= e > same E-Switch are created on the basis of the single PCI function and wit= h > current implementation each representor has its own dedicated Infiniband > device and operates within its own Infiniband context. It is proposed to > provide representors as ports of the single Infiniband device and operate= on > the shared Infiniband context. >=20 > mlx5_pci_probe() routine is planned to be extended to probe the ports of > found Infiniband devices. All active ports, belonging to the same Infinib= and > device will use the signle shared Infiniband context of that device: > - QP are created within shared context, with assigning to > specified port > - Verb flows are also created with specifying port index > - Protection Domain is shared by all representors > - Global Memory Regions Cache is shared by all representors, > local ones are not (not in this patchset) > - Shared Asynchronous Event Handler distributes events > among the device ports (not in this patchset) > - UAR mapping to user space is also shared (not in patchset) >=20 > Each representor has its own attached network interface device, interface > name and index can be retrieved via IB device and port index, so the link > control is performed via Netlink in the same way as in existing > implementation. >=20 > This patchset also superseedes http://patches.dpdk.org/patch/50486/ >=20 > Signed-off-by: Viacheslav Ovsiienko Series applied to next-net-mlx.=20 Good job Slava.=20 >=20 > --- > v4: > - minor typo fixes for debug compilation > - rebased on current top of repo > - removed dependency on DR (Direct Rules) >=20 > v3: > http://patches.dpdk.org/cover/51728/ > - vport_id field is added, contains associated VF vport > index on E-Switch. representor_id field is reverted > to keep the VF index > - some comment spellcheck > - some error logging is added for master/representor > wrong recognition > - shared IB context alloc/free routines mutex > protection added >=20 > v2: > http://patches.dpdk.org/patch/51642/ > - clarifying comments added > - secondary process does not probe IB device at all and > does not create shared context > - minor bugs (like ++ in assert) fixed > - representor_id contains corresponding VF vport index, > no corrections +1 is needed anymore. vport index is > calculated in the only place in code and if indexing > schema is changed it would be easy to modify >=20 > v1: > http://patches.dpdk.org/cover/51451/ >=20 > Viacheslav Ovsiienko (13): > net/mlx5: add representor recognition on kernels 5.x > net/mlx5: modify get ifindex routine for multiport IB > net/mlx5: add getting IB ports number for multiport IB > net/mlx5: add multiport IB device support to probing > net/mlx5: add IB shared context alloc/free functions > net/mlx5: switch to the names in the shared IB context > net/mlx5: switch to the shared Protection Domain > net/mlx5: switch to the shared context IB attributes > net/mlx5: switch to the shared IB device context > net/mlx5: provide IB port for the object being created > net/mlx5: update install/uninstall int handler routines > net/mlx5: update event handler for multiport IB devices > net/mlx5: add source vport match to the ingress rules >=20 > drivers/net/mlx5/Makefile | 10 + > drivers/net/mlx5/meson.build | 4 + > drivers/net/mlx5/mlx5.c | 638 ++++++++++++++++++++++++++-----= --- > --- > drivers/net/mlx5/mlx5.h | 45 ++- > drivers/net/mlx5/mlx5_ethdev.c | 248 +++++++++----- > drivers/net/mlx5/mlx5_flow.c | 2 + > drivers/net/mlx5/mlx5_flow_dv.c | 44 ++- > drivers/net/mlx5/mlx5_flow_verbs.c | 7 +- > drivers/net/mlx5/mlx5_mr.c | 4 +- > drivers/net/mlx5/mlx5_nl.c | 108 ++++++- > drivers/net/mlx5/mlx5_rxq.c | 41 +-- > drivers/net/mlx5/mlx5_socket.c | 4 +- > drivers/net/mlx5/mlx5_stats.c | 22 +- > drivers/net/mlx5/mlx5_trigger.c | 2 +- > drivers/net/mlx5/mlx5_txq.c | 24 +- > 15 files changed, 868 insertions(+), 335 deletions(-) >=20 > -- > 1.8.3.1 From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id AF4FAA067F for ; Thu, 28 Mar 2019 10:21:33 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id A3D808E76; Thu, 28 Mar 2019 10:21:32 +0100 (CET) Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150059.outbound.protection.outlook.com [40.107.15.59]) by dpdk.org (Postfix) with ESMTP id A9D3C7D52 for ; Thu, 28 Mar 2019 10:21:31 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=pnXfWzDgBZ9B1NrraGz0yO+gyYFsxdZmmzXc8brg4gA=; b=sIxVflK/uXexEevr8qPoYfmcjPX3hx7rgS1XTPBuq83SJqA/rdvvcuzKTsSyF8qsd9CleAaRFmVENNZ3rwbddrRz+bAViYLavf/e+ZBSumPfhdMoIILPrSqGEu50pVJpCi37KNEu2AU1qAzMoUPm9T8Yu3qPCw88uymwFM+V/sg= Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com (52.133.45.150) by AM0PR0502MB4081.eurprd05.prod.outlook.com (52.133.40.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1750.17; Thu, 28 Mar 2019 09:21:30 +0000 Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003]) by AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003%2]) with mapi id 15.20.1750.014; Thu, 28 Mar 2019 09:21:30 +0000 From: Shahaf Shuler To: Slava Ovsiienko , "dev@dpdk.org" Thread-Topic: [PATCH v4 00/14] net/mlx5: add support for multiport IB devices Thread-Index: AQHU5J9Kz04/u3fgmUSJf36mBrVK9aYgxdUQ Date: Thu, 28 Mar 2019 09:21:30 +0000 Message-ID: References: <1553614522-12151-1-git-send-email-viacheslavo@mellanox.com> <1553692547-16695-1-git-send-email-viacheslavo@mellanox.com> In-Reply-To: <1553692547-16695-1-git-send-email-viacheslavo@mellanox.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; x-originating-ip: [193.47.165.251] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 948f32d6-3fa2-4e0b-7636-08d6b35ec338 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7153060)(7193020); SRVR:AM0PR0502MB4081; x-ms-traffictypediagnostic: AM0PR0502MB4081: x-ms-exchange-purlcount: 4 x-microsoft-antispam-prvs: x-forefront-prvs: 0990C54589 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(136003)(396003)(39850400004)(366004)(376002)(346002)(189003)(199004)(6436002)(5024004)(68736007)(256004)(14444005)(97736004)(6506007)(66066001)(2501003)(14454004)(110136005)(71190400001)(71200400001)(229853002)(316002)(966005)(478600001)(55016002)(9686003)(74316002)(106356001)(53936002)(8676002)(105586002)(81166006)(86362001)(8936002)(81156014)(305945005)(6246003)(7696005)(76176011)(5660300002)(7736002)(26005)(6116002)(25786009)(3846002)(102836004)(11346002)(186003)(476003)(446003)(2906002)(6306002)(486006)(99286004)(33656002)(52536014); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR0502MB4081; H:AM0PR0502MB3795.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: nUe+cJyuFpD3y/vgR42qB06i9G27ptaopSAmXK9LYBm4xM/IFumvu9M+6ujEOVfFzSqk6tp6P9+Z1UFOhJuY9Pmn6bNJ++HlOUOIYlf2bSnodRk0WxVMwGWnw/e4RRtb2QmSP+TRQMHaDI5gGeesFjc/YNLS7KKu0hniYBH7QhHu5OEAV/9werKTBRytIfAQr2CA3k386Fnpo83HwhbW01liEgmNEKm/16rgEDxdeYuY1nwBjFPIIZfbjSHI7u4tAWLspe99DjVN2emTTdbqjBYzcCf0dLDkLvm9hIoqjWvVFZXvdBNRIIoU/jgowoSLSKfR2BYZjhkLr0aCNLgfulxHYuPk0VEA29EA2Ai9zmUo/vblcSTE1X8cy1oLjEjOH6/XPofi1+HNx2N4QrVQjzlG/7PCwGnZeyfFYCOYdi0= Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 948f32d6-3fa2-4e0b-7636-08d6b35ec338 X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Mar 2019 09:21:30.1507 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR0502MB4081 Subject: Re: [dpdk-dev] [PATCH v4 00/14] net/mlx5: add support for multiport IB devices X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Message-ID: <20190328092130.WSGX5qVX_97ODbTgp71LwMhmcqfpAVmwFqsaydzhYxo@z> Wednesday, March 27, 2019 3:16 PM, Viacheslav Ovsiienko: > Subject: [PATCH v4 00/14] net/mlx5: add support for multiport IB devices >=20 > The Mellanox NICs support SR-IOV and have E-Switch feature. > When SR-IOV is set up in switchdev mode and E-Switch is enabled we have > so called VF representors in the system. All representors belonging to th= e > same E-Switch are created on the basis of the single PCI function and wit= h > current implementation each representor has its own dedicated Infiniband > device and operates within its own Infiniband context. It is proposed to > provide representors as ports of the single Infiniband device and operate= on > the shared Infiniband context. >=20 > mlx5_pci_probe() routine is planned to be extended to probe the ports of > found Infiniband devices. All active ports, belonging to the same Infinib= and > device will use the signle shared Infiniband context of that device: > - QP are created within shared context, with assigning to > specified port > - Verb flows are also created with specifying port index > - Protection Domain is shared by all representors > - Global Memory Regions Cache is shared by all representors, > local ones are not (not in this patchset) > - Shared Asynchronous Event Handler distributes events > among the device ports (not in this patchset) > - UAR mapping to user space is also shared (not in patchset) >=20 > Each representor has its own attached network interface device, interface > name and index can be retrieved via IB device and port index, so the link > control is performed via Netlink in the same way as in existing > implementation. >=20 > This patchset also superseedes http://patches.dpdk.org/patch/50486/ >=20 > Signed-off-by: Viacheslav Ovsiienko Series applied to next-net-mlx.=20 Good job Slava.=20 >=20 > --- > v4: > - minor typo fixes for debug compilation > - rebased on current top of repo > - removed dependency on DR (Direct Rules) >=20 > v3: > http://patches.dpdk.org/cover/51728/ > - vport_id field is added, contains associated VF vport > index on E-Switch. representor_id field is reverted > to keep the VF index > - some comment spellcheck > - some error logging is added for master/representor > wrong recognition > - shared IB context alloc/free routines mutex > protection added >=20 > v2: > http://patches.dpdk.org/patch/51642/ > - clarifying comments added > - secondary process does not probe IB device at all and > does not create shared context > - minor bugs (like ++ in assert) fixed > - representor_id contains corresponding VF vport index, > no corrections +1 is needed anymore. vport index is > calculated in the only place in code and if indexing > schema is changed it would be easy to modify >=20 > v1: > http://patches.dpdk.org/cover/51451/ >=20 > Viacheslav Ovsiienko (13): > net/mlx5: add representor recognition on kernels 5.x > net/mlx5: modify get ifindex routine for multiport IB > net/mlx5: add getting IB ports number for multiport IB > net/mlx5: add multiport IB device support to probing > net/mlx5: add IB shared context alloc/free functions > net/mlx5: switch to the names in the shared IB context > net/mlx5: switch to the shared Protection Domain > net/mlx5: switch to the shared context IB attributes > net/mlx5: switch to the shared IB device context > net/mlx5: provide IB port for the object being created > net/mlx5: update install/uninstall int handler routines > net/mlx5: update event handler for multiport IB devices > net/mlx5: add source vport match to the ingress rules >=20 > drivers/net/mlx5/Makefile | 10 + > drivers/net/mlx5/meson.build | 4 + > drivers/net/mlx5/mlx5.c | 638 ++++++++++++++++++++++++++-----= --- > --- > drivers/net/mlx5/mlx5.h | 45 ++- > drivers/net/mlx5/mlx5_ethdev.c | 248 +++++++++----- > drivers/net/mlx5/mlx5_flow.c | 2 + > drivers/net/mlx5/mlx5_flow_dv.c | 44 ++- > drivers/net/mlx5/mlx5_flow_verbs.c | 7 +- > drivers/net/mlx5/mlx5_mr.c | 4 +- > drivers/net/mlx5/mlx5_nl.c | 108 ++++++- > drivers/net/mlx5/mlx5_rxq.c | 41 +-- > drivers/net/mlx5/mlx5_socket.c | 4 +- > drivers/net/mlx5/mlx5_stats.c | 22 +- > drivers/net/mlx5/mlx5_trigger.c | 2 +- > drivers/net/mlx5/mlx5_txq.c | 24 +- > 15 files changed, 868 insertions(+), 335 deletions(-) >=20 > -- > 1.8.3.1