From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id E7E48A04B1; Thu, 24 Sep 2020 14:15:46 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 372091DE7C; Thu, 24 Sep 2020 14:13:32 +0200 (CEST) Received: from dispatch1-us1.ppe-hosted.com (dispatch1-us1.ppe-hosted.com [148.163.129.52]) by dpdk.org (Postfix) with ESMTP id E98B31DE10 for ; Thu, 24 Sep 2020 14:12:56 +0200 (CEST) Received: from mx1-us1.ppe-hosted.com (unknown [10.7.65.62]) by dispatch1-us1.ppe-hosted.com (PPE Hosted ESMTP Server) with ESMTP id 78C4060086 for ; Thu, 24 Sep 2020 12:12:56 +0000 (UTC) Received: from us4-mdac16-32.ut7.mdlocal (unknown [10.7.66.145]) by mx1-us1.ppe-hosted.com (PPE Hosted ESMTP Server) with ESMTP id 771248009B for ; Thu, 24 Sep 2020 12:12:56 +0000 (UTC) X-Virus-Scanned: Proofpoint Essentials engine Received: from mx1-us1.ppe-hosted.com (unknown [10.7.65.174]) by mx1-us1.ppe-hosted.com (PPE Hosted ESMTP Server) with ESMTPS id D9D06280059 for ; Thu, 24 Sep 2020 12:12:55 +0000 (UTC) Received: from webmail.solarflare.com (uk.solarflare.com [193.34.186.16]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits)) (No client certificate requested) by mx1-us1.ppe-hosted.com (PPE Hosted ESMTP Server) with ESMTPS id 52E961C0080 for ; Thu, 24 Sep 2020 12:12:55 +0000 (UTC) Received: from ukex01.SolarFlarecom.com (10.17.10.4) by ukex01.SolarFlarecom.com (10.17.10.4) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 24 Sep 2020 13:12:46 +0100 Received: from opal.uk.solarflarecom.com (10.17.10.1) by ukex01.SolarFlarecom.com (10.17.10.4) with Microsoft SMTP Server id 15.0.1497.2 via Frontend Transport; Thu, 24 Sep 2020 13:12:46 +0100 Received: from ukv-loginhost.uk.solarflarecom.com (ukv-loginhost.uk.solarflarecom.com [10.17.10.39]) by opal.uk.solarflarecom.com (8.13.8/8.13.8) with ESMTP id 08OCCkPH025911 for ; Thu, 24 Sep 2020 13:12:46 +0100 Received: from ukv-loginhost.uk.solarflarecom.com (localhost [127.0.0.1]) by ukv-loginhost.uk.solarflarecom.com (Postfix) with ESMTP id 6AF771613AB for ; Thu, 24 Sep 2020 13:12:46 +0100 (BST) From: Andrew Rybchenko To: Date: Thu, 24 Sep 2020 13:11:49 +0100 Message-ID: <1600949555-28043-15-git-send-email-arybchenko@solarflare.com> X-Mailer: git-send-email 1.8.3.1 In-Reply-To: <1600949555-28043-1-git-send-email-arybchenko@solarflare.com> References: <1600764594-14752-1-git-send-email-arybchenko@solarflare.com> <1600949555-28043-1-git-send-email-arybchenko@solarflare.com> MIME-Version: 1.0 Content-Type: text/plain X-TM-AS-Product-Ver: SMEX-12.5.0.1300-8.6.1012-25674.003 X-TM-AS-Result: No-20.260100-8.000000-10 X-TMASE-MatchedRID: Q+PCvE2fENvabBVcqlDcF2wTEruL9ObTP6Tki+9nU39XiLrvhpKLfEAc 6DyoS2rIqQ4DH3i/D96tmhK3i1SK3y5Ara2x6EWazfqlpbtmcWhHcT14gBzqVg6QlBHhBZuwrvF YQ6ItqCik8KUgXucz7APVs5ktLr8djGILeNCFU/miAZ3zAhQYgo7P8sslRxoe4uxAgOavdLnSJJ cbp1Y+W278DSzaDuLBC2AKz19Qy/SlSstbEunVIAfC4JY9IggAxEksT8U2vYNHZg0gWH5yUcA3U eFsJzySaonT5WkIBWAPkyd+0GAinzTkUDpmb5dU4jnQTqD4CzQ4eGohd7gjNpiQXtm0V8JTJzlo WWMvKh20STX07mgcBcAANTVLSQFz3qZ3A4FG8d1ff79rzPd1mEewdu9S21aifkiy7TTogYYVLGI PVP4OQb/YkCk00rZtilCnnNoI9t0vmfQHDKJ1l4lLa95lbECYWC0RiLhMMl+dzjX37VUcWt+zQy BPDfsFgjygCLh5uNM6kswMLieVlEozHx70qoh4U9ht8cPjV47J5SXtoJPLyP/zPz0A8BuVD2VMA 3hbGfEnvY93EdQxLMlv9UbTsgXrbUDm/Odva3nO0WfNhCnjXF0DithooYrCd3XtjqAaoMIsWXnB f/Tq0qCQFlbvrjaOpdHaghyrHZTecSkNT7l/2Z8bz5uL7/e88boZEVitthhUJnGNRkHyM9O6Q5c VbfMni1DLgYIPUP6NXA6IRCXBU5pzYJ7huWQgPja3w1ExF8QF/7WGX+q/8NEsTITobgNEbasOqx HBOjdFQ7qCGsajLlsBNccCwHdvPFrxOr//W2KeAiCmPx4NwJuJ+Pb8n/VxMhmTylWIkjEqtq5d3 cxkNQP90fJP9eHt X-TM-AS-User-Approved-Sender: Yes X-TM-AS-User-Blocked-Sender: No X-TMASE-Result: 10--20.260100-8.000000 X-TMASE-Version: SMEX-12.5.0.1300-8.6.1012-25674.003 X-MDID: 1600949576-MXIneNUfDxTE Subject: [dpdk-dev] [PATCH v3 14/60] common/sfc_efx/base: add Riverhead support to NIC module X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Define basic NIC features and limitations. Signed-off-by: Andrew Rybchenko Reviewed-by: Andy Moreton Reviewed-by: Vijay Kumar Srivastava --- drivers/common/sfc_efx/base/ef10_impl.h | 25 ++ drivers/common/sfc_efx/base/ef10_nic.c | 52 ++- drivers/common/sfc_efx/base/efx_impl.h | 8 +- drivers/common/sfc_efx/base/efx_mcdi.c | 4 +- drivers/common/sfc_efx/base/efx_nic.c | 34 ++ drivers/common/sfc_efx/base/meson.build | 3 +- drivers/common/sfc_efx/base/rhead_impl.h | 105 +++++ drivers/common/sfc_efx/base/rhead_nic.c | 500 +++++++++++++++++++++++ 8 files changed, 716 insertions(+), 15 deletions(-) create mode 100644 drivers/common/sfc_efx/base/rhead_impl.h create mode 100644 drivers/common/sfc_efx/base/rhead_nic.c diff --git a/drivers/common/sfc_efx/base/ef10_impl.h b/drivers/common/sfc_efx/base/ef10_impl.h index da0ec7fab5..e933d88135 100644 --- a/drivers/common/sfc_efx/base/ef10_impl.h +++ b/drivers/common/sfc_efx/base/ef10_impl.h @@ -1422,12 +1422,37 @@ efx_mcdi_get_vector_cfg( __out_opt uint32_t *pf_nvecp, __out_opt uint32_t *vf_nvecp); +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +efx_mcdi_alloc_vis( + __in efx_nic_t *enp, + __in uint32_t min_vi_count, + __in uint32_t max_vi_count, + __out uint32_t *vi_basep, + __out uint32_t *vi_countp, + __out uint32_t *vi_shiftp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +efx_mcdi_free_vis( + __in efx_nic_t *enp); + LIBEFX_INTERNAL extern __checkReturn efx_rc_t ef10_get_privilege_mask( __in efx_nic_t *enp, __out uint32_t *maskp); +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +efx_mcdi_nic_board_cfg( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +efx_mcdi_entity_reset( + __in efx_nic_t *enp); + #if EFSYS_OPT_FW_SUBVARIANT_AWARE LIBEFX_INTERNAL diff --git a/drivers/common/sfc_efx/base/ef10_nic.c b/drivers/common/sfc_efx/base/ef10_nic.c index c5990f16cc..80dc99aed5 100644 --- a/drivers/common/sfc_efx/base/ef10_nic.c +++ b/drivers/common/sfc_efx/base/ef10_nic.c @@ -10,7 +10,7 @@ #include "mcdi_mon.h" #endif -#if EFX_OPTS_EF10() +#if EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() #include "ef10_tlv_layout.h" @@ -24,7 +24,7 @@ efx_mcdi_get_port_assignment( MC_CMD_GET_PORT_ASSIGNMENT_OUT_LEN); efx_rc_t rc; - EFSYS_ASSERT(EFX_FAMILY_IS_EF10(enp)); + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp) || EFX_FAMILY_IS_EF10(enp)); req.emr_cmd = MC_CMD_GET_PORT_ASSIGNMENT; req.emr_in_buf = payload; @@ -68,7 +68,7 @@ efx_mcdi_get_port_modes( MC_CMD_GET_PORT_MODES_OUT_LEN); efx_rc_t rc; - EFSYS_ASSERT(EFX_FAMILY_IS_EF10(enp)); + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp) || EFX_FAMILY_IS_EF10(enp)); req.emr_cmd = MC_CMD_GET_PORT_MODES; req.emr_in_buf = payload; @@ -223,6 +223,10 @@ ef10_nic_get_port_mode_bandwidth( return (rc); } +#endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ + +#if EFX_OPTS_EF10() + __checkReturn efx_rc_t efx_mcdi_vadaptor_alloc( __in efx_nic_t *enp, @@ -292,6 +296,10 @@ efx_mcdi_vadaptor_free( return (rc); } +#endif /* EFX_OPTS_EF10() */ + +#if EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() + __checkReturn efx_rc_t efx_mcdi_get_mac_address_pf( __in efx_nic_t *enp, @@ -302,7 +310,7 @@ efx_mcdi_get_mac_address_pf( MC_CMD_GET_MAC_ADDRESSES_OUT_LEN); efx_rc_t rc; - EFSYS_ASSERT(EFX_FAMILY_IS_EF10(enp)); + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp) || EFX_FAMILY_IS_EF10(enp)); req.emr_cmd = MC_CMD_GET_MAC_ADDRESSES; req.emr_in_buf = payload; @@ -358,7 +366,7 @@ efx_mcdi_get_mac_address_vf( MC_CMD_VPORT_GET_MAC_ADDRESSES_OUT_LENMAX); efx_rc_t rc; - EFSYS_ASSERT(EFX_FAMILY_IS_EF10(enp)); + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp) || EFX_FAMILY_IS_EF10(enp)); req.emr_cmd = MC_CMD_VPORT_GET_MAC_ADDRESSES; req.emr_in_buf = payload; @@ -420,7 +428,7 @@ efx_mcdi_get_clock( MC_CMD_GET_CLOCK_OUT_LEN); efx_rc_t rc; - EFSYS_ASSERT(EFX_FAMILY_IS_EF10(enp)); + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp) || EFX_FAMILY_IS_EF10(enp)); req.emr_cmd = MC_CMD_GET_CLOCK; req.emr_in_buf = payload; @@ -569,7 +577,7 @@ efx_mcdi_get_vector_cfg( return (rc); } -static __checkReturn efx_rc_t + __checkReturn efx_rc_t efx_mcdi_alloc_vis( __in efx_nic_t *enp, __in uint32_t min_vi_count, @@ -631,7 +639,7 @@ efx_mcdi_alloc_vis( } -static __checkReturn efx_rc_t + __checkReturn efx_rc_t efx_mcdi_free_vis( __in efx_nic_t *enp) { @@ -663,6 +671,9 @@ efx_mcdi_free_vis( return (rc); } +#endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ + +#if EFX_OPTS_EF10() static __checkReturn efx_rc_t efx_mcdi_alloc_piobuf( @@ -978,6 +989,10 @@ ef10_nic_pio_unlink( return (efx_mcdi_unlink_piobuf(enp, vi_index)); } +#endif /* EFX_OPTS_EF10() */ + +#if EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() + static __checkReturn efx_rc_t ef10_mcdi_get_pf_count( __in efx_nic_t *enp, @@ -1667,6 +1682,19 @@ static struct ef10_external_port_map_s { (1U << TLV_PORT_MODE_NA_2x2), /* mode 14 */ { EFX_EXT_PORT_NA, 0, EFX_EXT_PORT_NA, EFX_EXT_PORT_NA } }, + /* + * Modes that on Riverhead allocate each port number to a separate + * cage. + * port 0 -> cage 1 + * port 1 -> cage 2 + */ + { + EFX_FAMILY_RIVERHEAD, + (1U << TLV_PORT_MODE_1x1_NA) | /* mode 0 */ + (1U << TLV_PORT_MODE_1x4_NA) | /* mode 1 */ + (1U << TLV_PORT_MODE_1x1_1x1), /* mode 2 */ + { 0, 1, EFX_EXT_PORT_NA, EFX_EXT_PORT_NA } + }, }; static __checkReturn efx_rc_t @@ -1757,7 +1785,7 @@ ef10_external_port_mapping( return (rc); } -static __checkReturn efx_rc_t + __checkReturn efx_rc_t efx_mcdi_nic_board_cfg( __in efx_nic_t *enp) { @@ -1921,7 +1949,7 @@ efx_mcdi_nic_board_cfg( return (rc); } -static __checkReturn efx_rc_t + __checkReturn efx_rc_t efx_mcdi_entity_reset( __in efx_nic_t *enp) { @@ -1954,6 +1982,10 @@ efx_mcdi_entity_reset( return (rc); } +#endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ + +#if EFX_OPTS_EF10() + static __checkReturn efx_rc_t ef10_set_workaround_bug26807( __in efx_nic_t *enp) diff --git a/drivers/common/sfc_efx/base/efx_impl.h b/drivers/common/sfc_efx/base/efx_impl.h index c7edeaa000..b41b0e5dea 100644 --- a/drivers/common/sfc_efx/base/efx_impl.h +++ b/drivers/common/sfc_efx/base/efx_impl.h @@ -41,6 +41,10 @@ #include "ef10_impl.h" #endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ +#if EFSYS_OPT_RIVERHEAD +#include "rhead_impl.h" +#endif /* EFSYS_OPT_RIVERHEAD */ + #ifdef __cplusplus extern "C" { #endif @@ -835,7 +839,7 @@ struct efx_nic_s { #endif /* EFSYS_OPT_SIENA */ int enu_unused; } en_u; -#if EFX_OPTS_EF10() +#if EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() union en_arch { struct { int ena_vi_base; @@ -856,7 +860,7 @@ struct efx_nic_s { size_t ena_wc_mem_map_size; } ef10; } en_arch; -#endif /* EFX_OPTS_EF10() */ +#endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ #if EFSYS_OPT_EVB const efx_evb_ops_t *en_eeop; struct efx_vswitch_s *en_vswitchp; diff --git a/drivers/common/sfc_efx/base/efx_mcdi.c b/drivers/common/sfc_efx/base/efx_mcdi.c index dec3a170a7..ade7f7fed4 100644 --- a/drivers/common/sfc_efx/base/efx_mcdi.c +++ b/drivers/common/sfc_efx/base/efx_mcdi.c @@ -2032,7 +2032,7 @@ efx_mcdi_mac_stats_periodic( #endif /* EFSYS_OPT_MAC_STATS */ -#if EFX_OPTS_EF10() +#if EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() /* * This function returns the pf and vf number of a function. If it is a pf the @@ -2129,7 +2129,7 @@ efx_mcdi_privilege_mask( return (rc); } -#endif /* EFX_OPTS_EF10() */ +#endif /* EFSYS_OPT_RIVERHEAD || EFX_OPTS_EF10() */ __checkReturn efx_rc_t efx_mcdi_set_workaround( diff --git a/drivers/common/sfc_efx/base/efx_nic.c b/drivers/common/sfc_efx/base/efx_nic.c index 9d6961e2ff..465e2c7a36 100644 --- a/drivers/common/sfc_efx/base/efx_nic.c +++ b/drivers/common/sfc_efx/base/efx_nic.c @@ -188,6 +188,27 @@ static const efx_nic_ops_t __efx_nic_medford2_ops = { #endif /* EFSYS_OPT_MEDFORD2 */ +#if EFSYS_OPT_RIVERHEAD + +static const efx_nic_ops_t __efx_nic_riverhead_ops = { + rhead_nic_probe, /* eno_probe */ + rhead_board_cfg, /* eno_board_cfg */ + rhead_nic_set_drv_limits, /* eno_set_drv_limits */ + rhead_nic_reset, /* eno_reset */ + rhead_nic_init, /* eno_init */ + rhead_nic_get_vi_pool, /* eno_get_vi_pool */ + rhead_nic_get_bar_region, /* eno_get_bar_region */ + rhead_nic_hw_unavailable, /* eno_hw_unavailable */ + rhead_nic_set_hw_unavailable, /* eno_set_hw_unavailable */ +#if EFSYS_OPT_DIAG + rhead_nic_register_test, /* eno_register_test */ +#endif /* EFSYS_OPT_DIAG */ + rhead_nic_fini, /* eno_fini */ + rhead_nic_unprobe, /* eno_unprobe */ +}; + +#endif /* EFSYS_OPT_RIVERHEAD */ + __checkReturn efx_rc_t efx_nic_create( @@ -285,6 +306,19 @@ efx_nic_create( break; #endif /* EFSYS_OPT_MEDFORD2 */ +#if EFSYS_OPT_RIVERHEAD + case EFX_FAMILY_RIVERHEAD: + enp->en_enop = &__efx_nic_riverhead_ops; + enp->en_features = + EFX_FEATURE_IPV6 | + EFX_FEATURE_LINK_EVENTS | + EFX_FEATURE_PERIODIC_MAC_STATS | + EFX_FEATURE_MCDI | + EFX_FEATURE_MAC_HEADER_FILTERS | + EFX_FEATURE_MCDI_DMA; + break; +#endif /* EFSYS_OPT_RIVERHEAD */ + default: rc = ENOTSUP; goto fail2; diff --git a/drivers/common/sfc_efx/base/meson.build b/drivers/common/sfc_efx/base/meson.build index 8909525c34..6ca5b57023 100644 --- a/drivers/common/sfc_efx/base/meson.build +++ b/drivers/common/sfc_efx/base/meson.build @@ -51,7 +51,8 @@ sources = [ 'ef10_vpd.c', 'hunt_nic.c', 'medford_nic.c', - 'medford2_nic.c' + 'medford2_nic.c', + 'rhead_nic.c', ] extra_flags = [ diff --git a/drivers/common/sfc_efx/base/rhead_impl.h b/drivers/common/sfc_efx/base/rhead_impl.h new file mode 100644 index 0000000000..e25a871cb3 --- /dev/null +++ b/drivers/common/sfc_efx/base/rhead_impl.h @@ -0,0 +1,105 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * + * Copyright(c) 2019-2020 Xilinx, Inc. + * Copyright(c) 2018-2019 Solarflare Communications Inc. + */ + +#ifndef _SYS_RHEAD_IMPL_H +#define _SYS_RHEAD_IMPL_H + +#ifdef __cplusplus +extern "C" { +#endif + + +#define RHEAD_EVQ_MAXNEVS 16384 +#define RHEAD_EVQ_MINNEVS 256 + +#define RHEAD_RXQ_MAXNDESCS 16384 +#define RHEAD_RXQ_MINNDESCS 256 + +#define RHEAD_TXQ_MAXNDESCS 16384 +#define RHEAD_TXQ_MINNDESCS 256 + +#define RHEAD_EVQ_DESC_SIZE (sizeof (efx_qword_t)) +#define RHEAD_RXQ_DESC_SIZE (sizeof (efx_qword_t)) +#define RHEAD_TXQ_DESC_SIZE (sizeof (efx_oword_t)) + + +/* NIC */ + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_board_cfg( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_probe( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_set_drv_limits( + __inout efx_nic_t *enp, + __in efx_drv_limits_t *edlp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_get_vi_pool( + __in efx_nic_t *enp, + __out uint32_t *vi_countp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_get_bar_region( + __in efx_nic_t *enp, + __in efx_nic_region_t region, + __out uint32_t *offsetp, + __out size_t *sizep); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_reset( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_init( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern __checkReturn boolean_t +rhead_nic_hw_unavailable( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern void +rhead_nic_set_hw_unavailable( + __in efx_nic_t *enp); + +#if EFSYS_OPT_DIAG + +LIBEFX_INTERNAL +extern __checkReturn efx_rc_t +rhead_nic_register_test( + __in efx_nic_t *enp); + +#endif /* EFSYS_OPT_DIAG */ + +LIBEFX_INTERNAL +extern void +rhead_nic_fini( + __in efx_nic_t *enp); + +LIBEFX_INTERNAL +extern void +rhead_nic_unprobe( + __in efx_nic_t *enp); + + +#ifdef __cplusplus +} +#endif + +#endif /* _SYS_RHEAD_IMPL_H */ diff --git a/drivers/common/sfc_efx/base/rhead_nic.c b/drivers/common/sfc_efx/base/rhead_nic.c new file mode 100644 index 0000000000..c83d18e6ab --- /dev/null +++ b/drivers/common/sfc_efx/base/rhead_nic.c @@ -0,0 +1,500 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * + * Copyright(c) 2019-2020 Xilinx, Inc. + * Copyright(c) 2018-2019 Solarflare Communications Inc. + */ + +#include "efx.h" +#include "efx_impl.h" + + +#if EFSYS_OPT_RIVERHEAD + + __checkReturn efx_rc_t +rhead_board_cfg( + __in efx_nic_t *enp) +{ + efx_nic_cfg_t *encp = &(enp->en_nic_cfg); + uint32_t end_padding; + uint32_t bandwidth; + efx_rc_t rc; + + if ((rc = efx_mcdi_nic_board_cfg(enp)) != 0) + goto fail1; + + encp->enc_clk_mult = 1; /* not used for Riverhead */ + + /* + * FIXME There are TxSend and TxSeg descriptors on Riverhead. + * TxSeg is bigger than TxSend. + */ + encp->enc_tx_dma_desc_size_max = EFX_MASK32(ESF_GZ_TX_SEND_LEN); + /* No boundary crossing limits */ + encp->enc_tx_dma_desc_boundary = 0; + + /* + * Maximum number of bytes into the frame the TCP header can start for + * firmware assisted TSO to work. + * FIXME Get from design parameter DP_TSO_MAX_HDR_LEN. + */ + encp->enc_tx_tso_tcp_header_offset_limit = 0; + + /* + * Set resource limits for MC_CMD_ALLOC_VIS. Note that we cannot use + * MC_CMD_GET_RESOURCE_LIMITS here as that reports the available + * resources (allocated to this PCIe function), which is zero until + * after we have allocated VIs. + */ + encp->enc_evq_limit = 1024; + encp->enc_rxq_limit = EFX_RXQ_LIMIT_TARGET; + encp->enc_txq_limit = EFX_TXQ_LIMIT_TARGET; + + encp->enc_buftbl_limit = UINT32_MAX; + + /* + * Enable firmware workarounds for hardware errata. + * Expected responses are: + * - 0 (zero): + * Success: workaround enabled or disabled as requested. + * - MC_CMD_ERR_ENOSYS (reported as ENOTSUP): + * Firmware does not support the MC_CMD_WORKAROUND request. + * (assume that the workaround is not supported). + * - MC_CMD_ERR_ENOENT (reported as ENOENT): + * Firmware does not support the requested workaround. + * - MC_CMD_ERR_EPERM (reported as EACCES): + * Unprivileged function cannot enable/disable workarounds. + * + * See efx_mcdi_request_errcode() for MCDI error translations. + */ + + /* + * Replay engine on Riverhead should suppress duplicate packets + * (e.g. because of exact multicast and all-multicast filters + * match) to the same RxQ. + */ + encp->enc_bug26807_workaround = B_FALSE; + + /* + * Checksums for TSO sends should always be correct on Riverhead. + * FIXME: revisit when TSO support is implemented. + */ + encp->enc_bug61297_workaround = B_FALSE; + + encp->enc_evq_max_nevs = RHEAD_EVQ_MAXNEVS; + encp->enc_evq_min_nevs = RHEAD_EVQ_MINNEVS; + encp->enc_rxq_max_ndescs = RHEAD_RXQ_MAXNDESCS; + encp->enc_rxq_min_ndescs = RHEAD_RXQ_MINNDESCS; + encp->enc_txq_max_ndescs = RHEAD_TXQ_MAXNDESCS; + encp->enc_txq_min_ndescs = RHEAD_TXQ_MINNDESCS; + + /* Riverhead FW does not support event queue timers yet. */ + encp->enc_evq_timer_quantum_ns = 0; + encp->enc_evq_timer_max_us = 0; + + encp->enc_ev_desc_size = RHEAD_EVQ_DESC_SIZE; + encp->enc_rx_desc_size = RHEAD_RXQ_DESC_SIZE; + encp->enc_tx_desc_size = RHEAD_TXQ_DESC_SIZE; + + /* No required alignment for WPTR updates */ + encp->enc_rx_push_align = 1; + + /* Riverhead supports a single Rx prefix size. */ + encp->enc_rx_prefix_size = ESE_GZ_RX_PKT_PREFIX_LEN; + + /* Alignment for receive packet DMA buffers. */ + encp->enc_rx_buf_align_start = 1; + + /* Get the RX DMA end padding alignment configuration. */ + if ((rc = efx_mcdi_get_rxdp_config(enp, &end_padding)) != 0) { + if (rc != EACCES) + goto fail2; + + /* Assume largest tail padding size supported by hardware. */ + end_padding = 128; + } + encp->enc_rx_buf_align_end = end_padding; + + /* + * Riverhead stores a single global copy of VPD, not per-PF as on + * Huntington. + */ + encp->enc_vpd_is_global = B_TRUE; + + rc = ef10_nic_get_port_mode_bandwidth(enp, &bandwidth); + if (rc != 0) + goto fail3; + encp->enc_required_pcie_bandwidth_mbps = bandwidth; + encp->enc_max_pcie_link_gen = EFX_PCIE_LINK_SPEED_GEN3; + + return (0); + +fail3: + EFSYS_PROBE(fail3); +fail2: + EFSYS_PROBE(fail2); +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn efx_rc_t +rhead_nic_probe( + __in efx_nic_t *enp) +{ + const efx_nic_ops_t *enop = enp->en_enop; + efx_nic_cfg_t *encp = &(enp->en_nic_cfg); + efx_drv_cfg_t *edcp = &(enp->en_drv_cfg); + efx_rc_t rc; + + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp)); + + /* Read and clear any assertion state */ + if ((rc = efx_mcdi_read_assertion(enp)) != 0) + goto fail1; + + /* Exit the assertion handler */ + if ((rc = efx_mcdi_exit_assertion_handler(enp)) != 0) + if (rc != EACCES) + goto fail2; + + if ((rc = efx_mcdi_drv_attach(enp, B_TRUE)) != 0) + goto fail3; + + /* Get remaining controller-specific board config */ + if ((rc = enop->eno_board_cfg(enp)) != 0) + goto fail4; + + /* + * Set default driver config limits (based on board config). + * + * FIXME: For now allocate a fixed number of VIs which is likely to be + * sufficient and small enough to allow multiple functions on the same + * port. + */ + edcp->edc_min_vi_count = edcp->edc_max_vi_count = + MIN(128, MAX(encp->enc_rxq_limit, encp->enc_txq_limit)); + + /* + * The client driver must configure and enable PIO buffer support, + * but there is no PIO support on Riverhead anyway. + */ + edcp->edc_max_piobuf_count = 0; + edcp->edc_pio_alloc_size = 0; + +#if EFSYS_OPT_MAC_STATS + /* Wipe the MAC statistics */ + if ((rc = efx_mcdi_mac_stats_clear(enp)) != 0) + goto fail5; +#endif + +#if EFSYS_OPT_LOOPBACK + if ((rc = efx_mcdi_get_loopback_modes(enp)) != 0) + goto fail6; +#endif + + return (0); + +#if EFSYS_OPT_LOOPBACK +fail6: + EFSYS_PROBE(fail6); +#endif +#if EFSYS_OPT_MAC_STATS +fail5: + EFSYS_PROBE(fail5); +#endif +fail4: + EFSYS_PROBE(fail4); +fail3: + EFSYS_PROBE(fail3); +fail2: + EFSYS_PROBE(fail2); +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn efx_rc_t +rhead_nic_set_drv_limits( + __inout efx_nic_t *enp, + __in efx_drv_limits_t *edlp) +{ + const efx_nic_cfg_t *encp = efx_nic_cfg_get(enp); + efx_drv_cfg_t *edcp = &(enp->en_drv_cfg); + uint32_t min_evq_count, max_evq_count; + uint32_t min_rxq_count, max_rxq_count; + uint32_t min_txq_count, max_txq_count; + efx_rc_t rc; + + if (edlp == NULL) { + rc = EINVAL; + goto fail1; + } + + /* Get minimum required and maximum usable VI limits */ + min_evq_count = MIN(edlp->edl_min_evq_count, encp->enc_evq_limit); + min_rxq_count = MIN(edlp->edl_min_rxq_count, encp->enc_rxq_limit); + min_txq_count = MIN(edlp->edl_min_txq_count, encp->enc_txq_limit); + + edcp->edc_min_vi_count = + MAX(min_evq_count, MAX(min_rxq_count, min_txq_count)); + + max_evq_count = MIN(edlp->edl_max_evq_count, encp->enc_evq_limit); + max_rxq_count = MIN(edlp->edl_max_rxq_count, encp->enc_rxq_limit); + max_txq_count = MIN(edlp->edl_max_txq_count, encp->enc_txq_limit); + + edcp->edc_max_vi_count = + MAX(max_evq_count, MAX(max_rxq_count, max_txq_count)); + + /* There is no PIO support on Riverhead */ + edcp->edc_max_piobuf_count = 0; + edcp->edc_pio_alloc_size = 0; + + return (0); + +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn efx_rc_t +rhead_nic_reset( + __in efx_nic_t *enp) +{ + efx_rc_t rc; + + /* ef10_nic_reset() is called to recover from BADASSERT failures. */ + if ((rc = efx_mcdi_read_assertion(enp)) != 0) + goto fail1; + if ((rc = efx_mcdi_exit_assertion_handler(enp)) != 0) + goto fail2; + + if ((rc = efx_mcdi_entity_reset(enp)) != 0) + goto fail3; + + /* Clear RX/TX DMA queue errors */ + enp->en_reset_flags &= ~(EFX_RESET_RXQ_ERR | EFX_RESET_TXQ_ERR); + + return (0); + +fail3: + EFSYS_PROBE(fail3); +fail2: + EFSYS_PROBE(fail2); +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn efx_rc_t +rhead_nic_init( + __in efx_nic_t *enp) +{ + const efx_drv_cfg_t *edcp = &(enp->en_drv_cfg); + uint32_t min_vi_count, max_vi_count; + uint32_t vi_count, vi_base, vi_shift; + uint32_t vi_window_size; + efx_rc_t rc; + + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp)); + EFSYS_ASSERT3U(edcp->edc_max_piobuf_count, ==, 0); + + /* Enable reporting of some events (e.g. link change) */ + if ((rc = efx_mcdi_log_ctrl(enp)) != 0) + goto fail1; + + min_vi_count = edcp->edc_min_vi_count; + max_vi_count = edcp->edc_max_vi_count; + + /* Ensure that the previously attached driver's VIs are freed */ + if ((rc = efx_mcdi_free_vis(enp)) != 0) + goto fail2; + + /* + * Reserve VI resources (EVQ+RXQ+TXQ) for this PCIe function. If this + * fails then retrying the request for fewer VI resources may succeed. + */ + vi_count = 0; + if ((rc = efx_mcdi_alloc_vis(enp, min_vi_count, max_vi_count, + &vi_base, &vi_count, &vi_shift)) != 0) + goto fail3; + + EFSYS_PROBE2(vi_alloc, uint32_t, vi_base, uint32_t, vi_count); + + if (vi_count < min_vi_count) { + rc = ENOMEM; + goto fail4; + } + + enp->en_arch.ef10.ena_vi_base = vi_base; + enp->en_arch.ef10.ena_vi_count = vi_count; + enp->en_arch.ef10.ena_vi_shift = vi_shift; + + EFSYS_ASSERT3U(enp->en_nic_cfg.enc_vi_window_shift, !=, + EFX_VI_WINDOW_SHIFT_INVALID); + EFSYS_ASSERT3U(enp->en_nic_cfg.enc_vi_window_shift, <=, + EFX_VI_WINDOW_SHIFT_64K); + vi_window_size = 1U << enp->en_nic_cfg.enc_vi_window_shift; + + /* Save UC memory mapping details */ + enp->en_arch.ef10.ena_uc_mem_map_offset = 0; + enp->en_arch.ef10.ena_uc_mem_map_size = + vi_window_size * enp->en_arch.ef10.ena_vi_count; + + /* No WC memory mapping since PIO is not supported */ + enp->en_arch.ef10.ena_pio_write_vi_base = 0; + enp->en_arch.ef10.ena_wc_mem_map_offset = 0; + enp->en_arch.ef10.ena_wc_mem_map_size = 0; + + enp->en_vport_id = EVB_PORT_ID_NULL; + + enp->en_nic_cfg.enc_mcdi_max_payload_length = MCDI_CTL_SDU_LEN_MAX_V2; + + return (0); + +fail4: + EFSYS_PROBE(fail4); + + (void) efx_mcdi_free_vis(enp); + +fail3: + EFSYS_PROBE(fail3); +fail2: + EFSYS_PROBE(fail2); +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn efx_rc_t +rhead_nic_get_vi_pool( + __in efx_nic_t *enp, + __out uint32_t *vi_countp) +{ + /* + * Report VIs that the client driver can use. + * Do not include VIs used for PIO buffer writes. + */ + *vi_countp = enp->en_arch.ef10.ena_vi_count; + + return (0); +} + + __checkReturn efx_rc_t +rhead_nic_get_bar_region( + __in efx_nic_t *enp, + __in efx_nic_region_t region, + __out uint32_t *offsetp, + __out size_t *sizep) +{ + efx_rc_t rc; + + EFSYS_ASSERT(EFX_FAMILY_IS_EF100(enp)); + + /* + * TODO: Specify host memory mapping alignment and granularity + * in efx_drv_limits_t so that they can be taken into account + * when allocating extra VIs for PIO writes. + */ + switch (region) { + case EFX_REGION_VI: + /* UC mapped memory BAR region for VI registers */ + *offsetp = enp->en_arch.ef10.ena_uc_mem_map_offset; + *sizep = enp->en_arch.ef10.ena_uc_mem_map_size; + break; + + case EFX_REGION_PIO_WRITE_VI: + /* WC mapped memory BAR region for piobuf writes */ + *offsetp = enp->en_arch.ef10.ena_wc_mem_map_offset; + *sizep = enp->en_arch.ef10.ena_wc_mem_map_size; + break; + + default: + rc = EINVAL; + goto fail1; + } + + return (0); + +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + + __checkReturn boolean_t +rhead_nic_hw_unavailable( + __in efx_nic_t *enp) +{ + efx_dword_t dword; + + if (enp->en_reset_flags & EFX_RESET_HW_UNAVAIL) + return (B_TRUE); + + EFX_BAR_READD(enp, ER_GZ_MC_SFT_STATUS, &dword, B_FALSE); + if (EFX_DWORD_FIELD(dword, EFX_DWORD_0) == 0xffffffff) + goto unavail; + + return (B_FALSE); + +unavail: + rhead_nic_set_hw_unavailable(enp); + + return (B_TRUE); +} + + void +rhead_nic_set_hw_unavailable( + __in efx_nic_t *enp) +{ + EFSYS_PROBE(hw_unavail); + enp->en_reset_flags |= EFX_RESET_HW_UNAVAIL; +} + + void +rhead_nic_fini( + __in efx_nic_t *enp) +{ + (void) efx_mcdi_free_vis(enp); + enp->en_arch.ef10.ena_vi_count = 0; +} + + void +rhead_nic_unprobe( + __in efx_nic_t *enp) +{ + (void) efx_mcdi_drv_attach(enp, B_FALSE); +} + +#if EFSYS_OPT_DIAG + + __checkReturn efx_rc_t +rhead_nic_register_test( + __in efx_nic_t *enp) +{ + efx_rc_t rc; + + /* FIXME */ + _NOTE(ARGUNUSED(enp)) + _NOTE(CONSTANTCONDITION) + if (B_FALSE) { + rc = ENOTSUP; + goto fail1; + } + /* FIXME */ + + return (0); + +fail1: + EFSYS_PROBE1(fail1, efx_rc_t, rc); + + return (rc); +} + +#endif /* EFSYS_OPT_DIAG */ + +#endif /* EFSYS_OPT_RIVERHEAD */ -- 2.17.1