From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id BEBCBA0542; Tue, 31 May 2022 11:55:56 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 5379C400EF; Tue, 31 May 2022 11:55:56 +0200 (CEST) Received: from mga17.intel.com (mga17.intel.com [192.55.52.151]) by mails.dpdk.org (Postfix) with ESMTP id BD87D400D6; Tue, 31 May 2022 11:55:53 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1653990955; x=1685526955; h=from:to:cc:subject:date:message-id:in-reply-to: references:mime-version:content-transfer-encoding; bh=nDlv/UDTx5EOWE2s6x9aU6/MYgl4x9ciq1dBnVaWth0=; b=XUPZNQTxTOP9k1J+27zOrTFp/b1G1JIe47NwFzhHWFX3Q4eTdv9t/hQ0 p22vZifokINTwR1mZdDR6R8DWRwF9OTNFcvi11UpYYZYmi8KmptCSzAMs 4/Nd3OMhC+qBrIShmWVMiVyHW8fOKzBj4QQT74gQpqqQOUzIJtIJPSsEA o/UqigA1fPNuNQzhDWoNmq+pahmQMRK8YRGPM6t1XqIeh7fZsp7NHfTVj WEpXLJVqNXENSP/lzCSvA+688OwHsOhchuPIw3lbf/9bkSWx+rlIHNf/M R6Pn6Pd6CH918y2F3b9mbRqf6nw9r0D7nemtPDyzaIGCofNE8r7RciWRs w==; X-IronPort-AV: E=McAfee;i="6400,9594,10363"; a="255686289" X-IronPort-AV: E=Sophos;i="5.91,264,1647327600"; d="scan'208";a="255686289" Received: from orsmga008.jf.intel.com ([10.7.209.65]) by fmsmga107.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 31 May 2022 02:55:52 -0700 X-IronPort-AV: E=Sophos;i="5.91,264,1647327600"; d="scan'208";a="605592946" Received: from unknown (HELO localhost.localdomain) ([10.239.251.253]) by orsmga008-auth.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 31 May 2022 02:55:50 -0700 From: peng1x.zhang@intel.com To: qiming.yang@intel.com, qi.z.zhang@intel.com, dev@dpdk.org Cc: Peng Zhang , stable@dpdk.org Subject: [PATCH v4] net/ice: retry sending adminQ command after failure Date: Tue, 31 May 2022 17:48:27 +0000 Message-Id: <20220531174827.357629-1-peng1x.zhang@intel.com> X-Mailer: git-send-email 2.25.1 In-Reply-To: <20220520183112.26546-1-peng1x.zhang@intel.com> References: <20220520183112.26546-1-peng1x.zhang@intel.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org From: Peng Zhang The origin design is if error happen during the step 3 of following given situation, it will return error directly without retry. While in current patch, it will retry again and again during certain time. If retry succeed, rule can be continuously created. It will improve success rate of creating rule under following given situation. The given situation as following steps show: step 1. Kernel PF and DCF are ready at the beginning. step 2. A VF reset happen, kernel send an event to DPDK DCF and set STATE to pause. step 3. Before DPDK DCF receive the event, it is possible a rule creation is ongoing and switch rules, recipe, or vsi list related adminQ operation is executing. step 4. Then result of operation is failure, it will lead to error return to DPDK DCF. DPDK DCF error code will be set as EINVAL, not EAGAIN. Fixes: 6bad5047be24 ("net/ice/base: return correct error code") Fixes: 453d087ccaff ("net/ice/base: add common functions") Cc: stable@dpdk.org Signed-off-by: Peng Zhang --- v4 changes: - Add retry mechanism if fail to send adminQ command under given situation. v3 Changes: - Add the situation description, expected error code and incorrect error code - in commit log. v2 Changes: - Modify DCF state checking mechanism. drivers/net/ice/base/ice_common.c | 2 +- drivers/net/ice/base/ice_switch.c | 46 +++++++++++++++++++++++++++---- drivers/net/ice/base/ice_switch.h | 5 ++++ 3 files changed, 46 insertions(+), 7 deletions(-) diff --git a/drivers/net/ice/base/ice_common.c b/drivers/net/ice/base/ice_common.c index db87bacd97..013c255371 100644 --- a/drivers/net/ice/base/ice_common.c +++ b/drivers/net/ice/base/ice_common.c @@ -2127,7 +2127,7 @@ ice_aq_alloc_free_res(struct ice_hw *hw, u16 num_entries, cmd->num_entries = CPU_TO_LE16(num_entries); - return ice_aq_send_cmd(hw, &desc, buf, buf_size, cd); + return ice_aq_retry_send_cmd(hw, &desc, buf, buf_size, cd); } /** diff --git a/drivers/net/ice/base/ice_switch.c b/drivers/net/ice/base/ice_switch.c index d4cc664ad7..8db71f6edb 100644 --- a/drivers/net/ice/base/ice_switch.c +++ b/drivers/net/ice/base/ice_switch.c @@ -18,6 +18,9 @@ #define ICE_ETH_P_8021Q 0x8100 #define ICE_MPLS_ETHER_ID 0x8847 +#define ICE_DCF_ADMINQ_MAX_RETRIES 20 +#define ICE_DCF_ADMINQ_CHECK_TIME 2 /* msecs */ + /* Dummy ethernet header needed in the ice_aqc_sw_rules_elem * struct to configure any switch filter rules. * {DA (6 bytes), SA(6 bytes), @@ -3296,7 +3299,7 @@ ice_aq_sw_rules(struct ice_hw *hw, void *rule_list, u16 rule_list_sz, desc.flags |= CPU_TO_LE16(ICE_AQ_FLAG_RD); desc.params.sw_rules.num_rules_fltr_entry_index = CPU_TO_LE16(num_rules); - status = ice_aq_send_cmd(hw, &desc, rule_list, rule_list_sz, cd); + status = ice_aq_retry_send_cmd(hw, &desc, rule_list, rule_list_sz, cd); if (opc != ice_aqc_opc_add_sw_rules && hw->adminq.sq_last_status == ICE_AQ_RC_ENOENT) status = ICE_ERR_DOES_NOT_EXIST; @@ -3331,7 +3334,7 @@ ice_aq_add_recipe(struct ice_hw *hw, buf_size = num_recipes * sizeof(*s_recipe_list); - return ice_aq_send_cmd(hw, &desc, s_recipe_list, buf_size, cd); + return ice_aq_retry_send_cmd(hw, &desc, s_recipe_list, buf_size, cd); } /** @@ -3373,7 +3376,7 @@ ice_aq_get_recipe(struct ice_hw *hw, buf_size = *num_recipes * sizeof(*s_recipe_list); - status = ice_aq_send_cmd(hw, &desc, s_recipe_list, buf_size, cd); + status = ice_aq_retry_send_cmd(hw, &desc, s_recipe_list, buf_size, cd); *num_recipes = LE16_TO_CPU(cmd->num_sub_recipes); return status; @@ -3462,7 +3465,7 @@ ice_aq_map_recipe_to_profile(struct ice_hw *hw, u32 profile_id, u8 *r_bitmap, ice_memcpy(cmd->recipe_assoc, r_bitmap, sizeof(cmd->recipe_assoc), ICE_NONDMA_TO_NONDMA); - return ice_aq_send_cmd(hw, &desc, NULL, 0, cd); + return ice_aq_retry_send_cmd(hw, &desc, NULL, 0, cd); } /** @@ -3486,7 +3489,7 @@ ice_aq_get_recipe_to_profile(struct ice_hw *hw, u32 profile_id, u8 *r_bitmap, ice_fill_dflt_direct_cmd_desc(&desc, ice_aqc_opc_get_recipe_to_profile); cmd->profile_id = CPU_TO_LE16(profile_id); - status = ice_aq_send_cmd(hw, &desc, NULL, 0, cd); + status = ice_aq_retry_send_cmd(hw, &desc, NULL, 0, cd); if (!status) ice_memcpy(r_bitmap, cmd->recipe_assoc, sizeof(cmd->recipe_assoc), ICE_NONDMA_TO_NONDMA); @@ -4119,7 +4122,6 @@ ice_update_vsi_list_rule(struct ice_hw *hw, u16 *vsi_handle_arr, u16 num_vsi, s_rule->pdata.vsi_list.index = CPU_TO_LE16(vsi_list_id); status = ice_aq_sw_rules(hw, s_rule, s_rule_size, 1, opc, NULL); - exit: ice_free(hw, s_rule); return status; @@ -9582,3 +9584,35 @@ void ice_rm_all_sw_replay_rule_info(struct ice_hw *hw) { ice_rm_sw_replay_rule_info(hw, hw->switch_info); } + +/** + * ice_aq_retry_send_cmd - helper function to retry sending FW Admin Queue commands + * @hw: pointer to the HW struct + * @desc: descriptor describing the command + * @buf: buffer to use for indirect commands (NULL for direct commands) + * @buf_size: size of buffer for indirect commands (0 for direct commands) + * @cd: pointer to command details structure + * + * Retry sending FW Admin Queue commands to the FW Admin Queue if fail to send and + * DCF function is enabled. + */ +enum ice_status +ice_aq_retry_send_cmd(struct ice_hw *hw, struct ice_aq_desc *desc, + void *buf, u16 buf_size, struct ice_sq_cd *cd) +{ + enum ice_status status; + int i = 0; + + for (;;) { + status = ice_aq_send_cmd(hw, desc, buf, buf_size, cd); + if (status == 0 || !hw->dcf_enabled) + break; + + if (++i >= ICE_DCF_ADMINQ_MAX_RETRIES) + break; + + rte_delay_ms(ICE_DCF_ADMINQ_CHECK_TIME); + } + + return status; +} diff --git a/drivers/net/ice/base/ice_switch.h b/drivers/net/ice/base/ice_switch.h index a2b3c80107..1a3fd5472f 100644 --- a/drivers/net/ice/base/ice_switch.h +++ b/drivers/net/ice/base/ice_switch.h @@ -552,4 +552,9 @@ enum ice_status ice_update_recipe_lkup_idx(struct ice_hw *hw, struct ice_update_recipe_lkup_idx_params *params); void ice_change_proto_id_to_dvm(void); + +/* Retry sending adminQ command */ +enum ice_status +ice_aq_retry_send_cmd(struct ice_hw *hw, struct ice_aq_desc *desc, + void *buf, u16 buf_size, struct ice_sq_cd *cd); #endif /* _ICE_SWITCH_H_ */ -- 2.25.1