From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga02.intel.com (mga02.intel.com [134.134.136.20]) by dpdk.org (Postfix) with ESMTP id C344DB0BE for ; Tue, 6 May 2014 12:49:02 +0200 (CEST) Received: from orsmga001.jf.intel.com ([10.7.209.18]) by orsmga101.jf.intel.com with ESMTP; 06 May 2014 03:49:07 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="4.97,996,1389772800"; d="scan'208";a="506654899" Received: from irvmail001.ir.intel.com ([163.33.26.43]) by orsmga001.jf.intel.com with ESMTP; 06 May 2014 03:48:45 -0700 Received: from sivswdev02.ir.intel.com (sivswdev02.ir.intel.com [10.237.217.46]) by irvmail001.ir.intel.com (8.14.3/8.13.6/MailSET/Hub) with ESMTP id s46AmjMS000933; Tue, 6 May 2014 11:48:45 +0100 Received: from sivswdev02.ir.intel.com (localhost [127.0.0.1]) by sivswdev02.ir.intel.com with ESMTP id s46AmjCV011489; Tue, 6 May 2014 11:48:45 +0100 Received: (from kananye1@localhost) by sivswdev02.ir.intel.com with id s46Amj4k011485; Tue, 6 May 2014 11:48:45 +0100 From: Konstantin Ananyev To: dev@dpdk.org Date: Tue, 6 May 2014 11:48:36 +0100 Message-Id: <1399373316-11369-1-git-send-email-konstantin.ananyev@intel.com> X-Mailer: git-send-email 1.7.0.7 Subject: [dpdk-dev] [PATCH] fix for jumbo frame issue with DPDK VF X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 May 2014 10:49:03 -0000 When latest Linux ixgbe PF is used, and DPDK VF is used in DPDK application, jumbo frames are not received. Also - if Linux ixgbe PF has MTU set to 1500 (default), then normal sized packets can be received by DPDK VF. However, if Linux PF has MTU > 1500, then DPDK VF receives no packets (normal or jumbo). With ixgbe_mbox_api_10 ixgbe simply didn't allow set VF MTU > 1514 for 82599. With ixgbe_mbox_ajpi_11 it does, though now, if PF uses jumbo frames, it simply disables RX for all VFs. So to work with PF ithat using jumbo frames, at startup each VF has to: 1. negotiate with PF mbox_api_11. 2. Send to PF SET_LPE message with desired MTU. Note, that if PF already uses MTU bigger then asked by the VF, then PF wouldn't take any action. --- lib/librte_pmd_e1000/igb_rxtx.c | 5 +++ lib/librte_pmd_ixgbe/ixgbe_ethdev.c | 47 ++++++++++++++++++++++++---------- lib/librte_pmd_ixgbe/ixgbe_rxtx.c | 4 +++ 3 files changed, 42 insertions(+), 14 deletions(-) diff --git a/lib/librte_pmd_e1000/igb_rxtx.c b/lib/librte_pmd_e1000/igb_rxtx.c index 4608595..6b454a5 100644 --- a/lib/librte_pmd_e1000/igb_rxtx.c +++ b/lib/librte_pmd_e1000/igb_rxtx.c @@ -2077,6 +2077,11 @@ eth_igbvf_rx_init(struct rte_eth_dev *dev) hw = E1000_DEV_PRIVATE_TO_HW(dev->data->dev_private); + /* setup MTU */ + e1000_rlpml_set_vf(hw, + (uint16_t)(dev->data->dev_conf.rxmode.max_rx_pkt_len + + VLAN_TAG_SIZE)); + /* Configure and enable each RX queue. */ rctl_bsize = 0; dev->rx_pkt_burst = eth_igb_recv_pkts; diff --git a/lib/librte_pmd_ixgbe/ixgbe_ethdev.c b/lib/librte_pmd_ixgbe/ixgbe_ethdev.c index 89ab4aa..94dc3ec 100644 --- a/lib/librte_pmd_ixgbe/ixgbe_ethdev.c +++ b/lib/librte_pmd_ixgbe/ixgbe_ethdev.c @@ -808,19 +808,30 @@ eth_ixgbe_dev_init(__attribute__((unused)) struct eth_driver *eth_drv, return 0; } -static void ixgbevf_get_queue_num(struct ixgbe_hw *hw) + +/* + * Negotiate mailbox API version with the PF. + * After reset API version is always set to the basic one (ixgbe_mbox_api_10). + * Then we try to negotiate starting with the most recent one. + * If all negotiation attempts fail, then we will proceed with + * the default one (ixgbe_mbox_api_10). + */ +static void +ixgbevf_negotiate_api(struct ixgbe_hw *hw) { - /* Traffic classes are not supported by now */ - unsigned int tcs, tc; + int32_t i; - /* - * Must let PF know we are at mailbox API version 1.1. - * Otherwise PF won't answer properly. - * In case that PF fails to provide Rx/Tx queue number, - * max_tx_queues and max_rx_queues remain to be 1. - */ - if (!ixgbevf_negotiate_api_version(hw, ixgbe_mbox_api_11)) - ixgbevf_get_queues(hw, &tcs, &tc); + /* start with highest supported, proceed down */ + static const enum ixgbe_pfvf_api_rev sup_ver[] = { + ixgbe_mbox_api_11, + ixgbe_mbox_api_10, + }; + + for (i = 0; + i != RTE_DIM(sup_ver) && + ixgbevf_negotiate_api_version(hw, sup_ver[i]) != 0; + i++) + ; } /* @@ -830,9 +841,11 @@ static int eth_ixgbevf_dev_init(__attribute__((unused)) struct eth_driver *eth_drv, struct rte_eth_dev *eth_dev) { - struct rte_pci_device *pci_dev; - struct ixgbe_hw *hw = IXGBE_DEV_PRIVATE_TO_HW(eth_dev->data->dev_private); int diag; + uint32_t tc, tcs; + struct rte_pci_device *pci_dev; + struct ixgbe_hw *hw = + IXGBE_DEV_PRIVATE_TO_HW(eth_dev->data->dev_private); struct ixgbe_vfta * shadow_vfta = IXGBE_DEV_PRIVATE_TO_VFTA(eth_dev->data->dev_private); struct ixgbe_hwstrip *hwstrip = @@ -891,8 +904,11 @@ eth_ixgbevf_dev_init(__attribute__((unused)) struct eth_driver *eth_drv, return (diag); } + /* negotiate mailbox API version to use with the PF. */ + ixgbevf_negotiate_api(hw); + /* Get Rx/Tx queue count via mailbox, which is ready after reset_hw */ - ixgbevf_get_queue_num(hw); + ixgbevf_get_queues(hw, &tcs, &tc); /* Allocate memory for storing MAC addresses */ eth_dev->data->mac_addrs = rte_zmalloc("ixgbevf", ETHER_ADDR_LEN * @@ -2518,6 +2534,9 @@ ixgbevf_dev_start(struct rte_eth_dev *dev) hw->mac.ops.reset_hw(hw); + /* negotiate mailbox API version to use with the PF. */ + ixgbevf_negotiate_api(hw); + ixgbevf_dev_tx_init(dev); /* This can fail when allocating mbufs for descriptor rings */ diff --git a/lib/librte_pmd_ixgbe/ixgbe_rxtx.c b/lib/librte_pmd_ixgbe/ixgbe_rxtx.c index 55414b9..7930dbd 100644 --- a/lib/librte_pmd_ixgbe/ixgbe_rxtx.c +++ b/lib/librte_pmd_ixgbe/ixgbe_rxtx.c @@ -3594,6 +3594,10 @@ ixgbevf_dev_rx_init(struct rte_eth_dev *dev) PMD_INIT_FUNC_TRACE(); hw = IXGBE_DEV_PRIVATE_TO_HW(dev->data->dev_private); + /* setup MTU */ + ixgbevf_rlpml_set_vf(hw, + (uint16_t)dev->data->dev_conf.rxmode.max_rx_pkt_len); + /* Setup RX queues */ dev->rx_pkt_burst = ixgbe_recv_pkts; for (i = 0; i < dev->data->nb_rx_queues; i++) { -- 1.7.7.6