From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by dpdk.org (Postfix) with ESMTP id EC1EF37A4 for ; Tue, 24 Mar 2015 17:21:53 +0100 (CET) Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga102.fm.intel.com with ESMTP; 24 Mar 2015 09:21:45 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.11,459,1422950400"; d="scan'208";a="697029741" Received: from bricha3-mobl3.ger.corp.intel.com ([10.243.20.28]) by fmsmga002.fm.intel.com with SMTP; 24 Mar 2015 09:21:43 -0700 Received: by (sSMTP sendmail emulation); Tue, 24 Mar 2015 16:21:43 +0025 Date: Tue, 24 Mar 2015 16:21:43 +0000 From: Bruce Richardson To: Dor Green Message-ID: <20150324162143.GA6276@bricha3-MOBL3> References: <20150323145958.GA12720@bricha3-MOBL3> <20150323212459.GA5502@mhcomputing.net> <20150324131715.GA11384@bricha3-MOBL3> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Organization: Intel Shannon Ltd. User-Agent: Mutt/1.5.23 (2014-03-12) Cc: dev@dpdk.org Subject: Re: [dpdk-dev] Packet data out of bounds after rte_eth_rx_burst X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Mar 2015 16:21:54 -0000 On Tue, Mar 24, 2015 at 04:10:18PM +0200, Dor Green wrote: > 1 . The eth_conf is: > > static struct rte_eth_conf const ethconf = { > .link_speed = 0, > .link_duplex = 0, > > .rxmode = { > .mq_mode = ETH_MQ_RX_RSS, > .max_rx_pkt_len = ETHER_MAX_LEN, > .split_hdr_size = 0, > .header_split = 0, > .hw_ip_checksum = 0, > .hw_vlan_filter = 0, > .jumbo_frame = 0, > .hw_strip_crc = 0, /**< CRC stripped by hardware */ > }, > > .txmode = { > }, > > .rx_adv_conf = { > .rss_conf = { > .rss_key = NULL, > .rss_hf = ETH_RSS_IPV4 | ETH_RSS_IPV6, > } > }, > > .fdir_conf = { > .mode = RTE_FDIR_MODE_SIGNATURE, > > }, > > .intr_conf = { > .lsc = 0, > }, > }; > > I've tried setting jumbo frames on with a larger packet length and > even turning off RSS/FDIR. No luck. > > I don't see anything relating to the port in the initial prints, what > are you looking for? I'm looking for the PMD initialization text, like that shown below (from testpmd): Configuring Port 0 (socket 0) PMD: ixgbe_dev_tx_queue_setup(): sw_ring=0x7f9ba08cd700 hw_ring=0x7f9ba0b00080 dma_addr=0x36d00080 PMD: ixgbe_set_tx_function(): Using simple tx code path PMD: ixgbe_set_tx_function(): Vector tx enabled. PMD: ixgbe_dev_rx_queue_setup(): sw_ring=0x7f9ba08cce80 hw_ring=0x7f9ba0b10080 dma_addr=0x36d10080 PMD: ixgbe_set_rx_function(): Vector rx enabled, please make sure RX burst size no less than 32. Port 0: 68:05:CA:04:51:3A Configuring Port 1 (socket 0) PMD: ixgbe_dev_tx_queue_setup(): sw_ring=0x7f9ba08cab40 hw_ring=0x7f9ba0b20100 dma_addr=0x36d20100 PMD: ixgbe_set_tx_function(): Using simple tx code path PMD: ixgbe_set_tx_function(): Vector tx enabled. PMD: ixgbe_dev_rx_queue_setup(): sw_ring=0x7f9ba08ca2c0 hw_ring=0x7f9ba0b30100 dma_addr=0x36d30100 PMD: ixgbe_set_rx_function(): Vector rx enabled, please make sure RX burst size no less than 32. Port 1: 68:05:CA:04:51:38 This tells us what RX and TX functions are going to be used for each port. > > 2. The packet is a normal, albeit somewhat large (1239 bytes) TCP data > packet (SSL certificate data, specifically). > One important thing of note that I've just realised is that it's not > this "packet of death" which causes the segmentation fault (i.e. has > an out-of-bounds address for its data), but the packet afterwards-- no > matter what packet it is. > Can this problem be reproduced using testpmd or any of the standard dpdk example apps, by sending in the same packet sequence? Is there anything unusual being done in the setup of the mempool used for the packet buffers? /Bruce > > On Tue, Mar 24, 2015 at 3:17 PM, Bruce Richardson > wrote: > > On Tue, Mar 24, 2015 at 12:54:14PM +0200, Dor Green wrote: > >> I've managed to fix it so 1.8 works, and the segmentation fault still occurs. > >> > >> On Tue, Mar 24, 2015 at 11:55 AM, Dor Green wrote: > >> > I tried 1.8, but that fails to initialize my device and fails at the pci probe: > >> > "Cause: Requested device 0000:04:00.1 cannot be used" > >> > Can't even compile 2.0rc2 atm, getting: > >> > "/usr/lib/gcc/x86_64-linux-gnu/4.6/include/emmintrin.h:701:1: note: > >> > expected '__m128i' but argument is of type 'int'" > >> > For reasons I don't understand. > >> > > >> > As for the example apps (in 1.7), I can run them properly but I don't > >> > think any of them do the same processing as I do. Note that mine does > >> > work with most packets. > >> > > >> > > > > > Couple of further questions: > > 1. What config options are being used to configure the port and what is the > > output printed at port initialization time? This is needed to let us track down > > what specific RX path is being used inside the ixgbe driver > > 2. What type of packets specifically cause problems? Is it reproducible with > > one particular packet, or packet type? Are you sending in jumbo-frames? > > > > Regards, > > /Bruce > > > >> > On Mon, Mar 23, 2015 at 11:24 PM, Matthew Hall wrote: > >> >> On Mon, Mar 23, 2015 at 05:19:00PM +0200, Dor Green wrote: > >> >>> I changed it to free and it still happens. Note that the segmentation fault > >> >>> happens before that anyway. > >> >>> > >> >>> I am using 1.7.1 at the moment. I can try using a newer version. > >> >> > >> >> I'm using 1.7.X in my open-source DPDK-based app and it works, but I have an > >> >> IGB 1-gigabit NIC though, and how RX / TX work are quite driver specific of > >> >> course. > >> >> > >> >> I suspect there's some issue with how things are working in your IXGBE NIC > >> >> driver / setup. Do the same failures occur inside of the DPDK's own sample > >> >> apps? > >> >> > >> >> Matthew.