From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ob0-f171.google.com (mail-ob0-f171.google.com [209.85.214.171]) by dpdk.org (Postfix) with ESMTP id 357F9595B for ; Thu, 13 Nov 2014 03:40:54 +0100 (CET) Received: by mail-ob0-f171.google.com with SMTP id wp18so10196603obc.2 for ; Wed, 12 Nov 2014 18:50:50 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=sidebandnetworks.com; s=google; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Ku6WoVUyLNIGHuJ7EEvYROme7bj3U3kiFJgc3qcOpDU=; b=Oww5Jh90cYRVK89QpCll17A7SYfRpiR/i7g5qUCCXyIiG4kDc9S6g588zN+4vlJv0+ z4Ioj5MVbmhDDzOgD+Y/b6PCHMHAgzibkVo9IsVDN7eIFKsWEmq7/bC7nhH2vCnJEP2O jp8sES0+1DhwqLHOgRD9vf+ucWPVBDfESq770= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Ku6WoVUyLNIGHuJ7EEvYROme7bj3U3kiFJgc3qcOpDU=; b=m+nNT5OkFpYL17WYPJGmTBUzGJ56cZcqet+uEyJ9g/QJY7sI8k+WrEKubxnMLYpcIy YaCe+OPtPMu2g9i/KSJLInh9FxXfBWH3F8pM8rc7QTMnaL6H7qUK3e7dzQkn8ITv9KTg bSqNTr1ZY5LFtCtWOZSC4h8yRCeydHWviJKjUhVytjTCYWWRNxvTHaHWDd5MWaW+4ZT4 H2g/S2aKlDpuc07pWmUpLDchElbkcRCg6mhYLcNh9vzhbsawtBrsUa1zIVfk3YI/Iltq bEGDqfQxY13W7SZJtwrCnpBS3nUMZXgaOgiarFtdUwN63xj2/TEG/AR8DWBALZ6POmi9 C7Bw== X-Gm-Message-State: ALoCoQlayx6QotUeh+oUA2XX1I94zeExr20+loTTLhwwaYmVXh1DGYiOOk3cNBPJqAkA9rrUHbHX MIME-Version: 1.0 X-Received: by 10.182.20.112 with SMTP id m16mr41300792obe.25.1415847050064; Wed, 12 Nov 2014 18:50:50 -0800 (PST) Received: by 10.202.48.78 with HTTP; Wed, 12 Nov 2014 18:50:49 -0800 (PST) In-Reply-To: <20141107094828.GC4628@bricha3-MOBL3> References: <20141107094828.GC4628@bricha3-MOBL3> Date: Wed, 12 Nov 2014 21:50:50 -0500 Message-ID: From: Kamraan Nasim To: Bruce Richardson Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Cc: dev@dpdk.org Subject: Re: [dpdk-dev] Panic in rte MEMPOOL__mempool_check_cookies() X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2014 02:40:54 -0000 Hi Bruce, The issue seems to be triggered by a combination of using the CONFIG_RTE_LIBRTE_MEMPOOL_DEBUG option and contention in the mempool(small mempool size). I disabled that and the header panics went away. Thank you for your help! --Kam On Fri, Nov 7, 2014 at 4:48 AM, Bruce Richardson wrote: > On Thu, Nov 06, 2014 at 04:28:18PM -0500, Kamraan Nasim wrote: > > Greetings, > > > > I have been hitting this issue fairly consistently for the ixgbe driver > > > > MEMPOOL: obj=0x7ffeed1f5d00, mempool=0x7ffeecb69bc0, > cookie=badbadbadadd2e55 > > PANIC in __mempool_check_cookies(): > > MEMPOOL: bad header cookie (get) > > > > It seems to be a corruption in the mempool bound to my ixgbe port. What I > > have observed is that this ONLY happens if I initialize dpdk(i.e. start > > dpdk application) AFTER traffic is already flowing in through the port. > If > > I initialize dpdk and bind BEFORE I start traffic then things seem to > work > > fine. > > > > Any clues on why this might be happening? > > > > A bit stumped, so would really appreciate all the help I can get on this > > one. > > > > Hi. > Can you confirm if your application works ok with the mempool debug options > disabled? The mempool debug options are not often used because they slow > things > down so it's possible the bug could be in the cookie checking itself. > > /Bruce > > > Thanks, > > Kam > > > > > > (bt for your reference) > > > > #2 0x0000000000408cc6 in __rte_panic (funcname=0x571100 > > "__mempool_check_cookies", format= > > 0x568fb0 "MEMPOOL: bad header cookie (get)\n%.0s") > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_eal/linuxapp/eal/eal_debug.c:83 > > #3 0x00000000004af027 in __mempool_check_cookies (rxq= > out>) > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/x86_64-native-linuxapp-gcc/include/rte_mempool.h:357 > > #4 rte_mempool_get_bulk (rxq=) > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/x86_64-native-linuxapp-gcc/include/rte_mempool.h:1094 > > #5 ixgbe_rx_alloc_bufs (rxq=) > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:997 > > #6 0x00000000004afce9 in rx_recv_pkts (rx_queue=0x7ffeec8edbc0, > > rx_pkts=0x900410, > > nb_pkts=) > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:1074 > > #7 ixgbe_recv_pkts_bulk_alloc (rx_queue=0x7ffeec8edbc0, > rx_pkts=0x900410, > > nb_pkts=) > > at > > > /b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:1124 > > #8 0x0000000000520d36 in rte_eth_rx_burst (lp=0x900340, n_workers=14, > > bsz_rd=, bsz_wr= > > 144, pos_lb=0 '\000') at /usr/lib/dpdk/include/rte_ethdev.h:2368 >