From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <knasim@sidebandnetworks.com>
Received: from mail-ob0-f174.google.com (mail-ob0-f174.google.com
 [209.85.214.174]) by dpdk.org (Postfix) with ESMTP id 7C25A7E75
 for <dev@dpdk.org>; Thu,  6 Nov 2014 22:18:50 +0100 (CET)
Received: by mail-ob0-f174.google.com with SMTP id uz6so1589099obc.33
 for <dev@dpdk.org>; Thu, 06 Nov 2014 13:28:18 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=sidebandnetworks.com; s=google;
 h=mime-version:date:message-id:subject:from:to:cc:content-type;
 bh=t9BYxWsLdKCXHN42GeENbtBncQcHwUIFPlGJeK+iNo4=;
 b=IN5Z+DVP5uQN72dfxFcZVvnAjAi5xPlSoJ3BtiStSfFQwigYxY5DcPilopADuYNwEl
 fQoTqY2lJRSTu+w3h3s9gmdCkQwcKTOMa0auY3LQFQBpNlr4hG3xcCB0kjg9E/UQdMjU
 DjnviH6dx6inX+wqweFTAz96H04741LVINffQ=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20130820;
 h=x-gm-message-state:mime-version:date:message-id:subject:from:to:cc
 :content-type;
 bh=t9BYxWsLdKCXHN42GeENbtBncQcHwUIFPlGJeK+iNo4=;
 b=eQMP94J54tnzy4iwZZRvshGnySNZ7uDCbEgmnQwifTatW+Y15dOn+P8U6gAbaXuQsP
 4hM/FoWY8fd+vSEC6D+ixUgpuvyKvx3BPrb5JgoOv7esUxwZ6vuUzuDM+gU5yrlaOYW8
 FKbst5rA26iuS4a+hyDKbCZwzkvyFPP9b0DdL1WgSrNFCtDmhOaBe+AzNHjCa7j9aGF3
 mpc590QveNd7TIDwItHHhm72QVQYZxy/vG3rxSCvn1CPAOVJ/kwkS3V+3FTtJW88kh3t
 Rd/k8lMYtpC0JtVihKxHzuJnAoRT5EjfR+kYr9Xd1xRbpYNjVaJ4WMVZmF3+8QN6cMJO
 VuIQ==
X-Gm-Message-State: ALoCoQnZENQRmPifZzdt19PrLYjhClGs9vwsaerQB+UreDuB3V5e3APcRm6MWEJRJxu/OGkDWLp5
MIME-Version: 1.0
X-Received: by 10.202.196.15 with SMTP id u15mr5478840oif.21.1415309298826;
 Thu, 06 Nov 2014 13:28:18 -0800 (PST)
Received: by 10.202.106.79 with HTTP; Thu, 6 Nov 2014 13:28:18 -0800 (PST)
Date: Thu, 6 Nov 2014 16:28:18 -0500
Message-ID: <CAPrTskijLw42woTkBvt_cYcaNKcyDsYVhj_zEpQ2n7DPMw1_Kg@mail.gmail.com>
From: Kamraan Nasim <knasim@sidebandnetworks.com>
To: dev@dpdk.org
Content-Type: text/plain; charset=UTF-8
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Cc: Steve Noble <snoble@sidebandnetworks.com>
Subject: [dpdk-dev] Panic in rte MEMPOOL__mempool_check_cookies()
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: patches and discussions about DPDK <dev.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Thu, 06 Nov 2014 21:18:51 -0000

Greetings,

I have been hitting this issue fairly consistently for the ixgbe driver

MEMPOOL: obj=0x7ffeed1f5d00, mempool=0x7ffeecb69bc0, cookie=badbadbadadd2e55
PANIC in __mempool_check_cookies():
MEMPOOL: bad header cookie (get)

It seems to be a corruption in the mempool bound to my ixgbe port. What I
have observed is that this ONLY happens if I initialize dpdk(i.e. start
dpdk application) AFTER traffic is already flowing in through the port. If
I initialize dpdk and bind BEFORE I start traffic then things seem to work
fine.

Any clues on why this might be happening?

A bit stumped, so would really appreciate all the help I can get on this
one.

Thanks,
Kam


(bt for your reference)

#2  0x0000000000408cc6 in __rte_panic (funcname=0x571100
"__mempool_check_cookies", format=
    0x568fb0 "MEMPOOL: bad header cookie (get)\n%.0s")
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_eal/linuxapp/eal/eal_debug.c:83
#3  0x00000000004af027 in __mempool_check_cookies (rxq=<value optimized
out>)
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/x86_64-native-linuxapp-gcc/include/rte_mempool.h:357
#4  rte_mempool_get_bulk (rxq=<value optimized out>)
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/x86_64-native-linuxapp-gcc/include/rte_mempool.h:1094
#5  ixgbe_rx_alloc_bufs (rxq=<value optimized out>)
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:997
#6  0x00000000004afce9 in rx_recv_pkts (rx_queue=0x7ffeec8edbc0,
rx_pkts=0x900410,
    nb_pkts=<value optimized out>)
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:1074
#7  ixgbe_recv_pkts_bulk_alloc (rx_queue=0x7ffeec8edbc0, rx_pkts=0x900410,
nb_pkts=<value optimized out>)
    at
/b/knasim/bandwagon/sbn/src/share/dpdk/lib/librte_pmd_ixgbe/ixgbe_rxtx.c:1124
#8  0x0000000000520d36 in rte_eth_rx_burst (lp=0x900340, n_workers=14,
bsz_rd=<value optimized out>, bsz_wr=
    144, pos_lb=0 '\000') at /usr/lib/dpdk/include/rte_ethdev.h:2368