From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 0745CA32A2 for ; Thu, 24 Oct 2019 20:56:47 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id BDE271EBE3; Thu, 24 Oct 2019 20:56:46 +0200 (CEST) Received: from mail-lf1-f52.google.com (mail-lf1-f52.google.com [209.85.167.52]) by dpdk.org (Postfix) with ESMTP id 079291C2A3 for ; Thu, 24 Oct 2019 20:56:45 +0200 (CEST) Received: by mail-lf1-f52.google.com with SMTP id 195so20008786lfj.6 for ; Thu, 24 Oct 2019 11:56:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Fn5NKtt87KdQPiXTALzSsZ9c8uU6sXgYnbfvpPk78nU=; b=iB29bA3o1cm1D69BqrktB/sgWJ9gu0QBSFJnZQh6A4lhvqT+UIjxRMjHRuIgYt6MsX T2vLk5e8m2AXLK2mC1Z0vmV0FEaJkfXE8WJdkWuLfJuvHb3kqHi6DGejCNVI1ig8Sp2W +UPPYtw3as0W7sN+PMHB1yAff2uNnBd+4V6/BitifGTbiaq/MfFwN4ibu9QOo4zTpo6A yCswa6RGNNk/1Qc8t7GCzYGuao94k/AFzrxpsFj1ndjr8oss++DhLnlW5FOiihtg7mtF 3k7rzHbHw4aJ/HmmqXw+6iAQ+k/zEOeZ20Th+pcrymDioZJPTsJ9lbaBwrTRfiNkRLl6 rQcg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Fn5NKtt87KdQPiXTALzSsZ9c8uU6sXgYnbfvpPk78nU=; b=l6q2TmphOalHWj4i+HCH4pUHmmM3+0PMh0DOPxjrf+L1E05Pa+VHmO8pOS0mGc3KIi ym+HUmb7euI19aorlsdxeIVP8Uj4zQfcCSe+vdZZpFoIhsgaY0bvfh8xPBnqIsxQ68Xl Fp0BAm0EPYVWn2xk/bqyVPjQn1HNmZkEH6RZOUcxfmds6+KWmGFMFdb59JSRotfZerII Lp0jlUHBEiWl4gK0PEvvmpio6YbDhzMjhK350WqQVSZpqAjWFMRntER8ZRFDyqpQgXEb avVeY+A/17d3ZjMpppwhbEoDjsr3hjK0yixl5VQ7o5NKQdjlIlkDawCqWUm/sqhjb2bW 7Hlg== X-Gm-Message-State: APjAAAXZCoEoo2o9789gufi6tsE+dkttckh5HXiMEEazY3Kx3i/2DeA9 Bu5iCxT/w8ulrEhDhlvukdXYvcjauVHgwGTBbxU= X-Google-Smtp-Source: APXvYqwk2zUUr1XY3eVv06q4CnhMlKkndHiNI3b7QeavoklLx+1treVK9+dRqVwf43rsjrlquQPcnyzwX9OCU6qbAgE= X-Received: by 2002:a19:c354:: with SMTP id t81mr19519830lff.179.1571943404484; Thu, 24 Oct 2019 11:56:44 -0700 (PDT) MIME-Version: 1.0 References: <78751ab2-0e3b-4341-4090-bca86b5e1b01@solarflare.com> In-Reply-To: <78751ab2-0e3b-4341-4090-bca86b5e1b01@solarflare.com> From: Ravi Kerur Date: Thu, 24 Oct 2019 11:56:32 -0700 Message-ID: To: Andrew Rybchenko Cc: dev@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] Debug crash in bucket_enqueue () X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Thu, Oct 24, 2019 at 9:58 AM Andrew Rybchenko wrote: > Hello, > > please, see note on the following page: > https://doc.dpdk.org/guides/prog_guide/mempool_lib.html#mempool-handlers Thanks for your inputs. Note refers to '-d' for shared objects. In my case both OVS/DPDK and multi_process/simple_mp use static linked libraries. I am pretty use OVS/DPDK uses libdpdk.a which is a group of all archives. I see following from sample_mp_ovs.map file Archive member included to satisfy reference by file (symbol) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_pipeline.a(rte_pipeline.o) (--whole-archive) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_pipeline.a(rte_port_in_action.o) (--whole-archive) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_pipeline.a(rte_table_action.o) (--whole-archive) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_table.a(rte_table_lpm.o) (--whole-archive) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_table.a(rte_table_lpm_ipv6.o) (--whole-archive) /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/lib/librte_table.a(rte_table_acl.o) (--whole-archive) ... Thanks. > > > Andrew. > > On 10/24/19 7:42 PM, Ravi Kerur wrote: > > DPDK team, > > > > I have a simple multi process setup with OVS/DPDK as primary and another > > process as secondary. OVS/DPDK sets up mempool and rings with MP/MC flags > > and secondary process attaches to it. I have used > > example/multi-process/simple_mp as an example. I have disabled 'ASLR' and > > made sure primary and secondary use distinct EAL lcores. > > > > test case is that for every 10/12 packets OVS/DPDK does > > rte_mempool_get() and rte_ring_enqueue() > > with information about the packets > > > > secondary process does > > rte_ring_dequeue() and rte_mempool_put() > > > > Couple of minutes into the test secondary process crashes with following > > baktrace. > > > > Any other system level settings need to be set or inputs on debugging > > bucket_enqueue? > > > > #0 0x0000555555734160 in bucket_enqueue () > > #1 0x00005555555edf06 in rte_mempool_ops_enqueue_bulk (mp=0x17fa9ac80, > > obj_table=0x17fac8210, n=16) at > > > /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/include/rte_mempool.h:704 > > #2 0x00005555555f072a in __mempool_generic_put (cache=0x17fac8100, n=1, > > obj_table=0x7ffff4e09050, mp=0x17fa9ac80) at > > > /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/include/rte_mempool.h:1249 > > #3 rte_mempool_generic_put (cache=0x17fac8100, n=1, > > obj_table=0x7ffff4e09050, mp=0x17fa9ac80) at > > > /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/include/rte_mempool.h:1285 > > #4 rte_mempool_put_bulk (n=1, obj_table=0x7ffff4e09050, mp=0x17fa9ac80) > at > > > /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/include/rte_mempool.h:1308 > > #5 rte_mempool_put (obj=0x17f994300, mp=0x17fa9ac80) at > > > /home/rkerur/dpdk-stable-18.11.2//x86_64-native-linuxapp-gcc/include/rte_mempool.h:1326 > > #6 lcore_recv (arg=0x7fffffffd5b3) at > /home/rkerur/simple_mp_ovs/main.c:369 > > #7 0x00005555556df8f1 in eal_thread_loop () > > #8 0x00007ffff72086db in start_thread (arg=0x7ffff4e0b700) at > > pthread_create.c:463 > > #9 0x00007ffff6f3188f in clone () at > > ../sysdeps/unix/sysv/linux/x86_64/clone.S:95 > > > > Thanks, > > Ravi > >