From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4D5B8A04B3; Mon, 10 Feb 2020 15:42:51 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 2F1724C7A; Mon, 10 Feb 2020 15:42:50 +0100 (CET) Received: from us-smtp-1.mimecast.com (us-smtp-delivery-1.mimecast.com [207.211.31.120]) by dpdk.org (Postfix) with ESMTP id 26C91397D for ; Mon, 10 Feb 2020 15:42:49 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1581345768; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8Om4RlUASE6dvFa5NzGSmnhc1zSysLjpvLJCw6Ua8QE=; b=M357qLNLz7ZKG+hiTXe1u0NHQpysMnfgU8QlodQnWvWJwQsEJ0Wu7/g2MEGZgGJFPz9hr8 au9qHXTHaEDjdNGSjXK57haZattyIlcX8U0cxhF+j3cyltt+r++a1kJdj2Txatp2KRJArS Ab0aVfqxvWeV1926n24hUMjCTEu17sQ= Received: from mail-vk1-f200.google.com (mail-vk1-f200.google.com [209.85.221.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-231-NqZxp3JlOmyIRD2W79zZ0A-1; Mon, 10 Feb 2020 09:42:33 -0500 Received: by mail-vk1-f200.google.com with SMTP id s205so2281192vka.17 for ; Mon, 10 Feb 2020 06:42:33 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=fRqbwKZ0gWjCTE+o1smd3+y5n4e1EP9hDT/zMArUZGs=; b=fuqAUf95mSE2amoOlvvTKI6npqzHCRVQqrhekqhLJRC9A3TluitqCiULaZ5OjUBgW5 gC4ET1DtdwKXCdLH3e1h6zFUv/O3t8OLW/88w6rWN8bfIE2oJnMg6lbROU3ECOetP94W 0+8AlDoBetUJBvrObP/YdXyJRKdSegbUtw/uX8vikiVe1Y487okK8egDknQNBnm2Hc9q 8XL20179A2vB0it8gHUlU/jTB10WK7EvYtVl5HR6Du/wmM623fLvmd9I4YbAbfdVUbnR rA1AgcRe2hoOypQB0yKpiQ6L8yjVo2e4JipE56anKqVXggBTXH+bgtJ2TEVb5hOOjkqK 0zWQ== X-Gm-Message-State: APjAAAWPSfbNlXL5V2LOAj7lIEjo5HSIJnileKHx9uFN3gxBVVRSIvZ6 BZtcSmInfW866eUKoiG8CCC1aBWQA2S/9rD9S2qu6MOHgUiQvyR8K/PLiqjwbmHNnh9iOlDW1V7 Ig0uOBbjEheUGtbn3W8w= X-Received: by 2002:a67:f315:: with SMTP id p21mr6704051vsf.39.1581345752667; Mon, 10 Feb 2020 06:42:32 -0800 (PST) X-Google-Smtp-Source: APXvYqzv46gXZmqV6XA2UYXQr6GWegDtOIVXgosTpBDKVNjae1QJGSMQmxDQ0BORW51MpWGTky8W0PKCu1Qy6MTnhUo= X-Received: by 2002:a67:f315:: with SMTP id p21mr6704017vsf.39.1581345752277; Mon, 10 Feb 2020 06:42:32 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: David Marchand Date: Mon, 10 Feb 2020 15:42:21 +0100 Message-ID: To: "Van Haaren, Harry" Cc: Aaron Conole , dev X-MC-Unique: NqZxp3JlOmyIRD2W79zZ0A-1 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-dev] [RFC] service: stop lcore threads before 'finalize' X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Mon, Feb 10, 2020 at 3:16 PM Van Haaren, Harry wrote: > I haven't easily reproduced this yet - so I'll investigate a way to > reproduce with close to 100% rate, then we can identify the root cause > and actually get a clean fix. If you have pointers to reproduce easily, > please let me know. - In shell #1: $ git reset --hard v20.02-rc2 HEAD is now at 2636c2a23 version: 20.02-rc2 $ rm -rf build $ git diff diff --git a/app/test/meson.build b/app/test/meson.build index 3675ffb5c..23c00a618 100644 --- a/app/test/meson.build +++ b/app/test/meson.build @@ -400,7 +400,7 @@ timeout_seconds =3D 600 timeout_seconds_fast =3D 10 get_coremask =3D find_program('get-coremask.sh') -num_cores_arg =3D '-l ' + run_command(get_coremask).stdout().strip() +num_cores_arg =3D '-l 0,1' test_args =3D [num_cores_arg] foreach arg : fast_test_names $ meson --werror --buildtype=3Ddebugoptimized build The Meson build system Version: 0.47.2 Source dir: /home/dmarchan/dpdk Build dir: /home/dmarchan/dpdk/build Build type: native build Program cat found: YES (/usr/bin/cat) Project name: DPDK Project version: 20.02.0-rc2 ... $ ninja-build -C build ninja: Entering directory `build' [2081/2081] Linking target app/test/dpdk-test. $ taskset -pc 1 $$ pid 11143's current affinity list: 0-7 pid 11143's new affinity list: 1 $ while true; do true; done - Now, in shell #2, as root: # taskset -pc 0,1 $$ pid 22233's current affinity list: 0-7 pid 22233's new affinity list: 0,1 # meson test --gdb --repeat=3D10000 service_autotest ... + ------------------------------------------------------- + + Test Suite Summary + Tests Total : 16 + Tests Skipped : 3 + Tests Executed : 16 + Tests Unsupported: 0 + Tests Passed : 13 + Tests Failed : 0 + ------------------------------------------------------- + Test OK RTE>> Program received signal SIGSEGV, Segmentation fault. [Switching to Thread 0x7ffff4922700 (LWP 31194)] rte_service_runner_func (arg=3D) at ../lib/librte_eal/common/rte_service.c:453 453 cs->loops++; A debugging session is active. Inferior 1 [process 31187] will be killed. Quit anyway? (y or n) I get the crash in like 30s, often less. In my test right now, I got the crash on the 3rd try. --=20 David Marchand