From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50049.outbound.protection.outlook.com [40.107.5.49]) by dpdk.org (Postfix) with ESMTP id B50B337AC for ; Fri, 4 May 2018 12:12:32 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=yFo1LFQ20vUSHYlF7iYw86zjT6ynI7oX3tpdfITrjhs=; b=qilM/7hNfUB+aGNKRScqlkaqZlQ7pBCmyg7oD0WfsiMjH1vi28IZoln1qpfgj/qg8Ha/fLnQRRb+OIA1xy43Xzq4zWyoplcuKPLkhGHatp64UrZMMdFNAr3l3MK7dMrIUlrLqex0PK6z3uwYblslMIlMeLV2I9yu0+cSuLhgJDM= Received: from HE1PR0501MB2314.eurprd05.prod.outlook.com (10.168.34.19) by HE1PR0501MB2620.eurprd05.prod.outlook.com (10.172.130.138) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.715.23; Fri, 4 May 2018 10:12:30 +0000 Received: from HE1PR0501MB2314.eurprd05.prod.outlook.com ([fe80::d405:aec8:cd2f:85cc]) by HE1PR0501MB2314.eurprd05.prod.outlook.com ([fe80::d405:aec8:cd2f:85cc%18]) with mapi id 15.20.0715.024; Fri, 4 May 2018 10:12:30 +0000 From: Ophir Munk To: "dev@dpdk.org" , "jianfeng.tan@intel.com" , "shreyansh.jain@nxp.com" CC: Ferruh Yigit , Thomas Monjalon , Olga Shern , Shahaf Shuler Thread-Topic: testpmd crashes on startup Thread-Index: AdPjiZm2NScX+3DhRoCiwxmcWS3OqQABjdaA Date: Fri, 4 May 2018 10:12:29 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=ophirmu@mellanox.com; x-originating-ip: [93.172.127.40] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; HE1PR0501MB2620; 7:2HCh/b+t80SUImFwjQ+zE4cCI8SlURk5Yz1aHV1OXGzN8Btmmaum9qLH5P3Zgy5ijdmRJqGFATGtHp3YmLkLRI97ixuoxhpxQx/32GAbl5Xq2MajHcJzssBC3yKk9Qy+2+fCjHU4XcKR3/kldY6nTS0O/Y874k7XGcnixsTzp+AasNR6hJOfjXzE92y4N0Zg5z36pc95wEWVa0plaY/o/xf2Fj1WTtjEen2BdwRJFBvgHGOROSA/X4GHG46XQWn4 x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(5600026)(48565401081)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603328)(7153060)(7193020); SRVR:HE1PR0501MB2620; x-ms-traffictypediagnostic: HE1PR0501MB2620: x-ld-processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(20558992708506)(185117386973197)(228905959029699); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(5005006)(8121501046)(93006095)(93001095)(3231254)(944501410)(52105095)(10201501046)(3002001)(6055026)(6041310)(20161123558120)(20161123562045)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(6072148)(201708071742011); SRVR:HE1PR0501MB2620; BCL:0; PCL:0; RULEID:; SRVR:HE1PR0501MB2620; x-forefront-prvs: 06628F7CA4 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(39380400002)(376002)(396003)(39860400002)(346002)(13464003)(199004)(189003)(8656006)(6436002)(3846002)(68736007)(6116002)(2900100001)(186003)(9686003)(55016002)(86362001)(6246003)(107886003)(4326008)(33656002)(3280700002)(7736002)(478600001)(2201001)(305945005)(106356001)(26005)(316002)(110136005)(54906003)(5250100002)(53936002)(6506007)(53546011)(2940100002)(97736004)(99286004)(2906002)(3480700004)(8936002)(76176011)(5660300001)(25786009)(446003)(7696005)(229853002)(486006)(66066001)(8676002)(14454004)(102836004)(105586002)(3660700001)(74316002)(81156014)(81166006)(11346002)(2501003)(476003); DIR:OUT; SFP:1101; SCL:1; SRVR:HE1PR0501MB2620; H:HE1PR0501MB2314.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: LJaciQv2VBIvEbRQ/vs5Jd8MwRAHa6xYgUVRVTsxhIi+b0qlCKp5/9Y2cvYW9Ez+efk1slCr4IgSxwXCvu1vp0+27rWZJJcUGduYdqH17UDrLGKU5ohWqxHWJDJU52T9uv5jsqJFGa3ga6mKPNvfkzcLScnYDHB1HXT6TIPyzdVLKYlmSXNdFNEdKsPj57gZ spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Office365-Filtering-Correlation-Id: 07a9b9d9-8d88-4f3f-ceb8-08d5b1a78b83 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 07a9b9d9-8d88-4f3f-ceb8-08d5b1a78b83 X-MS-Exchange-CrossTenant-originalarrivaltime: 04 May 2018 10:12:29.9556 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR0501MB2620 Subject: Re: [dpdk-dev] testpmd crashes on startup X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 May 2018 10:12:33 -0000 The error printed with the crash: *** Error in `/download/dpdk/x86_64-native-linuxapp-gcc/build/app/test-pmd/= testpmd': corrupted double-linked list: 0x00000000010f1200 *** > -----Original Message----- > From: Ophir Munk > Sent: Friday, May 04, 2018 12:38 PM > To: dev@dpdk.org; jianfeng.tan@intel.com; shreyansh.jain@nxp.com > Cc: Ferruh Yigit ; Thomas Monjalon > ; Olga Shern ; Shahaf > Shuler > Subject: testpmd crashes on startup >=20 > Hi Jianfeng, >=20 > Following commit 3d09a6e26d ("eal: fix threads block on barrier") I am > seeing testpmd crashes on startups. > The crashes occur 10% of the time with a regular compilation: >=20 > make install T=3Dx86_64-native-linuxapp-gcc >=20 > and 70% of the time when using "-g" and "-o0" flags: >=20 > make install T=3Dx86_64-native-linuxapp-gcc EXTRA_CFLAGS+=3D-g > EXTRA_CFLAGS+=3D-O0 >=20 > config/common_base: > CONFIG_RTE_LIBRTE_MLX4_PMD=3Dy >=20 > I am running with an mlx4 Mellanox NIC on an Azure VM. >=20 > Please note the crash back trace in [1]. >=20 > Have you witnessed similar reports? > I can provide more details if needed. >=20 > [1] > Thread 1 "testpmd" received signal SIGABRT, Aborted. > 0x00007ffff6ae4428 in=A0GI_raise (sig=3Dsig@entry=3D6) at > ../sysdeps/unix/sysv/linux/raise.c:54 > 54 ../sysdeps/unix/sysv/linux/raise.c: No such file or directory. > (gdb) bt > #0 0x00007ffff6ae4428 in __GI_raise (sig=3Dsig@entry=3D6) at > ../sysdeps/unix/sysv/linux/raise.c:54 > #1 0x00007ffff6ae602a in __GI_abort () at abort.c:89 > #2 0x00007ffff6b267ea in __libc_message (do_abort=3Ddo_abort@entry=3D2, > fmt=3Dfmt@entry=3D0x7ffff6c3fed8 "*** Error in `%s': %s: 0x%s ***\n") at > ../sysdeps/posix/libc_fatal.c:175 > #3=A00x00007ffff6b2d6ed in malloc_printerr (ar_ptr=3D0x7ffff6e73b20 > , ptr=3D, str=3D0x7ffff6c3cc92 "corrupted doub= le- > linked list", action=3D) at malloc.c:5006 > #4 malloc_consolidate (av=3Dav@entry=3D0x7ffff6e73b20 ) at > malloc.c:4183 > #5=A00x00007ffff6b30cde in _int_malloc (av=3Dav@entry=3D0x7ffff6e73b20 > , bytes=3Dbytes@entry=3D1968) at malloc.c:3450 > #6=A00x00007ffff6b33184 in __GI_libc_malloc (bytes=3D1968) at malloc.c:29= 13 > #7=A00x000000000057a939 in pci_scan_one (dirname=3D0x7fffffffd120 > "/sys/bus/pci/devices/0002:00:02.0", addr=3D0x7fffffffd100) at ***/dpdk- > branches/drivers/bus/pci/linux/pci.c:226 > #8=A00x000000000057b3d8 in rte_pci_scan () at ***/dpdk- > branches/drivers/bus/pci/linux/pci.c:463 > #9=A00x0000000000554bce in rte_bus_scan () at ***/dpdk- > branches/lib/librte_eal/common/eal_common_bus.c:77 > #10=A00x000000000053e3e8 in rte_eal_init (argc=3D17, argv=3D0x7fffffffe42= 8) at > ***/dpdk-branches/lib/librte_eal/linuxapp/eal/eal.c:783 > #11=A00x0000000000470279 in main (argc=3D17, argv=3D0x7fffffffe428) at > ***/dpdk-branches/app/test-pmd/testpmd.c:2597