From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6CAB2A0543; Wed, 15 Jul 2020 22:26:41 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 105CE3421; Wed, 15 Jul 2020 22:26:40 +0200 (CEST) Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-eopbgr10082.outbound.protection.outlook.com [40.107.1.82]) by dpdk.org (Postfix) with ESMTP id 698FB2C58 for ; Wed, 15 Jul 2020 22:26:38 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tGoW1Cgy55zOm8qo2hEY33MM9sMYw/ObFb33mzZy1R8=; b=StdfRsriJzaLrk+WZ8wN0/EI6Uu8Z8qlsvuQBrL19uRxZnRtiYhup7+CzzCVTX7MdK7iGeOYqXByAu+CEmg3BkfMMdlwUMy2o9/OJEGcnO+ZCzW7U7xK4CjXqhiDWsbNQ1hFHdxYxU++Z5gjGSaQdEdT3aLMjqgaOYzph0hGOKY= Received: from AM5PR04CA0024.eurprd04.prod.outlook.com (2603:10a6:206:1::37) by DB6PR0802MB2341.eurprd08.prod.outlook.com (2603:10a6:4:89::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3174.21; Wed, 15 Jul 2020 20:26:36 +0000 Received: from AM5EUR03FT033.eop-EUR03.prod.protection.outlook.com (2603:10a6:206:1:cafe::f9) by AM5PR04CA0024.outlook.office365.com (2603:10a6:206:1::37) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3195.17 via Frontend Transport; Wed, 15 Jul 2020 20:26:36 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by AM5EUR03FT033.mail.protection.outlook.com (10.152.16.99) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3195.18 via Frontend Transport; Wed, 15 Jul 2020 20:26:36 +0000 Received: ("Tessian outbound 73b502bf693a:v62"); Wed, 15 Jul 2020 20:26:36 +0000 X-CR-MTA-TID: 64aa7808 Received: from 5af240ade4a0.3 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 87328580-EFB6-4174-BD8E-56F10E454A08.1; Wed, 15 Jul 2020 20:26:31 +0000 Received: from EUR05-AM6-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 5af240ade4a0.3 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Wed, 15 Jul 2020 20:26:31 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oX8WTRIl9Mnuzte5FluoT7Ht613EunaQAxHbMRmidCqemBXYp7HFVn7u1VtTRqq4d76TaUjtV0hgXKHkXdYHRNUt0sOkvJPG6paGgIZtkZSbEloGLRIx/zBcAmGnvnbk/Rf0DK79RNaxfELNN2Th8IIXCnXR3V6MGf0VB92qI2il1JfsvpLD+TOlft3lRI+9Aa8WM3VYwxbvuig0uc7zwEndDwDK9mh89xfsqqZTcJRes2WyPGW3Aynsr6G4O5Kv6je0BTJaojIKbxT12c6f1bXB9sUztvLv9Vob5K2G6iygYabmgezEz5lyyjzWNg1DxD44zGWXuXajFE2CSYo3fg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tGoW1Cgy55zOm8qo2hEY33MM9sMYw/ObFb33mzZy1R8=; b=TH/baW84SVPtG97a6GWDX2p6ISpAIMx/BDAwyGffITKMzKNLRkkdTYMlo1NGFzo3RSk/mzXZdczpONaC7QwnqAipUhcCY+nhH2JwAUaNOMS2Qf9W66PCzB9u94f344j5jCI+6TQ+f2qQAnklAGUqD02/Biso5P9Kk8J/U/BHLHnponnUPhuLknO0CrqDRfZBQo1up0KySC3ZYu6HNrYCMZoibxe/3GAka6yS7CLZ6ehuKTI8i2HSg82r1Y8UsVJiwu1mNoM1PtWf+ReoxJNoMTo7kECsG2niix0kWRT8Ozfom2YlrSxbpAA+3zPqBUuQW3ACWBtGLeoxaRRpELLS6A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tGoW1Cgy55zOm8qo2hEY33MM9sMYw/ObFb33mzZy1R8=; b=StdfRsriJzaLrk+WZ8wN0/EI6Uu8Z8qlsvuQBrL19uRxZnRtiYhup7+CzzCVTX7MdK7iGeOYqXByAu+CEmg3BkfMMdlwUMy2o9/OJEGcnO+ZCzW7U7xK4CjXqhiDWsbNQ1hFHdxYxU++Z5gjGSaQdEdT3aLMjqgaOYzph0hGOKY= Received: from DB6PR0802MB2216.eurprd08.prod.outlook.com (2603:10a6:4:85::9) by DB7PR08MB3625.eurprd08.prod.outlook.com (2603:10a6:10:42::13) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3195.18; Wed, 15 Jul 2020 20:26:28 +0000 Received: from DB6PR0802MB2216.eurprd08.prod.outlook.com ([fe80::9d1d:207b:e89d:199d]) by DB6PR0802MB2216.eurprd08.prod.outlook.com ([fe80::9d1d:207b:e89d:199d%10]) with mapi id 15.20.3174.026; Wed, 15 Jul 2020 20:26:28 +0000 From: Honnappa Nagarahalli To: Aaron Conole , David Marchand CC: Lukasz Wojciechowski , Van Haaren Harry , Igor Romanov , Phil Yang , dev , nd , Honnappa Nagarahalli , nd Thread-Topic: Random failure in service_autotest Thread-Index: AQHWWpDQU8aq9KGvYUi8tIvIqDewi6kImcLegAABgoCAAAH9AIAABTOAgAADXGGAAHEcoA== Date: Wed, 15 Jul 2020 20:26:28 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: d097da8e-a478-493d-8412-e91ee58056df.0 x-checkrecipientchecked: true Authentication-Results-Original: redhat.com; dkim=none (message not signed) header.d=none;redhat.com; dmarc=none action=none header.from=arm.com; x-originating-ip: [70.112.90.121] x-ms-publictraffictype: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: e71a3949-3e25-4dc8-40f1-08d828fd5f50 x-ms-traffictypediagnostic: DB7PR08MB3625:|DB6PR0802MB2341: x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:8273;OLM:8273; X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: MC48ntZPPu6CBXJYQv5h0hlEWNB1TbGsFHq+wQnOjD3YiiK8Yxl4rIxdI2fBZ728sOjxYiL7z4uhEpftzFhaaB5mk2q50TqlY0B2p0wm840Y5UGznAySeK2NMZDsPwTkaCH/duxK2pQPsegAyRLQpH6xY+S8WOjXNpfLUkw8enXO3nnc2Z2b1tQL/0M/z8fqFJ5cYoLLKzGS7t997TVCkcQNcytSlRMuPRbg1PhXETqiyGQ1PHbN41q5G4s0ETO4ukKERREteBk+qyrVhyYgwuyWllhbQrVy02FBLhet91iq+fu1GCB6PWswnYrb86EL6HA+HCGoDqzFVOSF4AKAuj0OrnGYvsQ+/Nc4aPtfbUKM1RMmEZ22QnnfDyqoQKKIU63YQWacy1T3imyvvHDjRQ== X-Forefront-Antispam-Report-Untrusted: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DB6PR0802MB2216.eurprd08.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(346002)(136003)(376002)(39860400002)(366004)(396003)(33656002)(4326008)(5660300002)(8676002)(8936002)(83380400001)(52536014)(71200400001)(86362001)(478600001)(110136005)(2906002)(66556008)(66476007)(76116006)(66446008)(66946007)(966005)(55016002)(64756008)(53546011)(7696005)(6506007)(186003)(54906003)(26005)(316002)(9686003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: abQ/9f1elYaS7xwcGVKtZrpqbhvX3Xd/fQ0IGVZzHiUcV/6H7mDoEZGZxfps7WuOL+LfO0jo4o9mc1LoOLp49HcL1XRFOBtTdGKf678/2s5PQss0s8LI5Isrdj38vVgI613SIIQmXxndZ5aPWOfH0994QBTMrwKHGtF0NVFfJDYMgUcaLof/1Ht1MHajo4HsWl7F8if1tdN5pUpxscnyKi8JHZACU62Cw8xsw5WUQ0yZpbAuDML6Lf4szAWvR6gVeZ73eyyDZOoguvCwJIQgeBGvWAgykI7SGmH+Ap+0kBZq6DdjCfqh+XsSOQWGhU6tMlsRX0DIJGVqf0WVfTaAVe9Q1pz8OI2Qw6DLdoEO6MO/rMWK6PDkl/JEAWl+fFJ2uncFlq2++tY9nFiXB0b13HIummryQVWyY0uc9snKQ4oe+MYRpJQa6W8Efl1Vi3E0JFvyPvcJg9SWAHntI92f/vKI4/uheyuUQJltngy9v/XfNn48ca6TMgSciRiu3vkV Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB7PR08MB3625 Original-Authentication-Results: redhat.com; dkim=none (message not signed) header.d=none;redhat.com; dmarc=none action=none header.from=arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: AM5EUR03FT033.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; CTRY:IE; LANG:en; SCL:1; SRV:; IPV:CAL; SFV:NSPM; H:64aa7808-outbound-1.mta.getcheckrecipient.com; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; CAT:NONE; SFTY:; SFS:(4636009)(39860400002)(136003)(396003)(376002)(346002)(46966005)(9686003)(186003)(7696005)(54906003)(26005)(4326008)(36906005)(478600001)(316002)(336012)(966005)(83380400001)(81166007)(5660300002)(82740400003)(70586007)(356005)(110136005)(33656002)(8676002)(82310400002)(70206006)(8936002)(53546011)(2906002)(6506007)(47076004)(55016002)(52536014)(86362001); DIR:OUT; SFP:1101; X-MS-Office365-Filtering-Correlation-Id-Prvs: 802eeb6e-40ce-4c24-7cf4-08d828fd5ab8 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: yOtYxpNfSJBje77CoFkfSpPdLEAdiy/1dYiG3l1SF2X5vOB9OcDDP5cW+AuQMN+ivgS/jjB4NxdqYnMwBCSwHKE8YuKRoHd/PZh3c6eup5UWXNaPT6AdUkGjdjNSJseCbv83Edi6DsUcsobUXTCNFk+6wCzV+tFKrpINUe3Wp9Q64NzdYCB2nI/0eZBoFIswzgqQUr0VZMYvIixouvb+lgyqd0pYuMd4w/hBhmfzjFOhFIgYBS5MIpAIQ3N7/dfpz7AOUkRivH5NdJ/1YZcouxgIDdiNBvtqceI6IvN06wSwnwwnGbn3YgEI23S7Y1GYR2+XzFgh546a2iupY9fjajAjs4kfFGeNcbTl73cNywMBJI5GFTrt5OuDGhTqlVF/uHZw3uju3ThPj9Dzc+KPU8T1HUFC8hbtO3EdMmO/iwyP1rjBWyBJooSAU5JIQ054R6VeAqxuOVwb/EmBf8RO+GGv9KSZDy+F4JU1ilwhfw0= X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Jul 2020 20:26:36.3317 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: e71a3949-3e25-4dc8-40f1-08d828fd5f50 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-AuthSource: AM5EUR03FT033.eop-EUR03.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB6PR0802MB2341 Subject: Re: [dpdk-dev] Random failure in service_autotest X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" > Subject: Re: Random failure in service_autotest >=20 > David Marchand writes: >=20 > > On Wed, Jul 15, 2020 at 3:09 PM Lukasz Wojciechowski > > wrote: > >> > >> > >> W dniu 15.07.2020 o 15:02, David Marchand pisze: > >> > On Wed, Jul 15, 2020 at 2:56 PM Aaron Conole > wrote: > >> >> I guess the service_lcore_attr_get failed, but with no useful > >> Why do you suspect service_lcore_attr_get() ? > > > > https://travis-ci.com/github/ovsrobot/dpdk/jobs/361097992#L18697 > > > > RTE>>service_autotest > > + ------------------------------------------------------- + + Test > > Suite : service core test suite + > > ------------------------------------------------------- + + TestCase > > [ 0] : unregister_all succeeded + TestCase [ 1] : service_name > > succeeded + TestCase [ 2] : service_get_by_name succeeded Service > > dummy_service Summary > > dummy_service: stats 1 calls 0 cycles 0 avg: 0 Service dummy_service > > Summary > > dummy_service: stats 0 calls 0 cycles 0 avg: 0 + TestCase [ 3] : > > service_dump succeeded + TestCase [ 4] : service_attr_get succeeded > > > > *** > > + TestCase [ 5] : service_lcore_attr_get failed > > *** > > > > + TestCase [ 6] : service_probe_capability succeeded + TestCase [ 7] > > : service_start_stop succeeded + TestCase [ 8] : > > service_lcore_add_del skipped + TestCase [ 9] : > > service_lcore_start_stop succeeded + TestCase [10] : > > service_lcore_en_dis_able succeeded + TestCase [11] : > > service_mt_unsafe_poll skipped + TestCase [12] : service_mt_safe_poll > > skipped perf test for MT Safe: 56.9 cycles per call + TestCase [13] : > > service_app_lcore_mt_safe succeeded perf test for MT Unsafe: 83.4 > > cycles per call + TestCase [14] : service_app_lcore_mt_unsafe > > succeeded + TestCase [15] : service_may_be_active succeeded + > > TestCase [16] : service_active_two_cores skipped + > > ------------------------------------------------------- + > > > > > >> >> information. We should have the test suite app turn the log level > >> >> all the way up. I realize it will increase the log data even > >> >> higher, but without it, we have no idea why this test failed. > >> >> > >> >> Something like the following > >> >> --- > >> >> > >> >> diff --git a/app/test/test.c b/app/test/test.c index > >> >> 94d26ab1f6..c47cb075f9 100644 > >> >> --- a/app/test/test.c > >> >> +++ b/app/test/test.c > >> >> @@ -150,6 +150,9 @@ main(int argc, char **argv) > >> >> > >> >> prgname =3D argv[0]; > >> >> > >> >> + rte_log_set_global_level(RTE_LOG_DEBUG); > >> >> + rte_log_set_level(RTE_LOGTYPE_EAL, RTE_LOG_DEBUG); > >> >> + > >> >> recursive_call =3D getenv(RECURSIVE_ENV_VAR); > >> >> if (recursive_call !=3D NULL) { > >> >> ret =3D do_recursive_call(); > >> >> --- > >> >> > >> >> That way we can at least debug when it happens. > >> > Debugging is one thing. > >> > But here service_lcore_attr_get() has a lot of asserts that should > >> > trigger a straight error. > >> > > >> Yes, but without debugs enabled, the assert message won't be printed o= ut. > > > > Changing the whole debug levels could have side effects on the > > libraries being tested: maybe hide races (too bad) or reveal races > > (that would be interesting ;-)). >=20 > 6 of one, 1/2 dozen of the other. >=20 > Maybe there are bugs where people run code inside log level tests that ge= t > omitted otherwise. >=20 > > On the other hand, what I am saying is that using debug level logs for > > test asserts might not be the best solution. Agree, at least error level is required. Please check: https://patches.dpdk.org/patch/74134/ >=20 > Yeah, that's also a good idea :)