From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 81B3AA0573; Thu, 5 Mar 2020 04:41:13 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 754B82BB8; Thu, 5 Mar 2020 04:41:12 +0100 (CET) Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2053.outbound.protection.outlook.com [40.107.21.53]) by dpdk.org (Postfix) with ESMTP id 25AF4FEB for ; Thu, 5 Mar 2020 04:41:11 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=XiwRenLhDSkVf4MDPr97/vRxxoO6Y+KHgXDjK3bicE4=; b=kFxiznhoPM9IXKMHLMTSb/ohr3q8zNiroZ7pwVMtNTnn2fjnsKEgHAfWFfrobeaLBZQRxCRf5pWUltIJLrSN1RH6/t9H4iftHIpNP1eH/QFPdcMr/BI6Zsb98+R006npQyNCu7sAv3ll6VkRGVuKvNKtSwVG1HKNXCSebKLrbrY= Received: from AM5PR0701CA0056.eurprd07.prod.outlook.com (2603:10a6:203:2::18) by VI1PR08MB5502.eurprd08.prod.outlook.com (2603:10a6:803:12f::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2750.21; Thu, 5 Mar 2020 03:41:09 +0000 Received: from VE1EUR03FT053.eop-EUR03.prod.protection.outlook.com (2603:10a6:203:2:cafe::ca) by AM5PR0701CA0056.outlook.office365.com (2603:10a6:203:2::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2793.9 via Frontend Transport; Thu, 5 Mar 2020 03:41:09 +0000 Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by VE1EUR03FT053.mail.protection.outlook.com (10.152.19.198) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2793.11 via Frontend Transport; Thu, 5 Mar 2020 03:41:09 +0000 Received: ("Tessian outbound d1ceabc7047e:v42"); Thu, 05 Mar 2020 03:41:08 +0000 X-CR-MTA-TID: 64aa7808 Received: from 9951d70cd49a.2 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 20AF3714-8C46-4C00-89CB-D950F5C9FC71.1; Thu, 05 Mar 2020 03:41:03 +0000 Received: from EUR02-VE1-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 9951d70cd49a.2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Thu, 05 Mar 2020 03:41:03 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=afBpgZSM+nv9CyCHsicn71xzPyhu/QsHm+c9EiefMEfkgTIuoFKnmqhOL7AhcHZAzWBxaKlI7s1/TNEEJSY1QUiSL1k8/+/koJV1vDmzJROj18WD/XOouLsKHkIeTsZdDP5zc7Y6BK2PvQ8BopXmMbyliqLyVym0xQw471/gu+bU8K/C0qTpiWcxUTAB3Kwx7bHAc0qPL9OvZhZhG8SB5YIRAWmRDoocEvzSeYjtjh9HCmxNohLDM5GXhttlYwIrSRqz8wHDWBBuv0nQz65Hsya7UOuP86St4fJ2vGXkf+GDdzzSVs/s1TjirN63RmX8lT9S0nG+wqYuiuQr+6afyg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=XiwRenLhDSkVf4MDPr97/vRxxoO6Y+KHgXDjK3bicE4=; b=TTu8gczs/puVrztOf+lNLBTaiPG10dssWtXuivoUYM2950b1569RdFPGmjdLlYySXiY1mesSf9TjsO2cYJKow/HL17Y0Qd2h+F6LeHHURIe2shbpJGqjtVSrjjJW1GS83bZlj0NhZtXZW0DkJ3lJ7hP/iuIQubufpvraQsbSxr0ho7PJcJSLk12TlZCPHBeWiRC/iIEGrtLvg6Uhvt2OLqUmZP/OPXinQQv5I0JhG8saPaCH9PcC4ycu3w9O3HqUnXcf6eR4F8M11nbpZWTFvRqODpzuwcgk8ePoGY4uxQNhSC3oDzPSjfB+XlYaw4u4EPN62P4BuaGa3BV2Mbg/Uw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=XiwRenLhDSkVf4MDPr97/vRxxoO6Y+KHgXDjK3bicE4=; b=kFxiznhoPM9IXKMHLMTSb/ohr3q8zNiroZ7pwVMtNTnn2fjnsKEgHAfWFfrobeaLBZQRxCRf5pWUltIJLrSN1RH6/t9H4iftHIpNP1eH/QFPdcMr/BI6Zsb98+R006npQyNCu7sAv3ll6VkRGVuKvNKtSwVG1HKNXCSebKLrbrY= Received: from AM0PR08MB3986.eurprd08.prod.outlook.com (20.178.118.90) by AM0PR08MB3409.eurprd08.prod.outlook.com (20.177.43.82) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2772.18; Thu, 5 Mar 2020 03:41:01 +0000 Received: from AM0PR08MB3986.eurprd08.prod.outlook.com ([fe80::7cbc:dcc5:f3da:ac56]) by AM0PR08MB3986.eurprd08.prod.outlook.com ([fe80::7cbc:dcc5:f3da:ac56%7]) with mapi id 15.20.2750.027; Thu, 5 Mar 2020 03:41:01 +0000 From: Ruifeng Wang To: Aaron Conole CC: "maicolgabriel@hotmail.com" , "bruce.richardson@intel.com" , "dev@dpdk.org" , "david.marchand@redhat.com" , Gavin Hu , Honnappa Nagarahalli , "juraj.linkes@pantheon.tech" , nd , nd Thread-Topic: [PATCH v2 2/2] ci: add test suite run without hugepage Thread-Index: AQHV7e5OO31oaidk8E6Ver6GeJIdEqg4uZ+dgACSjWA= Date: Thu, 5 Mar 2020 03:41:01 +0000 Message-ID: References: <20200225073236.135581-1-ruifeng.wang@arm.com> <20200228041904.195597-1-ruifeng.wang@arm.com> <20200228041904.195597-3-ruifeng.wang@arm.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: 63c31268-626a-4c94-b981-42be3d55cd3e.0 x-checkrecipientchecked: true Authentication-Results-Original: spf=none (sender IP is ) smtp.mailfrom=Ruifeng.Wang@arm.com; x-originating-ip: [113.29.88.7] x-ms-publictraffictype: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: fc59bad0-3535-4fbb-c2cf-08d7c0b70af6 X-MS-TrafficTypeDiagnostic: AM0PR08MB3409:|AM0PR08MB3409:|VI1PR08MB5502: x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: true x-ms-oob-tlc-oobclassifiers: OLM:8882;OLM:8882; x-forefront-prvs: 03333C607F X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(10009020)(4636009)(346002)(376002)(396003)(136003)(366004)(39860400002)(189003)(199004)(26005)(54906003)(33656002)(9686003)(55016002)(52536014)(6506007)(66556008)(76116006)(7696005)(4326008)(71200400001)(2906002)(66476007)(53546011)(186003)(55236004)(5660300002)(66446008)(64756008)(66946007)(478600001)(316002)(45080400002)(81156014)(966005)(86362001)(6916009)(8676002)(81166006)(8936002); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR08MB3409; H:AM0PR08MB3986.eurprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: arm.com does not designate permitted sender hosts) X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: uwscZL5vSXo+x7CCDitFlNFEMdmHjNIsDALmSGkdBLyiWCeKJrrbuTrFhwiVmmsI3orf5aYO7S1S+53EgQzNcamfkQgdt9P1kSTpIfwKwZc8hsJ4MHlPhxYBjjhRcutm2vF2ps6uOvOLHPUuplZYrNRQJtRsn0PXM5TVl3HwSMx6ZE+t9FHIlFNI/00jinjX9u6ebKdiXH3WVniF5IOaiIjgfAFScHB+q3oh4W4k6B36fICTapLLE+2TJxEAJh+wc+MLzj1FhoAd69MU+20Ac2IhU/+yBE0jo9KgsdJ0oXEHsPj4GmT6/ZrfA0sH7Xei7iNyJr+uFFaNDmOSEGHGpxATkauosi7pEc3gdsDhHR4o9wQFxHxd++0Veiqz59PaQLO2F0g4+iy2oobO4NByh1UW8L1HkSunYGXkW7+39YNH+n0SeQQzMgAC0Hnn4xXQNJ9WLLMkja7H/IG4Hgcp0P5TQnaIteUjYyLLyGXmWKZmaqusQedcfbrvHVxDis8Qtf1v4GyHUpWsOPm2f7zjdg== x-ms-exchange-antispam-messagedata: CND/LE6kRbntH1lHrIa3BW9cOpmCykWbmRkTfmT5QUJjgIZg9VS8hiGTgjvy8i9jx+zrrEVQ0PFzg0eTzXRG2ju957T3vhpj3/RpmGp7JDt2ByKcs2KW2ZeI3MgjpaExeYbyz45q/9yQ3wBE2GD+1g== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3409 Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Ruifeng.Wang@arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: VE1EUR03FT053.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; IPV:CAL; SCL:-1; CTRY:IE; EFV:NLI; SFV:NSPM; SFS:(10009020)(4636009)(136003)(346002)(376002)(396003)(39860400002)(199004)(189003)(26005)(45080400002)(336012)(186003)(53546011)(9686003)(26826003)(81156014)(70586007)(478600001)(70206006)(33656002)(6506007)(55016002)(81166006)(966005)(86362001)(52536014)(2906002)(316002)(6862004)(5660300002)(7696005)(4326008)(8676002)(54906003)(8936002)(36906005)(356004); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR08MB5502; H:64aa7808-outbound-1.mta.getcheckrecipient.com; FPR:; SPF:Pass; LANG:en; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; A:1; MX:1; X-MS-Office365-Filtering-Correlation-Id-Prvs: 278f4b9c-5829-438e-e027-08d7c0b7069c X-Forefront-PRVS: 03333C607F X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: hsCj+Ghg0cgg1F91LAxC0yPSN6w2yHQTLSZwQZXYzbaWExoqWjVReWLq9KzCEhb8w300f4v5y9RW0Tia8+K1aOWY9zYJx/wjDK2Lw/TXomVHPGetkYrm7vNp5LmeCftpLfAzZf1Xs9j3pUhliS2tcOYOjKcrNJ8fNymSF3MrOgK53g/u0awyM1YP3zO+o//ek6EIfOVYj363UsOPED5kHU3QbTTxhCPh1W87fHB6WoClIGUMsszKJobNRMWwjRgbQWutB3G6qicEGFnuPJ8AYr98gM6m7V9HDYNDr/JM9vfHYqACTJHS6vTTD8tXF4jnVEyuDc6rcucrEvhdIp9IgAvH6A3v5tAEn3Q14m+ahwGMsdSVK52F4ev3pYoGy5DsY8DjoOIbtoaqZia2nGtwZcG9n4iX1ryWDYoYTut3/TXUCoUa/zvqurDQMO2bUdUFTW3h5pVMae//9TjFUFwbErGQ2cJBhVeBJuIWiwwZ+YauNGAhk/oZwOSoiphPInpMCz+QUxgrAVzrsid2UOOA4Q== X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 05 Mar 2020 03:41:09.0673 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: fc59bad0-3535-4fbb-c2cf-08d7c0b70af6 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR08MB5502 Subject: Re: [dpdk-dev] [PATCH v2 2/2] ci: add test suite run without hugepage X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" > -----Original Message----- > From: Aaron Conole > Sent: Thursday, March 5, 2020 01:31 > To: Ruifeng Wang > Cc: maicolgabriel@hotmail.com; bruce.richardson@intel.com; dev@dpdk.org; > david.marchand@redhat.com; Gavin Hu ; Honnappa > Nagarahalli ; juraj.linkes@pantheon.tech; > nd > Subject: Re: [PATCH v2 2/2] ci: add test suite run without hugepage >=20 > Ruifeng Wang writes: >=20 > > This test suite is derived from fast-tests suite. Cases in this suite > > are run with '--no-huge' flag. > > > > The suite aims to cover as many as possible test cases out of the > > fast-tests suites in the environments without huge pages support, like > > containers. > > > > Signed-off-by: Ruifeng Wang > > Reviewed-by: Gavin Hu > > --- >=20 > I like this much more. Few comments. >=20 > > .travis.yml | 10 +++++-- > > app/test/meson.build | 71 > > ++++++++++++++++++++++++++++++++++++++++++++ >=20 > You should update doc/guides/prog_guide/meson_ut.rst to include some > detail about the new tests suite. >=20 Thanks. Will update document in next version. > > 2 files changed, 79 insertions(+), 2 deletions(-) > > > > diff --git a/.travis.yml b/.travis.yml index b64a81bd0..eed1d96db > > 100644 > > --- a/.travis.yml > > +++ b/.travis.yml > > @@ -40,7 +40,7 @@ jobs: > > - env: DEF_LIB=3D"static" > > arch: amd64 > > compiler: gcc > > - - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 > > + - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 TEST_SUITES=3D"fast-tests > nohuge-tests" > > arch: amd64 > > compiler: gcc > > - env: DEF_LIB=3D"shared" BUILD_DOCS=3D1 @@ -63,7 +63,7 @@ jobs: > > - env: DEF_LIB=3D"static" > > arch: amd64 > > compiler: clang > > - - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 > > + - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 TEST_SUITES=3D"fast-tests > nohuge-tests" > > arch: amd64 > > compiler: clang > > - env: DEF_LIB=3D"shared" BUILD_DOCS=3D1 @@ -101,6 +101,9 @@ jobs: > > - env: DEF_LIB=3D"static" > > arch: arm64 > > compiler: gcc > > + - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 TEST_SUITES=3D"nohuge-tests" > > + arch: arm64 > > + compiler: gcc > > - env: DEF_LIB=3D"shared" BUILD_DOCS=3D1 > > arch: arm64 > > compiler: gcc > > @@ -124,3 +127,6 @@ jobs: > > - env: DEF_LIB=3D"shared" > > arch: arm64 > > compiler: clang > > + - env: DEF_LIB=3D"shared" RUN_TESTS=3D1 TEST_SUITES=3D"nohuge-tests" > > + arch: arm64 > > + compiler: clang > > diff --git a/app/test/meson.build b/app/test/meson.build index > > 0a2ce710f..162a1a76f 100644 > > --- a/app/test/meson.build > > +++ b/app/test/meson.build > > @@ -237,6 +237,60 @@ fast_test_names =3D [ > > 'thash_autotest', > > ] >=20 > Shouldn't we also trim the list of fast-tests? Otherwise, these tests wi= ll run > twice. >=20 I think you mean to have exclusive lists for fast-tests and nohuge-tests. Overlapped cases will run twice if both test suites are opted in. But the two runs are not the same, one runs with hugepage and=20 the other runs in no-huge mode. If fast-tests list is splited, we will need to always run multiple suites to cover all fast tests. We can keep x86 to run only fast-tests suite to avoid extra test runs if they are not necessary. Thoughts? > ex: https://travis-ci.com/ovsrobot/dpdk/jobs/292037684 >=20 > > +nohuge_test_names =3D [ > > + 'byteorder_autotest', > > + 'cmdline_autotest', > > + 'common_autotest', > > + 'cpuflags_autotest', > > + 'cycles_autotest', > > + 'debug_autotest', > > + 'eal_flags_n_opt_autotest', > > + 'eal_flags_no_huge_autotest', > > + 'eal_flags_vdev_opt_autotest', > > + 'eal_fs_autotest', > > + 'errno_autotest', > > + 'event_ring_autotest', > > + 'fib_autotest', > > + 'fib6_autotest', > > + 'interrupt_autotest', > > + 'logs_autotest', > > + 'lpm_autotest', > > + 'lpm6_autotest', > > + 'memcpy_autotest', > > + 'meter_autotest', > > + 'per_lcore_autotest', > > + 'prefetch_autotest', > > + 'rcu_qsbr_autotest', > > + 'red_autotest', > > + 'rib_autotest', > > + 'rib6_autotest', > > + 'ring_autotest', > > + 'rwlock_rda_autotest', > > + 'rwlock_rds_wrm_autotest', > > + 'rwlock_rde_wro_autotest', > > + 'sched_autotest', > > + 'spinlock_autotest', > > + 'string_autotest', > > + 'tailq_autotest', > > + 'user_delay_us', > > + 'version_autotest', > > + 'crc_autotest', > > + 'delay_us_sleep_autotest', > > + 'eventdev_common_autotest', > > + 'fbarray_autotest', > > + 'ipsec_autotest', > > + 'kni_autotest', > > + 'kvargs_autotest', > > + 'member_autotest', > > + 'metrics_autotest', > > + 'power_cpufreq_autotest', > > + 'power_autotest', > > + 'power_kvm_vm_autotest', > > + 'reorder_autotest', > > + 'service_autotest', > > + 'thash_autotest', > > +] > > + > > perf_test_names =3D [ > > 'ring_perf_autotest', > > 'mempool_perf_autotest', > > @@ -341,6 +395,10 @@ if dpdk_conf.has('RTE_LIBRTE_RING_PMD') > > fast_test_names +=3D 'latencystats_autotest' > > driver_test_names +=3D 'link_bonding_mode4_autotest' > > fast_test_names +=3D 'pdump_autotest' > > + nohuge_test_names +=3D 'ring_pmd_autotest' > > + nohuge_test_names +=3D 'bitratestats_autotest' > > + nohuge_test_names +=3D 'latencystats_autotest' > > + nohuge_test_names +=3D 'pdump_autotest' > > endif > > > > if dpdk_conf.has('RTE_LIBRTE_POWER') > > @@ -430,6 +488,19 @@ foreach arg : fast_test_names > > endif > > endforeach > > > > +foreach arg : nohuge_test_names > > + if host_machine.system() =3D=3D 'linux' > > + test(arg, dpdk_test, > > + env : ['DPDK_TEST=3D' + arg], > > + args : test_args + > > + ['--no-huge'] + ['-m 1024'] + > > + ['--file-prefix=3D@0@'.format(arg)], > > + timeout : timeout_seconds_fast, > > + is_parallel : false, > > + suite : 'nohuge-tests') > > + endif > > +endforeach > > + > > foreach arg : perf_test_names > > test(arg, dpdk_test, > > env : ['DPDK_TEST=3D' + arg],