From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 7498AA04F3; Thu, 9 Jan 2020 08:00:50 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id EF2731DB99; Thu, 9 Jan 2020 08:00:49 +0100 (CET) Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00046.outbound.protection.outlook.com [40.107.0.46]) by dpdk.org (Postfix) with ESMTP id 4DFE01DB2F for ; Thu, 9 Jan 2020 08:00:48 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FK9TpcvknWuqD1UfqG6FmSOGwIL3PQp0VwX0MrBetIs=; b=a4FOXdJplXSvGBhwUPlulw1sVy8b2xgykvpOwub8YHWSVCsJ+hkyTfMMusdq6Zh9Fzyf0EEaMfuxYuQp/PFO7MYAFuTHyTCUfm5cDYO9jOe6ZsYOErUA93Nwo8J6tK6ZkZL3cpr8V2G+djdpkLkfjtUCPQ/h/Cn+jOXfwDTHBGM= Received: from VI1PR08CA0102.eurprd08.prod.outlook.com (2603:10a6:800:d3::28) by AM0PR08MB3412.eurprd08.prod.outlook.com (2603:10a6:208:dc::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2623.9; Thu, 9 Jan 2020 07:00:44 +0000 Received: from DB5EUR03FT055.eop-EUR03.prod.protection.outlook.com (2a01:111:f400:7e0a::205) by VI1PR08CA0102.outlook.office365.com (2603:10a6:800:d3::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2623.9 via Frontend Transport; Thu, 9 Jan 2020 07:00:44 +0000 Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by DB5EUR03FT055.mail.protection.outlook.com (10.152.21.30) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2602.11 via Frontend Transport; Thu, 9 Jan 2020 07:00:44 +0000 Received: ("Tessian outbound ca1df68f3668:v40"); Thu, 09 Jan 2020 07:00:44 +0000 X-CR-MTA-TID: 64aa7808 Received: from a51b3c45ee16.2 by 64aa7808-outbound-1.mta.getcheckrecipient.com id 04087ABA-6BC6-4FB2-9DD0-4099BEC2BC5E.1; Thu, 09 Jan 2020 07:00:39 +0000 Received: from EUR04-DB3-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id a51b3c45ee16.2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Thu, 09 Jan 2020 07:00:39 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Yd7qkuzaVuVaViuolWUS526ddvhnVuy8VadI4IdgbVYyiIUHD6iOj8wh84MBmudTkpCFgQJ21BAcdPcCNvjTxikHlvSIr1VbJjf/ECokwa5fzjSfFmghqx9qTC2fglfWRne0RL81CiQmhkbhsDdS6GPrVXDQxy/GxVLvTHBM1UfM6mS3yZPrcHkJQURAdwtD8obsVsQNDD9Ru0/+j04nhkWA0UMaEiQECj9I94yCq/bAsI8AqeqlkYc7t48l9t1gPgXkJlxrrBmEFxrK99JBel17bEaLgwNMy8THOzsfDd86lIY/z+eid7dcMAqvAI/5x5EjNM7/FzrxckiWR9RKlA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FK9TpcvknWuqD1UfqG6FmSOGwIL3PQp0VwX0MrBetIs=; b=KPWK6+2usFRMD2AtH/RoAfdrCHQw/1lhoRFK5NVAKynYLv6FILavk+LkYfw0QgdO0VumIuz4ZJYTlfhn961uEnoi3cOpZBqt1SOhZKEyuRgeh6Pd3J0ExOsVHLinCDz4I46tGRmfibrV+9gWmbbe3+8R2fd3Il9YP8eFStMGVlhoMVjOrzZr4oC5uZqdy3ZUROu0i8HbcaalfUdPo6oAeVTRv9nGh/Gr+hewHU6YTALJJn2LVOgNdbN713bk7fdZE6M9CxUujWEJTsOjGsxLv0RwPMUGHSMkGOBO70e9t90pUGUH5j9fjEjuvXVVJRlDlVGuirVkYRYcp7GOR7FJng== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=FK9TpcvknWuqD1UfqG6FmSOGwIL3PQp0VwX0MrBetIs=; b=a4FOXdJplXSvGBhwUPlulw1sVy8b2xgykvpOwub8YHWSVCsJ+hkyTfMMusdq6Zh9Fzyf0EEaMfuxYuQp/PFO7MYAFuTHyTCUfm5cDYO9jOe6ZsYOErUA93Nwo8J6tK6ZkZL3cpr8V2G+djdpkLkfjtUCPQ/h/Cn+jOXfwDTHBGM= Received: from AM0PR08MB3986.eurprd08.prod.outlook.com (20.178.118.90) by AM0PR08MB3089.eurprd08.prod.outlook.com (52.134.90.144) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2623.10; Thu, 9 Jan 2020 07:00:38 +0000 Received: from AM0PR08MB3986.eurprd08.prod.outlook.com ([fe80::789f:c8b2:1ca9:5541]) by AM0PR08MB3986.eurprd08.prod.outlook.com ([fe80::789f:c8b2:1ca9:5541%5]) with mapi id 15.20.2623.010; Thu, 9 Jan 2020 07:00:38 +0000 From: Ruifeng Wang To: Aaron Conole CC: "maicolgabriel@hotmail.com" , "thomas@monjalon.net" , "ferruh.yigit@intel.com" , "arybchenko@solarflare.com" , "dev@dpdk.org" , "david.marchand@redhat.com" , Gavin Hu , Honnappa Nagarahalli , nd , nd Thread-Topic: [PATCH v3 2/2] ci: add travis ci support for aarch64 Thread-Index: AQHVuV/lOmh7w5te3EaIKEejf8jUfKfduVK6gAEOg3CAAkBTMIAA8PkA Date: Thu, 9 Jan 2020 07:00:37 +0000 Message-ID: References: <20191218053902.193417-1-ruifeng.wang@arm.com> <20191223070833.144628-1-ruifeng.wang@arm.com> <20191223070833.144628-3-ruifeng.wang@arm.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: b51b69ad-0323-48bf-b956-d5d53d45007e.0 x-checkrecipientchecked: true Authentication-Results-Original: spf=none (sender IP is ) smtp.mailfrom=Ruifeng.Wang@arm.com; x-originating-ip: [113.29.88.7] x-ms-publictraffictype: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: a8f2b1b5-4af1-404c-332c-08d794d1a5c7 X-MS-TrafficTypeDiagnostic: AM0PR08MB3089:|AM0PR08MB3089:|AM0PR08MB3412: x-ld-processed: f34e5979-57d9-4aaa-ad4d-b122a662184d,ExtAddr x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: True x-ms-oob-tlc-oobclassifiers: OLM:10000;OLM:10000; x-forefront-prvs: 02778BF158 X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(10009020)(4636009)(366004)(346002)(376002)(396003)(136003)(39860400002)(13464003)(199004)(189003)(6506007)(4326008)(55236004)(53546011)(64756008)(66446008)(8936002)(86362001)(66556008)(66476007)(5660300002)(6916009)(478600001)(2906002)(76116006)(54906003)(45080400002)(71200400001)(26005)(33656002)(316002)(81156014)(7696005)(186003)(66946007)(8676002)(81166006)(9686003)(52536014)(55016002); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR08MB3089; H:AM0PR08MB3986.eurprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: arm.com does not designate permitted sender hosts) X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: xRnMuCps03Z3UTHYBMkPOTQgYtAZuJYmzD2hCooFC+m8EwzTYm7jEXU13yKm4gKEP3a5aJrmX2hlWzBvOLPTFssT7+AhTMtrf2LCEkqO1AbxCvGCp7VV7QSZf7C4jSTffyqBkKUf+5UEwda3D0F5UvdbWE3Te47kTkE7qw2BIrTIaAfcxomXPlV9obFqrz/M3ZAFrHRhNaqDQDAtq2UxkPW6sRqeQQyZo/rTPl8EyICP2ly20T1neu7vVOoJh5DGwqFQmuRqoiAA+zaLetplIghgavcWkgY6d5TkzysJRSFiV1TSy33PH3gaq184ozQGn3nuLs676z6W5m2R1ppNpvgynza/PisUlqg3gm4lC4vO2HBrpK28E2UVVuLVSQJqo/+xbaK8ZqW7+08PlfxF19ODd0Ns7XhWk5+t0B72kkjeBpnahd1ZnDbIRXCtxUNSe7eU5VPd61keSqIiQIqzGBQREO83JZ8ZGvmDkLO1PXnsumszFDpMxkJZfbSCKlQf Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3089 Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Ruifeng.Wang@arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: DB5EUR03FT055.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; IPV:CAL; SCL:-1; CTRY:IE; EFV:NLI; SFV:NSPM; SFS:(10009020)(4636009)(39860400002)(346002)(376002)(136003)(396003)(13464003)(199004)(189003)(478600001)(26826003)(4326008)(6862004)(356004)(45080400002)(9686003)(55016002)(2906002)(52536014)(70206006)(336012)(33656002)(70586007)(6506007)(53546011)(86362001)(26005)(316002)(54906003)(8936002)(186003)(5660300002)(8676002)(81156014)(81166006)(7696005); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR08MB3412; H:64aa7808-outbound-1.mta.getcheckrecipient.com; FPR:; SPF:Pass; LANG:en; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; A:1; MX:1; X-MS-Office365-Filtering-Correlation-Id-Prvs: 43435864-ff7d-4a9d-79bc-08d794d1a1de X-Forefront-PRVS: 02778BF158 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: J6RZWVW0bUUv1O52kF4EVa/jMSXhaOhDQzppvTFrSdXlAeyfU/6vBh6YSXmX1LdGWCF7Ja5XBuUF0ChJonJnvC/IVIyviEBRo1nxhphGHM6GmkRqTbUyHCF5EDPk2XppiEdD18tENbWVsFkz1ZK958CLh0vUSK1o4y+485hxZFf0b79JeEiK2czW1yQVF9b3GDGPEDRXkFMrmnUGzgAjt1t6PIVi3SM0HouvvimehVfRNFX6M8YbzfSe3uyxfigf9GJr3hVfEBfkSBwzfBYADIIZ8FN8HUJqZx+Vm3ej9kaq/Q1H+5FSe+7IHvV1+YbAu/b3aN8sEGIe8PuNfQ+o8Ktrzud+ee8NLGwh3A3EH3cNHUFaQzKQXPWE0qhgkaqDMdSxSdJ42xUrQdT653orTukOL3byzIzOm4PGcYdsOo8qB8H9x0n4mnVyhtpJOpieT1W/bSRNcvhgFiHbsvGbfFL0D6KVZs9ndK9MrWi0PZpIUhpjKv8lpAc1z/ws299X X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 09 Jan 2020 07:00:44.6095 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: a8f2b1b5-4af1-404c-332c-08d794d1a5c7 X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3412 Subject: Re: [dpdk-dev] [PATCH v3 2/2] ci: add travis ci support for aarch64 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" > -----Original Message----- > From: Aaron Conole > Sent: Thursday, January 9, 2020 00:05 > To: Ruifeng Wang > Cc: maicolgabriel@hotmail.com; thomas@monjalon.net; > ferruh.yigit@intel.com; arybchenko@solarflare.com; dev@dpdk.org; > david.marchand@redhat.com; Gavin Hu ; Honnappa > Nagarahalli ; nd > Subject: Re: [PATCH v3 2/2] ci: add travis ci support for aarch64 >=20 > Ruifeng Wang writes: >=20 > >> -----Original Message----- > >> From: Aaron Conole > >> Sent: Monday, January 6, 2020 21:34 > >> To: Ruifeng Wang > >> Cc: maicolgabriel@hotmail.com; thomas@monjalon.net; > >> ferruh.yigit@intel.com; arybchenko@solarflare.com; dev@dpdk.org; > >> david.marchand@redhat.com; Gavin Hu ; > Honnappa > >> Nagarahalli ; nd > >> Subject: Re: [PATCH v3 2/2] ci: add travis ci support for aarch64 > >> > >> Ruifeng Wang writes: > >> > >> > Add Travis compilation jobs for aarch64. gcc/clang compilations for > >> > static/shared libraries are added. > >> > > >> > Some limitations for current aarch64 Travis support: > >> > 1. Container is used. Huge page is not available due to security rea= son. > >> > 2. Missing kernel header package in Xenial distribution. > >> > > >> > Solutions to address the limitations: > >> > 1. Not to add unit test for now. And run tests with no-huge in futur= e. > >> > 2. Use Bionic distribution for all aarch64 jobs. > >> > > >> > Signed-off-by: Ruifeng Wang > >> > Reviewed-by: Gavin Hu > >> > --- > >> > >> Can't we achieve the same thing by setting > >> > >> arch: > >> - amd64 > >> - arm64 > >> > >> in the build matrix? Or will that also force the intel builds to use > >> the container infrastructure (in which case the no-huge support needs = to > be fixed)? > > > > No, container infrastructure will not be imposed to intel builds. > > AFAIN, Travis infrastructure for a specific CPU arch is provided as > > is, and there is no config option to control. > > The problem with just adding 'arch' in build matrix is that RUN_TESTS > > on arm64 is not supported by now (Travis limitation). 'env' with RUN_TE= STS > will fail. >=20 > Okay I see. >=20 > >> > >> One thing I wonder, isn't is possible to use qemu-user to do the > >> amd64 unit tests? Then do we really need some changes to do the nativ= e > build? > > > > Do you mean to use qemu-user to do unit tests for non-x86 arch? >=20 > Yes. This has the advantage of giving users a way to also do the multi-a= rch > checks on their own systems (so a developer with just an x86 could at lea= st > do some testing on arm or ppc). >=20 Yes, users can do multi-arch checks *locally* by using qemu.=20 This patch aims to enable *public* CI for aarch64. It has no sense to rely = on specific arch while infrastructure supports multi arch. > > Changes will be needed as well to enable qemu-user to do unit test. > > Since Travis support multi CPU arch, I think native build and test is s= impler > and more natural. >=20 > I agree, some script changes might be needed, but maybe not as many as > you fear (can't we use binfmt_misc infrastructure to do this with qemu-us= er > and then the actual 'execute' would work). >=20 It is more like a tool for local validation, and should be another story. > >> Does it buy us anything *today* given the cost of the hugepage > restriction? > >> Will that ever be resolved (I didn't see so from the docs on travis)? > > > > The hugepage issue has been reported to Travis. I think it will be > > resolved. But no set dates yet. >=20 > Is there a plan for them to address? I guess probably not. So we either= need > the ability for tests to run in the no-huge environment (and detect that = no > hugepages are available to run the tests that way), or we need the travis > environment supporting hugepages. Is there something I missed? >=20 Yes, over half of quick tests can run in no-huge environment. > >> > >> > .ci/linux-setup.sh | 11 +++++++---- > >> > .travis.yml | 42 > +++++++++++++++++++++++++++++++++++++++++- > >> > 2 files changed, 48 insertions(+), 5 deletions(-) > >> > > >> > diff --git a/.ci/linux-setup.sh b/.ci/linux-setup.sh index > >> > dfb9d4a20..a92978037 100755 > >> > --- a/.ci/linux-setup.sh > >> > +++ b/.ci/linux-setup.sh > >> > @@ -3,7 +3,10 @@ > >> > # need to install as 'root' since some of the unit tests won't run > >> > without it sudo python3 -m pip install --upgrade meson > >> > > >> > -# setup hugepages > >> > -cat /proc/meminfo > >> > -sudo sh -c 'echo 1024 > /proc/sys/vm/nr_hugepages' > >> > -cat /proc/meminfo > >> > +# hugepage settings are skipped on aarch64 due to environment > >> > +limitation if [ "$TRAVIS_ARCH" !=3D "aarch64" ]; then > >> > + # setup hugepages > >> > + cat /proc/meminfo > >> > + sudo sh -c 'echo 1024 > /proc/sys/vm/nr_hugepages' > >> > + cat /proc/meminfo > >> > +fi > >> > diff --git a/.travis.yml b/.travis.yml index 8f90d06f2..980c7605d > >> > 100644 > >> > --- a/.travis.yml > >> > +++ b/.travis.yml > >> > @@ -115,6 +115,46 @@ matrix: > >> > apt: > >> > packages: > >> > - *extra_packages > >> > - > >> > + - env: DEF_LIB=3D"static" > >> > + arch: arm64 > >> > + compiler: gcc > >> > + dist: bionic > >> > + addons: > >> > + apt: > >> > + packages: > >> > + - *required_packages > >> > + - env: DEF_LIB=3D"shared" > >> > + arch: arm64 > >> > + compiler: gcc > >> > + dist: bionic > >> > + addons: > >> > + apt: > >> > + packages: > >> > + - *required_packages > >> > + - env: DEF_LIB=3D"static" > >> > + arch: arm64 > >> > + dist: bionic > >> > + compiler: clang > >> > + addons: > >> > + apt: > >> > + packages: > >> > + - *required_packages > >> > + - env: DEF_LIB=3D"shared" > >> > + arch: arm64 > >> > + dist: bionic > >> > + compiler: clang > >> > + addons: > >> > + apt: > >> > + packages: > >> > + - *required_packages > >> > + - env: DEF_LIB=3D"shared" OPTS=3D"-Denable_kmods=3Dfalse" > BUILD_DOCS=3D1 > >> > + arch: arm64 > >> > + compiler: gcc > >> > + dist: bionic > >> > + addons: > >> > + apt: > >> > + packages: > >> > + - *required_packages > >> > + - *doc_packages > >> > > >> > script: ./.ci/${TRAVIS_OS_NAME}-build.sh