From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by dpdk.org (Postfix) with ESMTP id 68BA61B51E for ; Thu, 21 Mar 2019 16:45:29 +0100 (CET) Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 77C931E333; Thu, 21 Mar 2019 15:45:28 +0000 (UTC) Received: from localhost.localdomain (unknown [10.18.25.8]) by smtp.corp.redhat.com (Postfix) with ESMTP id 97A3760BE5; Thu, 21 Mar 2019 15:45:27 +0000 (UTC) To: Luca Boccassi , Thomas Monjalon , Aaron Conole Cc: dev@dpdk.org, Bruce Richardson , Honnappa Nagarahalli References: <20190207220114.8020-1-msantana@redhat.com> <20190304161232.5670-1-msantana@redhat.com> <20190304161232.5670-2-msantana@redhat.com> <9486436.3HrUK5duha@xps> <8cc57d73-bb0e-7f42-aa45-ffc5ab6abbf7@redhat.com> From: Michael Santana Francisco Organization: Red Hat Message-ID: <4e9ca415-3bda-9250-2d62-90efa4fd747c@redhat.com> Date: Thu, 21 Mar 2019 11:45:27 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.30]); Thu, 21 Mar 2019 15:45:28 +0000 (UTC) Subject: Re: [dpdk-dev] [PATCH v6 1/1] ci: Introduce travis builds for github repositories X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: msantana@redhat.com List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Mar 2019 15:45:29 -0000 On 3/20/19 5:11 PM, Luca Boccassi wrote: > On Wed, 2019-03-20 at 15:28 -0400, Michael Santana Francisco wrote: >>>> +matrix: >>>> + include: >>>> + - env: DEF_LIB="static" OPTS="-Denable_kmods=false" AARCH64=1 >>>> + compiler: gcc >>>> + addons: >>>> + apt: >>>> + packages: >>>> + - [libnuma-dev, linux-headers-$(uname -r), python3- >>>> setuptools, python3-wheel, python3-pip, ninja-build] >>>> + - [gcc-aarch64-linux-gnu, libc6-dev-arm64-cross] >>> Why packages are repeated here again? >>> (sorry, I don't know Travis and I want to understand) >> Yeah, we don't want to repeat ourselves either but we have no >> choice. >> This is due to a limitation in travis. >> This matrix does not inherit any packages from the main package list >> way >> above, which means we have to list them out manually here. >> In addition to the required packages we also want to install full >> builds >> with libraries like libbsd-dev, libpcap-dev, etc. >> We could of just put those libraries in the main package list above >> and >> put all the builds in the env: list because then the libraries would >> be >> inherited. >> The problem with that is that is that travis would not keep minimal >> builds and full builds separate. >> We could not have minimal builds because the minimal builds will >> also >> inherit the additional libraries; Meson will then automatically >> detect >> those additional libraries and builds with them. >> What we would like to have is a way to tell meson which libraries we >> want to use and which we dont, instead of being auto-detected. This >> would help us to get rid of this matrix. >> >> If someone knows a better way to do this we would greatly take in >> your >> ideas, but so far this is the best we could come up with > It's yaml so you can write the list to a variable once and reference it > multiple times for brevity, see for example: > > https://github.com/zeromq/czmq/blob/master/.travis.yml#L128 > Thank you Luca! I had previously tested this approach and then it wasn't working the way I was hoping it would. I just finished testing it again and it seems to be working correctly this time! I got it working with the required packages in one list and use a variable to reference to that list. Next I will see about having a list for extra packages, and another for ARM packages Again, thank you! Will work on it From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by dpdk.space (Postfix) with ESMTP id 8ACB3A00E6 for ; Thu, 21 Mar 2019 16:45:31 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 27CF51B520; Thu, 21 Mar 2019 16:45:30 +0100 (CET) Received: from mx1.redhat.com (mx1.redhat.com [209.132.183.28]) by dpdk.org (Postfix) with ESMTP id 68BA61B51E for ; Thu, 21 Mar 2019 16:45:29 +0100 (CET) Received: from smtp.corp.redhat.com (int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 77C931E333; Thu, 21 Mar 2019 15:45:28 +0000 (UTC) Received: from localhost.localdomain (unknown [10.18.25.8]) by smtp.corp.redhat.com (Postfix) with ESMTP id 97A3760BE5; Thu, 21 Mar 2019 15:45:27 +0000 (UTC) To: Luca Boccassi , Thomas Monjalon , Aaron Conole Cc: dev@dpdk.org, Bruce Richardson , Honnappa Nagarahalli References: <20190207220114.8020-1-msantana@redhat.com> <20190304161232.5670-1-msantana@redhat.com> <20190304161232.5670-2-msantana@redhat.com> <9486436.3HrUK5duha@xps> <8cc57d73-bb0e-7f42-aa45-ffc5ab6abbf7@redhat.com> From: Michael Santana Francisco Organization: Red Hat Message-ID: <4e9ca415-3bda-9250-2d62-90efa4fd747c@redhat.com> Date: Thu, 21 Mar 2019 11:45:27 -0400 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset="UTF-8"; format="flowed" Content-Transfer-Encoding: 7bit Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.12 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.30]); Thu, 21 Mar 2019 15:45:28 +0000 (UTC) Subject: Re: [dpdk-dev] [PATCH v6 1/1] ci: Introduce travis builds for github repositories X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list Reply-To: msantana@redhat.com List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Message-ID: <20190321154527._7RvGqet_KyZyYzafVLeG0H8zg-1kEOdtJGUEf2P6ow@z> On 3/20/19 5:11 PM, Luca Boccassi wrote: > On Wed, 2019-03-20 at 15:28 -0400, Michael Santana Francisco wrote: >>>> +matrix: >>>> + include: >>>> + - env: DEF_LIB="static" OPTS="-Denable_kmods=false" AARCH64=1 >>>> + compiler: gcc >>>> + addons: >>>> + apt: >>>> + packages: >>>> + - [libnuma-dev, linux-headers-$(uname -r), python3- >>>> setuptools, python3-wheel, python3-pip, ninja-build] >>>> + - [gcc-aarch64-linux-gnu, libc6-dev-arm64-cross] >>> Why packages are repeated here again? >>> (sorry, I don't know Travis and I want to understand) >> Yeah, we don't want to repeat ourselves either but we have no >> choice. >> This is due to a limitation in travis. >> This matrix does not inherit any packages from the main package list >> way >> above, which means we have to list them out manually here. >> In addition to the required packages we also want to install full >> builds >> with libraries like libbsd-dev, libpcap-dev, etc. >> We could of just put those libraries in the main package list above >> and >> put all the builds in the env: list because then the libraries would >> be >> inherited. >> The problem with that is that is that travis would not keep minimal >> builds and full builds separate. >> We could not have minimal builds because the minimal builds will >> also >> inherit the additional libraries; Meson will then automatically >> detect >> those additional libraries and builds with them. >> What we would like to have is a way to tell meson which libraries we >> want to use and which we dont, instead of being auto-detected. This >> would help us to get rid of this matrix. >> >> If someone knows a better way to do this we would greatly take in >> your >> ideas, but so far this is the best we could come up with > It's yaml so you can write the list to a variable once and reference it > multiple times for brevity, see for example: > > https://github.com/zeromq/czmq/blob/master/.travis.yml#L128 > Thank you Luca! I had previously tested this approach and then it wasn't working the way I was hoping it would. I just finished testing it again and it seems to be working correctly this time! I got it working with the required packages in one list and use a variable to reference to that list. Next I will see about having a list for extra packages, and another for ARM packages Again, thank you! Will work on it