From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 208D842D26 for ; Thu, 22 Jun 2023 21:28:54 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id F07EE40DDA; Thu, 22 Jun 2023 21:28:53 +0200 (CEST) Received: from mail-yb1-f180.google.com (mail-yb1-f180.google.com [209.85.219.180]) by mails.dpdk.org (Postfix) with ESMTP id 41503406BA for ; Thu, 22 Jun 2023 21:28:53 +0200 (CEST) Received: by mail-yb1-f180.google.com with SMTP id 3f1490d57ef6-bf3934ee767so1568025276.0 for ; Thu, 22 Jun 2023 12:28:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1687462132; x=1690054132; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=bW1+LmqCzN6fbbeTJUzfZEmVp4QGuou90ILdjppZlic=; b=hfuvVdVptgWcmGhz4j3fNaODzgLsUU6DxVXNbFY8LtDG5EVXxnF6DNYf5HTS37edOn 6P7NdAmnjQbenWQjbulWEZRsl8M9z//GK+PNzp+BZcHIYOWfW2RfNqCB6MumIWP0iO+i DxsLYyrPr2dwPZD8czyyUsxlPG6Shm6DII1xM= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1687462132; x=1690054132; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=bW1+LmqCzN6fbbeTJUzfZEmVp4QGuou90ILdjppZlic=; b=kVGEYmmbXLxSBkR6AD24+nH8epWauHOsBVDDJApBwCP38iQ+TWz+QZf+Jri+olbu8R TMH5aYJ5Q0d6OEFVot57AYaXoOCut+r0dFPtLN3DuzcH00BIkYAGdLDM0qrYJskyARlB QiQQy1doZf/Kqrc4ELlTpsMSVBFQqpxK15vZwGXYfXSpPc3W3lczndXBoN2DXBbqLhxe E12vJMfYoZSCcigf+j01gFVTvOO1jPxDn/neorzr+JkQTlSV96jbWcFYxb1or9wt2RhE MsRaZavfjN711U+bwRty0h9h3CQDEKl0VoaYXt7rF1Sq+MvPfDudKZOnoDdbqSb50gsX ZlGA== X-Gm-Message-State: AC+VfDwWOPLM7zC6hlclzet1ie8Y5NV4sB8dsJuRRctn1GZILpJ1IlXq R2Kslvxw85KmlqDd7oKKgHgzPywxT1EdXTLIKBiFvw== X-Google-Smtp-Source: ACHHUZ6JrS9P2jOEUFRJ+Z4UP1UzUzjtoVb/LZE7d8rrRv2Au3s9n+V7IlYMVuNNCyCxkuhDmybW7Jn4l0F81VP1SRE= X-Received: by 2002:a25:bc90:0:b0:bc9:22d:1914 with SMTP id e16-20020a25bc90000000b00bc9022d1914mr18932535ybk.10.1687462132528; Thu, 22 Jun 2023 12:28:52 -0700 (PDT) MIME-Version: 1.0 References: <20230525171505.1276457-1-ahassick@iol.unh.edu> In-Reply-To: From: Adam Hassick Date: Thu, 22 Jun 2023 15:28:41 -0400 Message-ID: Subject: Re: [PATCH v6 0/6] Community Lab Containers and Builder Engine To: Ali Alnubani Cc: "ci@dpdk.org" , "aconole@redhat.com" Content-Type: multipart/alternative; boundary="000000000000fb50c405febce4c4" X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org --000000000000fb50c405febce4c4 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable These changes are based off of an internal copy that should've been kept up-to-date with the latest patch series. This internal copy is what we're running in production to build our images. This is where I made my changes when adding documentation for new features. I'll make sure that the changes Owen was asked to add between the initial patchset and the v4 patchset are present in what we have running in production and in the next patch. On an unrelated note, the version of the arch dockerfile template in this patch no longer builds without error. This is due to a change in the arch base image that prevents the installation of pip packages in the root environment. I will include those changes in the next patchset as well. On Thu, Jun 22, 2023 at 11:29=E2=80=AFAM Ali Alnubani = wrote: > > -----Original Message----- > > From: Adam Hassick > > Sent: Thursday, May 25, 2023 8:15 PM > > To: ci@dpdk.org > > Cc: aconole@redhat.com; Ali Alnubani ; Adam Hassick > > > > Subject: [PATCH v6 0/6] Community Lab Containers and Builder Engine > > > > This patch series contains a new version of the DPDK CI containers. The > old > > version was tied very tightly to the Community Lab Infrastructure, so i= t > was > > not suitable for general use. This version is designed to make adding n= ew > > OSes or OS versions as easy as possible. The minimum functionality can > easily > > be built on any system that can compile DPDK. It includes support for > > building containers for other non-native architectures (ex: arm > containers > > on x86) and for baking ABI references into the images. Support for > > building the Coverity Scan container image has also been added. > > > > The inventory file as added in this patch series defines what the > community > > lab > > currently supports. > > > > If you want to build these yourself, don't try to do parallel Makefile > builds > > on non-server hardware. Libabigail is built into the containers, and > since it > > is not avaliable in all distros it is compiled from source for many > targets. > > If embedding the abi is enabled (DPDK_CI_CONTAINERS_BUILD_ABI=3DY), wit= h > > the > > current settings, DPDK will be compiled thrice for every target in the > > inventory file. Due to how the containers are constructed, building on > > non-native architectures is especially expensive because DPDK is > compiled with > > an emulated compiler in a qemu vm that only has one thread. > > > > Hi Adam, > > Are you sure your changes were based on Owen's most recent patchset (v4)? > I noticed that the README no longer mentions the dependency on podman > v4.0.0. See: > https://inbox.dpdk.org/ci/DM4PR12MB51677D9D8DBCD1A3D7D3997DDA2B9@DM4PR12M= B5167.namprd12.prod.outlook.com/ > --=20 *Adam Hassick* Senior Developer UNH InterOperability Lab ahassick@iol.unh.edu iol.unh.edu +1 (603) 475-8248 --000000000000fb50c405febce4c4 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
These changes are based off of an internal copy that = should've been kept up-to-date with the latest patch series. This inter= nal copy is what we're running in production to build our images. This = is where I made my changes when adding documentation for new features. I= 9;ll make sure that the changes Owen was asked to add between the initial p= atchset and the v4 patchset are present in what we have running in producti= on and in the next patch.

On an unrelated note= , the version of the arch dockerfile template in this patch no longer build= s without error. This is due to a change in the arch base image that preven= ts the installation of pip packages in the root environment. I will include= those changes in the next patchset as well.

On Thu, Jun 22, 2023= at 11:29=E2=80=AFAM Ali Alnubani <alialnu@nvidia.com> wrote:
> -----Original Message-----
> From: Adam Hassick <ahassick@iol.unh.edu>
> Sent: Thursday, May 25, 2023 8:15 PM
> To: ci@dpdk.org > Cc: aconole@re= dhat.com; Ali Alnubani <alialnu@nvidia.com>; Adam Hassick
> <ahassick= @iol.unh.edu>
> Subject: [PATCH v6 0/6] Community Lab Containers and Builder Engine >
> This patch series contains a new version of the DPDK CI containers. Th= e old
> version was tied very tightly to the Community Lab Infrastructure, so = it was
> not suitable for general use. This version is designed to make adding = new
> OSes or OS versions as easy as possible. The minimum functionality can= easily
> be built on any system that can compile DPDK. It includes support for<= br> > building containers for other non-native architectures (ex: arm contai= ners
> on x86) and for baking ABI references into the images. Support for
> building the Coverity Scan container image has also been added.
>
> The inventory file as added in this patch series defines what the comm= unity
> lab
> currently supports.
>
> If you want to build these yourself, don't try to do parallel Make= file builds
> on non-server hardware. Libabigail is built into the containers, and s= ince it
> is not avaliable in all distros it is compiled from source for many ta= rgets.
> If embedding the abi is enabled (DPDK_CI_CONTAINERS_BUILD_ABI=3DY), wi= th
> the
> current settings, DPDK will be compiled thrice for every target in the=
> inventory file. Due to how the containers are constructed, building on=
> non-native architectures is especially expensive because DPDK is compi= led with
> an emulated compiler in a qemu vm that only has one thread.
>

Hi Adam,

Are you sure your changes were based on Owen's most recent patchset (v4= )?
I noticed that the README no longer mentions the dependency on podman v4.0.= 0. See: https://inbox.dpdk.org/ci/DM4PR12MB51677D9D8DBCD1A3D7D3997DDA2= B9@DM4PR12MB5167.namprd12.prod.outlook.com/


--
Adam Hassick
Senior Developer
UNH InterOperability Lab
+1 (603) 475-8248
--000000000000fb50c405febce4c4--