From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 865FEA0548 for ; Tue, 11 Oct 2022 18:53:11 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8250A41181; Tue, 11 Oct 2022 18:53:11 +0200 (CEST) Received: from mail-pj1-f98.google.com (mail-pj1-f98.google.com [209.85.216.98]) by mails.dpdk.org (Postfix) with ESMTP id E29E6427EC for ; Tue, 11 Oct 2022 18:53:09 +0200 (CEST) Received: by mail-pj1-f98.google.com with SMTP id o9-20020a17090a0a0900b0020ad4e758b3so13745327pjo.4 for ; Tue, 11 Oct 2022 09:53:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to; bh=RG2AyyzVL26aVRpHpACBwK6XvfLqIuT5yK4LS03TkcQ=; b=gNE5lYwC+Z9PgInk4TP4+eo/58p26cUuQSYtaHuYeJijcNgOjcyBaQa0YiWRd12F2I +hK6v6Kw4+HopDzEE7QJn201HTpsNmCmM8BGPt6PNFvrvv0naVtAoIAE9mw/PzMVhG8G vBlODKIeIEYOu8LjFlZ0FK+ZtsLP7Ac4FbEM8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=RG2AyyzVL26aVRpHpACBwK6XvfLqIuT5yK4LS03TkcQ=; b=FgaHqNkxfVwofBdec8k1d8unn74XSr3bhJDorYx1XBk+3q0T/VLZQOfxxNra/OJsUJ nPfJqR2Uy2SqCLPzuSREo1jp6/+XGJTbIE3jiHBXXyLucbxx++qDRSN9zk9Xz2tRvMxW 1sGP6WDI1L4F0ahMmFkx30FYWjIjgKENw/1W1JNVSba3IE2M4RJSOLdE0KFQcEDaiHGH gBvolKVCKe+oSPZ220FeSXAIpkPX7DN70PF5wOJNoUY80nWKaCYjebU5FAMivJSHG5Bl 0LGj0l2wOeS7Yx5I0VxZJBS7q9QVodCmNtQxgpnpGzDR5sIPGmUQ5T6vMqiP6St8kbJ3 bPEw== X-Gm-Message-State: ACrzQf05tOqhy+cT0v6lKR4WyL+KXwvExTXcZhClp0/2uSrE/R3/Zu6Z hi4MVkvNtN7yulGeY8qHHPdY8EcvdPkohjId+RXSI256J4E8tmtw6d0fANIG7hejaJTsBU4sBYm sxyCMaamLy1g0//3zWzNhigC812gjcoNLWRXew4cxRqdtn/mkOFgtliDBMH4A6DLfSem0wxzmTW Cqjp4rLixM4r1S X-Google-Smtp-Source: AMsMyM6a5AArR23Vy4qJW/d84Cg2NUv5Q9UNnYbRacB6xvKYxt3xZN4k9vL7T9P1roel15e6GktyMkY+E88h X-Received: by 2002:a17:90b:4f45:b0:20d:3282:e5e0 with SMTP id pj5-20020a17090b4f4500b0020d3282e5e0mr84263pjb.8.1665507189072; Tue, 11 Oct 2022 09:53:09 -0700 (PDT) Received: from postal.iol.unh.edu (postal.iol.unh.edu. [2606:4100:3880:1234::84]) by smtp-relay.gmail.com with ESMTPS id e20-20020a170902ed9400b00179ba72b9dcsm602221plj.139.2022.10.11.09.53.08 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 11 Oct 2022 09:53:09 -0700 (PDT) X-Relaying-Domain: iol.unh.edu Received: from iol.unh.edu (unknown [IPv6:2606:4100:3880:1257::105d]) by postal.iol.unh.edu (Postfix) with ESMTP id 08FCE605251C; Tue, 11 Oct 2022 12:53:05 -0400 (EDT) From: ohilyard@iol.unh.edu To: ci@dpdk.org Cc: aconole@redhat.com, Owen Hilyard Subject: [PATCH 0/6] Community Lab Container Definitions Date: Tue, 11 Oct 2022 12:52:49 -0400 Message-Id: <20221011165255.506428-1-ohilyard@iol.unh.edu> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org From: Owen Hilyard This patch series contains a new version of the DPDK CI containers. The old version was tied very tightly to the Community Lab Infrastructure, so it was not suitable for general use. This version is designed to make adding new OSes or OS versions as easy as possible. The minimum functionality can easily be built on any system that can compile DPDK. It includes support for building containers for other non-native architectures (ex: arm containers on x86) and for baking ABI references into the images. The inventory file as added in this patch series defines what the community lab currently supports. If you want to build these yourself, don't try to do parallel Makefile builds on non-server hardware. Libabigail is built into the containers, and since it is not avaliable in all distros it is compiled from source for many targets. If embedding the abi is enabled (DPDK_CI_CONTAINERS_BUILD_ABI=Y), with the current settings, DPDK will be compiled twice for every target in the inventory file. This will become three times when DPDK main has ABI stability again. Due to how the containers are constructed, building on non-native architectures is especially expensive because DPDK is compiled with an emulated compiler in a qemu vm that only has one thread. Owen Hilyard (6): containers/docs: Add container builder start containers/inventory: Add inventory for container builder containers/builder: Dockerfile creation script containers/templates: Templates for Dockerfiles containers/container_builder: Container for python scripts containers/Makefile: Makefile to automate builds containers/Makefile | 152 ++++++++ containers/README.md | 137 +++++++ containers/container_builder.dockerfile | 26 ++ containers/template_engine/inventory.yaml | 360 ++++++++++++++++++ .../template_engine/inventory_schema.json | 153 ++++++++ containers/template_engine/make_dockerfile.py | 221 +++++++++++ containers/template_engine/pyproject.toml | 21 + .../templates/containers.makefile.j2 | 31 ++ .../templates/containers/alpine.dockerfile.j2 | 33 ++ .../templates/containers/arch.dockerfile.j2 | 37 ++ .../templates/containers/base.dockerfile.j2 | 81 ++++ .../containers/centos8.dockerfile.j2 | 21 + .../containers/centos9.dockerfile.j2 | 17 + .../templates/containers/debian.dockerfile.j2 | 7 + .../containers/debian10.dockerfile.j2 | 3 + .../containers/debian11.dockerfile.j2 | 3 + .../containers/debian_bullseye.dockerfile.j2 | 3 + .../containers/debian_buster.dockerfile.j2 | 3 + .../templates/containers/fedora.dockerfile.j2 | 11 + .../containers/fedora36_clang.dockerfile.j2 | 7 + .../containers/opensuse.dockerfile.j2 | 10 + .../containers/redhat_family.dockerfile.j2 | 5 + .../templates/containers/rhel.dockerfile.j2 | 12 + .../templates/containers/rhel7.dockerfile.j2 | 19 + .../templates/containers/rhel8.dockerfile.j2 | 19 + .../templates/containers/rhel9.dockerfile.j2 | 25 ++ .../templates/containers/rpm.dockerfile.j2 | 3 + .../templates/containers/ubuntu.dockerfile.j2 | 3 + .../containers/ubuntu20.04.dockerfile.j2 | 12 + .../containers/ubuntu22.04.dockerfile.j2 | 7 + .../containers/ubuntu_cross.dockerfile.j2 | 11 + .../containers/ubuntu_sve.dockerfile.j2 | 10 + 32 files changed, 1463 insertions(+) create mode 100644 containers/Makefile create mode 100644 containers/README.md create mode 100644 containers/container_builder.dockerfile create mode 100644 containers/template_engine/inventory.yaml create mode 100644 containers/template_engine/inventory_schema.json create mode 100755 containers/template_engine/make_dockerfile.py create mode 100644 containers/template_engine/pyproject.toml create mode 100644 containers/template_engine/templates/containers.makefile.j2 create mode 100644 containers/template_engine/templates/containers/alpine.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/arch.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/base.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/centos8.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/centos9.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/debian.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/debian10.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/debian11.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/debian_bullseye.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/debian_buster.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/fedora.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/fedora36_clang.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/opensuse.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/redhat_family.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/rhel.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/rhel7.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/rhel8.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/rhel9.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/rpm.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/ubuntu.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/ubuntu20.04.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/ubuntu22.04.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/ubuntu_cross.dockerfile.j2 create mode 100644 containers/template_engine/templates/containers/ubuntu_sve.dockerfile.j2 -- 2.34.1