From: Owen Hilyard <ohilyard@iol.unh.edu>
This patch series contains a new version of the DPDK CI containers. The old
version was tied very tightly to the Community Lab Infrastructure, so it was
not suitable for general use. This version is designed to make adding new
OSes or OS versions as easy as possible. The minimum functionality can easily
be built on any system that can compile DPDK. It includes support for
building containers for other non-native architectures (ex: arm containers
on x86) and for baking ABI references into the images.
The inventory file as added in this patch series defines what the community lab
currently supports.
If you want to build these yourself, don't try to do parallel Makefile builds
on non-server hardware. Libabigail is built into the containers, and since it
is not avaliable in all distros it is compiled from source for many targets.
If embedding the abi is enabled (DPDK_CI_CONTAINERS_BUILD_ABI=Y), with the
current settings, DPDK will be compiled twice for every target in the
inventory file. This will become three times when DPDK main has ABI stability
again. Due to how the containers are constructed, building on non-native
architectures is especially expensive because DPDK is compiled with an emulated
compiler in a qemu vm that only has one thread.
Owen Hilyard (6):
containers/docs: Add container builder start
containers/inventory: Add inventory for container builder
containers/builder: Dockerfile creation script
containers/templates: Templates for Dockerfiles
containers/container_builder: Container for python scripts
containers/Makefile: Makefile to automate builds
containers/Makefile | 166 ++++++++
containers/README.md | 138 +++++++
containers/container_builder.dockerfile | 26 ++
containers/template_engine/inventory.yaml | 356 ++++++++++++++++++
.../template_engine/inventory_schema.json | 153 ++++++++
containers/template_engine/make_dockerfile.py | 240 ++++++++++++
containers/template_engine/poetry.lock | 220 +++++++++++
containers/template_engine/pyproject.toml | 21 ++
.../templates/containers.makefile.j2 | 31 ++
.../templates/containers/alpine.dockerfile.j2 | 37 ++
.../templates/containers/arch.dockerfile.j2 | 37 ++
.../templates/containers/base.dockerfile.j2 | 85 +++++
.../containers/centos8.dockerfile.j2 | 21 ++
.../containers/centos9.dockerfile.j2 | 17 +
.../templates/containers/debian.dockerfile.j2 | 7 +
.../containers/debian10.dockerfile.j2 | 3 +
.../containers/debian11.dockerfile.j2 | 3 +
.../containers/debian_bullseye.dockerfile.j2 | 3 +
.../containers/debian_buster.dockerfile.j2 | 3 +
.../templates/containers/fedora.dockerfile.j2 | 11 +
.../containers/fedora36_clang.dockerfile.j2 | 7 +
.../containers/opensuse.dockerfile.j2 | 10 +
.../containers/redhat_family.dockerfile.j2 | 5 +
.../templates/containers/rhel.dockerfile.j2 | 12 +
.../templates/containers/rhel7.dockerfile.j2 | 19 +
.../templates/containers/rhel8.dockerfile.j2 | 19 +
.../templates/containers/rhel9.dockerfile.j2 | 25 ++
.../templates/containers/rpm.dockerfile.j2 | 3 +
.../templates/containers/ubuntu.dockerfile.j2 | 3 +
.../containers/ubuntu20.04.dockerfile.j2 | 12 +
.../containers/ubuntu22.04.dockerfile.j2 | 7 +
.../containers/ubuntu_cross.dockerfile.j2 | 11 +
.../containers/ubuntu_sve.dockerfile.j2 | 10 +
33 files changed, 1721 insertions(+)
create mode 100644 containers/Makefile
create mode 100644 containers/README.md
create mode 100644 containers/container_builder.dockerfile
create mode 100644 containers/template_engine/inventory.yaml
create mode 100644 containers/template_engine/inventory_schema.json
create mode 100755 containers/template_engine/make_dockerfile.py
create mode 100644 containers/template_engine/poetry.lock
create mode 100644 containers/template_engine/pyproject.toml
create mode 100644 containers/template_engine/templates/containers.makefile.j2
create mode 100644 containers/template_engine/templates/containers/alpine.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/arch.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/base.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/centos8.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/centos9.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/debian.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/debian10.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/debian11.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/debian_bullseye.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/debian_buster.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/fedora.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/fedora36_clang.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/opensuse.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/redhat_family.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/rhel.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/rhel7.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/rhel8.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/rhel9.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/rpm.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/ubuntu.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/ubuntu20.04.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/ubuntu22.04.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/ubuntu_cross.dockerfile.j2
create mode 100644 containers/template_engine/templates/containers/ubuntu_sve.dockerfile.j2
--
2.34.1
Ali, since I've made some functional modifications I would appreciate a retest. It should be the same as before, except that by default libabigail will not be built from source if DPDK_CI_CONTAINERS_BUILD_ABI=N.
Owen