From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6F705440D5; Sun, 26 May 2024 13:30:45 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id F422D402B2; Sun, 26 May 2024 13:30:44 +0200 (CEST) Received: from fhigh1-smtp.messagingengine.com (fhigh1-smtp.messagingengine.com [103.168.172.152]) by mails.dpdk.org (Postfix) with ESMTP id E856E40265 for ; Sun, 26 May 2024 13:30:42 +0200 (CEST) Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailfhigh.nyi.internal (Postfix) with ESMTP id 4F8801140170; Sun, 26 May 2024 07:30:42 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Sun, 26 May 2024 07:30:42 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=monjalon.net; h= cc:cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm1; t=1716723042; x=1716809442; bh=RL9R/mpFy8D5JWdA/YOq81hjGSa7kMxvg8krovV3d7s=; b= j7ZkmvNRPQSAly0g8gJCI5M3BNMoUAQXIzRJCjSc+PyZwzeW5hEUb/X8QddkoHfc BGxHfQCKc8/UHyAnMOjVmMJ+dq25K9qvSue0c1nGMl/Np5RI5hiGuY6Aatj9Lfch ypAoZXRHoSCFkRz6ztts9xElLO4WSaSdXfiUiG+a/J3hzPGm8+VB6P1yeL72eG6T GdwSPNMGUKscH+OoYEbNzGQOat85XGKJukxttfRx9URvsu2SAKDyU6NdkQNxjupJ E7a1QehlKWvf6nTS6ZqAwJoGQ+mvv5U6aySzyKjoyk66G+/OboloAWzCpP3aTGY4 HgQU4L8OaitCT/KC0d0Hkw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1716723042; x= 1716809442; bh=RL9R/mpFy8D5JWdA/YOq81hjGSa7kMxvg8krovV3d7s=; b=B cwh+Q3EWGZTXB/uYgtYUHtpEdMKh9VG1Y18qvhj45qW1k6G4NklPvSLv8KyOT4zR B4uYV7gbb+K09wmPsgn0LO4t2wkMvvMb0DVuHCV/n+jkKzY600I1jK+DwyH6rLrm cJyLCgJni0fEZQPKC17smKZm5VnldVsGIxUNA31UDLH7wi5OuBwvw6uDjUvnQJo2 TKjXIxgOLEehkQzXnnn6DqVbDICbn2dDOGn2/YZQrGO/9ZPt7ZxV2l7eYB4ts93P k+sVFLZsU97FxkY7RTdUwoLB4ull5fdItksADaPJ2mbKxXpt9OzymvzMvD0SCV7A d7/WDzJ3aJA5LMN60PSsg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrvdejvddggeduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufffkjghfggfgtgesthhqredttddtjeenucfhrhhomhepvfhhohhm rghsucfoohhnjhgrlhhonhcuoehthhhomhgrshesmhhonhhjrghlohhnrdhnvghtqeenuc ggtffrrghtthgvrhhnpeegtddtleejjeegffekkeektdejvedtheevtdekiedvueeuvdei uddvleevjeeujeenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfh hrohhmpehthhhomhgrshesmhhonhhjrghlohhnrdhnvght X-ME-Proxy: Feedback-ID: i47234305:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sun, 26 May 2024 07:30:40 -0400 (EDT) From: Thomas Monjalon To: Christian Ehrhardt Cc: dev@dpdk.org, Luca Boccassi , david.marchand@redhat.com, Bruce Richardson Subject: Re: [PATCH] doc: ensure sphinx output is reproducible Date: Sun, 26 May 2024 13:30:36 +0200 Message-ID: <12813876.VsHLxoZxqI@thomas> In-Reply-To: References: <20230629125838.1995751-1-christian.ehrhardt@canonical.com> <7653904.8F6SAcFxjW@thomas> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="utf-8" X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org 27/11/2023 18:00, Bruce Richardson: > On Mon, Nov 27, 2023 at 05:45:52PM +0100, Thomas Monjalon wrote: > > 06/07/2023 14:49, Christian Ehrhardt: > > > On Mon, Jul 3, 2023 at 5:29=E2=80=AFPM Thomas Monjalon wrote: > > > > > > > > 29/06/2023 14:58, christian.ehrhardt@canonical.com: > > > > > From: Christian Ehrhardt > > > > > > > > > > By adding -j we build in parallel, to make building on multiproce= ssor > > > > > machines more effective. While that works it does also break > > > > > reproducible builds as the order of the sphinx generated searchin= dex.js > > > > > is depending on execution speed of the individual processes. > > > > [...] > > > > > -if Version(ver) >=3D Version('1.7'): > > > > > - sphinx_cmd +=3D ['-j', 'auto'] > > > > > > > > What is the impact on build speed on an average machine? > > >=20 > > > Hi, > > > I haven't tested this in isolation as it was just a mandatory change > > > on the Debian/Ubuntu side. > > > And the time for exactly and only the doc build is hidden inside the > > > concurrency of meson. > > > But I can compare a full build [1] and a full build with the change [= 2]. > > >=20 > > > That is an average build machine and it is 35 seconds slower with the > > > change to no more do doc builds in parallel. > >=20 > > I would prefer adding an option for reproducible build > > (which is not a common requirement). > >=20 > Taking a slightly different tack, is it possible to sort the searchindex.= js > file post-build, so that even reproducible builds get the benefits of > parallelism? We never got a response to this question. I apply this patch, but I'm waiting for an effort in the direction Bruce is proposing. I remove the line "from packaging.version import Version" which becomes use= less. Same for PIPE and STDOUT. =46or now we are slowing down the build of docs because there is a strong p= ush for reproducibility and not enough effort for doing it efficiently.