From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 202EAA0A02 for ; Wed, 24 Mar 2021 08:45:07 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D7DDC4067B; Wed, 24 Mar 2021 08:45:06 +0100 (CET) Received: from youngberry.canonical.com (youngberry.canonical.com [91.189.89.112]) by mails.dpdk.org (Postfix) with ESMTP id E18C24067B for ; Wed, 24 Mar 2021 08:45:04 +0100 (CET) Received: from mail-qt1-f200.google.com ([209.85.160.200]) by youngberry.canonical.com with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.86_2) (envelope-from ) id 1lOyCO-0002dQ-4F for stable@dpdk.org; Wed, 24 Mar 2021 07:45:04 +0000 Received: by mail-qt1-f200.google.com with SMTP id v3so712496qtw.8 for ; Wed, 24 Mar 2021 00:45:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=Kmw1eKqSZFRHs3O39oFoxQfgzQj5zK/AK9TWLGftIXo=; b=K5lWprK0CoXEevjk6EyCTHUEFZjGhlLpgH9jri2LPW4GQxtPCofLwxocJNGFjK6gab 4DA/Cq1gfl4M+1em6l953lIbBeTtIHsg/O8IU3brpjNDayTalZaeSX6PVxjyGK9a/N/z Dz0WGwoYg4YNb1dysWt55Gcz4n2ja6YxpvrJd6R+FV5K45LffistienrVfNdXSWmZn1t KUOOsyC691G7+2IM4OUFrBz8a6dItTpcxVlm+llHkHlShQYznVBxmOZmNOYzKN8ilseH QAytmLjhtxAkJNgAPzicgivilOc+ZbYn4LunzkzpDpcLZhajSr3AJYKyAxr92IC7PnzV vNDw== X-Gm-Message-State: AOAM5311pCeFHxzWEjGe8UmYcnwGAzSXQaGbPIG2380ofO+DALQpsU2o nxZvocEejpovIrmGcQiA4JsCik4wk/xGEpS5gFwD2GRHmihxpGc5AOn+z/4rkgXIOpP0QqhMJVn 9OfMsT/5FyxF/Xypx3TbuNCysvO+ZyMAJjtTqaLm+ X-Received: by 2002:a37:e315:: with SMTP id y21mr1806288qki.418.1616571902978; Wed, 24 Mar 2021 00:45:02 -0700 (PDT) X-Google-Smtp-Source: ABdhPJyzcyOPaUsAIo9fD0aRmK6JPh3EqdbOrPVAeIKo85P09m1dz/MJJji7T/fGt2FnA1Vkbb5VCon4b86fKWaFC+w= X-Received: by 2002:a37:e315:: with SMTP id y21mr1806264qki.418.1616571902608; Wed, 24 Mar 2021 00:45:02 -0700 (PDT) MIME-Version: 1.0 References: <20200818181222.8462-1-bluca@debian.org> <11715925.4IKFeQ5fnV@thomas> <5269770.kVSxIry3NT@thomas> <708d8168-7338-5aed-94cb-9653e14e79f1@ovn.org> In-Reply-To: <708d8168-7338-5aed-94cb-9653e14e79f1@ovn.org> From: Christian Ehrhardt Date: Wed, 24 Mar 2021 08:44:36 +0100 Message-ID: To: Ilya Maximets Cc: Thomas Monjalon , Luca Boccassi , Bruce Richardson , "Pai G, Sunil" , "Stokes, Ian" , "Govindharajan, Hariprasad" , "stable@dpdk.org" , dev , James Page Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-stable] [dpdk-dev] 19.11.4 patches review and test X-BeenThere: stable@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: patches for DPDK stable branches List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: stable-bounces@dpdk.org Sender: "stable" On Tue, Mar 23, 2021 at 7:51 PM Ilya Maximets wrote: > > On 3/23/21 7:17 PM, Thomas Monjalon wrote: > > 22/03/2021 15:27, Christian Ehrhardt: > >> On Mon, Mar 22, 2021 at 1:25 PM Thomas Monjalon = wrote: > >>> 22/03/2021 12:59, Luca Boccassi: > >>>> On Mon, 2021-03-22 at 11:41 +0000, Bruce Richardson wrote: > >>>>> On Mon, Mar 22, 2021 at 10:49:54AM +0100, Christian Ehrhardt wrote: > >>>>>> On Thu, Mar 18, 2021 at 7:25 PM Pai G, Sunil wrote: > >>>>>>> Hi Christian, Ilya > >>>>>>> From: Ilya Maximets > >>>>>>>> On 3/18/21 2:36 PM, Pai G, Sunil wrote: > >>>>>>>>> Hey Christian, > >>>>>>>>> > >>>>>>>>> > >>>>>>>>> > >>>>>>>>>> back in 19.11.4 these DPDK changes were not picked up as they= have > >>>>>>>>>> broken builds as discussed here. > >>>>>>>>>> Later on the communication was that all this works fine now an= d > >>>>>>>>>> thereby Luca has "reverted the reverts" in 19.11.6 [1]. > >>>>>>>>>> > >>>>>>>>>> But today we were made aware that still no OVS 2.13 builds aga= inst a > >>>>>>>>>> DPDK that has those changes. > >>>>>>>>>> Not 2.13.1 as we have it in Ubuntu nor (if it needs some OVS c= hanges > >>>>>>>>>> backported) the recent 2.13.3 does build. > >>>>>>>>>> They still fail with the very same issue I reported [2] back t= hen. > >>>>>>>>>> > >>>>>>>>>> Unfortunately I have just released 19.11.7 so I can't revert t= hem > >>>>>>>>>> there - but OTOH reverting and counter reverting every other r= elease > >>>>>>>>>> seems wrong anyway. > >>>>>>>> > >>>>>>>> It is wrong indeed, but the main question here is why these patc= hes was > >>>>>>>> backported to stable release in a first place? > >>>>>>>> > >>>>>>>> Looking at these patches, they are not actual bug fixes but more= like "nice to > >>>>>>>> have" features that additionally breaks the way application link= s with DPDK. > >>>>>>>> Stuff like that should not be acceptable to the stable release w= ithout a strong > >>>>>>>> justification or, at least, testing with actual applications. > >>>>>> > >>>>>> I agree, but TBH IIRC these changes were initially by OVS people := -) > >>>>>> One could chase down the old talks between Luca and the requesters= , but I don't > >>>>>> think that gains us that much. > >>>>>> > >>>>>>>> Since we already have a revert of revert, revert of revert of re= vert doesn't > >>>>>>>> seem so bad. > >>>>>> > >>>>>> As long as we don't extend this series, yeah > >>>>>> > >>>>>>>>>> I wanted to ask if there is a set of patches that OVS would ne= ed to > >>>>>>>>>> backport to 2.13.x to make this work? > >>>>>>>>>> If they could be identified and prepared Distros could use the= m on > >>>>>>>>>> 2.13.3 asap and 2.13.4 could officially release them for OVS l= ater on. > >>>>>>>>>> > >>>>>>>>>> But for that we'd need a hint which OVS changes that would nee= d to be. > >>>>>>>>>> All I know atm is from the testing reports on DPDK it seems th= at OVS > >>>>>>>>>> 2.14.3 and 2.15 are happy with the new DPDK code. > >>>>>>>>>> Do you have pointers on what 2.13.3 would need to get backport= ed to > >>>>>>>>>> work again in regard to this build issue. > >>>>>>>>> > >>>>>>>>> You would need to use partial contents from patch : > >>>>>>>>> http://patchwork.ozlabs.org/project/openvswitch/patch/160814236= 5- > >>>>>>>> 26215 > >>>>>>>>> -1-git-send-email-ian.stokes@intel.com/ > >>>>>>>>> > >>>>>>>>> If you'd like me to send patches which would work with 2.13, 2.= 14, I'm > >>>>>>>>> ok with that too.[keeping only those parts from patch which fix= es the issue > >>>>>>>> you see.] But we must ensure it doesn=E2=80=99t cause problems f= or OVS too. > >>>>>>>>> Your thoughts Ilya ? > >>>>>>>> > >>>>>>>> We had more fixes on top of this particular patch and I'd like t= o not cherry- > >>>>>>>> pick and re-check all of this again. > >>>>>>> > >>>>>>> I agree, we had more fixes on top of this. It would be risky to c= herry-pick. > >>>>>>> So it might be a better option to revert. > >>>>>> > >>>>>> I agree, as far as I assessed the situation it would mean the reve= rt > >>>>>> of the following list. > >>>>>> And since that is a lot of "reverts" in the string, to be clear it= means that > >>>>>> those original changes would not be present anymore in 19.11.x. > >>>>>> > >>>>>> f49248a990 Revert "Revert "build/pkg-config: prevent overlinking"" > >>>>>> 39586a4cf0 Revert "Revert "build/pkg-config: improve static linkin= g flags"" > >>>>>> 906e935a1f Revert "Revert "build/pkg-config: output drivers first = for > >>>>>> static build"" > >>>>>> deebf95239 Revert "Revert "build/pkg-config: move pkg-config file = creation"" > >>>>>> a3bd9a34bf Revert "Revert "build: always link whole DPDK static li= braries"" > >>>>>> d4bc124438 Revert "Revert "devtools: test static linkage with pkg-= config"" > >>>>>> > >>>>>> But to avoid going back&forth I'd prefer to have a signed-off on t= hat > >>>>>> approach from: > >>>>>> - Luca (for 19.11.6 which has added the changes) > >>>>>> - Bruce (for being involved in the old&new case in general) > >>>>>> - Thomas (for general master maintainer thoughts) > >>>>>> > >>>>> > >>>>> If this is what is needed to ensure OVS can continue to use this re= lease > >>>>> series, then I am absolutely fine with it. > >>>> > >>>> This was requested by OVS, so if they don't need it anymore it's fin= e > >>>> by me as well > >>> > >>> I am not sure to understand the full story, > >>> but I am a bit worried that our release is dictated by > >>> a single "user" (project using DPDK). > >> > >> Sure, fair to ask for more detail :-) > >> > >>> Please do you have links of discussion history? > >> > >> I ordered the events by time and added links to those occasions that I > >> could find: > >> > >> July 2020 - Initial request by OVS - *1 > >> July 2020 - Initial queuing - > >> http://mails.dpdk.org/archives/stable/2020-July/024248.html > >> September 2020 - Issues identified; changes reverted - > >> http://mails.dpdk.org/archives/stable/2020-September/024796.html > >> October 2020 - Re-applying early in 19.11.6 cycle - *1 > >> November 2020 - Tests didn't spot it with 19.11.6 as OVS 2.14.x (not > >> the 2.13 LTS) was tested - > >> https://doc.dpdk.org/guides-19.11/rel_notes/release_19_11.html#id16 > >> March 2021 - Same issue re-found in >=3D19.11.6 - > >> http://mails.dpdk.org/archives/stable/2021-March/029418.html > >> > >> *1 - Luca and I looked for logs, there are no links that I'd know of > >> and Luca said it might have come up as a request during a meeting. > > > > First, I agree to revert the changes again if it causes a regression. > > Second, do we know the root cause of the issue? > > Is it a problem with the version of pkg-config? > > Is it OK with DPDK 20.11? > > > > I'd like to also ask someone to test build of both OVS 2.13 and OVS 2.14 > with these changes and with these changes reverted. I've test built a few of those already. - 19.11.4 (before the patches were applied) - OVS 2.13.1 worked - 19.11.6/19.11.7 (patches not yet reverted) - OVS 2.13.1 fails - OVS 2.13.3 fails - 19.11.7 patches reverted - OVS 2.13.3 works I'd also be happy to hear about OVS 2.14 test builds, so yeah if you could do so @Sunil that would be great. For the code, I've not yet pushed it to "real dpdk-stable" until we are sure about it, but already to: https://github.com/cpaelzer/dpdk-stable-queue/tree/19.11 If you happen to build on Ubuntu there is a 19.11.7 + reverts already available here https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/3690/ > Sunil, could you do that? > > > About the process, I see multiple issues: > > > > 1/ Some patches were backported for OVS only, > > but it could break other applications. As we found it even breaks (older) OVS, but importantly the OVS LTS which has the highest chance to be in use together with DPDK 19.11 in many places :-/ > > 2/ It is not clear whether the patches were really needed in 19.11. > > > > 3/ There is no trace of backport requests in the mailing list. > > > > So I feel we should be stricter on the reasons for a backport. > > Note: I am not blaming anyone. Everybody tries to do the best. > > I believe sharing requests and discussions on the mailing list > > could help in the decision process. Agreed > +1 > > > > > Thanks for all the work. --=20 Christian Ehrhardt Staff Engineer, Ubuntu Server Canonical Ltd