DPDK CI discussions
 help / color / Atom feed
* [dpdk-ci] Compiling dpdk in non compilation tests
@ 2020-10-25  8:35 David Marchand
  2020-10-27  9:17 ` Richardson, Bruce
  0 siblings, 1 reply; 3+ messages in thread
From: David Marchand @ 2020-10-25  8:35 UTC (permalink / raw)
  To: dpdklab, Lincoln Lavoie; +Cc: ci, Thomas Monjalon, Bruce Richardson

Looking at CI reports this morning, I noticed this on the series "ice:
update base code".

https://lab.dpdk.org/results/dashboard/patchsets/13992/

- Compilation is failing on OpenSuse, but I think this is because its
toolchain does not have AVX512 support.
This seems to be a regression introduced by the series, indeed, cool.


- On Ubuntu 18.04, build is fine, but unit tests are ko.
Looking into the unit tests zipped logs, I can see that:
* the unit tests job builds its own binaries,
* the unit tests environment is not the same as the build test
environment (only copying significant differences below):

Build:
The Meson build system
Version: 0.55.3
...
C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
7.5.0-3ubuntu1~18.04) 7.5.0")
C linker for the host machine: cc ld.bfd 2.30
...
Run-time dependency libpcap found: YES 1.8.1
Has header "pcap.h" with dependency libpcap: YES
...
Fetching value of define "__AVX2__" : 1
Fetching value of define "__AVX512BW__" : 1
Fetching value of define "__AVX512CD__" : 1
Fetching value of define "__AVX512DQ__" : 1
Fetching value of define "__AVX512F__" : 1
Fetching value of define "__AVX512VL__" : 1
...
Run-time dependency jansson found: YES 2.11
...

vs

Unit tests:
The Meson build system
Version: 0.53.1
...
C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
7.5.0-3ubuntu1~18.04) 7.5.0")
C linker for the host machine: cc GNU ld.bfd 2.30
...
Run-time dependency libpcap found: NO (tried pkgconfig)
Library pcap found: NO
...
Fetching value of define "__AVX2__" :
Fetching value of define "__AVX512BW__" :
Fetching value of define "__AVX512CD__" :
Fetching value of define "__AVX512DQ__" :
Fetching value of define "__AVX512F__" :
Fetching value of define "__AVX512VL__" :
...
Run-time dependency jansson found: NO (tried pkgconfig and cmake)
...


The Unit tests env does not have a AVX512 enabled toolchain, or
something in meson disables it, hence the compilation fails and the
unit tests are marked as failed while it has nothing to do with
functional tests.


Please rework the CI pipeline so that the Unit tests job only does
functional tests, while binaries are built by the Build test job.


Thanks.

-- 
David Marchand


^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [dpdk-ci] Compiling dpdk in non compilation tests
  2020-10-25  8:35 [dpdk-ci] Compiling dpdk in non compilation tests David Marchand
@ 2020-10-27  9:17 ` Richardson, Bruce
  2020-10-27 13:41   ` [dpdk-ci] [dpdklab] " Brandon Lo
  0 siblings, 1 reply; 3+ messages in thread
From: Richardson, Bruce @ 2020-10-27  9:17 UTC (permalink / raw)
  To: David Marchand, dpdklab, Lincoln Lavoie; +Cc: ci, Thomas Monjalon



> -----Original Message-----
> From: David Marchand <david.marchand@redhat.com>
> Sent: Sunday, October 25, 2020 8:36 AM
> To: dpdklab@iol.unh.edu; Lincoln Lavoie <lylavoie@iol.unh.edu>
> Cc: ci@dpdk.org; Thomas Monjalon <thomas@monjalon.net>; Richardson, Bruce
> <bruce.richardson@intel.com>
> Subject: Compiling dpdk in non compilation tests
> 
> Looking at CI reports this morning, I noticed this on the series "ice:
> update base code".
> 
> https://lab.dpdk.org/results/dashboard/patchsets/13992/
> 
> - Compilation is failing on OpenSuse, but I think this is because its
> toolchain does not have AVX512 support.
> This seems to be a regression introduced by the series, indeed, cool.
> 
> 
> - On Ubuntu 18.04, build is fine, but unit tests are ko.
> Looking into the unit tests zipped logs, I can see that:
> * the unit tests job builds its own binaries,
> * the unit tests environment is not the same as the build test
> environment (only copying significant differences below):
> 
> Build:
> The Meson build system
> Version: 0.55.3
> ...
> C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
> 7.5.0-3ubuntu1~18.04) 7.5.0")
> C linker for the host machine: cc ld.bfd 2.30
> ...
> Run-time dependency libpcap found: YES 1.8.1
> Has header "pcap.h" with dependency libpcap: YES
> ...
> Fetching value of define "__AVX2__" : 1
> Fetching value of define "__AVX512BW__" : 1
> Fetching value of define "__AVX512CD__" : 1
> Fetching value of define "__AVX512DQ__" : 1
> Fetching value of define "__AVX512F__" : 1
> Fetching value of define "__AVX512VL__" : 1
> ...
> Run-time dependency jansson found: YES 2.11
> ...
> 
> vs
> 
> Unit tests:
> The Meson build system
> Version: 0.53.1
> ...
> C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
> 7.5.0-3ubuntu1~18.04) 7.5.0")
> C linker for the host machine: cc GNU ld.bfd 2.30
> ...
> Run-time dependency libpcap found: NO (tried pkgconfig)
> Library pcap found: NO
> ...
> Fetching value of define "__AVX2__" :
> Fetching value of define "__AVX512BW__" :
> Fetching value of define "__AVX512CD__" :
> Fetching value of define "__AVX512DQ__" :
> Fetching value of define "__AVX512F__" :
> Fetching value of define "__AVX512VL__" :
> ...
> Run-time dependency jansson found: NO (tried pkgconfig and cmake)
> ...
> 
> 
> The Unit tests env does not have a AVX512 enabled toolchain, or
> something in meson disables it, hence the compilation fails and the
> unit tests are marked as failed while it has nothing to do with
> functional tests.
> 

FYI: The original release of Ubuntu 18.04 had broken AVX-512 support
in binutils. However, the fix for that issue has recently been 
backported to 18.04, so running "apt-get update && apt-get upgrade"
should fix that support.

/Bruce

PS: Yes, I'm old-skool and use apt-get rather than just "apt". I
don't like how plain apt does fancy things with the terminal for
the progress bar! 😊

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [dpdk-ci] [dpdklab] RE: Compiling dpdk in non compilation tests
  2020-10-27  9:17 ` Richardson, Bruce
@ 2020-10-27 13:41   ` " Brandon Lo
  0 siblings, 0 replies; 3+ messages in thread
From: Brandon Lo @ 2020-10-27 13:41 UTC (permalink / raw)
  To: Richardson, Bruce
  Cc: David Marchand, dpdklab, Lincoln Lavoie, ci, Thomas Monjalon

[-- Attachment #1: Type: text/plain, Size: 3553 bytes --]

Hi everyone,

Thank you for submitting.
I have started a bug ticket for this so we can track it:
https://bugs.dpdk.org/show_bug.cgi?id=566

Thanks,
Brandon

On Tue, Oct 27, 2020 at 5:17 AM Richardson, Bruce <
bruce.richardson@intel.com> wrote:

>
>
> > -----Original Message-----
> > From: David Marchand <david.marchand@redhat.com>
> > Sent: Sunday, October 25, 2020 8:36 AM
> > To: dpdklab@iol.unh.edu; Lincoln Lavoie <lylavoie@iol.unh.edu>
> > Cc: ci@dpdk.org; Thomas Monjalon <thomas@monjalon.net>; Richardson,
> Bruce
> > <bruce.richardson@intel.com>
> > Subject: Compiling dpdk in non compilation tests
> >
> > Looking at CI reports this morning, I noticed this on the series "ice:
> > update base code".
> >
> > https://lab.dpdk.org/results/dashboard/patchsets/13992/
> >
> > - Compilation is failing on OpenSuse, but I think this is because its
> > toolchain does not have AVX512 support.
> > This seems to be a regression introduced by the series, indeed, cool.
> >
> >
> > - On Ubuntu 18.04, build is fine, but unit tests are ko.
> > Looking into the unit tests zipped logs, I can see that:
> > * the unit tests job builds its own binaries,
> > * the unit tests environment is not the same as the build test
> > environment (only copying significant differences below):
> >
> > Build:
> > The Meson build system
> > Version: 0.55.3
> > ...
> > C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
> > 7.5.0-3ubuntu1~18.04) 7.5.0")
> > C linker for the host machine: cc ld.bfd 2.30
> > ...
> > Run-time dependency libpcap found: YES 1.8.1
> > Has header "pcap.h" with dependency libpcap: YES
> > ...
> > Fetching value of define "__AVX2__" : 1
> > Fetching value of define "__AVX512BW__" : 1
> > Fetching value of define "__AVX512CD__" : 1
> > Fetching value of define "__AVX512DQ__" : 1
> > Fetching value of define "__AVX512F__" : 1
> > Fetching value of define "__AVX512VL__" : 1
> > ...
> > Run-time dependency jansson found: YES 2.11
> > ...
> >
> > vs
> >
> > Unit tests:
> > The Meson build system
> > Version: 0.53.1
> > ...
> > C compiler for the host machine: cc (gcc 7.5.0 "cc (Ubuntu
> > 7.5.0-3ubuntu1~18.04) 7.5.0")
> > C linker for the host machine: cc GNU ld.bfd 2.30
> > ...
> > Run-time dependency libpcap found: NO (tried pkgconfig)
> > Library pcap found: NO
> > ...
> > Fetching value of define "__AVX2__" :
> > Fetching value of define "__AVX512BW__" :
> > Fetching value of define "__AVX512CD__" :
> > Fetching value of define "__AVX512DQ__" :
> > Fetching value of define "__AVX512F__" :
> > Fetching value of define "__AVX512VL__" :
> > ...
> > Run-time dependency jansson found: NO (tried pkgconfig and cmake)
> > ...
> >
> >
> > The Unit tests env does not have a AVX512 enabled toolchain, or
> > something in meson disables it, hence the compilation fails and the
> > unit tests are marked as failed while it has nothing to do with
> > functional tests.
> >
>
> FYI: The original release of Ubuntu 18.04 had broken AVX-512 support
> in binutils. However, the fix for that issue has recently been
> backported to 18.04, so running "apt-get update && apt-get upgrade"
> should fix that support.
>
> /Bruce
>
> PS: Yes, I'm old-skool and use apt-get rather than just "apt". I
> don't like how plain apt does fancy things with the terminal for
> the progress bar! 😊
>


-- 

Brandon Lo

UNH InterOperability Laboratory

21 Madbury Rd, Suite 100, Durham, NH 03824

blo@iol.unh.edu

www.iol.unh.edu

[-- Attachment #2: Type: text/html, Size: 6359 bytes --]

<div dir="ltr">Hi everyone,<div><br></div><div>Thank you for submitting.</div><div>I have started a bug ticket for this so we can track it: <a href="https://bugs.dpdk.org/show_bug.cgi?id=566">https://bugs.dpdk.org/show_bug.cgi?id=566</a></div><div><br></div><div>Thanks,</div><div>Brandon</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 27, 2020 at 5:17 AM Richardson, Bruce &lt;<a href="mailto:bruce.richardson@intel.com">bruce.richardson@intel.com</a>&gt; wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
<br>
&gt; -----Original Message-----<br>
&gt; From: David Marchand &lt;<a href="mailto:david.marchand@redhat.com" target="_blank">david.marchand@redhat.com</a>&gt;<br>
&gt; Sent: Sunday, October 25, 2020 8:36 AM<br>
&gt; To: <a href="mailto:dpdklab@iol.unh.edu" target="_blank">dpdklab@iol.unh.edu</a>; Lincoln Lavoie &lt;<a href="mailto:lylavoie@iol.unh.edu" target="_blank">lylavoie@iol.unh.edu</a>&gt;<br>
&gt; Cc: <a href="mailto:ci@dpdk.org" target="_blank">ci@dpdk.org</a>; Thomas Monjalon &lt;<a href="mailto:thomas@monjalon.net" target="_blank">thomas@monjalon.net</a>&gt;; Richardson, Bruce<br>
&gt; &lt;<a href="mailto:bruce.richardson@intel.com" target="_blank">bruce.richardson@intel.com</a>&gt;<br>
&gt; Subject: Compiling dpdk in non compilation tests<br>
&gt; <br>
&gt; Looking at CI reports this morning, I noticed this on the series &quot;ice:<br>
&gt; update base code&quot;.<br>
&gt; <br>
&gt; <a href="https://lab.dpdk.org/results/dashboard/patchsets/13992/" rel="noreferrer" target="_blank">https://lab.dpdk.org/results/dashboard/patchsets/13992/</a><br>
&gt; <br>
&gt; - Compilation is failing on OpenSuse, but I think this is because its<br>
&gt; toolchain does not have AVX512 support.<br>
&gt; This seems to be a regression introduced by the series, indeed, cool.<br>
&gt; <br>
&gt; <br>
&gt; - On Ubuntu 18.04, build is fine, but unit tests are ko.<br>
&gt; Looking into the unit tests zipped logs, I can see that:<br>
&gt; * the unit tests job builds its own binaries,<br>
&gt; * the unit tests environment is not the same as the build test<br>
&gt; environment (only copying significant differences below):<br>
&gt; <br>
&gt; Build:<br>
&gt; The Meson build system<br>
&gt; Version: 0.55.3<br>
&gt; ...<br>
&gt; C compiler for the host machine: cc (gcc 7.5.0 &quot;cc (Ubuntu<br>
&gt; 7.5.0-3ubuntu1~18.04) 7.5.0&quot;)<br>
&gt; C linker for the host machine: cc ld.bfd 2.30<br>
&gt; ...<br>
&gt; Run-time dependency libpcap found: YES 1.8.1<br>
&gt; Has header &quot;pcap.h&quot; with dependency libpcap: YES<br>
&gt; ...<br>
&gt; Fetching value of define &quot;__AVX2__&quot; : 1<br>
&gt; Fetching value of define &quot;__AVX512BW__&quot; : 1<br>
&gt; Fetching value of define &quot;__AVX512CD__&quot; : 1<br>
&gt; Fetching value of define &quot;__AVX512DQ__&quot; : 1<br>
&gt; Fetching value of define &quot;__AVX512F__&quot; : 1<br>
&gt; Fetching value of define &quot;__AVX512VL__&quot; : 1<br>
&gt; ...<br>
&gt; Run-time dependency jansson found: YES 2.11<br>
&gt; ...<br>
&gt; <br>
&gt; vs<br>
&gt; <br>
&gt; Unit tests:<br>
&gt; The Meson build system<br>
&gt; Version: 0.53.1<br>
&gt; ...<br>
&gt; C compiler for the host machine: cc (gcc 7.5.0 &quot;cc (Ubuntu<br>
&gt; 7.5.0-3ubuntu1~18.04) 7.5.0&quot;)<br>
&gt; C linker for the host machine: cc GNU ld.bfd 2.30<br>
&gt; ...<br>
&gt; Run-time dependency libpcap found: NO (tried pkgconfig)<br>
&gt; Library pcap found: NO<br>
&gt; ...<br>
&gt; Fetching value of define &quot;__AVX2__&quot; :<br>
&gt; Fetching value of define &quot;__AVX512BW__&quot; :<br>
&gt; Fetching value of define &quot;__AVX512CD__&quot; :<br>
&gt; Fetching value of define &quot;__AVX512DQ__&quot; :<br>
&gt; Fetching value of define &quot;__AVX512F__&quot; :<br>
&gt; Fetching value of define &quot;__AVX512VL__&quot; :<br>
&gt; ...<br>
&gt; Run-time dependency jansson found: NO (tried pkgconfig and cmake)<br>
&gt; ...<br>
&gt; <br>
&gt; <br>
&gt; The Unit tests env does not have a AVX512 enabled toolchain, or<br>
&gt; something in meson disables it, hence the compilation fails and the<br>
&gt; unit tests are marked as failed while it has nothing to do with<br>
&gt; functional tests.<br>
&gt; <br>
<br>
FYI: The original release of Ubuntu 18.04 had broken AVX-512 support<br>
in binutils. However, the fix for that issue has recently been <br>
backported to 18.04, so running &quot;apt-get update &amp;&amp; apt-get upgrade&quot;<br>
should fix that support.<br>
<br>
/Bruce<br>
<br>
PS: Yes, I&#39;m old-skool and use apt-get rather than just &quot;apt&quot;. I<br>
don&#39;t like how plain apt does fancy things with the terminal for<br>
the progress bar! 😊<br>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span><p dir="ltr" style="line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">Brandon Lo</span></p><p dir="ltr" style="line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">UNH InterOperability Laboratory</span></p><p dir="ltr" style="line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;vertical-align:baseline;white-space:pre-wrap">21 Madbury Rd, Suite 100, Durham, NH 03824</span></p><p dir="ltr" style="line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:Arial;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><a href="mailto:blo@iol.unh.edu" target="_blank">blo@iol.unh.edu</a></span></p><p dir="ltr" style="line-height:1.2;margin-top:0pt;margin-bottom:0pt"><span style="font-size:10pt;font-family:Arial;color:rgb(17,85,204);background-color:transparent;vertical-align:baseline;white-space:pre-wrap"><a href="http://www.iol.unh.edu/" target="_blank">www.iol.unh.edu</a></span></p></span></div></div></div></div>

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, back to index

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-10-25  8:35 [dpdk-ci] Compiling dpdk in non compilation tests David Marchand
2020-10-27  9:17 ` Richardson, Bruce
2020-10-27 13:41   ` [dpdk-ci] [dpdklab] " Brandon Lo

DPDK CI discussions

Archives are clonable:
	git clone --mirror http://inbox.dpdk.org/ci/0 ci/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 ci ci/ http://inbox.dpdk.org/ci \
		ci@dpdk.org
	public-inbox-index ci


Newsgroup available over NNTP:
	nntp://inbox.dpdk.org/inbox.dpdk.ci


AGPL code for this site: git clone https://public-inbox.org/ public-inbox