From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <ramirose@gmail.com>
Received: from mail-ed1-f51.google.com (mail-ed1-f51.google.com
 [209.85.208.51]) by dpdk.org (Postfix) with ESMTP id 486BA1B47C
 for <ci@dpdk.org>; Fri,  4 Jan 2019 11:46:09 +0100 (CET)
Received: by mail-ed1-f51.google.com with SMTP id b14so31394483edt.6
 for <ci@dpdk.org>; Fri, 04 Jan 2019 02:46:09 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:from:date:message-id:subject:to;
 bh=9IPaSxkY2QioMs7/OgHos4pZazC5fsBIPzObNQ2pb64=;
 b=HabS4q7tjEV8HlPJqdP4MblT3CIrAEWE3jn7QJoZlDU4/hQC15LO+1S5axFUTJsFL/
 2Om6dbsWbhTxv054Ge1n0C7Q1A6GhhQtwTamC53DHKEmrT7/B9C+8uZcVeuJ3g7sSbMf
 6Rl/beIJriyq6mMJjRZJ/YAXKHfrD8yCukDDF4KWAcXQUP1qyCpzGCq75ulpbXhsTExj
 jNfZ1UqFYWk64ZoK06bLIeDMzMZTrEDCorrs1GfRzXEUE2PPeeTBYsPF0y2sher30Qam
 KzI9QDw1nzoKZ+I/zOIubH6yz0228pqejCEoZ4kS+Ons1RBHf37MxbIT+o3j2Xx4jY4f
 c1Tw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
 bh=9IPaSxkY2QioMs7/OgHos4pZazC5fsBIPzObNQ2pb64=;
 b=OlCl+kBCXXg/9sRNfXJBsgmpPHJ1834O5kgSYjK2Ov+o7S5DRGN0bPISpJ7oIcFz5A
 mJ0ICErQ3TDP6srGyK40Lx3Mys5dWnCM9WOpyekBfFn9ORkRNs28RYn5vmqq4ckBTV7W
 Z7VqC/AxaxwU6pnPKvhSdPK952fNAZtPELjye+7W7SHpPS9WoyUjwefrK3Eyu07ryrLL
 fsw/MQgv9GhjdgU5kerGLD2zRZvtzmF+CNxl6k5YzWMQOHDN2F7pIWHfIm2l/mvLga8+
 oZJU6cCb2fqyRLZs3Re2keZcBEJY602E/xbOPeAdb3CWQFHNzod3YXtehIhRbhw+BPWA
 tb/Q==
X-Gm-Message-State: AJcUukfiIrtXDNibzIvrn3Lokbtw5pLx57++V+YRkWKo1wc2BQgE5skb
 vHdD4op12vfLJvv7hqF767rfJwggGL6TbeVYgN6Ft8VWOdU=
X-Google-Smtp-Source: ALg8bN6FdzTZ35aklFY2YyhG8FjhhgYCCBqRNGGS8jAgXQ22uB0UOlcL/wsbi/CzD6328phCfePKLw6PGURNoh8ztKA=
X-Received: by 2002:a17:906:4a0d:: with SMTP id
 w13-v6mr10778120eju.128.1546598768698; 
 Fri, 04 Jan 2019 02:46:08 -0800 (PST)
MIME-Version: 1.0
From: Rami Rosen <ramirose@gmail.com>
Date: Fri, 4 Jan 2019 12:45:58 +0200
Message-ID: <CAHLOa7TnitO=wrB69B3b8BEvrV_va1pXrAGwUe+0euioQy1PZQ@mail.gmail.com>
To: ci@dpdk.org
Content-Type: multipart/alternative; boundary="00000000000037ed71057e9f96b0"
Subject: [dpdk-ci] Question about performance test
X-BeenThere: ci@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK CI discussions <ci.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/ci>,
 <mailto:ci-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/ci/>
List-Post: <mailto:ci@dpdk.org>
List-Help: <mailto:ci-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/ci>,
 <mailto:ci-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Fri, 04 Jan 2019 10:46:09 -0000

--00000000000037ed71057e9f96b0
Content-Type: text/plain; charset="UTF-8"

Hi,
I have a question about DPDK CI process and the tests done when a patch is
submitted to dpdk-dev mailing list.
In DPDK patch work I see these response messages from the DPDK CI for all
patches:

...
ci/intel-Performance-Testing success Performance Testing PASS
ci/mellanox-Performance-Testing success Performance Testing PASS
...

My question is (I hope and believe the info is available publicly) : which
tests are run in the ci, generating these messages?  is it done with IXIA
and DTS ? (DPDK test suite, https://doc.dpdk.org/dts/gsg/) ? are these
l2fwd/l3fwd performance tests? or more than that ? and on which
Intel/Mellanox nics ?  Are these merely performance tests, or also
functional tests ?

And BTW, I noticed that the CI runs a full performance cycle also for doc
patches (at least these messages are generated), which is a kind of
redundant (unless there is some filter which checks that if a patch only
affects modules under "doc", than such a cycle is not done but the messages
are still sent)

Regards,
Rami Rosen

--00000000000037ed71057e9f96b0
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D"ltr">Hi,<div>I have a questio=
n about DPDK CI process and the tests done when a patch is submitted to dpd=
k-dev mailing list.</div><div>In DPDK patch work I see these response messa=
ges from the DPDK CI for all patches:</div><div><br></div><div>...</div><di=
v><div><div><font color=3D"#333333" face=3D"Helvetica Neue, Helvetica, Aria=
l, sans-serif"><span style=3D"font-size:14px">ci/intel-Performance-Testing<=
span style=3D"white-space:pre">	</span>success<span style=3D"white-space:pr=
e">	</span>Performance Testing PASS</span></font></div><div><font color=3D"=
#333333" face=3D"Helvetica Neue, Helvetica, Arial, sans-serif"><span style=
=3D"font-size:14px">ci/mellanox-Performance-Testing<span style=3D"white-spa=
ce:pre">	</span>success<span style=3D"white-space:pre">	</span>Performance =
Testing PASS=C2=A0</span></font></div></div><div><font color=3D"#333333" fa=
ce=3D"Helvetica Neue, Helvetica, Arial, sans-serif"><span style=3D"font-siz=
e:14px">...</span></font></div><div><font color=3D"#333333" face=3D"Helveti=
ca Neue, Helvetica, Arial, sans-serif"><span style=3D"font-size:14px"><br><=
/span></font></div><div><font color=3D"#333333" face=3D"Helvetica Neue, Hel=
vetica, Arial, sans-serif"><span style=3D"font-size:14px">My question is (I=
 hope and believe the info is available publicly) : which tests are run in =
the ci, generating these messages?=C2=A0 is it done with IXIA and DTS ? (DP=
DK test suite,=C2=A0<a href=3D"https://doc.dpdk.org/dts/gsg/">https://doc.d=
pdk.org/dts/gsg/</a>) ? are these l2fwd/l3fwd performance tests? or more th=
an that ? and on which Intel/Mellanox nics ?=C2=A0</span></font><span style=
=3D"font-size:14px;color:rgb(51,51,51);font-family:&quot;Helvetica Neue&quo=
t;,Helvetica,Arial,sans-serif">=C2=A0Are these merely performance tests, or=
 also=C2=A0</span></div><div><font color=3D"#333333" face=3D"Helvetica Neue=
, Helvetica, Arial, sans-serif"><span style=3D"font-size:14px">functional t=
ests ?=C2=A0</span></font></div><div><span style=3D"font-size:14px;color:rg=
b(51,51,51);font-family:&quot;Helvetica Neue&quot;,Helvetica,Arial,sans-ser=
if"><br></span></div><div><font color=3D"#333333" face=3D"Helvetica Neue, H=
elvetica, Arial, sans-serif"><span style=3D"font-size:14px">And BTW, I noti=
ced that the CI runs a full performance cycle also for doc patches (at leas=
t these messages are generated), which is a kind of redundant (unless there=
 is some filter which checks that if a patch only affects modules under &qu=
ot;doc&quot;, than such a cycle is not done but the messages are still sent=
)<br></span></font></div><div><br></div><div dir=3D"ltr" class=3D"gmail_sig=
nature"><div dir=3D"ltr">Regards,<br><div>Rami Rosen<br></div></div></div><=
/div></div></div></div>

--00000000000037ed71057e9f96b0--