From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id E3F80432CA; Tue, 7 Nov 2023 21:28:24 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C22BC40698; Tue, 7 Nov 2023 21:28:24 +0100 (CET) Received: from mail-yb1-f181.google.com (mail-yb1-f181.google.com [209.85.219.181]) by mails.dpdk.org (Postfix) with ESMTP id ED7764025E for ; Tue, 7 Nov 2023 21:28:23 +0100 (CET) Received: by mail-yb1-f181.google.com with SMTP id 3f1490d57ef6-da2b9234a9fso6328712276.3 for ; Tue, 07 Nov 2023 12:28:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1699388903; x=1699993703; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=SAzMc0OU1qBiHnV9LNMP6RKewwgnHs33RO99DVIcPYU=; b=KS8Jd/jHEXx44dtPs4v1n8YJAff+y8ILPMvFB1P8RpuZCArXY9XMbrwOOtCOhtQzxc +HgB5s4w5GQTgEuadiOTuiyy5JYCKjEpNb5GxqG+GiCuemV2gW4aOaovbUC37pmMfZ4V EWJXuurdT/hTiH9nF1v6CByhSFCPa4zXvS2rk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1699388903; x=1699993703; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=SAzMc0OU1qBiHnV9LNMP6RKewwgnHs33RO99DVIcPYU=; b=EUWuB1MV3dDtyFCOdv0yt8qZD0bZfZRhIPzaAWn+ufy/sSm0afSdombsnwvXmVojwZ IFfZh1ohRPatpA665eR70kbF7KW3j3bzJAXwfNpx8mANwKv3Fa3P7h/V4oTW9E7vN4AE WMtHKolxO6lqm9Lvj6gFClnhh6xgBfpGU+nY50ZpgoDD/rEo4y+Ynw4yWEyHIga6trlT nu0o37028RHZAootmKWGFwv1lIYF4K8EbGP3X68IrBVwv05lotPj07olhEgEFxtKD5LH oea/boXQRoH5nl5Ji0z32NwmTvV9pVXolrPssOjDJ8tjDS6nslHrOjcWascyTAFrKtye C4qA== X-Gm-Message-State: AOJu0YwG/x5h5rip3oCLhGCI8Ab6m2KvK2swF0JGEtPJ4fDicY9CcMPe E3pRK3EoJNChOq0im08Mjq9lLtfscuyjezqi3lRgKg== X-Google-Smtp-Source: AGHT+IGX4oscgwtd+/3iJ4ZiqpX6xxUzQcKg7ZqlrCdASroJmZNoq0V9pwN5hjXb7uJdGljJs7pEME2Bx35EMLGW030= X-Received: by 2002:a25:c5c6:0:b0:da0:3b47:bf0c with SMTP id v189-20020a25c5c6000000b00da03b47bf0cmr32962874ybe.20.1699388901681; Tue, 07 Nov 2023 12:28:21 -0800 (PST) MIME-Version: 1.0 References: <7788077c-4e0b-f68f-2e09-3994a49ae715@oktetlabs.ru> <1f53aade-73a7-baaf-aecb-2b9a33ab6682@oktetlabs.ru> <4979713b-8e5f-417b-b1af-21f54130eab7@oktetlabs.ru> <8e26b8e6-8d8b-4925-9b30-3fbc5e103e18@oktetlabs.ru> In-Reply-To: <8e26b8e6-8d8b-4925-9b30-3fbc5e103e18@oktetlabs.ru> From: Adam Hassick Date: Tue, 7 Nov 2023 15:30:20 -0500 Message-ID: Subject: Re: Setting up DPDK PMD Test Suite To: Andrew Rybchenko Cc: Konstantin Ushakov , Patrick Robb , ci@dpdk.org Content-Type: multipart/alternative; boundary="000000000000d20354060995cfc3" X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org --000000000000d20354060995cfc3 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Andrew, The runner machine was missing a dependency for one of the scripts, "pixz". After installing that, it appears to have worked. I can see the results listed on the ts-factory Bublik instance. In the latest revision of ts-rigs, there appears to be a syntax error at line 42 within the script located at "ts-rigs/scripts/publish_logs/prj/ts-factory/publish", within the if condition. I fixed it locally to get it to run. Taking a quick look at a comparison against your most recent X710 run, it looks like we're NOK on around ~400 more test cases. By percentage of tests, we're 1% off, however, it looks like whole subsets of the test suite that contain low numbers of tests are failing. I wonder if this is due to differences between the Intel X710 and XL710 or issues in our dev testbed. Thanks, Adam On Tue, Nov 7, 2023 at 11:58=E2=80=AFAM Andrew Rybchenko < andrew.rybchenko@oktetlabs.ru> wrote: > Hi Adam, > > I see no attempt to publish logs, so I guess something went wrong. Please= , > let me know if you need any help from me. Hopefully there is no need to > rerun tests and publish could be debugged using ./scripts/publish_logs. > > Andrew. > > On 11/7/23 02:16, Adam Hassick wrote: > > Hi Andrew, > > I've started a test run, it should finish at some point overnight. I > tested the authentication and it seems to work, fingers crossed that we s= ee > some results appear tomorrow. > > Thanks, > Adam > > On Fri, Oct 27, 2023 at 3:13=E2=80=AFPM Andrew Rybchenko < > andrew.rybchenko@oktetlabs.ru> wrote: > >> Hi Adam, >> >> fresh ts-rigs-sample has all required bindings to publish logs to >> ts-factory.io. See the top-most commit. >> So, you just need tune SSH to use correct user, port and key for >> ts-factory.io. You can add below settings >> to corresponding user .ssh/config or add corresponding options to sftp >> command in scripts/publish_logs/prj/ts-factory/publish: >> >> Host ts-factory.io >> User unh-iol >> Port 56777 >> IdentitiesOnly yes >> IdentityFile >> >> The publishing is asynchronous in ts-factory case. i.e. user puts logs >> and cron job checks incoming directory every 10 minutes and publish foun= d >> logs. >> >> You can request publishing when you start testing using --publish option >> or publish previous run testing results using ./scripts/publish_logs fro= m >> dpdk-ethdev-ts sources. PWD should be the directory you run tests from. >> >> Please, let me know how it goes. >> >> Regards, >> Andrew. >> >> (dropped history, since it became too big and require moderation) >> > > --000000000000d20354060995cfc3 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Andrew,

The runne= r machine was missing a dependency for one of the scripts, "pixz"= . After installing that, it appears to have worked. I can see the results l= isted on the ts-factory Bublik instance.
In the latest revision of= ts-rigs, there appears to be a syntax error at line 42 within the script l= ocated at "ts-rigs/scripts/publish_logs/prj/ts-factory/publish", = within the if condition. I fixed it locally to get it to run.

= Taking a quick look at a comparison against your most recent X710 run, it l= ooks like we're NOK on around ~400 more test cases. By percentage of te= sts, we're 1% off, however, it looks like whole subsets of the test sui= te that contain low numbers of tests are failing. I wonder if this is due t= o differences between the Intel X710 and XL710 or issues in our dev testbed= .

Thanks,
Adam

On Tue, Nov 7, 2023 at 1= 1:58=E2=80=AFAM Andrew Rybchenko <andrew.rybchenko@oktetlabs.ru> wrote:
=20 =20 =20
Hi Adam,

I see no attempt to publish logs, so I guess something went wrong. Please, let me know if you need any help from me. Hopefully there is no need to rerun tests and publish could be debugged using ./scripts/publish_logs.

Andrew.

On 11/7/23 02:16, Adam Hassick wrote:
=20
Hi Andrew,

I've started a test run, it should finish at some point overnight. I tested the authentication and it seems to work, fingers crossed that we see some results appear tomorrow.

Thanks,
Adam

On Fri, Oct 27, 2023 at 3:13=E2=80=AFPM Andrew Rybchenko <andrew.rybchenko@oktetlabs.ru>= ; wrote:
Hi Adam,

fresh ts-rigs-sample has all required bindings to publish logs to ts= -factory.io. See the top-most commit.
So, you just need tune SSH to use correct user, port and key for ts= -factory.io. You=C2=A0 can add below settings
to corresponding user .ssh/config or add corresponding options to sftp command in scripts/publish_logs/prj/ts-factory/publish:

Host ts-fa= ctory.io
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 User unh-iol
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Port 56777
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IdentitiesOnly yes=
=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 IdentityFile <p= ath-to-private-key>

The publishing is asynchronous in ts-factory case. i.e. user puts logs and cron job checks incoming directory every 10 minutes and publish found logs.

You can request publishing when you start testing using --publish option or publish previous run testing results using ./scripts/publish_logs from dpdk-ethdev-ts sources. PWD should be the directory you run tests from.

Please, let me know how it goes.

Regards,
Andrew.

(dropped history, since it became too big and require moderation)

--000000000000d20354060995cfc3--