From mboxrd@z Thu Jan 1 00:00:00 1970
Return-Path: <ci-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
by inbox.dpdk.org (Postfix) with ESMTP id DBCFE43C2E;
Wed, 28 Feb 2024 21:00:17 +0100 (CET)
Received: from mails.dpdk.org (localhost [127.0.0.1])
by mails.dpdk.org (Postfix) with ESMTP id D4B39402C7;
Wed, 28 Feb 2024 21:00:17 +0100 (CET)
Received: from mail-oo1-f54.google.com (mail-oo1-f54.google.com
[209.85.161.54]) by mails.dpdk.org (Postfix) with ESMTP id 2B7DE4029F
for <ci@dpdk.org>; Wed, 28 Feb 2024 21:00:16 +0100 (CET)
Received: by mail-oo1-f54.google.com with SMTP id
006d021491bc7-5a04fb5e689so60836eaf.1
for <ci@dpdk.org>; Wed, 28 Feb 2024 12:00:16 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=iol.unh.edu; s=unh-iol; t=1709150415; x=1709755215; darn=dpdk.org;
h=cc:to:subject:message-id:date:from:in-reply-to:references
:mime-version:from:to:cc:subject:date:message-id:reply-to;
bh=IZMAl8zreSCyZnjLvdxTozIJcGvnNsQtMWBD0IUB2lQ=;
b=S8P3gDlmC/HMxUg2xjujYzjXIcd9TurPJuQ/kfPpkxsPE5PVrhKXS+Hcv+dBpcpBxq
Kc1DHd22qCbDaGBYsfS4SoLv5jlNRYg1ZJt55/Cl6nUId4e8Z3JzxEsfsYkCXchrXfhb
AN2EZSDGGMqW2Jq71ij+V5SHnNJL9KuAatUek=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1709150415; x=1709755215;
h=cc:to:subject:message-id:date:from:in-reply-to:references
:mime-version:x-gm-message-state:from:to:cc:subject:date:message-id
:reply-to;
bh=IZMAl8zreSCyZnjLvdxTozIJcGvnNsQtMWBD0IUB2lQ=;
b=KamHLLdlddJdKXwhRIXKPbMFjhRx5r0UD9pAxgbYXjf0RSvb5DTU0Rex7Bv+Nmtnmw
19Kd/km1gBENC9w2ICfUCmYQHDUHB58IFWkzN0uQ/BBANb6/c2TDJ1rbN/PUGw57VuGA
/PPmjK0Rz0EJjmlviOm9aNgUYui6kvsCQIjvKCudVGWQ8hCobCNXOCJ6Eb5nl9nvRtAb
G462Kkghz7Us246LwOxhYDFvslisc9yNY9dzUfcfAT5F/H/QdgA/x0AfjELebdZKIVMY
dQg3/n7sCXUrWzcqMMtrL8lO5NHqbbdZychyyAu4yi4shQywIAQ8VZkD9nqPkpPffAiK
9lfw==
X-Forwarded-Encrypted: i=1;
AJvYcCU44ynXAaydoH0pIpKCTYEaPszAEG5ipatWy9MR967KPIUAmtHADn9L2jRwbhpbZ3AWs8M7rBiJSQXGrA==
X-Gm-Message-State: AOJu0Yxslitx9u6aSj7crJBREVAN/Of6666j8jovQvUN6M9J/JQ6udYZ
t5/+utlc0lvDDBesKLiS3PkXE5llTvYZHwfRNYC6wr4tLKoU8JFC3YBwVIpazVEtieCMPYZJTT4
m1aKj5Fmjo1dE0fvxB6Atqi/uqZ4VWKYGiRjx3g==
X-Google-Smtp-Source: AGHT+IE5UupDAxB2CTH3EqY+KlnOWH7n3TAOcLBcGSuK+Jy6TPIwyj5GMCoIb5HT9kHXoq/kC88CLenBvq2FD/puZdI=
X-Received: by 2002:a4a:2404:0:b0:5a0:cdd1:7f8e with SMTP id
m4-20020a4a2404000000b005a0cdd17f8emr140738oof.1.1709150415258; Wed, 28 Feb
2024 12:00:15 -0800 (PST)
MIME-Version: 1.0
References: <CAJvnSUCeHvf7dLo4KiV0GVrgMVaGT9zWbYDmUP-WMpj=5Bv3mw@mail.gmail.com>
<AS8PR08MB7080BFD3E3C508EED8C88FE19E09A@AS8PR08MB7080.eurprd08.prod.outlook.com>
<CAOb5WZaGmQVLuLo9=ZBVtRh6-2=9vtS-foJN3GZerjaq17e6ow@mail.gmail.com>
<AS8PR08MB70800D8F0315FFCE194C4FB99E0DA@AS8PR08MB7080.eurprd08.prod.outlook.com>
<CAJvnSUB0fOmVBng=omuvP0sBMmhz3=gFO-SVXzNzBYp9d-zKHQ@mail.gmail.com>
<CAOb5WZZ9eR9JBv825RLo1zqYM0hcD=Fozzqt4m7JeGUeVSO0gA@mail.gmail.com>
<CAJvnSUC06FuPoubSe7=vzs2_hg_LZ=f7Di=g7nV4qqBSKis-tw@mail.gmail.com>
<CAOb5WZZqHs3nZiVn5TY1iVk5Ao6mw=kmvBgUFwBw85U64F2V1g@mail.gmail.com>
<CAJvnSUAwUDqar1juNVbadUQ=LsTJYWHjV6pvNCn9vVEff_Cvxg@mail.gmail.com>
<AS8PR08MB7080C4E3F45C92F26EE79C4F9EFCA@AS8PR08MB7080.eurprd08.prod.outlook.com>
<CAJvnSUD+g--7c79q-OHHY4-XBzqTqdtzKmGH7jjvYwhrD5DnZg@mail.gmail.com>
<CAJvnSUCdX5F0_XRZ-N16rf-WRLjaWnAiV+bjMqZ0hZcVn4n8fQ@mail.gmail.com>
<AS4PR08MB755371CDAF5C105050D64850F7CDA@AS4PR08MB7553.eurprd08.prod.outlook.com>
<CAJvnSUA2XONXmcAcyBo73rWswkmMDqQsGes+it0u=j8Tiwgidg@mail.gmail.com>
<CAOb5WZZJgGbBr8r1azk5C35mxx64sfw9a6LHFhn15ZJpgnigRQ@mail.gmail.com>
<CAJvnSUA0F2RAYhXbN40zhP61OQ+Z1fvj3i-GBK1jQNC0sFo1PA@mail.gmail.com>
<CAJvnSUB1Wns-Ub3zNyUWotipZ2f23jF=NQxUS6v8_b8W9kNCQg@mail.gmail.com>
<AS8PR08MB7080E48001CD0368EA45D1A69EB2A@AS8PR08MB7080.eurprd08.prod.outlook.com>
<CAJvnSUCX+ftoRbhjx2hyQ6VuwULjiL1DgtqOGESQ972YNKznRw@mail.gmail.com>
<EFC730AB-51DB-404E-96A9-D7736E67FDA3@arm.com>
In-Reply-To: <EFC730AB-51DB-404E-96A9-D7736E67FDA3@arm.com>
From: Patrick Robb <probb@iol.unh.edu>
Date: Wed, 28 Feb 2024 15:00:04 -0500
Message-ID: <CAJvnSUDmdUSBbUdK2Wc9Ag7wyn-ffggwy6wXpfa_DSo+Z-htZg@mail.gmail.com>
Subject: Re: Intel QAT 8970 accel card on ARM Ampere Server
To: Honnappa Nagarahalli <Honnappa.Nagarahalli@arm.com>
Cc: Ruifeng Wang <Ruifeng.Wang@arm.com>,
=?UTF-8?Q?Juraj_Linke=C5=A1?= <juraj.linkes@pantheon.tech>,
Dharmik Jayesh Thakkar <DharmikJayesh.Thakkar@arm.com>,
David Marchand <david.marchand@redhat.com>,
"ci@dpdk.org" <ci@dpdk.org>, nd <nd@arm.com>,
Wathsala Wathawana Vithanage <wathsala.vithanage@arm.com>,
Paul Szczepanek <Paul.Szczepanek@arm.com>
Content-Type: multipart/alternative; boundary="0000000000005ea1280612769799"
X-BeenThere: ci@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: DPDK CI discussions <ci.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/ci>,
<mailto:ci-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/ci/>
List-Post: <mailto:ci@dpdk.org>
List-Help: <mailto:ci-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/ci>,
<mailto:ci-request@dpdk.org?subject=subscribe>
Errors-To: ci-bounces@dpdk.org
--0000000000005ea1280612769799
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
quick update:
I could bind the QAT VFs to vfio-pci after using the module loading options
Dharmik mentioned.
First I tested SYM QAT pmd from dpdk test on the VF and got:
+ Tests Total : 751
+ Tests Skipped : 257
+ Tests Executed : 659
+ Tests Unsupported: 0
+ Tests Passed : 494
+ Tests Failed : 0
+ ------------------------------------------------------- +
Test OK
I can try the crypto performance DTS testsuite next. Let me know if you
have any thoughts.
On Tue, Feb 27, 2024 at 8:51=E2=80=AFAM Honnappa Nagarahalli <
Honnappa.Nagarahalli@arm.com> wrote:
> + Paul, Wathsala
>
> > On Feb 27, 2024, at 12:58=E2=80=AFAM, Patrick Robb <probb@iol.unh.edu> =
wrote:
> >
> >
> >
> > On Tue, Nov 14, 2023 at 2:35=E2=80=AFAM Ruifeng Wang <Ruifeng.Wang@arm.=
com>
> wrote:
> > Hi Patrick,
> > It seems kernel v5.15 has a defect on this. A similar issue was fixed
> by commit:
> > 40da865381ad ("crypto: qat - remove unneeded packed attribute")
> > Could you patch the kernel and try again?
> >
> https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit=
/?id=3D40da865381ad061ab75a7a9da469ed4e623bdfeb
> > Thanks,
> > Ruifeng
> >
> > Hi Ruifeng,
> >
> > Sorry for the delay on this - there has been a work item backlog at the
> Community Lab we've been working through.
> >
> > I did rebuild the patch today with these changes from the commit (or
> similar, as the commit above was for the qat_common file in a different
> state, but I tried to remain as true to the commit as possible).
> >
> > And that does seem to have resolved the seg fault problem! Thank you so
> much for picking this commit out of obscurity and sending it our way!
> >
> > root@arm-ampere-dut:~# echo 16 >
> /sys/bus/pci/drivers/c6xx/0000:03:00.0/sriov_numvfs
> > root@arm-ampere-dut:~# cat
> /sys/bus/pci/drivers/c6xx/0000:03:00.0/sriov_numvfs
> > 16
> >
> > Wunderbar!
> >
> > The only other thing I changed (just because I was floating the idea
> with Dharmik before) was in the kernel .config I changed the qat_c62x and
> qat_c62xvf modules from statically built in (=3Dy) to loadable (=3Dm). Of
> course, this should not matter, and I presume the change in behavior
> relates to those brought in from the commit above. I just want to present
> fully all changes made so there is a complete picture.
> >
> > I will continue on this tomorrow according to where this conversation
> left off, and try to move this quickly. If indeed there are no more
> blockers I think we are very close. As a reminder, when standing up a new
> testing plan, we want to make sure at least 1 rep from each vendor has SS=
H
> access and can remotely login to help with system tuning, troubleshooting=
,
> etc. for the testbed and test plan. Who would be the best person from ARM
> for this at this time, given the context on QAT testing? Ruifeng? Dharmik=
?
> Someone else?
> >
> > Thanks, I'll keep yall apprised of the situation.
> >
>
>
--0000000000005ea1280612769799
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
<div dir=3D"ltr"><div>quick update:</div><div><br></div><div>I could bind t=
he QAT VFs to vfio-pci after using the module loading options Dharmik menti=
oned.=C2=A0</div><div><br></div><div>First I tested SYM QAT pmd from dpdk t=
est on the=C2=A0VF and got:</div><div><br></div><div>=C2=A0+ Tests Total : =
=C2=A0 =C2=A0 =C2=A0 751<br>=C2=A0+ Tests Skipped : =C2=A0 =C2=A0 257<br>=
=C2=A0+ Tests Executed : =C2=A0 =C2=A0659<br>=C2=A0+ Tests Unsupported: =C2=
=A0 0<br>=C2=A0+ Tests Passed : =C2=A0 =C2=A0 =C2=A0494<br>=C2=A0+ Tests Fa=
iled : =C2=A0 =C2=A0 =C2=A0 0<br>=C2=A0+ ----------------------------------=
--------------------- +<br>Test OK<br></div><div><br></div><div>I can try t=
he crypto performance DTS testsuite next. Let me know if you have any thoug=
hts.</div><div><br></div><div><br></div><br><div class=3D"gmail_quote"><div=
dir=3D"ltr" class=3D"gmail_attr">On Tue, Feb 27, 2024 at 8:51=E2=80=AFAM H=
onnappa Nagarahalli <<a href=3D"mailto:Honnappa.Nagarahalli@arm.com">Hon=
nappa.Nagarahalli@arm.com</a>> wrote:<br></div><blockquote class=3D"gmai=
l_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,20=
4,204);padding-left:1ex">+ Paul, Wathsala<br>
<br>
> On Feb 27, 2024, at 12:58=E2=80=AFAM, Patrick Robb <<a href=3D"mail=
to:probb@iol.unh.edu" target=3D"_blank">probb@iol.unh.edu</a>> wrote:<br=
>
> <br>
> <br>
> <br>
> On Tue, Nov 14, 2023 at 2:35=E2=80=AFAM Ruifeng Wang <<a href=3D"ma=
ilto:Ruifeng.Wang@arm.com" target=3D"_blank">Ruifeng.Wang@arm.com</a>> w=
rote:<br>
> Hi Patrick,<br>
>=C2=A0 It seems kernel v5.15 has a defect on this. A similar issue was =
fixed by commit:<br>
> 40da865381ad ("crypto: qat - remove unneeded packed attribute&quo=
t;)<br>
>=C2=A0 Could you patch the kernel and try again?<br>
> <a href=3D"https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/li=
nux.git/commit/?id=3D40da865381ad061ab75a7a9da469ed4e623bdfeb" rel=3D"noref=
errer" target=3D"_blank">https://git.kernel.org/pub/scm/linux/kernel/git/to=
rvalds/linux.git/commit/?id=3D40da865381ad061ab75a7a9da469ed4e623bdfeb</a><=
br>
>=C2=A0 Thanks,<br>
> Ruifeng<br>
>=C2=A0 <br>
> Hi Ruifeng,<br>
> <br>
> Sorry for the delay on this - there has been a work item backlog at th=
e Community Lab we've been working through. <br>
> <br>
> I did rebuild the patch today with these changes from the commit (or s=
imilar, as the commit above was for the qat_common file in a different stat=
e, but I tried to remain as true to the commit as possible). <br>
> <br>
> And that does seem to have resolved the seg fault problem! Thank you s=
o much for picking this commit out of obscurity and sending it our way! <br=
>
> <br>
> root@arm-ampere-dut:~# echo 16 > /sys/bus/pci/drivers/c6xx/0000:03:=
00.0/sriov_numvfs<br>
> root@arm-ampere-dut:~# cat /sys/bus/pci/drivers/c6xx/0000:03:00.0/srio=
v_numvfs<br>
> 16<br>
> <br>
> Wunderbar!<br>
> <br>
> The only other thing I changed (just because I was floating the idea w=
ith Dharmik before) was in the kernel .config I changed the qat_c62x and qa=
t_c62xvf modules from statically built in (=3Dy) to loadable (=3Dm). Of cou=
rse, this should not matter, and I presume the change in behavior relates t=
o those brought in from the commit above. I just want to present fully all =
changes made so there is a complete picture. <br>
> <br>
> I will continue on this tomorrow according to where this conversation =
left off, and try to move this quickly. If indeed there are no more blocker=
s I think we are very close. As a reminder, when standing up a new testing =
plan, we want to make sure at least 1 rep from each vendor has SSH access a=
nd can remotely login to help with system tuning, troubleshooting, etc. for=
the testbed and test plan. Who would be the best person from ARM for this =
at this time, given the context on QAT testing? Ruifeng? Dharmik? Someone e=
lse? <br>
> <br>
> Thanks, I'll keep yall apprised of the situation.<br>
> <br>
<br>
</blockquote></div><br clear=3D"all"><div><br></div></div>
--0000000000005ea1280612769799--