From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id DBCFE43C2E; Wed, 28 Feb 2024 21:00:17 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D4B39402C7; Wed, 28 Feb 2024 21:00:17 +0100 (CET) Received: from mail-oo1-f54.google.com (mail-oo1-f54.google.com [209.85.161.54]) by mails.dpdk.org (Postfix) with ESMTP id 2B7DE4029F for ; Wed, 28 Feb 2024 21:00:16 +0100 (CET) Received: by mail-oo1-f54.google.com with SMTP id 006d021491bc7-5a04fb5e689so60836eaf.1 for ; Wed, 28 Feb 2024 12:00:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iol.unh.edu; s=unh-iol; t=1709150415; x=1709755215; darn=dpdk.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=IZMAl8zreSCyZnjLvdxTozIJcGvnNsQtMWBD0IUB2lQ=; b=S8P3gDlmC/HMxUg2xjujYzjXIcd9TurPJuQ/kfPpkxsPE5PVrhKXS+Hcv+dBpcpBxq Kc1DHd22qCbDaGBYsfS4SoLv5jlNRYg1ZJt55/Cl6nUId4e8Z3JzxEsfsYkCXchrXfhb AN2EZSDGGMqW2Jq71ij+V5SHnNJL9KuAatUek= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1709150415; x=1709755215; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=IZMAl8zreSCyZnjLvdxTozIJcGvnNsQtMWBD0IUB2lQ=; b=KamHLLdlddJdKXwhRIXKPbMFjhRx5r0UD9pAxgbYXjf0RSvb5DTU0Rex7Bv+Nmtnmw 19Kd/km1gBENC9w2ICfUCmYQHDUHB58IFWkzN0uQ/BBANb6/c2TDJ1rbN/PUGw57VuGA /PPmjK0Rz0EJjmlviOm9aNgUYui6kvsCQIjvKCudVGWQ8hCobCNXOCJ6Eb5nl9nvRtAb G462Kkghz7Us246LwOxhYDFvslisc9yNY9dzUfcfAT5F/H/QdgA/x0AfjELebdZKIVMY dQg3/n7sCXUrWzcqMMtrL8lO5NHqbbdZychyyAu4yi4shQywIAQ8VZkD9nqPkpPffAiK 9lfw== X-Forwarded-Encrypted: i=1; AJvYcCU44ynXAaydoH0pIpKCTYEaPszAEG5ipatWy9MR967KPIUAmtHADn9L2jRwbhpbZ3AWs8M7rBiJSQXGrA== X-Gm-Message-State: AOJu0Yxslitx9u6aSj7crJBREVAN/Of6666j8jovQvUN6M9J/JQ6udYZ t5/+utlc0lvDDBesKLiS3PkXE5llTvYZHwfRNYC6wr4tLKoU8JFC3YBwVIpazVEtieCMPYZJTT4 m1aKj5Fmjo1dE0fvxB6Atqi/uqZ4VWKYGiRjx3g== X-Google-Smtp-Source: AGHT+IE5UupDAxB2CTH3EqY+KlnOWH7n3TAOcLBcGSuK+Jy6TPIwyj5GMCoIb5HT9kHXoq/kC88CLenBvq2FD/puZdI= X-Received: by 2002:a4a:2404:0:b0:5a0:cdd1:7f8e with SMTP id m4-20020a4a2404000000b005a0cdd17f8emr140738oof.1.1709150415258; Wed, 28 Feb 2024 12:00:15 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Patrick Robb Date: Wed, 28 Feb 2024 15:00:04 -0500 Message-ID: Subject: Re: Intel QAT 8970 accel card on ARM Ampere Server To: Honnappa Nagarahalli Cc: Ruifeng Wang , =?UTF-8?Q?Juraj_Linke=C5=A1?= , Dharmik Jayesh Thakkar , David Marchand , "ci@dpdk.org" , nd , Wathsala Wathawana Vithanage , Paul Szczepanek Content-Type: multipart/alternative; boundary="0000000000005ea1280612769799" X-BeenThere: ci@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK CI discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: ci-bounces@dpdk.org --0000000000005ea1280612769799 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable quick update: I could bind the QAT VFs to vfio-pci after using the module loading options Dharmik mentioned. First I tested SYM QAT pmd from dpdk test on the VF and got: + Tests Total : 751 + Tests Skipped : 257 + Tests Executed : 659 + Tests Unsupported: 0 + Tests Passed : 494 + Tests Failed : 0 + ------------------------------------------------------- + Test OK I can try the crypto performance DTS testsuite next. Let me know if you have any thoughts. On Tue, Feb 27, 2024 at 8:51=E2=80=AFAM Honnappa Nagarahalli < Honnappa.Nagarahalli@arm.com> wrote: > + Paul, Wathsala > > > On Feb 27, 2024, at 12:58=E2=80=AFAM, Patrick Robb = wrote: > > > > > > > > On Tue, Nov 14, 2023 at 2:35=E2=80=AFAM Ruifeng Wang > wrote: > > Hi Patrick, > > It seems kernel v5.15 has a defect on this. A similar issue was fixed > by commit: > > 40da865381ad ("crypto: qat - remove unneeded packed attribute") > > Could you patch the kernel and try again? > > > https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit= /?id=3D40da865381ad061ab75a7a9da469ed4e623bdfeb > > Thanks, > > Ruifeng > > > > Hi Ruifeng, > > > > Sorry for the delay on this - there has been a work item backlog at the > Community Lab we've been working through. > > > > I did rebuild the patch today with these changes from the commit (or > similar, as the commit above was for the qat_common file in a different > state, but I tried to remain as true to the commit as possible). > > > > And that does seem to have resolved the seg fault problem! Thank you so > much for picking this commit out of obscurity and sending it our way! > > > > root@arm-ampere-dut:~# echo 16 > > /sys/bus/pci/drivers/c6xx/0000:03:00.0/sriov_numvfs > > root@arm-ampere-dut:~# cat > /sys/bus/pci/drivers/c6xx/0000:03:00.0/sriov_numvfs > > 16 > > > > Wunderbar! > > > > The only other thing I changed (just because I was floating the idea > with Dharmik before) was in the kernel .config I changed the qat_c62x and > qat_c62xvf modules from statically built in (=3Dy) to loadable (=3Dm). Of > course, this should not matter, and I presume the change in behavior > relates to those brought in from the commit above. I just want to present > fully all changes made so there is a complete picture. > > > > I will continue on this tomorrow according to where this conversation > left off, and try to move this quickly. If indeed there are no more > blockers I think we are very close. As a reminder, when standing up a new > testing plan, we want to make sure at least 1 rep from each vendor has SS= H > access and can remotely login to help with system tuning, troubleshooting= , > etc. for the testbed and test plan. Who would be the best person from ARM > for this at this time, given the context on QAT testing? Ruifeng? Dharmik= ? > Someone else? > > > > Thanks, I'll keep yall apprised of the situation. > > > > --0000000000005ea1280612769799 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
quick update:

I could bind t= he QAT VFs to vfio-pci after using the module loading options Dharmik menti= oned.=C2=A0

First I tested SYM QAT pmd from dpdk t= est on the=C2=A0VF and got:

=C2=A0+ Tests Total : = =C2=A0 =C2=A0 =C2=A0 751
=C2=A0+ Tests Skipped : =C2=A0 =C2=A0 257
= =C2=A0+ Tests Executed : =C2=A0 =C2=A0659
=C2=A0+ Tests Unsupported: =C2= =A0 0
=C2=A0+ Tests Passed : =C2=A0 =C2=A0 =C2=A0494
=C2=A0+ Tests Fa= iled : =C2=A0 =C2=A0 =C2=A0 0
=C2=A0+ ----------------------------------= --------------------- +
Test OK

I can try t= he crypto performance DTS testsuite next. Let me know if you have any thoug= hts.



On Tue, Feb 27, 2024 at 8:51=E2=80=AFAM H= onnappa Nagarahalli <Hon= nappa.Nagarahalli@arm.com> wrote:
+ Paul, Wathsala

> On Feb 27, 2024, at 12:58=E2=80=AFAM, Patrick Robb <probb@iol.unh.edu> wrote: >
>
>
> On Tue, Nov 14, 2023 at 2:35=E2=80=AFAM Ruifeng Wang <Ruifeng.Wang@arm.com> w= rote:
> Hi Patrick,
>=C2=A0 It seems kernel v5.15 has a defect on this. A similar issue was = fixed by commit:
> 40da865381ad ("crypto: qat - remove unneeded packed attribute&quo= t;)
>=C2=A0 Could you patch the kernel and try again?
> https://git.kernel.org/pub/scm/linux/kernel/git/to= rvalds/linux.git/commit/?id=3D40da865381ad061ab75a7a9da469ed4e623bdfeb<= br> >=C2=A0 Thanks,
> Ruifeng
>=C2=A0
> Hi Ruifeng,
>
> Sorry for the delay on this - there has been a work item backlog at th= e Community Lab we've been working through.
>
> I did rebuild the patch today with these changes from the commit (or s= imilar, as the commit above was for the qat_common file in a different stat= e, but I tried to remain as true to the commit as possible).
>
> And that does seem to have resolved the seg fault problem! Thank you s= o much for picking this commit out of obscurity and sending it our way! >
> root@arm-ampere-dut:~# echo 16 > /sys/bus/pci/drivers/c6xx/0000:03:= 00.0/sriov_numvfs
> root@arm-ampere-dut:~# cat /sys/bus/pci/drivers/c6xx/0000:03:00.0/srio= v_numvfs
> 16
>
> Wunderbar!
>
> The only other thing I changed (just because I was floating the idea w= ith Dharmik before) was in the kernel .config I changed the qat_c62x and qa= t_c62xvf modules from statically built in (=3Dy) to loadable (=3Dm). Of cou= rse, this should not matter, and I presume the change in behavior relates t= o those brought in from the commit above. I just want to present fully all = changes made so there is a complete picture.
>
> I will continue on this tomorrow according to where this conversation = left off, and try to move this quickly. If indeed there are no more blocker= s I think we are very close. As a reminder, when standing up a new testing = plan, we want to make sure at least 1 rep from each vendor has SSH access a= nd can remotely login to help with system tuning, troubleshooting, etc. for= the testbed and test plan. Who would be the best person from ARM for this = at this time, given the context on QAT testing? Ruifeng? Dharmik? Someone e= lse?
>
> Thanks, I'll keep yall apprised of the situation.
>



--0000000000005ea1280612769799--