From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5D84042B6D; Mon, 22 May 2023 08:47:34 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3BECE410DD; Mon, 22 May 2023 08:47:34 +0200 (CEST) Received: from inbox.dpdk.org (inbox.dpdk.org [95.142.172.178]) by mails.dpdk.org (Postfix) with ESMTP id 87BC5410D1 for ; Mon, 22 May 2023 08:47:32 +0200 (CEST) Received: by inbox.dpdk.org (Postfix, from userid 33) id 6FEC342B6E; Mon, 22 May 2023 08:47:32 +0200 (CEST) From: bugzilla@dpdk.org To: dev@dpdk.org Subject: [Bug 1235] [dpdk-23.07]basic_4k_pages_cbdma: start dpdk-testpmd with dmas and `--no-huge ` parameters failed Date: Mon, 22 May 2023 06:47:31 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: DPDK X-Bugzilla-Component: vhost/virtio X-Bugzilla-Version: 23.07 X-Bugzilla-Keywords: X-Bugzilla-Severity: normal X-Bugzilla-Who: weix.ling@intel.com X-Bugzilla-Status: UNCONFIRMED X-Bugzilla-Resolution: X-Bugzilla-Priority: Normal X-Bugzilla-Assigned-To: dev@dpdk.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter target_milestone Message-ID: Content-Type: multipart/alternative; boundary=16847380520.29c40f9.482122 Content-Transfer-Encoding: 7bit X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All MIME-Version: 1.0 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --16847380520.29c40f9.482122 Date: Mon, 22 May 2023 08:47:32 +0200 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All https://bugs.dpdk.org/show_bug.cgi?id=3D1235 Bug ID: 1235 Summary: [dpdk-23.07]basic_4k_pages_cbdma: start dpdk-testpmd with dmas and `--no-huge ` parameters failed Product: DPDK Version: 23.07 Hardware: All OS: All Status: UNCONFIRMED Severity: normal Priority: Normal Component: vhost/virtio Assignee: dev@dpdk.org Reporter: weix.ling@intel.com Target Milestone: --- [Environment] DPDK version: Use make showversion or for a non-released version: git remot= e -v && git show-ref --heads 23.07.0-rc0 Other software versions: N/A OS: Ubuntu 22.04.2 LTS/Linux 5.15.45-051545-generic Compiler: gcc version 11.3.0 (Ubuntu 11.3.0-1ubuntu1~22.04) Hardware platform: Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz NIC hardware: N/A NIC firmware: N/A [Test Setup] Steps to reproduce List the steps to reproduce the issue. 1.Apply the DMA related local patch, and then build DPDK. the local patch in the attachment. 2.Bind 1 DMA channel to vfio-pci driver: dpdk-devbind.py --force --bind=3Dvfio-pci 0000:00:01.0=20 3.Start dpdk-testpmd as the following command: x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-9 -n 8 -a 0000:00:01.0 --file-prefix=3Dvhost \ --no-huge -m 1024 \ --vdev 'net_vhost0,iface=3D./vhost-net0,client=3D1,queues=3D1,dmas=3D[txq0@0000:00= :01.0]' \ -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 --rxq=3D1 --txq=3D1 4.Check start dpdk-testpmd successed or failed. Show the output from the previous commands. root@dut245:~/dpdk# x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-9 -n 8= -a 0000:00:01.0 --file-prefix=3Dvhost --no-huge -m 1024 --vdev 'net_vhost0,iface=3D./vhost-net0,client=3D1,queues=3D1,dmas=3D[txq0@0000:00= :01.0]' -- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 --rxq=3D1 --txq=3D1 EAL: Detected CPU lcores: 128 EAL: Detected NUMA nodes: 2 EAL: Detected static linkage of DPDK EAL: Multi-process socket /var/run/dpdk/vhost/mp_socket EAL: Selected IOVA mode 'VA' EAL: VFIO support initialized EAL: Using IOMMU type 1 (Type 1) EAL: Cannot set up DMA remapping, error 28 (No space left on device) EAL: 0000:00:01.0 DMA remapping failed, error 28 (No space left on device) EAL: Requested device 0000:00:01.0 cannot be used EAL: Bus (pci) probe failed. Fail to find DMA device 0000:00:01.0. Failed to parse dmas vdev_probe(): failed to initialize net_vhost0 device EAL: Bus (vdev) probe failed. testpmd: No probed ethernet devices Interactive-mode selected Fail: input rxq (1) can't be greater than max_rx_queues (0) of port 0 EAL: Error - exiting with code: 1 Cause: rxq 1 invalid - must be >=3D 0 && <=3D 0=20 [Expected Result] Explain what is the expected result in text or as an example output: Start dpdk-testpmd successed and no error info.=20 [Regression] Is this issue a regression: (Y) Version the regression was introduced: Specify git id if known. commit a399d7b5a994e335c446d4b15d7622d71dd8848c (HEAD -> main, origin/main, origin/HEAD) Author: Nipun Gupta Date: Wed Jan 4 10:49:36 2023 +0530 vfio: do not coalesce DMA mappings At the cleanup time when dma unmap is done, the Linux kernel VFIO driver does not allow unmap of individual segments which were coalesced togeth= er while creating the DMA map for type1 IOMMU mappings. So, this change updates the mapping of the memory segments (hugepages) = on a per-page basis. Signed-off-by: Nipun Gupta Signed-off-by: Nikhil Agarwal Reviewed-by: Anatoly Burakov --=20 You are receiving this mail because: You are the assignee for the bug.= --16847380520.29c40f9.482122 Date: Mon, 22 May 2023 08:47:32 +0200 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: http://bugs.dpdk.org/ Auto-Submitted: auto-generated X-Auto-Response-Suppress: All
Bug ID 1235
Summary [dpdk-23.07]basic_4k_pages_cbdma: start dpdk-testpmd with dma= s and `--no-huge ` parameters failed
Product DPDK
Version 23.07
Hardware All
OS All
Status UNCONFIRMED
Severity normal
Priority Normal
Component vhost/virtio
Assignee dev@dpdk.org
Reporter weix.ling@intel.com
Target Milestone --- 

[Environment]

DPDK version: Use make showversion or for a non-released version: git remot=
e -v
&& git show-ref --heads
23.07.0-rc0
Other software versions: N/A
OS: Ubuntu 22.04.2 LTS/Linux 5.15.45-051545-generic
Compiler: gcc version 11.3.0 (Ubuntu 11.3.0-1ubuntu1~22.04)
Hardware platform: Intel(R) Xeon(R) Platinum 8380 CPU @ 2.30GHz
NIC hardware: N/A
NIC firmware: N/A

[Test Setup]
Steps to reproduce
List the steps to reproduce the issue.

1.Apply the DMA related local patch, and then build DPDK.

the local patch in the attachment.

2.Bind 1 DMA channel to vfio-pci driver:

dpdk-devbind.py --force --bind=3Dvfio-pci 0000:00:01.0=20

3.Start dpdk-testpmd as the following command:

x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-9 -n 8 -a 0000:00:01.0
--file-prefix=3Dvhost \
--no-huge -m 1024 \
--vdev
'net_vhost0,iface=3D./vhost-net0,client=3D1,queues=3D1,dmas=3D[txq0@000=
0:00:01.0]' \
-- -i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 --rxq=3D1 --txq=3D1

4.Check start dpdk-testpmd successed or failed.


Show the output from the previous commands.

root@dut245:~/dpdk# x86_64-native-linuxapp-gcc/app/dpdk-testpmd -l 1-9 =
-n 8 -a
0000:00:01.0 --file-prefix=3Dvhost --no-huge -m 1024 --vdev
'net_vhost0,iface=3D./vhost-net0,client=3D1,queues=3D1,dmas=3D[txq0@000=
0:00:01.0]' --
-i --nb-cores=3D1 --txd=3D1024 --rxd=3D1024 --rxq=3D1 --txq=3D1
EAL: Detected CPU lcores: 128
EAL: Detected NUMA nodes: 2
EAL: Detected static linkage of DPDK
EAL: Multi-process socket /var/run/dpdk/vhost/mp_socket
EAL: Selected IOVA mode 'VA'
EAL: VFIO support initialized
EAL: Using IOMMU type 1 (Type 1)
EAL: Cannot set up DMA remapping, error 28 (No space left on device)
EAL: 0000:00:01.0 DMA remapping failed, error 28 (No space left on device)
EAL: Requested device 0000:00:01.0 cannot be used
EAL: Bus (pci) probe failed.
Fail to find DMA device 0000:00:01.0.
Failed to parse dmas
vdev_probe(): failed to initialize net_vhost0 device
EAL: Bus (vdev) probe failed.
testpmd: No probed ethernet devices
Interactive-mode selected
Fail: input rxq (1) can't be greater than max_rx_queues (0) of port 0
EAL: Error - exiting with code: 1
  Cause: rxq 1 invalid - must be >=3D 0 && <=3D 0=20


[Expected Result]
Explain what is the expected result in text or as an example output:

Start dpdk-testpmd successed and no error info.=20


[Regression]
Is this issue a regression: (Y)

Version the regression was introduced: Specify git id if known.

commit a399d7b5a994e335c446d4b15d7622d71dd8848c (HEAD -> main, origin/ma=
in,
origin/HEAD)
Author: Nipun Gupta <nipun.gu=
pta@amd.com>
Date:   Wed Jan 4 10:49:36 2023 +0530

    vfio: do not coalesce DMA mappings

    At the cleanup time when dma unmap is done, the Linux kernel VFIO driver
    does not allow unmap of individual segments which were coalesced togeth=
er
    while creating the DMA map for type1 IOMMU mappings.
    So, this change updates the mapping of the memory segments (hugepages) =
on
    a per-page basis.

    Signed-off-by: Nipun Gupta <nipun.gupta@amd.com>
    Signed-off-by: Nikhil Agarwal <nikhil.agarwal@amd.com>
    Reviewed-by: Anatoly Burakov <anatoly.burakov@intel.com>

You are receiving this mail because:
  • You are the assignee for the bug.
=20=20=20=20=20=20=20=20=20=20
= --16847380520.29c40f9.482122--