From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4006BA0545 for ; Wed, 10 Aug 2022 15:55:30 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 20E3E4068E; Wed, 10 Aug 2022 15:55:30 +0200 (CEST) Received: from mail-pl1-f174.google.com (mail-pl1-f174.google.com [209.85.214.174]) by mails.dpdk.org (Postfix) with ESMTP id 54CF44067C for ; Wed, 10 Aug 2022 15:55:28 +0200 (CEST) Received: by mail-pl1-f174.google.com with SMTP id w14so14282259plp.9 for ; Wed, 10 Aug 2022 06:55:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20210112.gappssmtp.com; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc; bh=+MO/YDNHM75gmh7ngzvasz+1wi4yfcnfar/yJGsybp4=; b=don42gZ9effYkUI6YevcOOkBT1zogShtt1KXpRpMo8ZNKgu3DyAhUggW8TuDFP0xO5 3V3UsgvVMBu0s29FK2VyshatlllK9TF1+p4LJiS9oo2uBDw9BUYIHou3XergZ4B9p2Uw 80zYu0MsILwVHkME547OEmG5WuSaDctEkrcKMi/tDQyemez9EBcSVE36UaYj2KYR/HGW 7PRDbimAU/SP7CaE6BKX8aSZClpM4NntfPmKIQzlDpc6Ck/sWoC6LAqDOnCpZpeo8wK2 /4hXWo4aKxuZOjFOjiOBRXEr8up8MzePfh/ZS5hu/IafpEa2Kj+G4F01z9LyEkdsvIJ6 gwSA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc; bh=+MO/YDNHM75gmh7ngzvasz+1wi4yfcnfar/yJGsybp4=; b=gNBuVPLMnBVRk7QTOxz29MZq3DAyJamhEZWFQGp8E9b40VcgeZptq43ufBHsZ5tY02 usSGksrP6m17mB2o/wXFP6SVMwRJYK0QjSpFaJ7JogGKOLvEQciK9fDWuq3JFHwgDzhh Zdxw5eXEaVS3ULcEehAAdBXO0n3pBrtOprq6naTeDGWpvNwWS5xRP/rTuPwTu563O5Pf ewiVl/wEFq3KhdmbIi/pl/YmqcL6H2Zp/vBaI21ckW1731A3RpMuBdO3tffX/M5UwVr2 WpZQQeO8b4qRomVyrpqqoMUnpCxuE9Wj6nRV4idbD7z0uQLT8NDuT5YgNWqNtgMTv/A9 yRNw== X-Gm-Message-State: ACgBeo1LTZrp/D3PSeRg3mUI6EsImGXdYXHowbAQDT0ykk3jRG4/SGAk zjwIPGfFWrW1jEtH0STvP4QDDgVOyRa+zA== X-Google-Smtp-Source: AA6agR7iSQkU5Xw/Sksbm+hQdq3P5Lapjnjcw06ABsyU6DJrdQL6HHUs4a82nLIEPBUDDPB7+YbGoA== X-Received: by 2002:a17:902:db06:b0:16e:e5fc:56d8 with SMTP id m6-20020a170902db0600b0016ee5fc56d8mr28458007plx.100.1660139727412; Wed, 10 Aug 2022 06:55:27 -0700 (PDT) Received: from hermes.local (204-195-120-218.wavecable.com. [204.195.120.218]) by smtp.gmail.com with ESMTPSA id w1-20020a170902d10100b00170abc421a6sm6383805plw.42.2022.08.10.06.55.26 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 10 Aug 2022 06:55:27 -0700 (PDT) Date: Wed, 10 Aug 2022 06:55:25 -0700 From: Stephen Hemminger To: sysman@scaled.cloud Cc: users@dpdk.org Subject: Re: How to resolve "Not all devices in IOMMU group bound to VFIO or unbound" ? Message-ID: <20220810065525.204e1901@hermes.local> In-Reply-To: References: <99e01fff837b85c1126ef0a235078fc3@scaled.cloud> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Wed, 10 Aug 2022 16:52:39 +0300 sysman@scaled.cloud wrote: > Hello! > > I have built and deployed latest DPDK from the git, so: > > dpdk-devbind.py -s > > Network devices using DPDK-compatible driver > ============================================ > 0000:02:04.0 '82545EM Gigabit Ethernet Controller (Copper) 100f' > drv=vfio-pci unused=e1000 > 0000:02:05.0 '82545EM Gigabit Ethernet Controller (Copper) 100f' > drv=vfio-pci unused=e1000 > 0000:02:06.0 '82545EM Gigabit Ethernet Controller (Copper) 100f' > drv=vfio-pci unused=e1000 > 0000:02:07.0 '82545EM Gigabit Ethernet Controller (Copper) 100f' > drv=vfio-pci unused=e1000 > > Network devices using kernel driver > =================================== > 0000:02:01.0 '82545EM Gigabit Ethernet Controller (Copper) 100f' if=eth0 > drv=e1000 unused=vfio-pci *Active* > > > > ./ipv4_multicast > ... > EAL: 0000:02:04.0 VFIO group is not viable! Not all devices in IOMMU > group bound to VFIO or unbound > EAL: Requested device 0000:02:04.0 cannot be used > EAL: 0000:02:05.0 VFIO group is not viable! Not all devices in IOMMU > group bound to VFIO or unbound > EAL: Requested device 0000:02:05.0 cannot be used > EAL: 0000:02:06.0 VFIO group is not viable! Not all devices in IOMMU > group bound to VFIO or unbound > EAL: Requested device 0000:02:06.0 cannot be used > EAL: 0000:02:07.0 VFIO group is not viable! Not all devices in IOMMU > group bound to VFIO or unbound > EAL: Requested device 0000:02:07.0 cannot be used > ... > > > root@devuan4-sysman:~# readlink > "/sys/bus/pci/devices/0000:02:04.0/iommu_group" > ../../../../kernel/iommu_groups/5 > root@devuan4-sysman:~# readlink > "/sys/bus/pci/devices/0000:02:05.0/iommu_group" > ../../../../kernel/iommu_groups/5 > root@devuan4-sysman:~# readlink > "/sys/bus/pci/devices/0000:02:06.0/iommu_group" > ../../../../kernel/iommu_groups/5 > root@devuan4-sysman:~# readlink > "/sys/bus/pci/devices/0000:02:07.0/iommu_group" > ../../../../kernel/iommu_groups/5 > > > > Can someone, please, help me resolve this problem? Can't really be fixed in software, the IOMMU groups come from the hardware. The best workaround if possible is to use a different NIC for eth0.