From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk0-f177.google.com (mail-qk0-f177.google.com [209.85.220.177]) by dpdk.org (Postfix) with ESMTP id 403F21B1A1 for ; Tue, 14 Nov 2017 09:38:06 +0100 (CET) Received: by mail-qk0-f177.google.com with SMTP id b85so7653522qkc.13 for ; Tue, 14 Nov 2017 00:38:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :content-transfer-encoding; bh=pgC2OZb88w84tDFf87/9WBRh8HEqjUOQm/2MM7bTnvk=; b=gzFUwNZRSTAApLDPbbIjLRE2vmkkhA9W2RAFZGj7v5gy76upR0qFcIkj9Wwwhe8v3i MVroDXVZ6+9cPrLLUb+tx2JbXbWWpY4Qs0q2CdFhifkRMBkBfrb/YuHdQrXqaeEfcM5v t3HpCPtWje6PAINbxTCHVxbrFkxNFwopElltia1KamhsEIEJh2RlsIHIdl4ZWQEYvRCI dlV0qzXUkJEnPeo2vSFMivRXUdutFccJeHGKagebyhDneod4VB6B4aZ1MeRwcj2RYeKA zld+ogmQkM8XYnvLk12oh5nGOHcEgb8ydhXUyEbt8Rrobe0yP0f1mBUqZm5oMzw2Fwix 7GQQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:content-transfer-encoding; bh=pgC2OZb88w84tDFf87/9WBRh8HEqjUOQm/2MM7bTnvk=; b=qO3zRLepf3q9CKVDZ3V95c3Lpm203q3Rdf1IDxATBu9ucDCumpNnrJl38gae+jdRhA FO+byyMWz5nnu5rpZrUBWLsd4F7VNlqyKr3yhBfCf66x8DzKjT/oj6dWpdoou8Gnpht5 JthEyqBMWIP6P0VttxuH5ElKNpaMvNUZ+7BxshbfHV7hHibj6y4mPu8CNq+U0GyEnDl8 TfdCSOkhwtN6MXbJ+fQQ8Lz1ROlVK1s8tq5/0mode/xhwJmHFOUTr+5IEgbxNqQG/nu0 X3nDYEhDjb2EUNYk2bHbjiMXqa3ae/mndeg4yO9TUB62UT6oP1filraMwErmrttLP1OH 31VA== X-Gm-Message-State: AJaThX6HAFe16D0Ez72KU+wt1ICIXfyNf6RM1vvu3HqwqwQ2PHIyxkyk Illu4qpmgB9LUWGmIST1+pXaYt+bG6wJRer9F/DZFw== X-Google-Smtp-Source: AGs4zMbnXpfNBAbJNIiyYR+cqCUgycYhkQjK0aEpoUr9V4pnu2B6gwu9juEkzfDYHsmTG6hnwrFjxqPBBNevnfzeqTg= X-Received: by 10.55.65.23 with SMTP id o23mr18584980qka.49.1510648686225; Tue, 14 Nov 2017 00:38:06 -0800 (PST) MIME-Version: 1.0 Received: by 10.140.106.71 with HTTP; Tue, 14 Nov 2017 00:37:35 -0800 (PST) In-Reply-To: <9B0331B6EBBD0E4684FBFAEDA55776F9444D7AEC@HASMSX110.ger.corp.intel.com> References: <3FEF1E9E-C001-4BD1-ACD7-84AD394F4C52@intel.com> <9B0331B6EBBD0E4684FBFAEDA55776F9444D7AEC@HASMSX110.ger.corp.intel.com> From: James Bensley Date: Tue, 14 Nov 2017 08:37:35 +0000 Message-ID: To: "Rosen, Rami" , "Wiles, Keith" , "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-users] Hard Crash with X710 and Pktgen X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 14 Nov 2017 08:38:07 -0000 Hi guys, Thank you all for your responses! I initially thought this was unlikely to be a Pktgen specific issue however I thought it worth mentioning I am using Pktgen just in case. On 14 November 2017 at 04:49, Muhammad Zain-ul-Abideen wrote: > where is -p argument Do you mean upper case "-P"? Lower case =E2=80=9Cp=E2=80=9D isn=E2=80=99t a= n option in =E2=80=9CPktgen =E2=80=93-help=E2=80=9D output. On 13 November 2017 at 19:35, James Bensley wrote: > $ sudo ./app/x86_64-native-linuxapp-gcc/pktgen -l 2-6 -n 1 -w 09:00.0 -w = 09:00.1 -v -- -P -m [3-4].0 [5-6].1 On 13 November 2017 at 21:49, Wiles, Keith wrote: > For the hard lockup problem try using testpmd application and see if that= the same problem if not then it will be next week before I can look at. > > Let me know if testpmd works or not. Thanks for taking the time to reply whilst traveling Keith! Sadly I=E2=80=99m getting the same behaviour with testpmd: $ ./dpdk-devbind.py --status-dev net Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:09:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=3Digb_uio u= nused=3D 0000:09:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=3Digb_uio u= nused=3D Network devices using kernel driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:02:00.0 'I350 Gigabit Network Connection 1521' if=3Deno1 drv=3Digb unused=3Digb_uio *Active* 0000:02:00.1 'I350 Gigabit Network Connection 1521' if=3Deno2 drv=3Digb unused=3Digb_uio 0000:06:00.0 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f0 drv=3Dtg3 unused=3Digb_uio 0000:06:00.1 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f1 drv=3Dtg3 unused=3Digb_uio 0000:06:00.2 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f2 drv=3Dtg3 unused=3Digb_uio *Active* 0000:06:00.3 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f3 drv=3Dtg3 unused=3Digb_uio $ sudo ./testpmd -l 0-3 -n 4 -- -i --portmask=3D0x1 --nb-cores=3D2 EAL: Detected 16 lcore(s) EAL: No free hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: PCI device 0000:02:00.0 on NUMA socket 0 EAL: probe driver: 8086:1521 net_e1000_igb EAL: PCI device 0000:02:00.1 on NUMA socket 0 EAL: probe driver: 8086:1521 net_e1000_igb EAL: PCI device 0000:09:00.0 on NUMA socket 0 EAL: probe driver: 8086:1572 net_i40e << HARD LOCK-UP >> $ ./dpdk-devbind.py --status-dev net Network devices using DPDK-compatible driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:09:00.0 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=3Dvfio-pci unused=3Digb_uio 0000:09:00.1 'Ethernet Controller X710 for 10GbE SFP+ 1572' drv=3Dvfio-pci unused=3Digb_uio Network devices using kernel driver =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D 0000:02:00.0 'I350 Gigabit Network Connection 1521' if=3Deno1 drv=3Digb unused=3Digb_uio,vfio-pci *Active* 0000:02:00.1 'I350 Gigabit Network Connection 1521' if=3Deno2 drv=3Digb unused=3Digb_uio,vfio-pci 0000:06:00.0 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f0 drv=3Dtg3 unused=3Digb_uio,vfio-pci 0000:06:00.1 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f1 drv=3Dtg3 unused=3Digb_uio,vfio-pci 0000:06:00.2 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f2 drv=3Dtg3 unused=3Digb_uio,vfio-pci *Active* 0000:06:00.3 'NetXtreme BCM5719 Gigabit Ethernet PCIe 1657' if=3Dens3f3 drv=3Dtg3 unused=3Digb_uio,vfio-pci $ sudo ./testpmd -l 0-3 -n 4 -- -i --portmask=3D0x1 --nb-cores=3D2 EAL: Detected 16 lcore(s) EAL: No free hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: VFIO support initialized EAL: PCI device 0000:02:00.0 on NUMA socket 0 EAL: probe driver: 8086:1521 net_e1000_igb EAL: PCI device 0000:02:00.1 on NUMA socket 0 EAL: probe driver: 8086:1521 net_e1000_igb EAL: PCI device 0000:09:00.0 on NUMA socket 0 EAL: probe driver: 8086:1572 net_i40e EAL: 0000:09:00.0 failed to select IOMMU type EAL: Requested device 0000:09:00.0 cannot be used EAL: PCI device 0000:09:00.1 on NUMA socket 0 EAL: probe driver: 8086:1572 net_i40e EAL: 0000:09:00.1 failed to select IOMMU type EAL: Requested device 0000:09:00.1 cannot be used EAL: No probed ethernet devices Interactive-mode selected USER1: create a new mbuf pool : n=3D171456, size=3D2176, socket=3D0 Done On 14 November 2017 at 06:29, Rosen, Rami wrote: > Second, I think the root cause for not finding the ports is around this m= essage ("failed to select IOMMU type") in: > ... >> EAL: probe driver: 8086:1572 net_i40e >> EAL: 0000:09:00.0 failed to select IOMMU type >> EAL: Requested device 0000:09:00.0 cannot be used >> EAL: PCI device 0000:09:00.1 on NUMA socket 0 >> EAL: probe driver: 8086:1572 net_i40e >> EAL: 0000:09:00.1 failed to select IOMMU type >> EAL: Requested device 0000:09:00.1 cannot be used > ... > > What does " find /sys/kernel/iommu_groups/ -type l" > give ? > > Could it be that 0000:09:00.0 and 0000:09:00.1 belongs to an IOMMU group = in which there are other devices ? To me (a layman) this looks correct, do you agree? $ find /sys/kernel/iommu_groups/ -type l | grep 09 /sys/kernel/iommu_groups/36/devices/0000:09:00.0 /sys/kernel/iommu_groups/37/devices/0000:09:00.1 $ find /sys/kernel/iommu_groups/ -type l | grep -E "36|37" /sys/kernel/iommu_groups/36/devices/0000:09:00.0 /sys/kernel/iommu_groups/37/devices/0000:09:00.1 Cheers, James.