From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-la0-x235.google.com (mail-la0-x235.google.com [IPv6:2a00:1450:4010:c03::235]) by dpdk.org (Postfix) with ESMTP id 107E6156 for ; Fri, 22 Nov 2013 13:28:56 +0100 (CET) Received: by mail-la0-f53.google.com with SMTP id ea20so866187lab.40 for ; Fri, 22 Nov 2013 04:29:55 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=ISWbHZFXL5LUwNAUnqRA/GCrM+FIXCreXT3g6uoZvYc=; b=l3GYv/Wt7vWuPaScWY65kbzYY+m/ZZHqzDmqlcK4vgQcPnMzPaZq0oGGcgXZFLMHF8 SSCEhIHty4CJxDX3Bv6GEbdRq8vkew3Cnia6EUpHcbFywOtLJvqKh/YeA8epzXThO/+7 yYGD/ntHs7Gu1D3O1izE3ssMLjpXz8NxHmHtCEjFPzmG7PilpW7u+kIEL6yvt5kTgtyl vYg4gmMJtX1MhJkD7zhDnQr9CGL0lX1XigltjE0KH/ceuxxC5TxE4ge+kduvyR1/yGYm ZzeqBOop29GcrRHz4WXBNoViFRBKM7GGFgO/36jqZzebsaaK4r7bRT52sKG0txAhNkVW AwGA== X-Received: by 10.112.204.74 with SMTP id kw10mr8968604lbc.13.1385123395283; Fri, 22 Nov 2013 04:29:55 -0800 (PST) Received: from [192.168.15.111] ([87.236.23.254]) by mx.google.com with ESMTPSA id m5sm28871265laj.4.2013.11.22.04.29.54 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 22 Nov 2013 04:29:54 -0800 (PST) Message-ID: <528F4E41.2000405@gmail.com> Date: Fri, 22 Nov 2013 16:29:53 +0400 From: Dmitry Vyal User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.1.0 MIME-Version: 1.0 To: "dev@dpdk.org" Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: [dpdk-dev] Sporadic errors while initializing NICs in example applications, dpdk-1.5.0r1 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 22 Nov 2013 12:28:57 -0000 Hi, I'm experiencing weird problems with running dpdk examples on my server running ubuntu-12.04. Application either manages to use ethernet ports or doesn't. For example, this is results of two identical sequental runs of l2fwd: ****************************************************************************** dev@tiny-one:~/dpdk-1.5.0r1/examples/l2fwd$ s -E ./build/l2fwd -c 0x3 -n 2 EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 1 on socket 0 EAL: Detected lcore 2 as core 2 on socket 0 EAL: Detected lcore 3 as core 3 on socket 0 EAL: Detected lcore 4 as core 0 on socket 0 EAL: Detected lcore 5 as core 1 on socket 0 EAL: Detected lcore 6 as core 2 on socket 0 EAL: Detected lcore 7 as core 3 on socket 0 EAL: Skip lcore 8 (not detected) EAL: Setting up memory... EAL: Ask a virtual area of 0x4194304 bytes EAL: Virtual area found at 0x7f6b82400000 (size = 0x400000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b82000000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b81c00000 (size = 0x200000) EAL: Ask a virtual area of 0x1056964608 bytes EAL: Virtual area found at 0x7f6b42a00000 (size = 0x3f000000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b42600000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b42200000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b41e00000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f6b41a00000 (size = 0x200000) EAL: Requesting 512 pages of size 2MB from socket 0 EAL: TSC frequency is ~1600000 KHz EAL: Master core 0 is ready (tid=836da800) EAL: Core 1 is ready (tid=40ff8700) EAL: PCI device 0000:02:00.0 on NUMA socket -1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7f6b83687000 EAL: PCI memory mapped at 0x7f6b83683000 EAL: PCI device 0000:02:00.1 on NUMA socket -1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7f6b83663000 EAL: PCI memory mapped at 0x7f6b8365f000 EAL: PCI device 0000:03:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:03:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:04:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:04:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:05:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:05:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:06:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:06:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:07:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:07:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:08:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:08:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:09:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:09:00.0 not managed by UIO driver, skipping EAL: Error - exiting with code: 1 Cause: No Ethernet ports - bye ************************************************************************************ dev@econat-tiny-one:~/dpdk-1.5.0r1/examples/l2fwd$ s -E ./build/l2fwd -c 0x3 -n 2 EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 1 on socket 0 EAL: Detected lcore 2 as core 2 on socket 0 EAL: Detected lcore 3 as core 3 on socket 0 EAL: Detected lcore 4 as core 0 on socket 0 EAL: Detected lcore 5 as core 1 on socket 0 EAL: Detected lcore 6 as core 2 on socket 0 EAL: Detected lcore 7 as core 3 on socket 0 EAL: Skip lcore 8 (not detected) EAL: Setting up memory... EAL: Ask a virtual area of 0x4194304 bytes EAL: Virtual area found at 0x7f538a600000 (size = 0x400000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f538a200000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f5389e00000 (size = 0x200000) EAL: Ask a virtual area of 0x1056964608 bytes EAL: Virtual area found at 0x7f534ac00000 (size = 0x3f000000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f534a800000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f534a400000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f534a000000 (size = 0x200000) EAL: Ask a virtual area of 0x2097152 bytes EAL: Virtual area found at 0x7f5349c00000 (size = 0x200000) EAL: Requesting 512 pages of size 2MB from socket 0 EAL: TSC frequency is ~3301000 KHz EAL: Master core 0 is ready (tid=8b98d800) EAL: Core 1 is ready (tid=491f8700) EAL: PCI device 0000:02:00.0 on NUMA socket -1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7f538b93a000 EAL: PCI memory mapped at 0x7f538b936000 EAL: PCI device 0000:02:00.1 on NUMA socket -1 EAL: probe driver: 8086:10fb rte_ixgbe_pmd EAL: PCI memory mapped at 0x7f538b916000 EAL: PCI memory mapped at 0x7f538b912000 EAL: PCI device 0000:03:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:03:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:04:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:04:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:05:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:05:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:06:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:06:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:07:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:07:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:08:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:08:00.0 not managed by UIO driver, skipping EAL: PCI device 0000:09:00.0 on NUMA socket -1 EAL: probe driver: 8086:10d3 rte_em_pmd EAL: 0000:09:00.0 not managed by UIO driver, skipping Skipping disabled port 0 Skipping disabled port 1 EAL: Error - exiting with code: 1 Cause: All available ports are disabled. Please set portmask. ****************************************************************** You see, final messages differ. Almost all the time I get "Cause: No Ethernet ports - bye" but sometimes (with probability of 1/10 or so) NIC is initialized successfully. Some info about the system: dev@tiny-one:~/dpdk-1.5.0r1/examples/l2fwd$ cat /proc/cpuinfo processor : 0 vendor_id : GenuineIntel cpu family : 6 model : 58 model name : Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz stepping : 9 microcode : 0x10 cpu MHz : 1600.000 cache size : 8192 KB physical id : 0 siblings : 8 core id : 0 cpu cores : 4 apicid : 0 initial apicid : 0 fpu : yes fpu_exception : yes cpuid level : 13 wp : yes flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx rdtscp lm constant_tsc arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm ida arat epb xsaveopt pln pts dtherm tpr_shadow vnmi flexpriority ept vpid fsgsbase smep erms bogomips : 6584.75 clflush size : 64 cache_alignment : 64 address sizes : 36 bits physical, 48 bits virtual power management: dev@tiny-one:~/dpdk-1.5.0r1/examples/l2fwd$ lspci 00:00.0 Host bridge: Intel Corporation Ivy Bridge DRAM Controller (rev 09) 00:01.0 PCI bridge: Intel Corporation Ivy Bridge PCI Express Root Port (rev 09) 00:01.1 PCI bridge: Intel Corporation Ivy Bridge PCI Express Root Port (rev 09) 00:16.0 Communication controller: Intel Corporation 6 Series/C200 Series Chipset Family MEI Controller #1 (rev 04) 00:1a.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #2 (rev 05) 00:1c.0 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 1 (rev b5) 00:1c.1 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 2 (rev b5) 00:1c.2 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 3 (rev b5) 00:1c.3 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 4 (rev b5) 00:1c.4 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 5 (rev b5) 00:1c.5 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 6 (rev b5) 00:1c.6 PCI bridge: Intel Corporation 6 Series/C200 Series Chipset Family PCI Express Root Port 7 (rev b5) 00:1d.0 USB controller: Intel Corporation 6 Series/C200 Series Chipset Family USB Enhanced Host Controller #1 (rev 05) 00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5) 00:1f.0 ISA bridge: Intel Corporation C206 Chipset Family LPC Controller (rev 05) 00:1f.2 IDE interface: Intel Corporation 6 Series/C200 Series Chipset Family 4 port SATA IDE Controller (rev 05) 00:1f.3 SMBus: Intel Corporation 6 Series/C200 Series Chipset Family SMBus Controller (rev 05) 00:1f.5 IDE interface: Intel Corporation 6 Series/C200 Series Chipset Family 2 port SATA IDE Controller (rev 05) 02:00.0 Ethernet controller: Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01) 02:00.1 Ethernet controller: Intel Corporation 82599EB 10-Gigabit SFI/SFP+ Network Connection (rev 01) 03:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 04:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 05:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 06:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 07:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 08:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection 09:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection dev@tiny-one:~/dpdk-1.5.0r1/examples/l2fwd$ lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description: Ubuntu 12.04.2 LTS Release: 12.04 Codename: precise Any ideas how to investigate this? Regards, Dmitry