From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qg0-f54.google.com (mail-qg0-f54.google.com [209.85.192.54]) by dpdk.org (Postfix) with ESMTP id DA7D48DB3 for ; Thu, 14 Jan 2016 03:17:03 +0100 (CET) Received: by mail-qg0-f54.google.com with SMTP id b35so340132532qge.0 for ; Wed, 13 Jan 2016 18:17:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=LW0GnH06Aa5TyAbzzQVueGQBvUVgllhLaJcxr44+U7g=; b=bMNHZbhbbO2Dd6c0vpmGIWlEwYeiD4GA4LiV/0ju134bsGZA0WioXc9MzFcDab8uCs /vRxn2bgx9fLpZHamgJkOhaKniJDw9yroSd/6WLtv+uRRr7NRM31Dy2u331jCcUpa8qu N4a+R6vTBYlh5R58tOjSz+2qZJnImXK+jGnzxGXkVk59H2Pr4l90BuDQwWSszAVz6T/x ZIYBxK3GAK4j+rnQWt6jBq6AdyOGeiVMYaICBVpIDiHs0hGHXQ4C0wERnN1uOAkIKO9P QD7bA50+9OII9Pm3AeIhPOHnuYVUn/7XnxfeY0lts8S9lCRscxqmL1k4RpdIOkj9JPxf Iuyw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=LW0GnH06Aa5TyAbzzQVueGQBvUVgllhLaJcxr44+U7g=; b=SjYAQTprbSu9ZkLhn2J/n5KQlCOvl6SHLeTGXgeLoycvjZX3Gc4t4PrBSCC11yQ5Aq /KrW0zwkjvofPRjQRuBXl73K+BlZNUlarUKweBy3XBidXQ+5MASalWUptRNsu0WOphYJ 0ZERNql2xFSIN0SERco9tyt1Qlnv8XoOxCP8LUEEW5GNNeddQvdLiBBkuLRIRl8SpVJP ++uJ58kRaXxSGPGBSnAxqk4VFYAJHtLyUvj7P96d5vhFgkJemUSx87bYT+CFbPcKRL6J g8RX5Td/rf/pqFIJfvf/J2n0M4lrPnbm8Il0w+7Z4kG9Dblkqu/AEpWbxnBkEQ6Gz7Yl l0bA== X-Gm-Message-State: ALoCoQntneS19edcwzAhMF9/QQMvEuPSNLORyUoJnUHSZfyBV7bfcvhDDUd1u5fWzXli2WWi7V+m8MRy4XehDbjsSAezMVU7Bw== MIME-Version: 1.0 X-Received: by 10.140.92.84 with SMTP id a78mr1893295qge.10.1452737823382; Wed, 13 Jan 2016 18:17:03 -0800 (PST) Received: by 10.140.95.120 with HTTP; Wed, 13 Jan 2016 18:17:03 -0800 (PST) In-Reply-To: <20160112154704.GE12095@6wind.com> References: <20160112154704.GE12095@6wind.com> Date: Thu, 14 Jan 2016 11:17:03 +0900 Message-ID: From: Masaru Kawashima To: users@dpdk.org, Olga Shern Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] HELP: MLX4 problem X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 14 Jan 2016 02:17:04 -0000 Hi Olga, Thank you for your advice. I checked the kernel modules you've shown (ib_uverbs, mlx4_en, mlx4_ib and mlx4_core) are all loaded fine. Following is the output of lsmod: > Module Size Used by > fuse 73530 0 > vtsspp 362000 0 > sep3_15 546746 0 > pax 4312 0 > blcr 115497 0 > blcr_imports 10683 1 blcr > autofs4 26481 3 > vboxpci 14851 0 > vboxnetadp 18352 0 > vboxnetflt 18816 0 > vboxdrv 454718 3 vboxpci,vboxnetadp,vboxnetflt > 8021q 25349 0 > garp 7152 1 8021q > stp 2218 1 garp > llc 5546 2 garp,stp > cpufreq_ondemand 10544 24 > acpi_cpufreq 7763 0 > freq_table 4936 2 cpufreq_ondemand,acpi_cpufreq > mperf 1557 1 acpi_cpufreq > cachefiles 36893 1 > fscache 55636 1 cachefiles > ipt_REJECT 2351 2 > iptable_filter 2793 1 > ipt_MASQUERADE 2466 1 > iptable_nat 6158 1 > nf_nat 22759 2 ipt_MASQUERADE,iptable_nat > nf_conntrack_ipv4 9506 14 iptable_nat,nf_nat > nf_defrag_ipv4 1483 1 nf_conntrack_ipv4 > ip_tables 17831 2 iptable_filter,iptable_nat > nf_conntrack_netbios_ns 1323 0 > nf_conntrack_broadcast 1471 1 nf_conntrack_netbios_ns > ip6t_REJECT 4628 2 > nf_conntrack_ipv6 8337 10 > nf_defrag_ipv6 11156 1 nf_conntrack_ipv6 > xt_state 1492 21 > nf_conntrack 79758 8 ipt_MASQUERADE,iptable_nat,nf_nat,nf_conntrack_ipv4,nf_conntrack_netbios_ns,nf_conntrack_broadcast,nf_conntrack_ipv6,xt_state > ip6table_filter 2889 1 > ip6_tables 18732 1 ip6table_filter > rdma_ucm 16467 0 > ib_ucm 12153 0 > rdma_cm 43237 1 rdma_ucm > iw_cm 30527 1 rdma_cm > configfs 29570 2 rdma_cm > ib_ipoib 124388 0 > ib_cm 38274 3 ib_ucm,rdma_cm,ib_ipoib > ib_uverbs 65802 2 rdma_ucm,ib_ucm > ib_umad 14678 0 > mlx5_ib 161275 0 > mlx5_core 325765 1 mlx5_ib > xfs 1128471 2 > exportfs 4236 1 xfs > ext3 240548 1 > jbd 80858 1 ext3 > knem 32213 0 > uinput 7992 0 > iTCO_wdt 7115 0 > iTCO_vendor_support 3056 1 iTCO_wdt > ax88179_178a 19166 0 > usbnet 40894 1 ax88179_178a > mii 5376 2 ax88179_178a,usbnet > microcode 112685 0 > igb 197504 0 > raid1 32045 1 > raid0 12417 1 > power_meter 9169 0 > i2c_i801 11359 0 > lpc_ich 12803 0 > mfd_core 1895 1 lpc_ich > shpchp 32778 0 > sg 29350 0 > mlx4_ib 195595 0 > ib_sa 24561 5 rdma_ucm,rdma_cm,ib_ipoib,ib_cm,mlx4_ib > ib_mad 47060 4 ib_cm,ib_umad,mlx4_ib,ib_sa > ib_core 126865 12 rdma_ucm,ib_ucm,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_uverbs,ib_umad,mlx5_ib,mlx4_ib,ib_sa,ib_mad > ib_addr 8243 3 rdma_ucm,rdma_cm,ib_core > ixgbe 243936 0 > mlx4_en 110837 0 > dca 7101 2 igb,ixgbe > ipv6 318183 97 vboxnetflt,ip6t_REJECT,nf_conntrack_ipv6,nf_defrag_ipv6,ib_ipoib,ib_core,ib_addr > ptp 9614 3 igb,ixgbe,mlx4_en > mdio 4769 1 ixgbe > pps_core 11458 1 ptp > mlx4_core 332788 2 mlx4_ib,mlx4_en > mlx_compat 31376 17 rdma_ucm,ib_ucm,rdma_cm,iw_cm,ib_ipoib,ib_cm,ib_uverbs,ib_umad,mlx5_ib,mlx5_core,mlx4_ib,ib_sa,ib_mad,ib_core,ib_addr,mlx4_en,mlx4_core > snd_hda_codec_hdmi 28922 1 > snd_hda_codec_realtek 43811 1 > snd_hda_intel 40562 2 > snd_hda_codec 179208 3 snd_hda_codec_hdmi,snd_hda_codec_realtek,snd_hda_intel > snd_hwdep 6780 1 snd_hda_codec > snd_seq 55727 0 > snd_seq_device 6500 1 snd_seq > snd_pcm 87790 3 snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec > snd_timer 22443 2 snd_seq,snd_pcm > snd 70745 13 snd_hda_codec_hdmi,snd_hda_codec_realtek,snd_hda_intel,snd_hda_codec,snd_hwdep,snd_seq,snd_seq_device,snd_pcm,snd_timer > soundcore 7958 1 snd > snd_page_alloc 8856 2 snd_hda_intel,snd_pcm > nvidia 8363378 52 > ext4 374405 1 > jbd2 93427 1 ext4 > mbcache 8193 2 ext3,ext4 > sd_mod 40217 16 > crc_t10dif 1541 1 sd_mod > xhci_hcd 148886 0 > ahci 42247 9 > nouveau 995383 0 > ttm 80590 1 nouveau > drm_kms_helper 44321 1 nouveau > drm 280012 3 nouveau,ttm,drm_kms_helper > i2c_algo_bit 5935 2 igb,nouveau > i2c_core 31084 7 igb,i2c_i801,nvidia,nouveau,drm_kms_helper,drm,i2c_algo_bit > mxm_wmi 1967 1 nouveau > video 20674 1 nouveau > output 2409 1 video > wmi 6287 2 nouveau,mxm_wmi > dm_mirror 14384 0 > dm_region_hash 12085 1 dm_mirror > dm_log 9930 2 dm_mirror,dm_region_hash > dm_mod 84337 2 dm_mirror,dm_log And, I believe they are parts of Mellanox OFED, because the module path listed in the modules.dep file are started with "weak-updates/mlnx-ofa_kernel/drivers/". Firmware version is up to date. Following is the output of flint query > Image type: FS2 > FW Version: 2.35.5100 > FW Release Date: 6.9.2015 > Product Version: 02.35.51.00 > Rom Info: type=PXE version=3.4.648 devid=4099 > Device ID: 4099 > Description: Node Port1 Port2 Sys image > GUIDs: ffffffffffffffff ffffffffffffffff ffffffffffffffff ffffffffffffffff > MACs: e41d2d0759a0 e41d2d0759a1 > VSD: > PSID: MT_1060140023 Now, what can I do next again? I still need more help! 2016-01-13 0:47 GMT+09:00 Adrien Mazarguil : > Hi Masaru, > > On Tue, Jan 12, 2016 at 06:43:53PM +0900, Masaru Kawashima wrote: > > Hi, all > > > > I'm trying to use dpdk with Mellanox ConnectX-3. > > But, mlnx4 pmd cannot work fine. > > > > Following is my environment: > > > > OS: CentOS 6.5 (x86_64) > > Mellanox OFED: MLNX_OFED_LINUX-3.1-1.1.0.1-rhel6.5-x86_64 > > DPDK: MLNX_DPDK-2.1_1.1 > > > > I'm trying to run testpmd, but librte_pmd_mlx4 reports > > "ibv_exp_query_device() failed", > > and EAL reports "No probed ethernet devices". > > > > What can I do next to work mlx4 pmd fine? > > > > > > Following is the testpmd's log: > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > EAL: Detected lcore 1 as core 1 on socket 0 > > EAL: Detected lcore 2 as core 2 on socket 0 > > EAL: Detected lcore 3 as core 3 on socket 0 > > EAL: Detected lcore 4 as core 4 on socket 0 > > EAL: Detected lcore 5 as core 5 on socket 0 > > EAL: Detected lcore 6 as core 8 on socket 0 > > EAL: Detected lcore 7 as core 9 on socket 0 > > EAL: Detected lcore 8 as core 10 on socket 0 > > EAL: Detected lcore 9 as core 11 on socket 0 > > EAL: Detected lcore 10 as core 12 on socket 0 > > EAL: Detected lcore 11 as core 13 on socket 0 > > EAL: Detected lcore 12 as core 0 on socket 1 > > EAL: Detected lcore 13 as core 1 on socket 1 > > EAL: Detected lcore 14 as core 2 on socket 1 > > EAL: Detected lcore 15 as core 3 on socket 1 > > EAL: Detected lcore 16 as core 4 on socket 1 > > EAL: Detected lcore 17 as core 5 on socket 1 > > EAL: Detected lcore 18 as core 8 on socket 1 > > EAL: Detected lcore 19 as core 9 on socket 1 > > EAL: Detected lcore 20 as core 10 on socket 1 > > EAL: Detected lcore 21 as core 11 on socket 1 > > EAL: Detected lcore 22 as core 12 on socket 1 > > EAL: Detected lcore 23 as core 13 on socket 1 > > EAL: Support maximum 128 logical core(s) by configuration. > > EAL: Detected 24 lcore(s) > > EAL: Setting up physically contiguous memory... > > EAL: Ask a virtual area of 0x80000000 bytes > > EAL: Virtual area found at 0x7f2940000000 (size = 0x80000000) > > EAL: Ask a virtual area of 0x80000000 bytes > > EAL: Virtual area found at 0x7f2880000000 (size = 0x80000000) > > EAL: Requesting 2 pages of size 1024MB from socket 0 > > EAL: Requesting 2 pages of size 1024MB from socket 1 > > EAL: TSC frequency is ~2300002 KHz > > EAL: Master lcore 0 is ready (tid=f6cdc8a0;cpuset=[0]) > > EAL: lcore 2 is ready (tid=f58d2700;cpuset=[2]) > > EAL: lcore 1 is ready (tid=f62d3700;cpuset=[1]) > > EAL: lcore 3 is ready (tid=f4ed1700;cpuset=[3]) > > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > > EAL: probe driver: 15b3:1003 librte_pmd_mlx4 > > PMD: librte_pmd_mlx4: PCI information matches, using device "mlx4_0" (VF: > > false) > > PMD: librte_pmd_mlx4: 1 port(s) detected > > PMD: librte_pmd_mlx4: ibv_exp_query_device() failed > > Make sure ib_uverbs, mlx4_en, mlx4_ib and mlx4_core are all loaded and > coming from Mellanox OFED (normally not the original modules provided by > your Linux distribution), and that you're using an up-to-date firmware > version, although installing MLNX_OFED should have taken care of these > automatically. > > -- > Adrien Mazarguil > 6WIND >