* [dpdk-dev] Cannot use MLX4 with igb_uio driver @ 2017-01-09 14:53 Royce Niu 2017-01-09 15:13 ` Adrien Mazarguil 0 siblings, 1 reply; 5+ messages in thread From: Royce Niu @ 2017-01-09 14:53 UTC (permalink / raw) To: dev Dear all, I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver. It always shows when I use my DPDK application. EAL: Detected 32 lcore(s) EAL: Probing VFIO support... PMD: bnxt_rte_pmd_init() called for (null) EAL: PCI device 0000:02:00.0 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: PCI device 0000:02:00.1 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: PCI device 0000:02:00.2 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: PCI device 0000:02:00.3 on NUMA socket 0 EAL: probe driver: 8086:1521 rte_igb_pmd EAL: PCI device 0000:81:00.0 on NUMA socket 1 EAL: probe driver: 15b3:1007 librte_pmd_mlx4 PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded? EAL: Error - exiting with code: 1 Cause: Cannot create mbuf pool --------------- I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and install MLNX_OFED_LINUX-3.4-2.0.0.0. Thanks. -- Regards, Royce ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [dpdk-dev] Cannot use MLX4 with igb_uio driver 2017-01-09 14:53 [dpdk-dev] Cannot use MLX4 with igb_uio driver Royce Niu @ 2017-01-09 15:13 ` Adrien Mazarguil 2017-01-09 15:23 ` Royce Niu 0 siblings, 1 reply; 5+ messages in thread From: Adrien Mazarguil @ 2017-01-09 15:13 UTC (permalink / raw) To: Royce Niu; +Cc: dev Hi Royce, On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote: > Dear all, > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver. > > It always shows when I use my DPDK application. > > EAL: Detected 32 lcore(s) > EAL: Probing VFIO support... > PMD: bnxt_rte_pmd_init() called for (null) > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: PCI device 0000:02:00.1 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: PCI device 0000:02:00.2 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: PCI device 0000:02:00.3 on NUMA socket 0 > EAL: probe driver: 8086:1521 rte_igb_pmd > EAL: PCI device 0000:81:00.0 on NUMA socket 1 > EAL: probe driver: 15b3:1007 librte_pmd_mlx4 > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded? > EAL: Error - exiting with code: 1 > Cause: Cannot create mbuf pool > > --------------- > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and > install MLNX_OFED_LINUX-3.4-2.0.0.0. The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]), PCI devices must remain bound to their original kernel module (mlx4_core), however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2]. [1] http://dpdk.org/doc/guides/nics/mlx4.html [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites -- Adrien Mazarguil 6WIND ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [dpdk-dev] Cannot use MLX4 with igb_uio driver 2017-01-09 15:13 ` Adrien Mazarguil @ 2017-01-09 15:23 ` Royce Niu 2017-01-09 16:13 ` Adrien Mazarguil 0 siblings, 1 reply; 5+ messages in thread From: Royce Niu @ 2017-01-09 15:23 UTC (permalink / raw) To: Adrien Mazarguil; +Cc: Royce Niu, dev Hi, Adrien, Actually, I tested using the original kernel module without binding. It works. However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a 40Gbps NIC. Is that right? On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil < adrien.mazarguil@6wind.com> wrote: > Hi Royce, > > On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote: > > Dear all, > > > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver. > > > > It always shows when I use my DPDK application. > > > > EAL: Detected 32 lcore(s) > > EAL: Probing VFIO support... > > PMD: bnxt_rte_pmd_init() called for (null) > > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > > EAL: probe driver: 8086:1521 rte_igb_pmd > > EAL: PCI device 0000:02:00.1 on NUMA socket 0 > > EAL: probe driver: 8086:1521 rte_igb_pmd > > EAL: PCI device 0000:02:00.2 on NUMA socket 0 > > EAL: probe driver: 8086:1521 rte_igb_pmd > > EAL: PCI device 0000:02:00.3 on NUMA socket 0 > > EAL: probe driver: 8086:1521 rte_igb_pmd > > EAL: PCI device 0000:81:00.0 on NUMA socket 1 > > EAL: probe driver: 15b3:1007 librte_pmd_mlx4 > > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded? > > EAL: Error - exiting with code: 1 > > Cause: Cannot create mbuf pool > > > > --------------- > > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and > > install MLNX_OFED_LINUX-3.4-2.0.0.0. > > The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]), > PCI devices must remain bound to their original kernel module (mlx4_core), > however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2]. > > [1] http://dpdk.org/doc/guides/nics/mlx4.html > [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites > > -- > Adrien Mazarguil > 6WIND > -- Regards, Royce ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [dpdk-dev] Cannot use MLX4 with igb_uio driver 2017-01-09 15:23 ` Royce Niu @ 2017-01-09 16:13 ` Adrien Mazarguil 2017-01-09 16:57 ` Royce Niu 0 siblings, 1 reply; 5+ messages in thread From: Adrien Mazarguil @ 2017-01-09 16:13 UTC (permalink / raw) To: Royce Niu; +Cc: dev On Mon, Jan 09, 2017 at 11:23:56PM +0800, Royce Niu wrote: > Hi, Adrien, > > Actually, I tested using the original kernel module without binding. It > works. > > However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a 40Gbps > NIC. > > Is that right? That's difficult to say without knowing your specific setup or application, however 6 Mpps seems abnormally slow assuming testpmd performing basic I/O forwarding using a single thread and two ports. > On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil < > adrien.mazarguil@6wind.com> wrote: > > > Hi Royce, > > > > On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote: > > > Dear all, > > > > > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio driver. > > > > > > It always shows when I use my DPDK application. > > > > > > EAL: Detected 32 lcore(s) > > > EAL: Probing VFIO support... > > > PMD: bnxt_rte_pmd_init() called for (null) > > > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > EAL: PCI device 0000:02:00.1 on NUMA socket 0 > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > EAL: PCI device 0000:02:00.2 on NUMA socket 0 > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > EAL: PCI device 0000:02:00.3 on NUMA socket 0 > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > EAL: PCI device 0000:81:00.0 on NUMA socket 1 > > > EAL: probe driver: 15b3:1007 librte_pmd_mlx4 > > > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded? > > > EAL: Error - exiting with code: 1 > > > Cause: Cannot create mbuf pool > > > > > > --------------- > > > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and > > > install MLNX_OFED_LINUX-3.4-2.0.0.0. > > > > The mlx4 PMD does not operate through igb_uio (see mlx4 documentation [1]), > > PCI devices must remain bound to their original kernel module (mlx4_core), > > however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs [2]. > > > > [1] http://dpdk.org/doc/guides/nics/mlx4.html > > [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites > > > > -- > > Adrien Mazarguil > > 6WIND > > > > > > -- > Regards, > > Royce -- Adrien Mazarguil 6WIND ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [dpdk-dev] Cannot use MLX4 with igb_uio driver 2017-01-09 16:13 ` Adrien Mazarguil @ 2017-01-09 16:57 ` Royce Niu 0 siblings, 0 replies; 5+ messages in thread From: Royce Niu @ 2017-01-09 16:57 UTC (permalink / raw) To: Adrien Mazarguil, Royce Niu; +Cc: dev It is a simple L2FWD. It can be 14mpps in x520 nics. So, do you think where should I check? Thanks On Tue, 10 Jan 2017 at 12:13 AM, Adrien Mazarguil < adrien.mazarguil@6wind.com> wrote: > On Mon, Jan 09, 2017 at 11:23:56PM +0800, Royce Niu wrote: > > > Hi, Adrien, > > > > > > Actually, I tested using the original kernel module without binding. It > > > works. > > > > > > However, it is only 6Mpps for 64B in pkt-gen, which is so slow for a > 40Gbps > > > NIC. > > > > > > Is that right? > > > > That's difficult to say without knowing your specific setup or application, > > however 6 Mpps seems abnormally slow assuming testpmd performing basic I/O > > forwarding using a single thread and two ports. > > > > > On Mon, Jan 9, 2017 at 11:13 PM, Adrien Mazarguil < > > > adrien.mazarguil@6wind.com> wrote: > > > > > > > Hi Royce, > > > > > > > > On Mon, Jan 09, 2017 at 10:53:37PM +0800, Royce Niu wrote: > > > > > Dear all, > > > > > > > > > > I cannot use my Mellanox 3 Pro, after I binded it with igb_uio > driver. > > > > > > > > > > It always shows when I use my DPDK application. > > > > > > > > > > EAL: Detected 32 lcore(s) > > > > > EAL: Probing VFIO support... > > > > > PMD: bnxt_rte_pmd_init() called for (null) > > > > > EAL: PCI device 0000:02:00.0 on NUMA socket 0 > > > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > > > EAL: PCI device 0000:02:00.1 on NUMA socket 0 > > > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > > > EAL: PCI device 0000:02:00.2 on NUMA socket 0 > > > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > > > EAL: PCI device 0000:02:00.3 on NUMA socket 0 > > > > > EAL: probe driver: 8086:1521 rte_igb_pmd > > > > > EAL: PCI device 0000:81:00.0 on NUMA socket 1 > > > > > EAL: probe driver: 15b3:1007 librte_pmd_mlx4 > > > > > PMD: librte_pmd_mlx4: cannot access device, is mlx4_ib loaded? > > > > > EAL: Error - exiting with code: 1 > > > > > Cause: Cannot create mbuf pool > > > > > > > > > > --------------- > > > > > I have added CONFIG_RTE_LIBRTE_MLX4_PMD=y in .config, and > > > > > install MLNX_OFED_LINUX-3.4-2.0.0.0. > > > > > > > > The mlx4 PMD does not operate through igb_uio (see mlx4 documentation > [1]), > > > > PCI devices must remain bound to their original kernel module > (mlx4_core), > > > > however you have to additionally load mlx4_ib, mlx4_en and ib_uverbs > [2]. > > > > > > > > [1] http://dpdk.org/doc/guides/nics/mlx4.html > > > > [2] http://dpdk.org/doc/guides/nics/mlx4.html#prerequisites > > > > > > > > -- > > > > Adrien Mazarguil > > > > 6WIND > > > > > > > > > > > > > > > > -- > > > Regards, > > > > > > Royce > > > > -- > > Adrien Mazarguil > > 6WIND > > ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2017-01-09 16:57 UTC | newest] Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2017-01-09 14:53 [dpdk-dev] Cannot use MLX4 with igb_uio driver Royce Niu 2017-01-09 15:13 ` Adrien Mazarguil 2017-01-09 15:23 ` Royce Niu 2017-01-09 16:13 ` Adrien Mazarguil 2017-01-09 16:57 ` Royce Niu
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).