* [dpdk-dev] l3fwd error, port 0 is not present on the board @ 2014-12-29 20:18 Lyn M 2014-12-29 21:02 ` Neil Horman 0 siblings, 1 reply; 14+ messages in thread From: Lyn M @ 2014-12-29 20:18 UTC (permalink / raw) To: dev Hello all, Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe card with 2x10 GbE fiber) FC20 with hugepages enabled DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc */usr/src/dpdk/tools/dpdk_nic_bind.py --status* Network devices using DPDK-compatible driver ============================================ 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio unused=ixgbe 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio unused=ixgbe Network devices using kernel driver =================================== 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb unused=igb_uio 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb unused=igb_uio 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb unused=igb_uio 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb unused=igb_uio 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 drv=ixgbe unused=igb_uio *Active* 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 drv=ixgbe unused=igb_uio Other network devices ===================== <none> The DPDK helloworld example seems to run OK, other than the warning about IVSHMEM configuration not found: *./helloworld -c 0x3 -n 4* EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 1 on socket 0 EAL: Detected lcore 2 as core 2 on socket 0 EAL: Detected lcore 3 as core 3 on socket 0 EAL: Detected lcore 4 as core 4 on socket 0 EAL: Detected lcore 5 as core 5 on socket 0 EAL: Detected lcore 6 as core 6 on socket 0 EAL: Detected lcore 7 as core 7 on socket 0 EAL: Support maximum 128 logical core(s) by configuration. EAL: Detected 8 lcore(s) EAL: Searching for IVSHMEM devices... EAL: No IVSHMEM configuration found! EAL: Setting up memory... EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) EAL: Ask a virtual area of 0x29400000 bytes EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) EAL: Ask a virtual area of 0x14d000000 bytes EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) EAL: Requesting 3000 pages of size 2MB from socket 0 EAL: TSC frequency is ~2393997 KHz EAL: Master core 0 is ready (tid=a4ca2840) EAL: Core 1 is ready (tid=2bbff700) hello from core 1 hello from core 0 I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in the DPDK 1.2 Release Benchmark Test Report .pdf: *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 -config="(0,0,1),(1,0,2)"* where the "-p option is the hexadecimal bit mask of the ports to configure" I am running this command: *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 --config="(0,0,0),(1,0,1)" --no-numa* EAL: Detected lcore 0 as core 0 on socket 0 EAL: Detected lcore 1 as core 1 on socket 0 EAL: Detected lcore 2 as core 2 on socket 0 EAL: Detected lcore 3 as core 3 on socket 0 EAL: Detected lcore 4 as core 4 on socket 0 EAL: Detected lcore 5 as core 5 on socket 0 EAL: Detected lcore 6 as core 6 on socket 0 EAL: Detected lcore 7 as core 7 on socket 0 EAL: Support maximum 128 logical core(s) by configuration. EAL: Detected 8 lcore(s) EAL: Searching for IVSHMEM devices... EAL: No IVSHMEM configuration found! EAL: Setting up memory... EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) EAL: Ask a virtual area of 0x29400000 bytes EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) EAL: Ask a virtual area of 0x400000 bytes EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) EAL: Ask a virtual area of 0x14d000000 bytes EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) EAL: Ask a virtual area of 0x200000 bytes EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) EAL: Requesting 512 pages of size 2MB from socket 0 EAL: TSC frequency is ~2393998 KHz EAL: Master core 0 is ready (tid=14734840) EAL: Core 1 is ready (tid=e8bff700) numa is disabled port 0 is not present on the board EAL: Error - exiting with code: 1 Cause: check_port_config failed Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux command, or combination of commands, would help show the appropriate hex portmask to use in my case? Thanks for your time, Lyn ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-29 20:18 [dpdk-dev] l3fwd error, port 0 is not present on the board Lyn M @ 2014-12-29 21:02 ` Neil Horman 2014-12-30 18:54 ` Lyn M 0 siblings, 1 reply; 14+ messages in thread From: Neil Horman @ 2014-12-29 21:02 UTC (permalink / raw) To: Lyn M; +Cc: dev On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > Hello all, > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe card > with 2x10 GbE fiber) > FC20 with hugepages enabled > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > Network devices using DPDK-compatible driver > > ============================================ > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > unused=ixgbe > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > unused=ixgbe > > > > Network devices using kernel driver > > =================================== > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb unused=igb_uio > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb unused=igb_uio > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb unused=igb_uio > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb unused=igb_uio > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 drv=ixgbe > unused=igb_uio *Active* > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 drv=ixgbe > unused=igb_uio > > > > Other network devices > > ===================== > > <none> > > The DPDK helloworld example seems to run OK, other than the warning about > IVSHMEM configuration not found: > *./helloworld -c 0x3 -n 4* > EAL: Detected lcore 0 as core 0 on socket 0 > EAL: Detected lcore 1 as core 1 on socket 0 > EAL: Detected lcore 2 as core 2 on socket 0 > EAL: Detected lcore 3 as core 3 on socket 0 > EAL: Detected lcore 4 as core 4 on socket 0 > EAL: Detected lcore 5 as core 5 on socket 0 > EAL: Detected lcore 6 as core 6 on socket 0 > EAL: Detected lcore 7 as core 7 on socket 0 > EAL: Support maximum 128 logical core(s) by configuration. > EAL: Detected 8 lcore(s) > EAL: Searching for IVSHMEM devices... > EAL: No IVSHMEM configuration found! > EAL: Setting up memory... > EAL: Ask a virtual area of 0x200000 bytes > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > EAL: Ask a virtual area of 0x29400000 bytes > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > EAL: Ask a virtual area of 0x400000 bytes > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > EAL: Ask a virtual area of 0x200000 bytes > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > EAL: Ask a virtual area of 0x200000 bytes > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > EAL: Ask a virtual area of 0x14d000000 bytes > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > EAL: Ask a virtual area of 0x200000 bytes > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > EAL: Requesting 3000 pages of size 2MB from socket 0 > EAL: TSC frequency is ~2393997 KHz > EAL: Master core 0 is ready (tid=a4ca2840) > EAL: Core 1 is ready (tid=2bbff700) > hello from core 1 > hello from core 0 > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in the > DPDK 1.2 Release Benchmark Test Report .pdf: > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > -config="(0,0,1),(1,0,2)"* > where the "-p option is the hexadecimal bit mask of the ports to configure" > > I am running this command: > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > --config="(0,0,0),(1,0,1)" --no-numa* > > EAL: Detected lcore 0 as core 0 on socket 0 > > EAL: Detected lcore 1 as core 1 on socket 0 > > EAL: Detected lcore 2 as core 2 on socket 0 > > EAL: Detected lcore 3 as core 3 on socket 0 > > EAL: Detected lcore 4 as core 4 on socket 0 > > EAL: Detected lcore 5 as core 5 on socket 0 > > EAL: Detected lcore 6 as core 6 on socket 0 > > EAL: Detected lcore 7 as core 7 on socket 0 > > EAL: Support maximum 128 logical core(s) by configuration. > > EAL: Detected 8 lcore(s) > > EAL: Searching for IVSHMEM devices... > > EAL: No IVSHMEM configuration found! > > EAL: Setting up memory... > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > EAL: Ask a virtual area of 0x29400000 bytes > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > EAL: Ask a virtual area of 0x400000 bytes > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > EAL: Ask a virtual area of 0x14d000000 bytes > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > EAL: Requesting 512 pages of size 2MB from socket 0 > > EAL: TSC frequency is ~2393998 KHz > > EAL: Master core 0 is ready (tid=14734840) > > EAL: Core 1 is ready (tid=e8bff700) > > numa is disabled > > port 0 is not present on the board > > EAL: Error - exiting with code: 1 > > Cause: check_port_config failed > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux command, or > combination of commands, would help show the appropriate hex portmask to > use in my case? > > Thanks for your time, > Lyn > I don't see the detection of any of your physical devices here. I'm guessing your setup is just looking for ivshmem devices, which you won't have any of in FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, which is why you're getting the error the results from portid 0 being greater than the number of detected ports on the system neil ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-29 21:02 ` Neil Horman @ 2014-12-30 18:54 ` Lyn M 2014-12-30 21:24 ` Neil Horman 0 siblings, 1 reply; 14+ messages in thread From: Lyn M @ 2014-12-30 18:54 UTC (permalink / raw) To: Neil Horman; +Cc: dev Neil, thank you for your reply. I used the DPDK 8.1.0 setup.sh script to clean the system (unbind NICs, rmmod igb_uio and uio, remove hugepage mappings), and then re-built for x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, bound the NICs, but have the same result when trying to run testpmd: EAL: Error - exiting with code: 1 Cause: No probed ethernet device I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh script to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs successfully, and I am able to run my l3fwd command as well. I also built for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other than the warning about no IVSHMEM configuration). Thoughts? On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > Hello all, > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe card > > with 2x10 GbE fiber) > > FC20 with hugepages enabled > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > Network devices using DPDK-compatible driver > > > > ============================================ > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > > unused=ixgbe > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > > unused=ixgbe > > > > > > > > Network devices using kernel driver > > > > =================================== > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > unused=igb_uio > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > unused=igb_uio > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > unused=igb_uio > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > unused=igb_uio > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 drv=ixgbe > > unused=igb_uio *Active* > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 drv=ixgbe > > unused=igb_uio > > > > > > > > Other network devices > > > > ===================== > > > > <none> > > > > The DPDK helloworld example seems to run OK, other than the warning about > > IVSHMEM configuration not found: > > *./helloworld -c 0x3 -n 4* > > EAL: Detected lcore 0 as core 0 on socket 0 > > EAL: Detected lcore 1 as core 1 on socket 0 > > EAL: Detected lcore 2 as core 2 on socket 0 > > EAL: Detected lcore 3 as core 3 on socket 0 > > EAL: Detected lcore 4 as core 4 on socket 0 > > EAL: Detected lcore 5 as core 5 on socket 0 > > EAL: Detected lcore 6 as core 6 on socket 0 > > EAL: Detected lcore 7 as core 7 on socket 0 > > EAL: Support maximum 128 logical core(s) by configuration. > > EAL: Detected 8 lcore(s) > > EAL: Searching for IVSHMEM devices... > > EAL: No IVSHMEM configuration found! > > EAL: Setting up memory... > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > EAL: Ask a virtual area of 0x29400000 bytes > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > EAL: Ask a virtual area of 0x400000 bytes > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > EAL: Ask a virtual area of 0x14d000000 bytes > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > EAL: Ask a virtual area of 0x200000 bytes > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > EAL: TSC frequency is ~2393997 KHz > > EAL: Master core 0 is ready (tid=a4ca2840) > > EAL: Core 1 is ready (tid=2bbff700) > > hello from core 1 > > hello from core 0 > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in the > > DPDK 1.2 Release Benchmark Test Report .pdf: > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > -config="(0,0,1),(1,0,2)"* > > where the "-p option is the hexadecimal bit mask of the ports to > configure" > > > > I am running this command: > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > EAL: Detected 8 lcore(s) > > > > EAL: Searching for IVSHMEM devices... > > > > EAL: No IVSHMEM configuration found! > > > > EAL: Setting up memory... > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > EAL: TSC frequency is ~2393998 KHz > > > > EAL: Master core 0 is ready (tid=14734840) > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > numa is disabled > > > > port 0 is not present on the board > > > > EAL: Error - exiting with code: 1 > > > > Cause: check_port_config failed > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux command, or > > combination of commands, would help show the appropriate hex portmask to > > use in my case? > > > > Thanks for your time, > > Lyn > > > I don't see the detection of any of your physical devices here. I'm > guessing > your setup is just looking for ivshmem devices, which you won't have any > of in > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, which > is why > you're getting the error the results from portid 0 being greater than the > number > of detected ports on the system > > neil > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-30 18:54 ` Lyn M @ 2014-12-30 21:24 ` Neil Horman 2014-12-31 14:18 ` Lyn M 0 siblings, 1 reply; 14+ messages in thread From: Neil Horman @ 2014-12-30 21:24 UTC (permalink / raw) To: Lyn M; +Cc: dev On Tue, Dec 30, 2014 at 12:54:17PM -0600, Lyn M wrote: > Neil, thank you for your reply. > > I used the DPDK 8.1.0 setup.sh script to clean the system (unbind NICs, > rmmod igb_uio and uio, remove hugepage mappings), and then re-built for > x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, bound the > NICs, but have the same result when trying to run testpmd: > EAL: Error - exiting with code: 1 > Cause: No probed ethernet device > > > I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh script > to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs > successfully, and I am able to run my l3fwd command as well. I also built > for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other than > the warning about no IVSHMEM configuration). > > Thoughts? > Well, the root cause is still the same, DPDK isn't detecting any devices over which to forward traffic, which means the nb_port count is zero. That would suggest that you didn't find any devices during rte_eal_init. The question is why. I'd turn on all the pmd init debug macros to see if all the init routines are getting called. Two questions: (1) are you doing a static or DSO build, and (2) did you make any changes to the make flags? Neil > On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > > > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > > Hello all, > > > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe card > > > with 2x10 GbE fiber) > > > FC20 with hugepages enabled > > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > > > > > Network devices using DPDK-compatible driver > > > > > > ============================================ > > > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > > > unused=ixgbe > > > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' drv=igb_uio > > > unused=ixgbe > > > > > > > > > > > > Network devices using kernel driver > > > > > > =================================== > > > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > > unused=igb_uio > > > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > > unused=igb_uio > > > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > > unused=igb_uio > > > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > > unused=igb_uio > > > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 drv=ixgbe > > > unused=igb_uio *Active* > > > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 drv=ixgbe > > > unused=igb_uio > > > > > > > > > > > > Other network devices > > > > > > ===================== > > > > > > <none> > > > > > > The DPDK helloworld example seems to run OK, other than the warning about > > > IVSHMEM configuration not found: > > > *./helloworld -c 0x3 -n 4* > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > EAL: Support maximum 128 logical core(s) by configuration. > > > EAL: Detected 8 lcore(s) > > > EAL: Searching for IVSHMEM devices... > > > EAL: No IVSHMEM configuration found! > > > EAL: Setting up memory... > > > EAL: Ask a virtual area of 0x200000 bytes > > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > > EAL: Ask a virtual area of 0x29400000 bytes > > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > > EAL: Ask a virtual area of 0x400000 bytes > > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > > EAL: Ask a virtual area of 0x200000 bytes > > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > > EAL: Ask a virtual area of 0x200000 bytes > > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > > EAL: Ask a virtual area of 0x200000 bytes > > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > > EAL: TSC frequency is ~2393997 KHz > > > EAL: Master core 0 is ready (tid=a4ca2840) > > > EAL: Core 1 is ready (tid=2bbff700) > > > hello from core 1 > > > hello from core 0 > > > > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in the > > > DPDK 1.2 Release Benchmark Test Report .pdf: > > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > -config="(0,0,1),(1,0,2)"* > > > where the "-p option is the hexadecimal bit mask of the ports to > > configure" > > > > > > I am running this command: > > > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > EAL: Detected 8 lcore(s) > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > EAL: No IVSHMEM configuration found! > > > > > > EAL: Setting up memory... > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > > > EAL: TSC frequency is ~2393998 KHz > > > > > > EAL: Master core 0 is ready (tid=14734840) > > > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > > > numa is disabled > > > > > > port 0 is not present on the board > > > > > > EAL: Error - exiting with code: 1 > > > > > > Cause: check_port_config failed > > > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux command, or > > > combination of commands, would help show the appropriate hex portmask to > > > use in my case? > > > > > > Thanks for your time, > > > Lyn > > > > > I don't see the detection of any of your physical devices here. I'm > > guessing > > your setup is just looking for ivshmem devices, which you won't have any > > of in > > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, which > > is why > > you're getting the error the results from portid 0 being greater than the > > number > > of detected ports on the system > > > > neil > > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-30 21:24 ` Neil Horman @ 2014-12-31 14:18 ` Lyn M 2014-12-31 14:48 ` Neil Horman 0 siblings, 1 reply; 14+ messages in thread From: Lyn M @ 2014-12-31 14:18 UTC (permalink / raw) To: Neil Horman; +Cc: dev Neil, to build DPDK, I am doing the following steps: 1) download DPDK tarball (1.7.1 or 1.8.0) from http://dpdk.org/browse/dpdk/refs/ 2) untar 3) edit config/common_linuxapp and change CONFIG_RTE_BUILD_COMBINE_LIBS from "n" to "y" 4) follow all of the steps in http://dpdk.org/doc/quick-start When I do those steps for DPDK 1.7.1, the output of testpmd is OK, and I see both of my NICs that are bound to igb_uio. When I do those steps for DPDK 1.8.0, the output of testpmd is: EAL: Error - exiting with code: 1 Cause: No probed ethernet device I see the same result when I use the setup.sh script instead of manually doing the steps in http://dpdk.org/doc/quick-start Can you please show me an example of enabling the pmd init debug macros? Lyn On Tue, Dec 30, 2014 at 3:24 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > On Tue, Dec 30, 2014 at 12:54:17PM -0600, Lyn M wrote: > > Neil, thank you for your reply. > > > > I used the DPDK 8.1.0 setup.sh script to clean the system (unbind NICs, > > rmmod igb_uio and uio, remove hugepage mappings), and then re-built for > > x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, bound > the > > NICs, but have the same result when trying to run testpmd: > > EAL: Error - exiting with code: 1 > > Cause: No probed ethernet device > > > > > > I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh > script > > to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs > > successfully, and I am able to run my l3fwd command as well. I also built > > for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other than > > the warning about no IVSHMEM configuration). > > > > Thoughts? > > > Well, the root cause is still the same, DPDK isn't detecting any devices > over > which to forward traffic, which means the nb_port count is zero. That > would > suggest that you didn't find any devices during rte_eal_init. The > question is > why. I'd turn on all the pmd init debug macros to see if all the init > routines > are getting called. > > Two questions: (1) are you doing a static or DSO build, and (2) did you > make any > changes to the make flags? > > Neil > > > On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> > wrote: > > > > > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > > > Hello all, > > > > > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe > card > > > > with 2x10 GbE fiber) > > > > FC20 with hugepages enabled > > > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > > > > > > > > > Network devices using DPDK-compatible driver > > > > > > > > ============================================ > > > > > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > drv=igb_uio > > > > unused=ixgbe > > > > > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > drv=igb_uio > > > > unused=ixgbe > > > > > > > > > > > > > > > > Network devices using kernel driver > > > > > > > > =================================== > > > > > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > > > unused=igb_uio > > > > > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > > > unused=igb_uio > > > > > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > > > unused=igb_uio > > > > > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > > > unused=igb_uio > > > > > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 > drv=ixgbe > > > > unused=igb_uio *Active* > > > > > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 > drv=ixgbe > > > > unused=igb_uio > > > > > > > > > > > > > > > > Other network devices > > > > > > > > ===================== > > > > > > > > <none> > > > > > > > > The DPDK helloworld example seems to run OK, other than the warning > about > > > > IVSHMEM configuration not found: > > > > *./helloworld -c 0x3 -n 4* > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > EAL: Detected 8 lcore(s) > > > > EAL: Searching for IVSHMEM devices... > > > > EAL: No IVSHMEM configuration found! > > > > EAL: Setting up memory... > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > > > EAL: TSC frequency is ~2393997 KHz > > > > EAL: Master core 0 is ready (tid=a4ca2840) > > > > EAL: Core 1 is ready (tid=2bbff700) > > > > hello from core 1 > > > > hello from core 0 > > > > > > > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in > the > > > > DPDK 1.2 Release Benchmark Test Report .pdf: > > > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > -config="(0,0,1),(1,0,2)"* > > > > where the "-p option is the hexadecimal bit mask of the ports to > > > configure" > > > > > > > > I am running this command: > > > > > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > > > EAL: Detected 8 lcore(s) > > > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > > > EAL: No IVSHMEM configuration found! > > > > > > > > EAL: Setting up memory... > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > > > > > EAL: TSC frequency is ~2393998 KHz > > > > > > > > EAL: Master core 0 is ready (tid=14734840) > > > > > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > > > > > numa is disabled > > > > > > > > port 0 is not present on the board > > > > > > > > EAL: Error - exiting with code: 1 > > > > > > > > Cause: check_port_config failed > > > > > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux > command, or > > > > combination of commands, would help show the appropriate hex > portmask to > > > > use in my case? > > > > > > > > Thanks for your time, > > > > Lyn > > > > > > > I don't see the detection of any of your physical devices here. I'm > > > guessing > > > your setup is just looking for ivshmem devices, which you won't have > any > > > of in > > > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, > which > > > is why > > > you're getting the error the results from portid 0 being greater than > the > > > number > > > of detected ports on the system > > > > > > neil > > > > > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-31 14:18 ` Lyn M @ 2014-12-31 14:48 ` Neil Horman 2014-12-31 16:50 ` Lyn M 0 siblings, 1 reply; 14+ messages in thread From: Neil Horman @ 2014-12-31 14:48 UTC (permalink / raw) To: Lyn M; +Cc: dev On Wed, Dec 31, 2014 at 08:18:34AM -0600, Lyn M wrote: > Neil, to build DPDK, I am doing the following steps: > 1) download DPDK tarball (1.7.1 or 1.8.0) from > http://dpdk.org/browse/dpdk/refs/ > 2) untar > 3) edit config/common_linuxapp and change CONFIG_RTE_BUILD_COMBINE_LIBS > from "n" to "y" > 4) follow all of the steps in http://dpdk.org/doc/quick-start > Hmm, I wonder if you're seeing a problem in which the constructors don't get linked in properly. Does it work if you don't specify CONFIG_RTE_BUILD_COMBINE_LIBS? I.e. if you build several .a files? Can you objdump -t the resultant binary with and without COMBINE_LIBS and post it? Neil > When I do those steps for DPDK 1.7.1, the output of testpmd is OK, and I > see both of my NICs that are bound to igb_uio. > When I do those steps for DPDK 1.8.0, the output of testpmd is: > EAL: Error - exiting with code: 1 > Cause: No probed ethernet device > > I see the same result when I use the setup.sh script instead of manually > doing the steps in http://dpdk.org/doc/quick-start > > Can you please show me an example of enabling the pmd init debug macros? > > Lyn > > On Tue, Dec 30, 2014 at 3:24 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > > > On Tue, Dec 30, 2014 at 12:54:17PM -0600, Lyn M wrote: > > > Neil, thank you for your reply. > > > > > > I used the DPDK 8.1.0 setup.sh script to clean the system (unbind NICs, > > > rmmod igb_uio and uio, remove hugepage mappings), and then re-built for > > > x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, bound > > the > > > NICs, but have the same result when trying to run testpmd: > > > EAL: Error - exiting with code: 1 > > > Cause: No probed ethernet device > > > > > > > > > I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh > > script > > > to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs > > > successfully, and I am able to run my l3fwd command as well. I also built > > > for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other than > > > the warning about no IVSHMEM configuration). > > > > > > Thoughts? > > > > > Well, the root cause is still the same, DPDK isn't detecting any devices > > over > > which to forward traffic, which means the nb_port count is zero. That > > would > > suggest that you didn't find any devices during rte_eal_init. The > > question is > > why. I'd turn on all the pmd init debug macros to see if all the init > > routines > > are getting called. > > > > Two questions: (1) are you doing a static or DSO build, and (2) did you > > make any > > changes to the make flags? > > > > Neil > > > > > On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> > > wrote: > > > > > > > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > > > > Hello all, > > > > > > > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel PCIe > > card > > > > > with 2x10 GbE fiber) > > > > > FC20 with hugepages enabled > > > > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > > > > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > > > > > > > > > > > > > Network devices using DPDK-compatible driver > > > > > > > > > > ============================================ > > > > > > > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > drv=igb_uio > > > > > unused=ixgbe > > > > > > > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > drv=igb_uio > > > > > unused=ixgbe > > > > > > > > > > > > > > > > > > > > Network devices using kernel driver > > > > > > > > > > =================================== > > > > > > > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > > > > unused=igb_uio > > > > > > > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > > > > unused=igb_uio > > > > > > > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > > > > unused=igb_uio > > > > > > > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > > > > unused=igb_uio > > > > > > > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 > > drv=ixgbe > > > > > unused=igb_uio *Active* > > > > > > > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 > > drv=ixgbe > > > > > unused=igb_uio > > > > > > > > > > > > > > > > > > > > Other network devices > > > > > > > > > > ===================== > > > > > > > > > > <none> > > > > > > > > > > The DPDK helloworld example seems to run OK, other than the warning > > about > > > > > IVSHMEM configuration not found: > > > > > *./helloworld -c 0x3 -n 4* > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > EAL: Detected 8 lcore(s) > > > > > EAL: Searching for IVSHMEM devices... > > > > > EAL: No IVSHMEM configuration found! > > > > > EAL: Setting up memory... > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > > > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > > > > EAL: TSC frequency is ~2393997 KHz > > > > > EAL: Master core 0 is ready (tid=a4ca2840) > > > > > EAL: Core 1 is ready (tid=2bbff700) > > > > > hello from core 1 > > > > > hello from core 0 > > > > > > > > > > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) in > > the > > > > > DPDK 1.2 Release Benchmark Test Report .pdf: > > > > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > -config="(0,0,1),(1,0,2)"* > > > > > where the "-p option is the hexadecimal bit mask of the ports to > > > > configure" > > > > > > > > > > I am running this command: > > > > > > > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > > > > > EAL: Detected 8 lcore(s) > > > > > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > > > > > EAL: No IVSHMEM configuration found! > > > > > > > > > > EAL: Setting up memory... > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > > > > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > > > > > > > EAL: TSC frequency is ~2393998 KHz > > > > > > > > > > EAL: Master core 0 is ready (tid=14734840) > > > > > > > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > > > > > > > numa is disabled > > > > > > > > > > port 0 is not present on the board > > > > > > > > > > EAL: Error - exiting with code: 1 > > > > > > > > > > Cause: check_port_config failed > > > > > > > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux > > command, or > > > > > combination of commands, would help show the appropriate hex > > portmask to > > > > > use in my case? > > > > > > > > > > Thanks for your time, > > > > > Lyn > > > > > > > > > I don't see the detection of any of your physical devices here. I'm > > > > guessing > > > > your setup is just looking for ivshmem devices, which you won't have > > any > > > > of in > > > > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, > > which > > > > is why > > > > you're getting the error the results from portid 0 being greater than > > the > > > > number > > > > of detected ports on the system > > > > > > > > neil > > > > > > > > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-31 14:48 ` Neil Horman @ 2014-12-31 16:50 ` Lyn M 2015-01-01 3:37 ` Neil Horman 0 siblings, 1 reply; 14+ messages in thread From: Lyn M @ 2014-12-31 16:50 UTC (permalink / raw) To: Neil Horman; +Cc: dev Neil, When I build DPDK 1.8.0 with the default value CONFIG_RTE_BUILD_COMBINE_LIBS=n, I am able to run the testpmd successfully. So, that does appear to be the culprit. The objdump -t output for testpmd (with COMBINE_LIBS=n and COMBINE_LIBS=y) files are here: https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 Thanks, Lyn On Wed, Dec 31, 2014 at 8:48 AM, Neil Horman <nhorman@tuxdriver.com> wrote: > On Wed, Dec 31, 2014 at 08:18:34AM -0600, Lyn M wrote: > > Neil, to build DPDK, I am doing the following steps: > > 1) download DPDK tarball (1.7.1 or 1.8.0) from > > http://dpdk.org/browse/dpdk/refs/ > > 2) untar > > 3) edit config/common_linuxapp and change CONFIG_RTE_BUILD_COMBINE_LIBS > > from "n" to "y" > > 4) follow all of the steps in http://dpdk.org/doc/quick-start > > > Hmm, I wonder if you're seeing a problem in which the constructors don't > get > linked in properly. Does it work if you don't specify > CONFIG_RTE_BUILD_COMBINE_LIBS? I.e. if you build several .a files? > > Can you objdump -t the resultant binary with and without COMBINE_LIBS and > post > it? > > Neil > > > When I do those steps for DPDK 1.7.1, the output of testpmd is OK, and I > > see both of my NICs that are bound to igb_uio. > > When I do those steps for DPDK 1.8.0, the output of testpmd is: > > EAL: Error - exiting with code: 1 > > Cause: No probed ethernet device > > > > I see the same result when I use the setup.sh script instead of manually > > doing the steps in http://dpdk.org/doc/quick-start > > > > Can you please show me an example of enabling the pmd init debug macros? > > > > Lyn > > > > On Tue, Dec 30, 2014 at 3:24 PM, Neil Horman <nhorman@tuxdriver.com> > wrote: > > > > > On Tue, Dec 30, 2014 at 12:54:17PM -0600, Lyn M wrote: > > > > Neil, thank you for your reply. > > > > > > > > I used the DPDK 8.1.0 setup.sh script to clean the system (unbind > NICs, > > > > rmmod igb_uio and uio, remove hugepage mappings), and then re-built > for > > > > x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, > bound > > > the > > > > NICs, but have the same result when trying to run testpmd: > > > > EAL: Error - exiting with code: 1 > > > > Cause: No probed ethernet device > > > > > > > > > > > > I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh > > > script > > > > to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs > > > > successfully, and I am able to run my l3fwd command as well. I also > built > > > > for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other > than > > > > the warning about no IVSHMEM configuration). > > > > > > > > Thoughts? > > > > > > > Well, the root cause is still the same, DPDK isn't detecting any > devices > > > over > > > which to forward traffic, which means the nb_port count is zero. That > > > would > > > suggest that you didn't find any devices during rte_eal_init. The > > > question is > > > why. I'd turn on all the pmd init debug macros to see if all the init > > > routines > > > are getting called. > > > > > > Two questions: (1) are you doing a static or DSO build, and (2) did you > > > make any > > > changes to the make flags? > > > > > > Neil > > > > > > > On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> > > > wrote: > > > > > > > > > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > > > > > Hello all, > > > > > > > > > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel > PCIe > > > card > > > > > > with 2x10 GbE fiber) > > > > > > FC20 with hugepages enabled > > > > > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > > > > > > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > > > > > > > > > > > > > > > > > Network devices using DPDK-compatible driver > > > > > > > > > > > > ============================================ > > > > > > > > > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > > drv=igb_uio > > > > > > unused=ixgbe > > > > > > > > > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > > drv=igb_uio > > > > > > unused=ixgbe > > > > > > > > > > > > > > > > > > > > > > > > Network devices using kernel driver > > > > > > > > > > > > =================================== > > > > > > > > > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > > > > > unused=igb_uio > > > > > > > > > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > > > > > unused=igb_uio > > > > > > > > > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > > > > > unused=igb_uio > > > > > > > > > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > > > > > unused=igb_uio > > > > > > > > > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 > > > drv=ixgbe > > > > > > unused=igb_uio *Active* > > > > > > > > > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 > > > drv=ixgbe > > > > > > unused=igb_uio > > > > > > > > > > > > > > > > > > > > > > > > Other network devices > > > > > > > > > > > > ===================== > > > > > > > > > > > > <none> > > > > > > > > > > > > The DPDK helloworld example seems to run OK, other than the > warning > > > about > > > > > > IVSHMEM configuration not found: > > > > > > *./helloworld -c 0x3 -n 4* > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > EAL: Detected 8 lcore(s) > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > EAL: No IVSHMEM configuration found! > > > > > > EAL: Setting up memory... > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > > > > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > > > > > EAL: TSC frequency is ~2393997 KHz > > > > > > EAL: Master core 0 is ready (tid=a4ca2840) > > > > > > EAL: Core 1 is ready (tid=2bbff700) > > > > > > hello from core 1 > > > > > > hello from core 0 > > > > > > > > > > > > > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) > in > > > the > > > > > > DPDK 1.2 Release Benchmark Test Report .pdf: > > > > > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > > -config="(0,0,1),(1,0,2)"* > > > > > > where the "-p option is the hexadecimal bit mask of the ports to > > > > > configure" > > > > > > > > > > > > I am running this command: > > > > > > > > > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > > > > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > > > > > > > EAL: Detected 8 lcore(s) > > > > > > > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > > > > > > > EAL: No IVSHMEM configuration found! > > > > > > > > > > > > EAL: Setting up memory... > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > > > > > > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > > > > > > > > > EAL: TSC frequency is ~2393998 KHz > > > > > > > > > > > > EAL: Master core 0 is ready (tid=14734840) > > > > > > > > > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > > > > > > > > > numa is disabled > > > > > > > > > > > > port 0 is not present on the board > > > > > > > > > > > > EAL: Error - exiting with code: 1 > > > > > > > > > > > > Cause: check_port_config failed > > > > > > > > > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux > > > command, or > > > > > > combination of commands, would help show the appropriate hex > > > portmask to > > > > > > use in my case? > > > > > > > > > > > > Thanks for your time, > > > > > > Lyn > > > > > > > > > > > I don't see the detection of any of your physical devices here. > I'm > > > > > guessing > > > > > your setup is just looking for ivshmem devices, which you won't > have > > > any > > > > > of in > > > > > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, > > > which > > > > > is why > > > > > you're getting the error the results from portid 0 being greater > than > > > the > > > > > number > > > > > of detected ports on the system > > > > > > > > > > neil > > > > > > > > > > > > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2014-12-31 16:50 ` Lyn M @ 2015-01-01 3:37 ` Neil Horman 2015-01-01 4:00 ` Neil Horman 0 siblings, 1 reply; 14+ messages in thread From: Neil Horman @ 2015-01-01 3:37 UTC (permalink / raw) To: Lyn M; +Cc: dev On Wed, Dec 31, 2014 at 10:50:10AM -0600, Lyn M wrote: > Neil, > When I build DPDK 1.8.0 with the default value CONFIG_RTE_BUILD_COMBINE_LIBS=n, > I am able to run the testpmd successfully. So, that does appear to be the > culprit. > The objdump -t output for testpmd (with COMBINE_LIBS=n and COMBINE_LIBS=y) > files are here: > https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 > > Thanks, > Lyn > I see the problem. none of the constructors are included in the l3fwd app. I think you might need 174572477028b7f04700389e38f87d2ba01a0adc. Its also possible something else has gone wrong withthe COMBINE_LIBS option. Try building with the head of the tree, and if that doesn't fix it, we can start debugging in earnest. Neil > On Wed, Dec 31, 2014 at 8:48 AM, Neil Horman <nhorman@tuxdriver.com> wrote: > > > On Wed, Dec 31, 2014 at 08:18:34AM -0600, Lyn M wrote: > > > Neil, to build DPDK, I am doing the following steps: > > > 1) download DPDK tarball (1.7.1 or 1.8.0) from > > > http://dpdk.org/browse/dpdk/refs/ > > > 2) untar > > > 3) edit config/common_linuxapp and change CONFIG_RTE_BUILD_COMBINE_LIBS > > > from "n" to "y" > > > 4) follow all of the steps in http://dpdk.org/doc/quick-start > > > > > Hmm, I wonder if you're seeing a problem in which the constructors don't > > get > > linked in properly. Does it work if you don't specify > > CONFIG_RTE_BUILD_COMBINE_LIBS? I.e. if you build several .a files? > > > > Can you objdump -t the resultant binary with and without COMBINE_LIBS and > > post > > it? > > > > Neil > > > > > When I do those steps for DPDK 1.7.1, the output of testpmd is OK, and I > > > see both of my NICs that are bound to igb_uio. > > > When I do those steps for DPDK 1.8.0, the output of testpmd is: > > > EAL: Error - exiting with code: 1 > > > Cause: No probed ethernet device > > > > > > I see the same result when I use the setup.sh script instead of manually > > > doing the steps in http://dpdk.org/doc/quick-start > > > > > > Can you please show me an example of enabling the pmd init debug macros? > > > > > > Lyn > > > > > > On Tue, Dec 30, 2014 at 3:24 PM, Neil Horman <nhorman@tuxdriver.com> > > wrote: > > > > > > > On Tue, Dec 30, 2014 at 12:54:17PM -0600, Lyn M wrote: > > > > > Neil, thank you for your reply. > > > > > > > > > > I used the DPDK 8.1.0 setup.sh script to clean the system (unbind > > NICs, > > > > > rmmod igb_uio and uio, remove hugepage mappings), and then re-built > > for > > > > > x86_64-native-linuxapp-gcc, setup hugepages, insmod the modules, > > bound > > > > the > > > > > NICs, but have the same result when trying to run testpmd: > > > > > EAL: Error - exiting with code: 1 > > > > > Cause: No probed ethernet device > > > > > > > > > > > > > > > I then cleaned up again, downloaded DPDK 1.7.1 and ran the setup.sh > > > > script > > > > > to build for x86_64-native-linuxapp-gcc. With 1.7.1, testpmd runs > > > > > successfully, and I am able to run my l3fwd command as well. I also > > built > > > > > for x86_64-ivshmem-linuxapp-gcc, and testpmd ran successfully (other > > than > > > > > the warning about no IVSHMEM configuration). > > > > > > > > > > Thoughts? > > > > > > > > > Well, the root cause is still the same, DPDK isn't detecting any > > devices > > > > over > > > > which to forward traffic, which means the nb_port count is zero. That > > > > would > > > > suggest that you didn't find any devices during rte_eal_init. The > > > > question is > > > > why. I'd turn on all the pmd init debug macros to see if all the init > > > > routines > > > > are getting called. > > > > > > > > Two questions: (1) are you doing a static or DSO build, and (2) did you > > > > make any > > > > changes to the make flags? > > > > > > > > Neil > > > > > > > > > On Mon, Dec 29, 2014 at 3:02 PM, Neil Horman <nhorman@tuxdriver.com> > > > > wrote: > > > > > > > > > > > On Mon, Dec 29, 2014 at 02:18:09PM -0600, Lyn M wrote: > > > > > > > Hello all, > > > > > > > > > > > > > > Rangeley platform (1 CPU with 8 cores, 4x1 GbE, 2x10 GbE, Intel > > PCIe > > > > card > > > > > > > with 2x10 GbE fiber) > > > > > > > FC20 with hugepages enabled > > > > > > > DPDK 1.8.0 built with T=x86_64-ivshmem-linuxapp-gcc > > > > > > > > > > > > > > */usr/src/dpdk/tools/dpdk_nic_bind.py --status* > > > > > > > > > > > > > > > > > > > > > > > > > > > > Network devices using DPDK-compatible driver > > > > > > > > > > > > > > ============================================ > > > > > > > > > > > > > > 0000:09:00.0 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > > > drv=igb_uio > > > > > > > unused=ixgbe > > > > > > > > > > > > > > 0000:09:00.1 '82599ES 10-Gigabit SFI/SFP+ Network Connection' > > > > drv=igb_uio > > > > > > > unused=ixgbe > > > > > > > > > > > > > > > > > > > > > > > > > > > > Network devices using kernel driver > > > > > > > > > > > > > > =================================== > > > > > > > > > > > > > > 0000:00:14.0 'Ethernet Connection I354' if=enp0s20f0 drv=igb > > > > > > unused=igb_uio > > > > > > > > > > > > > > 0000:00:14.1 'Ethernet Connection I354' if=enp0s20f1 drv=igb > > > > > > unused=igb_uio > > > > > > > > > > > > > > 0000:00:14.2 'Ethernet Connection I354' if=enp0s20f2 drv=igb > > > > > > unused=igb_uio > > > > > > > > > > > > > > 0000:00:14.3 'Ethernet Connection I354' if=enp0s20f3 drv=igb > > > > > > unused=igb_uio > > > > > > > > > > > > > > 0000:07:00.0 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p1 > > > > drv=ixgbe > > > > > > > unused=igb_uio *Active* > > > > > > > > > > > > > > 0000:07:00.1 'Ethernet Controller 10-Gigabit X540-AT2' if=p5p2 > > > > drv=ixgbe > > > > > > > unused=igb_uio > > > > > > > > > > > > > > > > > > > > > > > > > > > > Other network devices > > > > > > > > > > > > > > ===================== > > > > > > > > > > > > > > <none> > > > > > > > > > > > > > > The DPDK helloworld example seems to run OK, other than the > > warning > > > > about > > > > > > > IVSHMEM configuration not found: > > > > > > > *./helloworld -c 0x3 -n 4* > > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > > EAL: Detected 8 lcore(s) > > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > > EAL: No IVSHMEM configuration found! > > > > > > > EAL: Setting up memory... > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > EAL: Virtual area found at 0x7fcca2c00000 (size = 0x200000) > > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > > EAL: Virtual area found at 0x7fcc79600000 (size = 0x29400000) > > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > > EAL: Virtual area found at 0x7fcca3400000 (size = 0x400000) > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > EAL: Virtual area found at 0x7fcca3000000 (size = 0x200000) > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > EAL: Virtual area found at 0x7fcc79200000 (size = 0x200000) > > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > > EAL: Virtual area found at 0x7fcb2c000000 (size = 0x14d000000) > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > EAL: Virtual area found at 0x7fcb2bc00000 (size = 0x200000) > > > > > > > EAL: Requesting 3000 pages of size 2MB from socket 0 > > > > > > > EAL: TSC frequency is ~2393997 KHz > > > > > > > EAL: Master core 0 is ready (tid=a4ca2840) > > > > > > > EAL: Core 1 is ready (tid=2bbff700) > > > > > > > hello from core 1 > > > > > > > hello from core 0 > > > > > > > > > > > > > > > > > > > > > I want to run the l3fwd example app, per Appendix A.2 (pg 35-36) > > in > > > > the > > > > > > > DPDK 1.2 Release Benchmark Test Report .pdf: > > > > > > > *./build/l3fwd -c 0x6 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > > > -config="(0,0,1),(1,0,2)"* > > > > > > > where the "-p option is the hexadecimal bit mask of the ports to > > > > > > configure" > > > > > > > > > > > > > > I am running this command: > > > > > > > > > > > > > > *./build/l3fwd -c 0x3 -n 4 --socket-mem 1024,0 -- -p 0x3 > > > > > > > --config="(0,0,0),(1,0,1)" --no-numa* > > > > > > > > > > > > > > EAL: Detected lcore 0 as core 0 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 1 as core 1 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 2 as core 2 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 3 as core 3 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 4 as core 4 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 5 as core 5 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 6 as core 6 on socket 0 > > > > > > > > > > > > > > EAL: Detected lcore 7 as core 7 on socket 0 > > > > > > > > > > > > > > EAL: Support maximum 128 logical core(s) by configuration. > > > > > > > > > > > > > > EAL: Detected 8 lcore(s) > > > > > > > > > > > > > > EAL: Searching for IVSHMEM devices... > > > > > > > > > > > > > > EAL: No IVSHMEM configuration found! > > > > > > > > > > > > > > EAL: Setting up memory... > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212600000 (size = 0x200000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x29400000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f31e9000000 (size = 0x29400000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x400000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212e00000 (size = 0x400000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f3212a00000 (size = 0x200000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f31e8c00000 (size = 0x200000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x14d000000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f309ba00000 (size = 0x14d000000) > > > > > > > > > > > > > > EAL: Ask a virtual area of 0x200000 bytes > > > > > > > > > > > > > > EAL: Virtual area found at 0x7f309b600000 (size = 0x200000) > > > > > > > > > > > > > > EAL: Requesting 512 pages of size 2MB from socket 0 > > > > > > > > > > > > > > EAL: TSC frequency is ~2393998 KHz > > > > > > > > > > > > > > EAL: Master core 0 is ready (tid=14734840) > > > > > > > > > > > > > > EAL: Core 1 is ready (tid=e8bff700) > > > > > > > > > > > > > > numa is disabled > > > > > > > > > > > > > > port 0 is not present on the board > > > > > > > > > > > > > > EAL: Error - exiting with code: 1 > > > > > > > > > > > > > > Cause: check_port_config failed > > > > > > > > > > > > > > Perhaps the 0x3 (0011) hex portmask is incorrect? What Linux > > > > command, or > > > > > > > combination of commands, would help show the appropriate hex > > > > portmask to > > > > > > > use in my case? > > > > > > > > > > > > > > Thanks for your time, > > > > > > > Lyn > > > > > > > > > > > > > I don't see the detection of any of your physical devices here. > > I'm > > > > > > guessing > > > > > > your setup is just looking for ivshmem devices, which you won't > > have > > > > any > > > > > > of in > > > > > > FC20 unless you rebuild qemu. As such, dpdk doesn't see any ports, > > > > which > > > > > > is why > > > > > > you're getting the error the results from portid 0 being greater > > than > > > > the > > > > > > number > > > > > > of detected ports on the system > > > > > > > > > > > > neil > > > > > > > > > > > > > > > > > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-01 3:37 ` Neil Horman @ 2015-01-01 4:00 ` Neil Horman 2015-01-02 15:07 ` Lyn M 0 siblings, 1 reply; 14+ messages in thread From: Neil Horman @ 2015-01-01 4:00 UTC (permalink / raw) To: Lyn M; +Cc: dev On Wed, Dec 31, 2014 at 10:37:45PM -0500, Neil Horman wrote: > On Wed, Dec 31, 2014 at 10:50:10AM -0600, Lyn M wrote: > > Neil, > > When I build DPDK 1.8.0 with the default value CONFIG_RTE_BUILD_COMBINE_LIBS=n, > > I am able to run the testpmd successfully. So, that does appear to be the > > culprit. > > The objdump -t output for testpmd (with COMBINE_LIBS=n and COMBINE_LIBS=y) > > files are here: > > https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 > > > > Thanks, > > Lyn > > > I see the problem. none of the constructors are included in the l3fwd app. I > think you might need 174572477028b7f04700389e38f87d2ba01a0adc. Its also > possible something else has gone wrong withthe COMBINE_LIBS option. Try > building with the head of the tree, and if that doesn't fix it, we can start > debugging in earnest. > Neil Found the problem. Please try this patch diff --git a/mk/rte.app.mk b/mk/rte.app.mk index e1a0dbf..40afb2c 100644 --- a/mk/rte.app.mk +++ b/mk/rte.app.mk @@ -61,6 +61,10 @@ ifeq ($(NO_AUTOLIBS),) LDLIBS += --whole-archive +ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) +LDLIBS += -l$(RTE_LIBNAME) +endif + ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) ifeq ($(CONFIG_RTE_LIBRTE_DISTRIBUTOR),y) @@ -251,10 +255,6 @@ build: _postbuild exe2cmd = $(strip $(call dotfile,$(patsubst %,%.cmd,$(1)))) -ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) -LDLIBS += -l$(RTE_LIBNAME) -endif - ifeq ($(LINK_USING_CC),1) override EXTRA_LDFLAGS := $(call linkerprefix,$(EXTRA_LDFLAGS)) O_TO_EXE = $(CC) $(CFLAGS) $(LDFLAGS_$(@)) \ ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-01 4:00 ` Neil Horman @ 2015-01-02 15:07 ` Lyn M 2015-01-02 19:54 ` Neil Horman ` (2 more replies) 0 siblings, 3 replies; 14+ messages in thread From: Lyn M @ 2015-01-02 15:07 UTC (permalink / raw) To: Neil Horman; +Cc: dev Neil, your patch works. I am now able to run testpmd, as well as l3fwd with DPDK 1.8.0 and CONFIG_RTE_BUILD_COMBINE_LIBS=y. Thank you much! In my original post, I thought my choice of hex portmask -p 0x3 was causing this issue -- now I know that was not the case. But, I am still curious about how the hex portmask is determined. Since I only have two ports bound to igb_uio, my hex postmask will always be 0x3? What if I choose to bind other ports to igb_uio? Is there a Linux command I can run to determine what mask to use with the -p option? Happy New Year -- Lyn On Wed, Dec 31, 2014 at 10:00 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > On Wed, Dec 31, 2014 at 10:37:45PM -0500, Neil Horman wrote: > > On Wed, Dec 31, 2014 at 10:50:10AM -0600, Lyn M wrote: > > > Neil, > > > When I build DPDK 1.8.0 with the default value > CONFIG_RTE_BUILD_COMBINE_LIBS=n, > > > I am able to run the testpmd successfully. So, that does appear to be > the > > > culprit. > > > The objdump -t output for testpmd (with COMBINE_LIBS=n and > COMBINE_LIBS=y) > > > files are here: > > > > https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 > > > > > > Thanks, > > > Lyn > > > > > I see the problem. none of the constructors are included in the l3fwd > app. I > > think you might need 174572477028b7f04700389e38f87d2ba01a0adc. Its also > > possible something else has gone wrong withthe COMBINE_LIBS option. Try > > building with the head of the tree, and if that doesn't fix it, we can > start > > debugging in earnest. > > Neil > > Found the problem. Please try this patch > > > diff --git a/mk/rte.app.mk b/mk/rte.app.mk > index e1a0dbf..40afb2c 100644 > --- a/mk/rte.app.mk > +++ b/mk/rte.app.mk > @@ -61,6 +61,10 @@ ifeq ($(NO_AUTOLIBS),) > > LDLIBS += --whole-archive > > +ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) > +LDLIBS += -l$(RTE_LIBNAME) > +endif > + > ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) > > ifeq ($(CONFIG_RTE_LIBRTE_DISTRIBUTOR),y) > @@ -251,10 +255,6 @@ build: _postbuild > > exe2cmd = $(strip $(call dotfile,$(patsubst %,%.cmd,$(1)))) > > -ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) > -LDLIBS += -l$(RTE_LIBNAME) > -endif > - > ifeq ($(LINK_USING_CC),1) > override EXTRA_LDFLAGS := $(call linkerprefix,$(EXTRA_LDFLAGS)) > O_TO_EXE = $(CC) $(CFLAGS) $(LDFLAGS_$(@)) \ > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-02 15:07 ` Lyn M @ 2015-01-02 19:54 ` Neil Horman 2015-01-04 3:50 ` Qiu, Michael 2015-01-06 9:02 ` Thomas Monjalon 2 siblings, 0 replies; 14+ messages in thread From: Neil Horman @ 2015-01-02 19:54 UTC (permalink / raw) To: Lyn M; +Cc: dev On Fri, Jan 02, 2015 at 09:07:40AM -0600, Lyn M wrote: > Neil, your patch works. I am now able to run testpmd, as well as l3fwd > with DPDK 1.8.0 and CONFIG_RTE_BUILD_COMBINE_LIBS=y. Thank you much! > I'll post it for official review shortly. > In my original post, I thought my choice of hex portmask -p 0x3 was causing > this issue -- now I know that was not the case. But, I am still curious > about how the hex portmask is determined. Since I only have two ports > bound to igb_uio, my hex postmask will always be 0x3? What if I choose to > bind other ports to igb_uio? Is there a Linux command I can run to > determine what mask to use with the -p option? > portmask IIRC is determined by the cpus you decide you want to service various hardware queues. you can select whatever cpus you want, so in a sense, the portmask is entirely your decision. If you want it to be optimal, you should select a portmask where the cpus servicing your hardware are on the same numa node as the NIC itself. You should be able to determine the cpu numa node locality via /sys/class/net/<iface>/device/local_cpus Neil > Happy New Year -- > Lyn > > On Wed, Dec 31, 2014 at 10:00 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > > > On Wed, Dec 31, 2014 at 10:37:45PM -0500, Neil Horman wrote: > > > On Wed, Dec 31, 2014 at 10:50:10AM -0600, Lyn M wrote: > > > > Neil, > > > > When I build DPDK 1.8.0 with the default value > > CONFIG_RTE_BUILD_COMBINE_LIBS=n, > > > > I am able to run the testpmd successfully. So, that does appear to be > > the > > > > culprit. > > > > The objdump -t output for testpmd (with COMBINE_LIBS=n and > > COMBINE_LIBS=y) > > > > files are here: > > > > > > https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 > > > > > > > > Thanks, > > > > Lyn > > > > > > > I see the problem. none of the constructors are included in the l3fwd > > app. I > > > think you might need 174572477028b7f04700389e38f87d2ba01a0adc. Its also > > > possible something else has gone wrong withthe COMBINE_LIBS option. Try > > > building with the head of the tree, and if that doesn't fix it, we can > > start > > > debugging in earnest. > > > Neil > > > > Found the problem. Please try this patch > > > > > > diff --git a/mk/rte.app.mk b/mk/rte.app.mk > > index e1a0dbf..40afb2c 100644 > > --- a/mk/rte.app.mk > > +++ b/mk/rte.app.mk > > @@ -61,6 +61,10 @@ ifeq ($(NO_AUTOLIBS),) > > > > LDLIBS += --whole-archive > > > > +ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) > > +LDLIBS += -l$(RTE_LIBNAME) > > +endif > > + > > ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) > > > > ifeq ($(CONFIG_RTE_LIBRTE_DISTRIBUTOR),y) > > @@ -251,10 +255,6 @@ build: _postbuild > > > > exe2cmd = $(strip $(call dotfile,$(patsubst %,%.cmd,$(1)))) > > > > -ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) > > -LDLIBS += -l$(RTE_LIBNAME) > > -endif > > - > > ifeq ($(LINK_USING_CC),1) > > override EXTRA_LDFLAGS := $(call linkerprefix,$(EXTRA_LDFLAGS)) > > O_TO_EXE = $(CC) $(CFLAGS) $(LDFLAGS_$(@)) \ > > ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-02 15:07 ` Lyn M 2015-01-02 19:54 ` Neil Horman @ 2015-01-04 3:50 ` Qiu, Michael 2015-01-06 9:02 ` Thomas Monjalon 2 siblings, 0 replies; 14+ messages in thread From: Qiu, Michael @ 2015-01-04 3:50 UTC (permalink / raw) To: Lyn M; +Cc: dev On 1/2/2015 11:08 PM, Lyn M wrote: > Neil, your patch works. I am now able to run testpmd, as well as l3fwd > with DPDK 1.8.0 and CONFIG_RTE_BUILD_COMBINE_LIBS=y. Thank you much! > > In my original post, I thought my choice of hex portmask -p 0x3 was causing > this issue -- now I know that was not the case. But, I am still curious > about how the hex portmask is determined. Since I only have two ports > bound to igb_uio, my hex postmask will always be 0x3? What if I choose to > bind other ports to igb_uio? Is there a Linux command I can run to > determine what mask to use with the -p option? It is simply a mask used to enable or disable ports in DPDK. For example: If DPDK owns two ports, -p 0x03 means all two ports are enabled. If DPDK owns four ports, -p 0x03 means only port 0 and 1 are enabled, port 2 and 3 are unable to use. If you want to enable all ports, you should use -p 0x0f 0x03 is 0b11, 0x0f is 0b1111 Thanks, Michael > Happy New Year -- > Lyn > > On Wed, Dec 31, 2014 at 10:00 PM, Neil Horman <nhorman@tuxdriver.com> wrote: > >> On Wed, Dec 31, 2014 at 10:37:45PM -0500, Neil Horman wrote: >>> On Wed, Dec 31, 2014 at 10:50:10AM -0600, Lyn M wrote: >>>> Neil, >>>> When I build DPDK 1.8.0 with the default value >> CONFIG_RTE_BUILD_COMBINE_LIBS=n, >>>> I am able to run the testpmd successfully. So, that does appear to be >> the >>>> culprit. >>>> The objdump -t output for testpmd (with COMBINE_LIBS=n and >> COMBINE_LIBS=y) >>>> files are here: >>>> >> https://www.dropbox.com/sh/6os9yfn22jjcnmy/AAAjEV3u06XQ1t3UXdWcgru0a?dl=0 >>>> Thanks, >>>> Lyn >>>> >>> I see the problem. none of the constructors are included in the l3fwd >> app. I >>> think you might need 174572477028b7f04700389e38f87d2ba01a0adc. Its also >>> possible something else has gone wrong withthe COMBINE_LIBS option. Try >>> building with the head of the tree, and if that doesn't fix it, we can >> start >>> debugging in earnest. >>> Neil >> Found the problem. Please try this patch >> >> >> diff --git a/mk/rte.app.mk b/mk/rte.app.mk >> index e1a0dbf..40afb2c 100644 >> --- a/mk/rte.app.mk >> +++ b/mk/rte.app.mk >> @@ -61,6 +61,10 @@ ifeq ($(NO_AUTOLIBS),) >> >> LDLIBS += --whole-archive >> >> +ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) >> +LDLIBS += -l$(RTE_LIBNAME) >> +endif >> + >> ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),n) >> >> ifeq ($(CONFIG_RTE_LIBRTE_DISTRIBUTOR),y) >> @@ -251,10 +255,6 @@ build: _postbuild >> >> exe2cmd = $(strip $(call dotfile,$(patsubst %,%.cmd,$(1)))) >> >> -ifeq ($(CONFIG_RTE_BUILD_COMBINE_LIBS),y) >> -LDLIBS += -l$(RTE_LIBNAME) >> -endif >> - >> ifeq ($(LINK_USING_CC),1) >> override EXTRA_LDFLAGS := $(call linkerprefix,$(EXTRA_LDFLAGS)) >> O_TO_EXE = $(CC) $(CFLAGS) $(LDFLAGS_$(@)) \ >> ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-02 15:07 ` Lyn M 2015-01-02 19:54 ` Neil Horman 2015-01-04 3:50 ` Qiu, Michael @ 2015-01-06 9:02 ` Thomas Monjalon 2015-01-06 9:41 ` Bruce Richardson 2 siblings, 1 reply; 14+ messages in thread From: Thomas Monjalon @ 2015-01-06 9:02 UTC (permalink / raw) To: Lyn M; +Cc: dev 2015-01-02 09:07, Lyn M: > In my original post, I thought my choice of hex portmask -p 0x3 was causing > this issue -- now I know that was not the case. But, I am still curious > about how the hex portmask is determined. Since I only have two ports > bound to igb_uio, my hex postmask will always be 0x3? What if I choose to > bind other ports to igb_uio? Is there a Linux command I can run to > determine what mask to use with the -p option? That's something which could be done. Port numbering is defined by probing order. Does a tool showing the (dry-run) probed devices, their number and mask, would help you? By the way, you are welcome to try developing it. -- Thomas ^ permalink raw reply [flat|nested] 14+ messages in thread
* Re: [dpdk-dev] l3fwd error, port 0 is not present on the board 2015-01-06 9:02 ` Thomas Monjalon @ 2015-01-06 9:41 ` Bruce Richardson 0 siblings, 0 replies; 14+ messages in thread From: Bruce Richardson @ 2015-01-06 9:41 UTC (permalink / raw) To: Thomas Monjalon; +Cc: dev On Tue, Jan 06, 2015 at 10:02:25AM +0100, Thomas Monjalon wrote: > 2015-01-02 09:07, Lyn M: > > In my original post, I thought my choice of hex portmask -p 0x3 was causing > > this issue -- now I know that was not the case. But, I am still curious > > about how the hex portmask is determined. Since I only have two ports > > bound to igb_uio, my hex postmask will always be 0x3? What if I choose to > > bind other ports to igb_uio? Is there a Linux command I can run to > > determine what mask to use with the -p option? > > That's something which could be done. > Port numbering is defined by probing order. Does a tool showing the (dry-run) > probed devices, their number and mask, would help you? > By the way, you are welcome to try developing it. > > -- > Thomas The port numbering should generally be in the same order as the ports are listed in dpdk_nic_bind script, so perhaps we could just add a documentation note to that effect. /Bruce ^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2015-01-06 9:41 UTC | newest] Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2014-12-29 20:18 [dpdk-dev] l3fwd error, port 0 is not present on the board Lyn M 2014-12-29 21:02 ` Neil Horman 2014-12-30 18:54 ` Lyn M 2014-12-30 21:24 ` Neil Horman 2014-12-31 14:18 ` Lyn M 2014-12-31 14:48 ` Neil Horman 2014-12-31 16:50 ` Lyn M 2015-01-01 3:37 ` Neil Horman 2015-01-01 4:00 ` Neil Horman 2015-01-02 15:07 ` Lyn M 2015-01-02 19:54 ` Neil Horman 2015-01-04 3:50 ` Qiu, Michael 2015-01-06 9:02 ` Thomas Monjalon 2015-01-06 9:41 ` Bruce Richardson
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).