* [dpdk-dev] nic loopback
@ 2014-10-20 16:24 Alex Markuze
2014-10-21 1:18 ` Liang, Cunming
2014-10-21 15:32 ` [dpdk-dev] " Thomas Monjalon
0 siblings, 2 replies; 10+ messages in thread
From: Alex Markuze @ 2014-10-20 16:24 UTC (permalink / raw)
To: dev
Hi,
I'm trying to send packets from an application to it self, meaning smac ==
dmac.
I'm working with intel 82599 virtual function. But it seems that these
packets are lost.
Is there a software/hw limitation I'm missing here (some additional
anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
loopback should work, at least thats the theory.
Thanks.
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-20 16:24 [dpdk-dev] nic loopback Alex Markuze
@ 2014-10-21 1:18 ` Liang, Cunming
2014-10-21 15:16 ` Alex Markuze
2014-10-21 15:32 ` [dpdk-dev] " Thomas Monjalon
1 sibling, 1 reply; 10+ messages in thread
From: Liang, Cunming @ 2014-10-21 1:18 UTC (permalink / raw)
To: Alex Markuze; +Cc: dev
> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Alex Markuze
> Sent: Tuesday, October 21, 2014 12:24 AM
> To: dev@dpdk.org
> Subject: [dpdk-dev] nic loopback
>
> Hi,
> I'm trying to send packets from an application to it self, meaning smac ==
> dmac.
> I'm working with intel 82599 virtual function. But it seems that these
> packets are lost.
>
> Is there a software/hw limitation I'm missing here (some additional
> anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
> loopback should work, at least thats the theory.
>
[Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
Which allow an individual pool to be able to send traffic and have it loopback to itself.
>
> Thanks.
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-21 1:18 ` Liang, Cunming
@ 2014-10-21 15:16 ` Alex Markuze
2014-10-22 3:33 ` Liang, Cunming
0 siblings, 1 reply; 10+ messages in thread
From: Alex Markuze @ 2014-10-21 15:16 UTC (permalink / raw)
To: Liang, Cunming; +Cc: dev
How can I set/query this bit (LLE(PFVMTXSW[n]), intel 82599 ) on ESX, or
any other friendlier environment like Linux?
On Tue, Oct 21, 2014 at 4:18 AM, Liang, Cunming <cunming.liang@intel.com>
wrote:
>
>
> > -----Original Message-----
> > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Alex Markuze
> > Sent: Tuesday, October 21, 2014 12:24 AM
> > To: dev@dpdk.org
> > Subject: [dpdk-dev] nic loopback
> >
> > Hi,
> > I'm trying to send packets from an application to it self, meaning smac
> ==
> > dmac.
> > I'm working with intel 82599 virtual function. But it seems that these
> > packets are lost.
> >
> > Is there a software/hw limitation I'm missing here (some additional
> > anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
> > loopback should work, at least thats the theory.
> >
> [Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
> Which allow an individual pool to be able to send traffic and have it
> loopback to itself.
> >
> > Thanks.
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-20 16:24 [dpdk-dev] nic loopback Alex Markuze
2014-10-21 1:18 ` Liang, Cunming
@ 2014-10-21 15:32 ` Thomas Monjalon
2014-10-21 15:54 ` Alex Markuze
1 sibling, 1 reply; 10+ messages in thread
From: Thomas Monjalon @ 2014-10-21 15:32 UTC (permalink / raw)
To: Alex Markuze; +Cc: dev
2014-10-20 19:24, Alex Markuze:
> I'm trying to send packets from an application to it self, meaning smac ==
> dmac.
> I'm working with intel 82599 virtual function. But it seems that these
> packets are lost.
>
> Is there a software/hw limitation I'm missing here (some additional
> anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
> loopback should work, at least thats the theory.
I think you should look at these commits:
ixgbe: add Tx->Rx loopback mode for 82599
http://dpdk.org/browse/dpdk/commit/?id=db035925617
app/testpmd: add loopback topology
http://dpdk.org/browse/dpdk/commit/?id=3e2006d6186
--
Thomas
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-21 15:32 ` [dpdk-dev] " Thomas Monjalon
@ 2014-10-21 15:54 ` Alex Markuze
2014-10-21 20:14 ` Thomas Monjalon
0 siblings, 1 reply; 10+ messages in thread
From: Alex Markuze @ 2014-10-21 15:54 UTC (permalink / raw)
To: Thomas Monjalon; +Cc: dev
Thanks Thomas,
unfortunately these patches are only valid a pf*. This is also evident from
the ixgbe pmd code which is the only one looking at this bit (lpbk_mode).
The ixgbevf functions are agnostic to this capability.
*
http://www.intel.com/content/dam/doc/design-guide/82599-sr-iov-driver-companion-guide.pdf
On Tue, Oct 21, 2014 at 6:32 PM, Thomas Monjalon <thomas.monjalon@6wind.com>
wrote:
> 2014-10-20 19:24, Alex Markuze:
> > I'm trying to send packets from an application to it self, meaning smac
> ==
> > dmac.
> > I'm working with intel 82599 virtual function. But it seems that these
> > packets are lost.
> >
> > Is there a software/hw limitation I'm missing here (some additional
> > anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
> > loopback should work, at least thats the theory.
>
> I think you should look at these commits:
>
> ixgbe: add Tx->Rx loopback mode for 82599
> http://dpdk.org/browse/dpdk/commit/?id=db035925617
> app/testpmd: add loopback topology
> http://dpdk.org/browse/dpdk/commit/?id=3e2006d6186
>
> --
> Thomas
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-21 15:54 ` Alex Markuze
@ 2014-10-21 20:14 ` Thomas Monjalon
0 siblings, 0 replies; 10+ messages in thread
From: Thomas Monjalon @ 2014-10-21 20:14 UTC (permalink / raw)
To: Alex Markuze; +Cc: dev
21/10/2014 18:54, Alex Markuze :,
> unfortunately these patches are only valid a pf*. This is also evident from
> the ixgbe pmd code which is the only one looking at this bit (lpbk_mode).
> The ixgbevf functions are agnostic to this capability.
And did you try testpmd with PORT_TOPOLOGY_LOOP (2nd link)?
It could help to understand what's going wrong.
> > ixgbe: add Tx->Rx loopback mode for 82599
> >
> > http://dpdk.org/browse/dpdk/commit/?id=db035925617
> >
> > app/testpmd: add loopback topology
> >
> > http://dpdk.org/browse/dpdk/commit/?id=3e2006d6186
Please Alex, do not top post.
--
Thomas
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] nic loopback
2014-10-21 15:16 ` Alex Markuze
@ 2014-10-22 3:33 ` Liang, Cunming
2014-10-22 4:37 ` [dpdk-dev] FW: " Zhu, Heqing
0 siblings, 1 reply; 10+ messages in thread
From: Liang, Cunming @ 2014-10-22 3:33 UTC (permalink / raw)
To: Alex Markuze; +Cc: dev
It’s a pain VF can’t set the register directly.
As kernel ixgbe don’t support to set the value, I’m afraid you have to modify kernel ixgbe.
If your purpose is mainly for testing purpose.
One option is you can just set the register bit value to full 1 during device initialization.
Another option is you can choose to use DPDK as host PF.
Running testpmd in host, and set such register by interactive command line.
Ideally it’s better to add a kind of VF to PF mailbox message.
Host PF delegate VF to enable the local pool loopback.
So during runtime, VF can proactive to enable/disable the ability.
From: Alex Markuze [mailto:alex@weka.io]
Sent: Tuesday, October 21, 2014 11:16 PM
To: Liang, Cunming
Cc: dev@dpdk.org
Subject: Re: [dpdk-dev] nic loopback
How can I set/query this bit (LLE(PFVMTXSW[n]), intel 82599 ) on ESX, or any other friendlier environment like Linux?
On Tue, Oct 21, 2014 at 4:18 AM, Liang, Cunming <cunming.liang@intel.com<mailto:cunming.liang@intel.com>> wrote:
> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org>] On Behalf Of Alex Markuze
> Sent: Tuesday, October 21, 2014 12:24 AM
> To: dev@dpdk.org<mailto:dev@dpdk.org>
> Subject: [dpdk-dev] nic loopback
>
> Hi,
> I'm trying to send packets from an application to it self, meaning smac ==
> dmac.
> I'm working with intel 82599 virtual function. But it seems that these
> packets are lost.
>
> Is there a software/hw limitation I'm missing here (some additional
> anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the hw
> loopback should work, at least thats the theory.
>
[Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
Which allow an individual pool to be able to send traffic and have it loopback to itself.
>
> Thanks.
^ permalink raw reply [flat|nested] 10+ messages in thread
* [dpdk-dev] FW: nic loopback
2014-10-22 3:33 ` Liang, Cunming
@ 2014-10-22 4:37 ` Zhu, Heqing
2014-10-22 7:42 ` alex
0 siblings, 1 reply; 10+ messages in thread
From: Zhu, Heqing @ 2014-10-22 4:37 UTC (permalink / raw)
To: Liang, Cunming, alex; +Cc: dev
One line comment inline.
> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Liang, Cunming
> Sent: Tuesday, October 21, 2014 8:33 PM
> To: Alex Markuze
> Cc: dev@dpdk.org
> Subject: Re: [dpdk-dev] nic loopback
>
> It’s a pain VF can’t set the register directly.
> As kernel ixgbe don’t support to set the value, I’m afraid you have to modify
> kernel ixgbe.
> If your purpose is mainly for testing purpose.
> One option is you can just set the register bit value to full 1 during device
> initialization.
> Another option is you can choose to use DPDK as host PF.
> Running testpmd in host, and set such register by interactive command line.
>
> Ideally it’s better to add a kind of VF to PF mailbox message.
> Host PF delegate VF to enable the local pool loopback.
> So during runtime, VF can proactive to enable/disable the ability.
[heqing] Such a proposal has been discussed a few times, but the kernel driver does not accept this due to the security concern.
>
>
> From: Alex Markuze [mailto:alex@weka.io]
> Sent: Tuesday, October 21, 2014 11:16 PM
> To: Liang, Cunming
> Cc: dev@dpdk.org
> Subject: Re: [dpdk-dev] nic loopback
>
> How can I set/query this bit (LLE(PFVMTXSW[n]), intel 82599 ) on ESX, or any
> other friendlier environment like Linux?
>
> On Tue, Oct 21, 2014 at 4:18 AM, Liang, Cunming
> <cunming.liang@intel.com<mailto:cunming.liang@intel.com>> wrote:
>
>
> > -----Original Message-----
> > From: dev
> [mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org>]
> > On Behalf Of Alex Markuze
> > Sent: Tuesday, October 21, 2014 12:24 AM
> > To: dev@dpdk.org<mailto:dev@dpdk.org>
> > Subject: [dpdk-dev] nic loopback
> >
> > Hi,
> > I'm trying to send packets from an application to it self, meaning
> > smac == dmac.
> > I'm working with intel 82599 virtual function. But it seems that these
> > packets are lost.
> >
> > Is there a software/hw limitation I'm missing here (some additional
> > anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the
> > hw loopback should work, at least thats the theory.
> >
> [Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
> Which allow an individual pool to be able to send traffic and have it loopback
> to itself.
> >
> > Thanks.
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] FW: nic loopback
2014-10-22 4:37 ` [dpdk-dev] FW: " Zhu, Heqing
@ 2014-10-22 7:42 ` alex
2014-10-22 8:04 ` Liang, Cunming
0 siblings, 1 reply; 10+ messages in thread
From: alex @ 2014-10-22 7:42 UTC (permalink / raw)
To: Zhu, Heqing; +Cc: dev
On Wed, Oct 22, 2014 at 7:37 AM, Zhu, Heqing <heqing.zhu@intel.com> wrote:
> One line comment inline.
>
> > -----Original Message-----
> > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Liang, Cunming
> > Sent: Tuesday, October 21, 2014 8:33 PM
> > To: Alex Markuze
> > Cc: dev@dpdk.org
> > Subject: Re: [dpdk-dev] nic loopback
> >
> > It’s a pain VF can’t set the register directly.
> > As kernel ixgbe don’t support to set the value, I’m afraid you have to
> modify
> > kernel ixgbe.
> > If your purpose is mainly for testing purpose.
> > One option is you can just set the register bit value to full 1 during
> device
> > initialization.
> > Another option is you can choose to use DPDK as host PF.
> > Running testpmd in host, and set such register by interactive command
> line.
> >
> > Ideally it’s better to add a kind of VF to PF mailbox message.
> > Host PF delegate VF to enable the local pool loopback.
> > So during runtime, VF can proactive to enable/disable the ability.
>
> [heqing] Such a proposal has been discussed a few times, but the kernel
> driver does not accept this due to the security concern.
I will try a different approach, Is there a tool available by intel for
82599 nics that can access the NIC's configuration and modify these
registers manually? w/o Modifying hypervisor drivers and/or using PF?
>
> >
> >
> > From: Alex Markuze [mailto:alex@weka.io]
> > Sent: Tuesday, October 21, 2014 11:16 PM
> > To: Liang, Cunming
> > Cc: dev@dpdk.org
> > Subject: Re: [dpdk-dev] nic loopback
> >
> > How can I set/query this bit (LLE(PFVMTXSW[n]), intel 82599 ) on ESX, or
> any
> > other friendlier environment like Linux?
> >
> > On Tue, Oct 21, 2014 at 4:18 AM, Liang, Cunming
> > <cunming.liang@intel.com<mailto:cunming.liang@intel.com>> wrote:
> >
> >
> > > -----Original Message-----
> > > From: dev
> > [mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org>]
> > > On Behalf Of Alex Markuze
> > > Sent: Tuesday, October 21, 2014 12:24 AM
> > > To: dev@dpdk.org<mailto:dev@dpdk.org>
> > > Subject: [dpdk-dev] nic loopback
> > >
> > > Hi,
> > > I'm trying to send packets from an application to it self, meaning
> > > smac == dmac.
> > > I'm working with intel 82599 virtual function. But it seems that these
> > > packets are lost.
> > >
> > > Is there a software/hw limitation I'm missing here (some additional
> > > anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the
> > > hw loopback should work, at least thats the theory.
> > >
> > [Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
> > Which allow an individual pool to be able to send traffic and have it
> loopback
> > to itself.
> > >
> > > Thanks.
>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [dpdk-dev] FW: nic loopback
2014-10-22 7:42 ` alex
@ 2014-10-22 8:04 ` Liang, Cunming
0 siblings, 0 replies; 10+ messages in thread
From: Liang, Cunming @ 2014-10-22 8:04 UTC (permalink / raw)
To: alex, Zhu, Heqing; +Cc: dev
From: alex [mailto:alex@weka.io]
Sent: Wednesday, October 22, 2014 3:42 PM
To: Zhu, Heqing
Cc: Liang, Cunming; dev@dpdk.org
Subject: Re: FW: [dpdk-dev] nic loopback
On Wed, Oct 22, 2014 at 7:37 AM, Zhu, Heqing <heqing.zhu@intel.com<mailto:heqing.zhu@intel.com>> wrote:
One line comment inline.
> -----Original Message-----
> From: dev [mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org>] On Behalf Of Liang, Cunming
> Sent: Tuesday, October 21, 2014 8:33 PM
> To: Alex Markuze
> Cc: dev@dpdk.org<mailto:dev@dpdk.org>
> Subject: Re: [dpdk-dev] nic loopback
>
> It’s a pain VF can’t set the register directly.
> As kernel ixgbe don’t support to set the value, I’m afraid you have to modify
> kernel ixgbe.
> If your purpose is mainly for testing purpose.
> One option is you can just set the register bit value to full 1 during device
> initialization.
> Another option is you can choose to use DPDK as host PF.
> Running testpmd in host, and set such register by interactive command line.
>
> Ideally it’s better to add a kind of VF to PF mailbox message.
> Host PF delegate VF to enable the local pool loopback.
> So during runtime, VF can proactive to enable/disable the ability.
[heqing] Such a proposal has been discussed a few times, but the kernel driver does not accept this due to the security concern.
I will try a different approach, Is there a tool available by intel for 82599 nics that can access the NIC's configuration and modify these registers manually? w/o Modifying hypervisor drivers and/or using PF?
[Liang, Cunming] I don’t know. I think it’s not hard for you to make it, but with security concern.
>
>
> From: Alex Markuze [mailto:alex@weka.io<mailto:alex@weka.io>]
> Sent: Tuesday, October 21, 2014 11:16 PM
> To: Liang, Cunming
> Cc: dev@dpdk.org<mailto:dev@dpdk.org>
> Subject: Re: [dpdk-dev] nic loopback
>
> How can I set/query this bit (LLE(PFVMTXSW[n]), intel 82599 ) on ESX, or any
> other friendlier environment like Linux?
>
> On Tue, Oct 21, 2014 at 4:18 AM, Liang, Cunming
> <cunming.liang@intel.com<mailto:cunming.liang@intel.com><mailto:cunming.liang@intel.com<mailto:cunming.liang@intel.com>>> wrote:
>
>
> > -----Original Message-----
> > From: dev
> [mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org><mailto:dev-bounces@dpdk.org<mailto:dev-bounces@dpdk.org>>]
> > On Behalf Of Alex Markuze
> > Sent: Tuesday, October 21, 2014 12:24 AM
> > To: dev@dpdk.org<mailto:dev@dpdk.org><mailto:dev@dpdk.org<mailto:dev@dpdk.org>>
> > Subject: [dpdk-dev] nic loopback
> >
> > Hi,
> > I'm trying to send packets from an application to it self, meaning
> > smac == dmac.
> > I'm working with intel 82599 virtual function. But it seems that these
> > packets are lost.
> >
> > Is there a software/hw limitation I'm missing here (some additional
> > anti-spoofing)? AFAIK modern NICs with sriov are mini switches so the
> > hw loopback should work, at least thats the theory.
> >
> [Liang, Cunming] You could have a check on register LLE(PFVMTXSW[n]).
> Which allow an individual pool to be able to send traffic and have it loopback
> to itself.
> >
> > Thanks.
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2014-10-22 8:00 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-10-20 16:24 [dpdk-dev] nic loopback Alex Markuze
2014-10-21 1:18 ` Liang, Cunming
2014-10-21 15:16 ` Alex Markuze
2014-10-22 3:33 ` Liang, Cunming
2014-10-22 4:37 ` [dpdk-dev] FW: " Zhu, Heqing
2014-10-22 7:42 ` alex
2014-10-22 8:04 ` Liang, Cunming
2014-10-21 15:32 ` [dpdk-dev] " Thomas Monjalon
2014-10-21 15:54 ` Alex Markuze
2014-10-21 20:14 ` Thomas Monjalon
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).