* [dpdk-dev] Redirection Table @ 2013-12-31 19:45 Michael Quicquaro 2014-01-06 15:21 ` Ivan Boule 0 siblings, 1 reply; 6+ messages in thread From: Michael Quicquaro @ 2013-12-31 19:45 UTC (permalink / raw) To: dev Has anyone used the "port config all reta (hash,queue)" command of testpmd with any success? I haven't found much documentation on it. Can someone provide an example on why and how it was used. Regards and Happy New Year, Michael Quicquaro ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [dpdk-dev] Redirection Table 2013-12-31 19:45 [dpdk-dev] Redirection Table Michael Quicquaro @ 2014-01-06 15:21 ` Ivan Boule 2014-01-06 16:52 ` Michael Quicquaro 0 siblings, 1 reply; 6+ messages in thread From: Ivan Boule @ 2014-01-06 15:21 UTC (permalink / raw) To: Michael Quicquaro; +Cc: dev On 12/31/2013 08:45 PM, Michael Quicquaro wrote: > Has anyone used the "port config all reta (hash,queue)" command of testpmd > with any success? > > I haven't found much documentation on it. > > Can someone provide an example on why and how it was used. > > Regards and Happy New Year, > Michael Quicquaro Hi Michael, "RETA" stands for Redirection Table. It is a per-port configurable table of 128 entries that is used by the RSS filtering feature of Intel 1GbE and 10GbE controllers to select the RX queue into which to store a received IP packet. When receiving an IPv4/IPv6 packet, the controller computes a 32-bit hash on: * the source address and the destination address of the IP header of the packet, * the source port and the destination port of the UDP/TCP header, if any. Then, the controller takes the 7 lower bits of the RSS hash as an index into the RETA table to get the RX queue number where to store the packet. The API of the DPDK includes a function that is exported by Poll Mode Drivers to configure RETA entries of a given port. For test purposes, the testpmd application includes the following command "port config X rss reta (hash,queue)[,(hash,queue)]" to configure RETA entries of a port X, with each couple (hash,queue) contains the index of a RETA entry (between 0 and 127 included) and the RX queue number (between 0 and 15) to be stored into that RETA entry. Best regards Ivan -- Ivan Boule 6WIND Development Engineer ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [dpdk-dev] Redirection Table 2014-01-06 15:21 ` Ivan Boule @ 2014-01-06 16:52 ` Michael Quicquaro 2014-01-07 8:35 ` Ivan Boule 0 siblings, 1 reply; 6+ messages in thread From: Michael Quicquaro @ 2014-01-06 16:52 UTC (permalink / raw) To: Ivan Boule; +Cc: dev Thanks for the details. Can the hash function be modified so that I can provide my own RSS function? i.e. my ultimate goal is to provide RSS that is not dependent on packet contents. You may have seen my thread "generic load balancing". At this point, I'm realizing that the only way to accomplish this is to let the packets land where they may (the queue where the NIC places the packet) and distribute them (to other queues) by having some of the CPU processing devoted to this task. Can you verify this? Regards, - Michael. On Mon, Jan 6, 2014 at 10:21 AM, Ivan Boule <ivan.boule@6wind.com> wrote: > On 12/31/2013 08:45 PM, Michael Quicquaro wrote: > >> Has anyone used the "port config all reta (hash,queue)" command of testpmd >> with any success? >> >> I haven't found much documentation on it. >> >> Can someone provide an example on why and how it was used. >> >> Regards and Happy New Year, >> Michael Quicquaro >> > Hi Michael, > > "RETA" stands for Redirection Table. > It is a per-port configurable table of 128 entries that is used by the > RSS filtering feature of Intel 1GbE and 10GbE controllers to select the > RX queue into which to store a received IP packet. > When receiving an IPv4/IPv6 packet, the controller computes a 32-bit > hash on: > > * the source address and the destination address of the IP header of > the packet, > * the source port and the destination port of the UDP/TCP header, if any. > > Then, the controller takes the 7 lower bits of the RSS hash as an index > into the RETA table to get the RX queue number where to store the packet. > > The API of the DPDK includes a function that is exported by Poll Mode > Drivers to configure RETA entries of a given port. > > For test purposes, the testpmd application includes the following command > > "port config X rss reta (hash,queue)[,(hash,queue)]" > > to configure RETA entries of a port X, with each couple (hash,queue) > contains the index of a RETA entry (between 0 and 127 included) and the > RX queue number (between 0 and 15) to be stored into that RETA entry. > > Best regards > Ivan > > -- > Ivan Boule > 6WIND Development Engineer > > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [dpdk-dev] Redirection Table 2014-01-06 16:52 ` Michael Quicquaro @ 2014-01-07 8:35 ` Ivan Boule 2014-01-07 13:03 ` Stefan Baranoff 0 siblings, 1 reply; 6+ messages in thread From: Ivan Boule @ 2014-01-07 8:35 UTC (permalink / raw) To: Michael Quicquaro; +Cc: dev On 01/06/2014 05:52 PM, Michael Quicquaro wrote: > Thanks for the details. Can the hash function be modified so that I > can provide my own RSS function? i.e. my ultimate goal is to provide > RSS that is not dependent on packet contents. No, the RSS function is "hard-wired" and only works on IPv4/IPv6 packets. All other packets are stored in the same queue (0 by default). You can change the RSS key used by the RSS function to compute the hash value. See the following testpmd command: port config X rss-hash-key <80 hexa digits> to set the 320-bit RSS key of port X. Best regards, Ivan > You may have seen my thread "generic load balancing". At this point, > I'm realizing that the only way to accomplish this is to let the > packets land where they may (the queue where the NIC places the > packet) and distribute them (to other queues) by having some of the > CPU processing devoted to this task. Can you verify this? > > Regards, > - Michael. > > > On Mon, Jan 6, 2014 at 10:21 AM, Ivan Boule <ivan.boule@6wind.com > <mailto:ivan.boule@6wind.com>> wrote: > > On 12/31/2013 08:45 PM, Michael Quicquaro wrote: > > Has anyone used the "port config all reta (hash,queue)" > command of testpmd > with any success? > > I haven't found much documentation on it. > > Can someone provide an example on why and how it was used. > > Regards and Happy New Year, > Michael Quicquaro > > Hi Michael, > > "RETA" stands for Redirection Table. > It is a per-port configurable table of 128 entries that is used by the > RSS filtering feature of Intel 1GbE and 10GbE controllers to > select the > RX queue into which to store a received IP packet. > When receiving an IPv4/IPv6 packet, the controller computes a 32-bit > hash on: > > * the source address and the destination address of the IP header of > the packet, > * the source port and the destination port of the UDP/TCP > header, if any. > > Then, the controller takes the 7 lower bits of the RSS hash as an > index > into the RETA table to get the RX queue number where to store the > packet. > > The API of the DPDK includes a function that is exported by Poll Mode > Drivers to configure RETA entries of a given port. > > For test purposes, the testpmd application includes the following > command > > "port config X rss reta (hash,queue)[,(hash,queue)]" > > to configure RETA entries of a port X, with each couple (hash,queue) > contains the index of a RETA entry (between 0 and 127 included) > and the > RX queue number (between 0 and 15) to be stored into that RETA entry. > > Best regards > Ivan > > -- > Ivan Boule > 6WIND Development Engineer > > -- Ivan Boule 6WIND Development Engineer ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [dpdk-dev] Redirection Table 2014-01-07 8:35 ` Ivan Boule @ 2014-01-07 13:03 ` Stefan Baranoff 2014-01-10 10:14 ` Ivan Boule 0 siblings, 1 reply; 6+ messages in thread From: Stefan Baranoff @ 2014-01-07 13:03 UTC (permalink / raw) To: Ivan Boule; +Cc: dev All, Does this mean that an application looking at traffic in something like an IP/IP or GRE tunnel with only two endpoints on the tunnels but many clients behind them must do software load balancing as the packets would IP only (not TCP/UDP) with the same two addresses? How much of a penalty is there for crossing processor boundaries in that case and might a 1 CPU server, while less core dense, actually give better performance/watt? Thanks, Stefan Sent from my smart phone; people don't make typos, Swype does! On Jan 7, 2014 3:36 AM, "Ivan Boule" <ivan.boule@6wind.com> wrote: > On 01/06/2014 05:52 PM, Michael Quicquaro wrote: > >> Thanks for the details. Can the hash function be modified so that I can >> provide my own RSS function? i.e. my ultimate goal is to provide RSS that >> is not dependent on packet contents. >> > No, the RSS function is "hard-wired" and only works on IPv4/IPv6 packets. > All other packets are stored in the same queue (0 by default). > You can change the RSS key used by the RSS function to compute the hash > value. > See the following testpmd command: > > port config X rss-hash-key <80 hexa digits> > > to set the 320-bit RSS key of port X. > > Best regards, > Ivan > > You may have seen my thread "generic load balancing". At this point, I'm >> realizing that the only way to accomplish this is to let the packets land >> where they may (the queue where the NIC places the packet) and distribute >> them (to other queues) by having some of the CPU processing devoted to this >> task. Can you verify this? >> >> Regards, >> - Michael. >> >> >> On Mon, Jan 6, 2014 at 10:21 AM, Ivan Boule <ivan.boule@6wind.com<mailto: >> ivan.boule@6wind.com>> wrote: >> >> On 12/31/2013 08:45 PM, Michael Quicquaro wrote: >> >> Has anyone used the "port config all reta (hash,queue)" >> command of testpmd >> with any success? >> >> I haven't found much documentation on it. >> >> Can someone provide an example on why and how it was used. >> >> Regards and Happy New Year, >> Michael Quicquaro >> >> Hi Michael, >> >> "RETA" stands for Redirection Table. >> It is a per-port configurable table of 128 entries that is used by the >> RSS filtering feature of Intel 1GbE and 10GbE controllers to >> select the >> RX queue into which to store a received IP packet. >> When receiving an IPv4/IPv6 packet, the controller computes a 32-bit >> hash on: >> >> * the source address and the destination address of the IP header of >> the packet, >> * the source port and the destination port of the UDP/TCP >> header, if any. >> >> Then, the controller takes the 7 lower bits of the RSS hash as an >> index >> into the RETA table to get the RX queue number where to store the >> packet. >> >> The API of the DPDK includes a function that is exported by Poll Mode >> Drivers to configure RETA entries of a given port. >> >> For test purposes, the testpmd application includes the following >> command >> >> "port config X rss reta (hash,queue)[,(hash,queue)]" >> >> to configure RETA entries of a port X, with each couple (hash,queue) >> contains the index of a RETA entry (between 0 and 127 included) >> and the >> RX queue number (between 0 and 15) to be stored into that RETA entry. >> >> Best regards >> Ivan >> >> -- Ivan Boule >> 6WIND Development Engineer >> >> >> > > -- > Ivan Boule > 6WIND Development Engineer > > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [dpdk-dev] Redirection Table 2014-01-07 13:03 ` Stefan Baranoff @ 2014-01-10 10:14 ` Ivan Boule 0 siblings, 0 replies; 6+ messages in thread From: Ivan Boule @ 2014-01-10 10:14 UTC (permalink / raw) To: Stefan Baranoff; +Cc: dev On 01/07/2014 02:03 PM, Stefan Baranoff wrote: > > All, > > Does this mean that an application looking at traffic in something > like an IP/IP or GRE tunnel with only two endpoints on the tunnels but > many clients behind them must do software load balancing as the > packets would IP only (not TCP/UDP) with the same two addresses? > Yes, your understanding is correct, when Intel's NICs are used. But some other NICs could allow deeper packet analysis. When NICs only support IPv4/IPv6 RSS, then it is up to the network stack on top of the DPDK to provide the best optimal solution in software. > How much of a penalty is there for crossing processor boundaries in > that case and might a 1 CPU server, while less core dense, actually > give better performance/watt? > This is hard to say. It is likely to partially depend on the CPU/memory/bus/ characteristics. Note that if you consider dedicating a single core to the polling of packets received on all ports, then you only need a single RX queue per port. By the way, in such a case, you can still configure RSS on the ports, so that the hardware computes the 32-bit RSS hash on each IP packet (it is stored into the rte_mbuf structure by the Poll Mode Driver), so that the RSS hash can be used in software to speed-up the assignment of IP packets to [a subset of] processing cores, if needed. Regards Ivan > Thanks, > Stefan > > Sent from my smart phone; people don't make typos, Swype does! > > On Jan 7, 2014 3:36 AM, "Ivan Boule" <ivan.boule@6wind.com > <mailto:ivan.boule@6wind.com>> wrote: > > On 01/06/2014 05:52 PM, Michael Quicquaro wrote: > > Thanks for the details. Can the hash function be modified so > that I can provide my own RSS function? i.e. my ultimate > goal is to provide RSS that is not dependent on packet contents. > > No, the RSS function is "hard-wired" and only works on IPv4/IPv6 > packets. All other packets are stored in the same queue (0 by > default). > You can change the RSS key used by the RSS function to compute the > hash value. > See the following testpmd command: > > port config X rss-hash-key <80 hexa digits> > > to set the 320-bit RSS key of port X. > > Best regards, > Ivan > > You may have seen my thread "generic load balancing". At this > point, I'm realizing that the only way to accomplish this is > to let the packets land where they may (the queue where the > NIC places the packet) and distribute them (to other queues) > by having some of the CPU processing devoted to this task. > Can you verify this? > > Regards, > - Michael. > > > On Mon, Jan 6, 2014 at 10:21 AM, Ivan Boule > <ivan.boule@6wind.com <mailto:ivan.boule@6wind.com> > <mailto:ivan.boule@6wind.com <mailto:ivan.boule@6wind.com>>> > wrote: > > On 12/31/2013 08:45 PM, Michael Quicquaro wrote: > > Has anyone used the "port config all reta (hash,queue)" > command of testpmd > with any success? > > I haven't found much documentation on it. > > Can someone provide an example on why and how it was used. > > Regards and Happy New Year, > Michael Quicquaro > > Hi Michael, > > "RETA" stands for Redirection Table. > It is a per-port configurable table of 128 entries that is > used by the > RSS filtering feature of Intel 1GbE and 10GbE controllers to > select the > RX queue into which to store a received IP packet. > When receiving an IPv4/IPv6 packet, the controller > computes a 32-bit > hash on: > > * the source address and the destination address of the > IP header of > the packet, > * the source port and the destination port of the UDP/TCP > header, if any. > > Then, the controller takes the 7 lower bits of the RSS > hash as an > index > into the RETA table to get the RX queue number where to > store the > packet. > > The API of the DPDK includes a function that is exported > by Poll Mode > Drivers to configure RETA entries of a given port. > > For test purposes, the testpmd application includes the > following > command > > "port config X rss reta (hash,queue)[,(hash,queue)]" > > to configure RETA entries of a port X, with each couple > (hash,queue) > contains the index of a RETA entry (between 0 and 127 > included) > and the > RX queue number (between 0 and 15) to be stored into that > RETA entry. > > Best regards > Ivan > > -- Ivan Boule > 6WIND Development Engineer > > > > > -- > Ivan Boule > 6WIND Development Engineer > -- Ivan Boule 6WIND Development Engineer ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2014-01-10 10:12 UTC | newest] Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2013-12-31 19:45 [dpdk-dev] Redirection Table Michael Quicquaro 2014-01-06 15:21 ` Ivan Boule 2014-01-06 16:52 ` Michael Quicquaro 2014-01-07 8:35 ` Ivan Boule 2014-01-07 13:03 ` Stefan Baranoff 2014-01-10 10:14 ` Ivan Boule
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).