From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga07.intel.com (mga07.intel.com [134.134.136.100]) by dpdk.org (Postfix) with ESMTP id 8BEE41F5 for ; Sun, 9 Jul 2017 09:59:57 +0200 (CEST) Received: from fmsmga006.fm.intel.com ([10.253.24.20]) by orsmga105.jf.intel.com with ESMTP; 09 Jul 2017 00:59:56 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.40,333,1496127600"; d="scan'208";a="124955313" Received: from fmsmsx103.amr.corp.intel.com ([10.18.124.201]) by fmsmga006.fm.intel.com with ESMTP; 09 Jul 2017 00:59:56 -0700 Received: from FMSMSX109.amr.corp.intel.com (10.18.116.9) by FMSMSX103.amr.corp.intel.com (10.18.124.201) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 9 Jul 2017 00:59:55 -0700 Received: from shsmsx151.ccr.corp.intel.com (10.239.6.50) by fmsmsx109.amr.corp.intel.com (10.18.116.9) with Microsoft SMTP Server (TLS) id 14.3.319.2; Sun, 9 Jul 2017 00:59:55 -0700 Received: from shsmsx102.ccr.corp.intel.com ([169.254.2.146]) by SHSMSX151.ccr.corp.intel.com ([169.254.3.56]) with mapi id 14.03.0319.002; Sun, 9 Jul 2017 15:59:51 +0800 From: "Yao, Lei A" To: "Hu, Jiayu" , "dev@dpdk.org" CC: "Tan, Jianfeng" , "Ananyev, Konstantin" , "yliu@fridaylinux.org" , "stephen@networkplumber.org" , "Wu, Jingjing" Thread-Topic: [PATCH v14 3/3] app/testpmd: enable TCP/IPv4 GRO Thread-Index: AQHS+HaUODL5jktBkEiwmrtzy63fkaJLIPIQ Date: Sun, 9 Jul 2017 07:59:51 +0000 Message-ID: <2DBBFF226F7CF64BAFCA79B681719D953A219C76@shsmsx102.ccr.corp.intel.com> References: <1499562826-25558-1-git-send-email-jiayu.hu@intel.com> <1499579206-26919-1-git-send-email-jiayu.hu@intel.com> <1499579206-26919-4-git-send-email-jiayu.hu@intel.com> In-Reply-To: <1499579206-26919-4-git-send-email-jiayu.hu@intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiNmNlNjNkMTEtOWQ0ZS00MWQ5LWFhZWEtZWNmYjcwYTRiMjRlIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX0lDIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE2LjUuOS4zIiwiVHJ1c3RlZExhYmVsSGFzaCI6IkM4TFFQMGJtYVU4bTZ2SjRUQUtUWk1aYVZUUDdXUVRubVVBWnlSTmYwbms9In0= x-ctpclassification: CTP_IC dlp-product: dlpe-windows dlp-version: 10.0.102.7 dlp-reaction: no-action x-originating-ip: [10.239.127.40] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Subject: Re: [dpdk-dev] [PATCH v14 3/3] app/testpmd: enable TCP/IPv4 GRO X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 09 Jul 2017 07:59:59 -0000 > -----Original Message----- > From: Hu, Jiayu > Sent: Sunday, July 9, 2017 1:47 PM > To: dev@dpdk.org > Cc: Tan, Jianfeng ; Ananyev, Konstantin > ; yliu@fridaylinux.org; > stephen@networkplumber.org; Wu, Jingjing ; Yao, > Lei A ; Hu, Jiayu > Subject: [PATCH v14 3/3] app/testpmd: enable TCP/IPv4 GRO >=20 > This patch enables TCP/IPv4 GRO library in csum forwarding engine. > By default, GRO is turned off. Users can use command "gro (on|off) > (port_id)" to enable or disable GRO for a given port. If a port is > enabled GRO, all TCP/IPv4 packets received from the port are performed > GRO. Besides, users can set max flow number and packets number per-flow > by command "gro set (max_flow_num) (max_item_num_per_flow) > (port_id)". >=20 > Signed-off-by: Jiayu Hu Tested-by: Lei Yao This patch has been verified on Haswell bench for basic functions and=20 Performance. > --- > app/test-pmd/cmdline.c | 125 > ++++++++++++++++++++++++++++ > app/test-pmd/config.c | 36 ++++++++ > app/test-pmd/csumonly.c | 5 ++ > app/test-pmd/testpmd.c | 3 + > app/test-pmd/testpmd.h | 10 +++ > doc/guides/testpmd_app_ug/testpmd_funcs.rst | 34 ++++++++ > 6 files changed, 213 insertions(+) >=20 > diff --git a/app/test-pmd/cmdline.c b/app/test-pmd/cmdline.c > index d66e9c8..d4ff608 100644 > --- a/app/test-pmd/cmdline.c > +++ b/app/test-pmd/cmdline.c > @@ -76,6 +76,7 @@ > #include > #include > #include > +#include >=20 > #include > #include > @@ -423,6 +424,14 @@ static void cmd_help_long_parsed(void > *parsed_result, > "tso show (portid)" > " Display the status of TCP Segmentation > Offload.\n\n" >=20 > + "gro (on|off) (port_id)" > + " Enable or disable Generic Receive Offload in io" > + " forward engine.\n\n" > + > + "gro set (max_flow_num) > (max_item_num_per_flow) (port_id)\n" > + " Set max flow number and max packet number > per-flow" > + " for GRO.\n\n" > + > "set fwd (%s)\n" > " Set packet forwarding mode.\n\n" >=20 > @@ -3838,6 +3847,120 @@ cmdline_parse_inst_t cmd_tunnel_tso_show =3D { > }, > }; >=20 > +/* *** SET GRO FOR A PORT *** */ > +struct cmd_gro_result { > + cmdline_fixed_string_t cmd_keyword; > + cmdline_fixed_string_t mode; > + uint8_t port_id; > +}; > + > +static void > +cmd_enable_gro_parsed(void *parsed_result, > + __attribute__((unused)) struct cmdline *cl, > + __attribute__((unused)) void *data) > +{ > + struct cmd_gro_result *res; > + > + res =3D parsed_result; > + setup_gro(res->mode, res->port_id); > +} > + > +cmdline_parse_token_string_t cmd_gro_keyword =3D > + TOKEN_STRING_INITIALIZER(struct cmd_gro_result, > + cmd_keyword, "gro"); > +cmdline_parse_token_string_t cmd_gro_mode =3D > + TOKEN_STRING_INITIALIZER(struct cmd_gro_result, > + mode, "on#off"); > +cmdline_parse_token_num_t cmd_gro_pid =3D > + TOKEN_NUM_INITIALIZER(struct cmd_gro_result, > + port_id, UINT8); > + > +cmdline_parse_inst_t cmd_enable_gro =3D { > + .f =3D cmd_enable_gro_parsed, > + .data =3D NULL, > + .help_str =3D "gro (on|off) (port_id)", > + .tokens =3D { > + (void *)&cmd_gro_keyword, > + (void *)&cmd_gro_mode, > + (void *)&cmd_gro_pid, > + NULL, > + }, > +}; > + > +/* *** SET MAX FLOW NUMBER AND ITEM NUM PER FLOW FOR GRO *** > */ > +struct cmd_gro_set_result { > + cmdline_fixed_string_t gro; > + cmdline_fixed_string_t mode; > + uint16_t flow_num; > + uint16_t item_num_per_flow; > + uint8_t port_id; > +}; > + > +static void > +cmd_gro_set_parsed(void *parsed_result, > + __attribute__((unused)) struct cmdline *cl, > + __attribute__((unused)) void *data) > +{ > + struct cmd_gro_set_result *res =3D parsed_result; > + > + if (port_id_is_invalid(res->port_id, ENABLED_WARN)) > + return; > + if (test_done =3D=3D 0) { > + printf("Before set GRO flow_num and item_num_per_flow," > + " please stop forwarding first\n"); > + return; > + } > + > + if (!strcmp(res->mode, "set")) { > + if (res->flow_num =3D=3D 0) > + printf("Invalid flow number. Revert to default value:" > + " %u.\n", > GRO_DEFAULT_FLOW_NUM); > + else > + gro_ports[res->port_id].param.max_flow_num =3D > + res->flow_num; > + > + if (res->item_num_per_flow =3D=3D 0) > + printf("Invalid item number per-flow. Revert" > + " to default value:%u.\n", > + > GRO_DEFAULT_ITEM_NUM_PER_FLOW); > + else > + gro_ports[res->port_id].param.max_item_per_flow > =3D > + res->item_num_per_flow; > + } > +} > + > +cmdline_parse_token_string_t cmd_gro_set_gro =3D > + TOKEN_STRING_INITIALIZER(struct cmd_gro_set_result, > + gro, "gro"); > +cmdline_parse_token_string_t cmd_gro_set_mode =3D > + TOKEN_STRING_INITIALIZER(struct cmd_gro_set_result, > + mode, "set"); > +cmdline_parse_token_num_t cmd_gro_set_flow_num =3D > + TOKEN_NUM_INITIALIZER(struct cmd_gro_set_result, > + flow_num, UINT16); > +cmdline_parse_token_num_t cmd_gro_set_item_num_per_flow =3D > + TOKEN_NUM_INITIALIZER(struct cmd_gro_set_result, > + item_num_per_flow, UINT16); > +cmdline_parse_token_num_t cmd_gro_set_portid =3D > + TOKEN_NUM_INITIALIZER(struct cmd_gro_set_result, > + port_id, UINT8); > + > +cmdline_parse_inst_t cmd_gro_set =3D { > + .f =3D cmd_gro_set_parsed, > + .data =3D NULL, > + .help_str =3D "gro set > " > + ": set max flow number and max packet number > per-flow " > + "for GRO", > + .tokens =3D { > + (void *)&cmd_gro_set_gro, > + (void *)&cmd_gro_set_mode, > + (void *)&cmd_gro_set_flow_num, > + (void *)&cmd_gro_set_item_num_per_flow, > + (void *)&cmd_gro_set_portid, > + NULL, > + }, > +}; > + > /* *** ENABLE/DISABLE FLUSH ON RX STREAMS *** */ > struct cmd_set_flush_rx { > cmdline_fixed_string_t set; > @@ -14035,6 +14158,8 @@ cmdline_parse_ctx_t main_ctx[] =3D { > (cmdline_parse_inst_t *)&cmd_tso_show, > (cmdline_parse_inst_t *)&cmd_tunnel_tso_set, > (cmdline_parse_inst_t *)&cmd_tunnel_tso_show, > + (cmdline_parse_inst_t *)&cmd_enable_gro, > + (cmdline_parse_inst_t *)&cmd_gro_set, > (cmdline_parse_inst_t *)&cmd_link_flow_control_set, > (cmdline_parse_inst_t *)&cmd_link_flow_control_set_rx, > (cmdline_parse_inst_t *)&cmd_link_flow_control_set_tx, > diff --git a/app/test-pmd/config.c b/app/test-pmd/config.c > index 593677e..e0f0825 100644 > --- a/app/test-pmd/config.c > +++ b/app/test-pmd/config.c > @@ -71,6 +71,7 @@ > #ifdef RTE_LIBRTE_BNXT_PMD > #include > #endif > +#include >=20 > #include "testpmd.h" >=20 > @@ -2415,6 +2416,41 @@ set_tx_pkt_segments(unsigned *seg_lengths, > unsigned nb_segs) > tx_pkt_nb_segs =3D (uint8_t) nb_segs; > } >=20 > +void > +setup_gro(const char *mode, uint8_t port_id) > +{ > + if (!rte_eth_dev_is_valid_port(port_id)) { > + printf("invalid port id %u\n", port_id); > + return; > + } > + if (test_done =3D=3D 0) { > + printf("Before enable/disable GRO," > + " please stop forwarding first\n"); > + return; > + } > + if (strcmp(mode, "on") =3D=3D 0) { > + if (gro_ports[port_id].enable) { > + printf("port %u has enabled GRO\n", port_id); > + return; > + } > + gro_ports[port_id].enable =3D 1; > + gro_ports[port_id].param.gro_types =3D RTE_GRO_TCP_IPV4; > + > + if (gro_ports[port_id].param.max_flow_num =3D=3D 0) > + gro_ports[port_id].param.max_flow_num =3D > + GRO_DEFAULT_FLOW_NUM; > + if (gro_ports[port_id].param.max_item_per_flow =3D=3D 0) > + gro_ports[port_id].param.max_item_per_flow =3D > + GRO_DEFAULT_ITEM_NUM_PER_FLOW; > + } else { > + if (gro_ports[port_id].enable =3D=3D 0) { > + printf("port %u has disabled GRO\n", port_id); > + return; > + } > + gro_ports[port_id].enable =3D 0; > + } > +} > + > char* > list_pkt_forwarding_modes(void) > { > diff --git a/app/test-pmd/csumonly.c b/app/test-pmd/csumonly.c > index 66fc9a0..178ad75 100644 > --- a/app/test-pmd/csumonly.c > +++ b/app/test-pmd/csumonly.c > @@ -71,6 +71,7 @@ > #include > #include > #include > +#include > #include "testpmd.h" >=20 > #define IP_DEFTTL 64 /* from RFC 1340. */ > @@ -658,6 +659,10 @@ pkt_burst_checksum_forward(struct fwd_stream > *fs) > nb_pkt_per_burst); > if (unlikely(nb_rx =3D=3D 0)) > return; > + if (unlikely(gro_ports[fs->rx_port].enable)) > + nb_rx =3D rte_gro_reassemble_burst(pkts_burst, > + nb_rx, > + &(gro_ports[fs->rx_port].param)); >=20 > #ifdef RTE_TEST_PMD_RECORD_BURST_STATS > fs->rx_burst_stats.pkt_burst_spread[nb_rx]++; > diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c > index 308c1b7..e09b803 100644 > --- a/app/test-pmd/testpmd.c > +++ b/app/test-pmd/testpmd.c > @@ -90,6 +90,7 @@ > #ifdef RTE_LIBRTE_LATENCY_STATS > #include > #endif > +#include >=20 > #include "testpmd.h" >=20 > @@ -379,6 +380,8 @@ lcoreid_t bitrate_lcore_id; > uint8_t bitrate_enabled; > #endif >=20 > +struct gro_status gro_ports[RTE_MAX_ETHPORTS]; > + > /* Forward function declarations */ > static void map_port_queue_stats_mapping_registers(uint8_t pi, struct > rte_port *port); > static void check_all_ports_link_status(uint32_t port_mask); > diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h > index 9ccfb6d..73985c3 100644 > --- a/app/test-pmd/testpmd.h > +++ b/app/test-pmd/testpmd.h > @@ -35,6 +35,7 @@ > #define _TESTPMD_H_ >=20 > #include > +#include >=20 > #define RTE_PORT_ALL (~(portid_t)0x0) >=20 > @@ -432,6 +433,14 @@ extern struct ether_addr > peer_eth_addrs[RTE_MAX_ETHPORTS]; > extern uint32_t burst_tx_delay_time; /**< Burst tx delay time(us) for ma= c- > retry. */ > extern uint32_t burst_tx_retry_num; /**< Burst tx retry number for mac- > retry. */ >=20 > +#define GRO_DEFAULT_FLOW_NUM 4 > +#define GRO_DEFAULT_ITEM_NUM_PER_FLOW DEF_PKT_BURST > +struct gro_status { > + struct rte_gro_param param; > + uint8_t enable; > +}; > +extern struct gro_status gro_ports[RTE_MAX_ETHPORTS]; > + > static inline unsigned int > lcore_num(void) > { > @@ -630,6 +639,7 @@ void get_2tuple_filter(uint8_t port_id, uint16_t > index); > void get_5tuple_filter(uint8_t port_id, uint16_t index); > int rx_queue_id_is_invalid(queueid_t rxq_id); > int tx_queue_id_is_invalid(queueid_t txq_id); > +void setup_gro(const char *mode, uint8_t port_id); >=20 > /* Functions to manage the set of filtered Multicast MAC addresses */ > void mcast_addr_add(uint8_t port_id, struct ether_addr *mc_addr); > diff --git a/doc/guides/testpmd_app_ug/testpmd_funcs.rst > b/doc/guides/testpmd_app_ug/testpmd_funcs.rst > index 6c0d526..bb6a667 100644 > --- a/doc/guides/testpmd_app_ug/testpmd_funcs.rst > +++ b/doc/guides/testpmd_app_ug/testpmd_funcs.rst > @@ -898,6 +898,40 @@ Display the status of TCP Segmentation Offload:: >=20 > testpmd> tso show (port_id) >=20 > +gro > +~~~~~~~~ > + > +Enable or disable GRO in ``csum`` forwarding engine:: > + > + testpmd> gro (on|off) (port_id) > + > +If enabled, the csum forwarding engine will perform GRO on the TCP/IPv4 > +packets received from the given port. > + > +If disabled, packets received from the given port won't be performed > +GRO. By default, GRO is disabled for all ports. > + > +.. note:: > + > + When enable GRO for a port, TCP/IPv4 packets received from the port > + will be performed GRO. After GRO, the merged packets are multi- > segments. > + But csum forwarding engine doesn't support to calculate TCP checksum > + for multi-segment packets in SW. So please select TCP HW checksum > + calculation for the port which GROed packets are transmitted to. > + > +gro set > +~~~~~~~~ > + > +Set max flow number and max packet number per-flow for GRO:: > + > + testpmd> gro set (max_flow_num) (max_item_num_per_flow) (port_id) > + > +The product of ``max_flow_num`` and ``max_item_num_per_flow`` is the > max > +number of packets a GRO table can store. > + > +If current packet number is greater than or equal to the max value, GRO > +will stop processing incoming packets. > + > mac_addr add > ~~~~~~~~~~~~ >=20 > -- > 2.7.4