DPDK patches and discussions
 help / color / mirror / Atom feed
From: Jerin Jacob <jerinjacobk@gmail.com>
To: Andrey Vesnovaty <andreyv@mellanox.com>
Cc: dpdk-dev <dev@dpdk.org>,
	jer@marvell.com, Thomas Monjalon <thomas@monjalon.net>,
	 Ferruh Yigit <ferruh.yigit@intel.com>,
	Stephen Hemminger <stephen@networkplumber.org>,
	 "Richardson, Bruce" <bruce.richardson@intel.com>,
	Ori Kam <orika@mellanox.com>,
	Slava Ovsiienko <viacheslavo@mellanox.com>,
	Andrey Vesnovaty <andrey.vesnovaty@gmail.com>,
	 Marko Kovacevic <marko.kovacevic@intel.com>,
	Radu Nicolau <radu.nicolau@intel.com>,
	 Akhil Goyal <akhil.goyal@nxp.com>,
	Tomasz Kantecki <tomasz.kantecki@intel.com>,
	Sunil Kumar Kori <skori@marvell.com>,
	Pavan Nikhilesh <pbhagavatula@marvell.com>,
	 John McNamara <john.mcnamara@intel.com>
Subject: Re: [dpdk-dev] [PATCH v2 6/6] examples/flow_filtering: utilize shared RSS action
Date: Thu, 9 Jul 2020 10:14:01 +0530	[thread overview]
Message-ID: <CALBAE1NQHPheit9ZN9-bC69nmkwTxAwjRWHL9ZnXi=dTKH8Z3w@mail.gmail.com> (raw)
In-Reply-To: <20200708213946.30108-7-andreyv@mellanox.com>

On Thu, Jul 9, 2020 at 3:09 AM Andrey Vesnovaty <andreyv@mellanox.com> wrote:
>
> This commit gives very first shared RSS action usage example and
> demonstrates shared action capability for in-place update.
>
> First application creates shared action during initialization phase.

What if PMD does not support a shared context, Then this application
fails to run?
if so, have a mode or probe the capability(if capability present then
switches to new mode else fall back to old mode) before changing the
application behavior.


> Later on the flow object created by application uses previously created
> shared RSS action with 1 queue configured instead of queue action in
> original application.
>
> On each RX queue burst shared RSS action reconfigured via
> rte_flow_shared_action_update() API to switch queue 0 to 1 & 1 to 0.
> User supposed to observe consistent queue switches on each packet burst.
>
> Signed-off-by: Andrey Vesnovaty <andreyv@mellanox.com>
> ---
>  doc/guides/sample_app_ug/flow_filtering.rst | 62 +++++++++++++++++----
>  examples/flow_filtering/flow_blocks.c       | 30 +++++-----
>  examples/flow_filtering/main.c              | 41 +++++++++++++-
>  3 files changed, 105 insertions(+), 28 deletions(-)
>
> diff --git a/doc/guides/sample_app_ug/flow_filtering.rst b/doc/guides/sample_app_ug/flow_filtering.rst
> index 5e5a6cd8a0..cfe9334717 100644
> --- a/doc/guides/sample_app_ug/flow_filtering.rst
> +++ b/doc/guides/sample_app_ug/flow_filtering.rst
> @@ -106,7 +106,7 @@ following code:
>  .. code-block:: c
>
>     /* create flow for send packet with */
> -   flow = generate_ipv4_flow(port_id, selected_queue,
> +   flow = generate_ipv4_flow(port_id, shared_action,
>                                  SRC_IP, EMPTY_MASK,
>                                  DEST_IP, FULL_MASK, &error);
>     if (!flow) {
> @@ -242,7 +242,7 @@ The Ethernet port is configured with default settings using the
>     rxq_conf = dev_info.default_rxconf;
>     rxq_conf.offloads = port_conf.rxmode.offloads;
>
> -For this example we are configuring number of rx and tx queues that are connected
> +For this example we are configuring 2 rx and 2 tx queues that are connected
>  to a single port.
>
>  .. code-block:: c
> @@ -270,13 +270,22 @@ to a single port.
>            }
>     }
>
> +Before we create the flow we create shared action in order to send it as
> +actions argument when creating a flow. The action is single queue RSS action
> +similar to action queue with the only difference that shared RSS action
> +provides update capability after action creation.
> +
> +.. code-block:: c
> +
> +   shared_action = rte_flow_shared_action_create(port_id, &action, &error);
> +
>  In the next step we create and apply the flow rule. which is to send packets
>  with destination ip equals to 192.168.1.1 to queue number 1. The detail
>  explanation of the ``generate_ipv4_flow()`` appears later in this document:
>
>  .. code-block:: c
>
> -   flow = generate_ipv4_flow(port_id, selected_queue,
> +   flow = generate_ipv4_flow(port_id, shared_action,
>                               SRC_IP, EMPTY_MASK,
>                               DEST_IP, FULL_MASK, &error);
>
> @@ -339,6 +348,21 @@ looks like the following:
>                                             printf("\n");
>                                             rte_pktmbuf_free(m);
>                                     }
> +                                   if (rss_queue[0] == 0) {
> +                                           printf(">>> switching queue 0 -> 1\n");
> +                                           rss_queue[0] = 1;
> +                                   } else {
> +                                           printf(">>> switching queue 1 -> 0\n");
> +                                           rss_queue[0] = 0;
> +                                   }
> +                                   ret = rte_flow_shared_action_update
> +                                           (port_id, shared_action, &action,
> +                                            &error);
> +                                   if (ret)
> +                                           rte_exit(EXIT_FAILURE,
> +                                                    ":: error: RSS action update "
> +                                                    "failed: %s\n",
> +                                                    rte_strerror(-ret));
>                             }
>                     }
>             }
> @@ -348,6 +372,8 @@ looks like the following:
>             rte_eth_dev_close(port_id);
>     }
>
> +On each loop eteration Rx queue switched using
> +``rte_flow_shared_action_update()`` API.
>  The main work of the application is reading the packets from all
>  queues and printing for each packet the destination queue:
>
> @@ -365,6 +391,21 @@ queues and printing for each packet the destination queue:
>                               printf(" - queue=0x%x", (unsigned int)i);
>                               printf("\n");
>                               rte_pktmbuf_free(m);
> +                             if (rss_queue[0] == 0) {
> +                                     printf(">>> switching queue 0 -> 1\n");
> +                                     rss_queue[0] = 1;
> +                             } else {
> +                                     printf(">>> switching queue 1 -> 0\n");
> +                                     rss_queue[0] = 0;
> +                             }
> +                             ret = rte_flow_shared_action_update
> +                                     (port_id, shared_action, &action,
> +                                      &error);
> +                             if (ret)
> +                                     rte_exit(EXIT_FAILURE,
> +                                              ":: error: RSS action update "
> +                                              "failed: %s\n",
> +                                              rte_strerror(-ret));
>                          }
>                  }
>             }
> @@ -378,13 +419,15 @@ The forwarding loop can be interrupted and the application closed using
>  The generate_ipv4_flow function
>  ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
> +
>  The generate_ipv4_flow function is responsible for creating the flow rule.
>  This function is located in the ``flow_blocks.c`` file.
>
>  .. code-block:: c
>
>     static struct rte_flow *
> -   generate_ipv4_flow(uint8_t port_id, uint16_t rx_q,
> +   generate_ipv4_flow(uint8_t port_id,
> +                   cstructrte_flow_shared_action *shared_action,
>                     uint32_t src_ip, uint32_t src_mask,
>                     uint32_t dest_ip, uint32_t dest_mask,
>                     struct rte_flow_error *error)
> @@ -393,7 +436,6 @@ This function is located in the ``flow_blocks.c`` file.
>             struct rte_flow_item pattern[MAX_PATTERN_NUM];
>             struct rte_flow_action action[MAX_ACTION_NUM];
>             struct rte_flow *flow = NULL;
> -           struct rte_flow_action_queue queue = { .index = rx_q };
>             struct rte_flow_item_ipv4 ip_spec;
>             struct rte_flow_item_ipv4 ip_mask;
>
> @@ -411,8 +453,8 @@ This function is located in the ``flow_blocks.c`` file.
>              * create the action sequence.
>              * one action only,  move packet to queue
>              */
> -           action[0].type = RTE_FLOW_ACTION_TYPE_QUEUE;
> -           action[0].conf = &queue;
> +           action[0].type = RTE_FLOW_ACTION_TYPE_SHARED;
> +           action[0].conf = shared_action;
>             action[1].type = RTE_FLOW_ACTION_TYPE_END;
>
>             /*
> @@ -468,12 +510,12 @@ The following part create the flow attributes, in our case ingress.
>     attr.ingress = 1;
>
>  The third part defines the action to be taken when a packet matches
> -the rule. In this case send the packet to queue.
> +the rule. In this case send the packet to single RSS queue.
>
>  .. code-block:: c
>
> -   action[0].type = RTE_FLOW_ACTION_TYPE_QUEUE;
> -   action[0].conf = &queue;
> +   action[0].type = RTE_FLOW_ACTION_TYPE_SHARED;
> +   action[0].conf = shared_action;
>     action[1].type = RTE_FLOW_ACTION_TYPE_END;
>
>  The fourth part is responsible for creating the pattern and is built from
> diff --git a/examples/flow_filtering/flow_blocks.c b/examples/flow_filtering/flow_blocks.c
> index 575d792810..99bfed3172 100644
> --- a/examples/flow_filtering/flow_blocks.c
> +++ b/examples/flow_filtering/flow_blocks.c
> @@ -6,11 +6,11 @@
>  #define MAX_ACTION_NUM         2
>
>  struct rte_flow *
> -generate_ipv4_flow(uint16_t port_id, uint16_t rx_q,
> -               uint32_t src_ip, uint32_t src_mask,
> -               uint32_t dest_ip, uint32_t dest_mask,
> -               struct rte_flow_error *error);
> -
> +generate_ipv4_flow(uint16_t port_id,
> +                  struct rte_flow_shared_action *shared_action,
> +                  uint32_t src_ip, uint32_t src_mask,
> +                  uint32_t dest_ip, uint32_t dest_mask,
> +                  struct rte_flow_error *error);
>
>  /**
>   * create a flow rule that sends packets with matching src and dest ip
> @@ -18,8 +18,8 @@ generate_ipv4_flow(uint16_t port_id, uint16_t rx_q,
>   *
>   * @param port_id
>   *   The selected port.
> - * @param rx_q
> - *   The selected target queue.
> + * @param shared_action
> + *   The shared RSS action with single queue
>   * @param src_ip
>   *   The src ip value to match the input packet.
>   * @param src_mask
> @@ -35,16 +35,16 @@ generate_ipv4_flow(uint16_t port_id, uint16_t rx_q,
>   *   A flow if the rule could be created else return NULL.
>   */
>  struct rte_flow *
> -generate_ipv4_flow(uint16_t port_id, uint16_t rx_q,
> -               uint32_t src_ip, uint32_t src_mask,
> -               uint32_t dest_ip, uint32_t dest_mask,
> -               struct rte_flow_error *error)
> +generate_ipv4_flow(uint16_t port_id,
> +                  struct rte_flow_shared_action *shared_action,
> +                  uint32_t src_ip, uint32_t src_mask,
> +                  uint32_t dest_ip, uint32_t dest_mask,
> +                  struct rte_flow_error *error)
>  {
>         struct rte_flow_attr attr;
>         struct rte_flow_item pattern[MAX_PATTERN_NUM];
>         struct rte_flow_action action[MAX_ACTION_NUM];
>         struct rte_flow *flow = NULL;
> -       struct rte_flow_action_queue queue = { .index = rx_q };
>         struct rte_flow_item_ipv4 ip_spec;
>         struct rte_flow_item_ipv4 ip_mask;
>         int res;
> @@ -61,10 +61,10 @@ generate_ipv4_flow(uint16_t port_id, uint16_t rx_q,
>
>         /*
>          * create the action sequence.
> -        * one action only,  move packet to queue
> +        * one action only,  move packet to shared RSS queue
>          */
> -       action[0].type = RTE_FLOW_ACTION_TYPE_QUEUE;
> -       action[0].conf = &queue;
> +       action[0].type = RTE_FLOW_ACTION_TYPE_SHARED;
> +       action[0].conf = shared_action;
>         action[1].type = RTE_FLOW_ACTION_TYPE_END;
>
>         /*
> diff --git a/examples/flow_filtering/main.c b/examples/flow_filtering/main.c
> index cc9e7e7808..d6b18d95fc 100644
> --- a/examples/flow_filtering/main.c
> +++ b/examples/flow_filtering/main.c
> @@ -32,8 +32,7 @@
>  static volatile bool force_quit;
>
>  static uint16_t port_id;
> -static uint16_t nr_queues = 5;
> -static uint8_t selected_queue = 1;
> +static uint16_t nr_queues = 2;
>  struct rte_mempool *mbuf_pool;
>  struct rte_flow *flow;
>
> @@ -42,6 +41,24 @@ struct rte_flow *flow;
>  #define FULL_MASK 0xffffffff /* full mask */
>  #define EMPTY_MASK 0x0 /* empty mask */
>
> +struct rte_flow_shared_action *shared_action;
> +uint16_t rss_queue[1] = {0};
> +
> +struct rte_flow_action_rss action_rss = {
> +               .func = RTE_ETH_HASH_FUNCTION_DEFAULT,
> +               .level = 0,
> +               .types = 0,
> +               .key_len = 0,
> +               .key = NULL,
> +               .queue = rss_queue,
> +               .queue_num = 1,
> +};
> +
> +struct rte_flow_action action = {
> +       .type = RTE_FLOW_ACTION_TYPE_RSS,
> +       .conf = &action_rss,
> +};
> +
>  #include "flow_blocks.c"
>
>  static inline void
> @@ -61,6 +78,7 @@ main_loop(void)
>         uint16_t nb_rx;
>         uint16_t i;
>         uint16_t j;
> +       int ret;
>
>         while (!force_quit) {
>                 for (i = 0; i < nr_queues; i++) {
> @@ -82,6 +100,21 @@ main_loop(void)
>
>                                         rte_pktmbuf_free(m);
>                                 }
> +                               if (rss_queue[0] == 0) {
> +                                       printf(">>> switching queue 0 -> 1\n");
> +                                       rss_queue[0] = 1;
> +                               } else {
> +                                       printf(">>> switching queue 1 -> 0\n");
> +                                       rss_queue[0] = 0;
> +                               }
> +                               ret = rte_flow_shared_action_update
> +                                       (port_id, shared_action, &action,
> +                                        &error);
> +                               if (ret)
> +                                       rte_exit(EXIT_FAILURE,
> +                                                ":: error: RSS action update "
> +                                                "failed: %s\n",
> +                                                rte_strerror(-ret));
>                         }
>                 }
>         }
> @@ -243,8 +276,10 @@ main(int argc, char **argv)
>
>         init_port();
>
> +       shared_action = rte_flow_shared_action_create(port_id, &action, &error);
> +
>         /* create flow for send packet with */
> -       flow = generate_ipv4_flow(port_id, selected_queue,
> +       flow = generate_ipv4_flow(port_id, shared_action,
>                                 SRC_IP, EMPTY_MASK,
>                                 DEST_IP, FULL_MASK, &error);
>         if (!flow) {
> --
> 2.26.2
>

  reply	other threads:[~2020-07-09  4:44 UTC|newest]

Thread overview: 106+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-07-02 12:05 [dpdk-dev] [PATCH] add flow shared action API Andrey Vesnovaty
2020-07-03 15:02 ` Jerin Jacob
2020-07-03 15:21   ` Thomas Monjalon
2020-07-04  9:54     ` Andrey Vesnovaty
2020-07-04 10:10   ` Andrey Vesnovaty
2020-07-04 12:33     ` Jerin Jacob
2020-07-05 10:26       ` Ori Kam
2020-07-06  9:00         ` Jerin Jacob
2020-07-06 12:28           ` Ori Kam
2020-07-06 13:32             ` Andrey Vesnovaty
2020-07-07  2:30               ` Jerin Jacob
2020-07-07  6:21                 ` Ori Kam
2020-07-07 15:21                   ` Ferruh Yigit
2020-07-07 17:24                     ` Ori Kam
2020-07-07 17:52                       ` Ferruh Yigit
2020-07-07 19:38                   ` Jerin Jacob
2020-07-07 21:03                     ` Ori Kam
2020-07-08  9:25                       ` Jerin Jacob
2020-07-08  9:47                         ` Ori Kam
2020-07-08 11:00                           ` Jerin Jacob
2020-07-08 11:50                             ` Thomas Monjalon
2020-07-08 12:18                             ` Ori Kam
     [not found]                               ` <20200708204015.24429-2-andreyv@mellanox.com>
2020-07-13  8:04                                 ` [dpdk-dev] [PATCH v2 1/6] ethdev: " Kinsella, Ray
2020-07-13 10:16                                   ` Andrew Rybchenko
2020-07-15  8:54                                   ` Andrew Rybchenko
2020-07-15  9:00                                     ` Andrew Rybchenko
2020-09-15 11:30                                     ` Andrey Vesnovaty
     [not found]                               ` <20200708204015.24429-3-andreyv@mellanox.com>
2020-07-13  8:06                                 ` [dpdk-dev] [PATCH v2 2/6] common/mlx5: modify advanced Rx object via DevX Kinsella, Ray
2020-07-08 21:39 ` [dpdk-dev] [PATCH v2 0/6] add flow shared action API + PMD Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 1/6] ethdev: add flow shared action API Andrey Vesnovaty
2020-09-12  2:18     ` Ajit Khaparde
2020-09-15 11:50       ` Andrey Vesnovaty
2020-09-15 15:49         ` Ajit Khaparde
2020-09-16 15:52           ` Andrey Vesnovaty
2020-09-16 19:20             ` Ajit Khaparde
2020-09-17 15:33               ` Andrew Rybchenko
2020-09-17 16:02                 ` Ori Kam
2020-09-24 19:25                   ` Ajit Khaparde
2020-09-26 11:09                     ` Andrey Vesnovaty
2020-10-03 22:06                       ` [dpdk-dev] [PATCH v3 00/10] RTE flow shared action Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 01/10] ethdev: add flow shared action API Andrey Vesnovaty
2020-10-04 11:10                           ` Ori Kam
2020-10-06 10:22                             ` Andrey Vesnovaty
2020-10-04 17:00                           ` Stephen Hemminger
2020-10-04 17:01                             ` Stephen Hemminger
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 02/10] ethdev: add conf arg to shared action icreate API Andrey Vesnovaty
2020-10-04 11:11                           ` Ori Kam
2020-10-06 10:28                             ` Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 03/10] common/mlx5: modify advanced Rx object via DevX Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 04/10] net/mlx5: modify hash Rx queue objects Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 05/10] net/mlx5: shared action PMD Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 06/10] net/mlx5: shared action PMD create conf arg Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 07/10] net/mlx5: driver support for shared action Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 08/10] net/mlx5: shared action create conf drv support Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 09/10] examples/flow_filtering: utilize shared RSS action Andrey Vesnovaty
2020-10-04 11:21                           ` Ori Kam
2020-10-06 10:34                             ` Andrey Vesnovaty
2020-10-03 22:06                         ` [dpdk-dev] [PATCH v3 10/10] app/testpmd: support shared action Andrey Vesnovaty
2020-10-04 11:28                           ` Ori Kam
2020-10-04 12:04                             ` Ori Kam
2020-10-06 10:36                               ` Andrey Vesnovaty
2020-10-04 11:14                         ` [dpdk-dev] [PATCH v3 00/10] RTE flow " Ori Kam
2020-10-06 10:28                           ` Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 2/6] common/mlx5: modify advanced Rx object via DevX Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 3/6] net/mlx5: modify hash Rx queue objects Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 4/6] net/mlx5: shared action PMD Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 5/6] net/mlx5: driver support for shared action Andrey Vesnovaty
2020-07-08 21:39   ` [dpdk-dev] [PATCH v2 6/6] examples/flow_filtering: utilize shared RSS action Andrey Vesnovaty
2020-07-09  4:44     ` Jerin Jacob [this message]
2020-07-09  6:08       ` Ori Kam
2020-07-09 12:25         ` Andrey Vesnovaty
2020-07-09 12:39           ` Thomas Monjalon
2020-07-09  4:39   ` [dpdk-dev] [PATCH v2 0/6] add flow shared action API + PMD Jerin Jacob
2020-10-06 20:08 ` [dpdk-dev] [PATCH v4 0/2] RTE flow shared action Andrey Vesnovaty
2020-10-06 20:08   ` [dpdk-dev] [PATCH v4 1/2] ethdev: add flow shared action API Andrey Vesnovaty
2020-10-07  6:27     ` Ori Kam
2020-10-06 20:08   ` [dpdk-dev] [PATCH v4 2/2] app/testpmd: support shared action Andrey Vesnovaty
2020-10-07  6:30     ` Ori Kam
2020-10-07 12:56 ` [dpdk-dev] [PATCH v5 0/2] RTE flow " Andrey Vesnovaty
2020-10-07 12:56   ` [dpdk-dev] [PATCH v5 1/2] ethdev: add flow shared action API Andrey Vesnovaty
2020-10-07 13:01     ` Ori Kam
2020-10-07 21:23     ` Ajit Khaparde
2020-10-08  7:28       ` Andrey Vesnovaty
2020-10-07 12:56   ` [dpdk-dev] [PATCH v5 2/2] app/testpmd: support shared action Andrey Vesnovaty
2020-10-07 18:36 ` [dpdk-dev] [PATCH v6 0/2] RTE flow " Andrey Vesnovaty
2020-10-07 18:36   ` [dpdk-dev] [PATCH v6 1/2] ethdev: add flow shared action API Andrey Vesnovaty
2020-10-07 18:36   ` [dpdk-dev] [PATCH v6 2/2] app/testpmd: support shared action Andrey Vesnovaty
2020-10-07 20:01     ` Ajit Khaparde
2020-10-08 10:58       ` Andrey Vesnovaty
2020-10-08 11:51 ` [dpdk-dev] [PATCH v7 0/2] RTE flow " Andrey Vesnovaty
2020-10-08 11:51   ` [dpdk-dev] [PATCH v7 1/2] ethdev: add flow shared action API Andrey Vesnovaty
2020-10-08 22:30     ` Ajit Khaparde
2020-10-14 11:47       ` Andrey Vesnovaty
2020-10-12 14:19     ` Andrew Rybchenko
2020-10-13 20:06       ` Andrey Vesnovaty
2020-10-14  6:49         ` Andrew Rybchenko
2020-10-14  7:22           ` Thomas Monjalon
2020-10-14 11:43             ` Andrey Vesnovaty
2020-10-14 11:42           ` Andrey Vesnovaty
2020-10-08 11:51   ` [dpdk-dev] [PATCH v7 2/2] app/testpmd: support shared action Andrey Vesnovaty
2020-10-08 23:54     ` Ajit Khaparde
2020-10-14 11:40 ` [dpdk-dev] [PATCH v8 0/2] RTE flow " Andrey Vesnovaty
2020-10-14 11:40   ` [dpdk-dev] [PATCH v8 1/2] ethdev: add shared actions to flow API Andrey Vesnovaty
2020-10-14 11:44     ` Andrew Rybchenko
2020-10-14 16:17       ` Ferruh Yigit
2020-10-14 11:40   ` [dpdk-dev] [PATCH v8 2/2] app/testpmd: support shared action Andrey Vesnovaty

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CALBAE1NQHPheit9ZN9-bC69nmkwTxAwjRWHL9ZnXi=dTKH8Z3w@mail.gmail.com' \
    --to=jerinjacobk@gmail.com \
    --cc=akhil.goyal@nxp.com \
    --cc=andrey.vesnovaty@gmail.com \
    --cc=andreyv@mellanox.com \
    --cc=bruce.richardson@intel.com \
    --cc=dev@dpdk.org \
    --cc=ferruh.yigit@intel.com \
    --cc=jer@marvell.com \
    --cc=john.mcnamara@intel.com \
    --cc=marko.kovacevic@intel.com \
    --cc=orika@mellanox.com \
    --cc=pbhagavatula@marvell.com \
    --cc=radu.nicolau@intel.com \
    --cc=skori@marvell.com \
    --cc=stephen@networkplumber.org \
    --cc=thomas@monjalon.net \
    --cc=tomasz.kantecki@intel.com \
    --cc=viacheslavo@mellanox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).