DPDK patches and discussions
 help / color / mirror / Atom feed
* [PATCH] testpmd: optimize forward stream statistics
@ 2022-05-24  8:27 Junfeng Guo
  2022-05-31 15:27 ` Andrew Rybchenko
                   ` (2 more replies)
  0 siblings, 3 replies; 10+ messages in thread
From: Junfeng Guo @ 2022-05-24  8:27 UTC (permalink / raw)
  To: qi.z.zhang, jingjing.wu, beilei.xing; +Cc: dev, junfeng.guo, Xiao Wang

1. add throughput statistics for forward stream
2. display forward statistics for every forward stream

Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
---
 app/test-pmd/testpmd.c | 41 ++++++++++++++++++++++++++++++++++++++---
 app/test-pmd/testpmd.h |  6 ++++++
 2 files changed, 44 insertions(+), 3 deletions(-)

diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c
index fe2ce19f99..076a042e77 100644
--- a/app/test-pmd/testpmd.c
+++ b/app/test-pmd/testpmd.c
@@ -1926,6 +1926,8 @@ fwd_stream_stats_display(streamid_t stream_id)
 {
 	struct fwd_stream *fs;
 	static const char *fwd_top_stats_border = "-------";
+	uint64_t diff_pkts_rx, diff_pkts_tx, diff_cycles;
+	uint64_t pps_rx, pps_tx;
 
 	fs = fwd_streams[stream_id];
 	if ((fs->rx_packets == 0) && (fs->tx_packets == 0) &&
@@ -1939,6 +1941,21 @@ fwd_stream_stats_display(streamid_t stream_id)
 	       " TX-dropped: %-14"PRIu64,
 	       fs->rx_packets, fs->tx_packets, fs->fwd_dropped);
 
+	diff_pkts_rx = fs->rx_packets - fs->pre_rx;
+	diff_pkts_tx = fs->tx_packets - fs->pre_tx;
+	diff_cycles = fs->pre_cycles;
+
+	fs->pre_rx = fs->rx_packets;
+	fs->pre_tx = fs->tx_packets;
+	fs->pre_cycles = rte_rdtsc();
+	if (diff_cycles > 0)
+		diff_cycles = fs->pre_cycles - diff_cycles;
+
+	pps_rx = diff_cycles > 0 ?
+		(double)diff_pkts_rx * rte_get_tsc_hz() / diff_cycles : 0;
+	pps_tx = diff_cycles > 0 ?
+		(double)diff_pkts_tx * rte_get_tsc_hz() / diff_cycles : 0;
+
 	/* if checksum mode */
 	if (cur_fwd_eng == &csum_fwd_engine) {
 		printf("  RX- bad IP checksum: %-14"PRIu64
@@ -1952,6 +1969,11 @@ fwd_stream_stats_display(streamid_t stream_id)
 		printf("\n");
 	}
 
+	printf("\n  Throughput (since last show)\n");
+	printf("  Rx-pps: %12"PRIu64"\n  Tx-pps: %12"PRIu64"\n", pps_rx, pps_tx);
+	fs->rx_pps = pps_rx;
+	fs->tx_pps = pps_tx;
+
 	if (record_burst_stats) {
 		pkt_burst_stats_display("RX", &fs->rx_burst_stats);
 		pkt_burst_stats_display("TX", &fs->tx_burst_stats);
@@ -1979,6 +2001,8 @@ fwd_stats_display(void)
 	uint64_t fwd_cycles = 0;
 	uint64_t total_recv = 0;
 	uint64_t total_xmit = 0;
+	uint64_t total_rx_pps = 0;
+	uint64_t total_tx_pps = 0;
 	struct rte_port *port;
 	streamid_t sm_id;
 	portid_t pt_id;
@@ -1989,10 +2013,9 @@ fwd_stats_display(void)
 	for (sm_id = 0; sm_id < cur_fwd_config.nb_fwd_streams; sm_id++) {
 		struct fwd_stream *fs = fwd_streams[sm_id];
 
-		if (cur_fwd_config.nb_fwd_streams >
+		fwd_stream_stats_display(sm_id);
+		if (cur_fwd_config.nb_fwd_streams ==
 		    cur_fwd_config.nb_fwd_ports) {
-			fwd_stream_stats_display(sm_id);
-		} else {
 			ports_stats[fs->tx_port].tx_stream = fs;
 			ports_stats[fs->rx_port].rx_stream = fs;
 		}
@@ -2008,7 +2031,14 @@ fwd_stats_display(void)
 
 		if (record_core_cycles)
 			fwd_cycles += fs->core_cycles;
+
+		total_rx_pps += fs->rx_pps;
+		total_tx_pps += fs->tx_pps;
 	}
+
+	printf("\n  Total Rx-pps: %12"PRIu64"  Tx-pps: %12"PRIu64"\n",
+	       total_rx_pps, total_tx_pps);
+
 	for (i = 0; i < cur_fwd_config.nb_fwd_ports; i++) {
 		pt_id = fwd_ports_ids[i];
 		port = &ports[pt_id];
@@ -2124,6 +2154,11 @@ fwd_stats_reset(void)
 		fs->rx_bad_l4_csum = 0;
 		fs->rx_bad_outer_l4_csum = 0;
 		fs->rx_bad_outer_ip_csum = 0;
+		fs->pre_rx = 0;
+		fs->pre_tx = 0;
+		fs->pre_cycles = 0;
+		fs->rx_pps = 0;
+		fs->tx_pps = 0;
 
 		memset(&fs->rx_burst_stats, 0, sizeof(fs->rx_burst_stats));
 		memset(&fs->tx_burst_stats, 0, sizeof(fs->tx_burst_stats));
diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h
index 31f766c965..cad57af27e 100644
--- a/app/test-pmd/testpmd.h
+++ b/app/test-pmd/testpmd.h
@@ -155,6 +155,12 @@ struct fwd_stream {
 	struct pkt_burst_stats rx_burst_stats;
 	struct pkt_burst_stats tx_burst_stats;
 	struct fwd_lcore *lcore; /**< Lcore being scheduled. */
+
+	uint64_t pre_rx;
+	uint64_t pre_tx;
+	uint64_t pre_cycles;
+	uint64_t rx_pps;
+	uint64_t tx_pps;
 };
 
 /**
-- 
2.25.1


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [PATCH] testpmd: optimize forward stream statistics
  2022-05-24  8:27 [PATCH] testpmd: optimize forward stream statistics Junfeng Guo
@ 2022-05-31 15:27 ` Andrew Rybchenko
  2022-06-06  9:02   ` Guo, Junfeng
  2022-06-01  8:46 ` Singh, Aman Deep
  2022-06-06  9:39 ` [PATCH v2] app/testpmd: add throughput stats for forward streams Junfeng Guo
  2 siblings, 1 reply; 10+ messages in thread
From: Andrew Rybchenko @ 2022-05-31 15:27 UTC (permalink / raw)
  To: Junfeng Guo, qi.z.zhang, jingjing.wu, beilei.xing; +Cc: dev, Xiao Wang

On 5/24/22 11:27, Junfeng Guo wrote:
> 1. add throughput statistics for forward stream
> 2. display forward statistics for every forward stream
> 
> Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>

Sorry, I don't understand why summary say "optimize", but description
do not say what is optimized and how. It just mentioned some additions.

Shouldn't summary say:
app/testpmd: add throughput stats for forward streams

Any reviews from testpmd maintainers?

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [PATCH] testpmd: optimize forward stream statistics
  2022-05-24  8:27 [PATCH] testpmd: optimize forward stream statistics Junfeng Guo
  2022-05-31 15:27 ` Andrew Rybchenko
@ 2022-06-01  8:46 ` Singh, Aman Deep
  2022-06-06  9:00   ` Guo, Junfeng
  2022-06-06  9:39 ` [PATCH v2] app/testpmd: add throughput stats for forward streams Junfeng Guo
  2 siblings, 1 reply; 10+ messages in thread
From: Singh, Aman Deep @ 2022-06-01  8:46 UTC (permalink / raw)
  To: Junfeng Guo, qi.z.zhang, jingjing.wu, beilei.xing; +Cc: dev, Xiao Wang

Hi Junfeng

On 5/24/2022 1:57 PM, Junfeng Guo wrote:
> 1. add throughput statistics for forward stream
> 2. display forward statistics for every forward stream
>
> Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> ---
>   app/test-pmd/testpmd.c | 41 ++++++++++++++++++++++++++++++++++++++---
>   app/test-pmd/testpmd.h |  6 ++++++
>   2 files changed, 44 insertions(+), 3 deletions(-)
>
> diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c
> index fe2ce19f99..076a042e77 100644
> --- a/app/test-pmd/testpmd.c
> +++ b/app/test-pmd/testpmd.c
> @@ -1926,6 +1926,8 @@ fwd_stream_stats_display(streamid_t stream_id)
>   {
>   	struct fwd_stream *fs;
>   	static const char *fwd_top_stats_border = "-------";
> +	uint64_t diff_pkts_rx, diff_pkts_tx, diff_cycles;
> +	uint64_t pps_rx, pps_tx;
>   
>   	fs = fwd_streams[stream_id];
>   	if ((fs->rx_packets == 0) && (fs->tx_packets == 0) &&
> @@ -1939,6 +1941,21 @@ fwd_stream_stats_display(streamid_t stream_id)
>   	       " TX-dropped: %-14"PRIu64,
>   	       fs->rx_packets, fs->tx_packets, fs->fwd_dropped);
>   
> +	diff_pkts_rx = fs->rx_packets - fs->pre_rx;
> +	diff_pkts_tx = fs->tx_packets - fs->pre_tx;
> +	diff_cycles = fs->pre_cycles;
> +
> +	fs->pre_rx = fs->rx_packets;
> +	fs->pre_tx = fs->tx_packets;
> +	fs->pre_cycles = rte_rdtsc();
> +	if (diff_cycles > 0)
> +		diff_cycles = fs->pre_cycles - diff_cycles;
> +
> +	pps_rx = diff_cycles > 0 ?
> +		(double)diff_pkts_rx * rte_get_tsc_hz() / diff_cycles : 0;
> +	pps_tx = diff_cycles > 0 ?
> +		(double)diff_pkts_tx * rte_get_tsc_hz() / diff_cycles : 0;
> +
>   	/* if checksum mode */
>   	if (cur_fwd_eng == &csum_fwd_engine) {
>   		printf("  RX- bad IP checksum: %-14"PRIu64
> @@ -1952,6 +1969,11 @@ fwd_stream_stats_display(streamid_t stream_id)
>   		printf("\n");
>   	}
>   
> +	printf("\n  Throughput (since last show)\n");
> +	printf("  Rx-pps: %12"PRIu64"\n  Tx-pps: %12"PRIu64"\n", pps_rx, pps_tx);
> +	fs->rx_pps = pps_rx;
> +	fs->tx_pps = pps_tx;
> +
>   	if (record_burst_stats) {
>   		pkt_burst_stats_display("RX", &fs->rx_burst_stats);
>   		pkt_burst_stats_display("TX", &fs->tx_burst_stats);
> @@ -1979,6 +2001,8 @@ fwd_stats_display(void)
>   	uint64_t fwd_cycles = 0;
>   	uint64_t total_recv = 0;
>   	uint64_t total_xmit = 0;
> +	uint64_t total_rx_pps = 0;
> +	uint64_t total_tx_pps = 0;
>   	struct rte_port *port;
>   	streamid_t sm_id;
>   	portid_t pt_id;
> @@ -1989,10 +2013,9 @@ fwd_stats_display(void)
>   	for (sm_id = 0; sm_id < cur_fwd_config.nb_fwd_streams; sm_id++) {
>   		struct fwd_stream *fs = fwd_streams[sm_id];
>   
> -		if (cur_fwd_config.nb_fwd_streams >
> +		fwd_stream_stats_display(sm_id);
> +		if (cur_fwd_config.nb_fwd_streams ==
>   		    cur_fwd_config.nb_fwd_ports) {
> -			fwd_stream_stats_display(sm_id);
> -		} else {
>   			ports_stats[fs->tx_port].tx_stream = fs;
>   			ports_stats[fs->rx_port].rx_stream = fs;
>   		}
> @@ -2008,7 +2031,14 @@ fwd_stats_display(void)
>   
>   		if (record_core_cycles)
>   			fwd_cycles += fs->core_cycles;
> +
> +		total_rx_pps += fs->rx_pps;
> +		total_tx_pps += fs->tx_pps;
>   	}
> +
> +	printf("\n  Total Rx-pps: %12"PRIu64"  Tx-pps: %12"PRIu64"\n",
> +	       total_rx_pps, total_tx_pps);
> +
>   	for (i = 0; i < cur_fwd_config.nb_fwd_ports; i++) {
>   		pt_id = fwd_ports_ids[i];
>   		port = &ports[pt_id];
> @@ -2124,6 +2154,11 @@ fwd_stats_reset(void)
>   		fs->rx_bad_l4_csum = 0;
>   		fs->rx_bad_outer_l4_csum = 0;
>   		fs->rx_bad_outer_ip_csum = 0;
> +		fs->pre_rx = 0;
> +		fs->pre_tx = 0;
> +		fs->pre_cycles = 0;
> +		fs->rx_pps = 0;
> +		fs->tx_pps = 0;
>   
>   		memset(&fs->rx_burst_stats, 0, sizeof(fs->rx_burst_stats));
>   		memset(&fs->tx_burst_stats, 0, sizeof(fs->tx_burst_stats));
> diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h
> index 31f766c965..cad57af27e 100644
> --- a/app/test-pmd/testpmd.h
> +++ b/app/test-pmd/testpmd.h
> @@ -155,6 +155,12 @@ struct fwd_stream {
>   	struct pkt_burst_stats rx_burst_stats;
>   	struct pkt_burst_stats tx_burst_stats;
>   	struct fwd_lcore *lcore; /**< Lcore being scheduled. */
> +
> +	uint64_t pre_rx;
> +	uint64_t pre_tx;
> +	uint64_t pre_cycles;
> +	uint64_t rx_pps;
> +	uint64_t tx_pps;
>   };
For each parameter, please add comment to describe its purpose.
Just as it is done for other parameters in the struct.
>   
>   /**


^ permalink raw reply	[flat|nested] 10+ messages in thread

* RE: [PATCH] testpmd: optimize forward stream statistics
  2022-06-01  8:46 ` Singh, Aman Deep
@ 2022-06-06  9:00   ` Guo, Junfeng
  0 siblings, 0 replies; 10+ messages in thread
From: Guo, Junfeng @ 2022-06-06  9:00 UTC (permalink / raw)
  To: Singh, Aman Deep, Zhang, Qi Z, Wu, Jingjing, Xing, Beilei
  Cc: dev, Wang, Xiao W



> -----Original Message-----
> From: Singh, Aman Deep <aman.deep.singh@intel.com>
> Sent: Wednesday, June 1, 2022 16:46
> To: Guo, Junfeng <junfeng.guo@intel.com>; Zhang, Qi Z
> <qi.z.zhang@intel.com>; Wu, Jingjing <jingjing.wu@intel.com>; Xing,
> Beilei <beilei.xing@intel.com>
> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>
> Subject: Re: [PATCH] testpmd: optimize forward stream statistics
> 
> Hi Junfeng
> 
> On 5/24/2022 1:57 PM, Junfeng Guo wrote:
> > 1. add throughput statistics for forward stream
> > 2. display forward statistics for every forward stream
> >
> > Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> > Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> > ---
> >   app/test-pmd/testpmd.c | 41
> ++++++++++++++++++++++++++++++++++++++---
> >   app/test-pmd/testpmd.h |  6 ++++++
> >   2 files changed, 44 insertions(+), 3 deletions(-)
> >
> > diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c
> > index fe2ce19f99..076a042e77 100644
> > --- a/app/test-pmd/testpmd.c
> > +++ b/app/test-pmd/testpmd.c
> > @@ -1926,6 +1926,8 @@ fwd_stream_stats_display(streamid_t
> stream_id)
> >   {
> >   	struct fwd_stream *fs;
> >   	static const char *fwd_top_stats_border = "-------";
> > +	uint64_t diff_pkts_rx, diff_pkts_tx, diff_cycles;
> > +	uint64_t pps_rx, pps_tx;
> >
> >   	fs = fwd_streams[stream_id];
> >   	if ((fs->rx_packets == 0) && (fs->tx_packets == 0) &&
> > @@ -1939,6 +1941,21 @@ fwd_stream_stats_display(streamid_t
> stream_id)
> >   	       " TX-dropped: %-14"PRIu64,
> >   	       fs->rx_packets, fs->tx_packets, fs->fwd_dropped);
> >
> > +	diff_pkts_rx = fs->rx_packets - fs->pre_rx;
> > +	diff_pkts_tx = fs->tx_packets - fs->pre_tx;
> > +	diff_cycles = fs->pre_cycles;
> > +
> > +	fs->pre_rx = fs->rx_packets;
> > +	fs->pre_tx = fs->tx_packets;
> > +	fs->pre_cycles = rte_rdtsc();
> > +	if (diff_cycles > 0)
> > +		diff_cycles = fs->pre_cycles - diff_cycles;
> > +
> > +	pps_rx = diff_cycles > 0 ?
> > +		(double)diff_pkts_rx * rte_get_tsc_hz() / diff_cycles : 0;
> > +	pps_tx = diff_cycles > 0 ?
> > +		(double)diff_pkts_tx * rte_get_tsc_hz() / diff_cycles : 0;
> > +
> >   	/* if checksum mode */
> >   	if (cur_fwd_eng == &csum_fwd_engine) {
> >   		printf("  RX- bad IP checksum: %-14"PRIu64
> > @@ -1952,6 +1969,11 @@ fwd_stream_stats_display(streamid_t
> stream_id)
> >   		printf("\n");
> >   	}
> >
> > +	printf("\n  Throughput (since last show)\n");
> > +	printf("  Rx-pps: %12"PRIu64"\n  Tx-pps: %12"PRIu64"\n", pps_rx,
> pps_tx);
> > +	fs->rx_pps = pps_rx;
> > +	fs->tx_pps = pps_tx;
> > +
> >   	if (record_burst_stats) {
> >   		pkt_burst_stats_display("RX", &fs->rx_burst_stats);
> >   		pkt_burst_stats_display("TX", &fs->tx_burst_stats);
> > @@ -1979,6 +2001,8 @@ fwd_stats_display(void)
> >   	uint64_t fwd_cycles = 0;
> >   	uint64_t total_recv = 0;
> >   	uint64_t total_xmit = 0;
> > +	uint64_t total_rx_pps = 0;
> > +	uint64_t total_tx_pps = 0;
> >   	struct rte_port *port;
> >   	streamid_t sm_id;
> >   	portid_t pt_id;
> > @@ -1989,10 +2013,9 @@ fwd_stats_display(void)
> >   	for (sm_id = 0; sm_id < cur_fwd_config.nb_fwd_streams;
> sm_id++) {
> >   		struct fwd_stream *fs = fwd_streams[sm_id];
> >
> > -		if (cur_fwd_config.nb_fwd_streams >
> > +		fwd_stream_stats_display(sm_id);
> > +		if (cur_fwd_config.nb_fwd_streams ==
> >   		    cur_fwd_config.nb_fwd_ports) {
> > -			fwd_stream_stats_display(sm_id);
> > -		} else {
> >   			ports_stats[fs->tx_port].tx_stream = fs;
> >   			ports_stats[fs->rx_port].rx_stream = fs;
> >   		}
> > @@ -2008,7 +2031,14 @@ fwd_stats_display(void)
> >
> >   		if (record_core_cycles)
> >   			fwd_cycles += fs->core_cycles;
> > +
> > +		total_rx_pps += fs->rx_pps;
> > +		total_tx_pps += fs->tx_pps;
> >   	}
> > +
> > +	printf("\n  Total Rx-pps: %12"PRIu64"  Tx-pps: %12"PRIu64"\n",
> > +	       total_rx_pps, total_tx_pps);
> > +
> >   	for (i = 0; i < cur_fwd_config.nb_fwd_ports; i++) {
> >   		pt_id = fwd_ports_ids[i];
> >   		port = &ports[pt_id];
> > @@ -2124,6 +2154,11 @@ fwd_stats_reset(void)
> >   		fs->rx_bad_l4_csum = 0;
> >   		fs->rx_bad_outer_l4_csum = 0;
> >   		fs->rx_bad_outer_ip_csum = 0;
> > +		fs->pre_rx = 0;
> > +		fs->pre_tx = 0;
> > +		fs->pre_cycles = 0;
> > +		fs->rx_pps = 0;
> > +		fs->tx_pps = 0;
> >
> >   		memset(&fs->rx_burst_stats, 0, sizeof(fs-
> >rx_burst_stats));
> >   		memset(&fs->tx_burst_stats, 0, sizeof(fs-
> >tx_burst_stats));
> > diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h
> > index 31f766c965..cad57af27e 100644
> > --- a/app/test-pmd/testpmd.h
> > +++ b/app/test-pmd/testpmd.h
> > @@ -155,6 +155,12 @@ struct fwd_stream {
> >   	struct pkt_burst_stats rx_burst_stats;
> >   	struct pkt_burst_stats tx_burst_stats;
> >   	struct fwd_lcore *lcore; /**< Lcore being scheduled. */
> > +
> > +	uint64_t pre_rx;
> > +	uint64_t pre_tx;
> > +	uint64_t pre_cycles;
> > +	uint64_t rx_pps;
> > +	uint64_t tx_pps;
> >   };
> For each parameter, please add comment to describe its purpose.
> Just as it is done for other parameters in the struct.

Thanks for your review and comments!
I'll update the code in the coming version.

Regards,
Junfeng Guo

> >
> >   /**


^ permalink raw reply	[flat|nested] 10+ messages in thread

* RE: [PATCH] testpmd: optimize forward stream statistics
  2022-05-31 15:27 ` Andrew Rybchenko
@ 2022-06-06  9:02   ` Guo, Junfeng
  0 siblings, 0 replies; 10+ messages in thread
From: Guo, Junfeng @ 2022-06-06  9:02 UTC (permalink / raw)
  To: Andrew Rybchenko, Zhang, Qi Z, Wu, Jingjing, Xing, Beilei
  Cc: dev, Wang, Xiao W



> -----Original Message-----
> From: Andrew Rybchenko <andrew.rybchenko@oktetlabs.ru>
> Sent: Tuesday, May 31, 2022 23:28
> To: Guo, Junfeng <junfeng.guo@intel.com>; Zhang, Qi Z
> <qi.z.zhang@intel.com>; Wu, Jingjing <jingjing.wu@intel.com>; Xing,
> Beilei <beilei.xing@intel.com>
> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>
> Subject: Re: [PATCH] testpmd: optimize forward stream statistics
> 
> On 5/24/22 11:27, Junfeng Guo wrote:
> > 1. add throughput statistics for forward stream
> > 2. display forward statistics for every forward stream
> >
> > Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> > Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> 
> Sorry, I don't understand why summary say "optimize", but description
> do not say what is optimized and how. It just mentioned some additions.
> 
> Shouldn't summary say:
> app/testpmd: add throughput stats for forward streams

Thanks for your review and comments!
I'll update the patch in the coming version.

Regards,
Junfeng Guo

> 
> Any reviews from testpmd maintainers?

^ permalink raw reply	[flat|nested] 10+ messages in thread

* [PATCH v2] app/testpmd: add throughput stats for forward streams
  2022-05-24  8:27 [PATCH] testpmd: optimize forward stream statistics Junfeng Guo
  2022-05-31 15:27 ` Andrew Rybchenko
  2022-06-01  8:46 ` Singh, Aman Deep
@ 2022-06-06  9:39 ` Junfeng Guo
  2022-06-16 16:39   ` Singh, Aman Deep
  2 siblings, 1 reply; 10+ messages in thread
From: Junfeng Guo @ 2022-06-06  9:39 UTC (permalink / raw)
  To: qi.z.zhang, jingjing.wu, beilei.xing; +Cc: dev, junfeng.guo, Xiao Wang

1. add throughput statistics (in pps) for forward streams.
2. display the forward statistics for every forward stream.

v2:
add parameter descriptions and fix commit title.

Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
---
 app/test-pmd/testpmd.c | 41 ++++++++++++++++++++++++++++++++++++++---
 app/test-pmd/testpmd.h |  6 ++++++
 2 files changed, 44 insertions(+), 3 deletions(-)

diff --git a/app/test-pmd/testpmd.c b/app/test-pmd/testpmd.c
index fe2ce19f99..076a042e77 100644
--- a/app/test-pmd/testpmd.c
+++ b/app/test-pmd/testpmd.c
@@ -1926,6 +1926,8 @@ fwd_stream_stats_display(streamid_t stream_id)
 {
 	struct fwd_stream *fs;
 	static const char *fwd_top_stats_border = "-------";
+	uint64_t diff_pkts_rx, diff_pkts_tx, diff_cycles;
+	uint64_t pps_rx, pps_tx;
 
 	fs = fwd_streams[stream_id];
 	if ((fs->rx_packets == 0) && (fs->tx_packets == 0) &&
@@ -1939,6 +1941,21 @@ fwd_stream_stats_display(streamid_t stream_id)
 	       " TX-dropped: %-14"PRIu64,
 	       fs->rx_packets, fs->tx_packets, fs->fwd_dropped);
 
+	diff_pkts_rx = fs->rx_packets - fs->pre_rx;
+	diff_pkts_tx = fs->tx_packets - fs->pre_tx;
+	diff_cycles = fs->pre_cycles;
+
+	fs->pre_rx = fs->rx_packets;
+	fs->pre_tx = fs->tx_packets;
+	fs->pre_cycles = rte_rdtsc();
+	if (diff_cycles > 0)
+		diff_cycles = fs->pre_cycles - diff_cycles;
+
+	pps_rx = diff_cycles > 0 ?
+		(double)diff_pkts_rx * rte_get_tsc_hz() / diff_cycles : 0;
+	pps_tx = diff_cycles > 0 ?
+		(double)diff_pkts_tx * rte_get_tsc_hz() / diff_cycles : 0;
+
 	/* if checksum mode */
 	if (cur_fwd_eng == &csum_fwd_engine) {
 		printf("  RX- bad IP checksum: %-14"PRIu64
@@ -1952,6 +1969,11 @@ fwd_stream_stats_display(streamid_t stream_id)
 		printf("\n");
 	}
 
+	printf("\n  Throughput (since last show)\n");
+	printf("  Rx-pps: %12"PRIu64"\n  Tx-pps: %12"PRIu64"\n", pps_rx, pps_tx);
+	fs->rx_pps = pps_rx;
+	fs->tx_pps = pps_tx;
+
 	if (record_burst_stats) {
 		pkt_burst_stats_display("RX", &fs->rx_burst_stats);
 		pkt_burst_stats_display("TX", &fs->tx_burst_stats);
@@ -1979,6 +2001,8 @@ fwd_stats_display(void)
 	uint64_t fwd_cycles = 0;
 	uint64_t total_recv = 0;
 	uint64_t total_xmit = 0;
+	uint64_t total_rx_pps = 0;
+	uint64_t total_tx_pps = 0;
 	struct rte_port *port;
 	streamid_t sm_id;
 	portid_t pt_id;
@@ -1989,10 +2013,9 @@ fwd_stats_display(void)
 	for (sm_id = 0; sm_id < cur_fwd_config.nb_fwd_streams; sm_id++) {
 		struct fwd_stream *fs = fwd_streams[sm_id];
 
-		if (cur_fwd_config.nb_fwd_streams >
+		fwd_stream_stats_display(sm_id);
+		if (cur_fwd_config.nb_fwd_streams ==
 		    cur_fwd_config.nb_fwd_ports) {
-			fwd_stream_stats_display(sm_id);
-		} else {
 			ports_stats[fs->tx_port].tx_stream = fs;
 			ports_stats[fs->rx_port].rx_stream = fs;
 		}
@@ -2008,7 +2031,14 @@ fwd_stats_display(void)
 
 		if (record_core_cycles)
 			fwd_cycles += fs->core_cycles;
+
+		total_rx_pps += fs->rx_pps;
+		total_tx_pps += fs->tx_pps;
 	}
+
+	printf("\n  Total Rx-pps: %12"PRIu64"  Tx-pps: %12"PRIu64"\n",
+	       total_rx_pps, total_tx_pps);
+
 	for (i = 0; i < cur_fwd_config.nb_fwd_ports; i++) {
 		pt_id = fwd_ports_ids[i];
 		port = &ports[pt_id];
@@ -2124,6 +2154,11 @@ fwd_stats_reset(void)
 		fs->rx_bad_l4_csum = 0;
 		fs->rx_bad_outer_l4_csum = 0;
 		fs->rx_bad_outer_ip_csum = 0;
+		fs->pre_rx = 0;
+		fs->pre_tx = 0;
+		fs->pre_cycles = 0;
+		fs->rx_pps = 0;
+		fs->tx_pps = 0;
 
 		memset(&fs->rx_burst_stats, 0, sizeof(fs->rx_burst_stats));
 		memset(&fs->tx_burst_stats, 0, sizeof(fs->tx_burst_stats));
diff --git a/app/test-pmd/testpmd.h b/app/test-pmd/testpmd.h
index 31f766c965..dc1bba5637 100644
--- a/app/test-pmd/testpmd.h
+++ b/app/test-pmd/testpmd.h
@@ -155,6 +155,12 @@ struct fwd_stream {
 	struct pkt_burst_stats rx_burst_stats;
 	struct pkt_burst_stats tx_burst_stats;
 	struct fwd_lcore *lcore; /**< Lcore being scheduled. */
+
+	uint64_t pre_rx; /**< previously recorded received packets */
+	uint64_t pre_tx; /**< previously recorded transmitted packets */
+	uint64_t pre_cycles; /**< previously recorded processor's time-stamp counter cycles */
+	uint64_t rx_pps; /**< throughput of received packets in pps */
+	uint64_t tx_pps; /**< throughput of transmitted packets in pps */
 };
 
 /**
-- 
2.25.1


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [PATCH v2] app/testpmd: add throughput stats for forward streams
  2022-06-06  9:39 ` [PATCH v2] app/testpmd: add throughput stats for forward streams Junfeng Guo
@ 2022-06-16 16:39   ` Singh, Aman Deep
  2022-08-11  6:57     ` Guo, Junfeng
  0 siblings, 1 reply; 10+ messages in thread
From: Singh, Aman Deep @ 2022-06-16 16:39 UTC (permalink / raw)
  To: Junfeng Guo, qi.z.zhang, jingjing.wu, beilei.xing; +Cc: dev, Xiao Wang

Hi Junfeng,

Thanks for the patch.


On 6/6/2022 3:09 PM, Junfeng Guo wrote:
> 1. add throughput statistics (in pps) for forward streams.
> 2. display the forward statistics for every forward stream.
>
> v2:
> add parameter descriptions and fix commit title.
>
> Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> ---
>
We do have per port Rx/Tx pps in display stats.
For per forward stream we can enable "--record-burst-stats".
With it we can get per fwd stream Rx/Tx pps.

Please check if this patch is adding any additional functionality.

<snip>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* RE: [PATCH v2] app/testpmd: add throughput stats for forward streams
  2022-06-16 16:39   ` Singh, Aman Deep
@ 2022-08-11  6:57     ` Guo, Junfeng
  2022-08-16  9:32       ` Ferruh Yigit
  0 siblings, 1 reply; 10+ messages in thread
From: Guo, Junfeng @ 2022-08-11  6:57 UTC (permalink / raw)
  To: Singh, Aman Deep, Zhang, Qi Z, Wu, Jingjing, Xing, Beilei
  Cc: dev, Wang, Xiao W



> -----Original Message-----
> From: Singh, Aman Deep <aman.deep.singh@intel.com>
> Sent: Friday, June 17, 2022 00:40
> To: Guo, Junfeng <junfeng.guo@intel.com>; Zhang, Qi Z
> <qi.z.zhang@intel.com>; Wu, Jingjing <jingjing.wu@intel.com>; Xing,
> Beilei <beilei.xing@intel.com>
> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>
> Subject: Re: [PATCH v2] app/testpmd: add throughput stats for
> forward streams
> 
> Hi Junfeng,
> 
> Thanks for the patch.
> 
> 
> On 6/6/2022 3:09 PM, Junfeng Guo wrote:
> > 1. add throughput statistics (in pps) for forward streams.
> > 2. display the forward statistics for every forward stream.
> >
> > v2:
> > add parameter descriptions and fix commit title.
> >
> > Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> > Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> > ---
> >
> We do have per port Rx/Tx pps in display stats.
> For per forward stream we can enable "--record-burst-stats".
> With it we can get per fwd stream Rx/Tx pps.
> 
> Please check if this patch is adding any additional functionality.

Sorry for the late reply.
Seems that "--record-burst-stats" could only show the stats of Rx/Tx bursts.

Actually this patch can enable the throughput stats, which has not been supported in current testpmd.
So we hope this functionality could be added.
Thanks!

> 
> <snip>


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: [PATCH v2] app/testpmd: add throughput stats for forward streams
  2022-08-11  6:57     ` Guo, Junfeng
@ 2022-08-16  9:32       ` Ferruh Yigit
  2022-08-18  6:57         ` Guo, Junfeng
  0 siblings, 1 reply; 10+ messages in thread
From: Ferruh Yigit @ 2022-08-16  9:32 UTC (permalink / raw)
  To: Guo, Junfeng, Singh, Aman Deep, Zhang, Qi Z, Wu, Jingjing, Xing, Beilei
  Cc: dev, Wang, Xiao W, Honnappa Nagarahalli

On 8/11/2022 7:57 AM, Guo, Junfeng wrote:
> 
> 
>> -----Original Message-----
>> From: Singh, Aman Deep <aman.deep.singh@intel.com>
>> Sent: Friday, June 17, 2022 00:40
>> To: Guo, Junfeng <junfeng.guo@intel.com>; Zhang, Qi Z
>> <qi.z.zhang@intel.com>; Wu, Jingjing <jingjing.wu@intel.com>; Xing,
>> Beilei <beilei.xing@intel.com>
>> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>
>> Subject: Re: [PATCH v2] app/testpmd: add throughput stats for
>> forward streams
>>
>> Hi Junfeng,
>>
>> Thanks for the patch.
>>
>>
>> On 6/6/2022 3:09 PM, Junfeng Guo wrote:
>>> 1. add throughput statistics (in pps) for forward streams.
>>> 2. display the forward statistics for every forward stream.
>>>
>>> v2:
>>> add parameter descriptions and fix commit title.
>>>
>>> Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
>>> Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
>>> ---
>>>
>> We do have per port Rx/Tx pps in display stats.
>> For per forward stream we can enable "--record-burst-stats".
>> With it we can get per fwd stream Rx/Tx pps.
>>
>> Please check if this patch is adding any additional functionality.
> 
> Sorry for the late reply.
> Seems that "--record-burst-stats" could only show the stats of Rx/Tx bursts.
> 

Hi Junfeng,

What is the impact of this change to the performance?

And what do you think enabling it with an command,
like existing "set record-*" ones?

> Actually this patch can enable the throughput stats, which has not been supported in current testpmd.
> So we hope this functionality could be added.
> Thanks!
> 
>>
>> <snip>
> 


^ permalink raw reply	[flat|nested] 10+ messages in thread

* RE: [PATCH v2] app/testpmd: add throughput stats for forward streams
  2022-08-16  9:32       ` Ferruh Yigit
@ 2022-08-18  6:57         ` Guo, Junfeng
  0 siblings, 0 replies; 10+ messages in thread
From: Guo, Junfeng @ 2022-08-18  6:57 UTC (permalink / raw)
  To: Ferruh Yigit, Singh, Aman Deep, Zhang, Qi Z, Wu, Jingjing, Xing, Beilei
  Cc: dev, Wang, Xiao W, Honnappa Nagarahalli



> -----Original Message-----
> From: Ferruh Yigit <ferruh.yigit@xilinx.com>
> Sent: Tuesday, August 16, 2022 17:33
> To: Guo, Junfeng <junfeng.guo@intel.com>; Singh, Aman Deep
> <aman.deep.singh@intel.com>; Zhang, Qi Z <qi.z.zhang@intel.com>; Wu,
> Jingjing <jingjing.wu@intel.com>; Xing, Beilei <beilei.xing@intel.com>
> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>; Honnappa
> Nagarahalli <Honnappa.Nagarahalli@arm.com>
> Subject: Re: [PATCH v2] app/testpmd: add throughput stats for forward
> streams
> 
> On 8/11/2022 7:57 AM, Guo, Junfeng wrote:
> >
> >
> >> -----Original Message-----
> >> From: Singh, Aman Deep <aman.deep.singh@intel.com>
> >> Sent: Friday, June 17, 2022 00:40
> >> To: Guo, Junfeng <junfeng.guo@intel.com>; Zhang, Qi Z
> >> <qi.z.zhang@intel.com>; Wu, Jingjing <jingjing.wu@intel.com>; Xing,
> >> Beilei <beilei.xing@intel.com>
> >> Cc: dev@dpdk.org; Wang, Xiao W <xiao.w.wang@intel.com>
> >> Subject: Re: [PATCH v2] app/testpmd: add throughput stats for
> >> forward streams
> >>
> >> Hi Junfeng,
> >>
> >> Thanks for the patch.
> >>
> >>
> >> On 6/6/2022 3:09 PM, Junfeng Guo wrote:
> >>> 1. add throughput statistics (in pps) for forward streams.
> >>> 2. display the forward statistics for every forward stream.
> >>>
> >>> v2:
> >>> add parameter descriptions and fix commit title.
> >>>
> >>> Signed-off-by: Xiao Wang <xiao.w.wang@intel.com>
> >>> Signed-off-by: Junfeng Guo <junfeng.guo@intel.com>
> >>> ---
> >>>
> >> We do have per port Rx/Tx pps in display stats.
> >> For per forward stream we can enable "--record-burst-stats".
> >> With it we can get per fwd stream Rx/Tx pps.
> >>
> >> Please check if this patch is adding any additional functionality.
> >
> > Sorry for the late reply.
> > Seems that "--record-burst-stats" could only show the stats of Rx/Tx
> bursts.
> >
> 
> Hi Junfeng,
> 
> What is the impact of this change to the performance?
> 
> And what do you think enabling it with an command,
> like existing "set record-*" ones?

Thanks for your advice! 
We will consider about this method, and also the performance impact.
Thanks a lot!

Regards,
Junfeng Guo

> 
> > Actually this patch can enable the throughput stats, which has not been
> supported in current testpmd.
> > So we hope this functionality could be added.
> > Thanks!
> >
> >>
> >> <snip>
> >


^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2022-08-18  6:57 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-05-24  8:27 [PATCH] testpmd: optimize forward stream statistics Junfeng Guo
2022-05-31 15:27 ` Andrew Rybchenko
2022-06-06  9:02   ` Guo, Junfeng
2022-06-01  8:46 ` Singh, Aman Deep
2022-06-06  9:00   ` Guo, Junfeng
2022-06-06  9:39 ` [PATCH v2] app/testpmd: add throughput stats for forward streams Junfeng Guo
2022-06-16 16:39   ` Singh, Aman Deep
2022-08-11  6:57     ` Guo, Junfeng
2022-08-16  9:32       ` Ferruh Yigit
2022-08-18  6:57         ` Guo, Junfeng

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).