From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mga11.intel.com (mga11.intel.com [192.55.52.93]) by dpdk.org (Postfix) with ESMTP id 6BFE7592A for ; Thu, 21 May 2015 15:33:54 +0200 (CEST) Received: from orsmga003.jf.intel.com ([10.7.209.27]) by fmsmga102.fm.intel.com with ESMTP; 21 May 2015 06:33:54 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.13,469,1427785200"; d="scan'208";a="574849604" Received: from irsmsx102.ger.corp.intel.com ([163.33.3.155]) by orsmga003.jf.intel.com with ESMTP; 21 May 2015 06:33:52 -0700 Received: from irsmsx108.ger.corp.intel.com ([169.254.11.59]) by IRSMSX102.ger.corp.intel.com ([169.254.2.36]) with mapi id 14.03.0224.002; Thu, 21 May 2015 14:33:51 +0100 From: "Dumitrescu, Cristian" To: Thomas Monjalon Thread-Topic: [dpdk-dev] [PATCH v2] pipeline: add statistics for librte_pipeline ports and tables Thread-Index: AQHQkWZQUPiGW1BlN0muPEnhvuILX52D/wVsgADlY3D///8CgIAAfaVwgACbMwCAAGzG4A== Date: Thu, 21 May 2015 13:33:50 +0000 Message-ID: <3EB4FA525960D640B5BDFFD6A3D891263236AF3D@IRSMSX108.ger.corp.intel.com> References: <1430396143-10936-1-git-send-email-michalx.k.jastrzebski@intel.com> <2017641.P0ts6fjbPO@xps13> <3EB4FA525960D640B5BDFFD6A3D891263236A93E@IRSMSX108.ger.corp.intel.com> <1677593.4Cv3TcNdFE@xps13> In-Reply-To: <1677593.4Cv3TcNdFE@xps13> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [163.33.239.182] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] [PATCH v2] pipeline: add statistics for librte_pipeline ports and tables X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2015 13:33:55 -0000 > -----Original Message----- > From: Thomas Monjalon [mailto:thomas.monjalon@6wind.com] > Sent: Thursday, May 21, 2015 8:30 AM > To: Dumitrescu, Cristian > Cc: Wodkowski, PawelX; dev@dpdk.org; Jastrzebski, MichalX K > Subject: Re: [dpdk-dev] [PATCH v2] pipeline: add statistics for librte_pi= peline > ports and tables >=20 > 2015-05-20 23:41, Dumitrescu, Cristian: > > From: Thomas Monjalon [mailto:thomas.monjalon@6wind.com] > > > 2015-05-20 13:57, Dumitrescu, Cristian: > > > > From: Thomas Monjalon [mailto:thomas.monjalon@6wind.com] > > > > > Thanks for the detailed explanation. > > > > > > > > > > You are raising a trade-off problem about > > > > > feature/maintenance/performance. > > > > > I think we must choose among 4 solutions: > > > > > 1/ always enabled > > > > > 2/ build-time log level > > > > > 3/ run-time option > > > > > 4/ build-time option > > > > > > > > > > It's good to have this discussion and let other contributors givi= ng their > > > > > opinion. > > > > > > > > > > 2015-05-19 22:41, Dumitrescu, Cristian: > > > > > > 1. What is the technical solution to avoid performance loss due= to > stats > > > > > > support? > > > > > > Generally, I would agree with you that config options should be > avoided, > > > > > > especially those that alter the API (function prototypes, data > structure > > > > > > layouts, etc). Please note this is not the case for any of our = patches, > > > > > > as only the stats collection is enabled/disabled, while the dat= a > > > > > > structures and functions are not changed by the build time opti= on. > > > > > > > > > > > > But what can you do for statistics? We all know that collecting= the > stats > > > > > > sucks up CPU cycles, especially due to memory accesses, so stat= s > always > > > > > > have a run-time cost. Traditionally, stats are typically enable= d for > > > > > > debugging purposes and then turned off for the release version > when > > > > > > performance is required. How can this be done if build time fla= gs are > > > > > > not used? > > > > > > > > > > Statistics in drivers are always enabled (first solution). > > > > > If those statistics are only used for debugging, why not using th= e > build- > > > > > time option CONFIG_RTE_LOG_LEVEL? (second solution) > > > > > > > > Can you please describe what solution 2 on your list (build-time lo= g > > > > level) consists of? > > > > > > > > I see log level useful for printing messages when an event takes pl= ace, > > > > but this is not what these stats patches are about. We want to poll > > > > for those counters on demand: if the build-time flag is off, then t= he > > > > value of those counters is 0; when the build-time is on, then the s= tats > > > > counters have the real value. Basically, the build-time flag only > > > > enables/disables the update of the counters at run-time, which is > where > > > > CPU cycles are consumed. I am not sure how the log levels can help > here? > > > > > > I think that counting stats is a kind of logging. > > > Some stats are always counted (see drivers) and you want to use these > ones > > > only for debugging (after rebuilding DPDK with some debug options). > > > So I suggest, as second solution, to check CONFIG_RTE_LOG_LEVEL is at > > > debug > > > level instead of having one option per module. > > > It would be implemented with "#if RTE_LOG_LEVEL =3D=3D RTE_LOG_DEBUG" > in > > > RTE_PIPELINE_STATS_ADD. > > > > The problem I see with this approach is that you cannot turn off debug > > messages while still having the statistics collected. We should allow > > people to collects the stats without getting the debug messages. How do > > we do this? >=20 > By setting build-time log level to debug, you would enable stats and debu= g > messages. Then you can adjust the log messages level with the run-time > option --log-level. This is a really clever trick! I have to say it took me some time to make s= ure I got it right :) So when RTE_LOG_LEVEL (build time option) is set to DEBUG (i.e. 8), then we= get both the stats and the debug messages, but then we can adjust the leve= l of debug messages at run-time through the --log-level EAL option. I can work with this option, thank you! There is one more simple proposal that came to my mind late last night: how= about single config file option RTE_COLLECT_STATS=3Dy/n that should be use= d by all the libs across the board to indicate whether stats should be enab= led or not? This is logically very similar to the solution above, as they both look at = a single option in the config file, but maybe it is also more intuitive for= people. I will go with your choice. Which one do you pick?