From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-oi0-f49.google.com (mail-oi0-f49.google.com [209.85.218.49]) by dpdk.org (Postfix) with ESMTP id 556095949 for ; Fri, 3 Jun 2016 16:31:42 +0200 (CEST) Received: by mail-oi0-f49.google.com with SMTP id w184so129268441oiw.2 for ; Fri, 03 Jun 2016 07:31:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=qwilt-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=IArT+mvW0CI/Bzn7iaXSPg3lCgyR0lGDnt29ZzflwZs=; b=b/blcNjqrj7wJo0qTBfHychjG107oTtQmLApUtj5gAL+vznN7ef/GbQ6gjs1Nq4FU+ jPzKJWicWiXIwv0oPkYcOfNSPBOEv5cCC2s83B+Shh+QRhrNH2KpD8Zht+aKV1B5qmaH PSZv/Z3KGzEeohFGJBm67oEkuEpdePc37x7h1ZKdx4Q9e7eOiZS95LTYrVhDeLtZpsqS e9Iz1o0UGkUGsV6RtehvpetezZUAZA3D+CYtFWUKdZG42fC17su8saa2/WneyQ0IbnLQ oqIehJHX8Ylxr3LY4+/k0fQ/MsPRBR47+LG3Wc2OTbRkPBYj6s0FEnMW/mm+A0ILI5M6 02rw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=IArT+mvW0CI/Bzn7iaXSPg3lCgyR0lGDnt29ZzflwZs=; b=drLW6dcuxdfqq4x2rHuU8HpH1uKQijOZCFM7+wkTiFm2guPPms+FKYmyxDJ+LJFjm2 dNI6FJ5rjTTNDeO7xtaaHab/1Tg2p3abDGe2aUxvETmL0i8Zf5np4iImqIOwlCyu9wCW F7nQMTNAF+WoEuQuInd2aTJy15LWGwZcfdeaBeark448//oRX39HBZvX6tdkBA6kvaBy OCvr3NhVMi/UWqywnZzlI9SizxxXIBFWy6iQmrkPsJXck3cvOfJ7hkuSIClO0yGFj0Jj G5qs98m/AM0fjFnUvOVsBwBu3Ss3P6hDtfiG+5L7r+Xb2E38A9KWKlg7A7eCWXQ41ZMd EdiA== X-Gm-Message-State: ALyK8tKdoSvUHdXkLV286vGH153pQWBkeySLeFK4YBz57vsPY54X7Sl7u2KNK5+muy8XM8PO4tDLF7pxgA02gQ== X-Received: by 10.202.4.88 with SMTP id 85mr1705465oie.47.1464964301726; Fri, 03 Jun 2016 07:31:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.108.37 with HTTP; Fri, 3 Jun 2016 07:31:40 -0700 (PDT) In-Reply-To: References: <20160602104106.GA12923@hmsreliant.think-freely.org> <2363376.b1CWhBpcZG@xps13> <75917C44-9CF7-4A0B-B8D3-CD7DC7425D49@intel.com> <20160602171120.GB12923@hmsreliant.think-freely.org> <7091836E-B9D5-4F99-ADDB-A47B4C7B5F7E@intel.com> <20160602200837.GC12923@hmsreliant.think-freely.org> <20160603102943.GC16616@bricha3-MOBL3> <20160603110129.GB17812@bricha3-MOBL3> <20160603115048.GA12627@hmsreliant.think-freely.org> From: Arnon Warshavsky Date: Fri, 3 Jun 2016 17:31:40 +0300 Message-ID: To: Panu Matilainen Cc: Neil Horman , Bruce Richardson , "Wiles, Keith" , Thomas Monjalon , Yuanhan Liu , "dev@dpdk.org" , "Tan, Jianfeng" , Stephen Hemminger , Christian Ehrhardt , Olivier Matz Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] [RFC] Yet another option for DPDK options X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 03 Jun 2016 14:31:42 -0000 On Fri, Jun 3, 2016 at 3:53 PM, Panu Matilainen wrote= : > On 06/03/2016 03:01 PM, Arnon Warshavsky wrote: > >> >> >> On Fri, Jun 3, 2016 at 2:50 PM, Neil Horman > > wrote: >> >> On Fri, Jun 03, 2016 at 12:01:30PM +0100, Bruce Richardson wrote: >> > On Fri, Jun 03, 2016 at 11:29:43AM +0100, Bruce Richardson wrote: >> > > On Thu, Jun 02, 2016 at 04:08:37PM -0400, Neil Horman wrote: >> > > > On Thu, Jun 02, 2016 at 07:41:10PM +0000, Wiles, Keith wrote: >> > > > > >> > > > > On 6/2/16, 12:11 PM, "Neil Horman" > > wrote: >> > > > > >> > > > > > >> > > > > >1) The definition of a config structure that can be passed >> to rte_eal_init, >> > > > > >defining the configuration for that running process >> > > > > >> > > > > Having a configuration structure means we have to have an >> ABI change to that structure anytime we add or remove an option. I >> was thinking a very simple DB of some kind would be better. Have the >> code query the DB to obtain the needed information. The APIs used to >> query and set the DB needs to be very easy to use as well. >> > > > >> > > > Thats a fair point. A decent starting point is likely a >> simple struct that >> > > > looks like this: >> > > > >> > > > struct key_vals { >> > > > char *key; >> > > > union { >> > > > ulong longval; >> > > > void *ptrval; >> > > > } value; >> > > > }; >> > > > >> > > > struct config { >> > > > size_t count; >> > > > struct key_vals kvp[0]; >> > > > }; >> > > > >> > > > > >> > > > > Maybe each option can define its own structure if needed or >> just a simple variable type can be used for the basic types (int, >> string, bool, =E2=80=A6) >> > > > > >> > > > Well, if you have config sections that require mulitiple >> elements, I'd handle >> > > > that with naming, i.e. if you have a config group that has an >> int and char >> > > > value, I'd name them "group.intval", and "group.charval", so >> they are >> > > > independently searchable, but linked from a nomenclature >> standpoint. >> > > > >> > > > > Would this work better in the long run, does a fixed >> structure still make sense? >> > > > > >> > > > No. I think you're ABI concerns are valid, but the above is >> likely a good >> > > > starting point to address them. >> > > > >> > > > Best >> > > > Neil >> > > >> > > I'll throw out one implementation idea here that I looked at >> previously, for >> > > the reason that it was simple enough implement with existing cod= e. >> > > >> > > We already have the cfgfile library which works with name/value >> pairs read from >> > > ini files on disk. However, it would be easy enough to add >> couple of APIs to >> > > that to allow the user to "set" values inside an ini structure >> as well. With >> > > that done we can then just add a new eal_init api which takes a >> single >> > > "struct rte_cfgfile *" as parameter. For those apps that want to >> just use >> > > inifiles for configuration straight, they can then do: >> > > >> > > cfg =3D rte_cfgfile_load("my_cfg_file"); >> > > rte_eal_newinit(cfg); >> > > >> > > Those who want a different config can instead do: >> > > >> > > cfg =3D rte_cfgfile_new(); >> > > rte_cfgfile_add_section(cfg, "dpdk"); >> > > foreach_eal_setting_wanted: >> > > rte_cfgfile_set(cfg, "dpdk", mysetting, myvalue); >> > > rte_eal_newinit(cfg); >> > > >> > From chatting to a couple of other DPDK dev's here I suspect I may >> not have >> > been entirely clear here with this example. What is being shown >> above is building >> > up a "config-file" in memory - or rather a config structure which >> happens to >> > have the idea of sections and values as an ini file has. There is >> no actual >> > file ever being written to disk, and for those using any non-ini >> config file >> > structure for their app, the code overhead of using the APIs above >> should be >> > pretty much the same as building up any other set of key-value >> pairs in >> > memory to pass to an init function. >> > >> > Hope this is a little clearer now. >> > >> I'm fine with the idea of reusing the config file library that >> currently exists, >> or more to the point, modifying it to be usable as a configuration >> API, rather >> than a configuration file parser. My primary interest is in >> separating the user >> configuration mechanism from the internal library configuration look= up >> mechanism. What I would really like to be able to see is >> application developers >> have the flexibiilty to choose their own configuration method and >> format, and >> programatically build a configuration for the dpdk on a per-instance >> basis prior >> to calling rte_eal_init >> >> It seems like this approach satisfies that requirement >> Neil >> >> >> If the there is no configuration structure , rather an opaque >> configuration key/value store , >> the user applications can set and get knobs that are not seen by anyone >> (library) that does not know them by name >> >> e.g >> >> int num_nodes =3D getCfgInt ( cfgObject , "eal" , "num_numa_nodes"); >> int delay =3D getCfgInt ( cfgObject , "drivers.ixgbe" , "some_delay"); >> setCfgInt (cfgObject , "my_app" , "num_days" , 7); >> setCfgString (cfgObject , "my_app" , "best_day" , "Wednesday"); >> > > I dont see why it would not be possible to have the libraries export thei= r > known config keys in one way or the other. Or more. > > One aspect is runtime queries which would need an API of some kind. Being > able to query default values should work for that purpose and be handy fo= r > various other uses as well. > > Another one is build-time sanity checking which could be doen by > auto-generating header(s) from the library known keys, eg > > #define CFG_NUM_NUMA_NODES "num_numa_nodes" > > so if you use the macro instead of the actual string, you'll get a > compiler error in case of unknown key instead of runtime misbehavior in > case of typoed values etc. Whether that's worth it is an entirely differe= nt > question. > > - Panu - Thanks Panu . I was not clear here. Naturally libraries are better off accessed using well known macro keys. The other way around that does not require the library to know the keys of the applications.