From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ob0-f169.google.com (mail-ob0-f169.google.com [209.85.214.169]) by dpdk.org (Postfix) with ESMTP id 43016558B for ; Wed, 16 Mar 2016 14:25:33 +0100 (CET) Received: by mail-ob0-f169.google.com with SMTP id fp4so50607239obb.2 for ; Wed, 16 Mar 2016 06:25:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc; bh=uLYQz8WD44fzFoZ8O5p3FeMP/LLfLCDFWmJx3g8VdCw=; b=zGz3U0GJysO38wrF7CmY2cfyjBKXUG1n0Onl5PRkP4gkD7VVMsWp7s01zFa4sIjnnI oR5Yiqo8daJtRgIcCLnWOWY/MQkA+LTVqh/kGzLTcPqRU8y910arxqgDnTyoCwETyYw7 ASO4DAtCzLNEt11YQqbOP5pnap24Cq7zluiLwtVTdXQ0vgZtF9n+Vga0szkfxbDRoOwa reGCKTVdttq+h0e46l6gaPSru2mMYz7NF/6Rj9PU0Z4q4xL1hJRwrx2ahnuns1/S+Y/N iy9KGoocJ0Lp9NAxH2QKjLyZQ7NBmoah7H1+cRYQRJxLS7c4lPNeYXTsPLMyyKvEGQq3 zXiw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc; bh=uLYQz8WD44fzFoZ8O5p3FeMP/LLfLCDFWmJx3g8VdCw=; b=BVeEh9v8NBHrPWU2HatiZ6loW6r4of6ig0Vx25WzaquNWqlv5T3a8vEUo4sNJ2UIsS O5YHSAGqcIogrjFghEOqE8mhdbW6qVvpXm9WHgspSePRFtUKkoHJDHZoxZmz+qJl6qP7 hFW0p83t4Z7COjjGEXe1j73+nmn0HfNfPBQa4oVXtqF5wOyjOAYSwqu6uWcLWHcjrAI6 Cm4NIzvN5VY8lr1wMs8Zqu9IJio+1PtJettOpGFq1XpOGcTBfCX8Ad2crKArbcxEr39B G5y0mOSPwNWetU4BbbLXbDxMnLF4JC8Z4qi1ZToA+L3Vo2jWSnMAtYqN6sw5sywZiBlG qhjQ== X-Gm-Message-State: AD7BkJKT3Zd3Uo7fNOBGsrjYzeuKolFzPyhS1Tw+3a6R5wduDk7uwWW8ytaT5bw3B446GsJIdAosdDZWL/gtSg== MIME-Version: 1.0 X-Received: by 10.182.24.8 with SMTP id q8mr2232627obf.67.1458134732424; Wed, 16 Mar 2016 06:25:32 -0700 (PDT) Received: by 10.76.68.7 with HTTP; Wed, 16 Mar 2016 06:25:32 -0700 (PDT) In-Reply-To: References: Date: Wed, 16 Mar 2016 09:25:32 -0400 Message-ID: From: Kyle Larose To: Mahdi Moradmand Badie Cc: users@dpdk.org Content-Type: text/plain; charset=UTF-8 Subject: Re: [dpdk-users] Send and Receive packets to/from specific core X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 16 Mar 2016 13:25:33 -0000 Hi Mahdi, On Fri, Mar 11, 2016 at 5:19 PM, Mahdi Moradmand Badie wrote: > So you mean, > each core works with its thread as a worker, and in the ring as a share > memory, all cores(via their threads) could write and read in each part of > the ring (but it is better each core access to its threads). > My questions: > 1) How I could access to cache/register/etc of each core if so? As far as I'm aware, x86 CPUs do not give direct access to the cache. This is handled by the CPU itself through its hierarchical caching structures. Regarding register access, you'll need to write some assembly to get access to those. Now, maybe CAT exposes this level of information. I always thought it was about controlling access to the cache by configuring some stuff, but maybe it requires intervention from the kernel to manage it. If so, you could possibly look at doing that (I.e. write a kmod, or use some sort of existing user-space<->communication channel that lets you do it). > 2) How could I consider ring as share cache (L3), because here we use ring > as a share memory but if I wanna use share cache how I could do it, is there > any availability in DPDK? The cache will be used automatically. > 3) Is there any possibility to use ring as real memory, I mean ,Can I ask > the core to write the message in the specific part of ring (from this > address to this address)? The ring *is* real memory. It's a ring buffer of fixed-size entries, so typically you will "write" an entry to the ring in one process, and "read" that entry in another. You could read/write an arbitrary offset from the beginning of the ring, but it's not really meant for that. You'd probably want to build your own data structure on top of shared memory if you need that. > 4) I wanna have a share memory (ring or whatever) with for example the size > 4 (4 free place for read and write) which filled at first with 1, 7, 3, 4. > Then each core (0, 1, 2, 3 and I have totally 4 cores in my machine) read > the slot and add 1 to it and again write it in share memory so the result > should be (2, 8, 4, 5), this is possible do with ring? if so how? and each > core just could access to its specific part (or better in order to prevent > bad design)? > > A ring isn't really appropriate here, since it's meant to produce and consume messages in a fifo order. Here you want random access. An array in shared memory would be better. Alternatively, you could create a ring to each process. That only gets you the read and modify though. You still need to write back the result. Where do you expect to access it? \ If you want to use arrays, consider using the rte_memzone_reserve function to reserve some memory. Take a look at the memzone api and how it is used. Perhaps it will give you some ideas: http://dpdk.org/doc/api/rte__memzone_8h.html. > Sorry because I am new in DPDK and with not enough knowledge of C maybe my > questions seems crazy :) > Thanks, > > On 11 March 2016 at 16:50, Kyle Larose wrote: >> >> On Fri, Mar 11, 2016 at 4:01 PM, Mahdi Moradmand Badie >> wrote: >> > Yes, I found it before :), its a little ambiguous for me, I don't know >> > how I >> > could write the specific data(message or packet) into specific core, >> > then >> > change it and then read with the other core. >> >> Well, when one process writes to the other, it moves between threads. >> Each thread is pinned to a specific core (i.e. processor affinity). >> You can see that this is happening by looking at the output from the >> example. It mentions on the page I linked something like "Starting >> core 9" or "core 9: Received...". This means that the application has >> started its worker thread and associated it with core 9. It will only >> ever run on that core. Thus, in order for it to actually process the >> message, the contents of the message must be copied into the >> cache/registers/etc. of that core. >> >> To control which cores are used, you use the "-c" argument, and give >> the "core mask" in hex. For example, -c 3 would use cores 0 and 1. >> >> The key things to take away from this are that threads are constrained >> by the scheduler to only run on specific cores using processor >> affinity, and that message queues in the form of rings can be used to >> pass messages between these cores. A message processed on a thread >> assigned to core X will be modified/accessed locally on that core. >> This doesn't mean other cores couldn't access it. But, that should be >> prevented by good design. >> >> >> > >> > On 11 March 2016 at 15:54, Kyle Larose wrote: >> >> >> >> On Fri, Mar 11, 2016 at 3:47 PM, Mahdi Moradmand Badie >> >> wrote: >> >> > My big challenge is having a tested code (run able with right >> >> > functionality), then run and change it in order to have my task. >> >> > I wanna use the share memory btw cores in order to write/read to/from >> >> > and >> >> > knowing how do that :), all available code which I found are based on >> >> > NIC :( >> >> > or maybe I am wrong!!! >> >> > Thanks in advance, >> >> >> >> Take a look at this example: >> >> >> >> >> >> >> >> http://dpdk.org/doc/guides/sample_app_ug/multi_process.html#basic-multi-process-example >> >> >> >> IIRC, it uses rings to send messages back and forth between the cores. >> >> The code is available with the dpdk source, so it should serve as a >> >> good starting point to see how to set up the shared memory and use it. >> >> >> >> Does that help? >> >> >> >> > >> >> > On 11 March 2016 at 15:43, Kyle Larose wrote: >> >> >> >> >> >> On Fri, Mar 11, 2016 at 3:22 PM, Mahdi Moradmand Badie >> >> >> wrote: >> >> >> > Dear All, >> >> >> > >> >> >> > I wanna Send(write) a Packet(s) with specific data (for example x >> >> >> > = >> >> >> > 10) >> >> >> > from core 0 to share memory and Receive (Read) it with another >> >> >> > Core >> >> >> > (for >> >> >> > example Core 1), change it in Core 1 (for example X = X + 1) and >> >> >> > write >> >> >> > again in share memory. >> >> >> > I really don't know How I could do it, I wanna do this without >> >> >> > using >> >> >> > NIC >> >> >> > ot >> >> >> > rte_eth at all, so simple and easy but I confused. >> >> >> > Please help me. >> >> >> > >> >> >> > PS. I know there are many example do more complex than this small >> >> >> > exercise >> >> >> > but all did it via NIC. >> >> >> >> >> >> What is your biggest challenge? Is it moving information between >> >> >> cores, or getting information into your application? >> >> >> >> >> >> Consider that most of the multiprocess examples in DPDK do two >> >> >> things: >> >> >> 1) Send/Receive packets to/from a NIC >> >> >> 2) Send packets between cores >> >> >> >> >> >> You obviously want to do #2, and looking at those examples should >> >> >> make >> >> >> how to do it fairly obvious. Is your challenge replacing #1 with >> >> >> something other than a NIC? If so, you *could* consider using a pcap >> >> >> PMD to just read packets from a file. In the past, I have used ring >> >> >> PMDs in conjunction with a secondary process which generates packets >> >> >> to inject arbitrarily formatted packets into my program. >> >> >> >> >> >> > >> >> >> > -- >> >> >> > M@hdi Mor@dm@nd B@die >> >> > >> >> > >> >> > >> >> > >> >> > -- >> >> > M@hdi Mor@dm@nd B@die >> > >> > >> > >> > >> > -- >> > M@hdi Mor@dm@nd B@die > > > > > -- > M@hdi Mor@dm@nd B@die