From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-lj1-f175.google.com (mail-lj1-f175.google.com [209.85.208.175]) by dpdk.org (Postfix) with ESMTP id 8E0862E8F for ; Wed, 12 Sep 2018 09:25:45 +0200 (CEST) Received: by mail-lj1-f175.google.com with SMTP id f8-v6so745857ljk.1 for ; Wed, 12 Sep 2018 00:25:45 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intopalo.com; s=google; h=mime-version:from:date:message-id:subject:to; bh=NPbx+JKo+1zjsJWqwKzksGNBz/ZuiWInxVZADWCnb+M=; b=KEfL4h9/QYBV6TzNsvngZgbFga+ghGqs9P8Dbw5J8iiIenMi/919LLm77Js/YbE+ox 3DrAJla8s9kYRwh1yNGU+Cy4o5Kyz44MyrwFUh7HloZ5iKggQHlD3toe3yn0e2AAmbfM BxcgRVuvXvFQHjJZaro1gSSHq7GznnTCPaf0M= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=NPbx+JKo+1zjsJWqwKzksGNBz/ZuiWInxVZADWCnb+M=; b=He9h3mpr/M+AhQ9pJCKjMsNu9xEGUp4Fi9kzF/sD1uTxzJUZQ1AwYLlmIh4EreZg40 KBFOir7Z3v/oriih9qFjcXF7tpL/Jk4zhX6seMPmE6fZ++vMTHFsJiikOBGhRoHQ/KUo MmInQy1ote5ypG5AsltQz+Jc7jNROkG3qv14RNCAoT/+87RBNJ4Bur5mcUgC2pldnuEm yUH4lNqcBDt2+NTDK7SMQ3XrVp76kp7xjHFjtAz1Fi/vujwMyFPwA//OUSPZ8hpQfUhN WRD5KTth0dupglU0dwfrv4GV9OZzmTQ2vClRPeb2c4tieOm3tOXgQNoItpq5JHYeU2vk Y6Lw== X-Gm-Message-State: APzg51ChuhNS+uHeqOOO4eFJyo4ouIXTikBEIDECci2/axQGTtUWJI1W vP0XfIJPZj49zlzFtlOCprJn4F0b7bFYkmVDqFKFefsGWwk= X-Google-Smtp-Source: ANB0VdZp+i+gduXLRKkZsvnhg5X/DqIJOKD0yXP0zxZ9NTs0lPPB6FxAmKSUyqFugdOWR5I8aYVrq0rB1xvIe/7SUnc= X-Received: by 2002:a2e:4745:: with SMTP id u66-v6mr425363lja.76.1536737144734; Wed, 12 Sep 2018 00:25:44 -0700 (PDT) MIME-Version: 1.0 From: Mathieu Devos Date: Wed, 12 Sep 2018 10:25:33 +0300 Message-ID: To: users@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] DPDK Virtual Test location X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Sep 2018 07:25:45 -0000 Hello, After attempting several approaching, I'm starting to run out of ideas to approach this issue. My goal is to create a straightforward testing platform for our DKDP-enabled application. We can run the test in Vagrant manually on our own computers, as Vagrant has the option (with libvirt at least) to emulate new NICs. Through the use of libvirt we even have the option of selecting on which domain, bus, slot & function we place this new virtual NIC. Since DPDK just thinks this is a real NIC, it can safely use it, and we can run our tests. Which is great, well, kinda. The issue is that Vagrant has a history of being a tad bit very difficult to work with. As such we keep running into the "it works on my computer"-issue, something which I'm tasked with solving (DevOps fun, my understand of DPDK is extremely limited). Now I've taken a look at containers, but since they use exact kernel from the host, this is not an option, virtual machines such as EC2, Nova Compute, ... all seem to be having their own set of limitations. The problems continue as we would like to set up a VM with Application A & DPDK, link that to another VM with Application B & DPDK. We would then also need to bridge the network in between these two VMs. Let's say for the sake of simplicity the following setup: +-----------+ +---------+ | VM1 | | VM2 | | Encrypt | | Decrypt | | DPDK >>---->> DPDK | +-|---------+ +-------|-+ | | To test the application overall setup, we would just push in packets with any program into VM1, this will use our "whatever" encryption, send them to VM2, which will decrypt them. At the end we read them back out, and we should see the same packages as we sent in. I'm aware that speed will be very low, since this all virtual, and we're not using any of the hardware here. The test isn't resolved around speed, it's to test if we can set up that encryption software together with DPDK properly. My overall question, is there any cloud / server / DevOps setup, or toolkit, out there that you would recommend to create these kind of setups in an automated way. Ideally, when we write some code, it triggers a build server, builds the code for both VMs. Upon completion, spawn the VMs, create the links, run the test on the link, report output, and destroy the VMs + network links again. I'm currently at a loss to even figure out which direction to look in first. Any help or suggestions would be much appreciated. Best regards, Mathieu -- *M*athieu *D*evos M.Sc.(Tech) - Software Developer +358 45 787 48074 Intopalo