From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ee0-x22d.google.com (mail-ee0-x22d.google.com [IPv6:2a00:1450:4013:c00::22d]) by dpdk.org (Postfix) with ESMTP id 16D4A68FA for ; Tue, 4 Feb 2014 11:43:59 +0100 (CET) Received: by mail-ee0-f45.google.com with SMTP id b15so4109993eek.18 for ; Tue, 04 Feb 2014 02:45:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=6wYCe7PE7MfiDvGZTSZvrAqA4x3jMtk9OOS6obqUBJQ=; b=OvVibZdYBeoeWldDReIN4FrQL9XWI0QUmBg/+p6X2peucfkpIFR6sikPGiOdFOiGSN NGzpQVWu7r4fTb6QZ18Eafj7eI+mwd4C+r8dJBYGWBiF43KUpnKaMwmMkWYj8Blmfulv dg9ZMfoA9Yq2ZB2Z1c0w7O3Bp2uku3mSWuE+SLHWOFjtDICDVlSNxqo9/gUkqoh2++xr oWvh0s5EIMzq5nYFy8IyoD1epx6CsK679fudON/+Y3NePobBDQiwc0GvlMDvYED/hAMm rpxeUXxQzMV/M3+2H58mmjD4oORvb7EqtaOwfxGwkOZTlHq+uM2VVs1JXV2w3+ptYcTn 3lUQ== MIME-Version: 1.0 X-Received: by 10.15.35.194 with SMTP id g42mr49127688eev.20.1391510720556; Tue, 04 Feb 2014 02:45:20 -0800 (PST) Received: by 10.14.147.5 with HTTP; Tue, 4 Feb 2014 02:45:20 -0800 (PST) In-Reply-To: References: Date: Tue, 4 Feb 2014 11:45:20 +0100 Message-ID: From: Mats Liljegren To: jigsaw Content-Type: text/plain; charset=UTF-8 Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] How to debug packet sends to virtual functions X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Feb 2014 10:44:00 -0000 Hi Qinglai, Thanks for the response! My previous attempt was with ixgbe loaded in the host. I also needed to load ixgbevf, but this seems to be because of a short-coming in libvirt. Maybe loading ixgbevf and then unbind it when running the guest is what causes my problems. I could receive packets with this setup, but not transmit. I used extra debug to syslog, and it showed that packets was placed in the transmit queue, but these packets was never sent. I'll see if I can get this working without loading ixgbevf in the host. What instructions did you follow to get this working? Did you do any deviation from the instructions? Regards Mats On Tue, Feb 4, 2014 at 11:26 AM, jigsaw wrote: > Hi Mats, > > I've tried vf with 82599EB and it works fine. As long as the VF is > visible in guest, DPDK's VF driver should work just as ixgbevf, which > shares more or less the same code. > > I don't understand why you would expect DPDK@guest to work as VF, > while the host has no ixgbe loaded. > To make further debug I'd suggest compile ixgbe driver with your own > syslogs. At least you will be able to see the signalling between vf > and ixgbe drivers. > > -Qinglai > > > On Tue, Feb 4, 2014 at 12:08 PM, Mats Liljegren > wrote: >> This is my fourth mail in my desperate attempt to get DPDK running in >> KVM and no comments so far, not even any "it works for me". Am I the >> only one crazy enough to believe that this can be done? >> >> Anyway, out of desperation I tried to get it running without having >> ixgbe or ixgbevf kernel modules loaded in host nor guest. I followed >> the instructions in the Programmer's Guide, chapter "Setting Up a KVM >> Virtual Machine Monitor", using the PMD version of the instructions. >> >> I get as far as being able to see my four virtual functions in the >> guest using "lspci". But starting the DPDK application gives me the >> following error: >> >> PMD: The MAC address is not valid. >> The most likely cause of this error is that the VM host >> has not assigned a valid MAC address to this VF device. >> Please consult the DPDK Release Notes (FAQ section) for >> a possible solution to this problem. >> >> This may be true, but without any kernel modules loaded, how am I >> supposed to change any MAC addresses? Can this be done from within >> DPDK? >> >> As a side-note, I did try to load ixgbevf in the guest, but it >> produced no interfaces. There was no error messages in the syslog >> though. >> >> Is it possible to get X540 working in a guest or should I switch hardware? >> >> Since the instructions assumes I know the command line to KVM to start >> my guest (which I do not), I cannot followed them precisely. I use >> virsh and XML file, and maybe I've misunderstood how to translate the >> pci-assign parameter to XML code. I currently use a entry, >> but I've also tried . Neither has been >> working for me so far, though the version got me as far as >> being able to receive packets at least, but not transmitting. >> >> Regards >> Mats >> >> >> On Mon, Feb 3, 2014 at 12:13 PM, Mats Liljegren >> wrote: >>> Never mind, I was hit by the infamous MAC spoofing... I got it working >>> on both the host and the guest using ixgbevf driver, so apparently the >>> cables are correctly attached. >>> >>> Using DPDK is still no-go. It can receive packets, but when sending >>> the packets the function returns success, but the driver reports >>> nothing (i.e. no errors, no sent packets, no nothing, except for >>> received packets of course). >>> >>> What could cause this behavior? >>> >>> Regards >>> Mats >>> >>> On Fri, Jan 31, 2014 at 7:30 PM, Mats Liljegren >>> wrote: >>>> I have a follow-up on this: >>>> >>>> ixgbe version 3.13.10-k >>>> ixgbevf version 2.7.12-k >>>> >>>> (These are what was provided by Ubuntu 13.10) >>>> >>>> I tried the following sequence on the host, before starting the guest: >>>> 1) sudo rmmod ixgbe >>>> 2) sudo modprobe ixgbe max_vfs=2 >>>> 3) sudo ifconfig em1 up # This is the physical function >>>> 4) sudo ifconfig em1_0 192.168.2.2 # This is the virtual function >>>> 5) ping 192.168.2.1 >>>> >>>> I can see that the ping request reaches its target, and a reply is >>>> sent back. But this reply is not received by the ping shell command. >>>> >>>> Why? >>>> >>>> Regards, >>>> Mats >>>> >>>> On Wed, Jan 29, 2014 at 6:56 PM, Mats Liljegren >>>> wrote: >>>>> I'm trying to get a modified version of the l2fwd example running, and >>>>> have problems with packets being silently thrown away. I can receive >>>>> packets, and my printf's indicates that the packets are being sent to >>>>> the correct port, using correct MAC address as source address. And >>>>> still, the packets are lost. >>>>> >>>>> Since the port is a virtual function, it seems like I cannot use >>>>> tcpdump on it to see the network traffic. There is nothing coming out >>>>> of the cable (activity light not flashing, the receiving end running >>>>> tcpdump does not see any traffic). >>>>> >>>>> I'm using two X540 with two virtual functions each. The application >>>>> runs in a KVM/Qemu environmen. >>>>> >>>>> Any suggestions how to debug this? >>>>> >>>>> Regards, >>>>> Mats