From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ea0-x235.google.com (mail-ea0-x235.google.com [IPv6:2a00:1450:4013:c01::235]) by dpdk.org (Postfix) with ESMTP id 5DE7D6932 for ; Tue, 4 Feb 2014 12:46:37 +0100 (CET) Received: by mail-ea0-f181.google.com with SMTP id m10so4314134eaj.26 for ; Tue, 04 Feb 2014 03:47:58 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=8JkxU3bK5+6dNwsNiHDy9ciOwDL0lwPxdASNIBwkCsI=; b=Pg6Zhz64ZJuLvaHySQIb7pA+++czI+3J1KApckjIxrlgJAylDl6nGwnx5mMgqCJxjS TTfQCuoFtrTvQFRlA9ON/mY+Mb+K84EYkTZddCigpCvCTW1XzYAbmGHzqRWzINhzV5fX uDr1oVzI3hjhDAmmpzsv1J3UKATbjvUuyjIF27emHj42TmJifIx8hA8z5KcVlc/3wP7E I9ZsJ1mFIyFpxCE1pv25NORng1/TxUcJwYSYzGJFZnBHBBZm3u9smy9gI2AuWIBaHVem 7bXu+bVhUgSaOllcA/VH5i1e1Fxvaimywypezm0WmLGjY5aeAjW/VSyL6FCCiFGbDns2 Hk/Q== MIME-Version: 1.0 X-Received: by 10.14.194.131 with SMTP id m3mr50567096een.2.1391514478047; Tue, 04 Feb 2014 03:47:58 -0800 (PST) Received: by 10.14.147.5 with HTTP; Tue, 4 Feb 2014 03:47:57 -0800 (PST) In-Reply-To: References: Date: Tue, 4 Feb 2014 12:47:57 +0100 Message-ID: From: Mats Liljegren To: "Burakov, Anatoly" Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: "dev@dpdk.org" Subject: Re: [dpdk-dev] How to debug packet sends to virtual functions X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 04 Feb 2014 11:46:37 -0000 Hi Anatoly, Thanks for the clarification. Then I can't use those instructions, which is what I was starting to suspect. I have to find another way of getting DPDK running in the guest then. Using ixgbevf in the guest works fine, though. Regards Mats On Tue, Feb 4, 2014 at 12:21 PM, Burakov, Anatoly wrote: >> -----Original Message----- >> From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Mats Liljegren >> Sent: Tuesday, February 04, 2014 10:45 AM >> To: jigsaw >> Cc: dev@dpdk.org >> Subject: Re: [dpdk-dev] How to debug packet sends to virtual functions >> >> Hi Qinglai, >> >> Thanks for the response! >> >> My previous attempt was with ixgbe loaded in the host. I also needed to = load >> ixgbevf, but this seems to be because of a short-coming in libvirt. Mayb= e >> loading ixgbevf and then unbind it when running the guest is what causes= my >> problems. I could receive packets with this setup, but not transmit. I u= sed >> extra debug to syslog, and it showed that packets was placed in the tran= smit >> queue, but these packets was never sent. >> >> I'll see if I can get this working without loading ixgbevf in the host. >> >> What instructions did you follow to get this working? Did you do any >> deviation from the instructions? >> >> Regards >> Mats >> >> On Tue, Feb 4, 2014 at 11:26 AM, jigsaw wrote: >> > Hi Mats, >> > >> > I've tried vf with 82599EB and it works fine. As long as the VF is >> > visible in guest, DPDK's VF driver should work just as ixgbevf, which >> > shares more or less the same code. >> > >> > I don't understand why you would expect DPDK@guest to work as VF, >> > while the host has no ixgbe loaded. >> > To make further debug I'd suggest compile ixgbe driver with your own >> > syslogs. At least you will be able to see the signalling between vf >> > and ixgbe drivers. >> > >> > -Qinglai >> > >> > >> > On Tue, Feb 4, 2014 at 12:08 PM, Mats Liljegren >> > wrote: >> >> This is my fourth mail in my desperate attempt to get DPDK running in >> >> KVM and no comments so far, not even any "it works for me". Am I the >> >> only one crazy enough to believe that this can be done? >> >> >> >> Anyway, out of desperation I tried to get it running without having >> >> ixgbe or ixgbevf kernel modules loaded in host nor guest. I followed >> >> the instructions in the Programmer's Guide, chapter "Setting Up a KVM >> >> Virtual Machine Monitor", using the PMD version of the instructions. >> >> >> >> I get as far as being able to see my four virtual functions in the >> >> guest using "lspci". But starting the DPDK application gives me the >> >> following error: >> >> >> >> PMD: The MAC address is not valid. >> >> The most likely cause of this error is that the VM host >> >> has not assigned a valid MAC address to this VF device. >> >> Please consult the DPDK Release Notes (FAQ section) for >> >> a possible solution to this problem. >> >> >> >> This may be true, but without any kernel modules loaded, how am I >> >> supposed to change any MAC addresses? Can this be done from within >> >> DPDK? >> >> >> >> As a side-note, I did try to load ixgbevf in the guest, but it >> >> produced no interfaces. There was no error messages in the syslog >> >> though. >> >> >> >> Is it possible to get X540 working in a guest or should I switch hard= ware? >> >> >> >> Since the instructions assumes I know the command line to KVM to >> >> start my guest (which I do not), I cannot followed them precisely. I >> >> use virsh and XML file, and maybe I've misunderstood how to translate >> >> the pci-assign parameter to XML code. I currently use a >> >> entry, but I've also tried . Neither has >> >> been working for me so far, though the version got me as >> >> far as being able to receive packets at least, but not transmitting. >> >> >> >> Regards >> >> Mats >> >> >> >> >> >> On Mon, Feb 3, 2014 at 12:13 PM, Mats Liljegren >> >> wrote: >> >>> Never mind, I was hit by the infamous MAC spoofing... I got it >> >>> working on both the host and the guest using ixgbevf driver, so >> >>> apparently the cables are correctly attached. >> >>> >> >>> Using DPDK is still no-go. It can receive packets, but when sending >> >>> the packets the function returns success, but the driver reports >> >>> nothing (i.e. no errors, no sent packets, no nothing, except for >> >>> received packets of course). >> >>> >> >>> What could cause this behavior? >> >>> >> >>> Regards >> >>> Mats >> >>> >> >>> On Fri, Jan 31, 2014 at 7:30 PM, Mats Liljegren >> >>> wrote: >> >>>> I have a follow-up on this: >> >>>> >> >>>> ixgbe version 3.13.10-k >> >>>> ixgbevf version 2.7.12-k >> >>>> >> >>>> (These are what was provided by Ubuntu 13.10) >> >>>> >> >>>> I tried the following sequence on the host, before starting the gue= st: >> >>>> 1) sudo rmmod ixgbe >> >>>> 2) sudo modprobe ixgbe max_vfs=3D2 >> >>>> 3) sudo ifconfig em1 up # This is the physical function >> >>>> 4) sudo ifconfig em1_0 192.168.2.2 # This is the virtual function >> >>>> 5) ping 192.168.2.1 >> >>>> >> >>>> I can see that the ping request reaches its target, and a reply is >> >>>> sent back. But this reply is not received by the ping shell command= . >> >>>> >> >>>> Why? >> >>>> >> >>>> Regards, >> >>>> Mats >> >>>> >> >>>> On Wed, Jan 29, 2014 at 6:56 PM, Mats Liljegren >> >>>> wrote: >> >>>>> I'm trying to get a modified version of the l2fwd example running, >> >>>>> and have problems with packets being silently thrown away. I can >> >>>>> receive packets, and my printf's indicates that the packets are >> >>>>> being sent to the correct port, using correct MAC address as >> >>>>> source address. And still, the packets are lost. >> >>>>> >> >>>>> Since the port is a virtual function, it seems like I cannot use >> >>>>> tcpdump on it to see the network traffic. There is nothing coming >> >>>>> out of the cable (activity light not flashing, the receiving end >> >>>>> running tcpdump does not see any traffic). >> >>>>> >> >>>>> I'm using two X540 with two virtual functions each. The >> >>>>> application runs in a KVM/Qemu environmen. >> >>>>> >> >>>>> Any suggestions how to debug this? >> >>>>> >> >>>>> Regards, >> >>>>> Mats > > Hi Mats > > Basically, there is no way to change MAC address of a VF device from with= in the VM, you have to do it on the host. So, whatever the FAQ section desc= ribes (i.e. ip link ...) has to be done on the host, not inside the VM. Tha= t is, you have to load ixgbe kernel module on the host with max_vfs=3D set = to whatever number of VF devices you need, and then go through each VF devi= ce and assign a MAC address via the "ip link" command, as described in the = FAQ section of the DPDK Release Notes. You can then load either ixgbevf or = DPDK VF drivers on the guest, and they will initialize correctly. > > Best regards, > Anatoly Burakov > DPDK SW Engineer > -------------------------------------------------------------- > Intel Shannon Limited > Registered in Ireland > Registered Office: Collinstown Industrial Park, Leixlip, County Kildare > Registered Number: 308263 > Business address: Dromore House, East Park, Shannon, Co. Clare > > This e-mail and any attachments may contain confidential material for the= sole use of the intended recipient(s). Any review or distribution by other= s is strictly prohibited. If you are not the intended recipient, please con= tact the sender and delete all copies. >