From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 736F0A046B for ; Thu, 9 Jan 2020 11:35:12 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 32AC61DC03; Thu, 9 Jan 2020 11:35:12 +0100 (CET) Received: from mail-il1-f181.google.com (mail-il1-f181.google.com [209.85.166.181]) by dpdk.org (Postfix) with ESMTP id 510571DC02; Thu, 9 Jan 2020 11:35:10 +0100 (CET) Received: by mail-il1-f181.google.com with SMTP id p8so5269081iln.12; Thu, 09 Jan 2020 02:35:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=1UTJjQ7eOhTPkrlWR1sKW4ZgP5ePX8Egttfiimym/7c=; b=ac7wYw/dgCqMSszPvU+cLYIJ9BY4JRi8DoYMzCaVSc3QsUfm1Ran92KnsK8XWu41uO hJtV1ywg4IWxNIb/LJWS1Jxgj110vVEPfckTuIiZ5VxPcH1WNKvORO2prLdZPSBW1Ax4 MMdLxAq4REXDLTGta2WlUOBTzWfj74QrtazfyvnZPg0HhK74RRD4YMXHE34h84W/lXVT AwqNohGTwp21DfI0lb3uTpR+U8O3FLR14L0NPcyOfLU3ZGZaGckm3fmEfiA4gDiVa0+n dprg8t1lU0RgX+tYHDtJqifUO5BY4bVcr2Of86o/lr1EnnKgAbwiCertw9bRQnf7DC38 VaXA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=1UTJjQ7eOhTPkrlWR1sKW4ZgP5ePX8Egttfiimym/7c=; b=qRFgKafQmnSZDVhP2HRNfsTIEiAecYgU8TY7RUBZ/Yv2XDbxU2+HP2jR+OHP9qfJ8F J9r0rXKJH9CYK9b8E8oJ4ZavNTD/870FVu9M1LxE1yvlsrFT6sl874FS50jVzTkKnVSc eNcEEVMATGnhLQDEeMOVoAjII0B9bk/k6qj14oDzkRZ6FmpgvXmjsXf3+iBSF/4UH+lC lowkRJCj5LcQ6ooWqWrsT25eZhXZ7itNiYuMQLisvgfx3tw0EyU33cuGChz8LZ8urBT4 UU//F2kUbFIvCQ8MYeqSfKpTFqTTCkSkMpjkVDBUX9BQn2W/98+2Ss36PH4p+AINR429 8ZkQ== X-Gm-Message-State: APjAAAXPZrtU34tL4dyV5CRmCJzSikQT0yG/XJSXlLIsrHfbyosvKWq2 QT5R0/Z9iFVMVsErido5y/ee660hgWtw7xGXor3ak0Rm X-Google-Smtp-Source: APXvYqysO9CRJUIiEKRB5SuqbCwljyZvXvHtNf1B+VoTCKHvK58JWwP77BOA+fIUhq1Bwn3MuFF+3RnQEzPn9WJmjwg= X-Received: by 2002:a92:5bc7:: with SMTP id c68mr7859627ilg.184.1578566109548; Thu, 09 Jan 2020 02:35:09 -0800 (PST) MIME-Version: 1.0 References: <20200108221237.19daf0df@hermes.lan> In-Reply-To: <20200108221237.19daf0df@hermes.lan> From: satyavalli rama Date: Thu, 9 Jan 2020 16:04:58 +0530 Message-ID: To: Stephen Hemminger Cc: dev@dpdk.org, users@dpdk.org Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] [dpdk-dev] l2fwd application are not sending continuous packets . X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Thanks Stephen, We've tried to debug issue in couple of ways, please correct us whether these approaches or right not wrong? 1. We have increased the MAX_PKT_BURST from 32 to 64 and MEMEPOOL_CAHCE_SIZE 256 to 512 2. Keeping IGB_UIO as the only driver module. 3. Resetting the RX queues. But still we are seeing the issue, as mentioned above======== > > * Debugging and Observations :-=========================* > > When I tried to debug this issue , I could see that > > 1) In problematic state, rx queue of VM-3 is not getting packets, but VM-2 > > is sending packets properly. I checked this by using pdump of rx queue. > > 2) Just before problematic state in VM-3, I could see that previous > > packet(only one packet) instead of going to VM-4, it is coming back to > > again in rx queue of VM-3 and after wards I did not get any packets in rx > > queue. On Thu, Jan 9, 2020, 11:42 Stephen Hemminger wrote: > On Thu, 9 Jan 2020 07:25:45 +0530 > satyavalli rama wrote: > > > Can anyone please help us with this? > > > > > > On Mon, Jan 6, 2020, 11:25 satyavalli rama > > wrote: > > > > > > > > > > > > > > Hello Dpdk Team, > > > > > > I'm facing issue while forwarding packets in DPDK's l2fwd application. > > > While sending 1 Lac packets from Scapy, I could see sometimes packets > are > > > sending from one VM to another VM. > > > Before explaining issue let me explain topology. > > > > > > > > > > > > *Topology :-=======*1) I am having 4 VMs(Virtual Machines) in same > host. > > > All these VM are running on Ubuntu 16.04.1. > > > 2) VM-1 is used as Scapy to forward packets (Scapy version 2.4.3) . > While > > > creating packets I am giving destination mac(d-mac) address of VM-1. > > > 3) In VM-2 am running L2 forwarding application. > > > In this l2fwd application, I am doing simple packet forwarding by > > > statically keeping mac address of VM-3. > > > Code :- > > > l2fwd_mac_updating () { > > > ... > > > ...... > > > ....... > > > *((uint64_t *)tmp) = 0xddccbbaa/*VM-3 mac address*/ + > > > ((uint64_t)dest_portid << 40); > > > } > > > 4) Also in VM-3, I am doing same like VM-2, but I kept mac address of > VM-4 > > > 5) In VM-4, I am using wireshark to see packets coming from VM-3. > > > 6) In VM-2 and VM-3, I kept promiscuous mode off by commenting out > > > rte_eth_promiscuous_enable(). > > > > > > --------------- > --------------------- > > > ------------------ > > > ------------------------ > > > | VM-1 | ----------> | VM-2 | > > > ----------------> | VM-3 | ------------------> | > VM-4 > > > | > > > --------------- > --------------------- > > > ------------------ > > > ------------------------ > > > Scapy Simple L2 forwarding > > > Simple L2 forwarding Wireshark > > > used for sending packets Sending all packets to > > > Sending all packets to > > > VM-3 > > > VM-4 > > > (DPDK) > > > (DPDK) > > > > > > > > > *Problem :- ======*== > > > From scapy VM, I am sending 1 lac packets with rate of 100 packets per > > > second. *During problematic condition I could see packets are not > getting > > > forward from VM-3.**Problematic state is happening anytime after > sending > > > 1k packets.* > > > This issue is not consistence but I could see this issue 8 out of 10 > times. > > > > > > > > > * Debugging and Observations :-=========================* > > > When I tried to debug this issue , I could see that > > > 1) In problematic state, rx queue of VM-3 is not getting packets, but > VM-2 > > > is sending packets properly. I checked this by using pdump of rx queue. > > > 2) Just before problematic state in VM-3, I could see that previous > > > packet(only one packet) instead of going to VM-4, it is coming back to > > > again in rx queue of VM-3 and after wards I did not get any packets in > rx > > > queue. > > > 3) I have changed rate of packet forward 10packets per second. but > still > > > see the issue. > > > > > > > > > *Can anyone please help to solve this problem ? I need it urgently .* > > > Thanks, > > > Satya > > > > > Sorry, you need to dig inside the forwarding application and instrument > what is coming in and how packets are being processed. You usually can't > treat DPDK as a black box. >