From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <anandnprasad@yahoo.com>
Received: from sonic310-20.consmr.mail.sg3.yahoo.com
 (sonic310-20.consmr.mail.sg3.yahoo.com [106.10.244.140])
 by dpdk.org (Postfix) with ESMTP id 7B11E2C66
 for <users@dpdk.org>; Mon, 19 Feb 2018 15:27:29 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048;
 t=1519050447; bh=lvM70W56BQaMnWoOjPFEl8vZ42Ub3VI1SmnY+gIJ2R8=;
 h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:From:Subject;
 b=DyQf4lYp6KZAdvGFIaT3UvFoj34mRtw7VUQYEJM5eaxzREqHFCfGxrVj219tpGSnN47F/OmEuQ99XbWXgvmhbjW1fEDf7DQSG51COyRLgaPpoWWZBD/3eypzV0i4HhoCnGHiEwu7N4jcp1SIWZk02/QhmgE/5Ynsgx2Ysey916eksrUi1YJPrJ7pwR/OcQqPm37hLgBR/qfZ/sP22V+Dk6m/2L+AfDueTAdXMB4xQLWdsB19JPTZMClg+dMgJvQvTi8ZIWdPhYiU0nWBMyEMtdYPOAl9EfZoWITAjHMO6Y9Lo2Fcg34Mry7n7VIPl3PPYkp3r2PnQEwqa/8tO25TgQ==
X-YMail-OSG: IyRxyWgVM1nyWh8TZ27kBIDvQBq5oVbXiByLTDRpcmLgB4AYmzfsLSGBWPDjIEA
 mFP5RVXmqsveTcyu4YEP312tcfncri3e3_DwbxNqZX_9jFTdD3eEXt2iRz4dQmLJysqS7J6qP2cz
 3jAKD6k3vTHpIMqsrXzQTrUuZkotG5GWEfc5QwCpAjX86_b8nalM4qcDCr1hL1TDisi6QZP06r08
 OYokv34ux7tarvDifqMmFJAVwnBuTPTnMFGCWJaXKMLvXuIRY44SdN8Fu0D3tWqHs2IMOao1duMz
 7Wh6Wupqov8aasqWXfG0NK_A_buhyqr.wqHuDGRP0FEGqwH3FTnBXyvHIzNvxCbNC23DCWXzcOl_
 ebtXhTOB8adUlDxiTf._LV_tTNHhSKypqjZ.UPpV08Df3XxJh_Y1DUUlu94WL9TPZ.po4pODrJv8
 Lj3Kqg.kxjg51peuXJBqmOQmh4wEqtuH9awiPVkDGliyMwvKjt0aqjjl5b0wR6pa875hbDlrJGHw
 -
Received: from sonic.gate.mail.ne1.yahoo.com by
 sonic310.consmr.mail.sg3.yahoo.com with HTTP; Mon, 19 Feb 2018 14:27:27 +0000
Date: Mon, 19 Feb 2018 14:26:53 +0000 (UTC)
From: Anand Prasad <anandnprasad@yahoo.com>
To: Thomas Monjalon <thomas@monjalon.net>
Cc: "users@dpdk.org" <users@dpdk.org>
Message-ID: <1951877383.1038987.1519050413410@mail.yahoo.com>
In-Reply-To: <4438207.qMLY8BktU0@xps>
References: <401616826.3643255.1513152888444.ref@mail.yahoo.com>
 <401616826.3643255.1513152888444@mail.yahoo.com> <4438207.qMLY8BktU0@xps>
MIME-Version: 1.0
X-Mailer: WebService/1.1.11419 YahooMailNeo Mozilla/5.0 (X11; Ubuntu;
 Linux x86_64; rv:44.0) Gecko/20100101 Firefox/44.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: Re: [dpdk-users] DPDK Performance tips
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
Reply-To: Anand Prasad <anandnprasad@yahoo.com>
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Mon, 19 Feb 2018 14:27:29 -0000

Hi Thomas, et.al.

=C2=A0=C2=A0 Thanks for response.
=C2=A0=C2=A0 I have followed the advices provided in the links you have pro=
vided but still i see the problem.
Recently, I studied dpdk-pktgen application and developed an application ve=
ry much similar to that. I mean, have made device, rx and tx, memmory pool =
and cache size configurations that pktgen uses. pktgen seems work fine with=
out any Rx packet drop but my application reports packet drop.
=C2=A0=C2=A0 Any guess what could be wrong with my application?=20

=C2=A0=C2=A0 I see packet drops in my application, when I launch some other=
 application (say browser or system monitor). But, in such situations, pktg=
en application works without any packet drops.
Regards,Anand Prasad=C2=A0=20
=20

    On Wednesday, 13 December 2017 4:41 PM, Thomas Monjalon <thomas@monjalo=
n.net> wrote:
=20

 13/12/2017 09:14, Anand Prasad:
>=C2=A0 Hi Dpdk team,
>=C2=A0 =C2=A0 Can anyone please share tips to get better DPDK performance?=
 I have tried to run DPDK test applications on various PC configurations wi=
th different CPU Speeds, RAM Size/Speed and and PCIex16 2nd and 3rd generat=
ion connections... but I don't get very consistent results.
>=C2=A0 =C2=A0 The same test application does not behave similarly on 2 PC'=
s with same hardware configuration.But general observation is that, perform=
ance is better on Intel motherboard with 3rd generation PCIe slot. When tri=
ed on Gigabyte motherboard (even with higher CPU and RAM speeds), performan=
ce was very poor.
>=C2=A0 =C2=A0 The performance issue I am facing is the Packet Drop issue o=
n the Rx side.
>=C2=A0 Two PC's with exactly same hardware configuration, one PC drops pac=
kets after few hours, but in the other PC I don't observe packet drop
> Highly appreciate a quick response
> Regards,Anand Prasad

This is very complicate because it really depends on the hardware.
Managing performance requires a very good knowledge of the hardware.

You can find some basic advices in this guide for some Intel hardware:
=C2=A0=C2=A0=C2=A0 http://dpdk.org/doc/guides/linux_gsg/nic_perf_intel_plat=
form.html
You will also find some informations in the drivers guide. Example:
=C2=A0=C2=A0=C2=A0 http://dpdk.org/doc/guides/nics/mlx5.html#performance-tu=
ning



  =20
>From vhuertas@gmail.com  Wed Feb 21 18:20:22 2018
Return-Path: <vhuertas@gmail.com>
Received: from mail-wr0-f176.google.com (mail-wr0-f176.google.com
 [209.85.128.176]) by dpdk.org (Postfix) with ESMTP id 67F162B9F
 for <users@dpdk.org>; Wed, 21 Feb 2018 18:20:22 +0100 (CET)
Received: by mail-wr0-f176.google.com with SMTP id m5so6650191wrg.1
 for <users@dpdk.org>; Wed, 21 Feb 2018 09:20:22 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=mime-version:from:date:message-id:subject:to;
 bh=5SKx8jU7xzzIbh+JoMIl8KWCBr0B7CkR+bhvvhIePZM=;
 b=vOO1rzrpFllWfO3TJ07tzD9DThPYH2A8lUDP9q5W/CWepAuCEJdwO6EfS+0YOOl+E8
 xZaAbddLRDhxRU9msDUtEPcKe9fY+73l/5o+vJnA2d+NYsoE2zqYTMMkJ+Ziuzy6TRyy
 00bprHkcE7/oJ5eUimRvUXfA4GFLSwbMASByM/YBXO04wdNLhK3ghhyJRwSNIT3Tou2K
 nKvBlkVrAqXkliIZsUee9JXPiq6KlnFOkwuub1GpxZIeGLCYPBzu4guiwzlZEKYdeZ1k
 mEaiSTyDH6BfYmmrd5rk4zFrL+/bWdk1UPJSVqDlkEpRRIow2YDvlsC3zvKLoGLP7IDb
 DfsA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
 bh=5SKx8jU7xzzIbh+JoMIl8KWCBr0B7CkR+bhvvhIePZM=;
 b=SaO2yv0AA1YZwxj2WGtJ+KMSlJxlPsd0u8GMN1kZ7XsnVqRUDv24k9a8BWTiRm+UH4
 bsrYxAvxv7goMwj5ZDXg4nMz/oXH8jBnG56HpPuMP+rEY6Ln6c8SFRbltSjX56jgdQYK
 QFDYXGfEwE5+oX2Z1IVLyG97JooWkOKfF9GT140sRZiQiUaCUsSHMwj+BjUqQGx04noA
 Tnye0Yq7aaSv33ULLvegD/CijcUncclHbJ9U209a64eFQ/yVoXzR4jDDU6Suro7QsbjT
 CNbMAKBUsX0plZf58o94Xj/GBIarLfUayLuYA/RozgHjXMsK/NRpXLJG3FTHN9QQySqV
 NThQ==
X-Gm-Message-State: APf1xPA66KF12bupE1Bkid3CY32SsUxv0mE2bVMumsvd3CDxRgfBzEZo
 OgCswEcj/iU94sf+HcUISho79sUBh1qx5/qZUZnnhQ==
X-Google-Smtp-Source: AH8x224eaLmZ8V47WrLkKoZ16UJUt2aEiYAZgLwm1hZm3BgAlvq2ubCw1rssmorzpoVsKbEQlpssvOIkmxjoPQxhhCY=
X-Received: by 10.80.170.131 with SMTP id q3mr6020540edc.43.1519233621806;
 Wed, 21 Feb 2018 09:20:21 -0800 (PST)
MIME-Version: 1.0
Received: by 10.80.185.37 with HTTP; Wed, 21 Feb 2018 09:20:21 -0800 (PST)
From: Victor Huertas <vhuertas@gmail.com>
Date: Wed, 21 Feb 2018 18:20:21 +0100
Message-ID: <CAGxG5chJncxbr159ZE8st1zLeqOzNzFmUwA3PqkybOTUb76zjg@mail.gmail.com>
To: users@dpdk.org
Content-Type: text/plain; charset="UTF-8"
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: [dpdk-users] rte_eth_rx_queue_setup is returning error -28 (ENOSPC)
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Wed, 21 Feb 2018 17:20:22 -0000

Hi all,

I am trying to make an application for having various rx threads capturing
packets from various queues of the same NIC (to increase performance using
RSS on one NIC). I am basing the app on an example called l3fwd-thread.

However, when I try to create the rx queue in a port using the
rte_eth_rx_queue_setup function it returns an -28 error (ENOSPC).

Having a look at source code of rte_ethdev.c, where this function is
implemented, I have seen the only place where ENOSCP value is returned (see
below).

    if (mp->private_data_size < sizeof(struct rte_pktmbuf_pool_private)) {
        RTE_PMD_DEBUG_TRACE("%s private_data_size %d < %d\n",
                mp->name, (int) mp->private_data_size,
                (int) sizeof(struct rte_pktmbuf_pool_private));
        return -ENOSPC;
    }

Executing step by step (using Eclipse), I saw that the private_data_size of
the pktmbuf_pool was set to zero. And that was the reason why it returned
-ENOSPC.

Nevertheless in the init_mem function of the example, when the pktmbuf_pool
is created, the value for private_data_size as parameter is 0.

if (pktmbuf_pool[socketid] == NULL) {
            snprintf(s, sizeof(s), "mbuf_pool_%d", socketid);
            pktmbuf_pool[socketid] =
                rte_pktmbuf_pool_create(s, nb_mbuf,
                    MEMPOOL_CACHE_SIZE, 0,
                    RTE_MBUF_DEFAULT_BUF_SIZE, socketid);
            if (pktmbuf_pool[socketid] == NULL)
                rte_exit(EXIT_FAILURE,
                        "Cannot init mbuf pool on socket %d\n", socketid);
            else
                printf("Allocated mbuf pool on socket %d\n", socketid);

#if (APP_LOOKUP_METHOD == APP_LOOKUP_LPM)
            setup_lpm(socketid);
#else
            setup_hash(socketid);
#endif
        }

So this is contradictory. Why the example initializes the private_data_size
to 0 and then it provokes a bat rx queue initialization?

Or am I understanding it wrongly?

Thanks for your attention,

-- 
Victor