From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by dpdk.org (Postfix) with ESMTP id 3720D236 for ; Fri, 24 Nov 2017 17:03:05 +0100 (CET) Received: by mail-wm0-f48.google.com with SMTP id x63so23431679wmf.4 for ; Fri, 24 Nov 2017 08:03:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netronome-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=tdmWRjGMtvSgp2kiqZbzd7Vg6zD6CG82izOsVOdrG2I=; b=kTx/Hho+fEKZcDuNurEcp6eWxDYLb5yD+yhhUU1CQTSOBqbGw4AGKbvZSw8yd/r6VR 06Corh0qT7d+QEpm6aTb4XQl1t32QkuQqCSRmHPUmX16iT2D4QX7VgV/SgPeXjjP+r8i 0V27mb4NlIU4hJlL6dprvZdwTNF0T5xDb1GPD25a1/TFV/lNecNUSip0Rtjy/aC84UXf OaISHe36HvYbHeODXgwQKI+TVti4yhJ4gWTtUhK0MsIZsBStJ287r5Yl/e0zEMk2mbwx I2q68imFIgG5xImOP4DuQaFfuAz0HpYP0ENHprjAhaBUj9hVE7bJYWmwdntUWDUmSagx j+6Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=tdmWRjGMtvSgp2kiqZbzd7Vg6zD6CG82izOsVOdrG2I=; b=o6QSbg5k4b8pUJlmidGxK+jF5MfI4FR4GcDZuXEAXzJ/X/HIYfmHelUUVrECCL2Hkw Xfa3lfQOr7HsApfnBu9d/Ix7LMryQZfSraookXc+FvEcpSbPxpdWuooKbrtDai/Tm1SA V/FvNR4zLgYOMhiEgd/kFIQE1FuGnNAaIh4eJqVi8255FZXLac+jQmVyfj7o4RTXKKdI cYQQrBT6yqdphsteqiVNQlgRQumeB7FOBbDGk8NBnKWoS1+v7yTam+wuF8qGZvSnpR3k NSb7ZF4ZnYmqz8HaNO5LrYfORTQUEf9BnDsOvMZeoG8/mdF7QobsJrMEqJUhLo7qohRg Q5yg== X-Gm-Message-State: AJaThX4CKY4lyPZ/M+cCy6EGaZCOhq/txfrSWGlt5heyRMTpI5Zwku8n hDtg6kfxlfNzuvQKMe7L6D+3ZcjzvbqFdJssL0GgCil3 X-Google-Smtp-Source: AGs4zMY3SR+ha3jSeaooz7Lcc14KIDamnCPfbHa4IAbH3oe5Wbd5wc7rF6dI1Yuc7ZCM9WvYpKhPT2Sjm2T83usI3qE= X-Received: by 10.80.215.29 with SMTP id t29mr40563856edi.45.1511539384764; Fri, 24 Nov 2017 08:03:04 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.226.9 with HTTP; Fri, 24 Nov 2017 08:03:04 -0800 (PST) In-Reply-To: <77795f7a98ec48b29ea1a95ce241e85a@XCH-RTP-017.cisco.com> References: <77795f7a98ec48b29ea1a95ce241e85a@XCH-RTP-017.cisco.com> From: Alejandro Lucero Date: Fri, 24 Nov 2017 16:03:04 +0000 Message-ID: To: "Hanoch Haim (hhaim)" Cc: "dev@dpdk.org" Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] net/i40e: Significant performance degradation relative to DPDK 17.02 with TRex use-cases X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Nov 2017 16:03:05 -0000 We are seeing same performance drops but in our case is 16.11.3 compared against 17.05.2 and 17.08. That is when DPDK is used with SRIOV inside VMs, and the only change is the DPDK version. Similar tests but using SRIOV in the host don't have such a drop. One change that could impact performance was added in 17.05, and it is about how PMD private data is allocated. 16.11 and 17.02 use rte_zmalloc which calls rte_zmalloc_socket using SOCKET_ID_ANY by default, but since 17.05 such private data is allocated using rte_zmalloc_socket with dev->device.numa.node. With some testing in the host, I can see a minor impact when a PMD is using its private data allocated in another NUMA node, but this could have a bigger impact inside VMs. I'm investigating this and will inform about any progress. On Fri, Nov 24, 2017 at 11:36 AM, Hanoch Haim (hhaim) wrote: > Hi All, > Significant performance degradation observed with DPDK 17.11 > The Scenario is with TRex traffic generator (https://github.com/cisco- > system-traffic-generator/trex-core) > > > 1. Stateless mode, 64B packet stream (multi-core/single core) > > DPDK 17.02 - 37-39MPPS/core > DPDK 17.11 - 33.5MPPS/core > > ~12% degradation > > > 2. Stateless mode, Field Engine (Multi-core) > > > DPDK 17.02 - 14MPPS/core > DPDK 17.11 -11.8MPPS/core > > ~15% degradation > > > 3. Only DPDK was replaced > > 4. Is this expected? > > The full report can be found here: > https://trex-tgn.cisco.com/trex/doc/trex_analytics.html > > > > * Mellanox CX-5 (mlx5) shows significant improvement > > * Ixgbe shows improvement > > Thanks, > Hanoh > >