From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4DE5AA034F for ; Sat, 11 Sep 2021 10:56:33 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C509640042; Sat, 11 Sep 2021 10:56:32 +0200 (CEST) Received: from delivery.mailspamprotection.com (delivery.mailspamprotection.com [146.66.121.161]) by mails.dpdk.org (Postfix) with ESMTP id AA18240041 for ; Sat, 11 Sep 2021 10:56:31 +0200 (CEST) Received: from 72.204.214.35.bc.googleusercontent.com ([35.214.204.72] helo=es18.siteground.eu) by se17.mailspamprotection.com with esmtps (TLSv1.2:AES128-GCM-SHA256:128) (Exim 4.92) (envelope-from ) id 1mOyoF-000EDx-Uu for users@dpdk.org; Sat, 11 Sep 2021 03:56:30 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=filipjaniszewski.com; s=default; h=Content-Transfer-Encoding:Content-Type: In-Reply-To:MIME-Version:Date:Message-ID:References:To:From:Subject:Sender: Reply-To:Cc:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id:List-Help: List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=rkrvb7/r6KKyHSkCN+iZjAk/Te6iwerXR5fSqAUjoeY=; b=DEkNjkF52GlOi4cCjXUED1lprL Ohaa0wsqFwQrKNSOp4oyf1ndIs7TodrxHlTRs9vlYotHevQTwzMkW7a4sSBcPjz5U6jbNxJS6nObF PnOmkeZln34fYOBTJGt51P9NKAbetxw638/TrD6AZrkYBriOFrgb8AVfVTMxYMlBYPU+2waLSzpGb WH6ILYs5Lp3FIgVCkHZk6pOvvg92RXp/8e4bXvA5JhRWrZqmLm2TIVWCS4IHRLDegL5Ox/pq/6j12 HGHdHVoNXVFRsH0jKKts/pxOEaXYuvetQc123TG9AEJEhymptZA2Vui0NFXY1cUXc8VDwJPI4r6Y0 iCCNEoYg==; Received: from [89.64.148.179] (port=33856 helo=localhost.localdomain) by es18.siteground.eu with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.90-.1) (envelope-from ) id 1mOyoE-000ELP-KO for users@dpdk.org; Sat, 11 Sep 2021 08:56:26 +0000 From: Filip Janiszewski To: "users@dpdk.org" References: Message-ID: <57ab0193-689d-55b9-6f8c-dc23682e7c06@filipjaniszewski.com> Date: Sat, 11 Sep 2021 10:56:26 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.13.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=iso-8859-15 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Originating-IP: 35.214.204.72 X-SpamExperts-Domain: es18.siteground.eu X-SpamExperts-Username: 35.214.204.72 Authentication-Results: mailspamprotection.com; auth=pass smtp.auth=35.214.204.72@es18.siteground.eu X-SpamExperts-Outgoing-Class: ham X-SpamExperts-Outgoing-Evidence: Combined (0.19) X-Recommended-Action: accept X-Filter-ID: Pt3MvcO5N4iKaDQ5O6lkdGlMVN6RH8bjRMzItlySaT/+tKJ2f/HZ84m0a5QhbbAbPUtbdvnXkggZ 3YnVId/Y5jcf0yeVQAvfjHznO7+bT5wDtBK3p5VcS6iRNP7EipR8fYzfQXcfqmra3dmoHS4ygilY Nk4Q2GGXzdTterPvfjlWuRWrkPihq53YqAd1ENNq6iAM41hAeV/RVyTQeiNgOIMaxvXc9tQ1fZaW Jxab/NLu+GFU0sCml2vPee3sRKccf6uNtfvhlxVIcNsI7TpuMmCm1Mqx/0+DydNzT9K7qSnD/KIZ FjZmfdcVjL2SVfcQjmlJySLkQdPf+nBedSzwCmfenOukD31wzoxNLsD+qwR+2ViZMo6KCoS3Q3la AVGdWIxiTB0uxa1HdhDOuVInIWWLX2ZbQb3UJKihEmoDuwh8ZolFwwybCr3yWDyr1A1PvRkWzsAg aWolxIxCj2GHto6atsxaFkWS/KO9ggVt7y11v0HCq9Ij3WgoQoezM+scaWWR7drMd0qbJIo1RVCX ie2VXGdtLyog7ui50fJvZPXx1zG+dBgRGQy5Evn9+jdEgn5yrhquUfGKFVmhdtT5snHd0G1x4pfZ 1aISb7ugeb3EER4aaezxB4UAOdANOt+ul3AsDBujjw7GCggXV/wpTFs765aq/7Ihe5JpNEYIVsOM yGnDIpSchlco6RIDoNg/2Wq2InZGQXRwgp4DivepysN6jYX/nXkLyQnRCh0nB+uYUazmWajDqA7N T8Js52zSASJFC/49WOPBr5nlEUI4xORP7e7j8LTq/FlKWIZioClKC5XROoL23kHH2wGTQk+50JXq xnzrC76sZY+u+pfJxFXaDqbyZkBgwlsmJSApZEqGwbl8TXg3XKOyYkvqwVxA/SO94N/2SEEH7lin r52fw+KWcJtmG1plI+Nh+fOKdo9dSwHv18bIXaCSozrY6YvBicRNxE8lHVRedXHzx9B2331lF87H XtkB1vLi4H9iqNukS/EcU7I2bmK2Gg8g1BMgZysIUgRbwEbjQS5iXWpHek71nl8LtSoTAZ7CV7UR iTwh1nDzQkFBVYGPvfegTl+Dfqb5R4VemuUI6bcEARsm0BSzT3e/vErSojFNgZ+z2eBRGMCLmveJ Ez/K74eczsDjUYzyeeQlRL3BCK088rhJO2eupYYdzPm7YfRDaULOU2k3qaBFfCaFoX7lbNqfdmmz 2Fm01HXrVQ4RYy46tWH9VYjfMCvRZi/l0agnbmEWZxQ= X-Report-Abuse-To: spam@quarantine1.mailspamprotection.com Subject: Re: [dpdk-users] MLX ConnectX-4 Discarding packets X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" I ran more tests, This AMD server is a bit confusing, I can tune it to capture 28Mpps (64 bytes frame) from one single core, so I would assume that using one more core will at least increase a bit the capture capabilities, but it's not, 1% more speed and it drops regardless of how many queues are configured - I've not observed this situation on the Intel server, where adding more queues/cores scale to higher throughput. This issue have been verified now with both Mellanox and Intel (810 series, 100GbE) NICs. Anybody encountered anything similar? Thanks Il 9/10/21 3:34 PM, Filip Janiszewski ha scritto: > Hi, > > I've switched a 100Gbe MLX ConnectX-4 card from an Intel Xeon server to > an AMD EPYC server (running 75F3 CPU, 256GiB of RAM and PCIe4 lanes), > and using the same capture software we can't get any faster than 10Gbps, > when exceeding that speed regardless of the amount of queues configured > the rx_discards_phy counter starts to raise and packets are lost in huge > amounts. > > On the Xeon machine, I was able to get easily to 50Gbps with 4 queues. > > Is there any specific DPDK configuration that we might want to setup for > those AMD servers? The software is DPDK based so I wonder if some build > option is missing somewhere. > > What else I might want to look for to investigate this issue? > > Thanks > -- BR, Filip +48 666 369 823