From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A83B8A034F for ; Sat, 11 Sep 2021 12:20:04 +0200 (CEST) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 2B5A340042; Sat, 11 Sep 2021 12:20:04 +0200 (CEST) Received: from mail-wm1-f54.google.com (mail-wm1-f54.google.com [209.85.128.54]) by mails.dpdk.org (Postfix) with ESMTP id 8647540041 for ; Sat, 11 Sep 2021 12:20:02 +0200 (CEST) Received: by mail-wm1-f54.google.com with SMTP id b21-20020a1c8015000000b003049690d882so365396wmd.5 for ; Sat, 11 Sep 2021 03:20:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=content-transfer-encoding:from:mime-version:subject:date:message-id :references:cc:in-reply-to:to; bh=oAAiv7OzBgg9MLEsiN4Wta5OgA//DZFqTh0t5CAUmmI=; b=O4tokWyfFC069UDv1uVc56NLCL8sF5kCI0VGWUDre16h0L7cszdB2JXSbvKj3HwZVd FUQCu/ZDAzFVHi7o+qAzb8Dc2yHClJaV62vf8rA1ymRfGkL89SeKbRK7mSc0olQXpNRn p9u8PjFHndkPq8piYpMYVsHXk2VT7GidoBgV+OQPgE8Lp9DcW3LtQ+LfgbmZ60knKtmG lMYjNtByVoMU9G1uvtlyhTDOheJUzNQ7TgibOjHVyQ3qWGJusw95s0LnJsm6NNUrWfws A2UPNIkZMtv9CQXN02xmoGkYCwBeoon2ItJoHZ5IbACd5YksHSGQ7OCaDX80WpjFnRVZ sxpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:content-transfer-encoding:from:mime-version :subject:date:message-id:references:cc:in-reply-to:to; bh=oAAiv7OzBgg9MLEsiN4Wta5OgA//DZFqTh0t5CAUmmI=; b=4b81FUP7moQGdw7s0OKH/ku4VTVKaEhr9FBIZrPt8Kzy5dKUhQ12MtISZE3IjLUJHm SVIFoJqxR2u0WORkfBfKoOTcqkprEtdqIGgpWTNT6UFuC2XeeN3VIdpcoe4rSJck/EuG szCJYeKM9ZvWpfuOJGK1jdVRM3CXYxSHYlsMw0V7tryR/RPKYNFtfyeou9b/F39corJi iXqnQcCbNVMSe6jvKnRI8L+AojkZxosw/Rw3JXXKHh7QhoHDuah1EZnz9UIDRw2eNVc2 8gvViylsGxoqsQtA6+dywZMZDKQkM3jSTA3HoeF3+deEYfjW57Xaffs8IVmJ5hxqvhAv aVOQ== X-Gm-Message-State: AOAM5314lbn3qdmWlpqvLIUkkANqYOx7sS6VCh1ixtJJjTocrpTA47BT gXunjx6uB74y8M6AEewt0dGvcc748UQ= X-Google-Smtp-Source: ABdhPJy3s5gVQ1vj+5ux9ANjHiMMQ6JLwnTACS/X59XbrHX33JTtpU3mIIkDepJbQ5YGyWAIX34hQA== X-Received: by 2002:a05:600c:3502:: with SMTP id h2mr2181222wmq.182.1631355602292; Sat, 11 Sep 2021 03:20:02 -0700 (PDT) Received: from smtpclient.apple ([109.104.39.177]) by smtp.gmail.com with ESMTPSA id j14sm1286685wrp.21.2021.09.11.03.20.01 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 11 Sep 2021 03:20:01 -0700 (PDT) From: Steffen Weise Mime-Version: 1.0 (1.0) Date: Sat, 11 Sep 2021 12:20:00 +0200 Message-Id: References: <57ab0193-689d-55b9-6f8c-dc23682e7c06@filipjaniszewski.com> Cc: users@dpdk.org In-Reply-To: <57ab0193-689d-55b9-6f8c-dc23682e7c06@filipjaniszewski.com> To: Filip Janiszewski X-Mailer: iPhone Mail (18G82) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: Re: [dpdk-users] MLX ConnectX-4 Discarding packets X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi Filip, i have not seen the same issues. Are you aware of this tuning guide? I applied it and had no issues with inte= l 100G NIC. HPC Tuning Guide for AMD EPYC Processors http://developer.amd.com/wp-content/resources/56420.pdf Hope it helps. Cheers, Steffen Weise > Am 11.09.2021 um 10:56 schrieb Filip Janiszewski : >=20 > =EF=BB=BFI ran more tests, >=20 > This AMD server is a bit confusing, I can tune it to capture 28Mpps (64 > bytes frame) from one single core, so I would assume that using one more > core will at least increase a bit the capture capabilities, but it's > not, 1% more speed and it drops regardless of how many queues are > configured - I've not observed this situation on the Intel server, where > adding more queues/cores scale to higher throughput. >=20 > This issue have been verified now with both Mellanox and Intel (810 > series, 100GbE) NICs. >=20 > Anybody encountered anything similar? >=20 > Thanks >=20 > Il 9/10/21 3:34 PM, Filip Janiszewski ha scritto: >> Hi, >>=20 >> I've switched a 100Gbe MLX ConnectX-4 card from an Intel Xeon server to >> an AMD EPYC server (running 75F3 CPU, 256GiB of RAM and PCIe4 lanes), >> and using the same capture software we can't get any faster than 10Gbps, >> when exceeding that speed regardless of the amount of queues configured >> the rx_discards_phy counter starts to raise and packets are lost in huge >> amounts. >>=20 >> On the Xeon machine, I was able to get easily to 50Gbps with 4 queues. >>=20 >> Is there any specific DPDK configuration that we might want to setup for >> those AMD servers? The software is DPDK based so I wonder if some build >> option is missing somewhere. >>=20 >> What else I might want to look for to investigate this issue? >>=20 >> Thanks >>=20 >=20 > --=20 > BR, Filip > +48 666 369 823