From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id F3346A0547 for ; Fri, 12 Feb 2021 21:38:06 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id A9DFB22A22B; Fri, 12 Feb 2021 21:38:04 +0100 (CET) Received: from smtp4.epfl.ch (smtp4.epfl.ch [128.178.224.219]) by mails.dpdk.org (Postfix) with ESMTP id D2FF6227F63 for ; Fri, 12 Feb 2021 21:38:02 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=epfl.ch; s=epfl; t=1613162282; h=From:To:Subject:Date:Message-ID:Content-Type:MIME-Version; bh=3eCUOxQGtafdjD5neCZQusQC8M5jJZ1IguslMTwpbUo=; b=revQNQJNXucBD3PQgFXpDANj4RWsjDiyhPJ7BPGf14SX6QDOQ+DtV7jVfWXVC7Yv/ dOIHyO8oJkgtx0VUcMWBQiGh5qHqck+7PymJ0TEUA1VVvOG0IDf128y8owuutTSCp kF9tFfJc2KjbY3qqLb9+ilA6q99B0EqH1j4RCoUJA= Received: (qmail 35567 invoked by uid 107); 12 Feb 2021 20:38:02 -0000 Received: from ax-snat-224-5.epfl.ch (HELO ewa01.intranet.epfl.ch) (192.168.224.5) (TLS, AES256-GCM-SHA384 cipher) by mail.epfl.ch (AngelmatoPhylax SMTP proxy) with ESMTPS; Fri, 12 Feb 2021 21:38:02 +0100 X-EPFL-Auth: ICfWmbDlS2vAlJ/S3yolsYg3oq82PBvrDk6hDCoVii+FtwdVhzc= Received: from ewa09.intranet.epfl.ch (128.178.224.180) by ewa01.intranet.epfl.ch (128.178.224.158) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2106.2; Fri, 12 Feb 2021 21:38:01 +0100 Received: from ewa09.intranet.epfl.ch ([fe80::201c:93cc:a768:eb31]) by ewa09.intranet.epfl.ch ([fe80::201c:93cc:a768:eb31%3]) with mapi id 15.01.2044.004; Fri, 12 Feb 2021 21:38:01 +0100 From: Yan Lei To: "users@dpdk.org" Thread-Topic: [ICE DPDK 20.11] Packet drops under low offered load & Not able to achieve line rate Thread-Index: AQHXAX6xSgsqsZmXkUGa8nWH0ZSDKA== Date: Fri, 12 Feb 2021 20:38:01 +0000 Message-ID: <232bb58db5024fe59f069e24ea6a16f8@epfl.ch> Accept-Language: en-US, fr-CH Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [128.179.254.241] MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 Subject: [dpdk-users] [ICE DPDK 20.11] Packet drops under low offered load & Not able to achieve line rate X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi, I am experimenting with the new Intel E810 100G NICs. I'm trying to reprodu= ce the performance results here https://fast.dpdk.org/doc/perf/DPDK_20_11_I= ntel_NIC_performance_report.pdf (test #5). But I kept seeing packet drops (= loss ratio ranging from 10^-7 to 10^-5) when the offered load is above 50Gb= ps regardless of packet size, which is not the case in the performance repo= rt. Another issue is that the DUT (using l3fwd/testpmd) can only achieve 95% of= the line rate even with high core counts and large packets (1518B). I used the same settings as in the performance report except for the follow= ing difference: CPU: E5 2697 v3 @2.6GHz RAM: 256GB 1866MHz (4 channels) OS: Ubuntu 18.04 LTS Kernel 4.15.0-generic Traffic generator: MoonGen with two Mellanox ConnectX-5 EN 100G NICs DDP: ice_comms-1.3.22.0.pkg The DUT with 4 cores can already handle ~70Gbps offered load with 10^-5 los= s when using 64B packets, which is close to the theoretical packet rate upp= er-bound of the NIC, so I am sure the CPU is not the bottleneck. Am I missing any setups for the NIC? I understand the NIC is fairly new, so= it would be nice if you could forward this to someone who is familiar with= it? Maybe someone from the Intel DPDK Validation team? Many thanks, Lei