From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6146143FB8 for ; Sun, 5 May 2024 18:03:07 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id D28BD4028C; Sun, 5 May 2024 18:03:06 +0200 (CEST) Received: from mail-pg1-f174.google.com (mail-pg1-f174.google.com [209.85.215.174]) by mails.dpdk.org (Postfix) with ESMTP id 159F84025D for ; Sun, 5 May 2024 18:03:05 +0200 (CEST) Received: by mail-pg1-f174.google.com with SMTP id 41be03b00d2f7-5ff57410ebbso1016106a12.1 for ; Sun, 05 May 2024 09:03:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20230601.gappssmtp.com; s=20230601; t=1714924985; x=1715529785; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=jA1sS3D18MfL72M/h3MnYkFoJlTH67UJFBnkPZdTVt8=; b=uaDRmRfWuJZeoNSCg6ciC3U6J5qytkZ9bcD2cgaOoBQqPXZOhgeudG90eiaQzzZFQg E9JT56nU6rrxh9Nb2QYWqMLo1o8SR4mtgShr95fzAhje7+QJKoTPHOuEN+Yby1asxa/e mewCdgVwFwKU4LvP/EaF3LtJX0iASkz/V+Kzy/EXAM52iYnHixS14yxsq5UX7GZBcF6o 31vnosM0Hc8XKWHfIp+LNEGZyWwlNIKi0iQJHYGsqnXwgMceGcKW68S1+wipfRhAZOu0 VOAeXvBPyL1TvRWVk5qUqXxwfRoSkoHbdF5iI+fs2pvz2r/XcF0cik3xC6/6oCap6b8F h9fg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1714924985; x=1715529785; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=jA1sS3D18MfL72M/h3MnYkFoJlTH67UJFBnkPZdTVt8=; b=hju5Ve0yaEMvU/YFBGr09mx+BJKFoH3rMaY7cuBz9J2ono9mMR3ScXZLM9ypGnSO+Z xJhKvwkSeRnTeiasCxfPG6BQhMZUZG5E9V4cDo3Q2J3/ZpIizvmyeXC23Ccsl82tQRno hC6S/84S6qhJYPSk0vm+5KtoVWSh/ctX7T45QiPu4uJ2iVbde+vWflH0sT9rh8E3ntZx pfwZCw/jP7jPcFbHEfx8BasZbiiqKUt3fNsN+FHICyUvBlYOSbxBGoDZtSvlp6CJZIDq 10bBrrsgsPBAYruwXyVQ47d6shOtzkZMl6McTG2qt9s85LWsngAXKv4OVt0VlTO7V5dR csWg== X-Gm-Message-State: AOJu0Yx5kAN3RQjpG9IupoJb32xUSPRVAWvRxsAXZDHk8rPqj1dm/PQK ziPM6IyKuBeGFi+0siCgWGQUXb5eCXvtJ6NUcC2f/JhjORZnUJclcucRWgMT885oykb9soqaYYk 9TZM= X-Google-Smtp-Source: AGHT+IFKEis2oKt1APsHqlPhEScQEOqpIuOIHIJcP9w8C77T6T6sCAZiiw+tH7reNbX0ypL0CJiEYA== X-Received: by 2002:a05:6a00:c84:b0:6f3:ecdc:220e with SMTP id a4-20020a056a000c8400b006f3ecdc220emr8552947pfv.24.1714924984717; Sun, 05 May 2024 09:03:04 -0700 (PDT) Received: from hermes.local (204-195-96-226.wavecable.com. [204.195.96.226]) by smtp.gmail.com with ESMTPSA id n21-20020a634d55000000b0060d95a83e43sm6335399pgl.18.2024.05.05.09.02.58 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 05 May 2024 09:03:00 -0700 (PDT) Date: Sun, 5 May 2024 09:02:56 -0700 From: Stephen Hemminger To: Fuji Nafiul Cc: users@dpdk.org, dev@dpdk.org Subject: Re: High packet capturing rate in DPDK enabled port Message-ID: <20240505090256.5e2d916f@hermes.local> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Sun, 5 May 2024 13:09:42 +0600 Fuji Nafiul wrote: > I have a DPDK-enabled port (Linux server) that serves around 5,000-50,000 > concurrent calls, per packet size of 80 bytes to 200 bytes. so in peak > time, I require packet capture + file writing speed of around 1GByte/s or 8 > Gbit/sec (at least 0.5Gbyte/s is expected). dpdk official packet capture > example project "dpdk-dumpcap"'s documentation says it has a capability of > around 10MByte/s which is far less than required. I implemented a simple > packet capture and pcap writing code which was able to dump > around 5000-7000 concurrent call data where I used 1 core and 1 single ring > of size 4096, and this was all integrated into actual media code (didn't > use librte_pdump, simply copied to separate rte_ring after capturing > through rte_eth_rx_burst() and before sending through rte_eth_tx_burst() ). > I know I can launch this multiple cores and with multiple rings and so on > but is there any current project which already does this? > > I found a third-party project named "dpdkcap" which says it can support up > to 10Gbit/s. Has anyone used it and what's the review? > > Or, should I modify the "dpdk-dumpcap" project to my need to > implement multicore and multi-ring support so I can extend the capability? > Thanks in advance The limitations of high speed packet capture is more about speed of writing to disk. Doing single write per packet is part of the problem. Getting higher performance requires faster SSD, and using ioring API. I do not believe that dpdkcap is really supporting writing at 10 Gbit/sec only that it can capture data on a 10 Gbit/sec device.