From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A4779A0A03; Mon, 18 Jan 2021 09:32:24 +0100 (CET) Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3247F140D59; Mon, 18 Jan 2021 09:32:24 +0100 (CET) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [216.205.24.124]) by mails.dpdk.org (Postfix) with ESMTP id D5775140D24 for ; Mon, 18 Jan 2021 09:32:22 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1610958742; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=6OvAUb6oBrtrCf6JN/6JxrNKd8Rsaum4/vB3K4gEIQA=; b=B84ZVjCZbjoJ9LbG8qM5yyWHlTDFSH0a5BdGYgi0nPNzTrQsLtZ4kQUbNfQEX4oU6A14W5 p4e1xXO0bhayHk38o6aadGRRbwmVvvh1jFm0YetiDLyX49SYq46PNmsE0e14YlT+tWYFQ1 74jhJOP71rrrBXoqIQ/21CyCwARQggQ= Received: from mail-vk1-f200.google.com (mail-vk1-f200.google.com [209.85.221.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-503-nQGLqpj4PV66gt94IfQrdg-1; Mon, 18 Jan 2021 03:32:19 -0500 X-MC-Unique: nQGLqpj4PV66gt94IfQrdg-1 Received: by mail-vk1-f200.google.com with SMTP id p184so9068293vkd.18 for ; Mon, 18 Jan 2021 00:32:19 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=6OvAUb6oBrtrCf6JN/6JxrNKd8Rsaum4/vB3K4gEIQA=; b=XqH3PTFBQ4xPKO3cFVcF3OINFIfcp4cxol1+wjaCczeLfmCyJPKZq7SjRFZhAmD7t2 BknAt5g5MYPeWGHbMA5V8o1ii1v7N7sQlj9HWRp+FpP8RkElWMncP+Crqye+pH/s/r07 FG0PxHB2gZPfHDhXMY5mh7O9peXkNJr2wGZa1kQiLIYmWp0kOaIaAN3KZPO6xPEAnIB8 Sv0vU5SLY/6lxxBa0wOfmcc/Or8L4VoT24St3A7841nepD6yQq0RMbhGqE6hKAMHxW2n BRoqpuOJ1k6j1TAgE/Mp+gyXbr1cE4cN7OSwBTmRwudUZZKGDWi2m9brSb+1rY9ZlAC3 1cEQ== X-Gm-Message-State: AOAM531TqORyjruTnzHxGQ4sxm8jsxAI1k4BlFcN7lyjLrLcmPetcIIG 3NndbLYinhTX7WSxlenF3qZLcWU6N8WIBN9C99o0UwrZ441QyU7wuir6BH7yWxXU5pEFyARIKbR RDtJsFkDBf1+V2YXmFL4= X-Received: by 2002:a9f:2628:: with SMTP id 37mr15901960uag.87.1610958738701; Mon, 18 Jan 2021 00:32:18 -0800 (PST) X-Google-Smtp-Source: ABdhPJzj8Lfk9cZ/rSc7KgX3l9U6+LDhaBR1pWsevjJH2zp42dVxmVymhtADvv43OiCOin9bawZVtO4IYdi0iZR84PE= X-Received: by 2002:a9f:2628:: with SMTP id 37mr15901953uag.87.1610958738496; Mon, 18 Jan 2021 00:32:18 -0800 (PST) MIME-Version: 1.0 References: <20210116093859.3025-1-irusskikh@marvell.com> In-Reply-To: <20210116093859.3025-1-irusskikh@marvell.com> From: David Marchand Date: Mon, 18 Jan 2021 09:32:07 +0100 Message-ID: To: Igor Russkikh Cc: dev , Rasesh Mody , Devendra Singh Rawat , Ferruh Yigit , Wenzhuo Lu , Beilei Xing , Bernard Iremonger Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=dmarchan@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-dev] [PATCH] app/testpmd: tx pkt clones parameter in flowgen X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Sat, Jan 16, 2021 at 10:39 AM Igor Russkikh wrote: > > When testing high performance numbers, it is often that CPU performance > limits the max values device can reach (both in pps and in gbps) > > Here instead of recreating each packet separately, we use clones counter > to resend the same mbuf to the line multiple times. > > PMDs handle that transparently due to reference counting inside of mbuf. > > Reaching max PPS on small packet sizes helps here: > Some data from our 2 port x 50G device. Using 2*6 tx queues, 64b packets, > PowerEdge R7525, AMD EPYC 7452: > > ./build/app/dpdk-testpmd -l 32-63 -- --forward-mode=flowgen \ > --rxq=6 --txq=6 --disable-crc-strip --burst=512 \ > --flowgen-clones=0 --txd=4096 --stats-period=1 --txpkts=64 > > Gives ~46MPPS TX output: > > Tx-pps: 22926849 Tx-bps: 11738590176 > Tx-pps: 23642629 Tx-bps: 12105024112 > > Setting flowgen-clones to 512 pushes TX almost to our device > physical limit (68MPPS) using same 2*6 queues(cores): > > Tx-pps: 34357556 Tx-bps: 17591073696 > Tx-pps: 34353211 Tx-bps: 17588802640 > > Doing similar measurements per core, I see one core can do > 6.9MPPS (without clones) vs 11MPPS (with clones) > > Verified on Marvell qede and atlantic PMDs. Ubuntu 18.04 gcc complains: https://github.com/ovsrobot/dpdk/runs/1713302522?check_suite_focus=true#step:14:3097 Can you have a look? -- David Marchand