From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9EF4445C16; Wed, 30 Oct 2024 16:59:03 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6CF3C40299; Wed, 30 Oct 2024 16:59:03 +0100 (CET) Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.11]) by mails.dpdk.org (Postfix) with ESMTP id 5F01740281 for ; Wed, 30 Oct 2024 16:59:01 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1730303942; x=1761839942; h=date:from:to:cc:subject:message-id:references: content-transfer-encoding:in-reply-to:mime-version; bh=mEH7A5RBRAnDaQDTZbwn43Z92FFNa7geQiw/h01N8hY=; b=Y/yfsZG8+w5BhiPNbaAiBDVIGlkFKNs/L26cnd46cbspmh1gaVgaZjtF BLGhm533cHL3azdbklEgKXpVXh8T3xWTOYH4ii2atetNGeHXR4c//cLgA f8O/E4xl46bVFBhGY2h3PbE1Pqdhn86eDXvt5YUZDtFaAzccU4Glt7Uej NQCfuFXRCqUPGyq/hUeShiNk6yYWtBnn3yAgHhp62+1tSkuw3g+weiW79 bd4kKgVpKRXvvdYRdYhabV1p0dwKoeh/kBpblx4vb91O+YY7+BTHVvwiS vWLUpECPVh1JNMDqhL5g9LH7nsxCwWqszLPqUDY5ph40Zq/6+C+5TGiWs w==; X-CSE-ConnectionGUID: N1YjntsiTie+Vi2GL0AV2w== X-CSE-MsgGUID: XYf69kvnTsaC7HyajjpU7A== X-IronPort-AV: E=McAfee;i="6700,10204,11241"; a="40584901" X-IronPort-AV: E=Sophos;i="6.11,245,1725346800"; d="scan'208";a="40584901" Received: from orviesa008.jf.intel.com ([10.64.159.148]) by fmvoesa105.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 30 Oct 2024 08:59:00 -0700 X-CSE-ConnectionGUID: zg5Zwzb1Rz+BRhwMPk+RRw== X-CSE-MsgGUID: BHPuS67SSZ+PMcQ78CB6pg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.11,245,1725346800"; d="scan'208";a="83167215" Received: from orsmsx602.amr.corp.intel.com ([10.22.229.15]) by orviesa008.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 30 Oct 2024 08:58:59 -0700 Received: from orsmsx601.amr.corp.intel.com (10.22.229.14) by ORSMSX602.amr.corp.intel.com (10.22.229.15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39; Wed, 30 Oct 2024 08:58:55 -0700 Received: from ORSEDG602.ED.cps.intel.com (10.7.248.7) by orsmsx601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.39 via Frontend Transport; Wed, 30 Oct 2024 08:58:55 -0700 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (104.47.56.175) by edgegateway.intel.com (134.134.137.103) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.39; Wed, 30 Oct 2024 08:58:55 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector10001; d=microsoft.com; cv=none; b=CBELp4GzuIDzYa/AO5Vr6yK4E7DKjGliLI7CnEbOJOVA1cjhIF1M0oLRxnRcxg+hWk1uQyuzEEq2P3jTn5S/0UUrvHKHYSGpeqNcPe5oiTtH7QjqJVd0OG+5Wb8CNcbrbCFthtMbmuAHYDizK9s7XwN410X/OdNSgCvSBKbGbLrx23i9grK/X10u1AGR3rzwt97hLGo7PdZ0rjKw/KGg32KWVhcrhQ5wkOka5uwtZWVQqWMRywgqYN8DD0KaMmAHID0V9pLo8tovd1E12UTClGgQqXQ9o9Vnhe5jIfs0dT5JWzU+JJi2fZg5G38WX836i4q7Tul9O1AvorVzHMcS9A== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector10001; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=hDpfha5NxwAP81TFsGqyFw/6E1HKX9bU83rXeGvnQEU=; b=zSdAg/aU9rMhlT/wu103oo+Ui9KB+BwWGaz4SVmoi8+FuCKLJDoh8RmjtkPpcQDWpUZyac4mgGibpewmBu8af7hRtSO50Cf2ohMY9TpTMtTAHysTvozGMMH3WaKag0zu8b5Z3WoqarlctrmETbxgT2gSETp4+FrmLm0OtcIx3Fn+NqD1t4Kz1h5GG8vMr9HaKkCutPEfuvY96O+lRHnJfi/Ho2wYsufVY3bmT6FMQIjudmPJ2w2Ci7YmIPoBCvBzXIkLJP2vTPHjH2W6Ycxh3jiT053GJV9ZsmOqOjvH39ACKT/rjMjEWggMPr5HsZ7lRnuGoUxoxBQh9ZlYVstlDQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by PH7PR11MB7986.namprd11.prod.outlook.com (2603:10b6:510:241::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.8093.27; Wed, 30 Oct 2024 15:58:52 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::f120:cc1f:d78d:ae9b]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::f120:cc1f:d78d:ae9b%4]) with mapi id 15.20.8093.018; Wed, 30 Oct 2024 15:58:52 +0000 Date: Wed, 30 Oct 2024 15:58:47 +0000 From: Bruce Richardson To: =?utf-8?B?THVrw6HFoSDFoGnFoW1pxaE=?= CC: Stephen Hemminger , Morten =?iso-8859-1?Q?Br=F8rup?= , , , Subject: Re: [PATCH] net: increase the maximum of RX/TX descriptors Message-ID: References: <20241029124832.224112-1-sismis@cesnet.cz> <98CBD80474FA8B44BF855DF32C47DC35E9F845@smartserver.smartshare.dk> <20241030082020.2fe8eadb@hermes.local> <75463f4f-4139-4a53-9e63-05fe4cccb74f@cesnet.cz> Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <75463f4f-4139-4a53-9e63-05fe4cccb74f@cesnet.cz> X-ClientProxiedBy: DU7PR01CA0010.eurprd01.prod.exchangelabs.com (2603:10a6:10:50f::23) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|PH7PR11MB7986:EE_ X-MS-Office365-Filtering-Correlation-Id: 4217e773-afdf-4682-0c50-08dcf8fbc02e X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0;ARA:13230040|376014|366016|1800799024; X-Microsoft-Antispam-Message-Info: =?utf-8?B?eGxuYmliY2dlS1ljcWhiM2lvdHdRWGVmMXRyQklkenVoaDN0dGpxcXhreTFa?= =?utf-8?B?bUJGdStLWjVWdkdoK2JhYkNSamc4UFc0Y2RjcU9DNTlGMDQ5M0RldUNpMXR4?= =?utf-8?B?ZStiRS9yNXFXcEYwT1I2MWc1Nlh6N0ZFT1VYd05saFZxenNHRmY1ZnRaQU5K?= =?utf-8?B?RTZJREpiTUk0aUpzM3NBQWxRKytFSkhwWFRkQlIySHJyNk5kZ2J6Rk1OSzNL?= =?utf-8?B?ODArQW1NNkJwMC8wM2xQV3RwTkMrdzBGNUNMMjBVTXBQbXhTd2lnY25EZm5a?= =?utf-8?B?V3FkclFXM05zNzBsVTg1WUNQZy9sMi8ybnBGYWQwUUxBQ2MrWU1hVkk3SkRz?= =?utf-8?B?dzF1RnZPTHNnMDROWjFMOGV1VEdvOUlqYmJMYjhYcUpzWWxnSWRGejFhMzdG?= =?utf-8?B?aktNRE9qckN3elJ1TUF1UFFPekh1Vy95NStoTU1MeTF3Y3BuWS9VZTNvdmFP?= =?utf-8?B?d2dIaGZ2MnBBU1JSR0s5aEREQ1M1N3JCQnNlak1ITm1UdU5GWVFBY2lYdGVs?= =?utf-8?B?ZXg3alQ2UE8wU2lIMmtoODhwOVlnYit6bTBtRFM0eTB1dlloRldYOU1SdEw2?= =?utf-8?B?N3pJL0ZRTHF1cmFwanZlWmxOVndNbWd1M2FTUUs4eVFBbkU2Q254elI2YjZz?= =?utf-8?B?ZzdYZ0pUdkJ3ZXZYaUkyUnRya3RnUkNhUmhvV0xuRDlCendYQi9DZGNsK3pM?= =?utf-8?B?TWY1T3NvZHVyTUtBd3Q0MTZhdy85MUtOWHZ5SENWWHYrVUVIcHRWb1hXUysv?= =?utf-8?B?cG5WMStJbW1zVnhNRWErK2ZjQXVDdS96Si9IbXk2TWFCbTRadE05a1dPMXg3?= =?utf-8?B?amZLVGVXZEt3NWhkbktXbHNtY3d4aVBwS0tUUVZhQjFKRG45ZUlJL1gxbEtq?= =?utf-8?B?b3hqemFCRFJud1dkZEMzbk9uSXJDZVBVMUtBSWM0dVQzUEp2Y01XdExQdHFE?= =?utf-8?B?VDR0NWhnVDFic3hOb1VYMXpJUElQSDFyVytVcTBBcUlmb2JtK0p1Mm9JMzNa?= =?utf-8?B?ZWVSVElTQnVvVUlYT0RzTGJSbEdNbFJ6YnZhVG14N001VDIvVnpJWFNTQW5i?= =?utf-8?B?REpXby85c2JJV1JPL0FuWDhSY0lIVXgzT1JBblBpenRXQm14L2RGTkxpZGtO?= =?utf-8?B?Z2dJOTl5VWo0NFFjT0hlSU1wS3JrSTFwY1oyeDh1cXdiemhnMmh3bXJ4UWM5?= =?utf-8?B?cG1kL25lbUlScDd1MHJKU2xEVFNGakdvMldMZ3VYUDJabjB2NmRZZHJNYnlH?= =?utf-8?B?NWNNdVBPWjJ0QjQ1S0JqcWdwWFRiUCtpSzVtLzdDODNodnRwMVl4d3R1MlVM?= =?utf-8?B?UzVTRG83eUl0c3pzZjNNT0ZMYkFVc2RrS2dIKy95WGJINW56bDgyYmdKcWI2?= =?utf-8?B?aUFJN2I4UGwxdWtKSStWTjh6NWJXNFRhYk5XZHcwbkdPc01Wd00rWHltMzhI?= =?utf-8?B?QXFES0E3ekNHT3hTNHM5Z0RBQnZEZS9VaVhkUlRQbGp6ODZUd2U1OGFpOG8r?= =?utf-8?B?d3c0b0hVb3N5bWk1dGZXRGZzTUZYMGFFelFlRTByRG9uRUlnUnZIOUhJcjg5?= =?utf-8?B?Vm90SnAyYS95MHM2UEdsejZJRVlBOGZMU0ZyN2Z1bGl4WTh5L3JoNEhIUUpQ?= =?utf-8?B?QjB3OHJMRUFSdlFBYmQwaGFNRExxZVMxY0pYaWk4VytJNFlwWDA0V0YxTlYy?= =?utf-8?Q?I8QLbqbrW0k4d9GwbD0G?= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230040)(376014)(366016)(1800799024); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?V01ZU1lUbE5wdjFrbWZYazFHQVFPUEJrNFhDUEo5RzBHN1JwN0lqZnhDYk1X?= =?utf-8?B?dy9uN3puVlMzbEozb0lPVnRqSUkzTzE1ZVFrb0dadUw3NG9wTjNnOE1HTUVq?= =?utf-8?B?aFNjSW5LY1BjL2xYQ3N1ZDZYRHJKRnZZKzVKckNmcythYjh4TzRNMEpPM3lz?= =?utf-8?B?V2RYMDBTSkE1RGpOTlZtTnhmZ2RUYjVGek9SV0hIV09uZkhwYVJQZUczc1BL?= =?utf-8?B?L0hBcXVZSmlkcTJPdTdCcnRnTVp0dllpa2EvR1M5blNOYlhqNTI1M2tGYWRW?= =?utf-8?B?MFpIZTBlYUh0eTV2ZTcwdlFYMVVHbER1MW5KQUlVUm9PWjZtYnVLdVhKTm5N?= =?utf-8?B?UTZ4RHdka240Z3cwTHYzcVo1czZIVUlQQ1VjMCtJMHhleStGbnNydHB2N004?= =?utf-8?B?eWIwZlozOWI5Zm5RUzVSSStFOFp3N0dQeE9aZDhXdU1BUC9SSnJkb0FETFNR?= =?utf-8?B?V3Y0amEzM09pRnpuOG1CQlA4c0ZaWTloMi83OFNXN21CeFFxdU85RzdDSW5y?= =?utf-8?B?VjhnNFd3cEZQMXViU3pNNmprRG5NcXhZUXhpSEVMZGNDNkdsTS8zWUNNbGJ5?= =?utf-8?B?M1gyc0JIbkF1UTJTR1hNVTZvMGpMeFdGdllKVXRrdDkzS1NFZWo1QUx0MkRs?= =?utf-8?B?UnZ0K0NuTFl2Z1dRbk1RTDRvdjRDdUxhck9TMGVCMUN1aTgrS2hwb25DeXhn?= =?utf-8?B?eHZjVUl6eEhrT1FaU3RxM1ZaMS9PYjltZWczcFVqRVFpcUFrWTArSTlmbU1p?= =?utf-8?B?c0llWDRDK0pFKyt4ZnFNZ0I3TEMzUlZkelVCQ1hidTJmdlpvZFVnWlM3VTJp?= =?utf-8?B?bG0zQ1ZvVFZVNkRKRXh2R0tzYklkMGZpY0daNmxmMWZQREZ4eTFjT2MvcDdX?= =?utf-8?B?aTVNSHZlMy9iT2trNysrSnlNTmV3STVrSjNVaG1FTDNFVUdpZHRFQTZ2M3RK?= =?utf-8?B?dXVyVlkzQ0t6ZUVBekpEbTlNd2hzZnVDc2c3OUNQNC81Mmk2ditrL3l6OG01?= =?utf-8?B?WDJqZU8xTUVDaDNZOW1vUmJIeENzbjBzNTdQZHV4ZUxPVnI5cURyanlIeHZ3?= =?utf-8?B?VkZCWENqTllTbWhRdjFTSHB0bEVpdVkzcENXZ05QcVh0L0Z5dXZEVDlXTko4?= =?utf-8?B?VnFESmoyTXZidlV6N0FzSVpCbmRVMFNpa1lmUUs3NXhiUVFvNFBNQVZ6cGYv?= =?utf-8?B?cUlkS3E0WGdNMFhCaXo5UEZLMEd5VWZLY01jZFVIckZVYlVqUFViZlAxbE9z?= =?utf-8?B?Sm5mZUE0STdtSVZncHRxNnNQQXJwTER1a1FmMEo4ZWlVY2ZSTDk3bE1ZTHJG?= =?utf-8?B?dzh1QTVPMHQ3TFpKZEZEdC82UE5rOVF1NGVLTzZkUU9vLzd4cnZvMGlrZFgz?= =?utf-8?B?bzdYU2lONW5XNHcvKzdRc3paTDlWZmFrcFZMREZmZ3ZqY1luV2FtZFRaQ3lZ?= =?utf-8?B?SkFxNkFFMmFBOTUwZUROU0N6dERxakZPOGVBNlNESXM0dER2NVIwRkF2bm9B?= =?utf-8?B?REFQbkJZbHMxNlEvb2R0Y0NCMDVXYmR2cnFLMVlOY1JHT3p3VVhWY3p0UTNz?= =?utf-8?B?N1BKZUo1Rjk0V0JSc1h5UXpxSExmUTZkWUMyeFpCWU1ZdnVybldVKzBGTEdq?= =?utf-8?B?VGlMK0xwbHl0Z0UvNjlzeGd0eWt4ZllBaHF4azdXMlJiYTZ6VTYzaWhSWHcr?= =?utf-8?B?VnRnS1RhenNOVmFmZExEV0NpSUM2MW5Ianc2cWJxZWk1M3NRTll5RElUMEpJ?= =?utf-8?B?bEgxSkQ0WE85ZnpBTjFDc2ZBZUllbEhTbHJxVlRLREFGWWlFYlo5c1BVMmVF?= =?utf-8?B?ME9kSS84bXhUeFh6YUh4NXZjWW4rQkxLdEw5QWZRYzVTeUxNNEFGUTgyakNU?= =?utf-8?B?WmF5aDZEM01kSWZLVlZDY1pqdHNxWVY2TlkyeHpUeUY2aTRrVllLL2RLdEx2?= =?utf-8?B?Qll3UlNMRHNNcnBOdHpjL0RnWnBYaXM1VU9OSGROVTJEWUczSnY3QVRiMWk0?= =?utf-8?B?M1ZSa0o4MElmQ0VsZi85Y1p0OHo4dEJEbzNmdDNGME1CdS9USytRcFlUdXhC?= =?utf-8?B?UTBRUStNM3V0LytLbGUyOTZSdHlXNlJ0TmlwQkhnK0ZRLzFXWW92WnRKZ3Jx?= =?utf-8?B?YlB3clNJZ1k0b3JJVEdib3E2Z203NTRZRS8yMkZRV3RzempiMjhJdXBqcU9v?= =?utf-8?B?enc9PQ==?= X-MS-Exchange-CrossTenant-Network-Message-Id: 4217e773-afdf-4682-0c50-08dcf8fbc02e X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 30 Oct 2024 15:58:52.7339 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: n1AJJiJwlUidjhgjcnyBnNE0o/nIg7rYo0XiUJI1hVaJNCIpv/bjwWtSpafO5McI/BpWQXq9HBxxKhb2eZzx/0E3VDrOGBfNmqsClo7jJQA= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH7PR11MB7986 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Wed, Oct 30, 2024 at 04:40:10PM +0100, Lukáš Šišmiš wrote: > > On 30. 10. 24 16:20, Stephen Hemminger wrote: > > On Wed, 30 Oct 2024 14:58:40 +0100 > > Lukáš Šišmiš wrote: > > > > > On 29. 10. 24 15:37, Morten Brørup wrote: > > > > > From: Lukas Sismis [mailto:sismis@cesnet.cz] > > > > > Sent: Tuesday, 29 October 2024 13.49 > > > > > > > > > > Intel PMDs are capped by default to only 4096 RX/TX descriptors. > > > > > This can be limiting for applications requiring a bigger buffer > > > > > capabilities. The cap prevented the applications to configure > > > > > more descriptors. By bufferring more packets with RX/TX > > > > > descriptors, the applications can better handle the processing > > > > > peaks. > > > > > > > > > > Signed-off-by: Lukas Sismis > > > > > --- > > > > Seems like a good idea. > > > > > > > > Have the max number of descriptors been checked with the datasheets for all the affected NIC chips? > > > I was hoping to get some feedback on this from the Intel folks. > > > > > > But it seems like I can change it only for ixgbe (82599) to 32k > > > (possibly to 64k - 8), others - ice (E810) and i40e (X710) are capped at > > > 8k - 32. > > > > > > I neither have any experience with other drivers nor I have them > > > available to test so I will let it be in the follow-up version of this > > > patch. > > > > > > Lukas > > > > > Having large number of descriptors especially at lower speeds will > > increase buffer bloat. For real life applications, do not want increase > > latency more than 1ms. > > > > 10 Gbps has 7.62Gbps of effective bandwidth due to overhead. > > Rate for 1500 MTU is 7.62Gbs / (1500 * 8) = 635 K pps (i.e 1.5 us per packet) > > A ring of 4096 descriptors can take 6 ms for full size packets. > > > > Be careful, optimizing for 64 byte benchmarks can be disaster in real world. > > > Thanks for the info Stephen, however I am not trying to optimize for 64 byte > benchmarks. The work has been initiated by an IO problem and Intel NICs. > Suricata IDS worker (1 core per queue) received a burst of packets and then > sequentially processes them one by one. Well it seems like having a 4k > buffers it seems to not be enough. NVIDIA NICs allow e.g. 32k descriptors > and it works fine. In the end it worked fine when ixgbe descriptors were > increased as well. I am not sure why AF-Packet can handle this much better > than DPDK, AFP doesn't have crazy high number of descriptors configured <= > 4096, yet it works better. At the moment I assume there is an internal > buffering in the kernel which allows to handle processing spikes. > > To give more context here is the forum discussion - https://forum.suricata.io/t/high-packet-drop-rate-with-dpdk-compared-to-af-packet-in-suricata-7-0-7/4896 > Thanks for the context, and it is an interesting discussion. One small suggestion, which I sadly don't think it will help with your problem specifically, but I suspect that you don't need both Rx and Tx queues to be that big. Given that the traffic going out is not going to be greater than the traffic rate coming in, you shouldn't need much buffering, on the Tx side. Therefore, even if you increase the Rx buffers to 32k, I'd suggest using only 1k or 512 Tx ring slots and see how it goes. That will give you better performance due to a reduced memory buffer footprint. Any packets buffers transmitted will remain in the NIC ring until SW wraps all the way around the ring, meaning a 4k Tx ring will likely always hold 4k-64 buffers in it, and similarly a 32k Tx ring will increase your active buffer count (and hence app cache footprint) by 32k-64. /Bruce