From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 6AB5443CD0; Wed, 27 Mar 2024 15:55:50 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id DF20D402C0; Wed, 27 Mar 2024 15:55:49 +0100 (CET) Received: from mgamail.intel.com (mgamail.intel.com [192.198.163.14]) by mails.dpdk.org (Postfix) with ESMTP id D28D7402A3 for ; Wed, 27 Mar 2024 15:55:47 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1711551348; x=1743087348; h=date:from:to:cc:subject:message-id:references: in-reply-to:mime-version; bh=WIuOKxAkljX4DZYEM83OlivBbflX5abdTX2fdN7W7Zs=; b=PMo25XkY5uzQSHZAcwOj9HYGGKq3d8YgcnmXW5uZx8qjFFkG2mwWKiQk dyKnGEogHrC31VT9WHQON/PdUwPhh2vHX+9LnH7kKA1rBxUZuBgM2MIw3 Cm9vzIqgXuyLyG+BOeS/9DlZOtMTzMBuZMMUXpGKw0lbNh1vjOi0GjX41 olIFE6b4R3x4rojCV0xzDpEa+As2vxeutjOeHDSWAkHe0rRK7Qkcbp5LR M/DWv4g5TTDxU5BF2POUQ5roO/PAPYa+lYRospwMUiIPf77X/4IupdyEk xccFlYCDOIPF5CBzNbw3zjg8+lMHBkSUH3/TvL/p9ouhXeaUvPe79ILHm Q==; X-CSE-ConnectionGUID: T8VLqWhrQ3elWR6akn61HQ== X-CSE-MsgGUID: vjEDhAGNQ4eLsGotIUgkGA== X-IronPort-AV: E=McAfee;i="6600,9927,11026"; a="6868027" X-IronPort-AV: E=Sophos;i="6.07,159,1708416000"; d="scan'208";a="6868027" Received: from orviesa010.jf.intel.com ([10.64.159.150]) by fmvoesa108.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 Mar 2024 07:55:46 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="6.07,159,1708416000"; d="scan'208";a="16160146" Received: from fmsmsx601.amr.corp.intel.com ([10.18.126.81]) by orviesa010.jf.intel.com with ESMTP/TLS/AES256-GCM-SHA384; 27 Mar 2024 07:55:46 -0700 Received: from fmsmsx612.amr.corp.intel.com (10.18.126.92) by fmsmsx601.amr.corp.intel.com (10.18.126.81) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35; Wed, 27 Mar 2024 07:55:45 -0700 Received: from fmsedg601.ED.cps.intel.com (10.1.192.135) by fmsmsx612.amr.corp.intel.com (10.18.126.92) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.35 via Frontend Transport; Wed, 27 Mar 2024 07:55:45 -0700 Received: from NAM10-MW2-obe.outbound.protection.outlook.com (104.47.55.100) by edgegateway.intel.com (192.55.55.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.35; Wed, 27 Mar 2024 07:55:45 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UV9hXzEWWDcgouXnIOJy/36CzwAyoukz6KyiiNhsDapeocBItEgQt6KdgIbR8PU6xZDhxVOpEhhXowlJbtI8GrTWkUDeqmyq65yEZq8F3L/IGrAHMYVLRi4uvpNmRlcgJ9deQBmRkU7emqYn1bEJZBT/TYogUGeVw9T2l4t1IxUYAPvFYutZJkZdomDc4q1PyoKcc/O1ngYOfYJQfQOdfmY+A7zcnyzMiy3W84Ohjbbg9hN0Kh52wv9QI9Pd6K59qvj8NDMBZCXg78pD1ql0f1TyJiRuD1NpCu8OHB7F5DRwRWPCq9ZJBYuEQiVlbbcI77v3GbXk7aKkw3J59AM+3w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=u5s0M6pzHxRjOgFXg/rNne8wamxo3/sGrwLaFuAflMA=; b=MOKt7s9o5hMsB+15VKv8EOlkV7uo2clElbl5LayGa3dK1AvRoR0jxZ4eXq3ERRdiMeQ0nr9HSYfDz+x679VknHpau02CLqa8PZUEm6gVpas9SqVBbGJ+xM1reqMyGAsVbYuNPjS9JRx3SV0uPTTLSZMo1D9akHxMuvBcCjd54hgzwF77TWmSsAs6xqfgKiCD+xs+NOGghJ55lNfMrgC84fGwoEdL3QnvEonG4wg/qT2/OUwXlNuTWgvKbZSfqQvEAbuyi4fktLLwvSL0WYEqJepC8LTEn9YVlYniC/g4F/Iz1+dSr9OsnvzK9kDsmCOH8jej/QPETs5PzxJTfBbVEw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; Received: from DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) by MW6PR11MB8366.namprd11.prod.outlook.com (2603:10b6:303:24c::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7409.32; Wed, 27 Mar 2024 14:55:42 +0000 Received: from DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::487e:e20c:ad88:9c0f]) by DS0PR11MB7309.namprd11.prod.outlook.com ([fe80::487e:e20c:ad88:9c0f%7]) with mapi id 15.20.7409.031; Wed, 27 Mar 2024 14:55:40 +0000 Date: Wed, 27 Mar 2024 14:55:36 +0000 From: Bruce Richardson To: Avijit Pandey CC: "dev@dpdk.org" Subject: Re: Error in rte_eal_init() when multiple PODs over single node of K8 cluster Message-ID: References: Content-Type: text/plain; charset="us-ascii" Content-Disposition: inline In-Reply-To: X-ClientProxiedBy: DUZPR01CA0039.eurprd01.prod.exchangelabs.com (2603:10a6:10:468::17) To DS0PR11MB7309.namprd11.prod.outlook.com (2603:10b6:8:13e::17) MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: DS0PR11MB7309:EE_|MW6PR11MB8366:EE_ X-MS-Office365-Filtering-Correlation-Id: ec8b31cf-ade5-4e9c-0978-08dc4e6df834 X-LD-Processed: 46c98d88-e344-4ed4-8496-4ed7712e255d,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: LXoUaE5/g6VSBPyemnsVszFgW0kld6TOx+zJsJDqMvZmArANpPj2IfnBGKf06rtA0mrLfqxp+AQGEa9Cd9Pu5FuPfBeQU+ovvxjyIgo0sxhWIM463aGL1rXnz+Yq1/psWPQVNFc1WTK0l+ETfJ4fox6Qw8mzxBusju9fQeZaZXthe9mLDy7AnHQYiO7MBg4dqW4tbvYFjwNVPa4KUxxZFc8KKE1wJ6S/BpM6B0NY1u94XdqlN8HDstsHLjLVdtz4U5c3JS11BXIvXNFdUji8iO4NhQZfdTk09nsbudZvKRfXrmlIMB2Vy5Hk0OvM/Dt1E7no/HvliDkHBTEh60xi1hv82r92hu1C1BDuf5m0rMBO3yEoYhRuoAeGQdPyO+xMU9EOEhSTUXWPqD59GH9uH8ciGwmgicdv3gTO5V8n9oHaUTXf3Y66mbFSAnK3W4t7xHqXCPsC2Gw57lM2DeyC4nqMM5KiIr7sdUV96bpRMKvD906rXwaXPBiAXu8Bi/GA0zOCj/5YtGTz7kHaQaLo+0585at7lb2MwFNeshJxgzrR1d8tmH415+8BDLVwpjqdjoaiydy90fFqVUBYdv76qrz0a6xH4sJMtqS106QdjxAlh7Rx6V5eBXZaWOCn9tQpOybhhojt0BUNlDbA6BFqOYFq1SuMTnBeXZ+b2RuXQeE= X-Forefront-Antispam-Report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DS0PR11MB7309.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(366007)(1800799015)(376005); DIR:OUT; SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?B7OTi2UpjTuRJCDM3R0vnLUiyS0otM2D/y77sePo1lOtF6qzpySdp8FTjD12?= =?us-ascii?Q?SlnoBdHge+xrsqaWhZ++ZDFv9tkfa36H4FhLbsvj2W99cLOTta1J4PtD+xjx?= =?us-ascii?Q?tx+Kwg1D3VCks75VF1qVIKbHqIsnJchcWxTOgR9HzjNqO5uAbmLgMkfSJc+c?= =?us-ascii?Q?KJLAvS1q9LkNSCc/stDYF0DolTa3jmlxAHb4uHekXKH4Zz+DfYFgypCOqDGz?= =?us-ascii?Q?u3jIz1eEPc4N75U2T3NkZDcvge6+t/ZlYoZ6hpHQ/tyCsHGy6GLW38J4qi7T?= =?us-ascii?Q?JeJPkAC+dOSm4CybE52GPEGlbo48dYX9b/BMvRo6AJt1tExg7eLVXPquQPYR?= =?us-ascii?Q?BAx591QxoRM/LDoQcZwmiBaaWf5j/QQ7ZRpUwtTer4LHTwbuqm6aIWBN4A0b?= =?us-ascii?Q?fPiEX9uZdUYUBoFrPngZiXiROrohK4EjFL/0+S0dY6IEYQAZ3r6NOOSBQsNi?= =?us-ascii?Q?OwEqH1ont7btCo4jWce3kK3iI1xzoWl8ROeSANfNwNv0bd34chyxpDm75KMq?= =?us-ascii?Q?U57vEl5bsa3Lz2HauxN0LAXdDJLaFTfLjiICUYu6u+ulXhqE4pUwcEA5i1b/?= =?us-ascii?Q?+dnEm4nCRnJkF85ac7oFPtai77/1od1bWmehUXEJOlHbzfLXRtNw+B8SBeDw?= =?us-ascii?Q?mRN3TbWzAW+gRMZILI5euGGtGZk+okn8Uy4FUPlMSX0Vkjf0UNmS86ivrZR/?= =?us-ascii?Q?k9FLQONnpDgVltucSvvWuXExV76L0wWxYjGwc+TQ5bFTPiJkEYbx3XCG/LY8?= =?us-ascii?Q?ongu0vT+3LGHhO8aPqtNqYRORt7K5D3oviuHT7A3iUd2+SFoIovpyZuWJAcH?= =?us-ascii?Q?yhdhPt1QXQDUIFrqsofG1jJLROSn9KtDxUwUDAMOQB7vG/4wU0n7iGi0c6m9?= =?us-ascii?Q?mmhXaz8tCV2uVBhp72o868xomWYrCTb6PmyCXEdr4UPWa/+lpxcT/lbyGLvc?= =?us-ascii?Q?7RKF17tT71KxjVsxgulECIhdFfCWJyr5/YgLNFIRbVfW0vvDc9H+e8ogh1yj?= =?us-ascii?Q?ErMxrR5cMf2Gy3s7ZrIwr9jlflcieIJ+7u0m5lwYfjD2ncvlOLwJwraWRlm6?= =?us-ascii?Q?FtmrB5ZgxQdlFTZxycDZkKxLg/31KRbQlvv8IU5KsHaHL84RNKwihzm82Za+?= =?us-ascii?Q?Lyh3rJnaEvLmRp3oSFuJG0bEqOypps2OFj4EfBDN8YoD/RzvKqZZqrh5pF2U?= =?us-ascii?Q?j7T21JJtBmnU5El/9+CtIctGGKzsmKF+RhLjyAt3qi2nM5oFAOv1ajToPg+e?= =?us-ascii?Q?SPwxQaawn4gc+UENP2UBNc0cIf75Tkq1Gjy1vKZWjO41OJdBmOut+Tjp2/NK?= =?us-ascii?Q?C3zildVSmwrN5GkITgFIAuQ2CavR/x40X9rQM2JG1tK1SYZjSzcoblSoai1y?= =?us-ascii?Q?SCkece7SzgBAyjnMbpSQ2zX6EXBQD+ZXYuuxacqw06xh46twlnUfVqTOyPNY?= =?us-ascii?Q?VVLhzupuYjZL2rwMPWVdZOCmZt9C/B0XUIrs7F7szq8Mm/+ckgfZ+46uzOek?= =?us-ascii?Q?6kSX/rsCOmGcxL/yYNzJ8/9gwEOZ8nLt9HTbYCd+qdJLyWwTijZpyOXjtO12?= =?us-ascii?Q?10WeoqgVLh5SMAeDM9NRlv701dIxa9VkQxF9JaaU79ZPR2eiKffvsCaLOS/I?= =?us-ascii?Q?Mg=3D=3D?= X-MS-Exchange-CrossTenant-Network-Message-Id: ec8b31cf-ade5-4e9c-0978-08dc4e6df834 X-MS-Exchange-CrossTenant-AuthSource: DS0PR11MB7309.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 27 Mar 2024 14:55:40.3671 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: x5P+GeC+2yokzDb17cB9bGH+h0ms6w2tsdWuMxH6SOJymDKBtPQPDGFnqAv1Q2OrqItGhERSpLCJTjpF14A9ybgTdxb8pRmhuBzvaO9bZi8= X-MS-Exchange-Transport-CrossTenantHeadersStamped: MW6PR11MB8366 X-OriginatorOrg: intel.com X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org On Wed, Mar 27, 2024 at 12:42:55PM +0000, Avijit Pandey wrote: > Hello Devs, > > > I hope this email finds you well. > > I am reaching out to seek assistance regarding an issue I am facing in > DPDK within my Kubernetes cluster. > > > I have deployed a Kubernetes cluster v1.26.0, and I am currently > running network testing through DPPD-PRoX ([1]commit/02425932) using > DPDK (v22.11.0). I have deployed 3 pairs of PODs (3 server pods and 3 > client pods) on a single K8 node. The server generates and sends > traffic to the receiver pod. > > > During the automated testing, I encounter an error: "Error in > rte_eal_init()." This error occurs randomly, and I am unable to > determine the root cause. However, this issue does not occur when I use > a single pair of PODs (1 server pod and 1 client pod). The traffic is > sent and received through the sriov NICs. > > > With master core index 23, full core mask is 0x2800000 > > EAL command line: /opt/samplevnf/VNFs/DPPD-PROX/build/prox > -c0x2800000 --main-lcore=23 -n4 --allow 0000:86:04.6 > > error Error in rte_eal_init() > > Not sure what the problem is exactly, without a better error message. Can you manage to provide the EAL output in the failure case, perhaps using --log-level flag to up the log levels a bit higher if the error is not clear from the default output. Also, in case of running multiple instances of DPDK on a single system, I'd generally recommend passing --in-memory flag to each instance to avoid issues with conflicts over hugepage files. (This will disable support for DPDK multi-process operation, so don't use the flag if that is a feature you are using.) /Bruce PS: couple of other comments on your commandline that may be of interest, since it's a little longer than it needs to be :-) - We'd generally recommend, for clarity, using "-l" flag rather than "-c" for passing core masks. In your case "-c 0x2800000" should be equivalent to the more comprehensible "-l 23,25". - DPDK always uses the lowest core number as the main lcore, so in the example above --main-lcore=23 should be superfluous and can be omitted - For mempool creation, -n 4 is the default in DPDK if unsupecified, so again that flag can be dropped without impact, unless something specific in the app depends on it in some other way. - If you want to shorten your allow list a little, the "0000:" can be dropped from the PCI address. So "--allow 0000:86:04.6" can be "-a 86:04.6"