From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id A162A43D55; Wed, 27 Mar 2024 13:42:59 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 3B036402B2; Wed, 27 Mar 2024 13:42:59 +0100 (CET) Received: from EUR05-AM6-obe.outbound.protection.outlook.com (mail-am6eur05on2113.outbound.protection.outlook.com [40.107.22.113]) by mails.dpdk.org (Postfix) with ESMTP id CE391402A3 for ; Wed, 27 Mar 2024 13:42:57 +0100 (CET) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=RkephYLfnKRLK+J8UCml24sVNkTosPhA454qB+zYCP/430mRIIEKvX3REqHL/DsB0spWfX4CvaP+QgbkVis3mS38JxQF95YlJnuiBRljSc3Lvr5zHXEqxcaO+c1UEsTtel+alfK1b+QRd3Rj4vgh+1NzK2VH6wAfYPm58NKSvonDt0NvXMN+AvxtVmwzFzb4dWzT6VdDuY6xdVR4uRG+X7RdCWfMdUlJEs8sqrkmDc53L7puCwPDwkaJSEdeXinD8PG/rGa9F55+4ISng6rfvwZzK4g3AJIMEmAQoDvvOpDSWdUzBvpo9hRCTzVcYUln2JcWhX7IAiZwhPyb3OvOiQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Y80CYSViNzr0CSGYkipyTtDaCd2XEhEHXS9g33lkprM=; b=YdOqk2QZhM0SunfnSVEABCNoGFHpGJfjyA+KGVzm9f7b0mVBDQ1J2slE4kS8O8E7Yp489nDvCJG3b2MppM0k6v83l2ZzHYhsUBpwyWfgokLbeQgmPNYCm1lCkHdX5P/7pMkA8gR8jK0GA2mq49NetYlKlCr0eEAbdJLEwDvmsYST7A1FUlWSoGCiiN3wp3hl03AAFUJnn/2vCbLF7mphpUSZVNWEB2m0I7FoK6QytRzat1GJyD67viToa1wXBtgUzHpVHO70gzTU6G/wbziZuiRqXoVYEP2nVGDBX+P+vV1lbsQ74tmQHfRGHeW8Wawl+5nylyTQeBwEckGgyLxy1Q== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=voereir.com; dmarc=pass action=none header.from=voereir.com; dkim=pass header.d=voereir.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=voereir.onmicrosoft.com; s=selector2-voereir-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Y80CYSViNzr0CSGYkipyTtDaCd2XEhEHXS9g33lkprM=; b=uJFELtpmUSQW0RQNW2S00suhx5S8PbPh79EbrirmLalHUXsuT5mY8Bo3LIXVl6QW/x9+LcljglU0yxJnsaiMopWAryB3/XUr46Z+ilpee53ebKl2O4wiyG6nAEVqjriu96yzHo0aFmbN1/3BxM2jhu/sVUk9tacsW2FGUeaoQSI= Received: from AS8PR02MB6837.eurprd02.prod.outlook.com (2603:10a6:20b:257::19) by DU5PR02MB10516.eurprd02.prod.outlook.com (2603:10a6:10:51e::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7409.28; Wed, 27 Mar 2024 12:42:55 +0000 Received: from AS8PR02MB6837.eurprd02.prod.outlook.com ([fe80::c011:a01c:487:34bc]) by AS8PR02MB6837.eurprd02.prod.outlook.com ([fe80::c011:a01c:487:34bc%4]) with mapi id 15.20.7409.028; Wed, 27 Mar 2024 12:42:55 +0000 From: "Avijit Pandey" To: "dev@dpdk.org" Subject: Error in rte_eal_init() when multiple PODs over single node of K8 cluster Thread-Topic: Error in rte_eal_init() when multiple PODs over single node of K8 cluster Thread-Index: AQHagAH68ojGARUElUGZhFy20pvxfg== Date: Wed, 27 Mar 2024 12:42:55 +0000 Message-ID: Accept-Language: en-GB, en-IN, en-US Content-Language: en-IN X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=voereir.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: AS8PR02MB6837:EE_|DU5PR02MB10516:EE_ x-ms-office365-filtering-correlation-id: 9ce67e1f-09af-41ad-6433-08dc4e5b6ca2 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 8pWuvecGnjI9UaSuyo73L4Gcd6ATxIXslt5gJUFsRdBcifpAoie99ULqCsfOpXpH2tfq2vltdpvWzMDf6HG4ywHzehV7NGxesh54/qBmhgYfMNbqfmktvLwu3zs5vWYpWeEH9C5KwpWMeCkqyDCLUlysIvXVHSCU7QcdcZKjaTud9AKU7Z7KOdySQ5jBauYXbzulxCLlhsEryAk19Sv+ni5nstHwarVRXUQOp6TjhwR+mhlvxqpn5mtW+yLaXoOwGhfD6qQPFkyb9++0IQmbw6CjEa56iLPEBHUPk7lm8kniR9DwwPwUr/8sUq5zTYgjhZOSrWfPrGyH73yyMcY6kJmWH+8CgoVTQAZvSU96SuI4JzdXwUsrL6XXoBV/VhaUGerx13x2MyfM07GU2Zy9SU3bMhfLGFVPWG2GHSpaZDq8MCLHx4j/21KBsaVY2vlNLLiyOZfKjcbMReesoW1OxfVWykQcR0cV5slEy/br43D/GPtfyv0TaUMjA2kTmUeXTExwHMTCGClu/BjertosulmHZHt+YFwBvCzbdwOJI/VzzRjXEbuwLWts57B1NV41xL6UibcM2rdT8KDxtJTT9bTH8cpfqzP320YcaSgPHxQWSN6D0OJFGi+mAfDdDNkhV2geLHfqK+O/otrl535cx4MyNpWM385ofNc+NffvMBQ= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AS8PR02MB6837.eurprd02.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230031)(366007)(376005)(1800799015)(38070700009); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?SvoSVmh1o7r+uEOit9ldGVH+rsn5yV7GP5eP6ja3AowTiHIiio2C6eaDTJNj?= =?us-ascii?Q?1qtdx06628x0U/iYJGxwlzOILXHo9qQKnePMwZThF7oqCF6vl0K+2Ulq36VH?= =?us-ascii?Q?b/E9ezftdhIdwGNaYVCmjgs2HLIm8FuRaXG/kA+5RUvLp7TNXtDjQURrfLa5?= =?us-ascii?Q?kwToHs1aLoiHYVzXtP3/7/VDLBJseLspa5A2LpWVue4xmS7e/ZwXKMdMvj2+?= =?us-ascii?Q?0dtAaLEKu4Dhbrt+pLBXMMfcbq8Z5dkMPlWY95SeN6ZQtD7KcqGiaNvGWwy2?= =?us-ascii?Q?uQqj4cxZOvrRpDCVyvn9eCxEHrk9nAAStUq88Zx56JI9ZgfnlYfLO7xABKww?= =?us-ascii?Q?iJRjP1AQIHBadspr7W0tjI4eriDi2304pTkRcHW0mZT/+l7olD+ZH9eE0bmq?= =?us-ascii?Q?sa6wjviuRak2AhO7bqTrERP7HHrYIDGHTj8hX9779tGq1eWZl/mRw/xV8tPR?= =?us-ascii?Q?7D0qE9U7kw+HkWYgiqZxuFByA4pdxNsV7zpXdy9Xx9um9y3YJv6M5LcCGZnn?= =?us-ascii?Q?RMdrmaHO3STPhahgCBQHviy+UkD7fW3x+/f36cMMCocLvP8+1yOsAkpLZYW8?= =?us-ascii?Q?yVExz3hgyemO2XaW6s9X6hWB5mZqBjAzCf/AGNuRAJ/DNArVSD4s9hpDEPoj?= =?us-ascii?Q?XBReMjg4MACmM1KsNnQkuVMHkIqc53o6l+hT0p/SpQz9V/XKRgGlgfgsSBzC?= =?us-ascii?Q?AAiYXzmEPiOGbelWBlf6U6ATU6whlW1SMipsnxkLvnQRspPyVCOo/H2zcnEe?= =?us-ascii?Q?0iNAydz9kkIKlgXAlmG96YkHZjcE94zlSf2Z2b5RGVkrEMsXskQFUbB/Qhzm?= =?us-ascii?Q?V3hF57zCB5EXnPu3LMekW3OiJFrSQE/mfiZzDllk/iXEwZKWYMESDm19jIz5?= =?us-ascii?Q?iwhspAku1dMP/yEG6Mb/bXdI8S6HBe/Dz8OCtakC7iO3XYncAcw2xT+P5BIo?= =?us-ascii?Q?uH+QXIDpyNrjG3/gRyFZ/RAQgucPSC4biZmy2nd35wcynmw4lgwu/xFBECSr?= =?us-ascii?Q?Sh/ibgQbXkStuRgRRhO16MF4qhuJRz6WADMGLpEkkmV/Yz0tOJPkQp8WDj8v?= =?us-ascii?Q?1nhcO/CvrRIOgw7SN6Vr2Lw0aKwii77rfLIcBQHWvflpMtzYLxawLdwke8UV?= =?us-ascii?Q?5hicXgH+Ru3E0oh1mD4548ZX3ATzipctv3xweBtg+w+mCIk+MsOvl8qeQPDi?= =?us-ascii?Q?m/mDDM+Gd5YeNi4mD23rBz6JjpkzLquAqsrm8ci7/yTU4xVPAoms1Tkw2zDr?= =?us-ascii?Q?BwuFW8leMK4dFBruw44nnjIt/mk+focD/3/Cocj8U17U1BLydFQgwZhd9UMW?= =?us-ascii?Q?Iz1FJtsz/6Ql2mNjSDH9wFD6d6PE+8GoCSTv81pUDJxX38VeRRjzL8mnRSZY?= =?us-ascii?Q?qyqOv2BmZ26bfShKDfcJETz+9pga8dKGF1QKnupbmC2S282t51/EN8hdUwZ/?= =?us-ascii?Q?NULE3WEN9EpUihV3hXy5utBKHTzuEgGw6I0Qf8PUsXjE5R78yS8c1kHf2aLU?= =?us-ascii?Q?CRHdSdmhWePKbOMD5YXqqa+/tKlhGoq9FwuhUFSZE/JTlprS2z304882OMbH?= =?us-ascii?Q?SnWaN/VH1JVuECIwU3DJqmHBHWzFL/xuf3YxtsuxVuun6t8h0RsDODF+4pH6?= =?us-ascii?Q?GQ=3D=3D?= Content-Type: multipart/alternative; boundary="_000_AS8PR02MB68374A2E9CBB30E6FA700300CC342AS8PR02MB6837eurp_" MIME-Version: 1.0 X-OriginatorOrg: voereir.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: AS8PR02MB6837.eurprd02.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9ce67e1f-09af-41ad-6433-08dc4e5b6ca2 X-MS-Exchange-CrossTenant-originalarrivaltime: 27 Mar 2024 12:42:55.1249 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: c0332603-0945-429b-ba2e-ef89b4a710a3 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: JVE3dP85SNFA5A5vZtOoShd9WzWhMY6JgroIvsUPstwRuiXtQ+zrcBEeQA1XrU4YaBGglQI9noB9ioSNw/2mfQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU5PR02MB10516 X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org --_000_AS8PR02MB68374A2E9CBB30E6FA700300CC342AS8PR02MB6837eurp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello Devs, I hope this email finds you well. I am reaching out to seek assistance regarding an issue I am facing in DPDK= within my Kubernetes cluster. I have deployed a Kubernetes cluster v1.26.0, and I am currently running ne= twork testing through DPPD-PRoX (commit/02425932) using DPDK (v22.11.0). I have deployed 3 pairs o= f PODs (3 server pods and 3 client pods) on a single K8 node. The server ge= nerates and sends traffic to the receiver pod. During the automated testing, I encounter an error: "Error in rte_eal_init(= )." This error occurs randomly, and I am unable to determine the root cause= . However, this issue does not occur when I use a single pair of PODs (1 se= rver pod and 1 client pod). The traffic is sent and received through the sr= iov NICs. PFB the software catalogue I am using: DPPD-PRoX: commit/02425932 DPDK version: v22.11.0 DPDK driver: vfio-pci SRIOV VF driver: iavf POD OS: Ubuntu 20.04 POD Kernel: 4.18.0-372.9.1.el8.x86_64 Kubernetes: v1.26.0 Error logs: EAL: Detected CPU lcores: 104 EAL: Detected NUMA nodes: 2 EAL: Detected shared linkage of DPDK EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: Selected IOVA mode 'VA' EAL: VFIO support initialized EAL: Cannot allocate memzone list EAL: FATAL: Cannot init memzone EAL: Cannot init memzone Supports Intel RDT Monitoring capability RDT-A. Supports Intel RDT Allocation capability Supports L3 Cache Intel RDT Monitoring Intel RDT Monitoring has 207 maximum RMID Supports L3 occupancy monitoring Supports L3 Total bandwidth monitoring Supports L3 Local bandwidth monitoring L3 Cache Intel RDT Monitoring Capability has 207 maximum RMID Upscaling_factor =3D 106496 Supports L3 Cache Allocation Technology Supports MBA Allocation Technology Code and Data Prioritization Technology supported L3 Cache Allocation Technology Enumeration Highest COS number =3D 1= 5 L2 Cache Allocation Technology Enumeration COS number =3D 0 Memory Bandwidth Allocation Enumeration COS number =3D 7 =3D=3D=3D Parsing configuration file '/tmp/tmpwkvn651h.cfg' =3D=3D=3D *** Reading [lua] section *** *** Reading [variables] section *** *** Reading [eal options] section *** *** Reading [cache set #] sections *** *** Reading [port #] sections *** *** Reading [defaults] section *** *** Reading [global] section *** *** Reading [core #] sections *** =3D=3D=3D Setting up RTE EAL =3D=3D=3D Worker threads core mask is 0x2800000 With master core index 23, full core mask is 0x2800000 EAL command line: /opt/samplevnf/VNFs/DPPD-PROX/build/prox -c0x2800= 000 --main-lcore=3D23 -n4 --allow 0000:86:04.6 error Error in rte_eal_init() Any insights or guidance to help resolve this issue would be highly appreci= ated. If you need any more details, please feel free to ask. Thank you for your time and assistance! Best Regards, Avijit Pandey Cloud SME | VoerEirAB +919598570190 --_000_AS8PR02MB68374A2E9CBB30E6FA700300CC342AS8PR02MB6837eurp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hello Devs,

 

I hope this email finds you well.

I am reaching out to seek assistance regarding an is= sue I am facing in DPDK within my Kubernetes cluster.

 

I have deployed a Kubernetes cluster v1.26.0, and I = am currently running network testing through DPPD-PRoX (commit/02425932) using DPDK (v22.11.0). I have deployed 3 pairs of PODs (3 server pods and = 3 client pods) on a single K8 node. The server generates and sends traffic = to the receiver pod.

 

During the automated testing, I encounter an error: = "Error in rte_eal_init()." This error occurs randomly, and= I am unable to determine the root cause. However, this issue does not occu= r when I use a single pair of PODs (1 server pod and 1 client pod). The traffic is sent and received through the sriov = NICs.

 

PFB the software catalogue I am using:

DPPD-PRoX: commit/02425= 932

DPDK version: v22.11.0

DPDK driver: vfio-pci

SRIOV VF driver: iavf

POD OS: Ubuntu 20.04

POD Kernel: 4.18.0-372.= 9.1.el8.x86_64

Kubernetes: v1.26.0

 

Error logs:

 

EAL: Detecte= d CPU lcores: 104

EAL: Detecte= d NUMA nodes: 2

EAL: Detecte= d shared linkage of DPDK

EAL: Multi-p= rocess socket /var/run/dpdk/rte/mp_socket

EAL: Selecte= d IOVA mode 'VA'

EAL: VFIO su= pport initialized

EAL: Cannot = allocate memzone list

EAL: FATAL: = Cannot init memzone

EAL: Cannot = init memzone

Supports Int= el RDT Monitoring capability

  =       RDT-A. Supports Intel RDT Allocation capabil= ity

  =       Supports L3 Cache Intel RDT Monitoring<= /o:p>

  =       Intel RDT Monitoring has 207 maximum RMID

  =       Supports L3 occupancy monitoring<= /span>

  =       Supports L3 Total bandwidth monitoring<= /o:p>

  =       Supports L3 Local bandwidth monitoring<= /o:p>

  =       L3 Cache Intel RDT Monitoring Capability has= 207 maximum RMID

  =       Upscaling_factor =3D 106496

  =       Supports L3 Cache Allocation Technology=

  =       Supports MBA Allocation Technology

  =       Code and Data Prioritization Technology supp= orted

  =       L3 Cache Allocation Technology Enumeration H= ighest COS number =3D 15

  =       L2 Cache Allocation Technology Enumeration C= OS number =3D 0

  =       Memory Bandwidth Allocation Enumeration COS = number =3D 7

=3D=3D=3D Pa= rsing configuration file '/tmp/tmpwkvn651h.cfg' =3D=3D=3D=

  =       *** Reading [lua] section ***

  =       *** Reading [variables] section ***

  =       *** Reading [eal options] section ***

  =       *** Reading [cache set #] sections ***<= /o:p>

  =       *** Reading [port #] sections ***=

  =       *** Reading [defaults] section ***

  =       *** Reading [global] section ***<= /span>

  =       *** Reading [core #] sections ***=

=3D=3D=3D Se= tting up RTE EAL =3D=3D=3D

  =       Worker threads core mask is 0x2800000

  =       With master core index 23, full core mask is= 0x2800000

  =       EAL command line: /opt/samplevnf/VNFs/DPPD-P= ROX/build/prox -c0x2800000 --main-lcore=3D23 -n4 --allow 0000:86:04.6<= /o:p>

error  = Error in rte_eal_init()

 <= /o:p>

 

Any insights or guidance to help resolve this issue would be high= ly appreciated. If you need any more details, please feel free to ask.=

Thank you for your time and assistance!

 <= /o:p>

 

 

Best Regards,

Avijit Pandey
Cloud SME | VoerEirAB
+919598570190

 <= /o:p>

--_000_AS8PR02MB68374A2E9CBB30E6FA700300CC342AS8PR02MB6837eurp_--