From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from na01-by2-obe.outbound.protection.outlook.com (mail-by2on0096.outbound.protection.outlook.com [207.46.100.96]) by dpdk.org (Postfix) with ESMTP id 54C622C4D for ; Fri, 26 Feb 2016 12:55:27 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=SonusNetworks.onmicrosoft.com; s=selector1-sonusnet-com; h=From:To:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=gwMyYG559auR11ypovMrxJsojQQ8ly9sw6ozYZ7r6hE=; b=ZVbP6KGxtDm6L3WxCh7DraWQfrUy+QPmsBQHJH1CUqrbcHquU+vM1xVaMkTuxtn71/beSHwMyZvxQTlOLQhbrWp6CTruwC7ZF5GDG0iLx4DZDvRhUWRV+0tnMxs3diYmuwQfEEENe7SCw4zltW+4jtXfj6WRtZyaD3vI7+m52fQ= Received: from BY2PR0301MB1542.namprd03.prod.outlook.com (10.163.27.156) by BY2PR0301MB1542.namprd03.prod.outlook.com (10.163.27.156) with Microsoft SMTP Server (TLS) id 15.1.409.15; Fri, 26 Feb 2016 11:55:25 +0000 Received: from BY2PR0301MB1542.namprd03.prod.outlook.com ([10.163.27.156]) by BY2PR0301MB1542.namprd03.prod.outlook.com ([10.163.27.156]) with mapi id 15.01.0409.024; Fri, 26 Feb 2016 11:55:25 +0000 From: "Rapelly, Varun" To: "Ananyev, Konstantin" , "dev@dpdk.org" Thread-Topic: ACL memory allocation failures Thread-Index: AdFwf4kdB1whTVNNQG6hirscCjj/gAAANPTAAADEVXAAAf5KEA== Date: Fri, 26 Feb 2016 11:55:24 +0000 Message-ID: References: <2601191342CEEE43887BDE71AB97725836B0BA25@irsmsx105.ger.corp.intel.com> In-Reply-To: <2601191342CEEE43887BDE71AB97725836B0BA25@irsmsx105.ger.corp.intel.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=sonusnet.com; x-originating-ip: [121.242.142.135] x-ms-office365-filtering-correlation-id: 768ddd5d-1105-413d-4423-08d33ea3b682 x-microsoft-exchange-diagnostics: 1; BY2PR0301MB1542; 5:MbPf3Dsme17YGrEG5zamhXgffhFIaPtRAtSizhCqeBHNSkuuyVUb2G+g1COaVt2sIprNa+IPKOYBnJJP6hRvW0JThitOA+aj1II9Igg9ReXsxxV9jTXBHqkp7hmrLOxMVc7NHTH/ht9Wsj9xXekV1A==; 24:q1+jKFSH6WDSqURonRV2r8vRJp4sxrbwsDSA3AL0nFUjA83mkfUzLNord63tIzoIwXZI4G29mYSPVdXRDIbBvPykiZMef31a870G19pypQU= x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BY2PR0301MB1542; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046); SRVR:BY2PR0301MB1542; BCL:0; PCL:0; RULEID:; SRVR:BY2PR0301MB1542; x-forefront-prvs: 0864A36BBF x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(377454003)(13464003)(53754006)(24434003)(92566002)(15975445007)(99286002)(6116002)(74316001)(40100003)(3280700002)(77096005)(19580395003)(3480700003)(19580405001)(33656002)(2950100001)(5001770100001)(2501003)(3660700001)(2900100001)(5003600100002)(122556002)(10400500002)(15395725005)(54356999)(11100500001)(1096002)(76176999)(107886002)(5001960100002)(87936001)(3846002)(50986999)(102836003)(1220700001)(586003)(5004730100002)(5008740100001)(2906002)(76576001)(66066001)(86362001)(189998001); DIR:OUT; SFP:1101; SCL:1; SRVR:BY2PR0301MB1542; H:BY2PR0301MB1542.namprd03.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en; spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: sonusnet.com X-MS-Exchange-CrossTenant-originalarrivaltime: 26 Feb 2016 11:55:24.9766 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 29a671dc-ed7e-4a54-b1e5-8da1eb495dc3 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BY2PR0301MB1542 Subject: Re: [dpdk-dev] ACL memory allocation failures X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Feb 2016 11:55:27 -0000 Thanks Konstantin. Previous allocation error was coming with 1024 huge pages of 2 MB size.=20 After increasing the huge pages to 2048, I was able to add another ~140 rul= es [IPv4 rule data--> with src, dst IP address & port, next header ] more, = ie., 950 rules were added. Logically it did not increase number of rules [expected 2*817, but only 950= were added]. Is it really using huge pages memory only?=20 >>From the code it looks like heap memory. [ ret =3D malloc_heap_alloc(&mcfg-= >malloc_heaps[i], type, size, 0, align =3D=3D 0 ? 1 : align, 0) ] > -----Original Message----- > From: dev [mailto:dev-bounces@dpdk.org] On Behalf Of Rapelly, Varun > Sent: Friday, February 26, 2016 10:28 AM > To: dev@dpdk.org > Subject: Re: [dpdk-dev] ACL memory allocation failures >=20 > Hi All, >=20 > When I'm trying to configure some 5000+ ACL rules with different=20 > source IP addresses, getting ACL memory allocation failure. I'm using DPD= K 2.1. >=20 > [root@ACLISSUE log_2015_10_26_08_19_42]# vim np.log match nodes/bytes=20 > used: 816/104448 > total: 12940832 bytes > ACL: Build phase for ACL "ipv4_acl_table2": > memory consumed: 947913495 > ACL: trie 0: number of rules: 816 > ACL: allocation of 12966528 bytes on socket 0 for ipv4_acl_table1=20 > failed > ACL: Build phase for ACL "ipv4_acl_table1": > memory consumed: 947913495 > ACL: trie 0: number of rules: 817 > EAL: Error - exiting with code: 1 > Cause: Failed to build ACL trie >=20 > Again sourced the ACL config file. After adding around 77 again the same = error came. >=20 > total: 14912784 bytes > ACL: Build phase for ACL "ipv4_acl_table1": > memory consumed: 1040188260 > ACL: trie 0: number of rules: 893 > ACL: allocation of 14938480 bytes on socket 0 for ipv4_acl_table2=20 > failed You are running out of hugepages memory. > ACL: Build phase for ACL "ipv4_acl_table2": > memory consumed: 1040188260 > ACL: trie 0: number of rules: 894 > EAL: Error - exiting with code: 1 > Cause: Failed to build ACL trie >=20 > Where to increase the memory to avoid this issue? Refer to: http://dpdk.org/doc/guides/linux_gsg/sys_reqs.html#running-dpdk-application= s Section 2.3.2=20 Konstantin