From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from userp2130.oracle.com (userp2130.oracle.com [156.151.31.86]) by dpdk.org (Postfix) with ESMTP id 570825A6A for ; Wed, 27 Feb 2019 14:57:16 +0100 (CET) Received: from pps.filterd (userp2130.oracle.com [127.0.0.1]) by userp2130.oracle.com (8.16.0.27/8.16.0.27) with SMTP id x1RDn82p085245; Wed, 27 Feb 2019 13:57:15 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=oracle.com; h=mime-version : message-id : date : from : sender : to : cc : subject : references : in-reply-to : content-type : content-transfer-encoding; s=corp-2018-07-02; bh=ni/DIpqc65DVu+iFOtgK6LRv/yd90n4SJ6yBjKnuYXQ=; b=tMM2yvSx0Ijwo/SgTMs2mHEf2mn4XNATmQy4ai1uKolNoXEVqLm0uj2E0k3bquGbaTEI aCoAqRD3VSxdipdXcL2tWMMPsVdesAFnbaqa7VmQXg44TRdp3o+dX/DUKHH5/I0TxLv8 t0mzBunZEZK9X7Wajl2B+fUwJ105dv2f16GvXRFZDm/miUmsgBgcUHVJRU23cbBK0HDV C/9k+Q9+lxXCsnisiH0oB/7bzcVnefXhZPnlcZ2IZmRRW1UlUWOJUDJjjIJA5zy/dmFj i50k8WkiG24u2IE7B/1s5CYJTWpEpraX221TQl9W4FAVnM5PiAyJcBbVB0dvibjFX64p /g== Received: from aserv0022.oracle.com (aserv0022.oracle.com [141.146.126.234]) by userp2130.oracle.com with ESMTP id 2qtwkuayqg-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 27 Feb 2019 13:57:14 +0000 Received: from userv0121.oracle.com (userv0121.oracle.com [156.151.31.72]) by aserv0022.oracle.com (8.14.4/8.14.4) with ESMTP id x1RDv8bE013322 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 27 Feb 2019 13:57:09 GMT Received: from abhmp0009.oracle.com (abhmp0009.oracle.com [141.146.116.15]) by userv0121.oracle.com (8.14.4/8.13.8) with ESMTP id x1RDv8U2004402; Wed, 27 Feb 2019 13:57:08 GMT MIME-Version: 1.0 Message-ID: Date: Wed, 27 Feb 2019 05:57:07 -0800 (PST) From: Iain Barker Sender: Iain Barker To: "Burakov, Anatoly" , "Wiles, Keith" Cc: dev@dpdk.org, Edwin Leung References: <631579E3-02F5-4E12-8BE6-DDAC0AE2E4A7@oracle.com> <549A6EB0-6E19-460D-9BE5-52AA40003AF0@intel.com> <345EDE69-C416-405F-B88C-04EE8384D20F@oracle.com> <896AF59A-4CCF-42FE-B2D7-160C69427DD2@intel.com> <2b3d84de-f0a5-4b38-f670-6318725821ab@intel.com> In-Reply-To: <2b3d84de-f0a5-4b38-f670-6318725821ab@intel.com> X-Priority: 3 X-Mailer: Oracle Beehive Extensions for Outlook 2.0.1.9.1 (1003210) [OL 15.0.5111.0 (x86)] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Proofpoint-Virus-Version: vendor=nai engine=5900 definitions=9179 signatures=668685 X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1810050000 definitions=main-1902270093 Subject: Re: [dpdk-dev] Question about DPDK hugepage fd change X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Feb 2019 13:57:16 -0000 Original Message from: Burakov, Anatoly [mailto:anatoly.burakov@intel.com]= =20 >I just realized that, unless you're using --legacy-mem switch, one other= =20 >way to alleviate the issue would be to use --single-file-segments=20 >option. This will still store the fd's, however it will only do so per=20 >memseg list, not per page. So, instead of 1000's of fd's with 2MB pages,= =20 >you'd end up with under 10. Hope this helps! Hi Anatoly, Thanks for the update and suggestion. We did try using --single-file-segmen= ts previously. Although it lowers the amount of fd's allocated for tracking= the segments as you noted, there is still a problem. It seems that a .lock file is created for each huge page, not for each segm= ent. So with 2MB pages the glibc limit of 1024 fd's is still exhausted quic= kly if there is ~2GB of 2MB huge pages. Edwin can provide more details from his testing. In our case much sooner, a= s we already use >500 fd's for the application, just 1GB of 2MB huge pages = is enough to hit the fd limit due to the .lock files. Thanks.