From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 5CB64A00C2 for ; Thu, 23 Apr 2020 02:28:14 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id CA3FB1D181; Thu, 23 Apr 2020 02:28:13 +0200 (CEST) Received: from sonic317-27.consmr.mail.bf2.yahoo.com (sonic317-27.consmr.mail.bf2.yahoo.com [74.6.129.82]) by dpdk.org (Postfix) with ESMTP id 7B97B1D166 for ; Thu, 23 Apr 2020 02:28:11 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1587601690; bh=RuBT7X/9N59rpfjOIC+4YONt4o3+9sqRwZ5OH0obJI4=; h=Date:From:To:Subject:References:From:Subject; b=jqr+qDRNjKe9A4iuBWDPEKPMinwIF6Yy6tMTfUyzhzhSm+iyWx3cK0Pl5LL9B63Q/A8vG7/UP7AciBmYhh5lyQfWn5RL7WsMxODfkJDtM8QNjFXGbuaIPEHJN3B1131YVQG+y7YQ6naX7GxBw5hHPblphLngIAN6esw6sVzxMWo0v0O4vJIvP73I3RTe/2N0Wb5JVL5hg3BJJwxlFzmIH1LTUB9lk3z/+L5Ai7AkuCiu8SQK56j7drO34BTRanBo5+jhGLwq5cOhgGFfkGHxsTx4S5H816I4A/NLjI+keFUBZWLF8OzZEmOBvgMQYOQFnGWlVIPKw8Roz0LUASnsRw== X-YMail-OSG: t4zncWkVM1m1doPGcP_2OJstVkKvOPZDwedMqbNfOI5ZsUekqCMaYA1OaMwjjht l0CuhFzyd5jrJM9ACEeeqfuU6hNywGlVw4ia4c2wMU2j92GFJNvVvjqk7hR0sRAJhFq9pk8Q9ldP 70WlmRV7H0jPJXLR53D4rezXhez9uiNAuwfWU3iEwYfXc2lRJShMe10N37kvWNVG.BISZqgb_V.x HVuVp_lrJ7Xo4vBMgG4Nkjk8ujknQAOg2zFSV1kokJDMKroJOJ_5fVZ7CIVWb3MvskC0hEuxlZOx FLlU6J.Sy2ErAJaQHYz8y6ZrJv9UqrIeVdHGJdJiXQlz6fxcPrCUpZyhTTMqUQDKyZ9EhViEqpxG pMb8UHw0Sy.Nlbz5Bo._1KzGrDaPMUlJLfF42pR1zzpOBuLspymR8RJOg2j2Fr0V8M94DuX9CjZG PxW8zKwlZL17z0zuOAoEi1zV5YvMYSwshaqcJVeQEw4g7wao8n.2UngR5MKYj3h6PSkIGwGHn2fv 7sSSSL0F1Rq6mXUDlPoETOe66KPS9EGJBs8v9WUSJTSqg1P039ff9tfwCnicjqdk81EgPdP8ZuPk 8vbHNR7Ud7FFSx9.cQBvuVUfiLgTlX2mNgurjb7CroyDNShyh1t.t12rQDdJVC8NmttjNFRfSfc6 iHkC7t12zP0wMM5IiEye8LLIS9C0tdw3DMVwygyHzd6Pb3ZBu1tzUbFfOAULH5ZenjP6Sqbp_Pl4 Ae7YgxC2hA7ztazB9MOM4YSIrTU.tcaGW_ru_1Jgt1D7U1n9VbtzX2EhTZsz8Eo4MaDf0CqotSV1 GQQmYPVlM_8GewYDBbTWpHflxaKYR8QFUMESTnR_b6DfN8WsEtx6ChvedZqR.LQNzzkT4ruUdIC4 xDrGB6HXmBn9LTYRohx9n6GfaF3Ze2e5W2ywEgIU1U.A34HrV2vPVTiqADCRgNZ2ayC3ouqniUXe pnS5_dXSQ4cjhAdYwvkBzGY5N_7bfmuOxOh08OTOcWn4LhJUKubqLk01gumCDUGe4WB2Xj4cZeMs G5k9j8o3yB_WU4T_lSTlLjo5YefHsdx_eDctum9lqWT1VyP6nMjC.CvrSK030M_uq7OZp7o8Wj1J ZVn2xJV2pC86MLARHcVkACPu0RyNn4xq7uzHJSMrSaNvyry.ayE8UudEdE.ZNTzO0ZM0VX_43UiJ aS00A_CKbmr1vGQ3kkn.FDOLBf8PVJtLkLAceP5gWHnG77YjW_E9XU5KZyOQJiUXaAI84PWEopHl MD24gR6mN4SRL_a08NfMh2GGu7OWJE7oxsSaS_dqvW5.caEHn2yuTxtx8zhQmHrAx801IudN42pV OS0YNSQESAg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.bf2.yahoo.com with HTTP; Thu, 23 Apr 2020 00:28:10 +0000 Date: Thu, 23 Apr 2020 00:28:08 +0000 (UTC) From: amit sehas To: "users@dpdk.org" Message-ID: <1065727738.41362.1587601688678@mail.yahoo.com> MIME-Version: 1.0 References: <1065727738.41362.1587601688678.ref@mail.yahoo.com> X-Mailer: WebService/1.1.15756 YMailNorrin Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36 Edge/18.18363 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] rte_pktmbuf_pool_create() performance X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" I switched from utilizing dpdk 16.11.1 to dpdk 18.11.6, in the process I st= arted utilizing --single-file-segments,previously I was utilizing a patch f= or the same functionality on dpdk-16.11.1. And while linking I somehowneed = to link in -lnuma now which I previously did not need to. I don't know what= dependencies have beenintroduced by dpdk-18.11.6 but I can no longer build= my executables without linking in numa. That is the only notable change I made. And nothing else has changed, huge = pages, tlbs etc are all the same. yet the performance of=C2=A0rte_pktmbuf_pool_create() has completely tanked= , it has become much much slower.I am quite new to dpdk and am not sure wha= t is going on =E2=80=A6 so I went in with a debugger and this is whati find= : this function call is taking up all the time:=C2=A0 rte_mempool_populate_de= fault() which in turn invokes the following which is taking all the time:=C2=A0=C2= =A0 rte_memzone_reserve_aligned() which in turn invokes the following which is taking all the time:memzone_re= serve_aligned_thread_unsafe() which in turn invokes the following which is taking all the time:=C2=A0mall= oc_heap_alloc() which in turn invokes the following which is taking all the time:=C2=A0mall= oc_get_numa_socket() It could also be that this is the function that is the most time consuming:= malloc_heap_alloc_on_heap_id() My guess is that somehow numa has started interfering with the performance,= but i am not quite sure what to do to fix it... any help is greatly appreciated, i suspect someone familiar with the above = should quickly identify the issue and its remedy... regards