From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id BC2B3A00C2; Thu, 23 Apr 2020 01:51:38 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 929B61C440; Thu, 23 Apr 2020 01:51:37 +0200 (CEST) Received: from sonic310-15.consmr.mail.bf2.yahoo.com (sonic310-15.consmr.mail.bf2.yahoo.com [74.6.135.125]) by dpdk.org (Postfix) with ESMTP id 5DEE51C2F9 for ; Thu, 23 Apr 2020 01:51:35 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1587599494; bh=cm8EEb+63HBZc/60Y9IT52X/SitAVp+GzjZu+4yxmvQ=; h=Date:From:To:In-Reply-To:References:Subject:From:Subject; b=sVtQe7gytxc7c1HJ4Z3VgQI5JmqlGyOlb51SMXuRBMPeVOfo1GrQ/PRlEK63nMm1DLuUDf+UKsz5+0FrrnVXwCh1eQDRA26NDZ20TmkuEyiSn0jGSbfSYL2lwX6/GYBlurNfbR0jZYC6XxuD9dSLN8eymmB5dGfi9qsg+6Iu8V6lz6/x9fML9Zvt2JKFgU01q/3Kni0jzCrnjdufK2/xKpr6y15VARZMbhZLklsIfCTlS86/HgmzX2ex5j+D64MDdXjQljQHNvLoWVVJYyFUim6qyKHa7pAEJ6/pJ+nEYKE0ajopMPgronQAu/pYHSvDx06YSjyHQVYiCvACCaBL1g== X-YMail-OSG: g9ybOS8VM1kR8ZkOcHDsWqUS65ZzdCDUtl31CezsDau.NySSVzMVytmB.iHsVMq gt9XBXMceTsOH7L0TzoIDuei0xv4OI.1eCRNE6wPReUOxEmwJnOkV7tPQCIdp2SgoVjaytV0osQ4 m3VdvvdWeYvuWjx8OZd.PAeEkJzqiVQUdxtMgKfV03LTQRSzUujSlsMSXg8bGIS9SvHdwS16N_.O Vk6P_gWLIbY6gJHP5myLSus5SCDYJ3sDtJmUPxPpK7M7r8IXAWg7Y_NjU.R0ekkHAR.wb8_Sdoe3 BBegPV__j5Iv5wB6UHV0xJ6JZvXFd9IUhiqaTwu3FJoxSAjDZ3_47WocJQMk9yaa4lgkqQbekPUx nJJYRDqMBPTHAG4Zgjghl8FJ8hI1Db2MIUrPnzxznrQ73DgYU4QBluHKNQwDnHVYCN_gre96Evpq OCThp2O1NX7htLiKQRivHkaeZ6jD0SON6TgWmnXYRk08PtdU0uFITnbHh2VNO47cMZw0dLpoSQIk 0sTtHRJIzjChFf51zGie_cmJeDwYzVrUNCiDSwMWcY5L6gdhplI44BlshSDlhxTLbd5pLj5F7EVb MKJW0D5s3AiPsvfVZJInj4EJeznNCEQogP1OhGbonJBS8ZZCVbozwFpqCppnRSbLaQU6wb451m9g OH9UCq.7YeyRG2a6abebvsm0F8S5n5D3f53Jtw8s.QJADI3R_gfCgnfcqFCxntPQ66ZmUXyznAuF 0AeI69XMOyWeXzAKFptTdkcidHnzBuSRQPwMsI5MKzQncNEpO.C5bpDuRl334kB..RqW.Uln8nkJ 2hlRSnZy2gcxKsxHmG9HEii9dymKQ56.pV9cEAbW.Pds_ijNogSJ67b2gEAEnC4d9bqPCNx1mnz8 BxR0TPEGtR239T7IIf6UL3i1tROeRcpCF0SGtrv1HEK1_VUwbBMWwdx.SY7M564vaAWpJ.x6MwYe GtOLfL5QbKomv_ZBS47o0i_2uxmVxTOtSbNolk.3R22CaxRrEMthZEur9QrupndTAXPqX9THhQSX gwzyDPWLiPFRG4neKs4YoEeWagxF.ojwZX_xglK3B767ccyiesPbsy.QXsr73u7rksGGLoC82sV. QHZ3ssE8aBTuENL0oxyL03kPzRymCfU7KEHoOPU5_Z2PNURzInNuNSFiWR.vYAeBwq9w7q.3Teoi 37WuREbz7I__qSPE_s9oix4cSLfRWSbGuWGpKW6JBGTUskNeM6saEPmIrWy7rpG.x_YSDe1zt1dR jvnHh.wEQ7.RSvt3Cj3sf1X5DJKA32dVTDIkWj4VLBphDzpMtPp7YsBLoLUNqt2jGywM7cspd9u9 3xqxKoedU Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.bf2.yahoo.com with HTTP; Wed, 22 Apr 2020 23:51:34 +0000 Date: Wed, 22 Apr 2020 23:51:32 +0000 (UTC) From: amit sehas To: "dev@dpdk.org" Message-ID: <106152608.25563.1587599492894@mail.yahoo.com> In-Reply-To: <356213701.35888.1587599111210@mail.yahoo.com> References: <356213701.35888.1587599111210.ref@mail.yahoo.com> <356213701.35888.1587599111210@mail.yahoo.com> MIME-Version: 1.0 X-Mailer: WebService/1.1.15756 YMailNorrin Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/70.0.3538.102 Safari/537.36 Edge/18.18363 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-dev] rte_pktmbuf_pool_create performance X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" It could also be that this is the function that is the most time consuming= :malloc_heap_alloc_on_heap_id() still looking, I suspect others have encountered such an issue and know wha= t the problem is ... On Wednesday, April 22, 2020, 04:45:11 PM PDT, amit= sehas wrote: =20 =20 I switched from utilizing dpdk 16.11.1 to dpdk 18.11.6, in the process I s= tarted utilizing --single-file-segments,previously I was utilizing a patch = for the same functionality on dpdk-16.11.1. And while linking I somehowneed= to link in -lnuma now which I previously did not need to. I don't know wha= t dependencies have beenintroduced by dpdk-18.11.6 but I can no longer buil= d my executables without linking in numa. That is the only notable change I made. And nothing else has changed, huge = pages, tlbs etc are all the same. yet the performance of=C2=A0rte_pktmbuf_pool_create() has completely tanked= , it has become much much slower.I am quite new to dpdk and am not sure wha= t is going on =E2=80=A6 so I went in with a debugger and this is whati find= : this function call is taking up all the time:=C2=A0 rte_mempool_populate_de= fault() which in turn invokes the following which is taking all the time:=C2=A0=C2= =A0 rte_memzone_reserve_aligned() which in turn invokes the following which is taking all the time:memzone_re= serve_aligned_thread_unsafe() which in turn invokes the following which is taking all the time:=C2=A0mall= oc_heap_alloc() which in turn invokes the following which is taking all the time:=C2=A0mall= oc_get_numa_socket() My guess is that somehow numa has started interfering with the performance,= but i am not quite sure what to do to fix it... any help is greatly appreciated, i suspect someone familiar with the above = should quickly identify the issue and its remedy... regards =20