From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 26F704253A for ; Thu, 7 Sep 2023 23:33:24 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 9D1DC4026C; Thu, 7 Sep 2023 23:33:23 +0200 (CEST) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) by mails.dpdk.org (Postfix) with ESMTP id 85337400EF for ; Thu, 7 Sep 2023 23:33:21 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694122400; bh=mMLDrCvDMgi3KqZTHWi6vTF8HW5wXbemt2ONEAZnjv8=; h=Date:From:Reply-To:To:Cc:In-Reply-To:References:Subject:From:Subject:Reply-To; b=Jh4YwxJrhZNPT0r5wZOekmRhlwhe3aSoC9JK8VtSLvy4uJ0d2wv2/F/nbPuoMPkGuqi/gJNV3ysFMIENhicCluupPvxyTk40cf07AeUxG7eSpnDrpJer60TmDwzj19ouU7vRjQwCTsJbC4s2sfgfHjBti/rPuZJ1vBPMIhH8j7kJCApqGhAIpvfZlrKKOSS4LrO3KnnUrPe6TH5Ih/1oHuC7BBr3VOQnVJG4aD467r0Tzfh6K1w5NU4CMyf+N/02BO+UTtSkIFmpRjmwIeri4BJ5whEZIRoM4H+hvizCsAAEU+LWs4G2ShTT1Wuu3LcH8hAbgI8Dp+sA0W1+7IW52g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694122400; bh=c97rPOggczRLDQ12AXHeOolX52uODFvtfJUbhiwxb0d=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=c8WdVKoJgmS25ePRUs76LoVKyvul6rwZWH0OxppdUg+533cuO/ilDAXJGVW2unyUkqHRIarwkF/NkhXqT5ljUrFelXVUUIdPA0NAQ22I06Wa7/d4QsxSpTTDFCn5mTdtE28xWC+3taTBqmPHRBZ4XP3K1POneS+VScZ2gf4s9jpPi8TIREFRz1pF8Y4n8FbZ3zJ6tbdJJvPcmMwXi1O9BkGLBDlQWZn2g6qQWCIyGtEdAhw6RujrKE1m9P9V4vkbYZtVL2kXxnp7ycu6wKhYbyilZQlVuWdR1SxStiQ6M2hm8Sgze1aUtJKadFePSkVRBDEZMMmhPkFHGpocesc3eA== X-YMail-OSG: KP8W8VcVM1mq6bjc9xmAkcfC67x8QxgE8MdrOVv.Toj.dOf98Jcs66R29Nu2ShB Y4_EmzSYkyYhJLzRnUuxnc7eOoXHA.NfP2F3OvAVNSNw9fIWENKWbE55WSoY5S39uqB8juS8shb5 EA9fD6QjHnE2vnysDAQRjEZOfMebohN3REBVGKse6nIx4yFVpswvsddTKSfwFCNm7Ftfp3PgLDcr RljlGJxGsYTu3hrifICy0m.70pjLyON7W0Ri5T3rBSRbHmKX8AAKmGm04lXo1G5qq4SqNvVgl6N2 joeWRsZI3xNPSPldjwry1y9dzJt99K5yd19tW2t9C875Ea6ckXWoardh6qnPTvbyonfSCwn0FFOe qnd4IfYSqzi9fRVLl8tvvWtE2MMzfRyUpYNtjehTUj9Oo.cNq8ypeDuSvcGvST6zC1yLmLFNRa.B 2hRCmPMalOjxvJ_8x8zI5pkFUVKgdvpLBT.rlq6XPKgtsrSXnuh1f4VuPlcLr9anedh4SdL0hkt7 ines7fzqw_c_ZxTw.5wxrz1h4Y5NJBBJKz2Mv4FwgOwaQXEqZjXlF8s7PnABbnSv7HLgXlC9N9ua kGhSz8N217qThtTCx0cpQv7ICD_2RNuu2vhBv.lw4meUVGAWneDgFT4RD7COKFaaLaPABRe68Vkk xPKA7WbT2hFZRmP53HlpCcysVOF45bsTq5drIzoFmTjZ0WbKIsez_LCl_k4TUqXGSIaeVMotPFj1 rkprd9W1LJr3yytiRVWgKlApTgEaDUdbhHnxKZPHl6ErS5SGdg6.N8Vml1doFA7Og6tANplKjeYj hoc7f1uaEp1DcBXVoFH1rFtGxRBkTyGjntxtah55MBWgvPi0iJ0UTjrjtT5X0kBdgk3Njzans3O2 JF5CxGVOwkYpeK06knCOgnHRZrccbtFNl4FBCqghpwkym6Lxv33HA_Fydju2EA8yM_Y8m8sLMqIl 0l3m6aZVAZAIYFeFB6aEElz9GEgoMBfv4YGJ568BfcvgrJuqpPC5kFJG.eFG9PpnSNjGb.MBGYJh ov8I2vACfyjVBW._PBHUcpzv0k6R8Ew.2IGsloO_FkUJj0t58w394UPqJa94WmOQ0egohszjYb1d fkj0R19KvqsEmXLk5r5y6a1seJ6kziQo1bvYR0cUt.o.DmaY5OP17VkHyVKmv9m4GR9ThNhnOtmr GHDM9vI22D76iErmydo8O_oefz1TBnjBZKnqNjilpselUZkqW_wPnbNZtSVbLlAj1kAaoc_poJ.8 1BmPlWvYa_OaeUsEo7e.sFnWYXlKHrkmz8k_rVwCd0JsxejehAPiKS.COrmO96y7nsGcC4aoa.pD kH0GFx1uEMn6Oz5XbWif3NH5CVpuHE9hksJh2Pz1veVKP6Fhu.KyweUTW.JhC5Fp1.iSfxupN2Zd MeqY7naXFmIW8EYswkam.5AYOYN.nXE_yGEnuNmPloZT2uPoAy_LG5M6H3dLlNLpeZCT3uFdmxdQ Zy8TGLUwFAL4qQgnLl8tABd4fvJgO2J2kWaxdGWq3Q52bRDXO53YtnfQQ0ccjpeUmPReR_IQwo5D y_qIMW4Z6R2e9n4GGbLwVIrIG_snKG.c1VLQ2RsEN1A0qp86uHd6gjOWWQ2xOxNJjAVNM_Nbhp3O Ezg9lJtvf9_aVavyTx.HauBXfDzDPg6v6iReZgsRu6.RZWR.p8rIGZ9GThq_HSd_5Z6Hlac4Blp5 iBYlkH2QauhzfnZOwPPMdFITNC57_8F_wMK5HmCvxbxpBfysCUNQNnR4d9EeW._jdOJcC4Aw.MCl aPQ16E6Qh7q8C6NjNyzc7nntkABjXPn_NzENIHBlytvSFcEAML7bS_8ETFHbP.zMDnBWgqCF.0uz k_lYGjdHAlW7e5kDSlT8M8f9oKTETKx5JrFGauhgWATLLJBA2iUuKTaBrcVgyD2.a2pzaEk408Z1 T6TokXsikhZwH1Tyb7dgp06e.Ztlz4gzguaGiZ5AKY6D5awEkHORJJwvFeRz_LPlAFbpXPFm80aH Yc8EUZuxY9M1XXd3DI_HrdMQVjDczlzL.NMtUqD56A659D7Sd3lD_O.mVUKfeDomAt88rKRTtTLi 0s7T_kWGLXplwMsa3LQj_PxfhdOEVjtEo85fzx8gVq6j64I8JLj1aMVZyd1LOgQ1q8yhx5r9HhJa qoS2wFTHgqX.I1I765Wf7R5JPNOpIX7OfvmqCpkN8SuQwHcOgd9PwEIt1XOQ6vKLjG4hNMr2GSon 8NwZzVK.YCivp.lR3345pqRnZQBUdc5vwlX06IHE8cmSmg5ZZa9qCzpCIZLSRAzXrZUBrdTK1L.h K8Rck3VBkWBVjRVU- X-Sonic-MF: X-Sonic-ID: 655c40e0-cbb2-448e-9aad-ffdb1f0e7b48 Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Thu, 7 Sep 2023 21:33:20 +0000 Date: Thu, 7 Sep 2023 21:33:15 +0000 (UTC) From: Don Trotter To: Stephen Hemminger Cc: "users@dpdk.org" Message-ID: <1253918721.5206797.1694122395105@mail.yahoo.com> In-Reply-To: <20230907132109.2bd85f08@hermes.local> References: <2101629309.5133186.1694112839948.ref@mail.yahoo.com> <2101629309.5133186.1694112839948@mail.yahoo.com> <1630438817.5159600.1694116715543@mail.yahoo.com> <20230907132109.2bd85f08@hermes.local> Subject: Re: EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suitable memseg_list MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_5206796_1840507989.1694122395103" X-Mailer: WebService/1.1.21763 YMailNorrin X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Don Trotter Errors-To: users-bounces@dpdk.org ------=_Part_5206796_1840507989.1694122395103 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Thursday, September 7, 2023 at 03:21:12 PM CDT, Stephen Hemminger wrote: On Thu, 7 Sep 2023 19:58:35 +0000 (UTC) Don Trotter wrote: >=C2=A0 To clarify, the log message when my application called=C2=A0rte_mem= pool_create() to create the "node_pool", and the call succeeded. > Thanks,Don Trotter >=C2=A0 =C2=A0 On Thursday, September 7, 2023 at 01:54:08 PM CDT, Don Trott= er wrote:=C2=A0 >=C2=A0 >=C2=A0 Hi, > I have recently started using DPDK. I am working on a project on OcteonTX= 2 with DPDK 11.23.01. I am seeing this message from EAL during EAL init, bu= t everything is working. > =C2=A0 =C2=A0=C2=A0EAL: eal_memalloc_alloc_seg_bulk(): couldn't find suit= able memseg_list > The system has 96GB of memory.=C2=A0 These 2 pools get created and everyt= hing works fine. > mempool @0x13fed3e00=C2=A0 flags=3D10=C2=A0 socket_id=3D0=C2= =A0 pool=3D0x1140300000=C2=A0 iova=3D0x13fed3e00=C2=A0 nb_mem_chunks=3D1=C2= =A0 size=3D65535=C2=A0 populated_size=3D65535=C2=A0 header_size=3D128=C2=A0= elt_size=3D10200=C2=A0 trailer_size=3D40=C2=A0 total_obj_size=3D10368=C2= =A0 private_data_size=3D128=C2=A0 ops_index=3D0=C2=A0 ops_name: =C2=A0 avg bytes/object=3D10368.558602 > mempool @0x1575d8180=C2=A0 flags=3D10=C2=A0 socket_id=3D-1=C2= =A0 pool=3D0x19ffffd00=C2=A0 iova=3D0x1575d8180=C2=A0 nb_mem_chunks=3D2=C2= =A0 size=3D134217727=C2=A0 populated_size=3D134217727=C2=A0 header_size=3D1= 28=C2=A0 elt_size=3D256=C2=A0 trailer_size=3D0=C2=A0 total_obj_size=3D384= =C2=A0 private_data_size=3D0=C2=A0 ops_index=3D3=C2=A0 ops_name: =C2=A0 avg bytes/object=3D384.000094 > You read that right. I=E2=80=99ve got 128*1024*1024 256 byte buffers crea= ted for data. > I also see there is still heap left, although pretty low after. > Heap id:0=C2=A0 =C2=A0 =C2=A0 =C2=A0 Heap name:socket_0=C2=A0 =C2=A0 =C2= =A0 =C2=A0 Heap_size:55834574848,=C2=A0 =C2=A0 =C2=A0 =C2=A0 Free_size:2403= 644544,=C2=A0 =C2=A0 =C2=A0 =C2=A0 Alloc_size:53430930304,=C2=A0 =C2=A0 =C2= =A0 =C2=A0 Greatest_free_size:536870016,=C2=A0 =C2=A0 =C2=A0 =C2=A0 Alloc_c= ount:293,=C2=A0 =C2=A0 =C2=A0 =C2=A0 Free_count:5, > Linux free stats. > tmp# free -h -w=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 total=C2= =A0 =C2=A0 =C2=A0 =C2=A0 used=C2=A0 =C2=A0 =C2=A0 =C2=A0 free=C2=A0 =C2=A0 = =C2=A0 shared=C2=A0 =C2=A0 =C2=A0buffers=C2=A0 =C2=A0 =C2=A0 =C2=A0cache=C2= =A0 =C2=A0availableMem:=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A095Gi=C2=A0 = =C2=A0 =C2=A0 =C2=A0 88Gi=C2=A0 =C2=A0 =C2=A0 =C2=A06.5Gi=C2=A0 =C2=A0 =C2= =A0 =C2=A0444Mi=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0B=C2=A0 =C2=A0 =C2=A0 = =C2=A0470Mi=C2=A0 =C2=A0 =C2=A0 =C2=A0599MiSwap:=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 0B=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 0B=C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 0B > Is there anything wrong with that EAL log? Is there a lurking problem? > Thanks,Don Trotter > >=C2=A0 Did you setup hugepages? How many and what size? Is this a NUMA system? Also 11.23.01 seems like a weird release number. The DPDK release numbering scheme is year followed by month. I.e. 22.11 was= released in November of 2022 # cat /sys/kernel/mm/hugepages/hugepages-524288kB/nr_hugepages176 Yes it is a NUMA system. You are correct sir. The SDK is SDK11.23.01 (2023-01) and DPDK is 22.11. = =20 Thanks, Don Trotter =20 ------=_Part_5206796_1840507989.1694122395103 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
On Thursday, September 7, 2023 at 03:21:12 PM CDT= , Stephen Hemminger <stephen@networkplumber.org> wrote:


On Thu, 7 Sep 20= 23 19:58:35 +0000 (UTC)

Don Trotter <djtrotter@yahoo.com> wrote:

> Thanks,Don Trotter>    On Th= ursday, September 7, 2023 at 01:54:08 PM CDT, Don Trotter <djtrotter@yahoo.com> wrote: 
> 
>  Hi,
> I have recently started using DPDK. I am work= ing on a project on OcteonTX2 with DPDK 11.23.01. I am seeing this message = from EAL during EAL init, but everything is working.
>     EAL: eal_memalloc_a= lloc_seg_bulk(): couldn't find suitable memseg_list
> The system has 96GB of memory.  Th= ese 2 pools get created and everything works fine.
> mempool <mbuf_pool>@0x13fed3e00&n= bsp; flags=3D10  socket_id=3D0  pool=3D0x1140300000  iova=3D= 0x13fed3e00  nb_mem_chunks=3D1  size=3D65535  populated_size= =3D65535  header_size=3D128  elt_size=3D10200  trailer_size= =3D40  total_obj_size=3D10368  private_data_size=3D128  ops_= index=3D0  ops_name: <cn9k_mempool_ops>  avg bytes/object= =3D10368.558602
> = mempool <node_pool>@0x1575d8180  flags=3D10  socket_id=3D-1=   pool=3D0x19ffffd00  iova=3D0x1575d8180  nb_mem_chunks=3D2&= nbsp; size=3D134217727  populated_size=3D134217727  header_size= =3D128  elt_size=3D256  trailer_size=3D0  total_obj_size=3D3= 84  private_data_size=3D0  ops_index=3D3  ops_name: <ring= _mp_mc>  avg bytes/object=3D384.000094
> You read that right. I=E2=80=99ve got 128*10= 24*1024 256 byte buffers created for data.
> I also see there is still heap left, although pr= etty low after.
> = Heap id:0        Heap name:socket_0     =   Heap_size:55834574848,        Free_size:2403644= 544,        Alloc_size:53430930304,     =   Greatest_free_size:536870016,        Alloc_coun= t:293,        Free_count:5,
> Linux free stats.
> tmp# free -h -w      &nb= sp;       total        used   =     free      shared     buffers&n= bsp;      cache   availableMem:     = ;      95Gi        88Gi    &nb= sp;  6.5Gi       444Mi        =   0B       470Mi       599MiSw= ap:            0B        =   0B          0B
> Is there anything wrong with that EAL log? I= s there a lurking problem?
> Thanks,Don Trotter

>
&= gt; 

Did you setup hugepages?
How many and what size?Is this a NUMA system?=

Also 11.23.01 seems like a weird release= number.
The DPDK rel= ease numbering scheme is year followed by month. I.e. 22.11 was released in= November of 2022


# cat /sys/kernel/mm/hugepages/hugepages-= 524288kB/nr_hugepages
176

Yes it is a NUMA system.

You are cor= rect sir. The SDK is SDK11.23.01 (2023-01) and DPDK is 22.11.
=20
=20

Thank= s, Don Trotter

------=_Part_5206796_1840507989.1694122395103--