From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2C05346428 for ; Wed, 19 Mar 2025 21:23:54 +0100 (CET) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id B2DED40268; Wed, 19 Mar 2025 21:23:53 +0100 (CET) Received: from mail-pl1-f181.google.com (mail-pl1-f181.google.com [209.85.214.181]) by mails.dpdk.org (Postfix) with ESMTP id 2366F400D5 for ; Wed, 19 Mar 2025 21:23:53 +0100 (CET) Received: by mail-pl1-f181.google.com with SMTP id d9443c01a7336-224171d6826so56139805ad.3 for ; Wed, 19 Mar 2025 13:23:52 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20230601.gappssmtp.com; s=20230601; t=1742415832; x=1743020632; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=lNFTarflmygGwkoXpM7Rv0Gc9qTtb4KpWQ5X4ZpqBcg=; b=Y0yrogMoHC2TKStz7GC6hdjGXrqtd+kg9dSW+5vdTu6jq0vJcfoJE2F0F6+BPnKQJE NmbLU0gYlGovmtT1TDHsndvqRpmnqp8qX2d66nG5VnlN9MABYDwKxa5hcHxrGPaZovFL FxUWO3FQV8CbXW3y62tS+zE3MK3peHoTrZpV9BALOszkHQAbl8TucsjsXlTuzLb4wqxJ NYpDtn1yUuoi5TeVxdfetzIamLVJZnE23vCH7+9GoZ+S0kWUhUN8pswafavtECevzI4c VQZ31I/d8bdt3z92zCBTr80BTXsS7F47IXFsDUn0Tz3ks23+lwRcK652lIBHoQBu299n d+EA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742415832; x=1743020632; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=lNFTarflmygGwkoXpM7Rv0Gc9qTtb4KpWQ5X4ZpqBcg=; b=su5HEbeedaMdaRnAuR3P9ak3TtkBghJek/+/8LLnLpbhodOJDQQr8UyC18t7aQo5eg sd7oFU0GH3XR2ZIWvcvpoRSt2VIkM/e/SX+011JTu2Q1t30AJxvsPnlfHorE4NAPyPL5 w4ssIpr3AIayplEJjErhQU+Xv/guNuXe90//s4eQmteHwtRpyRf89D0xcilB/v0cm6QE qbNdEyFKdpVXGoRuCUwUxhYaRRtKm76tOcvZvcpco9RlhF3x3yeOLZt3hjogFYf14clT cOcYTr+OXURzRgcuP83W+G3dW/bHAgnCBPNN4VBcTZmmXixo4O2mnNDSBdQiG9KNwup0 PNZg== X-Gm-Message-State: AOJu0YwYGPNYVgHqsJ1xgjFxFmVym/eoFWfu0ESSAqasoN4ez4DbfT27 pJXAPeJ3rM+YbeHeUXN3t1oT8XkXgCdpQD6zz7TIUOel/uTV8TPgtugndWgo9HU= X-Gm-Gg: ASbGnctzsrT0B5qz5VSNPFYPH0T4mDnwNJiscR3BAFkcEbtW750eFrEvADRd/50IoNB wdRh93GPCNOB/zcoPCWbsPyTAVAFhX7Dt6KW/qvPch2mkjkXRCmnImJQ3Wh0+siJf/BKvBg7fkB 33yqFE+oT4kkQA7eeyW5DcX/MGcV/otU3JmnC+LCa5qXdfDfwNV5kMGtKczIHmAO2/aatQeeWsG HeUcufEqo6NXhksu7C4+a2ve2TofNGN1gQ9QiO5hUEmtDPNYx6pfVmHhUSaX7+BaMUTg/C0fDZP EObs7TWzFXUgvXu0FXbtRPEe0e/1+Ze7gstc2jvDFyOU2FyaWllmyA4cnen1bYQV/OSxIJaJb3b ifehegesxBBkBhE+3LoRd2nnlE4RfLusP X-Google-Smtp-Source: AGHT+IHjBEjjEhzli3bXKxGHEpEaaGFGGR8wDtdZjDxurWgoCSasIxI2oHf5ZB68+6M/Xa61UjqZmg== X-Received: by 2002:a05:6a00:2286:b0:736:34ff:be8 with SMTP id d2e1a72fcca58-7376d6da268mr6182358b3a.19.1742415831739; Wed, 19 Mar 2025 13:23:51 -0700 (PDT) Received: from hermes.local (204-195-96-226.wavecable.com. [204.195.96.226]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-7371155075dsm12080293b3a.47.2025.03.19.13.23.51 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 19 Mar 2025 13:23:51 -0700 (PDT) Date: Wed, 19 Mar 2025 13:23:49 -0700 From: Stephen Hemminger To: "Lombardo, Ed" Cc: "users@dpdk.org" Subject: Re: tailqs issue Message-ID: <20250319132349.5ff339a7@hermes.local> In-Reply-To: References: MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Wed, 19 Mar 2025 17:50:46 +0000 "Lombardo, Ed" wrote: > Hi, > My goal is to test DPDK applications running on the same server as a primary process and secondary process. > When I execute two dpdk-simple-mp processes, one as primary and other as secondary, I see them both startup with no issues. > > # ./dpdk-simple_mp -c 0x2 -n 4 --legacy-mem --proc-type primary -- > # ./dpdk-simple_mp -c 0x8 -n 4 --legacy-mem --proc-type secondary -- > > > Now when I test our DPDK application (as primary) and same dpdk-simple-mp (as secondary) I get error "EAL: Cannot initialize tailq: RTE_FIB). > EAL args: MyApp, -l 25,26,27,28 -n 4 -socket-mem=2048, --legacy-mem -no-telemetry -proc_type=primary > > # ./dpdk-simple_mp -l 24 -n 4 --legacy-mem --proc-type secondary -- > > > When I use gdb I see that t->head is 0x0 in eal_common_tailqs.c Line 148. > (gdb) p *t > $40 = {head = 0x0, next = {tqe_next = 0x1c68c40 , tqe_prev = 0x1c67108 }, > name = "RTE_FIB", '\000' } > > I created 2 - 1G hugepages per CPU socket for each test case listed above. > > [root@localhost ~]# /opt/dpdk/dpdk-hugepages.py -s > Node Pages Size Total > 0 2 1Gb 2Gb > 1 2 1Gb 2Gb > > > The dpdk-simple_mp execution output is shown below: > [root@localhost ~]# ./dpdk-simple_mp -l 24 -n 4 --legacy-mem --huge-dir /dev/mnt/huge --proc-type secondary -- > EAL: Detected CPU lcores: 128 > EAL: Detected NUMA nodes: 2 > EAL: Static memory layout is selected, amount of reserved memory can be adjusted with -m or --socket-mem > EAL: Detected static linkage of DPDK > EAL: Multi-process socket /var/run/dpdk/rte/mp_socket_18349_8160ff395b1 > EAL: Selected IOVA mode 'PA' > EAL: WARNING: Address Space Layout Randomization (ASLR) is enabled in the kernel. > EAL: This may cause issues with mapping memory into secondary processes > EAL: Cannot initialize tailq: RTE_FIB > Tailq 0: qname:, tqh_first:(nil), tqh_last:0x100004490 > Tailq 1: qname:, tqh_first:(nil), tqh_last:0x1000044c0 > Tailq 2: qname:, tqh_first:(nil), tqh_last:0x1000044f0 > Tailq 3: qname:, tqh_first:(nil), tqh_last:0x100004520 > Tailq 4: qname:, tqh_first:(nil), tqh_last:0x100004550 > Tailq 5: qname:, tqh_first:(nil), tqh_last:0x100004580 > Tailq 6: qname:, tqh_first:(nil), tqh_last:0x1000045b0 > Tailq 7: qname:, tqh_first:0x1bfd9f140, tqh_last:0x1bf6f4240 > Tailq 8: qname:, tqh_first:(nil), tqh_last:0x100004610 > Tailq 9: qname:, tqh_first:(nil), tqh_last:0x100004640 > Tailq 10: qname:, tqh_first:(nil), tqh_last:0x100004670 > Tailq 11: qname:, tqh_first:(nil), tqh_last:0x1000046a0 > Tailq 12: qname:, tqh_first:(nil), tqh_last:0x1000046d0 > Tailq 13: qname:, tqh_first:0x1bf282000, tqh_last:0x1bf282000 > Tailq 14: qname:, tqh_first:0x1bfdc79c0, tqh_last:0x14f261ac0 > Tailq 15: qname:, tqh_first:0x14f871680, tqh_last:0x14f870cc0 > Tailq 16: qname:, tqh_first:0x14f871080, tqh_last:0x14f871080 > Tailq 17: qname:, tqh_first:0x1bfffce00, tqh_last:0x1bf939e40 > Tailq 18: qname:, tqh_first:(nil), tqh_last:0x1000047f0 > Tailq 19: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 20: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 21: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 22: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 23: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 24: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 25: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 26: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 27: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 28: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 29: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 30: qname:<>, tqh_first:(nil), tqh_last:(nil) > Tailq 31: qname:<>, tqh_first:(nil), tqh_last:(nil) > EAL: Cannot init tail queues for objects > EAL: Error - exiting with code: 1 > Cannot init EAL > > How do I resolve this issue? > > Thanks, > Ed The problem is that the primary process has not linked in the fib library. The primary process is the only one that can register tailq's at initialization.