From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 58D45468D7 for ; Wed, 11 Jun 2025 17:32:32 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id E602A402EA; Wed, 11 Jun 2025 17:32:31 +0200 (CEST) Received: from mail-qk1-f178.google.com (mail-qk1-f178.google.com [209.85.222.178]) by mails.dpdk.org (Postfix) with ESMTP id E05F6402DB for ; Wed, 11 Jun 2025 17:32:30 +0200 (CEST) Received: by mail-qk1-f178.google.com with SMTP id af79cd13be357-7d3862646eeso245615185a.2 for ; Wed, 11 Jun 2025 08:32:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20230601.gappssmtp.com; s=20230601; t=1749655950; x=1750260750; darn=dpdk.org; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=P3So0b/HvMk+WcMgx/iLn4nECzqKyftVO8ZsOgbiLk4=; b=YOiwEeSRd/edufymjy4Vx4gKGri+BwH8nDDxFcaq038Nv4KqX1M28T0fdS0CHzT0/l RDbeKxlJ0DqIPalSP1X4Ercs8ZSON/37B7I+A/G4hxtt3jIUgPb+ZpFG+rm4EdlywMR4 ZiBV+ykh0Ke4w6aXQjsOQ2edLPv0KfH+oS2Oqv0eT29IEERI/Sf6rozpCP0PszkDkL+N QiPkhSomIpvzsDI+xFUcLk/MoGDDcCdssILynVqtojHYd94sqPAiR0h6CfyhhVoicrp8 462NHod4fRr7WkFnWdwyRWRtfXzBohUddA6i1ENF2tBKNtvjY+PosXbehFCgIkY4+NiL Ktzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1749655950; x=1750260750; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=P3So0b/HvMk+WcMgx/iLn4nECzqKyftVO8ZsOgbiLk4=; b=WKT5whfccxFaPTt/fvrKFbZs99nYQonzMbuz6B2lr6wX64OGRO2WrjC8EokeGR1v6l 7VghzxBwvJfcpfctIA8ZC1gzrMFCCwbq3hvx8wNUn0eT8bmhI7yTkBzNn/vsoCtWmqrI IHm/TSjMemNM6OzIRwahbKTDqACfA1qOs5tKBfxXaWs7w7YZdQKZTqGNSRFqJl6f5UyX Re4G0u/2MhZhlThRsggz7dwIHmFxrWE73u9lKhEn5UQDPxPoW+Caw1XzHOiLm3fDwwGS NkDQ7WBjNRHa0a2DJuhDoIYSAbR7XGfDLhRFth13RohCLEzx8j9TjzVIR79wj/Yjab5h txFA== X-Gm-Message-State: AOJu0Yyno3jvAv5Ceu/8MvxLMaBn4t1fPCFsGyMyRHGS/0sTqGAo2qZk Kvu6wPNFiTJEyuCnwzppxY3fuH/G4IxSu5LRU8AUZK8gCTjQiUxH0u1HoKM7F92EpWU= X-Gm-Gg: ASbGncu2h5Geq5G0JDM/8XVBHj+s4xq4RCkAzRgtgJEmyypo9i+V88z/pw0Me9GG8r7 /Mppx6JJN2Upcas8+N+mey2hUC7ctlyJCcCAPZta0q+bbl8hwIyUA/6DOiamj94adOWGhG4Z6gr lE7Lr1YB9wdE/mXYBxivPkHLejOamS8OYH6johaGlY/OYvY4F8kWfg/Of7GS6e91ZkhpruKlpQ3 QTnSmYkxeGS6pi1YjvVaDVorAiZikGHswjnZnTLQX3Wwp9H0q+78al9xdZKKlQ0ShTDaXY75IRv oNiqQSgNJWZPhuB3zGu9j90VoZCqYwbp1stQhuP3KUEiTz8fIrpM6w8W1wfAxguF4EwIwW9Wrod 7/5Dc1t3miWIuN58SH+2URUpeh9IAtnlQWeiFOG/5xwaMdDbCtA== X-Google-Smtp-Source: AGHT+IFSZ0SG94ZiSnWUXglc+Wemt8zWKUcrKis5ulQoMKYvXlg4RYHafc5cwozIphRIpkuasW7rwQ== X-Received: by 2002:a05:620a:880e:b0:7d0:970e:8dde with SMTP id af79cd13be357-7d3a88aa392mr524267985a.31.1749655949869; Wed, 11 Jun 2025 08:32:29 -0700 (PDT) Received: from hermes.local (204-195-96-226.wavecable.com. [204.195.96.226]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7d25a6187e1sm874545285a.79.2025.06.11.08.32.29 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 11 Jun 2025 08:32:29 -0700 (PDT) Date: Wed, 11 Jun 2025 08:32:26 -0700 From: Stephen Hemminger To: Isaac Lim Cc: "users@dpdk.org" Subject: Re: DPDK for File Transfer and Writing Message-ID: <20250611083226.577a03a0@hermes.local> In-Reply-To: <1636271141.560185.1749629300722@mail.yahoo.com> References: <1091299300.1853887.1749545342300.ref@mail.yahoo.com> <1091299300.1853887.1749545342300@mail.yahoo.com> <20250610063640.36f6b67c@hermes.local> <1636271141.560185.1749629300722@mail.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org On Wed, 11 Jun 2025 08:08:20 +0000 (UTC) Isaac Lim wrote: > Dear Stephen, > Thank you so much. > Regarding SPDX, I did a Google search. Is it Software Package Data Exchan= ge? > Best Regards,Isaac=20 >=20 > On Tuesday, June 10, 2025 at 09:36:45 PM GMT+8, Stephen Hemminger wrote: =20 > =20 > On Tue, 10 Jun 2025 08:49:02 +0000 (UTC) > Isaac Lim wrote: >=20 > > Dear all, > > We are using DPDK to transfer files and write to SSD on the receiver si= de. > > On the sender side, we are splitting the files into 1024-byte packets b= efore sending over to the receiver. > > Currently, on the sender side, we are using a worker lcore to retrieve = the packets and storing the file data in a buffer while the main lcore=C2= =A0writes the data to file using write(). > > However, we are realizing that the write speed is not fast enough to ke= ep up with the number of packets being received. > > We have tried using io_uring to aid speeding up the writing but it seem= s to be even slower than just writing the file normally. > > We would like to check with the community if you have any DPDK compatib= le suggestions that would help improve file transfer and write performance? > > Thank you very much in advance. > > Best Regards,Isaac LIM =20 >=20 > You could try SPDX to get faster storage, but networking is faster than s= torage. >=20 > At some point you need a full network stack with real protocols like TCP. > =20 SPDK https://spdk.io/