From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 67C52468D4 for ; Wed, 11 Jun 2025 10:14:25 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id F008A402C5; Wed, 11 Jun 2025 10:14:24 +0200 (CEST) Received: from sonic322-10.consmr.mail.ne1.yahoo.com (sonic322-10.consmr.mail.ne1.yahoo.com [66.163.189.33]) by mails.dpdk.org (Postfix) with ESMTP id 4182B402C2 for ; Wed, 11 Jun 2025 10:14:23 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1749629662; bh=tTQSyFLnzcuh4peTRuCgPlxNvHh5fsmuKjWvhtkOMhA=; h=Date:From:To:Cc:In-Reply-To:References:Subject:From:Subject:Reply-To; b=Z/nD8DYGYE/GBT9dlyHZTA+d58RnFDcKSePK/oqvZqZXpsFQVp8Lr+etsMzjhKaXQ57F/ceFmUjMUHt+VZZm9Esl+oAYMhHoF9q2xZXby93WCjg6f4usUcgABxoM27U4JI5bD2AkIaYdbShaJlSQTieazBur9XtoYaw5qAHDLOJXIW01OVXj/S5d490XT2amSIf4oub/h1rJ9Zt1UgClsTgQbarU+JvsujaV2ypuees1p98xEc2k5hTdJQHi4rRf6vf4UaWcSyEKUtjaZvPjkPrhW3xOJVKXwkcVKQ/Jx1PFbfIbTZLNklmKWaJbaEdtXJlHPexqZ91dg3wQGy8iAw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1749629662; bh=augJt6jd4RQaYOeGA86g/CgOfcOuCiZIeJegbRt0Y4M=; h=X-Sonic-MF:Date:From:To:Subject:From:Subject; b=tHl6cMldFjPl9R0mwgLGkWEa3yy/eQ7yoPiEXgLiQs4lhLUEs5bUDY34QWE5Ix5I/8Lhc7JM0Adm62Fhx28A5nIqEVqN8rgSS0GGd0FuQ9pXfiohzvscQr3+AmckOGDkC7+tEm/L28qbocKPElDgLUW3lc6atIePftA6bNkWBzkxUNyW7vN8LGgDedw8ZAIMu2kM/q/HbpgsmN5kwsjEXW/cIk7rm9thm98F9vypcVBDPU9hkqQUUSCOFQVjhyaij0fpcpmRWMB6o0/eHWYcXPdatw88xzkrlMpPJ7x/CQ8evfSbq4DiFruIvQCCSoJtz0tG4vr5lf4ZZYftM9I9rQ== X-YMail-OSG: lEA4pzsVM1mNfxNDOq2DN0i38l9UZWuebQGoTcMYM4i0ybeD7nIXq5rEvcJsRfz rGM2dt9w8LD41GTHTzIVYFXMPSx5YGt9vVYP0vCRJtW8nvYSoyqt00cKiTNSjKvuy5qnaXO.zHme 5KXek1PPLS.u2y_y.vgq8V1pIzAznBHWuyYgbHEf4m8WuWPbRVV.JGdjO2J2MFMUjPdk5A.pkTL4 9G1w_2yfzibunIdpggLpV5YySlnj3DJdLE4Hb0DvuOMDx0bWJAoLj9Tg7S46TRj7cP3YuYxVIz6W KjFQxp7P_Nw5k2Bpjd0OH0Uuy_XW8yPjnA5Un680Sv9c4XxDtttc2C3lnBDm3HyW1l00JJeVxzAE FKqCVRMLg9CE9qcJWnP.sI.cwxuzspHA2wejeBbK8ymKaKV.x8m0BU1PsMFN50C3_YMuQH..d4V4 Fdf1IZJ_zskiyjYWynwOAqn5s80TgajU_IjKkUxClpGuSD3KMlaae5ZL05rONYf3ncjS5WjXDRUc xK8DVik4inO793OkpAj9X64sqPd3KGSi_RfxIdaOFeSfkEofeRBvX6E5SaQ.UI_3yeFIWakxY5MK TtBYO5cJ7KIwXtrKitl7Dt2RqdHhnp5Ok4HVNFHeLk9.Vuf6wSrrZdeAfPHobaOLCMGWBiwQLLtY 7Dn9j435uN8UZZw8bPItBmdFsCuLjJpDyiD.aDw_AlGZbRR.r7bg_47lgLHq.pGdC5Dn__TqbmQm o82H_aZU.Vbn3sjl0iBuHM4eYZErPnBvwTfNjkTBGBeyCINvRaStZ0PpnRp_Q_Qdm5StoKaox63S gxZdESXRKCpcMsjyeSaluU2YMfELy8e62M31GvvQZNtq1YjgDk5QYqW0DBqvvpGKdFw7sGuXIGSE 4d2kV1PiOdtAFh7lnO4GTukBp7uc5lHXQ39g8JD1tPZAnlNFCArV6n4yQAw6f3Sk8i5O8A_FuoHZ o.b2ELPWZCHyikJq3njTWUowQLzm1h3xaundQAZuepL8JuZxIRNcnLDKZtKcJQz5uphpOzT581i4 hsJRoLMuKaDlDvajnIoqtniq0lPf8oaOgvprucbjC3q.XbetQ.ASPwIplBVsKtBbr9uqibvXqAk0 agaL5ZLYauVNNlEs3SBxnQ0Inr34ArJ64CTNyZbCIm6vHkuyzootge1qCdRFf.UL0zkavXWkOkvI Nd9I9ttyCZiBPUHdO0y3rSHub4q6tzhGW0GfHl.yf8PRsiDyLcQJvpSGVLXuCjjvNMm8atj17efh hxmoNSFTtUDkIX2DB2OD.48mBsIPCWzTqERGdNYeoB4FFIBN.a_WWxwKegBIBIzo9USaIpIvVblc prSZ6QlL3BjkRFyRdoR4ganRZSby8F6Y7rOuKDu7Dp.fahEpNm9ysxoMPuM7xHyHwa4EB20sEyJ_ Bhlw__ldA4iVLf4GHct7Tu7n.yC6sMTJGd4LTCqC9YTcNzUuP0nFDDC1Sr9cGeqUvPSW1dEyUVU6 A.cTs6cmn9njwG1K94OS4PMed6ewmLYFI34KSQkBxoks_yWT9juuqb5a6oAB61u22tKhi37dmlqy IYEk44S_cVVG3z3cKKVyInTeejtz6L.KzvYNCJPaGIq9DueZWMhfgYOzqemWl2t61EHSVvt86fBT FUjV3f6sxyVq6iBmqUXa1yinrOrRLSdvl65LSSBlsdN6LDBreQozaHw2kkcX4PU07Mj8GWncVUxn l1mx7cSAJGTA.LurMszCmIQaQOsqi78yk3bnHMUn4EI1.RDhYjeQ70CX6DuPnZqQpj72Jj86DM7m 9yQo4aNwV9y0oNwvE_NwjKaPZ1nl9K7Hz8stHXlHLttsThL8addNLMfarRHSzF.wqTsuoI_mFipH sXabVxPnGMgqKxwmVcsljCOmfvBxSuaVoV2UAdFwLQvAWsMf57zt5s1MeN2VxPj4Xnif62ngQGDu JIJ5XNmEpTQWL3SN3bwj.QMpcHr1xG6peLrPG1r299HHl.ctDpcGQOB0YrBFHmYia0HjEXP.M5lD t5UPcThJSyBOdm7GmOPz50FancXzaOtMPK1P.H4zH55qHioq2OMB_BoeIKPH0bTfpqUaHG5UKF4C fwWIytJvmBaVv3xYZY5_94P9Ev9YuKUgtNaC5TG40F9R55eOlbEX.aUV20T_F58kGGQjr6v4lqoW II7SybhJgceRYMwWoZFM2qcVGYopFyslJXloxwk_kX0iI16SM3pRw0RHEPTDW1LpArG9pYAo72SH T9yMVUzJAWrodejG0bcuk.9Z6KAJvst6zpEX0vg65Yw2WcRKfkA-- X-Sonic-MF: X-Sonic-ID: 83830681-fdb8-407c-9462-f616f66b5f32 Received: from sonic.gate.mail.ne1.yahoo.com by sonic322.consmr.mail.ne1.yahoo.com with HTTP; Wed, 11 Jun 2025 08:14:22 +0000 Date: Wed, 11 Jun 2025 08:08:20 +0000 (UTC) From: Isaac Lim To: Stephen Hemminger Cc: "users@dpdk.org" Message-ID: <1636271141.560185.1749629300722@mail.yahoo.com> In-Reply-To: <20250610063640.36f6b67c@hermes.local> References: <1091299300.1853887.1749545342300.ref@mail.yahoo.com> <1091299300.1853887.1749545342300@mail.yahoo.com> <20250610063640.36f6b67c@hermes.local> Subject: Re: DPDK for File Transfer and Writing MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_560184_1891754507.1749629300721" X-Mailer: WebService/1.1.23956 YMailNorrin X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org ------=_Part_560184_1891754507.1749629300721 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Dear Stephen, Thank you so much. Regarding SPDX, I did a Google search. Is it Software Package Data Exchange= ? Best Regards,Isaac=20 On Tuesday, June 10, 2025 at 09:36:45 PM GMT+8, Stephen Hemminger wrote: =20 =20 On Tue, 10 Jun 2025 08:49:02 +0000 (UTC) Isaac Lim wrote: > Dear all, > We are using DPDK to transfer files and write to SSD on the receiver side= . > On the sender side, we are splitting the files into 1024-byte packets bef= ore sending over to the receiver. > Currently, on the sender side, we are using a worker lcore to retrieve th= e packets and storing the file data in a buffer while the main lcore=C2=A0w= rites the data to file using write(). > However, we are realizing that the write speed is not fast enough to keep= up with the number of packets being received. > We have tried using io_uring to aid speeding up the writing but it seems = to be even slower than just writing the file normally. > We would like to check with the community if you have any DPDK compatible= suggestions that would help improve file transfer and write performance? > Thank you very much in advance. > Best Regards,Isaac LIM You could try SPDX to get faster storage, but networking is faster than sto= rage. At some point you need a full network stack with real protocols like TCP. =20 ------=_Part_560184_1891754507.1749629300721 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Dear Stephen,

Thank you so much.

Regarding SPDX, I did a Google se= arch. Is it Software Package Data Exchange?

Best Regards,
= Isaac


=20
=20
On Tuesday, June 10, 2025 at 09:36:45 PM GMT+8, Ste= phen Hemminger <stephen@networkplumber.org> wrote:


=20 =20
On Tue, 10 Jun 2025 08:49:02 +0000 (U= TC)
Isaac Lim <izlim@yahoo.com> wrote:

> Dear all,
> We a= re using DPDK to transfer files and write to SSD on the receiver side.
> On the sender side, we are splitting the files into 1024= -byte packets before sending over to the receiver.
> C= urrently, on the sender side, we are using a worker lcore to retrieve the p= ackets and storing the file data in a buffer while the main lcore writ= es the data to file using write().
> However, we are r= ealizing that the write speed is not fast enough to keep up with the number= of packets being received.
> We have tried using io_u= ring to aid speeding up the writing but it seems to be even slower than jus= t writing the file normally.
> We would like to check = with the community if you have any DPDK compatible suggestions that would h= elp improve file transfer and write performance?
> Tha= nk you very much in advance.
> Best Regards,Isaac LIM<= /div>

You could try SPDX to get faster= storage, but networking is faster than storage.

At some point you need a full network stack with real protocols = like TCP.

------=_Part_560184_1891754507.1749629300721--