From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 7475B46BF1 for ; Wed, 23 Jul 2025 15:20:58 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 6B61740B98; Wed, 23 Jul 2025 15:20:58 +0200 (CEST) Received: from mail-pf1-f181.google.com (mail-pf1-f181.google.com [209.85.210.181]) by mails.dpdk.org (Postfix) with ESMTP id A426F402E2 for ; Wed, 23 Jul 2025 15:20:57 +0200 (CEST) Received: by mail-pf1-f181.google.com with SMTP id d2e1a72fcca58-7494999de5cso4530541b3a.3 for ; Wed, 23 Jul 2025 06:20:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1753276857; x=1753881657; darn=dpdk.org; h=mime-version:subject:references:in-reply-to:message-id:cc:to:from :date:from:to:cc:subject:date:message-id:reply-to; bh=t3um/zhgwvVaT7EKVIYnaP1IfuRHRXP4zwVsHAjFqfg=; b=mMEnhgVf7HWXp7vR/sl7974VDBJdR7VZjvrVWXIuuHTecvb7mGCEGuUp19PI46Z3TQ GGjKV1NyG4d7Lk3NZ/lY6e9zEqyAzRBbTG7l9+xXjzgH4ele/Ls05iZ7aNsb8xyu/VcX 8l0P0Tbvag3311GBPtljM0X7OhTkZ/zawFdKFSV37dlffZZ9K2uPTpQaLCLoVZDLv2tn nNLHCGNde/OqKEIrgf8wuwmKgTmIQe7840i/VhQcrZa8dMLxfPQpUaahj32sAC54Yqd5 i36D2e/qOpb0vTZ+JKzSVTquX4WXtxYWV63ClgPfXEKIKrjDYfGHDaomAPBkyj1P6z53 XcpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1753276857; x=1753881657; h=mime-version:subject:references:in-reply-to:message-id:cc:to:from :date:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=t3um/zhgwvVaT7EKVIYnaP1IfuRHRXP4zwVsHAjFqfg=; b=hfhz/FjgzAk/z+YJA3TmKiDsmCUIuS/fcldNVjMpIrG05YS6BIn1F30P76zHQU4fIw FRGIkZW0C6azjF0NtPxjgnSxuel5rfe4eBFqeU7X1Sr8/XebA9JWBOV8l6s9V07zvfiQ RU19ptC4jGC9oodZZ8og7kCnYtMp6OARjsDkTrrzDp/i84V3gPW8xnIdjGq+5i2MGbuv oOpEm3zBCedX1hRWGJfb3lFgDao6avkTgr8NH19J6FoddzFqvvDEe9HVzbXcGTYKSqZm 7O/FaBLHQ3Ywj0ypG4+9UO7DH1F13ERkC9M8gsj+/ExyyCzjiJqR+cTrTpW24fP5QPia 2AEA== X-Gm-Message-State: AOJu0YzQca8kurPEXDZTh6K1C0LwBq5tlF8zMK6ZGVtkoQ5lF2UKPShK UGeggNBE4EftmP2DIx8RAVEJtXz96y/3Uvw5WCUUVMEo3r0VfdrfLCM2 X-Gm-Gg: ASbGnctxqWMMYGjaF5gkZAO+SVSaWCJ1ltNI1znEwRe2H2VsjZAsFAffi+Djiu2xVv2 1tqtSc7OXOAttSPv9VlWsR7TeE5EOKdSluZawgD5auOI+K6OZp08OsREMIHZ6HgKAwIFUaERCon avTflqtoY/M4CImd8XnMBynfpDxx0xehow0A4PqHTkL6WElmv0kjNTas4wKYBT708S8qGIb2lUY JftaVVSMMeBOesGAMC/Ezz4DttypwXHNEsS5ntR2RYh7/kEv0fmjahCX3+cPXNeYD6BO9e10uDb DINTta0DRKh0OXPYUcVXCxF4+p+dXd/01CiPY5ZLVtUU3OjUMLSVIEwId18bT39PePLPXVFKSAB hpfK5i7rshbUzEh4WzITZ9ktBGLHfuzBp4KU= X-Google-Smtp-Source: AGHT+IHq1cmbivxmn6AU8JvcUq6iL52IP7uSxrr6LlXq9X8FFbCK38TI8ceDBa+BCO2ObrMqKiK1qA== X-Received: by 2002:a05:6a00:1914:b0:75f:8239:5c2b with SMTP id d2e1a72fcca58-76035ff3a9dmr4690894b3a.23.1753276855538; Wed, 23 Jul 2025 06:20:55 -0700 (PDT) Received: from [192.168.0.12] ([147.47.193.124]) by smtp.gmail.com with ESMTPSA id d2e1a72fcca58-75eb876df3csm3821740b3a.7.2025.07.23.06.20.53 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 23 Jul 2025 06:20:54 -0700 (PDT) Date: Wed, 23 Jul 2025 22:20:48 +0900 From: Yoon Junghan To: Ivan Malov Cc: users@dpdk.org Message-ID: <8f3a156a-2f2a-4418-a5e0-47a4450cd10a@Spark> In-Reply-To: <391481b9-1b18-5567-a8a0-563c5c5eb37c@arknetworks.am> References: <3f7df93b-ee00-bcdb-337c-8faa7bd73f6c@arknetworks.am> <391481b9-1b18-5567-a8a0-563c5c5eb37c@arknetworks.am> Subject: Re: HW RX timestamp with LRO enabled on ConnectX-7 (DPDK 20.11) X-Readdle-Message-ID: 8f3a156a-2f2a-4418-a5e0-47a4450cd10a@Spark MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="6880e1b2_6ceaf087_5997" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org --6880e1b2_6ceaf087_5997 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Thank you for quick response. 1) They are different NICs. Not in the same board. Separate adapters in d= ifferent PCIe slots. 2) My DPDK app uses 4 separate ports; port 0, port 1, port 2, and port 3.= They are all on different boards. Thus, they are running at the same tim= e. Sincerely, Junghan Yoon On 2025=EB=85=84 7=EC=9B=94 23=EC=9D=BC PM 10:09 +0900, Ivan Malov , wrote: > Hello, > > On Wed, 23 Jul 2025, Yoon Junghan wrote: > > > > Hello, > > As advised, I tested hardware timestamps with LRO enabled on our Conn= ectX-7 NICs. However, the timestamps of LROed packets still show inconsis= tent and abnormally large gaps from normal > > packets. > > > > Interestingly, I found this issue does not appear on all CX-7 NICs. E= ven with identical DPDK code, firmware version (28.43.2566), and hardware= models from the same manufacturer, only > > specific NICs exhibit this inconsistency. > > I have confirmed that: > > * All NICs use the same driver and firmware version. > > * All NICs are of the same model (MCX75310AAS-NEA=5FAx). > > > > 1) Do the two =22NICs=22 ('port 0' and 'port 1' from below printout) re= present two > different ports/P=46s of the same physical 'board'/'adapter card' in fa= ct=3F > > 2) If (1) is true, were the results obtained by running the application= on both > ports simultaneously (both managed by the DPDK at the same time)=3F > > (just to clarify, -- I'm confused by the fact that the NIC driver itsel= f seems > to invoke 'rte=5Fmbuf=5Fdyn=5Frx=5Ftimestamp=5Fregister' for each new R= xQ rather than call > it once and then look-up and reuse the existing offsets for more ports/= queue ). > > Thank you. > > > > * The issue occurs only when LRO is enabled together with RX hardware= timestamping. > > * Disabling LRO eliminates the issue. > > I would appreciate any insight into how this behavior can occur on on= ly some ports despite same software and hardware setup. > > > > Below is my code snippet. > > > > =60=60=60c > > /*-------------------------------------------------------------------= ---------*/ > > static inline int > > is=5Ftimestamp=5Fenabled(struct rte=5Fmbuf *mbuf) > > =7B > > =C2=A0 =C2=A0static uint64=5Ft timestamp=5Frx=5Fdynflag =3D 0; > > =C2=A0 =C2=A0int timestamp=5Frx=5Fdynflag=5Foffset; > > > > =C2=A0 =C2=A0if (=21timestamp=5Frx=5Fdynflag) > > =C2=A0 =C2=A0=7B > > =C2=A0 =C2=A0 =C2=A0 =C2=A0timestamp=5Frx=5Fdynflag=5Foffset =3D > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0rte=5Fmbuf=5Fdynflag=5Flooku= p(RTE=5FMBU=46=5FDYN=46LAG=5FRX=5FTIMESTAMP=5FNAME, NULL); > > =C2=A0 =C2=A0 =C2=A0 =C2=A0if (timestamp=5Frx=5Fdynflag=5Foffset < 0)= > > =C2=A0 =C2=A0 =C2=A0 =C2=A0=7B > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0return 0; > > =C2=A0 =C2=A0 =C2=A0 =C2=A0=7D > > =C2=A0 =C2=A0 =C2=A0 =C2=A0timestamp=5Frx=5Fdynflag =3D RTE=5FBIT64(t= imestamp=5Frx=5Fdynflag=5Foffset); > > =C2=A0 =C2=A0=7D > > > > =C2=A0 =C2=A0return mbuf->ol=5Fflags & timestamp=5Frx=5Fdynflag; > > =7D > > /*-------------------------------------------------------------------= ---------*/ > > static inline rte=5Fmbuf=5Ftimestamp=5Ft * > > get=5Ftimestamp(struct rte=5Fmbuf *mbuf) > > =7B > > =C2=A0 =C2=A0static int timestamp=5Fdynfield=5Foffset =3D -1; > > > > =C2=A0 =C2=A0if (timestamp=5Fdynfield=5Foffset < 0) > > =C2=A0 =C2=A0=7B > > =C2=A0 =C2=A0 =C2=A0 =C2=A0timestamp=5Fdynfield=5Foffset =3D > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0rte=5Fmbuf=5Fdynfield=5Flook= up(RTE=5FMBU=46=5FDYN=46IELD=5FTIMESTAMP=5FNAME, NULL); > > =C2=A0 =C2=A0 =C2=A0 =C2=A0if (timestamp=5Fdynfield=5Foffset < 0) > > =C2=A0 =C2=A0 =C2=A0 =C2=A0=7B > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0return 0; > > =C2=A0 =C2=A0 =C2=A0 =C2=A0=7D > > =C2=A0 =C2=A0=7D > > > > =C2=A0 =C2=A0return RTE=5FMBU=46=5FDYN=46IELD(mbuf, > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0timestamp=5Fdynfield=5Foffset, > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0rte=5Fmbuf=5Ftimestamp=5Ft *); > > =7D > > /*-------------------------------------------------------------------= ---------*/ > > static inline rte=5Fmbuf=5Ftimestamp=5Ft * > > get=5Frx=5Fhw=5Ftimestamp(struct rte=5Fmbuf *pkt) > > =7B > > =C2=A0 =C2=A0if (=21is=5Ftimestamp=5Fenabled(pkt)) > > =C2=A0 =C2=A0=7B > > =C2=A0 =C2=A0 =C2=A0 =C2=A0printf(=22rx=5Fhw=5Ftimestamp not enabled = in mbuf=21=5Cn=22); > > =C2=A0 =C2=A0 =C2=A0 =C2=A0return NULL; > > =C2=A0 =C2=A0=7D > > > > =C2=A0 =C2=A0return get=5Ftimestamp(pkt); > > =7D > > =60=60=60 > > > > My DPDK application prints logs as below. > > > > =60=60=60c > > =C2=A0 =C2=A0/* parse HW timestamp */ > > =C2=A0 =C2=A0rte=5Fmbuf=5Ftimestamp=5Ft *rx=5Ftimestamp =3D get=5Frx=5F= hw=5Ftimestamp(pkt); > > =C2=A0 =C2=A0printf(=22=5Bport %d=5D RX HW timestamp: %=23016lx %s=5C= n=22, > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 pctx->port=5Fid, > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 *rx=5Ftimestamp, > > =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 pkt->ol=5Fflags & PKT=5FRX=5FLRO =3F= =22(LROed)=22 : =22(not LROed)=22); > > =60=60=60 > > > > Below are observations from two CX-7 ports under identical conditions= . > > > > Normal NIC (port 0): > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d185b (LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d1911 (LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d19c9 (LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d37ca (LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d4cb3 (not LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd2d4cb3 (not LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd30e019 (not LROed) > > =5Bport 0=5D RX HW timestamp: 0x00007dcd3280bb (not LROed) > > > > Erroneous NIC (port 1): > > Below is erroneous NIC's timestamp. > > =5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed) > > =5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed) > > =5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed) > > =5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed) > > =5Bport 1=5D RX HW timestamp: 0x000080691b7557 (not LROed) > > =5Bport 1=5D RX HW timestamp: 0x000080691e2311 (not LROed) > > =5Bport 1=5D RX HW timestamp: 0x00008069357553 (not LROed) > > =5Bport 1=5D RX HW timestamp: 0x0000806936e8c1 (not LROed) > > > > As shown above, non-LRO packets consistently have normal hardware tim= estamps on both NICs. However, on port 1, all LROed packets return a fixe= d, invalid timestamp (0x3e6eef91bc19f0fd), > > which is clearly inconsistent. > > I have also confirmed that other dynfields (rather than dynfield=5B1=5D= and dynfield=5B2=5D) are unused. > > > > > > Sincerely, > > Junghan Yoon > > On Jul 22, 2025, 5:31 PM +0900, Ivan Malov , wrote: > > Hello, > > > > On Tue, 22 Jul 2025, Yoon Junghan wrote: > > > > Hello, > > > > I'm currently using DPDK 20.11 with a ConnectX-7 NIC, and I'm trying = to retrieve RX hardware timestamps using =60rte=5Fmbuf=5Fdyn=5Frx=5Ftimes= tamp=5Fregister()=60. > > > > > > Does the application invoke 'rte=5Fmbuf=5Fdyn=5Frx=5Ftimestamp=5Fregi= ster' on its own=3F If > > yes, consider to replace this with invocations of APIs =5B1=5D (with = field name =5B2=5D) > > and =5B3=5D (with flag name =5B4=5D). =46or an example, please refer = to =5B5=5D and =5B6=5D. > > > > This is because, as per =5B7=5D, the driver in question might 'regist= er' the field > > and the flag on its own, in response to 'DEV=5FRX=5FO=46=46LOAD=5FTIM= ESTAMP' request, so, > > the user application should look up the field/flag, not 'register' it= afresh. > > > > If this does not help, then consider to clarify whether the timestamp= s are > > accurate (and whether the flag is seen in the mbufs) when LRO is not = enabled. > > > > =5B1=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.ht= ml=23a6adf9b352a83e7d521fd6aa04e305b1c > > =5B2=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.ht= ml=23a5159b2d34fa801d171ed0ccce451121b > > =5B3=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.ht= ml=23a89d835027034f76a27eb2afe7987ae35 > > =5B4=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.ht= ml=23a831d7066c7193788351797a65186848a > > =5B5=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b9659= 7469b7f6e6207/app/test-pmd/util.c=23L44 > > =5B6=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b9659= 7469b7f6e6207/app/test-pmd/util.c=23L60 > > =5B7=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b9659= 7469b7f6e6207/drivers/net/mlx5/mlx5=5Frxq.c=23L1743 > > > > Thank you. > > > > > > When LRO is enabled, I notice that LROed mbufs seem to share identica= l timestamp values, and the timestamps are unexpectedly large or inconsis= tent. This raises > > the question of whether > > LRO is interfering with the correctness of the RX HW timestamps. > > > > I=E2=80=99d appreciate any clarification on whether HW RX timestampin= g is reliable when LRO is enabled on this platform, or if LRO should be j= ust disabled for accurate > > per-packet timestamping. > > > > > > Sincerely, > > Junghan Yoon > > > > > > --6880e1b2_6ceaf087_5997 Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline
Thank you for quick response.
&=23160;
1) They are different NICs. Not in the same board. Separate adapters= in different PCIe slots.
2) My DPDK app uses 4 separate ports; port 0, port 1, port 2, and po= rt 3. They are all on different boards. Thus, they are running at the sam= e time.

Sincerely,
Junghan Yoon
On 2025=EB=85=84 7=EC=9B=94 23=EC=9D=BC PM 10:09 +0900, Ivan Malov &= lt;ivan.malov=40arknet= works.am>, wrote:
&=23160;
Hello,

On Wed, 23 Jul 2025, Yoon Junghan wrote:

&=23160;
Hello,
As advised, I tested hardware timestamps with LRO enabled on our ConnectX= -7 NICs. However, the timestamps of LROed packets still show inconsistent= and abnormally large gaps from normal
packets.
&=23160;
Interestingly, I found this issue does not appear on all CX-7 NICs. Even = with identical DPDK code, firmware version (28.43.2566), and hardware mod= els from the same manufacturer, only
specific NICs exhibit this inconsistency.
I have confirmed that:
* All NICs use the same driver and firmware version.
* All NICs are of the same model (MCX75310AAS-NEA=5FAx).
&=23160;

1) Do the two =22NICs=22 ('port 0' and 'port 1' from below printout) repr= esent two
different ports/P=46s of the same physical 'board'/'adapter card' in fact= =3F

2) If (1) is true, were the results obtained by running the application o= n both
ports simultaneously (both managed by the DPDK at the same time)=3F
=
(just to clarify, -- I'm confused by the fact that the NIC driver itself = seems
to invoke 'rte=5Fmbuf=5Fdyn=5Frx=5Ftimestamp=5Fregister' for each new RxQ= rather than call
it once and then look-up and reuse the existing offsets for more ports/qu= eue ).

Thank you.

&=23160;
* The issue occurs only when LRO is enabled together with RX hardwar= e timestamping.
* Disabling LRO eliminates the issue.
I would appreciate any insight into how this behavior can occur on only s= ome ports despite same software and hardware setup.
&=23160;
Below is my code snippet.
&=23160;
=60=60=60c
/*-----------------------------------------------------------------------= -----*/
static inline int
is=5Ftimestamp=5Fenabled(struct rte=5Fmbuf *mbuf)
=7B
&=23160; &=23160;static uint64=5Ft timestamp=5Frx=5Fdynflag =3D 0;
&=23160; &=23160;int timestamp=5Frx=5Fdynflag=5Foffset;
&=23160;
&=23160; &=23160;if (=21timestamp=5Frx=5Fdynflag)
&=23160; &=23160;=7B
&=23160; &=23160; &=23160; &=23160;timestamp=5Frx=5Fdynflag=5Foffset =3D<= br /> &=23160; &=23160; &=23160; &=23160; &=23160; &=23160;rte=5Fmbuf=5Fdynflag= =5Flookup(RTE=5FMBU=46=5FDYN=46LAG=5FRX=5FTIMESTAMP=5FNAME, NULL);
&=23160; &=23160; &=23160; &=23160;if (timestamp=5Frx=5Fdynflag=5Foffset = < 0)
&=23160; &=23160; &=23160; &=23160;=7B
&=23160; &=23160; &=23160; &=23160; &=23160; &=23160;return 0;
&=23160; &=23160; &=23160; &=23160;=7D
&=23160; &=23160; &=23160; &=23160;timestamp=5Frx=5Fdynflag =3D RTE=5FBIT= 64(timestamp=5Frx=5Fdynflag=5Foffset);
&=23160; &=23160;=7D
&=23160;
&=23160; &=23160;return mbuf->ol=5Fflags & timestamp=5Frx=5Fdynfla= g;
=7D
/*-----------------------------------------------------------------------= -----*/
static inline rte=5Fmbuf=5Ftimestamp=5Ft *
get=5Ftimestamp(struct rte=5Fmbuf *mbuf)
=7B
&=23160; &=23160;static int timestamp=5Fdynfield=5Foffset =3D -1;
&=23160;
&=23160; &=23160;if (timestamp=5Fdynfield=5Foffset < 0)
&=23160; &=23160;=7B
&=23160; &=23160; &=23160; &=23160;timestamp=5Fdynfield=5Foffset =3D
&=23160; &=23160; &=23160; &=23160; &=23160; &=23160;rte=5Fmbuf=5Fdynfiel= d=5Flookup(RTE=5FMBU=46=5FDYN=46IELD=5FTIMESTAMP=5FNAME, NULL);
&=23160; &=23160; &=23160; &=23160;if (timestamp=5Fdynfield=5Foffset <= 0)
&=23160; &=23160; &=23160; &=23160;=7B
&=23160; &=23160; &=23160; &=23160; &=23160; &=23160;return 0;
&=23160; &=23160; &=23160; &=23160;=7D
&=23160; &=23160;=7D
&=23160;
&=23160; &=23160;return RTE=5FMBU=46=5FDYN=46IELD(mbuf,
&=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &= =23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160;timestamp=5F= dynfield=5Foffset,
&=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160; &= =23160; &=23160; &=23160; &=23160; &=23160; &=23160; &=23160;rte=5Fmbuf=5F= timestamp=5Ft *);
=7D
/*-----------------------------------------------------------------------= -----*/
static inline rte=5Fmbuf=5Ftimestamp=5Ft *
get=5Frx=5Fhw=5Ftimestamp(struct rte=5Fmbuf *pkt)
=7B
&=23160; &=23160;if (=21is=5Ftimestamp=5Fenabled(pkt))
&=23160; &=23160;=7B
&=23160; &=23160; &=23160; &=23160;printf(=22rx=5Fhw=5Ftimestamp not enab= led in mbuf=21=5Cn=22);
&=23160; &=23160; &=23160; &=23160;return NULL;
&=23160; &=23160;=7D
&=23160;
&=23160; &=23160;return get=5Ftimestamp(pkt);
=7D
=60=60=60
&=23160;
My DPDK application prints logs as below.
&=23160;
=60=60=60c
&=23160; &=23160;/* parse HW timestamp */
&=23160; &=23160;rte=5Fmbuf=5Ftimestamp=5Ft *rx=5Ftimestamp =3D get=5Frx=5F= hw=5Ftimestamp(pkt);
&=23160; &=23160;printf(=22=5Bport %d=5D RX HW timestamp: %=23016lx %s=5C= n=22,
&=23160; &=23160; &=23160; &=23160; &=23160; pctx->port=5Fid,
&=23160; &=23160; &=23160; &=23160; &=23160; *rx=5Ftimestamp,
&=23160; &=23160; &=23160; &=23160; &=23160; pkt->ol=5Fflags & PKT= =5FRX=5FLRO =3F =22(LROed)=22 : =22(not LROed)=22);
=60=60=60
&=23160;
Below are observations from two CX-7 ports under identical conditions. &=23160;
Normal NIC (port 0):
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d185b (LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d1911 (LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d19c9 (LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d37ca (LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d4cb3 (not LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd2d4cb3 (not LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd30e019 (not LROed)
=5Bport 0=5D RX HW timestamp: 0x00007dcd3280bb (not LROed)
&=23160;
Erroneous NIC (port 1):
Below is erroneous NIC's timestamp.
=5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed)
=5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed)
=5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed)
=5Bport 1=5D RX HW timestamp: 0x3e6eef91bc19f0fd (LROed)
=5Bport 1=5D RX HW timestamp: 0x000080691b7557 (not LROed)
=5Bport 1=5D RX HW timestamp: 0x000080691e2311 (not LROed)
=5Bport 1=5D RX HW timestamp: 0x00008069357553 (not LROed)
=5Bport 1=5D RX HW timestamp: 0x0000806936e8c1 (not LROed)

As shown above, non-LRO packets consistently have normal hardware timesta= mps on both NICs. However, on port 1, all LROed packets return a fixed, i= nvalid timestamp (0x3e6eef91bc19f0fd),
which is clearly inconsistent.
I have also confirmed that other dynfields (rather than dynfield=5B1=5D a= nd dynfield=5B2=5D) are unused.
&=23160;

Sincerely,
Junghan Yoon
On Jul 22, 2025, 5:31 PM +0900, Ivan Malov <ivan.malov=40arknetworks.a= m>, wrote:
Hello,

On Tue, 22 Jul 2025, Yoon Junghan wrote:

Hello,
&=23160;
I'm currently using DPDK 20.11 with a ConnectX-7 NIC, and I'm trying to r= etrieve RX hardware timestamps using =60rte=5Fmbuf=5Fdyn=5Frx=5Ftimestamp= =5Fregister()=60.


Does the application invoke 'rte=5Fmbuf=5Fdyn=5Frx=5Ftimestamp=5Fregister= ' on its own=3F If
yes, consider to replace this with invocations of APIs =5B1=5D (with fiel= d name =5B2=5D)
and =5B3=5D (with flag name =5B4=5D). =46or an example, please refer to =5B= 5=5D and =5B6=5D.

This is because, as per =5B7=5D, the driver in question might 'register' = the field
and the flag on its own, in response to 'DEV=5FRX=5FO=46=46LOAD=5FTIMESTA= MP' request, so,
the user application should look up the field/flag, not 'register' it afr= esh.

If this does not help, then consider to clarify whether the timestamps ar= e
accurate (and whether the flag is seen in the mbufs) when LRO is not enab= led.

=5B1=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.html=23= a6adf9b352a83e7d521fd6aa04e305b1c
=5B2=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.html=23= a5159b2d34fa801d171ed0ccce451121b
=5B3=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.html=23= a89d835027034f76a27eb2afe7987ae35
=5B4=5D https://doc.dpdk.org/api-20.11/rte=5F=5Fmbuf=5F=5Fdyn=5F8h.html=23= a831d7066c7193788351797a65186848a
=5B5=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b96597469= b7f6e6207/app/test-pmd/util.c=23L44
=5B6=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b96597469= b7f6e6207/app/test-pmd/util.c=23L60
=5B7=5D https://github.com/DPDK/dpdk/blob/d69724b1dcc69784bcef00b96597469= b7f6e6207/drivers/net/mlx5/mlx5=5Frxq.c=23L1743

Thank you.

&=23160;
When LRO is enabled, I notice that LROed mbufs seem to share identical ti= mestamp values, and the timestamps are unexpectedly large or inconsistent= . This raises
the question of whether
LRO is interfering with the correctness of the RX HW timestamps.
&=23160;
I=E2=80=99d appreciate any clarification on whether HW RX timestamping is= reliable when LRO is enabled on this platform, or if LRO should be just = disabled for accurate
per-packet timestamping.
&=23160;

Sincerely,
Junghan Yoon


&=23160;
--6880e1b2_6ceaf087_5997--