From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f68.google.com (mail-wm0-f68.google.com [74.125.82.68]) by dpdk.org (Postfix) with ESMTP id 7C4471B238 for ; Thu, 19 Oct 2017 17:09:02 +0200 (CEST) Received: by mail-wm0-f68.google.com with SMTP id u138so16661147wmu.5 for ; Thu, 19 Oct 2017 08:09:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=6wind-com.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:content-transfer-encoding:in-reply-to :user-agent; bh=JA7Rhrqc7aEuJVy33oPPYfGPp9y0rZ5Y54wbGN9YIoM=; b=rfC8cL/F3QnXNBV4IC/3ZdK1+TOwVXcEkb9UBvMK2qRsjpZQl3blWw+3KQPtGe0ClR NXyU8svAdRqiX+2ICoLArC3TEqBkQAe5ZjnqR2WvkqBbZf+6nC5eXiUqWNsiw/CqrHlc n85VTJmetVFhezkxkPgvQnNmNsBiqCDFC0/JShsZmp9xY25WMshxULVEKY6Ce97Mh4S1 gQ70c66wzSPbMTGwg0fb8FnVxf4c5kqPUQgwNAamGpnsf0wWkpX9pTkF09Tno2MHX/AH WrH4zqPIfN1HGOIFSBe0KYV5CWzHWVl7DcUiTzjQQKr5o9nuck1lY0V82puKn/PpWx6a /54w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:content-transfer-encoding :in-reply-to:user-agent; bh=JA7Rhrqc7aEuJVy33oPPYfGPp9y0rZ5Y54wbGN9YIoM=; b=kNfAlCYney4imbkSD/Zb0yjDRcpkmm1wVUhPiOo7WR7T6VBMd+z2A3SBSi2GPqRtHh v+NlLQzFt90E6tViOOTmsr/OTxEOGMPqkCVx7793/4Kjw+A+Xre54cmrWtSaqtNimRML ZgffkMpOiVOfR1iyNhfC3wJV6neLB3CQkUoqPnX38gD9dvnoaAZSkhqDbbX67V6gZ4Ot +NMckcl5L7tibU+5HQrp+HGZkG+JekQEUGGifLk3aow2/PuUmzYbxjN7exb67P8P6aXC nEosIQEMTKUZbCviDwYajFVOxJ7MdudMrAeUxIehJPs4X4oDsNuGXyOA7Hzys6w9Vlyh YYLw== X-Gm-Message-State: AMCzsaW1nmTO+uhsAdB13fT6fpo1ZaotVfeYu+CXkPsBB15VYqa5UHcS y3x0xotygYTXgsGzyAWKKKL/yA== X-Google-Smtp-Source: ABhQp+QDCT3Z3OzFVdruC5iVxRP5BKqZ1q6C6y6Qvj0YIhOEID8B/lb1B7bphcdr+xDE5FhrOVTmLw== X-Received: by 10.28.8.145 with SMTP id 139mr2103133wmi.115.1508425741931; Thu, 19 Oct 2017 08:09:01 -0700 (PDT) Received: from bidouze.vm.6wind.com (host.78.145.23.62.rev.coltfrance.com. [62.23.145.78]) by smtp.gmail.com with ESMTPSA id r23sm10964223wrc.93.2017.10.19.08.09.00 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 19 Oct 2017 08:09:00 -0700 (PDT) Date: Thu, 19 Oct 2017 17:08:49 +0200 From: =?iso-8859-1?Q?Ga=EBtan?= Rivet To: Matan Azrad Cc: dev@dpdk.org Message-ID: <20171019150849.GG3596@bidouze.vm.6wind.com> References: <1508139710-12798-1-git-send-email-matan@mellanox.com> <1508423514-28557-1-git-send-email-matan@mellanox.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <1508423514-28557-1-git-send-email-matan@mellanox.com> User-Agent: Mutt/1.5.23 (2014-03-12) Subject: Re: [dpdk-dev] [PATCH v2] net/failsafe: improve stats accuracy X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Oct 2017 15:09:02 -0000 Hello Matan, Adding the time delta should have been done in a separate commit. Can you please divide this patch in two? The first one will only attempt the ultimate stat read, the second one would add the delay warning. Small nit below for your v3. On Thu, Oct 19, 2017 at 02:31:54PM +0000, Matan Azrad wrote: > The stats_get API was changed to signal a potential failure to read > stats. Furthermore, some PMDs are able to provide statistics even after > a removal event occurred. > > Considering this, the fail-safe can try to access the latest statistics > of a PMD to improve statistics accuracy. > > Attempt an ultimate statistics read on removal time; if that fails, use > the latest recorded snapshot. > > Signed-off-by: Matan Azrad > --- > drivers/net/failsafe/failsafe_ether.c | 19 +++++++++++++++++-- > drivers/net/failsafe/failsafe_ops.c | 10 ++++++++-- > drivers/net/failsafe/failsafe_private.h | 7 ++++++- > 3 files changed, 31 insertions(+), 5 deletions(-) > > diff --git a/drivers/net/failsafe/failsafe_ether.c b/drivers/net/failsafe/failsafe_ether.c > index f4db423..df38360 100644 > --- a/drivers/net/failsafe/failsafe_ether.c > +++ b/drivers/net/failsafe/failsafe_ether.c > @@ -35,6 +35,7 @@ > > #include > #include > +#include > > #include "failsafe_private.h" > > @@ -312,9 +313,23 @@ > static void > fs_dev_stats_save(struct sub_device *sdev) > { > + struct rte_eth_stats stats; > + int err; > + > + /* Attempt to read current stats. */ > + err = rte_eth_stats_get(PORT_ID(sdev), &stats); > + if (err) { > + uint64_t cycles = sdev->stats_snapshot.cycles; > + > + WARN("Could not access latest statistics from sub-device %d.\n", > + SUB_ID(sdev)); > + if (cycles != 0) > + WARN("Using latest snapshot taken before %lu seconds.\n", > + (rte_rdtsc() - cycles) / rte_get_tsc_hz()); > + } > failsafe_stats_increment(&PRIV(sdev->fs_dev)->stats_accumulator, > - &sdev->stats_snapshot); > - memset(&sdev->stats_snapshot, 0, sizeof(struct rte_eth_stats)); > + err ? &sdev->stats_snapshot.stats : &stats); > + memset(&sdev->stats_snapshot, 0, sizeof(sdev->stats_snapshot)); > } > > static inline int > diff --git a/drivers/net/failsafe/failsafe_ops.c b/drivers/net/failsafe/failsafe_ops.c > index d360965..818f12d 100644 > --- a/drivers/net/failsafe/failsafe_ops.c > +++ b/drivers/net/failsafe/failsafe_ops.c > @@ -38,6 +38,7 @@ > #include > #include > #include > +#include > > #include "failsafe_private.h" > > @@ -592,13 +593,18 @@ > > rte_memcpy(stats, &PRIV(dev)->stats_accumulator, sizeof(*stats)); > FOREACH_SUBDEV_STATE(sdev, i, dev, DEV_ACTIVE) { > - ret = rte_eth_stats_get(PORT_ID(sdev), &sdev->stats_snapshot); > + struct rte_eth_stats *snapshot = &sdev->stats_snapshot.stats; > + uint64_t *cycles = &sdev->stats_snapshot.cycles; > + > + ret = rte_eth_stats_get(PORT_ID(sdev), snapshot); > if (ret) { > ERROR("Operation rte_eth_stats_get failed for sub_device %d with error %d", > i, ret); > + *cycles = 0; > return ret; > } > - failsafe_stats_increment(stats, &sdev->stats_snapshot); > + *cycles = rte_rdtsc(); > + failsafe_stats_increment(stats, snapshot); > } > return 0; > } > diff --git a/drivers/net/failsafe/failsafe_private.h b/drivers/net/failsafe/failsafe_private.h > index d343ebf..1df52f4 100644 > --- a/drivers/net/failsafe/failsafe_private.h > +++ b/drivers/net/failsafe/failsafe_private.h > @@ -93,6 +93,11 @@ enum dev_state { > DEV_STARTED, > }; > > +struct fs_stats { > + struct rte_eth_stats stats; > + uint64_t cycles; What do you think of the name "timestamp" for this field? It would be more descriptive of its use. > +}; > + > struct sub_device { > /* Exhaustive DPDK device description */ > struct rte_devargs devargs; > @@ -103,7 +108,7 @@ struct sub_device { > /* Device state machine */ > enum dev_state state; > /* Last stats snapshot passed to user */ > - struct rte_eth_stats stats_snapshot; > + struct fs_stats stats_snapshot; > /* Some device are defined as a command line */ > char *cmdline; > /* fail-safe device backreference */ > -- > 1.8.3.1 > Thanks, -- Gaëtan Rivet 6WIND