From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <test-report-bounces@dpdk.org>
Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124])
	by inbox.dpdk.org (Postfix) with ESMTP id C54F745501
	for <public@inbox.dpdk.org>; Wed, 26 Jun 2024 15:19:50 +0200 (CEST)
Received: from mails.dpdk.org (localhost [127.0.0.1])
	by mails.dpdk.org (Postfix) with ESMTP id 71A5E434E3;
	Wed, 26 Jun 2024 15:19:49 +0200 (CEST)
Received: from mail-io1-f98.google.com (mail-io1-f98.google.com
 [209.85.166.98]) by mails.dpdk.org (Postfix) with ESMTP id 81CE840660
 for <test-report@dpdk.org>; Wed, 26 Jun 2024 15:11:31 +0200 (CEST)
Received: by mail-io1-f98.google.com with SMTP id
 ca18e2360f4ac-7f3b36cc47bso143396039f.0
 for <test-report@dpdk.org>; Wed, 26 Jun 2024 06:11:31 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=iol.unh.edu; s=unh-iol; t=1719407491; x=1720012291; darn=dpdk.org;
 h=references:in-reply-to:cc:to:from:subject:message-id:date:from:to
 :cc:subject:date:message-id:reply-to;
 bh=p9MJF83Oe7314Ki2PJieyPEvD4y4eKiGDGW0UAUcO4U=;
 b=ARa8b5HrXTF8rFzHsEOpqGSJTk0McK+3GYuXMr0eGSzhCNuWQPZtHEBXKtMfX9heJQ
 GR2BNS5RRuMnYmL2qdllskloZoFtydZZGbiFITSHbJ4kSfHR6NkZOq+4l+068+/Q57NV
 rUgxuD2vSFmwmA4HH2oP47wVWeIYg2TTHPaPs=
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1719407491; x=1720012291;
 h=references:in-reply-to:cc:to:from:subject:message-id:date
 :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
 bh=p9MJF83Oe7314Ki2PJieyPEvD4y4eKiGDGW0UAUcO4U=;
 b=Qf9sgHJz4K4z43zB97j1C4gbM42kq41AgmJzfmQIy59t3dqpz4qsYjRrmEz43zZlAa
 OECETJNUp9puBYGYcHPjeaDKqxRrTnX/GZMsGtEln2UWQcM31UJC+Jg5l3RnS+ZvUQ9P
 o7Nb5aaby06wDdzwBmD5aLyw3hjBQ/zfepmf0AA71gRf+a7r2QkjIynLxNoErXAZtmUd
 D7ulObA29Fke8Ugcma/4eYSk75tew1p8TFDneyLIyo5iRNTkln5UAtfH/PGtgc/j5UOc
 oFjtIK5UyCa7/DntH2m3oDZtKX9iN864XlM4r52EcR5g4f4rLX8lpHoSqeS4thCWyZ3H
 klKQ==
X-Gm-Message-State: AOJu0Yyvz8ZANcZ6avFKkYNLs36BuqxgMRX9Cmkqcab5RZBLPEwXL4l5
 90suAmuXd+xfCl0ahVVOaVKNDLSnbntabnEDXgm3RYgzb0v8OtuZ372EwNZaxgxFVZHftyd0VLA
 FRPQ0esizMhXTJvx/zx0Exas4PS9YWf2HMlBd/cp631LIQ0CbYnOM06F/
X-Google-Smtp-Source: AGHT+IGVCpIkG2LpUa9jT+l7jaXvKkurGX49Kfg4v69m6DWJYc/odAeJKdokKap633LWw7vtUpd+OxSA/2QR
X-Received: by 2002:a05:6602:6b86:b0:7f3:ad73:a83 with SMTP id
 ca18e2360f4ac-7f3ad73111bmr1050113439f.0.1719407490919; 
 Wed, 26 Jun 2024 06:11:30 -0700 (PDT)
Received: from postal.iol.unh.edu (postal.iol.unh.edu.
 [2606:4100:3880:1234::84]) by smtp-relay.gmail.com with ESMTPS id
 8926c6da1cb9f-4b9e8efddcasm122815173.3.2024.06.26.06.11.30
 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128);
 Wed, 26 Jun 2024 06:11:30 -0700 (PDT)
X-Relaying-Domain: iol.unh.edu
Date: Wed, 26 Jun 2024 06:11:30 -0700 (PDT)
Message-ID: <667c1382.050a0220.6d21d.84c1SMTPIN_ADDED_MISSING@mx.google.com>
Received: from [172.21.0.7] (unknown [172.18.0.240])
 by postal.iol.unh.edu (Postfix) with ESMTP id 26AB4605C378;
 Wed, 26 Jun 2024 09:11:30 -0400 (EDT)
Subject: |FAILURE| pw141760 [PATCH] [v2] examples/fips_validation: fix coveri
From: dpdklab@iol.unh.edu
To: Test Report <test-report@dpdk.org>, Ferruh Yigit <ferruh.yigit@intel.com>,
 Georgii Tkachuk <georgii.tkachuk@intel.com>, Qian Xu <qian.q.xu@intel.com>,
 Lijuan Tu <lijuan.tu@intel.com>
Cc: dpdk-test-reports@iol.unh.edu,
 Gowrishankar Muthukrishnan <gmuthukrishn@marvell.com>
In-Reply-To: <20240626102626.1934-1-gmuthukrishn@marvell.com>
References: <20240626102626.1934-1-gmuthukrishn@marvell.com>
Content-Type: text/plain
X-BeenThere: test-report@dpdk.org
X-Mailman-Version: 2.1.29
Precedence: list
List-Id: automatic DPDK test reports <test-report.dpdk.org>
List-Unsubscribe: <https://mails.dpdk.org/options/test-report>,
 <mailto:test-report-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://mails.dpdk.org/archives/test-report/>
List-Post: <mailto:test-report@dpdk.org>
List-Help: <mailto:test-report-request@dpdk.org?subject=help>
List-Subscribe: <https://mails.dpdk.org/listinfo/test-report>,
 <mailto:test-report-request@dpdk.org?subject=subscribe>
Errors-To: test-report-bounces@dpdk.org

Test-Label: iol-intel-Performance
Test-Status: FAILURE
http://dpdk.org/patch/141760

_Performance Testing issues_

Submitter: Gowrishankar Muthukrishnan <gmuthukrishn@marvell.com>
Date: Wednesday, June 26 2024 10:26:23 
DPDK git baseline: Repo:dpdk
  Branch: master
  CommitID:9ab7baa5c14b1ba928c09bda4734827d6d367d6b

141760 --> performance testing issues

Test environment and result as below:

22.04
Kernel: 5.15.0-94-generic
Compiler: gcc 11.4.0
NIC: Intel E810 100000 Mbps
Target: Unknown
Fail/Total: 1/4
Failed cases list:
      - DTS https://dpdklab.iol.unh.edu/results/testcases/1/

Detail performance results: 
+------------+---------+----------+-------------+------------------------------+
| frame_size | txd/rxd | num_cpus | num_threads |  throughput difference from  |
|            |         |          |             |           expected           |
+============+=========+==========+=============+==============================+
| 64         | 512     | 1        | 2           | 1.8%                         |
+------------+---------+----------+-------------+------------------------------+
| 64         | 2048    | 1        | 2           | -0.5%                        |
+------------+---------+----------+-------------+------------------------------+
| 64         | 512     | 1        | 1           | -0.3%                        |
+------------+---------+----------+-------------+------------------------------+
| 64         | 2048    | 1        | 1           | -12.4%                       |
+------------+---------+----------+-------------+------------------------------+

Ubuntu 20.04 ARM
Kernel: 5.15.0-97-generic
Compiler: gcc 11.4.0
NIC: Arm Intel Corporation Ethernet Converged Network Adapter XL710-QDA2 40000 Mbps
Target: Unknown
Fail/Total: 0/2

Detail performance results: 
+------------+---------+----------+-------------+------------------------------+
| frame_size | txd/rxd | num_cpus | num_threads |  throughput difference from  |
|            |         |          |             |           expected           |
+============+=========+==========+=============+==============================+
| 64         | 512     | 1        | 1           | -0.9%                        |
+------------+---------+----------+-------------+------------------------------+
| 64         | 2048    | 1        | 1           | 0.0%                         |
+------------+---------+----------+-------------+------------------------------+

Ubuntu 20.04
Kernel: 5.4.0-122-generic
Compiler: gcc 9.4.0
NIC: Intel Corporation Ethernet Converged Network Adapter XL710-QDA2 40000 Mbps
Target: Unknown
Fail/Total: 0/4

Detail performance results: 
+----------+-------------+---------+------------+------------------------------+
| num_cpus | num_threads | txd/rxd | frame_size |  throughput difference from  |
|          |             |         |            |           expected           |
+==========+=============+=========+============+==============================+
| 1        | 2           | 512     | 64         | 0.7%                         |
+----------+-------------+---------+------------+------------------------------+
| 1        | 2           | 2048    | 64         | -0.8%                        |
+----------+-------------+---------+------------+------------------------------+
| 1        | 1           | 512     | 64         | -2.3%                        |
+----------+-------------+---------+------------+------------------------------+
| 1        | 1           | 2048    | 64         | 2.1%                         |
+----------+-------------+---------+------------+------------------------------+

Ubuntu 20.04
Kernel: 5.4.0-122-generic
Compiler: gcc 9.4.0
NIC: Intel Corporation Ethernet Converged Network Adapter 82599ES 10000 Mbps
Target: Unknown
Fail/Total: 0/6

Detail performance results: 
+----------+-------------+---------+------------+------------------------------+
| num_cpus | num_threads | txd/rxd | frame_size |  throughput difference from  |
|          |             |         |            |           expected           |
+==========+=============+=========+============+==============================+
| 1        | 2           | 128     | 64         | 0.1%                         |
+----------+-------------+---------+------------+------------------------------+
| 1        | 2           | 512     | 64         | -0.0%                        |
+----------+-------------+---------+------------+------------------------------+
| 1        | 2           | 2048    | 64         | -0.1%                        |
+----------+-------------+---------+------------+------------------------------+
| 1        | 1           | 128     | 64         | -0.2%                        |
+----------+-------------+---------+------------+------------------------------+
| 1        | 1           | 512     | 64         | 0.3%                         |
+----------+-------------+---------+------------+------------------------------+
| 1        | 1           | 2048    | 64         | -0.2%                        |
+----------+-------------+---------+------------+------------------------------+

To view detailed results, visit:
https://lab.dpdk.org/results/dashboard/patchsets/30319/

UNH-IOL DPDK Community Lab

To manage your email subscriptions, visit: 
https://lab.dpdk.org/results/dashboard/preferences/subscriptions/