test suite reviews and discussions
 help / color / mirror / Atom feed
* [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain
@ 2017-03-14  7:24 gangx.yang
  2017-03-14  7:24 ` [dts] [PATCH V2 1/2]test-crypto-perf:Add crypto performance auto test code gangx.yang
  2017-03-14  7:24 ` [dts] [PATCH V2 2/2]test-crypto-perf:add crypto performance test plan gangx.yang
  0 siblings, 2 replies; 4+ messages in thread
From: gangx.yang @ 2017-03-14  7:24 UTC (permalink / raw)
  To: dts; +Cc: Gang Yang

From: Gang Yang <gangx.yang@intel.com>

* delete unserviceable lib 
* update invalid cipher-op for aes-gcm algorithm
* update incorrect algoritm map in test plan 

Gang Yang (2):
  deleted unserviceable lib
  update test plan doc

 test_plans/crypto_perf_test_plan.rst | 104 +++++++++++++++++------------------
 tests/TestSuite_crypto_perf.py       |   9 ++-
 2 files changed, 56 insertions(+), 57 deletions(-)

-- 
2.5.5

^ permalink raw reply	[flat|nested] 4+ messages in thread

* [dts] [PATCH V2 1/2]test-crypto-perf:Add crypto performance auto test code
  2017-03-14  7:24 [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain gangx.yang
@ 2017-03-14  7:24 ` gangx.yang
  2017-03-14  7:24 ` [dts] [PATCH V2 2/2]test-crypto-perf:add crypto performance test plan gangx.yang
  1 sibling, 0 replies; 4+ messages in thread
From: gangx.yang @ 2017-03-14  7:24 UTC (permalink / raw)
  To: dts; +Cc: Gang Yang

From: Gang Yang <gangx.yang@intel.com>

* delete unserviceable lib
* update invalid cipher-op for aes-gcm algorithm

Signed-off-by: Gang Yang <gangx.yang@intel.com>
---
 tests/TestSuite_crypto_perf.py | 9 ++++-----
 1 file changed, 4 insertions(+), 5 deletions(-)

diff --git a/tests/TestSuite_crypto_perf.py b/tests/TestSuite_crypto_perf.py
index aaf79fe..e6f6c2e 100755
--- a/tests/TestSuite_crypto_perf.py
+++ b/tests/TestSuite_crypto_perf.py
@@ -42,8 +42,6 @@ import copy
 import time
 import random
 from test_case import TestCase
-sys.path.append("/root")
-from CryptoMobile.CM import *
 
 class TestL2fwdCrypto(TestCase):
 
@@ -439,7 +437,6 @@ class TestL2fwdCrypto(TestCase):
                 else:
                     map_combine[temp_str] = len(test_vector_list)
         for k,v in alg_map.iteritems():
-            
             self.logger.info("Total {name} cases:\t\t\t{number}".format(name=k,number=v))
         for k,v in pmd_map.iteritems():
             self.logger.info("Total {name} cases:\t\t\t{number}".format(name=k,number=v))
@@ -489,7 +486,9 @@ class TestL2fwdCrypto(TestCase):
                 value_data_list = data_list.split(";")
                 if length == count :
                     data_finished = True
-                latency = latency + self.__buffer_size_result_check(value_data_list[1],value_data_list[5],value_data_list[4],data_finished)
+                latency = latency + self.__buffer_size_result_check( \
+                                        value_data_list[1],value_data_list[5], \
+                                        value_data_list[4],data_finished)
         latency = latency + "\n"
         return latency
     
@@ -1075,7 +1074,7 @@ test_vectors = {
         "ptest": ["throughput","latency"],
         "optype": ["aead"],
         "cipher-algo": ["aes-gcm"],
-        "cipher-op": ["aead"],
+        "cipher-op": ["encrypt", "decrypt"],
         "cipher-key-sz": [16, 24, 32],
         "cipher-iv-sz": [16],
         "auth-algo": ["aes-gcm","aes-gmac","md5-hmac", "sha1-hmac", "sha2-224-hmac", "sha2-256-hmac",
-- 
2.5.5

^ permalink raw reply	[flat|nested] 4+ messages in thread

* [dts] [PATCH V2 2/2]test-crypto-perf:add crypto performance test plan
  2017-03-14  7:24 [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain gangx.yang
  2017-03-14  7:24 ` [dts] [PATCH V2 1/2]test-crypto-perf:Add crypto performance auto test code gangx.yang
@ 2017-03-14  7:24 ` gangx.yang
  1 sibling, 0 replies; 4+ messages in thread
From: gangx.yang @ 2017-03-14  7:24 UTC (permalink / raw)
  To: dts; +Cc: Gang Yang

From: Gang Yang <gangx.yang@intel.com>

* update incorrect algoritm map in test plan

Signed-off-by: Gang Yang <gangx.yang@intel.com>
---
 test_plans/crypto_perf_test_plan.rst | 104 +++++++++++++++++------------------
 1 file changed, 52 insertions(+), 52 deletions(-)

diff --git a/test_plans/crypto_perf_test_plan.rst b/test_plans/crypto_perf_test_plan.rst
index 6c043a9..7d5ee0d 100755
--- a/test_plans/crypto_perf_test_plan.rst
+++ b/test_plans/crypto_perf_test_plan.rst
@@ -39,8 +39,8 @@ Description
 ===========
 
 This document provides the test plan for testing Cryptodev performance by 
-crypto perf application. The crypto perf application is a DPDK example under 
-DPDK examples folder. 
+crypto perf application. The crypto perf application is a DPDK app under 
+DPDK app folder. 
 
 Crypto perf application supports most of Cryptodev PMDs(polling mode dirver)
 Intel QuickAssist Technology DH895xxC/DH_C62xx hardware 
@@ -55,21 +55,21 @@ Part of the algorithms are not supported currently.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CBC               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | cbc               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CTR               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | ctr               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| MD      |                   |  MD5                                                                      | 
+| md      |                   |  md5                                                                      | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| SHA     |                   |  SHA-1, SHA2-224, SHA2-384, SHA2-256, SHA2-512                            | 
+| sha     |                   |  sha1, sha2-224, sha2-384, sha2-256, sha2-512                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| HMAC    |                   |  Support MD5 and SHA implementations SHA-1, SHA2-224, SHA2-256,           |
-|         |                   |  SHA2-384, SHA2-512                                                       |
+| hmac    |                   |  Support md5 and sha implementations sha1, sha2-224, sha2-256,            |
+|         |                   |  sha2-384, sha2-512                                                       |
 |         |                   |  Key Size versus Block size support: Key Size must be <= block size;      |
-|         |                   |  Mac Len Supported SHA-1 10, 12, 16, 20 bytes;                            |
-|         |                   |  Mac Len Supported SHA2-256 16, 24, 32 bytes;                             |
-|         |                   |  Mac Len Supported SHA2-384 24,32, 40, 48 bytes;                          |
-|         |                   |  Mac Len Supported SHA2-512 32, 40, 48, 56, 64 bytes;                     |
+|         |                   |  Mac Len Supported sha1 10, 12, 16, 20 bytes;                             |
+|         |                   |  Mac Len Supported sha2-256 16, 24, 32 bytes;                             |
+|         |                   |  Mac Len Supported sha2-384 24,32, 40, 48 bytes;                          |
+|         |                   |  Mac Len Supported sha2-512 32, 40, 48, 56, 64 bytes;                     |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
 
 QAT algorithm table:
@@ -80,40 +80,40 @@ Part of the algorithms are not supported currently.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CBC               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | cbc               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CTR               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | ctr               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| 3DES    | CBC               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
+| 3des    | cbc               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| 3DES    | CTR               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
+| 3des    | ctr               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| MD      |                   |  MD5                                                                      | 
+| md      |                   |  md5                                                                      | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| SHA     |                   |  SHA-1, SHA2-224, SHA2-256, SHA2-384, SHA2-512                            |
+| sha     |                   |  sha1, sha2-224, sha2-256, sha2-384, sha2-512                             |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| HMAC    |                   |  Support MD5 and SHA implementations SHA-1, SHA2-224, SHA2-256,           |
-|         |                   |  SHA2-384, SHA2-512                                                       |
+| hmac    |                   |  Support md5 and sha implementations sha1, sha2-224, sha2-256,            |
+|         |                   |  sha2-384, sha2-512                                                       |
 |         |                   |  Key Size versus Block size support: Key Size must be <= block size;      |
-|         |                   |  Mac Len Supported SHA-1 10, 12, 16, 20 bytes;                            |
-|         |                   |  Mac Len Supported SHA2-256 16, 24, 32 bytes;                             |
-|         |                   |  Mac Len Supported SHA2-384 24,32, 40, 48 bytes;                          |
-|         |                   |  Mac Len Supported SHA2-512 32, 40, 48, 56, 64 bytes;                     |
+|         |                   |  Mac Len Supported sha1 10, 12, 16, 20 bytes;                             |
+|         |                   |  Mac Len Supported sha2-256 16, 24, 32 bytes;                             |
+|         |                   |  Mac Len Supported sha2-384 24,32, 40, 48 bytes;                          |
+|         |                   |  Mac Len Supported sha2-512 32, 40, 48, 56, 64 bytes;                     |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     |  GCM              |  Key Sizes:128, 192, 256 bits;                                            |
+| aes     |  gcm              |  Key Sizes:128, 192, 256 bits;                                            |
 |         |                   |  Associated Data Length: 0 ~ 240 bytes;                                   |
 |         |                   |  Payload Length: 0 ~ (2^32 -1) bytes;                                     |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 96 bits;                                                     |
 |         |                   |  Tag Lengths: 8, 12, 16 bytes;                                            |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| Kasumi  |  F8               |  Encrypt/Decrypt; Key size: 128                                           |
+| kasumi  |  f8               |  Encrypt/Decrypt; Key size: 128                                           |
 +         +---------+---------+---------+----------+----------+----------+----------+----------+----------+
-|         |  F9               |  Generate/Verify; Key size: 128                                           |
+|         |  f9               |  Generate/Verify; Key size: 128                                           |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| Snow3G  |  UEA2             |  Encrypt/Decrypt; Key size: 128                                           |
+| snow3g  |  uea2             |  Encrypt/Decrypt; Key size: 128                                           |
 +         +---------+---------+---------+----------+----------+----------+----------+----------+----------+
-|         |  UIA2             |  Generate/Verify; Key size: 128                                           |
+|         |  uia2             |  Generate/Verify; Key size: 128                                           |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
 
 AESNI_GCM algorithm table 
@@ -124,7 +124,7 @@ in crypto perf
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     |  GCM              |  Encrypt/Decrypt;Key Sizes:128, 256 bits;                                 |
+| aes     |  gcm              |  Encrypt/Decrypt;Key Sizes:128, 256 bits;                                 |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 96 bits;                                                     |
 |         |                   |  Generate/Verify;Key Sizes:128,192,256 bits;                              |
@@ -132,7 +132,7 @@ in crypto perf
 |         |                   |  Payload Length: 0 ~ (2^32 -1) bytes;                                     |
 |         |                   |  Tag Lengths: 8, 12, 16 bytes;                                            | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | GMAC              |  Generate/Verify;Key Sizes:128,192,256 bits;                              | 
+| aes     | gmac              |  Generate/Verify;Key Sizes:128,192,256 bits;                              | 
 |         |                   |  Associated Data Length: 0 ~ 240 bytes;                                   |
 |         |                   |  Payload Length: 0 ~ (2^32 -1) bytes;                                     |
 |         |                   |  Tag Lengths: 8, 12, 16 bytes;                                            | 
@@ -146,7 +146,7 @@ Part of the algorithms are not supported currently.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| NULL    |  NULL             |  Encrypt/Decrypt;Key Sizes:0 bits;                                        |
+| null    |  null             |  Encrypt/Decrypt;Key Sizes:0 bits;                                        |
 |         |                   |  IV Lengths: 0 bits;                                                      |
 |         |                   |  Generate/Verify;Key Sizes:0 bits;                                        |
 |         |                   |  Associated Data Length: 1 bytes;                                         |
@@ -161,11 +161,11 @@ The table below contains KASUMI algorithms which are supported in crypto perf.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| KASUMI  |  F8               |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
+| kasumi  |  f8               |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 64 bits;                                                     |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| KASUMI  |  F9               |  Generate/Verify;Key Sizes:128  bits;                                     | 
+| kasumi  |  f9               |  Generate/Verify;Key Sizes:128  bits;                                     | 
 |         |                   |  Payload Length: 64 bytes;                                                |
 |         |                   |  Tag Lengths: 4 bytes;                                                    | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
@@ -177,11 +177,11 @@ The table below contains SNOW3G algorithms which are supported in crypto perf.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| SNOW3G  |  UEA2             |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
+| snow3g  |  uea2             |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 128 bits;                                                    |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| SNOW3G  |  UIA2             |  Generate/Verify;Key Sizes:128  bits;                                     | 
+| snow3g  |  uia2             |  Generate/Verify;Key Sizes:128  bits;                                     | 
 |         |                   |  Payload Length: 128 bytes;                                               |
 |         |                   |  Tag Lengths: 4 bytes;                                                    | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
@@ -193,11 +193,11 @@ The table below contains ZUC algorithms which are supported in crypto perf.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| ZUC     |  EEA3             |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
+| zuc     |  eea3             |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 128 bits;                                                    |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| ZUC     |  EIA2             |  Generate/Verify;Key Sizes:128  bits;                                     | 
+| zuc     |  eia2             |  Generate/Verify;Key Sizes:128  bits;                                     | 
 |         |                   |  Payload Length: 128 bytes;                                               |
 |         |                   |  Tag Lengths: 4 bytes;                                                    | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
@@ -209,27 +209,27 @@ The table below contains OPENSSL algorithms which are supported in crypto perf.
 |Algorithm|  Mode             | Detail                                                                    | 
 |         |                                                                                               |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CBC               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | cbc               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | CTR               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
+| aes     | ctr               |  Encrypt/Decrypt;Key size: 128, 192, 256 bits                             | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| 3DES    | CBC               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
+| 3des    | cbc               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| 3DES    | CTR               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
+| 3des    | ctr               |  Encrypt/Decrypt;Key size: 128, 192 bits                                  | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| MD      |                   |  MD5                                                                      | 
+| md      |                   |  md5                                                                      | 
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| SHA     |                   |  SHA-1, SHA2-224, SHA2-256, SHA2-384, SHA2-512                            |
+| sha     |                   |  sha1, sha2-224, sha2-256, sha2-384, sha2-512                             |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| HMAC    |                   |  Support MD5 and SHA implementations SHA-1, SHA2-224, SHA2-256,           |
-|         |                   |  SHA2-384, SHA2-512                                                       |
+| hmac    |                   |  Support md5 and sha implementations sha1, sha2-224, sha2-256,            |
+|         |                   |  sha2-384, sha2-512                                                       |
 |         |                   |  Key Size versus Block size support: Key Size must be <= block size;      |
-|         |                   |  Mac Len Supported SHA-1 10, 12, 16, 20 bytes;                            |
-|         |                   |  Mac Len Supported SHA2-256 16, 24, 32 bytes;                             |
-|         |                   |  Mac Len Supported SHA2-384 24,32, 40, 48 bytes;                          |
-|         |                   |  Mac Len Supported SHA2-512 32, 40, 48, 56, 64 bytes;                     |
+|         |                   |  Mac Len Supported sha1 10, 12, 16, 20 bytes;                             |
+|         |                   |  Mac Len Supported sha2-256 16, 24, 32 bytes;                             |
+|         |                   |  Mac Len Supported sha2-384 24,32, 40, 48 bytes;                          |
+|         |                   |  Mac Len Supported sha2-512 32, 40, 48, 56, 64 bytes;                     |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     |  GCM              |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
+| aes     |  gcm              |  Encrypt/Decrypt;Key Sizes:128 bits;                                      |
 |         |                   |  IV source: external;                                                     |
 |         |                   |  IV Lengths: 96 bits;                                                     |
 |         |                   |  Associated Data Length: 0 ~ 240 bytes;                                   |
@@ -237,7 +237,7 @@ The table below contains OPENSSL algorithms which are supported in crypto perf.
 |         |                   |  Payload Length: 64,128 bytes;                                            |
 |         |                   |  Tag Lengths: 16 bytes;                                                   |
 +---------+---------+---------+---------+----------+----------+----------+----------+----------+----------+
-| AES     | GMAC              |  Generate/Verify;Key Sizes:128,192,256 bits;                              | 
+| aes     | gmac              |  Generate/Verify;Key Sizes:128,192,256 bits;                              | 
 |         |                   |  Associated Data Length: 0 ~ 240 bytes;                                   |
 |         |                   |  Payload Length: 8 ~ (2^32 -4) bytes;                                     |
 |         |                   |  Tag Lengths:16 bytes;                                                    | 
-- 
2.5.5

^ permalink raw reply	[flat|nested] 4+ messages in thread

* [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain
@ 2017-03-16  2:25 gangx.yang
  0 siblings, 0 replies; 4+ messages in thread
From: gangx.yang @ 2017-03-16  2:25 UTC (permalink / raw)
  To: dts; +Cc: Gang Yang

From: Gang Yang <gangx.yang@intel.com>

v3:
 -pep8 passed  

Gang Yang (2):
  update test plan doc
  update crypto performance test code to pass pep8

 test_plans/crypto_perf_test_plan.rst | 104 ++--
 tests/TestSuite_crypto_perf.py       | 901 +++++++++++++++++------------------
 2 files changed, 499 insertions(+), 506 deletions(-)

-- 
2.5.5

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2017-03-16  2:30 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-03-14  7:24 [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain gangx.yang
2017-03-14  7:24 ` [dts] [PATCH V2 1/2]test-crypto-perf:Add crypto performance auto test code gangx.yang
2017-03-14  7:24 ` [dts] [PATCH V2 2/2]test-crypto-perf:add crypto performance test plan gangx.yang
2017-03-16  2:25 [dts] [PATCH V2 0/2]test-crypto-perf: Add crypto performance auto test code and test plain gangx.yang

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).