From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f54.google.com (mail-wm0-f54.google.com [74.125.82.54]) by dpdk.org (Postfix) with ESMTP id 670139ACC for ; Wed, 22 Jun 2016 16:07:07 +0200 (CEST) Received: by mail-wm0-f54.google.com with SMTP id f126so89382338wma.1 for ; Wed, 22 Jun 2016 07:07:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=wshMGmUb1J05usS3GI6sDlsJJp9EaW2MvVQVOtYS2JA=; b=MdM5KrJDt6Rm/2ghebv+KQFkTqQVphFhPxWqw5sR4Zn8XvZie3jC5u02+chMMthXcN huV09BSTDFD5916Fl/JSWk6IMsuk0l8ZFF1OwD7J9s4pzJylsWDEC8BoOyuY72T7JvOU Q0pxmm6mRZ33Ivx6SWY2jPiAvEtSbMV2IWr7SEm3t6pbhaBP4ouWUQcZyx3J+pwmDVbp N7EgRnMZC7KqEhN4IXKaSIL+Gbeg8xH/QiYIyW5DqM8VaxVdvZLYKWsRkxqWfYSPSNU/ I+fg+CMyrKlRNnYHRiRHj9KAfpK1pNWKY3wM+gwDCpJkanpCXiW2tiaU1QsgrtumVMDg YF3g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=wshMGmUb1J05usS3GI6sDlsJJp9EaW2MvVQVOtYS2JA=; b=EqBpTT7QY2yYP/uQbJLlxk13Q4vuiTRhfa/a8sXWEtT/Mn3slpfY/RdwZyqxKr/iO3 ebpvjFxMZDG7kRg7qmkKyWrGB+pQAkaZol8YSmS3teJbKCNuC3PfAjX0LP7Yf2B8ihgv Y9SgGXeNqLLO8altce+kpqVgChRoQqQ98ovPbLfQN0bYjkxFkJ62hL64sqSr3nvKcPEG XvYgMV8Lz5WxrhFHeqFYzmrr4MHEvHXqypR3Vb8gWYxW0EwburAV2eEy2V32cJpHbJ26 RIvEXURrwocZS6+LxWpKxPC7YplhaUwMUjGXJSQoD7AwDBzVGMbo/xw8DF477M2Ak/sw sE7A== X-Gm-Message-State: ALyK8tI2iQrIoKINNS0/7cNG6zfwrZf8oe1anhVIxhcbftuvDrTFZvb28o3Pw7VhNvslrnszFWfHDH+bkvzJOg== X-Received: by 10.28.73.212 with SMTP id w203mr8506249wma.98.1466604426526; Wed, 22 Jun 2016 07:07:06 -0700 (PDT) MIME-Version: 1.0 Received: by 10.194.14.1 with HTTP; Wed, 22 Jun 2016 07:07:05 -0700 (PDT) In-Reply-To: References: From: Chinmaya Dwibedy Date: Wed, 22 Jun 2016 19:37:05 +0530 Message-ID: To: users@dpdk.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] Issue with cryptodev_qat_autotest on CentOS 7.2 host system using dpdk-2.2.0 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Jun 2016 14:07:07 -0000 Hi , Here are the console logs during run of cryptodev_qat_autotest" under app/test. PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 0, bundle 0, ring 10 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_10, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 128 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 1, bundle 0, ring 11 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_11, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 2048 msgs: qp_id 0, bundle 0, ring 2 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 262144 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 12, in bytes 262144, nb msgs 2048, msg_size 128, max_inflights 2047 modulo 18 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 2048 msgs: qp id 0, bundle 0, ring 10 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_10, size 65536 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 10, in bytes 65536, nb msgs 2048, msg_size 32, max_inflights 2047 modulo 16 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 2048 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 262144 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 12, in bytes 262144, nb msgs 2048, msg_size 128, max_inflights 2047 modulo 18 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 2048 msgs: qp id 1, bundle 0, ring 11 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_11, size 65536 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 10, in bytes 65536, nb msgs 2048, msg_size 32, max_inflights 2047 modulo 16 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 4096 msgs: qp_id 0, bundle 0, ring 2 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 524288 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 13, in bytes 524288, nb msgs 4096, msg_size 128, max_inflights 4095 modulo 19 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 4096 msgs: qp id 0, bundle 0, ring 10 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_10, size 131072 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 11, in bytes 131072, nb msgs 4096, msg_size 32, max_inflights 4095 modulo 17 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 4096 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 524288 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 13, in bytes 524288, nb msgs 4096, msg_size 128, max_inflights 4095 modulo 19 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 4096 msgs: qp id 1, bundle 0, ring 11 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_11, size 131072 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 11, in bytes 131072, nb msgs 4096, msg_size 32, max_inflights 4095 modulo 17 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_crypto_sym_qp_setup(): Can't create qp for 4098 descriptors PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_crypto_sym_qp_setup(): Can't create qp for 4098 descriptors PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_setup(): Can't create qp for 4294967294 descriptors PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_setup(): Can't create qp for 4294967294 descriptors PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 128 msgs: qp_id 0, bundle 0, ring 2 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 0, bundle 0, ring 10 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_10, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 128 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 1, bundle 0, ring 11 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_11, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 129 msgs: qp_id 0, bundle 0, ring 2 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 16512 on socket 0 EAL: memzone_reserve_aligned_thread_unsafe(): Invalid alignment: 16512 PMD: qat_queue_create(): Failed to allocate ring memzone PMD: qat_crypto_sym_qp_setup(): Tx queue create failed queue_pair_id=0 PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_crypto_sym_qp_release(): >> PMD: adf_queue_arb_disable(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 129 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 16512 on socket 0 EAL: memzone_reserve_aligned_thread_unsafe(): Invalid alignment: 16512 PMD: qat_queue_create(): Failed to allocate ring memzone PMD: qat_crypto_sym_qp_setup(): Tx queue create failed queue_pair_id=1 CRYPTODEV: rte_cryptodev_queue_pair_setup() line 763: Invalid queue_pair_id=2 CRYPTODEV: rte_cryptodev_queue_pair_setup() line 763: Invalid queue_pair_id=65535 USER1: CRYPTO_MBUFPOOL count 8191 PMD: qat_crypto_sym_stats_get(): >> PMD: qat_crypto_sym_stats_get(): Uninitialised queue pair PMD: qat_crypto_sym_stats_get(): Uninitialised queue pair CRYPTODEV: rte_cryptodev_stop() line 690: Device with dev_id=0 already stopped + TestCase [ 2] : test_queue_pair_descriptor_setup succeeded CRYPTODEV: rte_cryptodev_queue_pairs_config() line 467: Setup 2 queues pairs on device 0 PMD: qat_dev_info_get(): >> CRYPTODEV: rte_crypto_session_pool_create() line 1031: cdev_0_sess_mp mempool created! PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 128 msgs: qp_id 0, bundle 0, ring 2 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_2, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 0, bundle 0, ring 10 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_10, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_qp_setup(): >> PMD: qat_tx_queue_create(): >> PMD: qat_tx_queue_create(): TX ring for 128 msgs: qp_id 1, bundle 0, ring 3 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_3, size 16384 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 8, in bytes 16384, nb msgs 128, msg_size 128, max_inflights 127 modulo 14 PMD: qat_rx_queue_create(): >> PMD: qat_rx_queue_create(): RX ring for 128 msgs: qp id 1, bundle 0, ring 11 PMD: qat_queue_create(): >> PMD: queue_dma_zone_reserve(): >> PMD: queue_dma_zone_reserve(): Allocate memzone for rte_qat_pmd_qp_mem_0_0_11, size 4096 on socket 0 PMD: qat_qp_check_queue_alignment(): >> PMD: adf_verify_queue_size(): >> PMD: qat_queue_create(): RING size in CSR: 6, in bytes 4096, nb msgs 128, msg_size 32, max_inflights 127 modulo 12 PMD: adf_configure_queues(): >> PMD: adf_queue_arb_enable(): >> PMD: qat_crypto_sym_stats_reset(): >> PMD: qat_crypto_sym_stats_reset(): QAT crypto: stats cleared CRYPTODEV: rte_cryptodev_start() line 636: Start dev_id=0 PMD: qat_dev_start(): >> PMD: qat_dev_info_get(): >> PMD: qat_crypto_sym_configure_session(): >> PMD: qat_alg_aead_session_create_content_desc(): >> PMD: qat_alg_do_precomputes(): >> PMD: partial_hash_compute(): >> PMD: partial_hash_compute(): >> PMD: qat_alg_init_common_hdr(): >> qat_req: at [0x7f35eb00c000], len=128 00000000: 00 03 04 80 44 00 00 00 90 5E D9 B4 0F 00 00 00 | ....D....^...... 00000010: 00 00 28 00 00 00 00 00 C0 0C 22 F8 35 7F 00 00 | ..(.......".5... 00000020: B0 0D 82 2F 0D 00 00 00 B0 0D 82 2F 0D 00 00 00 | .../......./.... 00000030: 50 02 00 00 50 02 00 00 10 00 00 00 00 02 00 00 | P...P........... 00000040: 00 01 02 03 04 05 06 07 08 09 0A 0B 0C 0D 0E 0F | ................ 00000050: 10 00 00 00 00 02 00 00 00 00 00 00 00 00 00 00 | ................ 00000060: C0 0F 82 2F 0D 00 00 00 00 00 00 40 02 02 00 41 | .../.......@...A 00000070: 00 00 10 12 00 00 40 40 00 40 1A 40 00 00 00 00 | ......@@.@.@.... Regards, Chinmaya On Wed, Jun 22, 2016 at 7:27 PM, Chinmaya Dwibedy wrote: > Hi All, > > > I do have CentOS Linux release 7.2.1511 (Core) host system, where two > Intel QAT devices are installed. I have installed dpdk-2.2.0 and QAT driver > as mentioned in section 6.4. (i.e., Installation using 01.org QAT driver) > of http://dpdk.readthedocs.io/en/v16.04/cryptodevs/qat.html. I tested > "cryptodev_qat_autotest" under app/test. I found this test case to be > failed. It appears that, it the dequeue burst API fails to retrieve any > processed operations available from the queue pair (on the QAT Crypto > device), from the devices processed queue. I have captured and attached > the console.log here. > > > Can anyone please suggest, is it an issue with the setup/configuration or > QAT PMD code? Kindly point me to right direction whenever you find me wrong.Thank > you in advance for your time and support. > > > Here goes my configuration. > > > > [root@localhost ~]# service qat_service status > > There is 2 acceleration device(s) in the system: > > icp_dev0 - type=dh895xcc, inst_id=0, node_id=1, bdf=83:00:0, #accel=6, > #engines=12, state=up > > icp_dev1 - type=dh895xcc, inst_id=1, node_id=1, bdf=88:00:0, #accel=6, > #engines=12, state=up > > > [root@localhost ~]# lspci -nn | grep 0435 > > 83:00.0 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT > [8086:0435] > > 88:00.0 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT > [8086:0435] > > [root@localhost ~]# > > > > > > [root@localhost ~]# lspci -nn|grep -e "QAT.*Virtual" > > 83:01.0 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 83:01.1 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 83:01.2 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 83:01.3 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 83:01.4 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 83:01.5 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > > ------------------------------------------------------------------------------------------------------------- > > ------------------------------------------------------------------------------------------------------------- > > > 88:04.1 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.2 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.3 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.4 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.5 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.6 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > 88:04.7 Co-processor [0b40]: Intel Corporation DH895XCC Series QAT Virtual > Function [8086:0443] > > > [root@localhost ~]# lspci -nn|grep -e "QAT.*Virtual" | wc -l > > 64 > > [root@localhost ~]# > > > Note: This host is capable of PCI passthrough and SR-IOV. > > > > [root@localhost ~]# grep -i dmar /var/log/dmesg > > [ 0.000000] ACPI: DMAR 000000007b69a000 00130 (v01 INTEL S2600WT > 00000001 INTL 20091013) > > [ 0.135336] dmar: Host address width 46 > > [ 0.135587] dmar: DRHD base: 0x000000fbffc000 flags: 0x0 > > [ 0.135855] dmar: IOMMU 0: reg_base_addr fbffc000 ver 1:0 cap > d2078c106f0466 ecap f020de > > [ 0.136309] dmar: DRHD base: 0x000000c7ffc000 flags: 0x1 > > [ 0.136569] dmar: IOMMU 1: reg_base_addr c7ffc000 ver 1:0 cap > d2078c106f0466 ecap f020de > > [ 0.137016] dmar: RMRR base: 0x0000007a3db000 end: 0x0000007a3ddfff > > [ 0.137274] dmar: ATSR flags: 0x0 > > [ 0.137522] dmar: ATSR flags: 0x0 > > [root@localhost ~]# grep -i "iommu.*enabled" /var/log/dmesg > > [ 0.000000] Intel-IOMMU: enabled > > > [root@localhost test(keystone_admin)]# cat /proc/cmdline > > BOOT_IMAGE=/vmlinuz-3.10.0-327.18.2.el7.x86_64 > root=/dev/mapper/centos-root ro rd.lvm.lv=centos/swap crashkernel=auto > nomodeset rd.lvm.lv=centos/root rhgb iommu=pt intel_iommu=on > > [root@localhost test(keystone_admin)]# > > > The below output confirms that, QAT driver is correctly installed. > > > [root@localhost ~]# cat /proc/icp_dh895xcc_dev0/version > > +--------------------------------------------------+ > > | Hardware and Software versions for device 0 | > > +--------------------------------------------------+ > > Hardware Version: A0 SKU2 > > Firmware Version: 2.6.0 > > MMP Version: 1.0.0 > > Driver Version: 2.6.0 > > Lowest Compatible Driver: 2.3 > > QuickAssist API CY Version: 1.9 > > QuickAssist API DC Version: 1.6 > > +--------------------------------------------------+ > > [root@localhost ~]# cat /proc/icp_dh895xcc_dev1/version > > +--------------------------------------------------+ > > | Hardware and Software versions for device 1 | > > +--------------------------------------------------+ > > Hardware Version: A0 SKU2 > > Firmware Version: 2.6.0 > > MMP Version: 1.0.0 > > Driver Version: 2.6.0 > > Lowest Compatible Driver: 2.3 > > QuickAssist API CY Version: 1.9 > > QuickAssist API DC Version: 1.6 > > +--------------------------------------------------+ > > [root@localhost ~]# > > > > The # lspci -d:443 confirms the bdf of the 32 VF devices are available > per QAT device. > > > > [root@localhost ~]# lspci -d:443 > > 83:01.0 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 83:01.1 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 83:01.2 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 83:01.3 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > > ------------------------------------------------------------------------------------- > > > ------------------------------------------------------------------------------------- > > 88:04.3 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 88:04.4 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 88:04.5 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 88:04.6 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > 88:04.7 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > [root@localhost ~]# > > > > *DPDK configuration options in config/defconfig_x86_64-native-linuxapp-gcc* > > > > CONFIG_RTE_LIBRTE_PMD_AESNI_MB=n > > CONFIG_RTE_LIBRTE_CRYPTODEV_DEBUG=y > > CONFIG_RTE_LIBRTE_VIRTIO_PMD=n > > CONFIG_RTE_LIBRTE_VIRTIO_DEBUG_INIT=n > > CONFIG_RTE_LIBRTE_VIRTIO_DEBUG_DRIVER=n > > CONFIG_RTE_LIBRTE_PMD_QAT=y > > CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_INIT=y > > CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_TX=y > > CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_RX=y > > CONFIG_RTE_LIBRTE_PMD_QAT_DEBUG_DRIVER=y > > CONFIG_RTE_MAX_MEMSEG=4096 > > [root@localhost dpdk-2.2.0]# > > > > Here goes my setup.sh > > > > make config T=x86_64-native-linuxapp-gcc > > sed -ri 's,(PMD_PCAP=).*,\1y,' build/.config > > make install T=x86_64-native-linuxapp-gcc > > mkdir -p /mnt/huge > > mount -t hugetlbfs nodev /mnt/huge > > echo 8192 > > /sys/devices/system/node/node0/hugepages/hugepages-2048kB/nr_hugepages > > echo 8192 > > /sys/devices/system/node/node1/hugepages/hugepages-2048kB/nr_hugepages > > sudo modprobe uio_pci_generic > > sudo modprobe uio > > rmmod igb_uio > > insmod > ./x86_64-native-linuxapp-gcc/build/lib/librte_eal/linuxapp/igb_uio/igb_uio.ko > > echo -n "0000:83:01.0" > /sys/bus/pci/devices/0000\:83\:01.0/driver/unbind > > echo "8086 0443" > /sys/bus/pci/drivers/igb_uio/new_id > > > The below OP confirms that, the QAT VF is bound to the DPDK UIO driver. > > > > 83:01.0 Co-processor: Intel Corporation DH895XCC Series QAT Virtual > Function > > Subsystem: Intel Corporation Device 0000 > > Control: I/O- Mem- BusMaster+ SpecCycle- MemWINV- VGASnoop- > ParErr- Stepping- SERR- FastB2B- DisINTx- > > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- > SERR- > Latency: 0 > > Region 0: [virtual] Memory at c8280000 (64-bit, non-prefetchable) > [size=4K] > > Region 2: [virtual] Memory at c82a0000 (64-bit, non-prefetchable) > [size=4K] > > Capabilities: [90] MSI: Enable- Count=1/1 Maskable+ 64bit+ > > Address: 0000000000000000 Data: 0000 > > Masking: 00000000 Pending: 00000000 > > Kernel driver in use: igb_uio > > > Regards, > > Chinmaya >