From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR02-HE1-obe.outbound.protection.outlook.com (mail-eopbgr10074.outbound.protection.outlook.com [40.107.1.74]) by dpdk.org (Postfix) with ESMTP id 4498523D for ; Mon, 15 Oct 2018 08:44:23 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nxp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=V9TO3OPmntgGo8QujRluns6nk+2bAk3EMdyeBnOpcqM=; b=cQoreN+Vcoy0gge5LG1mRWn4BrDQkf5MjLtkwAoZdi3V6Eu4zpwg0l04+g1qZImcjzviaD3wX3+RThvooqlDj/jgRv4QbolDAriztus1/+yM08CEZXEl27FbvQU1LoAsNOGH1yriwvOzGPmVsqM+4ArxOWqbfGRY1XqKbLgCcjo= Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=shreyansh.jain@nxp.com; Received: from Tophie.ap.freescale.net (14.142.187.166) by AM6PR04MB4677.eurprd04.prod.outlook.com (2603:10a6:20b:1b::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1228.24; Mon, 15 Oct 2018 06:44:18 +0000 From: Shreyansh Jain To: ferruh.yigit@intel.com, thomas@monjalon.net Cc: anatoly.burakov@intel.com, pbhagavatula@caviumnetworks.com, dev@dpdk.org, Shreyansh Jain Date: Mon, 15 Oct 2018 12:12:00 +0530 Message-Id: <20181015064202.20802-4-shreyansh.jain@nxp.com> X-Mailer: git-send-email 2.17.1 In-Reply-To: <20181015064202.20802-1-shreyansh.jain@nxp.com> References: <20181013122130.22588-1-shreyansh.jain@nxp.com> <20181015064202.20802-1-shreyansh.jain@nxp.com> MIME-Version: 1.0 Content-Type: text/plain X-Originating-IP: [14.142.187.166] X-ClientProxiedBy: OSAPR01CA0083.jpnprd01.prod.outlook.com (2603:1096:604:b::23) To AM6PR04MB4677.eurprd04.prod.outlook.com (2603:10a6:20b:1b::24) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 613583b9-c588-4a17-5e08-08d63269a3a8 X-MS-Office365-Filtering-HT: Tenant X-Microsoft-Antispam: BCL:0; PCL:0; RULEID:(7020095)(4652040)(8989299)(5600074)(711020)(4618075)(4534185)(7168020)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:AM6PR04MB4677; X-Microsoft-Exchange-Diagnostics: 1; AM6PR04MB4677; 3:AorWd4RF/6c+w9yaTP9CvZrUZuiE3jpbjvQs8q702aOOOUuQIVx2AjnY5rfPp/08jjmbsenekV597o5P0FG0A6NMpAFo2pMS3D4VZhfPSnSZ3QyKHRib7T2gDQFUU0dXxAjpVAWm6rPGE9xqsRJZr+ADki77OCAcgG+i8yCe4UY5EPGJJWwr6JBb6ESbhwoVZGB6Z1eGpZuOkJT7sxeW4Sq+KTv5ePBu/m+Dqp3lLUjyLdbSC5Bd6dAFuNiopEqR; 25:5spiUZBJoLrVdgrE6kOBB3IcpRWLzhL3FXw0fyODuj8GuOH59Uhin/D0SR36WVH+adBAmed5rOaP2EKaCtBxVNRSP+DKDnqT4czXx1R+018QHkwXqVw26Fnzy3XAItpMLg7VWwQpYZ6XnI06FjxImCd3W90VXxEdE66GcAcfM4NHbyMg0A3eqOwfJsS5lbfALzqQULEbPSmzR2qpTi0J/7BP1EjCGgx9r3moevL29/x05yvKOeYXBkkOsMXU7BoQuxUGhInPvheEVYF1Mznc5Chywthxrrs5PVwr9NF5zauey+qeaFo4Nosm5MUh6DSf8yfcjKyZC5ARHjyt0Xsv5g==; 31:hygsGiTrWOZhEaybDMdGfRdOyVO1A4shZ5Mi0Su+idcNTkyjtdqzbCPDDkr6K3G1o70BwxG09U0kfttN040kyabADADyOzbDOGNSIOwhMgm3npRwsnhEFxaRnykNWHHG45A/abXT6Egpw3jp511ZPz/0DMNwJ7C/Lke0e1mc7r4gGjoM41uslt9CUSzW8Sm1/6lJa4D00O1tbEek9AntOXDrzxUudMzHG7pA/CKyX3I= X-MS-TrafficTypeDiagnostic: AM6PR04MB4677: X-Microsoft-Exchange-Diagnostics: 1; AM6PR04MB4677; 20:HwIjbsAMntNWrdXcxB44aqGVL7U8S6okayYLX4fps+LWJ0PYg72HiO7qIeSXqeEjmI0dJ9+w4A7ATLiqt3Gh91FwgTB2rjixk2WZZN1G5J3KeLdtFCh8TXh3aBYyI1yXtkU0CP/cojP6sxQq3/0o43B05hLJ5/QgjPNU5u7k3aP0hfGeLFNgD6UkmOxXIR5QkxUig/eSWrdttQmzqu+smhhnnGV/9IRkszxNBGOqXJ5rE9elFcMtSA0mgJxljq+6pv+YAJTlHfO/ZfSbh5ducfF7pND+cpme4cyF9wO21oOYEkDBuytfdfIhaebO4LeadMKfJuuWeGLNEiqnDgqIdpY95JWmUgIQseUEsoENZPDvd7StR7hnl+dnmYw4c5qi+xgi+6Zxi5gkqp/Lf99UUFEMFrNLKAQ2oyxcM2SP8HIJpCI826v+ni8jLunkrPR4hjv/7vHTWgnMQsO6NQ+F0F6MoDMk0dFw+u5vn1x8ljhJ83rnBTjLfGa67coAQJQq; 4:8LuRPrx3sKtMDfN3QIvSxXpXirpq1XH3qVHstVSQEaYVTXfuVBi7Eac7uOMi2wiZhDwCg5RyFBWpXWIC178pX67xtfF3aAkzDwZSNCNWbAQUQOAGgxRySIaS+qohs2zataeuu01j5S2ISmBYhkdfH7lD/Dv2A36hrf4eNUcRKBQaCLSnvRktQyU2vXXr8jEFvIg0rbIbovqc75rTmbyuImHVSM0DSHEYbnZKbinPo1cvyE4APSxkIRvFuxS80NQA1tkqnBvStH/kv9AgSYjdlrNyVuKF6lbUsYMmdWDHYZq0Wn1AvNjbrHS+QE16aDg0mZBfkPWE08dLJ4tNKsMsDBFTgP055xV8Tfvq2rLQlFPTS9jDHuZ/urUBwfDWxtQL X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(185117386973197)(131327999870524)(163750095850); X-MS-Exchange-SenderADCheck: 1 X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(8211001083)(6040522)(2401047)(8121501046)(5005006)(3231355)(944501410)(52105095)(3002001)(10201501046)(93006095)(93001095)(6055026)(149066)(150057)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123562045)(20161123564045)(20161123560045)(201708071742011)(7699051)(76991067); SRVR:AM6PR04MB4677; BCL:0; PCL:0; RULEID:; SRVR:AM6PR04MB4677; X-Forefront-PRVS: 0826B2F01B X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(396003)(376002)(346002)(136003)(39860400002)(366004)(199004)(189003)(3846002)(68736007)(50466002)(6116002)(478600001)(4326008)(2616005)(476003)(446003)(1076002)(486006)(6512007)(53936002)(50226002)(186003)(5660300001)(956004)(11346002)(78486010)(16586007)(14444005)(55236004)(6666004)(2906002)(16526019)(1006002)(52116002)(81156014)(6506007)(81166006)(316002)(386003)(44832011)(48376002)(76176011)(8936002)(51416003)(8676002)(86362001)(575784001)(7736002)(305945005)(4744004)(26005)(6486002)(47776003)(66066001)(105586002)(106356001)(97736004)(25786009)(36756003)(110426005)(21314002); DIR:OUT; SFP:1101; SCL:1; SRVR:AM6PR04MB4677; H:Tophie.ap.freescale.net; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; Received-SPF: None (protection.outlook.com: nxp.com does not designate permitted sender hosts) X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; AM6PR04MB4677; 23:lnv1q0CIH0PHk57efFqeX9JReaVt7arwHNm583Wt6?= =?us-ascii?Q?95SsaL2rM2VMWXSBpKW1DS+0DCJAvPqYEkgrlstbhqUPh9eQF4PWvGrXBHeI?= =?us-ascii?Q?4beXHRUb+DIscJXRQ2sspTkLFdomSfqC1kZI3/iHVratRlGekPspUVmIsdqQ?= =?us-ascii?Q?r3Q/fZEmveK5Xn/kl1OXSs6w1+YNjvWy48uQQ0QTf4+jaKhUBKWxuSoJ6fd2?= =?us-ascii?Q?qLNwUxNb+ZAeur0E0mOyv5vstflb8QjUzsp9kO8qvaOZPggqXxBznTYZ/qik?= =?us-ascii?Q?NgyD8G/cniIohX5jdl3Kij2D70X6NYaSvZ7doteOMN26wIhbSxc9M41+Ts0E?= =?us-ascii?Q?JWD53mOLclZpyENhIYcD8DKqmGwN803OYj0R/6qDeeG7r+rmb/A6UhHrLpMg?= =?us-ascii?Q?uR5+sNhRH/wJ91XCIyG3fKRkGpKOlEaPHBV04FmrMAUNW1z/a2Hi3UtL9GGu?= =?us-ascii?Q?QelhYjiaGZyfIUEM3PszjqZo+TSupS7le0iXGEXYM22MjHgHfT9BgPfBzNpu?= =?us-ascii?Q?ulARwNoXVCjNBWMjCIENrfdPgM5QzwLc20UlEXV0JuE8b0vCKECMJzFZvgJN?= =?us-ascii?Q?gc8cf1JPeqOnxS6Ss+UQMBgx7nI9ossPZGdzO+hd1gmWD2SQdmi1vprJhEZ3?= =?us-ascii?Q?YX3tPpIq4s28tpm9lzGqqMwngpd9mldbg53aYuEipFF79uixqXiA+MPjQnxU?= =?us-ascii?Q?zQfELjDlWfUaq/DXhKUQH479B87mlpCTmxKcp2vjaDG3zrQVo27zcZLRkWAG?= =?us-ascii?Q?6xFTlQynZJzm8i0VJ8EmvNiH6EV3ft0oO4VGlNoYu5xrusXmofdS+2sgUF8J?= =?us-ascii?Q?gT+LVUQLYYHK25h1fL1HOnfwD0gkgqrC3al3jjMP8eU+rmmGnHHIUTNaE8qE?= =?us-ascii?Q?2NkDAIVdOHdLfPQTvwu6ZBRRbVHODHjpBPcq7E86ER4mEHK9YAR9smu+wBmm?= =?us-ascii?Q?ZTvTZyXSF4TV+nB+qu0z+FHSKCixipGfmL+Ta0jla7cypWz9Rrv2t3Tuq35G?= =?us-ascii?Q?LdP2LxD3OTKfIB1UGiUYvWyV++N0+VdWiw7W+tbeAZtvp5sXqxtIAfp7A8TG?= =?us-ascii?Q?jX05hFs9CiehfFf0aMYlI2xJqUoj8b0TFNnthAVGvL/kcFU7Ojchf7Usp3va?= =?us-ascii?Q?EZm5ajzHNJ7Ams7aGaElcxej0s0SYCmEIRjO1NmsC0+BEC0K5U3TUXdTaIuK?= =?us-ascii?Q?GRZ4NKZiFjA9sZYzKBQof2uAZukKFfWaN7oNCjkQ7BcF1oRIwl8+ld9RyiGq?= =?us-ascii?Q?Fx9DZpsKhBLAsvlbbT1OR1lPUIgl7utX8CIzl6FjBMy4FeNpic+US49Yfjk0?= =?us-ascii?Q?wXirb0F0i27U+rWRr2CzMvghR9ZfTQusaTa1rjrzbQBla/yHM1igTTh466yA?= =?us-ascii?Q?iXAbw=3D=3D?= X-Microsoft-Antispam-Message-Info: nOOCFWFCF2kDADbVKzgOSIbJpbRh4DKx+EYElN0Rcc5XYRW9VYx1wDF5ws6TY2rexm+JF8o8lsIpBhwybXRhlL3l0GLlSmkOeGdhWZc1zoyoX43EJ01dFXbsGQDXID1PmjwofNvL817lTYGPXmB0/E5i7G1DHXeimEhvrsZfNqFlT7uBH57RO1VVikyB3VH8gfkD2riA0/UPGJIfwaYYFrLs0/zuejTcCpibcly+1Bp56Wh1GFREbU3uYGu1B35pguuPd3U5duaAu0XNSJXcGg6DhcpCOdri8Za0awJ4PqyBwp/v6iw95gcRp184QlCrKSCSW+4FUgjmy8efMRuNbSrOTujQMqH6O6p6SpwSCKQ= X-Microsoft-Exchange-Diagnostics: 1; AM6PR04MB4677; 6:umuOtiGuBUL/vxkgQagJJJrhUOh3c2/WN1rhlHUrMPJDoyQ/hlomH0TbFNuo3T3ThQTrJwIWMWk5ZFLEDKdWzc7esSVE7f0EbwqyKucFS+AqVDDYQT9g4ZOPaMLEk/kvMb0sxnNBUNbBumstQwbazhyAhxjVxpGS4x2o+en+6KZP6FFFwit4kpiLjXDlEVSHiKjWSxlYKObbxoWVg2RfGz680BTpisw+FJzOTl/ZdDSucsQWg0pE//Y2EXwBbCE52z1lj8VH4g4r3v9IBmUiBgN9yhObo7SHcTtcdmyB/HXmR/rSrBuGQQYFWFPYgNsZOs4e2kJddFQLOStudncBU+1cJLVtVUU6xTEpPVMO8eGpSXmmPgAY26wmQv3NrpxoiOEvsGuy8LiJtvZO29oUq/111qu2/HYcr7CdBA/J5jHeiZQjyQwY8CG0ur5dUq3JhdwWSQYR6vw7xQ3Fum3DJA==; 5:C6uGeHao6WR/btAdBD14RgvcJFk/0vHd9CNjPhscwWBLrsMpVOrJP/k3aFNf9bvLjJAb8RbEoMMAMNqIQRLhu2H46Pl1eeq4YN2P/nzG5WQKKYEmAe3YUh9q/Hb5/WUQmIL5vs5/nHNdHNxLhfGiDNId/JAnYkDF5oDc/yuOzCY=; 7:N4Lf2ZoPdcLGk2VXXYoGWibKObSwInt8C7TzLqazejIwQpo9ib6Trf9R1O5pbl5fn4b7nEUnbVC8ETXTMrDrbY0b2jP6V3ROWYSKI9rhbjfTlxtrTltwlUb4vCm1/KR6/+qjhk1xtqLva4UHMRqTRsM3mIxNF3RjGWyDQtdGZT8SwPlU/feKtJjCBug+0P8dVjDEm/qhWWtZvYEuFuRvrMWJXgfknen7agdPETI97k/xmp2802sshl3Di8yEgCK5 SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: nxp.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Oct 2018 06:44:18.7397 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: 613583b9-c588-4a17-5e08-08d63269a3a8 X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 686ea1d3-bc2b-4c6f-a92c-d99c5c301635 X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR04MB4677 Subject: [dpdk-dev] [PATCH v4 3/5] common/dpaax: add library for PA VA translation table X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Oct 2018 06:44:23 -0000 A common library, valid for dpaaX drivers, which is used to maintain a local copy of PA->VA translations. In case of physical addressing mode (one of the option for FSLMC, and only option for DPAA bus), the addresses of descriptors Rx'd are physical. These need to be converted into equivalent VA for rte_mbuf and other similar calls. Using the rte_mem_virt2iova or rte_mem_virt2phy is expensive. This library is an attempt to reduce the overall cost associated with this translation. A small table is maintained, containing continuous entries representing a continguous physical range. Each of these entries stores the equivalent VA, which is fed during mempool creation, or memory allocation/deallocation callbacks. Signed-off-by: Shreyansh Jain --- config/common_base | 5 + config/common_linuxapp | 5 + drivers/common/Makefile | 4 + drivers/common/dpaax/Makefile | 31 ++ drivers/common/dpaax/dpaax_iova_table.c | 461 ++++++++++++++++++ drivers/common/dpaax/dpaax_iova_table.h | 103 ++++ drivers/common/dpaax/dpaax_logs.h | 39 ++ drivers/common/dpaax/meson.build | 12 + .../common/dpaax/rte_common_dpaax_version.map | 11 + drivers/common/meson.build | 2 +- 10 files changed, 672 insertions(+), 1 deletion(-) create mode 100644 drivers/common/dpaax/Makefile create mode 100644 drivers/common/dpaax/dpaax_iova_table.c create mode 100644 drivers/common/dpaax/dpaax_iova_table.h create mode 100644 drivers/common/dpaax/dpaax_logs.h create mode 100644 drivers/common/dpaax/meson.build create mode 100644 drivers/common/dpaax/rte_common_dpaax_version.map diff --git a/config/common_base b/config/common_base index 8c7ead68d..7f10f7215 100644 --- a/config/common_base +++ b/config/common_base @@ -139,6 +139,11 @@ CONFIG_RTE_ETHDEV_PROFILE_WITH_VTUNE=n # CONFIG_RTE_ETHDEV_TX_PREPARE_NOOP=n +# +# Common libraries, before Bus/PMDs +# +CONFIG_RTE_LIBRTE_COMMON_DPAAX=n + # # Compile the Intel FPGA bus # diff --git a/config/common_linuxapp b/config/common_linuxapp index 485e1467d..76b884c48 100644 --- a/config/common_linuxapp +++ b/config/common_linuxapp @@ -29,6 +29,11 @@ CONFIG_RTE_PROC_INFO=y CONFIG_RTE_LIBRTE_VMBUS=y CONFIG_RTE_LIBRTE_NETVSC_PMD=y +# +# Common libraries, before Bus/PMDs +# +CONFIG_RTE_LIBRTE_COMMON_DPAAX=y + # NXP DPAA BUS and drivers CONFIG_RTE_LIBRTE_DPAA_BUS=y CONFIG_RTE_LIBRTE_DPAA_MEMPOOL=y diff --git a/drivers/common/Makefile b/drivers/common/Makefile index b498c238f..6392a3412 100644 --- a/drivers/common/Makefile +++ b/drivers/common/Makefile @@ -14,4 +14,8 @@ ifneq (,$(findstring y,$(MVEP-y))) DIRS-y += mvep endif +ifeq ($(CONFIG_RTE_LIBRTE_COMMON_DPAAX),y) +DIRS-y += dpaax +endif + include $(RTE_SDK)/mk/rte.subdir.mk diff --git a/drivers/common/dpaax/Makefile b/drivers/common/dpaax/Makefile new file mode 100644 index 000000000..94d2cf0ce --- /dev/null +++ b/drivers/common/dpaax/Makefile @@ -0,0 +1,31 @@ +# SPDX-License-Identifier: BSD-3-Clause +# Copyright 2018 NXP +# + +include $(RTE_SDK)/mk/rte.vars.mk + +# +# library name +# +LIB = librte_common_dpaax.a + +CFLAGS += -DALLOW_EXPERIMENTAL_API +CFLAGS += -O3 +CFLAGS += $(WERROR_FLAGS) + +# versioning export map +EXPORT_MAP := rte_common_dpaax_version.map + +# library version +LIBABIVER := 1 + +# +# all source are stored in SRCS-y +# +SRCS-y += dpaax_iova_table.c + +LDLIBS += -lrte_eal + +SYMLINK-y-include += dpaax_iova_table.h + +include $(RTE_SDK)/mk/rte.lib.mk \ No newline at end of file diff --git a/drivers/common/dpaax/dpaax_iova_table.c b/drivers/common/dpaax/dpaax_iova_table.c new file mode 100644 index 000000000..d54267bb7 --- /dev/null +++ b/drivers/common/dpaax/dpaax_iova_table.c @@ -0,0 +1,461 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright 2018 NXP + */ + +#include + +#include "dpaax_iova_table.h" +#include "dpaax_logs.h" + +/* Global dpaax logger identifier */ +int dpaax_logger; + +/* Global table reference */ +struct dpaax_iova_table *dpaax_iova_table_p; + +static int dpaax_handle_memevents(void); + +/* A structure representing the device-tree node available in /proc/device-tree. + */ +struct reg_node { + phys_addr_t addr; + size_t len; +}; + +/* A ntohll equivalent routine + * XXX: This is only applicable for 64 bit environment. + */ +static void +rotate_8(unsigned char *arr) +{ + uint32_t temp; + uint32_t *first_half; + uint32_t *second_half; + + first_half = (uint32_t *)(arr); + second_half = (uint32_t *)(arr + 4); + + temp = *first_half; + *first_half = *second_half; + *second_half = temp; + + *first_half = ntohl(*first_half); + *second_half = ntohl(*second_half); +} + +/* read_memory_nodes + * Memory layout for DPAAx platforms (LS1043, LS1046, LS1088, LS2088, LX2160) + * are populated by Uboot and available in device tree: + * /proc/device-tree/memory@
/reg <= register. + * Entries are of the form: + * (<8 byte start addr><8 byte length>)(..more similar blocks of start,len>).. + * + * @param count + * OUT populate number of entries found in memory node + * @return + * Pointer to array of reg_node elements, count size + */ +static struct reg_node * +read_memory_node(unsigned int *count) +{ + int fd, ret, i; + unsigned int j; + glob_t result = {0}; + struct stat statbuf = {0}; + char file_data[MEM_NODE_FILE_LEN]; + struct reg_node *nodes = NULL; + + *count = 0; + + ret = glob(MEM_NODE_PATH_GLOB, 0, NULL, &result); + if (ret != 0) { + DPAAX_ERR("Unable to glob device-tree memory node: (%s)(%d)", + MEM_NODE_PATH_GLOB, ret); + goto out; + } + + if (result.gl_pathc != 1) { + /* Either more than one memory@ node found, or none. + * In either case, cannot work ahead. + */ + DPAAX_ERR("Found (%zu) entries in device-tree. Not supported!", + result.gl_pathc); + goto out; + } + + DPAAX_DEBUG("Opening and parsing device-tree node: (%s)", + result.gl_pathv[0]); + fd = open(result.gl_pathv[0], O_RDONLY); + if (fd < 0) { + DPAAX_ERR("Unable to open the device-tree node: (%s)(fd=%d)", + MEM_NODE_PATH_GLOB, fd); + goto cleanup; + } + + /* Stat to get the file size */ + ret = fstat(fd, &statbuf); + if (ret != 0) { + DPAAX_ERR("Unable to get device-tree memory node size."); + goto cleanup; + } + + DPAAX_DEBUG("Size of device-tree mem node: %lu", statbuf.st_size); + if (statbuf.st_size > MEM_NODE_FILE_LEN) { + DPAAX_WARN("More memory nodes available than assumed."); + DPAAX_WARN("System may not work properly!"); + } + + ret = read(fd, file_data, statbuf.st_size > MEM_NODE_FILE_LEN ? + MEM_NODE_FILE_LEN : statbuf.st_size); + if (ret <= 0) { + DPAAX_ERR("Unable to read device-tree memory node: (%d)", ret); + goto cleanup; + } + + /* The reg node should be multiple of 16 bytes, 8 bytes each for addr + * and len. + */ + *count = (statbuf.st_size / 16); + if ((*count) <= 0 || (statbuf.st_size % 16 != 0)) { + DPAAX_ERR("Invalid memory node values or count. (size=%lu)", + statbuf.st_size); + goto cleanup; + } + + /* each entry is of 16 bytes, and size/16 is total count of entries */ + nodes = malloc(sizeof(struct reg_node) * (*count)); + if (!nodes) { + DPAAX_ERR("Failure in allocating working memory."); + goto cleanup; + } + memset(nodes, 0, sizeof(struct reg_node) * (*count)); + + for (i = 0, j = 0; i < (statbuf.st_size) && j < (*count); i += 16, j++) { + memcpy(&nodes[j], file_data + i, 16); + /* Rotate (ntohl) each 8 byte entry */ + rotate_8((unsigned char *)(&(nodes[j].addr))); + rotate_8((unsigned char *)(&(nodes[j].len))); + } + + DPAAX_DEBUG("Device-tree memory node data:"); + do { + DPAAX_DEBUG("\n %08" PRIx64 " %08zu", nodes[j].addr, nodes[j].len); + } while (--j); + +cleanup: + close(fd); + globfree(&result); +out: + return nodes; +} + +int +dpaax_iova_table_populate(void) +{ + int ret; + unsigned int i, node_count; + size_t tot_memory_size, total_table_size; + struct reg_node *nodes; + struct dpaax_iovat_element *entry; + + /* dpaax_iova_table_p is a singleton - only one instance should be + * created. + */ + if (dpaax_iova_table_p) { + DPAAX_DEBUG("Multiple allocation attempt for IOVA Table (%p)", + dpaax_iova_table_p); + /* This can be an error case as well - some path not cleaning + * up table - but, for now, it is assumed that if IOVA Table + * pointer is valid, table is allocated. + */ + return 0; + } + + nodes = read_memory_node(&node_count); + if (nodes == NULL || node_count <= 0) { + DPAAX_WARN("PA->VA translation not available;"); + DPAAX_WARN("Expect performance impact."); + return -1; + } + + tot_memory_size = 0; + for (i = 0; i < node_count; i++) + tot_memory_size += nodes[i].len; + + DPAAX_DEBUG("Total available PA memory size: %zu", tot_memory_size); + + /* Total table size = meta data + tot_memory_size/8 */ + total_table_size = sizeof(struct dpaax_iova_table) + + (sizeof(struct dpaax_iovat_element) * node_count) + + ((tot_memory_size / DPAAX_MEM_SPLIT) * sizeof(uint64_t)); + + /* TODO: This memory doesn't need to shared but needs to be always + * pinned to RAM (no swap out) - using hugepage rather than malloc + */ + dpaax_iova_table_p = rte_zmalloc(NULL, total_table_size, 0); + if (dpaax_iova_table_p == NULL) { + DPAAX_WARN("Unable to allocate memory for PA->VA Table;"); + DPAAX_WARN("PA->VA translation not available;"); + DPAAX_WARN("Expect performance impact."); + free(nodes); + return -1; + } + + /* Initialize table */ + dpaax_iova_table_p->count = node_count; + entry = dpaax_iova_table_p->entries; + + DPAAX_DEBUG("IOVA Table entries: (entry start = %p)", (void *)entry); + DPAAX_DEBUG("\t(entry),(start),(len),(next)"); + + for (i = 0; i < node_count; i++) { + /* dpaax_iova_table_p + * | dpaax_iova_table_p->entries + * | | + * | | + * V V + * +------+------+-------+---+----------+---------+--- + * |iova_ |entry | entry | | pages | pages | + * |table | 1 | 2 |...| entry 1 | entry2 | + * +-----'+.-----+-------+---+;---------+;--------+--- + * \ \ / / + * `~~~~~~|~~~~~>pages / + * \ / + * `~~~~~~~~~~~>pages + */ + entry[i].start = nodes[i].addr; + entry[i].len = nodes[i].len; + if (i > 0) + entry[i].pages = entry[i-1].pages + + ((entry[i-1].len/DPAAX_MEM_SPLIT)); + else + entry[i].pages = (uint64_t *)((unsigned char *)entry + + (sizeof(struct dpaax_iovat_element) * + node_count)); + + DPAAX_DEBUG("\t(%u),(%8"PRIx64"),(%8zu),(%8p)", + i, entry[i].start, entry[i].len, entry[i].pages); + } + + /* Release memory associated with nodes array - not required now */ + free(nodes); + + DPAAX_DEBUG("Adding mem-event handler\n"); + ret = dpaax_handle_memevents(); + if (ret) { + DPAAX_ERR("Unable to add mem-event handler"); + DPAAX_WARN("Cases with non-buffer pool mem won't work!"); + } + + return 0; +} + +void +dpaax_iova_table_depopulate(void) +{ + if (dpaax_iova_table_p == NULL) + return; + + rte_free(dpaax_iova_table_p->entries); + dpaax_iova_table_p = NULL; + + DPAAX_DEBUG("IOVA Table cleanedup"); +} + +int +dpaax_iova_table_update(phys_addr_t paddr, void *vaddr, size_t length) +{ + int found = 0; + unsigned int i; + size_t req_length = length, e_offset; + struct dpaax_iovat_element *entry; + uintptr_t align_vaddr; + phys_addr_t align_paddr; + + align_paddr = paddr & DPAAX_MEM_SPLIT_MASK; + align_vaddr = ((uintptr_t)vaddr & DPAAX_MEM_SPLIT_MASK); + + /* Check if paddr is available in table */ + entry = dpaax_iova_table_p->entries; + for (i = 0; i < dpaax_iova_table_p->count; i++) { + if (align_paddr < entry[i].start) { + /* Address lower than start, but not found in previous + * iteration shouldn't exist. + */ + DPAAX_ERR("Add: Incorrect entry for PA->VA Table" + "(%"PRIu64")", paddr); + DPAAX_ERR("Add: Lowest address: %"PRIu64"", + entry[i].start); + return -1; + } + + if (align_paddr > (entry[i].start + entry[i].len)) + continue; + + /* align_paddr >= start && align_paddr < (start + len) */ + found = 1; + + do { + e_offset = ((align_paddr - entry[i].start) / DPAAX_MEM_SPLIT); + /* TODO: Whatif something already exists at this + * location - is that an error? For now, ignoring the + * case. + */ + entry[i].pages[e_offset] = align_vaddr; + DPAAX_DEBUG("Added: vaddr=%zu for Phy:%"PRIu64" at %zu" + " remaining len %zu", align_vaddr, + align_paddr, e_offset, req_length); + + /* Incoming request can be larger than the + * DPAAX_MEM_SPLIT size - in which case, multiple + * entries in entry->pages[] are filled up. + */ + if (req_length <= DPAAX_MEM_SPLIT) + break; + align_paddr += DPAAX_MEM_SPLIT; + align_vaddr += DPAAX_MEM_SPLIT; + req_length -= DPAAX_MEM_SPLIT; + } while (1); + + break; + } + + if (!found) { + /* There might be case where the incoming physical address is + * beyond the address discovered in the memory node of + * device-tree. Specially if some malloc'd area is used by EAL + * and the memevent handlers passes that across. But, this is + * not necessarily an error. + */ + DPAAX_DEBUG("Add: Unable to find slot for vaddr:(%p)," + " phy(%"PRIu64")", + vaddr, paddr); + return -1; + } + + DPAAX_DEBUG("Add: Found slot at (%"PRIu64")[(%zu)] for vaddr:(%p)," + " phy(%"PRIu64"), len(%zu)", entry[i].start, e_offset, + vaddr, paddr, length); + return 0; +} + +/* dpaax_iova_table_dump + * Dump the table, with its entries, on screen. Only works in Debug Mode + * Not for weak hearted - the tables can get quite large + */ +void +dpaax_iova_table_dump(void) +{ + unsigned int i, j; + struct dpaax_iovat_element *entry; + + /* In case DEBUG is not enabled, some 'if' conditions might misbehave + * as they have nothing else in them except a DPAAX_DEBUG() which if + * tuned out would leave 'if' naked. + */ + if (rte_log_get_global_level() < RTE_LOG_DEBUG) { + DPAAX_ERR("Set log level to Debug for PA->Table dump!"); + return; + } + + DPAAX_DEBUG(" === Start of PA->VA Translation Table ==="); + if (dpaax_iova_table_p == NULL) + DPAAX_DEBUG("\tNULL"); + + entry = dpaax_iova_table_p->entries; + for (i = 0; i < dpaax_iova_table_p->count; i++) { + DPAAX_DEBUG("\t(%16i),(%16"PRIu64"),(%16zu),(%16p)", + i, entry[i].start, entry[i].len, entry[i].pages); + DPAAX_DEBUG("\t\t (PA), (VA)"); + for (j = 0; j < (entry->len/DPAAX_MEM_SPLIT); j++) { + if (entry[i].pages[j] == 0) + continue; + DPAAX_DEBUG("\t\t(%16"PRIx64"),(%16"PRIx64")", + (entry[i].start + (j * sizeof(uint64_t))), + entry[i].pages[j]); + } + } + DPAAX_DEBUG(" === End of PA->VA Translation Table ==="); +} + +static void +dpaax_memevent_cb(enum rte_mem_event type, const void *addr, size_t len, + void *arg __rte_unused) +{ + struct rte_memseg_list *msl; + struct rte_memseg *ms; + size_t cur_len = 0, map_len = 0; + phys_addr_t phys_addr; + void *virt_addr; + int ret; + + DPAAX_DEBUG("Called with addr=%p, len=%zu", addr, len); + + msl = rte_mem_virt2memseg_list(addr); + + while (cur_len < len) { + const void *va = RTE_PTR_ADD(addr, cur_len); + + ms = rte_mem_virt2memseg(va, msl); + phys_addr = rte_mem_virt2phy(ms->addr); + virt_addr = ms->addr; + map_len = ms->len; + + DPAAX_DEBUG("Request for %s, va=%p, virt_addr=%p," + "iova=%"PRIu64", map_len=%zu", + type == RTE_MEM_EVENT_ALLOC ? + "alloc" : "dealloc", + va, virt_addr, phys_addr, map_len); + + if (type == RTE_MEM_EVENT_ALLOC) + ret = dpaax_iova_table_update(phys_addr, virt_addr, + map_len); + else + /* In case of mem_events for MEM_EVENT_FREE, complete + * hugepage is released and its PA entry is set to 0. + */ + ret = dpaax_iova_table_update(phys_addr, 0, map_len); + + if (ret != 0) { + DPAAX_ERR("PA-Table entry update failed. " + "Map=%d, addr=%p, len=%zu, err:(%d)", + type, va, map_len, ret); + return; + } + + cur_len += map_len; + } +} + +static int +dpaax_memevent_walk_memsegs(const struct rte_memseg_list *msl __rte_unused, + const struct rte_memseg *ms, size_t len, + void *arg __rte_unused) +{ + DPAAX_DEBUG("Walking for %p (pa=%"PRIu64") and len %zu", + ms->addr, ms->phys_addr, len); + dpaax_iova_table_update(rte_mem_virt2phy(ms->addr), ms->addr, len); + return 0; +} + +static int +dpaax_handle_memevents(void) +{ + /* First, walk through all memsegs and pin them, before installing + * handler. This assures that all memseg which have already been + * identified/allocated by EAL, are already part of PA->VA Table. This + * is especially for cases where application allocates memory before + * the EAL or this is an externally allocated memory passed to EAL. + */ + rte_memseg_contig_walk_thread_unsafe(dpaax_memevent_walk_memsegs, NULL); + + return rte_mem_event_callback_register("dpaax_memevents_cb", + dpaax_memevent_cb, NULL); +} + +RTE_INIT(dpaax_log) +{ + dpaax_logger = rte_log_register("pmd.common.dpaax"); + if (dpaax_logger >= 0) + rte_log_set_level(dpaax_logger, RTE_LOG_NOTICE); +} diff --git a/drivers/common/dpaax/dpaax_iova_table.h b/drivers/common/dpaax/dpaax_iova_table.h new file mode 100644 index 000000000..3e913ef45 --- /dev/null +++ b/drivers/common/dpaax/dpaax_iova_table.h @@ -0,0 +1,103 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright 2018 NXP + */ + +#ifndef _DPAAX_IOVA_TABLE_H_ +#define _DPAAX_IOVA_TABLE_H_ + +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include +#include + +#include +#include +#include +#include + +struct dpaax_iovat_element { + phys_addr_t start; /**< Start address of block of physical pages */ + size_t len; /**< Difference of end-start for quick access */ + uint64_t *pages; /**< VA for each physical page in this block */ +}; + +struct dpaax_iova_table { + unsigned int count; /**< No. of blocks of contiguous physical pages */ + struct dpaax_iovat_element entries[0]; +}; + +/* Pointer to the table, which is common for DPAA/DPAA2 and only a single + * instance is required across net/crypto/event drivers. This table is + * populated iff devices are found on the bus. + */ +extern struct dpaax_iova_table *dpaax_iova_table_p; + +/* Device tree file for memory layout is named 'memory@' where the 'addr' + * is SoC dependent, or even Uboot fixup dependent. + */ +#define MEM_NODE_PATH_GLOB "/proc/device-tree/memory[@0-9]*/reg" +/* Device file should be multiple of 16 bytes, each containing 8 byte of addr + * and its length. Assuming max of 5 entries. + */ +#define MEM_NODE_FILE_LEN ((16 * 5) + 1) + +/* Table is made up of DPAAX_MEM_SPLIT elements for each contiguous zone. This + * helps avoid separate handling for cases where more than one size of hugepage + * is supported. + */ +#define DPAAX_MEM_SPLIT (1<<21) +#define DPAAX_MEM_SPLIT_MASK ~(DPAAX_MEM_SPLIT - 1) /**< Floor aligned */ +#define DPAAX_MEM_SPLIT_MASK_OFF (DPAAX_MEM_SPLIT - 1) /**< Offset */ + +/* APIs exposed */ +int dpaax_iova_table_populate(void); +void dpaax_iova_table_depopulate(void); +int dpaax_iova_table_update(phys_addr_t paddr, void *vaddr, size_t length); +void dpaax_iova_table_dump(void); + +static inline void *dpaax_iova_table_get_va(phys_addr_t paddr) __attribute__((hot)); + +static inline void * +dpaax_iova_table_get_va(phys_addr_t paddr) { + unsigned int i = 0, index; + void *vaddr = 0; + phys_addr_t paddr_align = paddr & DPAAX_MEM_SPLIT_MASK; + size_t offset = paddr & DPAAX_MEM_SPLIT_MASK_OFF; + struct dpaax_iovat_element *entry; + + entry = dpaax_iova_table_p->entries; + + do { + if (unlikely(i > dpaax_iova_table_p->count)) + break; + + if (paddr_align < entry[i].start) { + /* Incorrect paddr; Not in memory range */ + return NULL; + } + + if (paddr_align > (entry[i].start + entry[i].len)) { + i++; + continue; + } + + /* paddr > entry->start && paddr <= entry->(start+len) */ + index = (paddr_align - entry[i].start)/DPAAX_MEM_SPLIT; + vaddr = (void *)((uintptr_t)entry[i].pages[index] + offset); + break; + } while (1); + + return vaddr; +} + +#endif /* _DPAAX_IOVA_TABLE_H_ */ diff --git a/drivers/common/dpaax/dpaax_logs.h b/drivers/common/dpaax/dpaax_logs.h new file mode 100644 index 000000000..bf1b27cc1 --- /dev/null +++ b/drivers/common/dpaax/dpaax_logs.h @@ -0,0 +1,39 @@ +/* SPDX-License-Identifier: BSD-3-Clause + * Copyright 2018 NXP + */ + +#ifndef _DPAAX_LOGS_H_ +#define _DPAAX_LOGS_H_ + +#include + +extern int dpaax_logger; + +#define DPAAX_LOG(level, fmt, args...) \ + rte_log(RTE_LOG_ ## level, dpaax_logger, "dpaax: " fmt "\n", \ + ##args) + +/* Debug logs are with Function names */ +#define DPAAX_DEBUG(fmt, args...) \ + rte_log(RTE_LOG_DEBUG, dpaax_logger, "dpaax: %s(): " fmt "\n", \ + __func__, ##args) + +#define DPAAX_INFO(fmt, args...) \ + DPAAX_LOG(INFO, fmt, ## args) +#define DPAAX_ERR(fmt, args...) \ + DPAAX_LOG(ERR, fmt, ## args) +#define DPAAX_WARN(fmt, args...) \ + DPAAX_LOG(WARNING, fmt, ## args) + +/* DP Logs, toggled out at compile time if level lower than current level */ +#define DPAAX_DP_LOG(level, fmt, args...) \ + RTE_LOG_DP(level, PMD, fmt, ## args) + +#define DPAAX_DP_DEBUG(fmt, args...) \ + DPAAX_DP_LOG(DEBUG, fmt, ## args) +#define DPAAX_DP_INFO(fmt, args...) \ + DPAAX_DP_LOG(INFO, fmt, ## args) +#define DPAAX_DP_WARN(fmt, args...) \ + DPAAX_DP_LOG(WARNING, fmt, ## args) + +#endif /* _DPAAX_LOGS_H_ */ diff --git a/drivers/common/dpaax/meson.build b/drivers/common/dpaax/meson.build new file mode 100644 index 000000000..98a1bdd48 --- /dev/null +++ b/drivers/common/dpaax/meson.build @@ -0,0 +1,12 @@ +# SPDX-License-Identifier: BSD-3-Clause +# Copyright(c) 2018 NXP + +allow_experimental_apis = true + +if host_machine.system() != 'linux' + build = false +endif + +sources = files('dpaax_iova_table.c') + +cflags += ['-D_GNU_SOURCE'] diff --git a/drivers/common/dpaax/rte_common_dpaax_version.map b/drivers/common/dpaax/rte_common_dpaax_version.map new file mode 100644 index 000000000..8131c9e30 --- /dev/null +++ b/drivers/common/dpaax/rte_common_dpaax_version.map @@ -0,0 +1,11 @@ +DPDK_18.11 { + global: + + dpaax_iova_table_update; + dpaax_iova_table_depopulate; + dpaax_iova_table_dump; + dpaax_iova_table_p; + dpaax_iova_table_populate; + + local: *; +}; diff --git a/drivers/common/meson.build b/drivers/common/meson.build index f828ce7f7..0257d4d2b 100644 --- a/drivers/common/meson.build +++ b/drivers/common/meson.build @@ -2,6 +2,6 @@ # Copyright(c) 2018 Cavium, Inc std_deps = ['eal'] -drivers = ['mvep', 'octeontx', 'qat'] +drivers = ['dpaax', 'mvep', 'octeontx', 'qat'] config_flag_fmt = 'RTE_LIBRTE_@0@_COMMON' driver_name_fmt = 'rte_common_@0@' -- 2.17.1