From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <bernard.iremonger@intel.com>
Received: from mga03.intel.com (mga03.intel.com [134.134.136.65])
 by dpdk.org (Postfix) with ESMTP id 7C5895A6C
 for <dev@dpdk.org>; Mon, 15 Jun 2015 16:31:48 +0200 (CEST)
Received: from fmsmga001.fm.intel.com ([10.253.24.23])
 by orsmga103.jf.intel.com with ESMTP; 15 Jun 2015 07:31:48 -0700
X-ExtLoop1: 1
X-IronPort-AV: E=Sophos;i="5.13,618,1427785200"; d="scan'208";a="727678771"
Received: from irsmsx103.ger.corp.intel.com ([163.33.3.157])
 by fmsmga001.fm.intel.com with ESMTP; 15 Jun 2015 07:31:46 -0700
Received: from irsmsx108.ger.corp.intel.com ([169.254.11.59]) by
 IRSMSX103.ger.corp.intel.com ([169.254.3.215]) with mapi id 14.03.0224.002;
 Mon, 15 Jun 2015 15:31:46 +0100
From: "Iremonger, Bernard" <bernard.iremonger@intel.com>
To: Tetsuya Mukawa <mukawa@igel.co.jp>, "dev@dpdk.org" <dev@dpdk.org>
Thread-Topic: [PATCH v4 5/5] eal: Fix uio mapping differences between
 linuxapp and bsdapp
Thread-Index: AQHQkfh9X8eoAWH6cUqJ0ddeywhLHJ2ty4mQ
Date: Mon, 15 Jun 2015 14:31:45 +0000
Message-ID: <8CEF83825BEC744B83065625E567D7C204A2EE7F@IRSMSX108.ger.corp.intel.com>
References: <1432014898-3543-1-git-send-email-mukawa@igel.co.jp>
 <1432014898-3543-6-git-send-email-mukawa@igel.co.jp>
In-Reply-To: <1432014898-3543-6-git-send-email-mukawa@igel.co.jp>
Accept-Language: en-GB, en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [163.33.239.180]
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
Subject: Re: [dpdk-dev] [PATCH v4 5/5] eal: Fix uio mapping differences
 between linuxapp and bsdapp
X-BeenThere: dev@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: patches and discussions about DPDK <dev.dpdk.org>
List-Unsubscribe: <http://dpdk.org/ml/options/dev>,
 <mailto:dev-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/dev/>
List-Post: <mailto:dev@dpdk.org>
List-Help: <mailto:dev-request@dpdk.org?subject=help>
List-Subscribe: <http://dpdk.org/ml/listinfo/dev>,
 <mailto:dev-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Mon, 15 Jun 2015 14:31:49 -0000

> -----Original Message-----
> From: Tetsuya Mukawa [mailto:mukawa@igel.co.jp]
> Sent: Tuesday, May 19, 2015 6:55 AM
> To: dev@dpdk.org
> Cc: Iremonger, Bernard; Tetsuya Mukawa
> Subject: [PATCH v4 5/5] eal: Fix uio mapping differences between linuxapp
> and bsdapp
>=20
> This patch fixes below.
> - bsdapp
>  - Use map_id in pci_uio_map_resource().
>  - Fix interface of pci_map_resource().
>  - Move path variable of mapped_pci_resource structure to pci_map.
> - linuxapp
>  - Remove redundant error message of linuxapp.
>=20
> 'pci_uio_map_resource()' is implemented in both linuxapp and bsdapp, but
> interface is different. The patch fixes the function of bsdapp to do same=
 as
> linuxapp. After applying it, file descriptor should be opened and closed =
out of
> pci_map_resource().
>=20
> Signed-off-by: Tetsuya Mukawa <mukawa@igel.co.jp>
> ---
>  lib/librte_eal/bsdapp/eal/eal_pci.c       | 118 ++++++++++++++++++------=
-----
> -
>  lib/librte_eal/linuxapp/eal/eal_pci_uio.c |  21 +++---
>  2 files changed, 80 insertions(+), 59 deletions(-)
>=20
> diff --git a/lib/librte_eal/bsdapp/eal/eal_pci.c
> b/lib/librte_eal/bsdapp/eal/eal_pci.c
> index 8261e09..06c564f 100644
> --- a/lib/librte_eal/bsdapp/eal/eal_pci.c
> +++ b/lib/librte_eal/bsdapp/eal/eal_pci.c
> @@ -85,6 +85,7 @@
>=20
>  struct pci_map {
>  	void *addr;
> +	char *path;
>  	uint64_t offset;
>  	uint64_t size;
>  	uint64_t phaddr;
> @@ -99,7 +100,7 @@ struct mapped_pci_resource {
>=20
>  	struct rte_pci_addr pci_addr;
>  	char path[PATH_MAX];
> -	size_t nb_maps;
> +	int nb_maps;
>  	struct pci_map maps[PCI_MAX_RESOURCE];  };
>=20
> @@ -121,47 +122,30 @@ pci_unbind_kernel_driver(struct rte_pci_device
> *dev __rte_unused)
>=20
>  /* map a particular resource from a file */  static void * -
> pci_map_resource(void *requested_addr, const char *devname, off_t
> offset,
> -		 size_t size)
> +pci_map_resource(void *requested_addr, int fd, off_t offset, size_t size=
,
> +		 int additional_flags)
>  {
> -	int fd;
>  	void *mapaddr;
>=20
> -	/*
> -	 * open devname, to mmap it
> -	 */
> -	fd =3D open(devname, O_RDWR);
> -	if (fd < 0) {
> -		RTE_LOG(ERR, EAL, "Cannot open %s: %s\n",
> -			devname, strerror(errno));
> -		goto fail;
> -	}
> -
>  	/* Map the PCI memory resource of device */
>  	mapaddr =3D mmap(requested_addr, size, PROT_READ | PROT_WRITE,
> -			MAP_SHARED, fd, offset);
> -	close(fd);
> -	if (mapaddr =3D=3D MAP_FAILED ||
> -			(requested_addr !=3D NULL && mapaddr !=3D
> requested_addr)) {
> -		RTE_LOG(ERR, EAL, "%s(): cannot mmap(%s(%d), %p, 0x%lx,
> 0x%lx):"
> -			" %s (%p)\n", __func__, devname, fd,
> requested_addr,
> +			MAP_SHARED | additional_flags, fd, offset);
> +	if (mapaddr =3D=3D MAP_FAILED) {
> +		RTE_LOG(ERR, EAL,
> +			"%s(): cannot mmap(%d, %p, 0x%lx, 0x%lx): %s
> (%p)\n",
> +			__func__, fd, requested_addr,
>  			(unsigned long)size, (unsigned long)offset,
>  			strerror(errno), mapaddr);
> -		goto fail;
> -	}
> -
> -	RTE_LOG(DEBUG, EAL, "  PCI memory mapped at %p\n", mapaddr);
> +	} else
> +		RTE_LOG(DEBUG, EAL, "  PCI memory mapped at %p\n",
> mapaddr);
>=20
>  	return mapaddr;
> -
> -fail:
> -	return NULL;
>  }
>=20
>  static int
>  pci_uio_map_secondary(struct rte_pci_device *dev)  {
> -	size_t i;
> +	int i, fd;
>  	struct mapped_pci_resource *uio_res;
>  	struct mapped_pci_res_list *uio_res_list =3D
>  			RTE_TAILQ_CAST(rte_uio_tailq.head,
> mapped_pci_res_list); @@ -169,19 +153,34 @@
> pci_uio_map_secondary(struct rte_pci_device *dev)
>  	TAILQ_FOREACH(uio_res, uio_res_list, next) {
>=20
>  		/* skip this element if it doesn't match our PCI address */
> -		if (memcmp(&uio_res->pci_addr, &dev->addr, sizeof(dev-
> >addr)))
> +		if (rte_eal_compare_pci_addr(&uio_res->pci_addr, &dev-
> >addr))
>  			continue;
>=20
>  		for (i =3D 0; i !=3D uio_res->nb_maps; i++) {
> -			if (pci_map_resource(uio_res->maps[i].addr,
> -					     uio_res->path,
> -					     (off_t)uio_res->maps[i].offset,
> -					     (size_t)uio_res->maps[i].size)
> -			    !=3D uio_res->maps[i].addr) {
> +			/*
> +			 * open devname, to mmap it
> +			 */
> +			fd =3D open(uio_res->maps[i].path, O_RDWR);
> +			if (fd < 0) {
> +				RTE_LOG(ERR, EAL, "Cannot open %s: %s\n",
> +					uio_res->maps[i].path,
> strerror(errno));
> +				return -1;
> +			}
> +
> +			void *mapaddr =3D pci_map_resource(uio_res-
> >maps[i].addr,
> +					fd, (off_t)uio_res->maps[i].offset,
> +					(size_t)uio_res->maps[i].size, 0);
> +			if (mapaddr !=3D uio_res->maps[i].addr) {
>  				RTE_LOG(ERR, EAL,
> -					"Cannot mmap device resource\n");
> +						"Cannot mmap device
> resource "
> +						"file %s to address: %p\n",
> +						uio_res->maps[i].path,
> +						uio_res->maps[i].addr);
> +				close(fd);
>  				return -1;
>  			}
> +			/* fd is not needed in slave process, close it */
> +			close(fd);
>  		}
>  		return 0;
>  	}
> @@ -194,7 +193,7 @@ pci_uio_map_secondary(struct rte_pci_device *dev)
> static int  pci_uio_map_resource(struct rte_pci_device *dev)  {
> -	int i, j;
> +	int i, map_idx;
>  	char devname[PATH_MAX]; /* contains the /dev/uioX */
>  	void *mapaddr;
>  	uint64_t phaddr;
> @@ -246,35 +245,60 @@ pci_uio_map_resource(struct rte_pci_device *dev)
>  	pagesz =3D sysconf(_SC_PAGESIZE);
>=20
>  	maps =3D uio_res->maps;
> -	for (i =3D uio_res->nb_maps =3D 0; i !=3D PCI_MAX_RESOURCE; i++) {
> +	for (i =3D 0, map_idx =3D 0; i !=3D PCI_MAX_RESOURCE; i++) {
> +		int fd;
>=20
> -		j =3D uio_res->nb_maps;
>  		/* skip empty BAR */
>  		if ((phaddr =3D dev->mem_resource[i].phys_addr) =3D=3D 0)
>  			continue;
>=20
> +		/* allocate memory to keep path */
> +		maps[map_idx].path =3D rte_malloc(NULL, strlen(devname) +
> 1, 0);
> +		if (maps[map_idx].path =3D=3D NULL) {
> +			RTE_LOG(ERR, EAL, "Cannot allocate memory for "
> +					"path: %s\n", strerror(errno));
> +			goto free_uio_res;
> +		}
> +
> +		/*
> +		 * open resource file, to mmap it
> +		 */
> +		fd =3D open(devname, O_RDWR);
> +		if (fd < 0) {
> +			RTE_LOG(ERR, EAL, "Cannot open %s: %s\n",
> +					devname, strerror(errno));
> +			rte_free(maps[map_idx].path);
> +			goto free_uio_res;
> +		}
> +
>  		/* if matching map is found, then use it */
>  		offset =3D i * pagesz;
> -		maps[j].offset =3D offset;
> -		maps[j].phaddr =3D dev->mem_resource[i].phys_addr;
> -		maps[j].size =3D dev->mem_resource[i].len;
> -		if (maps[j].addr !=3D NULL ||
> -		    (mapaddr =3D pci_map_resource(NULL, devname,
> (off_t)offset,
> -						(size_t)maps[j].size)
> -		    ) =3D=3D NULL) {
> +		mapaddr =3D pci_map_resource(NULL, fd, (off_t)offset,
> +					(size_t)dev->mem_resource[i].len,
> 0);
> +		close(fd);
> +		if (mapaddr =3D=3D MAP_FAILED) {
> +			rte_free(maps[map_idx].path);
>  			goto free_uio_res;
>  		}
>=20
> -		maps[j].addr =3D mapaddr;
> -		uio_res->nb_maps++;
> +		maps[map_idx].phaddr =3D dev->mem_resource[i].phys_addr;
> +		maps[map_idx].size =3D dev->mem_resource[i].len;
> +		maps[map_idx].addr =3D mapaddr;
> +		maps[map_idx].offset =3D offset;
> +		strcpy(maps[map_idx].path, devname);
> +		map_idx++;
>  		dev->mem_resource[i].addr =3D mapaddr;
>  	}
>=20
> +	uio_res->nb_maps =3D map_idx;
> +
>  	TAILQ_INSERT_TAIL(uio_res_list, uio_res, next);
>=20
>  	return 0;
>=20
>  free_uio_res:
> +	for (i =3D 0; i < map_idx; i++)
> +		rte_free(maps[i].path);
>  	rte_free(uio_res);
>  close_fd:
>  	close(dev->intr_handle.fd);
> diff --git a/lib/librte_eal/linuxapp/eal/eal_pci_uio.c
> b/lib/librte_eal/linuxapp/eal/eal_pci_uio.c
> index 2dd83d3..98f4847 100644
> --- a/lib/librte_eal/linuxapp/eal/eal_pci_uio.c
> +++ b/lib/librte_eal/linuxapp/eal/eal_pci_uio.c
> @@ -116,17 +116,11 @@ pci_uio_map_secondary(struct rte_pci_device
> *dev)
>  					fd, (off_t)uio_res->maps[i].offset,
>  					(size_t)uio_res->maps[i].size, 0);
>  			if (mapaddr !=3D uio_res->maps[i].addr) {
> -				if (mapaddr =3D=3D MAP_FAILED)
> -					RTE_LOG(ERR, EAL,
> -							"Cannot mmap
> device resource file %s: %s\n",
> -							uio_res-
> >maps[i].path,
> -							strerror(errno));
> -				else
> -					RTE_LOG(ERR, EAL,
> -							"Cannot mmap
> device resource file %s to address: %p\n",
> -							uio_res-
> >maps[i].path,
> -							uio_res-
> >maps[i].addr);
> -
> +				RTE_LOG(ERR, EAL,
> +						"Cannot mmap device
> resource "
> +						"file %s to address: %p\n",
> +						uio_res->maps[i].path,
> +						uio_res->maps[i].addr);
>  				close(fd);
>  				return -1;
>  			}
> @@ -353,8 +347,11 @@ pci_uio_map_resource(struct rte_pci_device *dev)
>=20
>  		/* allocate memory to keep path */
>  		maps[map_idx].path =3D rte_malloc(NULL, strlen(devname) +
> 1, 0);
> -		if (maps[map_idx].path =3D=3D NULL)
> +		if (maps[map_idx].path =3D=3D NULL) {
> +			RTE_LOG(ERR, EAL, "Cannot allocate memory for "
> +					"path: %s\n", strerror(errno));
>  			goto free_uio_res;
> +		}
>=20
>  		/*
>  		 * open resource file, to mmap it
> --
> 2.1.4

Hi Tetsuya,

This patch fails to apply to the latest code.

Applying: eal: Fix uio mapping differences between linuxapp and bsdapp
error: patch failed: lib/librte_eal/bsdapp/eal/eal_pci.c:238
error: lib/librte_eal/bsdapp/eal/eal_pci.c: patch does not apply
error: patch failed: lib/librte_eal/linuxapp/eal/eal_pci_uio.c:326
error: lib/librte_eal/linuxapp/eal/eal_pci_uio.c: patch does not apply

It looks like another rebase is needed.

Regards,

Bernard.