From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-eopbgr70044.outbound.protection.outlook.com [40.107.7.44]) by dpdk.org (Postfix) with ESMTP id 5CA51F94 for ; Sun, 3 Mar 2019 09:43:43 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=qVX0TCHYaki6wdmbTlj/2SdSPOhlviIq3X0S2j99FGI=; b=UPGOKxHEQAEGC7zhYqdNIO6TwLgTZghZAMst0xo6NEMkL9IhN7fGWuTnxsatz4pzTBPffEOGkuZAh54Il36sYS7crJblD5XbsgiLca9NhNG9+ZTU+JEjeI0gvpfdXh5qaham4skQbcTHVFKsDxtDTlb/Xwfx8JFi2h964J0zX28= Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com (52.133.45.150) by AM0PR0502MB3778.eurprd05.prod.outlook.com (52.133.50.29) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1665.18; Sun, 3 Mar 2019 08:43:41 +0000 Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003]) by AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003%2]) with mapi id 15.20.1665.017; Sun, 3 Mar 2019 08:43:41 +0000 From: Shahaf Shuler To: Mit Matelske , stephen CC: Thomas Monjalon , dev , Yongseok Koh Thread-Topic: [dpdk-dev] mlx5 under FreeBSD Thread-Index: AQHUgBne83qEGdtAiUCv0MW4WOiaYKVXVLEAgAMlsYCAADJaAICc4ikAgAKrAAA= Date: Sun, 3 Mar 2019 08:43:41 +0000 Message-ID: References: <1203238912.103536.1542300483728.JavaMail.zimbra@perftech.com> <4060784.NMgGY7Cv01@xps> <164311280.707048.1542583391811.JavaMail.zimbra@perftech.com> <383796151.782033.1542640162186.JavaMail.zimbra@perftech.com> <20181119090810.02543f44@xeon-e3> <1145619802.1261333.1542820311675.JavaMail.zimbra@perftech.com> <20181121121204.297ef328@xeon-e3> <832315875.3148291.1551455882901.JavaMail.zimbra@perftech.com> In-Reply-To: <832315875.3148291.1551455882901.JavaMail.zimbra@perftech.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [31.154.10.105] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: e643894f-5c97-4145-185a-08d69fb45682 x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600127)(711020)(4605104)(4618075)(2017052603328)(7153060)(7193020); SRVR:AM0PR0502MB3778; x-ms-traffictypediagnostic: AM0PR0502MB3778: x-ld-processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr x-microsoft-exchange-diagnostics: =?us-ascii?Q?1; AM0PR0502MB3778; 23:odazD0eINuYOB6BxVpl92jyiLGPQPyHARRna4mJ?= =?us-ascii?Q?ptZ+IfLjD+Yt37wd5sshkpaa3DBEoxd6jHwUZw6RaO8qMpWgW0sonxvhcKbe?= =?us-ascii?Q?z78mLIn7aQwXBnzdBuomFhcUSL6o/kTYHWnobxV6QdoCz1M2JrlQ68J7oYwo?= =?us-ascii?Q?j7ECi3o91OBZDDWHcTBZjB79Fkkr06JU08GToylnMEkXM8s8uzNmCmxmSgbW?= =?us-ascii?Q?WzTn3Aqcd6PBIklMmlqHwmKsWjMrKW1YWgriKNpZ1+vWvxJPSO1r/4tO4qfC?= =?us-ascii?Q?Qo/CL0SF5AZNJ6dB0HNT9dSGxoWGStdDOvmbbmNKLTQ44SA0IIt0tvSQL+8/?= =?us-ascii?Q?wo12zlfy/+7P4YRXEtbIMCGUE7Q59XGJta4YCAYhPlnnwjhMH0mNmdrOx836?= =?us-ascii?Q?JjAVymxEDIoeegLmHQoQFB/ApMk7lN2qzjpgN98kYGxU3JaSC15hnne345RQ?= =?us-ascii?Q?s1xGytk7eFQKqj1xAXvwfstzyZJs8dEN6ucykYcSJDzx8i4j2IWErEUao3KE?= =?us-ascii?Q?L1zAR7dvFLiDmDQ9hVx9tFJKoztYBjHa/9tco+d5yK3TBxcjTSDljkCaqcdu?= =?us-ascii?Q?V6qUy0Ndc0oYRVw4hmmbp/EUfwRPfyP6zkwZxTx5+f3NTiuBeUijFFQC13Kj?= =?us-ascii?Q?16qknGGkMimadV/qHEF3bHkCq0s/4DRLIbel+uAJPq9MKVzao9VzBm3g8cX2?= =?us-ascii?Q?kq4AZGs6w9nilGqpNw9DrPpEZ2fqjlU3zCk4GZxq7mCgu7HTZ98D2GVjpPnj?= =?us-ascii?Q?iLCKm9QT2g8tfMBaMbFXa+eNg0Za5+ZpHSOoTW48ijS4+K6cxngeyx3QHPnX?= =?us-ascii?Q?RoZOzsTITLKhg0tV6tlG/+6TAUppVZtUhna0dKvjJaY9tYWnnNUfFXofs2zD?= =?us-ascii?Q?VWKa8Dm3tJWZ+6QsvLac12lPH9mYskjktej4p8tEszh4m0X1BEjMats6rLt6?= =?us-ascii?Q?OwTKuFphKEIT9Ufv0uhN7ZLpNCxsXdt0X6ulDHbV9zTp+7cBRvTouhBsPp2N?= =?us-ascii?Q?5O4arRxzn1fFpzhAZ3JDNc0Uh4x5iOTnVa07Wteh+v3ntLRAOBVQ27kAYEv/?= =?us-ascii?Q?dMaIY7U0vpPJbOODGVZ7oSR6DoQLBzBpp9IHSCXDzV4aGHV2P1qAnhVzNaIY?= =?us-ascii?Q?3JYJt+zBHYJigR+lF2dt3TAx6y2Y4h4FRgo/5iqA1gbyl3oL7yVZn9iMcqQ9?= =?us-ascii?Q?GiKiQRn9GkkBnhlcDF24qPqpl8OPaqvLp01mo2+IlB8oxFrbrlbsgQs6I2To?= =?us-ascii?Q?qjTkZ1UmZL/FLzhUMV0EQbpiOq8jxtO87QpKR98pzZqRRQzgPHr0qXaCzb+Z?= =?us-ascii?Q?pDUoQaeIMot4Tn5fgAsi6ZoI=3D?= x-microsoft-antispam-prvs: x-forefront-prvs: 096507C068 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(346002)(376002)(39860400002)(396003)(136003)(189003)(199004)(13464003)(53936002)(99286004)(26005)(97736004)(74316002)(6506007)(305945005)(7736002)(107886003)(6246003)(93886005)(316002)(6436002)(229853002)(66066001)(14454004)(102836004)(5660300002)(186003)(110136005)(54906003)(52536013)(55016002)(9686003)(6346003)(2906002)(478600001)(14444005)(256004)(33656002)(76176011)(105586002)(7696005)(106356001)(8936002)(86362001)(81166006)(81156014)(71190400001)(71200400001)(6116002)(486006)(11346002)(446003)(3846002)(476003)(8676002)(4326008)(68736007)(25786009); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR0502MB3778; H:AM0PR0502MB3795.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) authentication-results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: qto0f+nb8XrgrlqJsyNjEhUP6jwaCNOadLdvi3/a6gvvSrkKwR8MdouVnL4Gs0uTOwG+3c6o1gz+/Hz/DU1AIJOweJqkG0LEoA/eWEfa7yjeX6bqbwFK8fFxRcHpYlz2oaGF/+4kBjdGV6hOH3L4rmsH21OsdACggh7h6qHVkjJ4m0FMLNdIipkmvzXD2Mr9HeWwsfddqDjYNUwvt8YwM9HD6P4uXqeT01JBYH7N49+Ziux91QFTFKSyxQjtjhEBXIiTy2YAgG+ua3OxbeKDfhffabRAfKXlc08BdKweM74ulfQhCNRJG+HPlhhTqTU6A3Hj3iUfaLX2ARhjT3SU/pxJEzFE3SF+TosqonwBDlQhSMPr3SvABiAOTL0yBuchBBI+aCn7IK6wRayYbt6aivQGGPLiraj85qhGQgbWlkw= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: e643894f-5c97-4145-185a-08d69fb45682 X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Mar 2019 08:43:41.2959 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR0502MB3778 Subject: Re: [dpdk-dev] mlx5 under FreeBSD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 03 Mar 2019 08:43:43 -0000 Friday, March 1, 2019 5:58 PM, Mit Matelske: > Subject: Re: [dpdk-dev] mlx5 under FreeBSD >=20 > I was wondering if I could lean on the experts to help me out with an iss= ue? > I'm finally testing this port but don't understand why the following erro= r is > happening: >=20 > net_mlx5: mlx5_rxq.c:2151: mlx5_hrxq_drop_new(): port 0 cannot allocate > QP for drop queue >=20 > The driver is giving the following error corresponding with that DPDK > message: >=20 > Feb 28 15:00:44 fb100g1 kernel: mlx5_core0: ERR: mlx5_cmd_check:701:(pid > 6819): CREATE_TIR(0x900) op_mod(0x0) failed, status bad parameter(0x3), > syndrome (0x569ee6) Hard to say why. I tried to look for the syndrome above on FW but couldn't = find. Are you sure this is correct one?=20 Which FW version you use?=20 >=20 > The mlx5_core_create_tir function completes successfully for the en drive= r, > just not the ib driver when trying to build the hash tables. Any ideas? >=20 > I've instrumented libmlx5.so.1, mlx5.ko and mlx5ib.ko to debug this and > everything looks fine according to my limited knowledge. Not sure why th= e > card is balking on this action. >=20 > Thanks! >=20 > Mit Matelske >=20 > ----- Original Message ----- > From: "stephen" > To: "Mit Matelske" > Cc: "shahafs" , "Thomas Monjalon" > , "dev" , "Yongseok Koh" > > Sent: Wednesday, November 21, 2018 2:12:04 PM > Subject: Re: [dpdk-dev] mlx5 under FreeBSD >=20 > On Wed, 21 Nov 2018 11:11:51 -0600 (CST) Mit Matelske > wrote: >=20 > > > > > > Rather than building a complex shim, why not just have an OS > > > dependent section of the driver. The bigger issue is that the > > > kernel side functionality in BSD is different or missing. For exampl= e TAP > API is different and not multi-queue. > > > > Once I started working on it, I had to go this route. I haven't been > > able to but much time into it yet, but it is coming along: > > > > EAL: PCI device 0000:b3:00.0 on NUMA socket 0 > > EAL: probe driver: 15b3:1013 net_mlx5 > > net_mlx5: mlx5.c:1315: mlx5_pci_probe(): checking device "mlx5_0" > > uverbs0 /sys/class/infiniband_verbs/uverbs0 > > /sys/class/infiniband/mlx5_0 > > net_mlx5: mlx5.c:1325: mlx5_pci_probe(): PCI information matches for > device "mlx5_0" > > net_mlx5: mlx5.c:1315: mlx5_pci_probe(): checking device "mlx5_1" > > uverbs1 /sys/class/infiniband_verbs/uverbs1 > > /sys/class/infiniband/mlx5_1 > > net_mlx5: mlx5.c:1382: mlx5_pci_probe(): no switch support detected > > net_mlx5: mlx5.c:796: mlx5_dev_spawn(): MPW isn't supported > > net_mlx5: mlx5.c:852: mlx5_dev_spawn(): tunnel offloading disabled due > > to old OFED/rdma-core version > > net_mlx5: mlx5.c:864: mlx5_dev_spawn(): MPLS over GRE/UDP tunnel > > offloading disabled due to old OFED/rdma-core version or firmware > > configuration > > net_mlx5: mlx5.c:877: mlx5_dev_spawn(): naming Ethernet device > "0000:b3:00.0" > > net_mlx5: mlx5.c:1007: mlx5_dev_spawn(): checksum offloading is > > supported > > net_mlx5: mlx5.c:1024: mlx5_dev_spawn(): maximum Rx indirection table > > size is 512 > > net_mlx5: mlx5.c:1028: mlx5_dev_spawn(): VLAN stripping is not > > supported > > net_mlx5: mlx5.c:1032: mlx5_dev_spawn(): FCS stripping configuration > > is not supported > > net_mlx5: mlx5.c:1037: mlx5_dev_spawn(): hardware Rx end alignment > > padding is not supported > > net_mlx5: mlx5.c:1052: mlx5_dev_spawn(): MPS is disabled > > net_mlx5: mlx5.c:628: mlx5_uar_init_primary(): port 0 reserved UAR > > address space: 0x880000000 > > net_mlx5: mlx5.c:1107: mlx5_dev_spawn(): port 0 MAC address is > > 00:90:0b:78:2a:ea > > net_mlx5: mlx5.c:1114: mlx5_dev_spawn(): port 0 ifname is "mce0" > > net_mlx5: mlx5.c:1127: mlx5_dev_spawn(): port 0 MTU is 1500 > > net_mlx5: mlx5.c:1142: mlx5_dev_spawn(): flow rules relying on switch > > offloads will not be supported: cannot open libmnl socket: Address > > family not supported by protocol family > > net_mlx5: mlx5.c:1176: mlx5_dev_spawn(): port 0 forcing Ethernet > > interface up > > net_mlx5: mlx5_ethdev.c:735: mlx5_link_update_unlocked_gs(): port 0 > > ioctl(SIOCGIFFLAGS) failed: No such file or directory > > net_mlx5: mlx5_ethdev.c:664: mlx5_link_update_unlocked_gset(): port 0 > > ioctl(SIOCGIFFLAGS) failed: No such file or directory > > net_mlx5: mlx5_rxq.c:2150: mlx5_hrxq_drop_new(): port 0 cannot > > allocate QP for drop queue Segmentation fault (core dumped) > > > > Working through mlx5_ethdev now... > > > > Mit >=20 > Also if you are targeting Azure or Hyper-V, then don't bother porting > TAP/VDEV_NETVSC/Failsafe model because that is being replaced by netvsc > native PMD. It would be easier to just get that working. > It would mean writing a uio equivalent driver for FreeBSD.