From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150071.outbound.protection.outlook.com [40.107.15.71]) by dpdk.org (Postfix) with ESMTP id A3FFF5B3C for ; Wed, 6 Mar 2019 15:59:53 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=48REu4BuQznmm95MKFdhL1a8TyxEseiriNLdZuG5yuk=; b=gUTFXKJ7UGRXj+9WT6b7sEUVx+yvo1OYqL2lzmNCXl50xbSmqxBCHh+O9gpU8BHXzOucusbm1R4c/zGaFlchaJPuNFpihCFzrr4IO4FYV9jYzA3iD3pW9qfXSSwOShcXenoVGa4HnoOv6fPMuFCITIk4va4ew8W4Q5AlumZdUcc= Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com (52.133.45.150) by AM0PR0502MB3905.eurprd05.prod.outlook.com (52.133.45.151) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1665.19; Wed, 6 Mar 2019 14:59:50 +0000 Received: from AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003]) by AM0PR0502MB3795.eurprd05.prod.outlook.com ([fe80::84f3:7e92:7a51:1003%2]) with mapi id 15.20.1686.018; Wed, 6 Mar 2019 14:59:50 +0000 From: Shahaf Shuler To: Mit Matelske CC: stephen , Thomas Monjalon , dev , Yongseok Koh Thread-Topic: [dpdk-dev] mlx5 under FreeBSD Thread-Index: AQHUgBne83qEGdtAiUCv0MW4WOiaYKVXVLEAgAMlsYCAADJaAICc4ikAgAKrAAD88E9MG4MU0Bng Date: Wed, 6 Mar 2019 14:59:50 +0000 Message-ID: References: <1203238912.103536.1542300483728.JavaMail.zimbra@perftech.com> <383796151.782033.1542640162186.JavaMail.zimbra@perftech.com> <20181119090810.02543f44@xeon-e3> <1145619802.1261333.1542820311675.JavaMail.zimbra@perftech.com> <20181121121204.297ef328@xeon-e3> <832315875.3148291.1551455882901.JavaMail.zimbra@perftech.com> <873778686.3682315.1551717896130.JavaMail.zimbra@perftech.com> In-Reply-To: <873778686.3682315.1551717896130.JavaMail.zimbra@perftech.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=shahafs@mellanox.com; x-originating-ip: [193.47.165.251] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 437b97d2-f58d-438d-9bbf-08d6a244621f x-ms-office365-filtering-ht: Tenant x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390118)(7020095)(4652040)(8989299)(5600127)(711020)(4605104)(4618075)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(2017052603328)(7153060)(7193020); SRVR:AM0PR0502MB3905; x-ms-traffictypediagnostic: AM0PR0502MB3905: x-ld-processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr x-microsoft-exchange-diagnostics: =?us-ascii?Q?1; AM0PR0502MB3905; 23:3NGXbAZdJ3f7TkwuIKoYr/hG3udEhjIHSfaNv4R?= =?us-ascii?Q?aUiQ0Pn9yjfNwqaS5cIvwHkS1AhJ0vkndncrWU2/HXU8jLffAH68dpsl/SWy?= =?us-ascii?Q?/7RmY7GI6geudjrKIj0OOw4U/AvMHncVjvFxgJd4P4fGzEk7afIspnXVFM8W?= =?us-ascii?Q?sm1ONy5h9sqwN+O9HbNwm7R7btm+xSuNVZ+0F7eRN0Uczf2Pj/bYG+F9pCAC?= =?us-ascii?Q?6IvEdmb6P8RqCukax0jbMfZ3a1rUEbBbbGkU+Tg7knltVQVhpTPoTcPphAyB?= =?us-ascii?Q?7RXtflp71NAdXFNpL7rrmlLriF9VhUejfW+ZYXXvEKLnp3H20KOlFBp6mFok?= =?us-ascii?Q?WcShxRwiJvCknv+TmUqVC76X56Xj5U+HQ2iL5U1rspexXN/PYyisMev18Idd?= =?us-ascii?Q?qtqQW1RsRQNHnakTy7/i4dxUntJoUQG+AmrsU5x4UWCsdtp2H24Vo8tfA6qf?= =?us-ascii?Q?QTEKF0K/ExduOuTHnVOvzlnqyozCGPYx+90dS2ibJ+0KPc18wDLbd958BDWw?= =?us-ascii?Q?EsmIXjDVY7BZ+MBuCdWrZi/J46mRm8y9pi9jQPklrWxG6hN06pa2mxJcP+Ic?= =?us-ascii?Q?kil5Pq79iZEPO6KsQIMAv/CVGUJ2qzmUbdWZSs1mE9FvE0WGBPF2FzCyDrDD?= =?us-ascii?Q?NV3eohBv7NsRCSQNo8MxosumAlg15kedMODx1ug88J1RiXXoMnUELsOURZ0H?= =?us-ascii?Q?sOf93zpXfmtGC/z9u+hzp3t48xcVlwbvxPtMcmxGk7JE6xrPiGcg4gVaANBa?= =?us-ascii?Q?6IPKy0yY53QZqrNcrWf5qEE4oS3Mewi+olo823vFWPVjx7ZD0vXsfQw9fQsu?= =?us-ascii?Q?uP66ltve/lpRN3M25rkfa9QCpf8zVv3zrBAn0kjT99f019oYrrvm6Y3Svdgi?= =?us-ascii?Q?tOz/FBj5bpzLCwn5ah3d8ZHZf1XkV5/sFhH1kpI/HyQoIcEqYJQwJ5YSIIUP?= =?us-ascii?Q?m261e5Y2dDTSg/0is8/yqB9fLNDeRdzaTbJnm2xlYO3IhgBD8XZhaU0NupUh?= =?us-ascii?Q?sdlDbGRtP28Xsj/87igs0cxPTphU6Xp6DzlU1efQvqrGzusPQexnX8RGORoh?= =?us-ascii?Q?wvGxsOxeVu1W/mDYh/YWcDHX8pK6H1jCB3R0luvMiSGn+PlBnEKGEf6SmN7h?= =?us-ascii?Q?EwycPRcSbqpUZODzigZ+GPg6P0vuwFdhLQREBhEmB7XoCsy2WkwkUkFDDk79?= =?us-ascii?Q?xV9Yc3LtNiSBzQnBtwvllZhBmRX8cANENdCsHu+avMUVHj7YqQ+GLtRJfQVM?= =?us-ascii?Q?OyTRFs1DyQv3sSmgEPw/dFqU8c1sy/EcOhtchv/VhHHNA/37PdUtcNx6wdMu?= =?us-ascii?Q?wbQ=3D=3D?= x-microsoft-antispam-prvs: x-forefront-prvs: 0968D37274 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(376002)(39860400002)(396003)(366004)(346002)(136003)(13464003)(199004)(189003)(66066001)(26005)(86362001)(102836004)(478600001)(446003)(11346002)(186003)(74316002)(486006)(106356001)(105586002)(76176011)(7696005)(476003)(99286004)(7736002)(305945005)(81156014)(81166006)(6506007)(8676002)(3846002)(6116002)(6436002)(53936002)(8936002)(229853002)(68736007)(97736004)(14454004)(93886005)(5660300002)(55016002)(25786009)(6246003)(2906002)(6916009)(9686003)(14444005)(256004)(33656002)(54906003)(4326008)(316002)(71200400001)(71190400001)(107886003)(52536013); DIR:OUT; SFP:1101; SCL:1; SRVR:AM0PR0502MB3905; H:AM0PR0502MB3795.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:3; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam-message-info: RpSqDPov/J9l2sNk5mrhbHk9oqQjRoOsmsd6cmoX1f88gFCoTdP7yS6qv5QwwizZG0f6vOFtEob/ciOXoDi3OSrVeHB3h/LxzVUA9JGD6yLuq3Io1/wknlF//yGjfPwReGuA/npDNxW9HWhv33Qn09veP2pxNHjSNWzapohhgSIqXc+Xybw4jlf4w9bglCf2JYK3tWHVZqMYWFrYqo8htRvh1FAg/gVep4vlISwsaNjY2ij75IrRNXNCa0eUFRumhA76ktU4wcGbonTlWKDfRko0H96k4f0qmf8h+sC+LMps4llAcsv/qA6TXfDUK8YPTEHHeseO3Goj7ZlClYsX8Tz7cDok7Ds81WU8f1v261JFrAuXX9p04M01QOqcMy56WuCy5vxnWyRviniRU1WT0m1drQeHb3GZHlKo2YWf2BA= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 437b97d2-f58d-438d-9bbf-08d6a244621f X-MS-Exchange-CrossTenant-originalarrivaltime: 06 Mar 2019 14:59:50.5387 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR0502MB3905 Subject: Re: [dpdk-dev] mlx5 under FreeBSD X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Mar 2019 14:59:53 -0000 Hi Mit, Monday, March 4, 2019 6:45 PM, Mit Matelske: > Subject: Re: [dpdk-dev] mlx5 under FreeBSD >=20 > dev.mlx5_core.1.hw.board_id: LNR3270110033 > dev.mlx5_core.1.hw.fw_version: 12.17.2020 Getting back to you on this one. >>From the FW it looks like you are trying to create a TIR (QP) which doesn't= use Toeplitz hash function (IBV_RX_HASH_FUNC_TOEPLITZ) but the rss key is = not reserved.=20 Makes sense?=20 >=20 > Thanks! >=20 > Mit Matelske >=20 > ----- Original Message ----- > From: "shahafs" > To: "Mit Matelske" , "stephen" > > Cc: "Thomas Monjalon" , "dev" , > "Yongseok Koh" > Sent: Sunday, March 3, 2019 2:43:41 AM > Subject: RE: [dpdk-dev] mlx5 under FreeBSD >=20 > Friday, March 1, 2019 5:58 PM, Mit Matelske: > > Subject: Re: [dpdk-dev] mlx5 under FreeBSD > > > > I was wondering if I could lean on the experts to help me out with an i= ssue? > > I'm finally testing this port but don't understand why the following > > error is > > happening: > > > > net_mlx5: mlx5_rxq.c:2151: mlx5_hrxq_drop_new(): port 0 cannot > > allocate QP for drop queue > > > > The driver is giving the following error corresponding with that DPDK > > message: > > > > Feb 28 15:00:44 fb100g1 kernel: mlx5_core0: ERR: > > mlx5_cmd_check:701:(pid > > 6819): CREATE_TIR(0x900) op_mod(0x0) failed, status bad > > parameter(0x3), syndrome (0x569ee6) >=20 > Hard to say why. I tried to look for the syndrome above on FW but couldn'= t > find. Are you sure this is correct one? > Which FW version you use? >=20 > > > > The mlx5_core_create_tir function completes successfully for the en > > driver, just not the ib driver when trying to build the hash tables. A= ny > ideas? > > > > I've instrumented libmlx5.so.1, mlx5.ko and mlx5ib.ko to debug this > > and everything looks fine according to my limited knowledge. Not sure > > why the card is balking on this action. > > > > Thanks! > > > > Mit Matelske > > > > ----- Original Message ----- > > From: "stephen" > > To: "Mit Matelske" > > Cc: "shahafs" , "Thomas Monjalon" > > , "dev" , "Yongseok Koh" > > > > Sent: Wednesday, November 21, 2018 2:12:04 PM > > Subject: Re: [dpdk-dev] mlx5 under FreeBSD > > > > On Wed, 21 Nov 2018 11:11:51 -0600 (CST) Mit Matelske > > wrote: > > > > > > > > > > Rather than building a complex shim, why not just have an OS > > > > dependent section of the driver. The bigger issue is that the > > > > kernel side functionality in BSD is different or missing. For > > > > example TAP > > API is different and not multi-queue. > > > > > > Once I started working on it, I had to go this route. I haven't > > > been able to but much time into it yet, but it is coming along: > > > > > > EAL: PCI device 0000:b3:00.0 on NUMA socket 0 > > > EAL: probe driver: 15b3:1013 net_mlx5 > > > net_mlx5: mlx5.c:1315: mlx5_pci_probe(): checking device "mlx5_0" > > > uverbs0 /sys/class/infiniband_verbs/uverbs0 > > > /sys/class/infiniband/mlx5_0 > > > net_mlx5: mlx5.c:1325: mlx5_pci_probe(): PCI information matches for > > device "mlx5_0" > > > net_mlx5: mlx5.c:1315: mlx5_pci_probe(): checking device "mlx5_1" > > > uverbs1 /sys/class/infiniband_verbs/uverbs1 > > > /sys/class/infiniband/mlx5_1 > > > net_mlx5: mlx5.c:1382: mlx5_pci_probe(): no switch support detected > > > net_mlx5: mlx5.c:796: mlx5_dev_spawn(): MPW isn't supported > > > net_mlx5: mlx5.c:852: mlx5_dev_spawn(): tunnel offloading disabled > > > due to old OFED/rdma-core version > > > net_mlx5: mlx5.c:864: mlx5_dev_spawn(): MPLS over GRE/UDP tunnel > > > offloading disabled due to old OFED/rdma-core version or firmware > > > configuration > > > net_mlx5: mlx5.c:877: mlx5_dev_spawn(): naming Ethernet device > > "0000:b3:00.0" > > > net_mlx5: mlx5.c:1007: mlx5_dev_spawn(): checksum offloading is > > > supported > > > net_mlx5: mlx5.c:1024: mlx5_dev_spawn(): maximum Rx indirection > > > table size is 512 > > > net_mlx5: mlx5.c:1028: mlx5_dev_spawn(): VLAN stripping is not > > > supported > > > net_mlx5: mlx5.c:1032: mlx5_dev_spawn(): FCS stripping configuration > > > is not supported > > > net_mlx5: mlx5.c:1037: mlx5_dev_spawn(): hardware Rx end alignment > > > padding is not supported > > > net_mlx5: mlx5.c:1052: mlx5_dev_spawn(): MPS is disabled > > > net_mlx5: mlx5.c:628: mlx5_uar_init_primary(): port 0 reserved UAR > > > address space: 0x880000000 > > > net_mlx5: mlx5.c:1107: mlx5_dev_spawn(): port 0 MAC address is > > > 00:90:0b:78:2a:ea > > > net_mlx5: mlx5.c:1114: mlx5_dev_spawn(): port 0 ifname is "mce0" > > > net_mlx5: mlx5.c:1127: mlx5_dev_spawn(): port 0 MTU is 1500 > > > net_mlx5: mlx5.c:1142: mlx5_dev_spawn(): flow rules relying on > > > switch offloads will not be supported: cannot open libmnl socket: > > > Address family not supported by protocol family > > > net_mlx5: mlx5.c:1176: mlx5_dev_spawn(): port 0 forcing Ethernet > > > interface up > > > net_mlx5: mlx5_ethdev.c:735: mlx5_link_update_unlocked_gs(): port 0 > > > ioctl(SIOCGIFFLAGS) failed: No such file or directory > > > net_mlx5: mlx5_ethdev.c:664: mlx5_link_update_unlocked_gset(): port > > > 0 > > > ioctl(SIOCGIFFLAGS) failed: No such file or directory > > > net_mlx5: mlx5_rxq.c:2150: mlx5_hrxq_drop_new(): port 0 cannot > > > allocate QP for drop queue Segmentation fault (core dumped) > > > > > > Working through mlx5_ethdev now... > > > > > > Mit > > > > Also if you are targeting Azure or Hyper-V, then don't bother porting > > TAP/VDEV_NETVSC/Failsafe model because that is being replaced by > > netvsc native PMD. It would be easier to just get that working. > > It would mean writing a uio equivalent driver for FreeBSD.