From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 0B289A0562 for ; Thu, 2 Apr 2020 18:18:18 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 50CCC2BCE; Thu, 2 Apr 2020 18:18:18 +0200 (CEST) Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00059.outbound.protection.outlook.com [40.107.0.59]) by dpdk.org (Postfix) with ESMTP id AF1282B8B for ; Thu, 2 Apr 2020 18:18:17 +0200 (CEST) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=kf7BnbXM2ggW41Ds9jMM7yz5xWBiBfFImSCxqV/1rZP+5t6zCYp/9//S//MqaUQ2900UYGyoRbOFfT6S8SlAlRYzTlw6FNptsjIs6jmxOfPIKCA0q/DT0bYmICe4YSAutiKGjx4BlfoyFKqzMDYNFyS8XSUwsT79GdF7uuGUKSu2dZZse+NCahB+0sD20UJurO2Orp5rbJtVcYJLliMpkA449gbENWquK0ZPxe2OtDTtWlRon3COmSoBTMXhr0ja66fXq1g1ND73961jAOHnHuQUXfuQHH49yDBaCszHkzqHpbPmCh52t0ei97QOfJx82tWwqye3uIgqRE1w0r0vMw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=E79b5tBl385UkzrgwBdOix/qgwiLEc9bOC3FboEFj34=; b=gO4lspQWF/9e8uTEY8v6mmEWS26VPGlnS6L92c7YI3qh+tsyZ2efPXfERIFaLxfeMQzxVQ7mHKUknLwGAyrq/GtEjO4651jUkV9RNRgi3YOTQaIsY5nfk4VxETcDvgJ9P2K/BMIJuvKatrq551JVTn5NnEFJZD0/xdZzBg0vR8gsyIjm2tYEm/Yqpy7PEwhbOIt2Cgty+3KsjXEhdfMUyjjiWW7C5ZK0ykuPcVmXMuJIqeHqitgyiR4UDBG38OdISf5x9fIInu9TXi1nwZcq0Vk1sQLbxT5N+jIVUB1kv0gA1xYfgCTroXGPYct18/KOe+rKJs6XkOnbg/3COQWMkQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=E79b5tBl385UkzrgwBdOix/qgwiLEc9bOC3FboEFj34=; b=oaTq9qBQNa1b5UJLDh+DljxbfforRhft+AJbmyEsdQclOMoOMjjymFNR5ultK+L833Jgk+wdO8W6u9FKhXDbEzbPv7H7A+7M8o5LifSxJPvWJiuT6PHCV+V0HY7goYKnLs9dqmntZktc2aByQJs/y596MZF/v/MGXD9N7QQ2PDE= Received: from AM0PR0502MB4019.eurprd05.prod.outlook.com (52.133.39.139) by AM0PR0502MB3619.eurprd05.prod.outlook.com (52.133.46.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2835.18; Thu, 2 Apr 2020 16:18:16 +0000 Received: from AM0PR0502MB4019.eurprd05.prod.outlook.com ([fe80::a564:a117:9022:1fee]) by AM0PR0502MB4019.eurprd05.prod.outlook.com ([fe80::a564:a117:9022:1fee%7]) with mapi id 15.20.2878.014; Thu, 2 Apr 2020 16:18:16 +0000 From: Matan Azrad To: "users@dpdk.org" , "Benoit Ganne (bganne)" CC: Shahaf Shuler , Slava Ovsiienko Thread-Topic: mlx5 pmd + rdma-core 28 init failure Thread-Index: AdYIQ9Z8ZbHXLbfSTDeYhwt0ihzoWAAwhXsgAAERNso= Date: Thu, 2 Apr 2020 16:18:15 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-US, he-IL Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=matan@mellanox.com; x-originating-ip: [77.125.94.232] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: fbed397a-de09-46f8-32bb-08d7d7217317 x-ms-traffictypediagnostic: AM0PR0502MB3619:|AM0PR0502MB3619: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6430; x-forefront-prvs: 0361212EA8 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:AM0PR0502MB4019.eurprd05.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10009020)(4636009)(396003)(136003)(346002)(39860400002)(366004)(376002)(478600001)(71200400001)(53546011)(186003)(33656002)(966005)(66946007)(45080400002)(5660300002)(66476007)(86362001)(66446008)(55016002)(76116006)(9686003)(66556008)(64756008)(4326008)(107886003)(8676002)(26005)(52536014)(110136005)(8936002)(81156014)(54906003)(7696005)(2906002)(6506007)(81166006)(316002); DIR:OUT; SFP:1101; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ho/3d5fC8FqBCGdU+Aw6CLuXbsjusf8TW+8R8CGrbAYU7EXddAPuiTgo3qwD8k1F17pJAP60EIwmjoti42doLsHU+bmrU1b0BsVccx7ZRyr+G7665RLuL/ZkkKlMY3viWpqFi4fBpFD3vIG2hhuIH5VoKrRnoe86Mry2Yy76ESXvBhMJBjwiAhaozePdd/u0XmInN3c17pLznhuDd1jMIh0KcT+AV/vrCfNt0FuLmBm2ts4fc7HpDeC2uSSa+CW0kmajlZBNrUDPIgngQ1kfqYbd2e5itPfzgwMQoJX0As2hhmOH0ED3ZMjtdeVjk/IMPEdhoff0OjsOA67Itv4AMwInkKXLkiWGzH8qw9072SZaghl/wRQpuHpN8ZRISzbt2w01eU4Qx5HsGmFamimFE768RrSPqeqA8BdvNY/Xzdo/gIes/TQUeUN+ZmDIzLkNKmPfY0lOYpdepGIwhV9kz0uL2unMueoU1JO4Dpe84Mj9PCHoB8rZm3D3LSa+a1rknQl/xtoy1dmTy/TeHIhnbw== x-ms-exchange-antispam-messagedata: uTJ7cW3HBnj1cZEydBvKoGqbrSQn3SyHi2E1ZtOFwbg4Q0bMBNZaaXiYxlslPGRtccfHRBFDFDMirBELXOfF+9Ki02b10H+h2VL6wV4mrpXeIKv9WtN8hECYuSeNwL1JF0BiieMZhrhwOGO6ndkZ0A== MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: fbed397a-de09-46f8-32bb-08d7d7217317 X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Apr 2020 16:18:15.9957 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: Vh1q3V1Tm+63mEHFdOnvmogn2SJqA3l9gGvAvdfI1wBiET7Yn3uQCcc5vxERDwRuAyLxciHdv+2eSmKj8RWS4Q== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR0502MB3619 Content-Type: text/plain; charset="iso-8859-8-i" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: Re: [dpdk-users] mlx5 pmd + rdma-core 28 init failure X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Can you run with log level debug and send us the log? =E4=F9=E2 =E0=FA Outlook =F2=E1=E5=F8 Android ________________________________ From: Benoit Ganne (bganne) Sent: Thursday, April 2, 2020 6:50:22 PM To: users@dpdk.org Cc: Matan Azrad ; Shahaf Shuler ;= Slava Ovsiienko Subject: RE: mlx5 pmd + rdma-core 28 init failure Adding MLX5 PMD maintainers. I also checked with latest rdma-core master and latest DPDK master and it i= s failing with the same issue. Any recommendation? Best ben > -----Original Message----- > From: Benoit Ganne (bganne) > Sent: mercredi 1 avril 2020 18:52 > To: users@dpdk.org > Subject: mlx5 pmd + rdma-core 28 init failure > > Hi all, > > I have troubles making DPDK v20.02 MLX5 PMD working with rdma-core v28.0: > it looks like the flow initialization done while initializing the device > fails in rdma-core providers/mlx5/dr_table.c:mlx5dv_dr_table_create() > because of unsupported parameters. > The issue is the following test in rdma-core > providers/mlx5/dr_table.c:mlx5dv_dr_table_create(): > if (level && !dmn->info.supp_sw_steering) { > errno =3D EOPNOTSUPP; > goto dec_ref; > } > Where level =3D=3D 65534 and dmn->info.supp_sw_steering =3D=3D false, hen= ce the > test is true and the function returns EOPNOTSUPP. > > Is this expected? It does work fine with ibv instead of dv API. Any help > appreciated. > > Here is what I do: > 1) checkout & compile rdma-core v28.0 > ~# git clone https://eur03.safelinks.protection.outlook.com/?url=3Dhttps%= 3A%2F%2Fgithub.com%2Flinux-rdma%2Frdma-core&data=3D02%7C01%7Cmatan%40me= llanox.com%7C7984449b13af4519d70608d7d71d9000%7Ca652971c7d2e4d9ba6a4d149256= f461b%7C0%7C0%7C637214394282618427&sdata=3DDSLvWg3cWwY8prSFOm8BAFf1I2bb= KnqPOKBPEiy4b44%3D&reserved=3D0 > ~# cd rdma-core > ~# git checkout v28.0 > ~# mkdir build > ~# cd build > ~# CFLAGS=3D-fPIC cmake -DIN_PLACE=3D1 -DENABLE_STATIC=3D1 -GNinja .. > ~# ninja > > 2) checkout & compile dpdk v20.02 > ~# git clone git://dpdk.org/dpdk > ~# cd dpdk > ~# make config T=3Dx86_64-native-linuxapp-gcc > ~# sed -ri 's,(MLX5_PMD=3D).*,\1y,' build/.config > ~# sed -ri 's,(IBVERBS_LINK_STATIC_PMD=3D).*,\1y,' build/.config > ~# make EXTRA_CFLAGS=3D-I/home/bganne/src/rdma-core/build/include > EXTRA_LDFLAGS=3D-L/home/bganne/src/rdma-core/build/lib > PKG_CONFIG_PATH=3D/home/bganne/src/rdma-core/build/lib/pkgconfig > ~# sudo gdb --args ./build/app/testpmd -w 0000:5e:00.0 -w 0000:5e:00.1 -l > 4,11,35 -- -a --forward-mode=3Drxonly -i > > The backtrace looks like this: > #0 mlx5dv_dr_table_create (dmn=3D0x555556c641b0, level=3D65534) at > ../providers/mlx5/dr_table.c:183 > #1 0x0000555555dfaeaa in flow_dv_tbl_resource_get (dev=3D= , > table_id=3D65534, egress=3D, transfer=3D, > error=3D0x7fffffffdca0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:6746 > #2 0x0000555555e02b28 in __flow_dv_translate > (dev=3Ddev@entry=3D0x555556bbcdc0 , dev_flow=3D0x1003883= 00, > attr=3D, items=3D, actions=3D, > error=3D) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:7503 > #3 0x0000555555e04954 in flow_dv_translate (dev=3D0x555556bbcdc0 > , dev_flow=3D, attr=3D, > items=3D, actions=3D, error=3D) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:8841 > #4 0x0000555555df152f in flow_drv_translate (error=3D0x7fffffffdca0, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > dev_flow=3D, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:2571 > #5 flow_create_split_inner (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > prefix_layers=3D0, sub_flow=3D0x0, flow=3D0x1003885c0, dev=3D0x555556bbcd= c0 > ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3490 > #6 flow_create_split_metadata (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > prefix_layers=3D0, flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) > at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3865 > #7 flow_create_split_meter (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, > flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4121 > #8 flow_create_split_outer (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, > flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4178 > #9 flow_list_create (dev=3Ddev@entry=3D0x555556bbcdc0 , > list=3Dlist@entry=3D0x0, attr=3Dattr@entry=3D0x7fffffffdc94, > items=3Ditems@entry=3D0x7fffffffdcc0, actions=3Dactions@entry=3D0x7ffffff= fdce0, > external=3Dexternal@entry=3Dfalse, error=3D0x7fffffffdca0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4306 > #10 0x0000555555df8587 in mlx5_flow_discover_mreg_c > (dev=3Ddev@entry=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:5747 > #11 0x0000555555d692a6 in mlx5_dev_spawn (config=3D..., spawn=3D0x1003e9e= 00, > dpdk_dev=3D0x555556dd6fe0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5.c:2763 > #12 mlx5_pci_probe (pci_drv=3D, pci_dev=3D)= at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5.c:3363 > #13 0x0000555555a411c8 in pci_probe_all_drivers () > #14 0x0000555555a412f8 in rte_pci_probe () > #15 0x0000555555a083da in rte_bus_probe () > #16 0x00005555559f204d in rte_eal_init () > #17 0x00005555556a0d45 in main () > > Best > ben