From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 2DA9BA0562 for ; Thu, 2 Apr 2020 17:50:28 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 52BD81BEC7; Thu, 2 Apr 2020 17:50:27 +0200 (CEST) Received: from rcdn-iport-6.cisco.com (rcdn-iport-6.cisco.com [173.37.86.77]) by dpdk.org (Postfix) with ESMTP id 886F12BCE for ; Thu, 2 Apr 2020 17:50:25 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=5487; q=dns/txt; s=iport; t=1585842625; x=1587052225; h=from:to:cc:subject:date:message-id:references: in-reply-to:content-transfer-encoding:mime-version; bh=sbHDg6D15kV6qb2Nvy67eNIJUq4OMBMuZVL2qn3LD2Y=; b=iIj1Bg/FqqZbEk+C4gtEtn47kvShjEEsO1AY7J89gVjM0dBndqcjAr2U JsDQC0PX+5LNKnQo98k9p0mBj1nnfc9UWpfHFnwpYBuh3p9YHZfzc7+rt QQyEh6/l59aU1PrtUvIJyEuBYW6Z4frCpUt3s/zEF7E+mzLWcoq904Xif c=; IronPort-PHdr: =?us-ascii?q?9a23=3ATxGjCxDcN+avkmZCu0aKUyQJPHJ1sqjoPgMT9p?= =?us-ascii?q?ssgq5PdaLm5Zn5IUjD/qg83kTRU9Dd7PRJw6rNvqbsVHZIwK7JsWtKMfkuHw?= =?us-ascii?q?QAld1QmgUhBMCfDkiuJvHjaSo3NM9DT1RiuXq8NBsdFQ=3D=3D?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0BqCACuCIZe/4kNJK1mHgELHIFwC4F?= =?us-ascii?q?UUAVsWCAECyoKh1YDimeCX4EBlx2BLoEkA1QKAQEBDAEBHw4CBAEBhEQCgkE?= =?us-ascii?q?kNgcOAgMBAQsBAQUBAQECAQUEbYVWAQuFcAEBAQEDEhUTBgEBNwELBAIBCBE?= =?us-ascii?q?EAQEfEDIdCAEBBAoEBQgagwWCSwMuAQ6kTwKBOYhigXQzgn8BAQWFNhiCDAm?= =?us-ascii?q?BOIwxGoFBP4ERR4IYNT6CThkCgWeDQoIsoS+PVwqCPYdpj0+DUJgijymJIZJ?= =?us-ascii?q?1AgQCBAUCDgEBBYFZByuBV3AVO4JpCUcYDY4dg3OFFIVBdIEpjQ4BgQ8BAQ?= X-IronPort-AV: E=Sophos;i="5.72,336,1580774400"; d="scan'208";a="750185212" Received: from alln-core-4.cisco.com ([173.36.13.137]) by rcdn-iport-6.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 02 Apr 2020 15:50:24 +0000 Received: from XCH-ALN-001.cisco.com (xch-aln-001.cisco.com [173.36.7.11]) by alln-core-4.cisco.com (8.15.2/8.15.2) with ESMTPS id 032FoOl8015430 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL); Thu, 2 Apr 2020 15:50:24 GMT Received: from xhs-aln-003.cisco.com (173.37.135.120) by XCH-ALN-001.cisco.com (173.36.7.11) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 2 Apr 2020 10:50:24 -0500 Received: from xhs-rcd-002.cisco.com (173.37.227.247) by xhs-aln-003.cisco.com (173.37.135.120) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Thu, 2 Apr 2020 10:50:23 -0500 Received: from NAM10-DM6-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-002.cisco.com (173.37.227.247) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Thu, 2 Apr 2020 10:50:23 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=IioVuIFUqKeqEdqhjCwVPsR3kO2pmjJrFruWp0BoiZlph3UrsgmwTC4Vl6Wk5Nhg2yukCq3lR1YiuFfKTobiimeAYu05q2kgkoJEedtOQexskIafwHzaVqpwy1tOImneavGk7rEM/f+8ZIFztW28d9YlgJEJtTa/eQA9ebz89QCOwgk0JWUiKQ5ySGmW5lapxIQ4+4xYb/Uc6BTfdQS/wFw1DjpZTDESjN6fsjUYR69GPvDRnrg1jYY1WlkuPh+tSfx1YonvGorlEZ7AzKu1qF4VpqKJUVt9DK1W7YPXntm6JcXIif2Yt3kkIsEoKH+Tp6hyWeLnUG+DylaD4vpKmw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4OGG1M2IXygyJYAPjoKlP5VdXWyHGHNUIvNvA+mwcYc=; b=EIzWG7KH4Kf7gaYhirYB2BkK8cmu853YRvqAKuIry5b5fgAjWqrC0UHwhJeEQfKm3vXd0dSVs0g9x8k6fA4hcfnky/GzoUjtl6IFwybjSK07Rh+OA6EDjy6qIPkc6EbE5v2qAntPTd2/x+JLBza2AmaFKNQf+ZN/e3/+MUdWwZ30lc7/HBzosx8VpeDNI697mTM/XZrkU1cLtb97PRk/9d9Y5B3AfN0Nai+y6NBYbJMljbsfNlq+YUSPkxc0tWg0x9zbw6aCFWtAvRjReLYXyYm+isyDBWJHS3YMJw8QbXqF7WHP3b2/LWqoML5Myu8cQF3amFBLylbZJ+IY+WD6YQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=4OGG1M2IXygyJYAPjoKlP5VdXWyHGHNUIvNvA+mwcYc=; b=lvN1shA5Pzl9R+2j6SKNVQ11WBRaNwP+oXQriBbbwaNnJGEudyvykF9wAjr+Ta9BqZ3eiBvUfc1a3aJ7+p4pJA974ak76aUK4Lpu0ggyfT59EcvSpQSjSeU45BFAawnHc1Lk8DCwH8leDttUZqJXnel2dMoMnOc+8Yiuq4Dv5ZM= Received: from CH2PR11MB4327.namprd11.prod.outlook.com (2603:10b6:610:43::30) by CH2PR11MB4453.namprd11.prod.outlook.com (2603:10b6:610:43::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2856.18; Thu, 2 Apr 2020 15:50:22 +0000 Received: from CH2PR11MB4327.namprd11.prod.outlook.com ([fe80::2d84:413f:5702:c519]) by CH2PR11MB4327.namprd11.prod.outlook.com ([fe80::2d84:413f:5702:c519%5]) with mapi id 15.20.2856.019; Thu, 2 Apr 2020 15:50:22 +0000 From: "Benoit Ganne (bganne)" To: "users@dpdk.org" CC: "matan@mellanox.com" , "shahafs@mellanox.com" , "viacheslavo@mellanox.com" Thread-Topic: mlx5 pmd + rdma-core 28 init failure Thread-Index: AdYIQ9Z8ZbHXLbfSTDeYhwt0ihzoWAAwhXsg Date: Thu, 2 Apr 2020 15:50:22 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=bganne@cisco.com; x-originating-ip: [173.38.220.39] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 861434c7-de73-47ac-ed57-08d7d71d8d75 x-ms-traffictypediagnostic: CH2PR11MB4453: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6790; x-forefront-prvs: 0361212EA8 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH2PR11MB4327.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10009020)(4636009)(396003)(346002)(376002)(39860400002)(366004)(136003)(186003)(8936002)(76116006)(4326008)(26005)(5660300002)(71200400001)(66446008)(2906002)(33656002)(316002)(66946007)(66476007)(81166006)(53546011)(81156014)(86362001)(966005)(66556008)(64756008)(54906003)(7696005)(478600001)(9686003)(6916009)(8676002)(55016002)(6506007)(52536014); DIR:OUT; SFP:1101; received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: qfbh0VZkn2m8szMIcFloYh0sJgQ6Q4qfTaFAA5Qal3NixEfqWmCBv49WEpNWC5dl1UxRW+FS/m656BYmQE/sTSdhU+IebDzwwQRiCV6Dk1WidrwyyDqSEvs4glYQ1f4MFZkXoDcjBv8/XmvCESk2YSng8jliuKImdP8OP+AgSTYQIyV4+2dKVSSBp7i8piKRzjqoX/Dxdk6HQ84U3v1iLQyEloFcS9xFI85Wv5Mq66LyEX1t/66L9kNu1FlzQsxmr8ZsfzRtOknRg673EhY6kMjM5C0Bwgw+5RpZ7rccT0KwBzoH3cOFHo5LOOMqw3tzzNzgmy2Xt8HlYBIyUYaoPUng8Jo+YQQko04++vs5mlyg3FCyShuIU/e2SD3a8UkLPEdTqVk3cLg2283i3T5GYvMyC0hHhx1TBiNq5dOCdKEqRhvBg01mUMsTtknk0URtr4yk5gDUCqINNk1BwGXmpcz+n13hYlIPSZnVp3viZB0OphjMeDwnFsbvHhRt8VIr5It2acHnqcLI7s7m99TbYA== x-ms-exchange-antispam-messagedata: keDw29RXDY2ZQXOWJwrJ/c1mTwJHtumYwQe/2n9ya2N+A8V9XnOSWIYGcYpWFpFVKdyBK6b/BI+i6v0eNpvz9gOMpnmHKChgtwfUi1uH54sP4kvW7KwoONUYjPTpSNbqcHS4AIiYPoN98DAwlcBl/Q== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: 861434c7-de73-47ac-ed57-08d7d71d8d75 X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Apr 2020 15:50:22.1924 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: SD90Dd08fjJt8XQ03+/+SLvYCLYdbcmW3fWsSJML3s2brozVLtyHJYwYUu4a/JVYJEXqdW/gVWsLCTUfRHF8UQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH2PR11MB4453 X-OriginatorOrg: cisco.com X-Outbound-SMTP-Client: 173.36.7.11, xch-aln-001.cisco.com X-Outbound-Node: alln-core-4.cisco.com Subject: Re: [dpdk-users] mlx5 pmd + rdma-core 28 init failure X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Adding MLX5 PMD maintainers. I also checked with latest rdma-core master and latest DPDK master and it i= s failing with the same issue. Any recommendation? Best ben > -----Original Message----- > From: Benoit Ganne (bganne) > Sent: mercredi 1 avril 2020 18:52 > To: users@dpdk.org > Subject: mlx5 pmd + rdma-core 28 init failure >=20 > Hi all, >=20 > I have troubles making DPDK v20.02 MLX5 PMD working with rdma-core v28.0: > it looks like the flow initialization done while initializing the device > fails in rdma-core providers/mlx5/dr_table.c:mlx5dv_dr_table_create() > because of unsupported parameters. > The issue is the following test in rdma-core > providers/mlx5/dr_table.c:mlx5dv_dr_table_create(): > if (level && !dmn->info.supp_sw_steering) { > errno =3D EOPNOTSUPP; > goto dec_ref; > } > Where level =3D=3D 65534 and dmn->info.supp_sw_steering =3D=3D false, hen= ce the > test is true and the function returns EOPNOTSUPP. >=20 > Is this expected? It does work fine with ibv instead of dv API. Any help > appreciated. >=20 > Here is what I do: > 1) checkout & compile rdma-core v28.0 > ~# git clone https://github.com/linux-rdma/rdma-core > ~# cd rdma-core > ~# git checkout v28.0 > ~# mkdir build > ~# cd build > ~# CFLAGS=3D-fPIC cmake -DIN_PLACE=3D1 -DENABLE_STATIC=3D1 -GNinja .. > ~# ninja >=20 > 2) checkout & compile dpdk v20.02 > ~# git clone git://dpdk.org/dpdk > ~# cd dpdk > ~# make config T=3Dx86_64-native-linuxapp-gcc > ~# sed -ri 's,(MLX5_PMD=3D).*,\1y,' build/.config > ~# sed -ri 's,(IBVERBS_LINK_STATIC_PMD=3D).*,\1y,' build/.config > ~# make EXTRA_CFLAGS=3D-I/home/bganne/src/rdma-core/build/include > EXTRA_LDFLAGS=3D-L/home/bganne/src/rdma-core/build/lib > PKG_CONFIG_PATH=3D/home/bganne/src/rdma-core/build/lib/pkgconfig > ~# sudo gdb --args ./build/app/testpmd -w 0000:5e:00.0 -w 0000:5e:00.1 -l > 4,11,35 -- -a --forward-mode=3Drxonly -i >=20 > The backtrace looks like this: > #0 mlx5dv_dr_table_create (dmn=3D0x555556c641b0, level=3D65534) at > ../providers/mlx5/dr_table.c:183 > #1 0x0000555555dfaeaa in flow_dv_tbl_resource_get (dev=3D= , > table_id=3D65534, egress=3D, transfer=3D, > error=3D0x7fffffffdca0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:6746 > #2 0x0000555555e02b28 in __flow_dv_translate > (dev=3Ddev@entry=3D0x555556bbcdc0 , dev_flow=3D0x1003883= 00, > attr=3D, items=3D, actions=3D, > error=3D) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:7503 > #3 0x0000555555e04954 in flow_dv_translate (dev=3D0x555556bbcdc0 > , dev_flow=3D, attr=3D, > items=3D, actions=3D, error=3D) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:8841 > #4 0x0000555555df152f in flow_drv_translate (error=3D0x7fffffffdca0, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > dev_flow=3D, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:2571 > #5 flow_create_split_inner (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > prefix_layers=3D0, sub_flow=3D0x0, flow=3D0x1003885c0, dev=3D0x555556bbcd= c0 > ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3490 > #6 flow_create_split_metadata (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, > prefix_layers=3D0, flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) > at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3865 > #7 flow_create_split_meter (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, > flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4121 > #8 flow_create_split_outer (error=3D0x7fffffffdca0, external=3Dfalse, > actions=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, > flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4178 > #9 flow_list_create (dev=3Ddev@entry=3D0x555556bbcdc0 , > list=3Dlist@entry=3D0x0, attr=3Dattr@entry=3D0x7fffffffdc94, > items=3Ditems@entry=3D0x7fffffffdcc0, actions=3Dactions@entry=3D0x7ffffff= fdce0, > external=3Dexternal@entry=3Dfalse, error=3D0x7fffffffdca0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:4306 > #10 0x0000555555df8587 in mlx5_flow_discover_mreg_c > (dev=3Ddev@entry=3D0x555556bbcdc0 ) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:5747 > #11 0x0000555555d692a6 in mlx5_dev_spawn (config=3D..., spawn=3D0x1003e9e= 00, > dpdk_dev=3D0x555556dd6fe0) at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5.c:2763 > #12 mlx5_pci_probe (pci_drv=3D, pci_dev=3D)= at > /home/bganne/src/dpdk/drivers/net/mlx5/mlx5.c:3363 > #13 0x0000555555a411c8 in pci_probe_all_drivers () > #14 0x0000555555a412f8 in rte_pci_probe () > #15 0x0000555555a083da in rte_bus_probe () > #16 0x00005555559f204d in rte_eal_init () > #17 0x00005555556a0d45 in main () >=20 > Best > ben