From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 4E22DA0588 for ; Wed, 1 Apr 2020 18:51:51 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 040111BFA6; Wed, 1 Apr 2020 18:51:51 +0200 (CEST) Received: from alln-iport-4.cisco.com (alln-iport-4.cisco.com [173.37.142.91]) by dpdk.org (Postfix) with ESMTP id 9796E1BF4F for ; Wed, 1 Apr 2020 18:51:49 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=cisco.com; i=@cisco.com; l=4980; q=dns/txt; s=iport; t=1585759909; x=1586969509; h=from:to:subject:date:message-id: content-transfer-encoding:mime-version; bh=tDNbi+Nh4zW56ZjPDBDVtGkZerkf/nCtVkvHJ+pT9Wk=; b=iTc2oHjBPB3vt38cbxo7uNW5Z4ZZgJgZI/EdFR2E61rHKMLJMSjL7JcY BMsoIvQW3DrYnwyOAk956lgmsUafjClLadnt1X51QAERNbRPMy90YpGAI Xek2kGw4qHDjd24iHQXviSWknAH/MOiCPEOkw2aaLjpnmeFXswui19a6q A=; IronPort-PHdr: =?us-ascii?q?9a23=3AmF2ZfRVJ1lYGLzw4YMNPdw5dveLV8LGuZFwc94?= =?us-ascii?q?YnhrRSc6+q45XlOgnF6O5wiEPSANSJ8OpK3uzRta2oGXcN55qMqjgjSNRNTF?= =?us-ascii?q?dE7KdehAk8GIiAAEz/IuTtankwE81EUlJN9HCgOk8TE8H7NBXf?= X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: =?us-ascii?q?A0DkMQCCxoRe/5hdJa1mHAEBATgBBAQ?= =?us-ascii?q?BAQIBBwEBgVWBPgIBARBQBWxYIAQLKgqHVQOKbk6DEpccglIDVAoBAQEMAQE?= =?us-ascii?q?fDgIEAQGERAKCOCQ4EwIDAQELAQEFAQEBAgEFBG2FVgELhgkVEwYBATgRAT5?= =?us-ascii?q?CJgEEChEagwWCSwMuAQMLo3gCgTmIYoF0M4J/AQEFhRwYggwJgTYCAQEBAYw?= =?us-ascii?q?tGoFBP4ERR4IYg0EZAoFng0KCLLEECoI9h2iPVYNQmCKPJ4kdknECBAIEBQI?= =?us-ascii?q?OAQEFgWkigVhwFTuCbAlHGA2SEIUUhUF0gSmMfAGBDwEB?= X-IronPort-AV: E=Sophos;i="5.72,332,1580774400"; d="scan'208";a="456664792" Received: from rcdn-core-1.cisco.com ([173.37.93.152]) by alln-iport-4.cisco.com with ESMTP/TLS/DHE-RSA-SEED-SHA; 01 Apr 2020 16:51:48 +0000 Received: from XCH-ALN-003.cisco.com (xch-aln-003.cisco.com [173.36.7.13]) by rcdn-core-1.cisco.com (8.15.2/8.15.2) with ESMTPS id 031GpmWQ003729 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=FAIL) for ; Wed, 1 Apr 2020 16:51:48 GMT Received: from xhs-rtp-003.cisco.com (64.101.210.230) by XCH-ALN-003.cisco.com (173.36.7.13) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 1 Apr 2020 11:51:48 -0500 Received: from xhs-rcd-002.cisco.com (173.37.227.247) by xhs-rtp-003.cisco.com (64.101.210.230) with Microsoft SMTP Server (TLS) id 15.0.1497.2; Wed, 1 Apr 2020 12:51:47 -0400 Received: from NAM11-CO1-obe.outbound.protection.outlook.com (72.163.14.9) by xhs-rcd-002.cisco.com (173.37.227.247) with Microsoft SMTP Server (TLS) id 15.0.1497.2 via Frontend Transport; Wed, 1 Apr 2020 11:51:46 -0500 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=fSQMGonYdFRwTWwFrySiS+rCo5g7jH0MYc8VMVWSEtazkMay5vDL6byQ8gNbb0J7CEyZ+exAT11FG4eKVIkdtg7Plfgmhhlsc1Pm7VxW79VE+11is4ZkCyLDGYMDlym+uis9IK4ndO/WKa16GYIBww44yCScvYuEI2j7Ji6PBcMrw/VgjCx3D++GqFKirlpUXMDO+AK4OIx+w3+qTqKQCRVUIbY8hanNF7IoIzxDzbCnr7doHvgvo8mHyVf5UgILuw9MAnkGNdHuzWPyGU2pzGP06iAsNCWNuY4xW3X604SdTGaJTxwIBef6PTkjPx8Bd4NIR2IO08oPff7LzvItMQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=j/adNa4/7nfA2Brnrj3ypBBZ1aVYBW3aXuuR8MsCL+s=; b=iiTzA5cHKK0ZrQoqNnLKIQmd4Vouy1Is3dHT6EpiNfamXooPZCmLV0uMUtVy7w7p5MMvTF7d/ziRfo802UzHvuPKsNSEMI1qcfH3KXjI5Yv4V2WxTGw9yI8mh/KcM8FLv7C+ispGG2rk2U0o24jGRnwOm/A+qhxaR2oTFzn4yVdIfED9aY7Jsion9Ve8tXj4wabVxa/nZWdvvS6bac+Dso7BRHPIRRJ9QSQpInfaYh8jhkAsPe2aQc5xZkETvWSO8WiltSwAsmplruv/tdjAOtA1orPcztLLSYL9jyvorsoe6kvgwOtjK5DA55oESvx4m0SZ0D71Nez45+L9OpDovg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=cisco.com; dmarc=pass action=none header.from=cisco.com; dkim=pass header.d=cisco.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cisco.onmicrosoft.com; s=selector2-cisco-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=j/adNa4/7nfA2Brnrj3ypBBZ1aVYBW3aXuuR8MsCL+s=; b=l9EhJQ0M2HEEJJurnYM7pYtI6Fq1x0MzAKXe0h8PGFGHDOUucIi47lyDSc+TfWMegM6NhWh/Gg2tQYAiMT7WV/ofCKyl7kdnbbzjGxGbKbX45WG1bXQX5n4QZRafL/PPjZXDbgZCdNaC66xGG01ANKHl4mgy9MIcsJfrsRF8EfU= Received: from CH2PR11MB4327.namprd11.prod.outlook.com (2603:10b6:610:43::30) by CH2PR11MB4455.namprd11.prod.outlook.com (2603:10b6:610:46::20) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2856.20; Wed, 1 Apr 2020 16:51:46 +0000 Received: from CH2PR11MB4327.namprd11.prod.outlook.com ([fe80::2d84:413f:5702:c519]) by CH2PR11MB4327.namprd11.prod.outlook.com ([fe80::2d84:413f:5702:c519%5]) with mapi id 15.20.2856.019; Wed, 1 Apr 2020 16:51:46 +0000 From: "Benoit Ganne (bganne)" To: "users@dpdk.org" Thread-Topic: mlx5 pmd + rdma-core 28 init failure Thread-Index: AdYIQ9Z8ZbHXLbfSTDeYhwt0ihzoWA== Date: Wed, 1 Apr 2020 16:51:45 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=bganne@cisco.com; x-originating-ip: [92.154.90.183] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: f2f76244-304f-4058-23fc-08d7d65cf6b5 x-ms-traffictypediagnostic: CH2PR11MB4455: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:6790; x-forefront-prvs: 03607C04F0 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CH2PR11MB4327.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(10009020)(4636009)(39860400002)(366004)(136003)(346002)(396003)(376002)(8676002)(81166006)(55016002)(316002)(81156014)(966005)(71200400001)(66446008)(9686003)(66476007)(478600001)(64756008)(186003)(5660300002)(76116006)(6916009)(52536014)(7696005)(8936002)(26005)(66946007)(66556008)(2906002)(6506007)(86362001)(33656002); DIR:OUT; SFP:1101; received-spf: None (protection.outlook.com: cisco.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: l7b0tR2W6U5xw0JuoXVwrmbkmBD8BgYf4rZ/7KZLJFAns+opobapletDdb6cAdttNu7/GjYYIoOpuDYN2cSkeHkBwrU7H2DERbZ4QmGL3z0pUs6xQMB7//RfsfSA42nAUzahMP1INX7bqTVm6RUqi1rbs4KitMjoMV71aKkvIu1F0gXx0yKkhshsYZHBF56QuMTt5RY6hIj5ELjrRdznMXaN6ogtt7hq8N/USOqWigVQI2bNemR/NYsSEgWUyNrcN5NMrTYQL+dLG/OZPgKSGZYG15cWCCKKQcsuwLwZvyUswqS4NX1+QXnAm76xc5MCJSNwxaJ4xkPUC3Iej8jzF7qj7Gn4wS80wa4kkdxbBMJu+MUcSZ82hVwjbzWaMNxCBiDw3CIWj7yftJxISV4cNfrMEI4n2vaUyixrHntOqWzn6OdHTheqr1JyxHNVkGJGEifpuQkrPtA9JqHutDuMfnwP7tBQCx/DJ3vrDpvhPtxkTQOtGXs8pvyQ6iAnnPH2wgGQus1NqRPP2uMraEosUA== x-ms-exchange-antispam-messagedata: ugJ+X1O3Gh+ItxhJWUKhDBEuaTpO0RpFiePIKHBlvU5bKgBL2Zn6cHNA0uDQ0ye6cY7TaRFnqk06+EvoKm14rdKZmybqKzD5VYUZ54pk+hv72NuFmI8iOFssodCt3MRySwDZ3FIb4c+TcTOG3zPSdQ== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-Network-Message-Id: f2f76244-304f-4058-23fc-08d7d65cf6b5 X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Apr 2020 16:51:45.8897 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 5ae1af62-9505-4097-a69a-c1553ef7840e X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: UlD6+8dGBSDJIxDIkw0nJ3lVlSVhlm2uP+wDqoKNnnBCUSff6sQy92Kwz6MGPHtrK/S+zH4bneYcDRyujYP/+g== X-MS-Exchange-Transport-CrossTenantHeadersStamped: CH2PR11MB4455 X-OriginatorOrg: cisco.com X-Outbound-SMTP-Client: 173.36.7.13, xch-aln-003.cisco.com X-Outbound-Node: rcdn-core-1.cisco.com Subject: [dpdk-users] mlx5 pmd + rdma-core 28 init failure X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" Hi all, I have troubles making DPDK v20.02 MLX5 PMD working with rdma-core v28.0: i= t looks like the flow initialization done while initializing the device fai= ls in rdma-core providers/mlx5/dr_table.c:mlx5dv_dr_table_create() because = of unsupported parameters. The issue is the following test in rdma-core providers/mlx5/dr_table.c:mlx5= dv_dr_table_create(): if (level && !dmn->info.supp_sw_steering) { errno =3D EOPNOTSUPP; goto dec_ref; } Where level =3D=3D 65534 and dmn->info.supp_sw_steering =3D=3D false, hence= the test is true and the function returns EOPNOTSUPP. Is this expected? It does work fine with ibv instead of dv API. Any help ap= preciated. Here is what I do: 1) checkout & compile rdma-core v28.0 ~# git clone https://github.com/linux-rdma/rdma-core ~# cd rdma-core ~# git checkout v28.0 ~# mkdir build ~# cd build ~# CFLAGS=3D-fPIC cmake -DIN_PLACE=3D1 -DENABLE_STATIC=3D1 -GNinja .. ~# ninja 2) checkout & compile dpdk v20.02 ~# git clone git://dpdk.org/dpdk ~# cd dpdk ~# make config T=3Dx86_64-native-linuxapp-gcc ~# sed -ri 's,(MLX5_PMD=3D).*,\1y,' build/.config ~# sed -ri 's,(IBVERBS_LINK_STATIC_PMD=3D).*,\1y,' build/.config ~# make EXTRA_CFLAGS=3D-I/home/bganne/src/rdma-core/build/include EXTRA_LDF= LAGS=3D-L/home/bganne/src/rdma-core/build/lib PKG_CONFIG_PATH=3D/home/bgann= e/src/rdma-core/build/lib/pkgconfig ~# sudo gdb --args ./build/app/testpmd -w 0000:5e:00.0 -w 0000:5e:00.1 -l 4= ,11,35 -- -a --forward-mode=3Drxonly -i The backtrace looks like this: #0 mlx5dv_dr_table_create (dmn=3D0x555556c641b0, level=3D65534) at ../prov= iders/mlx5/dr_table.c:183 #1 0x0000555555dfaeaa in flow_dv_tbl_resource_get (dev=3D, = table_id=3D65534, egress=3D, transfer=3D, err= or=3D0x7fffffffdca0) at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv= .c:6746 #2 0x0000555555e02b28 in __flow_dv_translate (dev=3Ddev@entry=3D0x555556bb= cdc0 , dev_flow=3D0x100388300, attr=3D, ite= ms=3D, actions=3D, error=3D) a= t /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:7503 #3 0x0000555555e04954 in flow_dv_translate (dev=3D0x555556bbcdc0 , dev_flow=3D, attr=3D, items=3D, actions=3D, error=3D) at /home/bg= anne/src/dpdk/drivers/net/mlx5/mlx5_flow_dv.c:8841 #4 0x0000555555df152f in flow_drv_translate (error=3D0x7fffffffdca0, actio= ns=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, dev_flo= w=3D, dev=3D0x555556bbcdc0 ) at /home/bgann= e/src/dpdk/drivers/net/mlx5/mlx5_flow.c:2571 #5 flow_create_split_inner (error=3D0x7fffffffdca0, external=3Dfalse, acti= ons=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, prefix= _layers=3D0, sub_flow=3D0x0, flow=3D0x1003885c0, dev=3D0x555556bbcdc0 ) at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3490 #6 flow_create_split_metadata (error=3D0x7fffffffdca0, external=3Dfalse, a= ctions=3D0x7fffffffdce0, items=3D0x7fffffffdcc0, attr=3D0x7fffffffbb88, pre= fix_layers=3D0, flow=3D0x1003885c0, dev=3D0x555556bbcdc0 )= at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5_flow.c:3865 #7 flow_create_split_meter (error=3D0x7fffffffdca0, external=3Dfalse, acti= ons=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, flow= =3D0x1003885c0, dev=3D0x555556bbcdc0 ) at /home/bganne/src= /dpdk/drivers/net/mlx5/mlx5_flow.c:4121 #8 flow_create_split_outer (error=3D0x7fffffffdca0, external=3Dfalse, acti= ons=3D0x7fffffffdce0, items=3D, attr=3D0x7fffffffdc94, flow= =3D0x1003885c0, dev=3D0x555556bbcdc0 ) at /home/bganne/src= /dpdk/drivers/net/mlx5/mlx5_flow.c:4178 #9 flow_list_create (dev=3Ddev@entry=3D0x555556bbcdc0 , l= ist=3Dlist@entry=3D0x0, attr=3Dattr@entry=3D0x7fffffffdc94, items=3Ditems@e= ntry=3D0x7fffffffdcc0, actions=3Dactions@entry=3D0x7fffffffdce0, external= =3Dexternal@entry=3Dfalse, error=3D0x7fffffffdca0) at /home/bganne/src/dpdk= /drivers/net/mlx5/mlx5_flow.c:4306 #10 0x0000555555df8587 in mlx5_flow_discover_mreg_c (dev=3Ddev@entry=3D0x55= 5556bbcdc0 ) at /home/bganne/src/dpdk/drivers/net/mlx5/mlx= 5_flow.c:5747 #11 0x0000555555d692a6 in mlx5_dev_spawn (config=3D..., spawn=3D0x1003e9e00= , dpdk_dev=3D0x555556dd6fe0) at /home/bganne/src/dpdk/drivers/net/mlx5/mlx5= .c:2763 #12 mlx5_pci_probe (pci_drv=3D, pci_dev=3D) a= t /home/bganne/src/dpdk/drivers/net/mlx5/mlx5.c:3363 #13 0x0000555555a411c8 in pci_probe_all_drivers () #14 0x0000555555a412f8 in rte_pci_probe () #15 0x0000555555a083da in rte_bus_probe () #16 0x00005555559f204d in rte_eal_init () #17 0x00005555556a0d45 in main () Best ben