From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM01-BN3-obe.outbound.protection.outlook.com (mail-bn3nam01on0081.outbound.protection.outlook.com [104.47.33.81]) by dpdk.org (Postfix) with ESMTP id 9ED7F23B for ; Tue, 23 May 2017 07:39:38 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=studentuml.onmicrosoft.com; s=selector1-student-uml-edu; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=uWNVBo/kGuBf9eVWv+HWyLP3kIPl6AlQL2zdryxtz2s=; b=jOy6o54wpZr7O3kZPJsnOvMdVeiCxHnC/RgNH1JNjNm5HPe03NECMEgA+bnz4KFQUb5FfCvVnFejLrleP8AWGXudiQOmWpmZkWuQ45Ig3PoJVDBpWfCKAh/203bMvWsia7gXBMzvDK/AI3O0nfJm79QfQeRZ0odQBAAwWQl6VbU= Received: from BN6PR02MB2706.namprd02.prod.outlook.com (10.175.95.20) by BN6PR02MB2707.namprd02.prod.outlook.com (10.175.95.21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1101.14; Tue, 23 May 2017 05:39:36 +0000 Received: from BN6PR02MB2706.namprd02.prod.outlook.com ([10.175.95.20]) by BN6PR02MB2706.namprd02.prod.outlook.com ([10.175.95.20]) with mapi id 15.01.1101.019; Tue, 23 May 2017 05:39:36 +0000 From: "Wu, Xiaoban" To: "users@dpdk.org" Thread-Topic: Mellanox 100G NIC, VF SR-IOV, docker container, EAL could not detect the device Thread-Index: AQHS04bl+l8wHsB7oEadpj/oNHqf7w== Date: Tue, 23 May 2017 05:39:36 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=student.uml.edu; x-originating-ip: [2603:10b6:404:f5:cafe::37] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; BN6PR02MB2707; 7:se5w77qlvik3YNVprj/21qECzJzIVqZ9WOLmzpm3kIDsCq7jfuQPTscz99vjQAN03yov7KPTlZq+DdlcF+j5GZ3EovfHwrXdX2t8HkP4zy1Fkmzq6uOwYP9zyy9uZQMyFUV6qtqrrlm6r2z0dwB0PBqCsHzEoTR/x0J6xeYf2Bm44cc9rou5NTiZ+Vs4/rJ3TEHEZ2kcapUI83E5na5o6LCYLdpjtvus6e7lufr425x0c+nNdtmrCExMYm2j3WRFTxEa+0DNBsg3UvoIFTjWm32doYWT3OPGUtakManR63Yx7wOqWkGbtuT3omisXaBBRF4WBgL8Oo5ih27hgH3g/g== x-ms-traffictypediagnostic: BN6PR02MB2707: x-ms-office365-filtering-correlation-id: 144f8f72-9922-4a2d-8292-08d4a19e1925 x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(22001)(2017030254075)(201703131423075)(201703031133081); SRVR:BN6PR02MB2707; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040450)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(93006095)(93001095)(6041248)(20161123560025)(20161123555025)(20161123564025)(201703131423075)(201702281529075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123558100)(6072148); SRVR:BN6PR02MB2707; BCL:0; PCL:0; RULEID:; SRVR:BN6PR02MB2707; x-forefront-prvs: 0316567485 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(39400400002)(39840400002)(39450400003)(39410400002)(75432002)(6606003)(2906002)(7696004)(88552002)(74316002)(54356999)(102836003)(7736002)(33656002)(122556002)(53936002)(19627405001)(50986999)(5640700003)(38730400002)(6916009)(42882006)(53336002)(77096006)(189998001)(55016002)(99286003)(110136004)(25786009)(54896002)(2351001)(9686003)(478600001)(6436002)(6506006)(6116002)(86362001)(2900100001)(81166006)(5660300001)(8936002)(3660700001)(1730700003)(72206003)(2501003)(3280700002)(8676002)(413944005); DIR:OUT; SFP:1101; SCL:1; SRVR:BN6PR02MB2707; H:BN6PR02MB2706.namprd02.prod.outlook.com; FPR:; SPF:None; MLV:sfv; LANG:en; spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: student.uml.edu X-MS-Exchange-CrossTenant-originalarrivaltime: 23 May 2017 05:39:36.3444 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4c25b8a6-17f7-46f9-83f0-54734ab81fb1 X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR02MB2707 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Mellanox 100G NIC, VF SR-IOV, docker container, EAL could not detect the device X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 May 2017 05:39:39 -0000 Dear DPDK users, I am trying to use the VF of the Mellanox 100G NIC enabled by SR-IOV. The f= ollowing is what I have done. 1. Add "intel_iommu=3Don iommu=3Dpt" to kernel command line option, up= date-grub, and reboot 2. Install the MLNX-OFED, reboot 3. In default the card is in infiband mode, so I switched it to ethern= et mode (in order to run DPDK application) and reboot. 4. mst start mlxconfig -d /dev/mst/mt4115_pciconf0 q #query mlxconfig -d /dev/mst/mt4115_pciconf0 set SRIOV_EN=3D1 NUM_OF_VFS= =3D1 reboot 5. echo 1 > /sys/bus/pci/devices/0000\:83\:00.0/mlx5_num_vfs 6. modprobe vfio-pci 7. dpdk-devbind.py --status 8. dpdk-devbind.py -b vfio-pci 0000:83:00.1 9. ls -al /dev/vfio 10. docker run -it --privileged --device=3D/dev/vfio/54:/dev/vfio/54 -= -device=3D/dev/vfio/vfio:/dev/vfio/vfio -v /mnt/huge/:/dev/hugepages/ -v /v= ar/run:/var/run $IMAGEID bash 11. $dpdkapp -c 0x01 --socket-mem=3D128,128 --file-prefix=3D"docker1" However, in the EAL part, it does not list any usable devices EAL: Detected 12 lcore(s) EAL: Probing VFIO support... EAL: VFIO support initialized PMD: bnxt_rte_pmd_init() called for (null) Error, rte_eth_dev_configure() returns negative! Can anybody please point out any possible solution? Looking forward to your= reply. Thanks very much for your help. Best wishes, Xiaoban