From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50071.outbound.protection.outlook.com [40.107.5.71]) by dpdk.org (Postfix) with ESMTP id 3B9622B9C for ; Mon, 4 Jul 2016 13:00:11 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=7MD2kntyZCsdbZNam4hC+rH+AKZ0ofVdjvvHnRe3VSA=; b=fYAvGECgd8xJefrDqTosKIDsVrhfG+Z/Jt07Uj9gv1LRlkbg20DbE5VbR2pkdtwUS2NfKTs3qmGdXZR+BZlHjFp0v5uZ5ceIMSiAsZdsOHjQqJdmNBvV8OAdUWxBrhLfwfXvy3RHoYW5QaszVeQi6hd2OUPSSnUBb1psy/cr+as= Received: from AM4PR05MB1651.eurprd05.prod.outlook.com (10.165.245.146) by AM3PR05MB1396.eurprd05.prod.outlook.com (10.163.8.139) with Microsoft SMTP Server (TLS) id 15.1.528.16; Mon, 4 Jul 2016 11:00:10 +0000 Received: from AM4PR05MB1651.eurprd05.prod.outlook.com ([10.165.245.146]) by AM4PR05MB1651.eurprd05.prod.outlook.com ([10.165.245.146]) with mapi id 15.01.0534.015; Mon, 4 Jul 2016 11:00:09 +0000 From: Olga Shern To: Ruslan Osmanov CC: "users@dpdk.org" , Gideon Naim Thread-Topic: [dpdk-users] testpmd: [mlx4] rxq_add_flow(): flow configuration failed, errno=38: Function not implemented Thread-Index: AQHR1DpLpSawJuf2BEODxdPTR5hIDaAGn6PAgAERfwCAAAbkgIAAZJ6g Date: Mon, 4 Jul 2016 11:00:09 +0000 Message-ID: References: <20160702151812.4ce83c53@asus> <20160704113030.021deebd@asus> <20160704115509.49fac9c7@asus> In-Reply-To: <20160704115509.49fac9c7@asus> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=olgas@mellanox.com; x-originating-ip: [193.47.165.251] x-ms-office365-filtering-correlation-id: c3c06951-45dc-49ed-d75a-08d3a3fa5dbe x-microsoft-exchange-diagnostics: 1; AM3PR05MB1396; 6:rBuGw5cZdJuxGk59X9SjDp9i+b/K/pJXi9y8dIbx39cwKtppImMOwTta/ssi8+wyDVpWhTnnYCf72/Roykw5hIIYtFyTSS2xn2fRqQVu+U9y2tTcCodmotI/Cla1i6l0iZp5DYf/KuoY/Z5M1Poz8oKr0VTqKStLX5CNA1kZy1N/aUf9WJq1THO+NmEF3x8nvpzTuYbw8XQkCvfkMmpUdlPQZagJwPTJLN7KydjKILDU1tz3hMdS1rahM0Xok+K0uLTyPNxrZw1AGiwtKmpkft4UOHCgwWQW37g/Qpo+Pt+lgrvOqfSFYWSqalIwb18GM3EOtJ1rQH0jbuUe2t1BIQ==; 5:92OF1toaHCaWR+DejAy02Kd1K2PzhvKJBCwRL1/QMUqLdo2e3MMujmnBdAw/lcEPtUn/yYkyNEOT40fhl9fCQ9fhDYAWpefg71nc2V2AyWF7sndv2eZ6fn+lOw+z1MPNQrV0LNF/JRz2TPYmtPiDWg==; 24:1w2If6DvHOwIbbuVMsYjEG1YwBXc+UGBQAUIUTW4t0x6KcJOqV4yVHWJE+jOGGAIIS3UWXDcrteDZn4UpcQsGOXEORRlspfByBYRTS+bx8c=; 7:lLVplcxtbtOfLnDFMClMS1g6p/kMYR/d0JNn+Yd14LXBksvKIdU6p+TdBERZ10bUUJWfsc6txcMtGMBN5iOOy3dHMJkdNdfo8/K7AY5meYSk5ed2sy8q3Jh48orSj2xcG5QD/Vsj2Et+1Q4Hs1fI4iEuZIzfI+H15w1o/VHrbeEgGoqjFeCJPrVx51uVjPyACJLhrrXf0URDr/37xLjqX6W0I+X+DR2T+XHDzO94MXS95w4E2Oe0Tp64X76IBOGL x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:AM3PR05MB1396; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(278428928389397)(166708455590820)(209352067349851)(192278398808882); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(5005006)(8121501046)(3002001)(10201501046)(6055026); SRVR:AM3PR05MB1396; BCL:0; PCL:0; RULEID:; SRVR:AM3PR05MB1396; x-forefront-prvs: 0993689CD1 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(13464003)(189002)(199003)(53474002)(288314003)(51234002)(377454003)(24454002)(4001430100002)(93886004)(5003600100003)(7696003)(7846002)(74316002)(7736002)(10400500002)(4326007)(97736004)(305945005)(33656002)(77096005)(8936002)(8676002)(189998001)(15975445007)(92566002)(110136002)(122556002)(3846002)(102836003)(6116002)(106116001)(1411001)(81166006)(50986999)(54356999)(76176999)(68736007)(3280700002)(106356001)(66066001)(19580395003)(5002640100001)(19580405001)(2950100001)(3660700001)(2900100001)(76576001)(87936001)(107886002)(2906002)(9686002)(81156014)(105586002)(5890100001)(86362001)(101416001)(586003)(575784001); DIR:OUT; SFP:1101; SCL:1; SRVR:AM3PR05MB1396; H:AM4PR05MB1651.eurprd05.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-originalarrivaltime: 04 Jul 2016 11:00:09.7419 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM3PR05MB1396 Subject: Re: [dpdk-users] testpmd: [mlx4] rxq_add_flow(): flow configuration failed, errno=38: Function not implemented X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jul 2016 11:00:11 -0000 Hi Ruslan,=20 According to your output you are using VF. Do you run testpmd on the VM? Your FW is a little bit old, it is recommended to use FW that is coming wit= h MLNX_OFED. Please upgrade to 2.36.5000. After FW upgrade is you still have this issue Please run raw_ethernet_bw example:=20 raw_ethernet_bw --client -d mlx5_1 -l 1 -n 5 -s 64 --dest_mac 7C:FE:90:29:= 23:4F --source_mac 7C:FE:90:29:23:67 =20 > dpdk_nic_bind --status: > https://gist.github.com/2449c7b943eec70a2a3dc8da905148b2 This script is not relevant for Mellanox NICs.=20 Best Regards, Olga -----Original Message----- From: Ruslan Osmanov [mailto:rrosmanov@gmail.com]=20 Sent: Monday, July 04, 2016 7:55 AM To: Olga Shern Cc: users@dpdk.org Subject: Re: [dpdk-users] testpmd: [mlx4] rxq_add_flow(): flow configuratio= n failed, errno=3D38: Function not implemented Sorry, I forgot to mention that I had to add `#define _GNU_SOURCE` at the t= op of mlx4.c file, because it failed to compile otherwise. diff -Naur \ tmp/dpdk-16.04/drivers/net/mlx4/ \ /opt/dpdk-16.04/drivers/net/mlx4/ (the first is original) https://gist.github.com/ebe70bb62fafb30ab6bb01d164ea5c7f And this is how the build fails without _GNU_SOURCE: https://gist.github.com/ed6fd3022b2cbf86d5bd30cf444765a4 On Mon, 4 Jul 2016 11:30:30 +0700 Ruslan Osmanov wrote: > System information > ------------------- >=20 > OS: Ubuntu 16.04 LTS > Arch: x86_64 > Kernel: 4.4.0-28-generic > Kernel configuration: > https://gist.github.com/9b896efae7ad097b3f05581640f670d0 Installed > packages: https://gist.github.com/5d1fe6557a9a41cea9ce70b7269e35ac > ibv_devinfo: https://gist.github.com/8c0ecd660aa1be16ddc6aa7b96ffcd11 > ofed_info -s: MLNX_OFED_LINUX-3.3-1.0.0.0: > dpdk_nic_bind --status: > https://gist.github.com/2449c7b943eec70a2a3dc8da905148b2 >=20 >=20 > testpmd without --no-huge --proc-type=3Dauto > ------------------------------------------ >=20 > sudo -E ~/DPDK/x86_64-native-linuxapp-gcc/build/app/test-pmd/testpmd \=20 > -c 0x3 --pci-blacklist 0000:00:06.0 -- -i --total-num-mbufs=3D2048 >=20 > ###### OUTPUT ####### > ... > mlx4.c:5464: mlx4_pci_devinit(): > PCI information matches, using device "mlx4_1" (VF: true) ... >=20 > mlx4.c:2503: rxq_add_flow(): 0x7ffd6ca10050: > adding MAC address 8e:d5:86:2e:a3:02 index 0 (VLAN index 4294967295) >=20 > mlx4.c:2511: rxq_add_flow(): 0x7ffd6ca10050: > flow configuration failed, errno=3D38: Function not implemented >=20 > mlx4.c:3862: rxq_setup(): 0x921a20: > QP flow attachment failed: Function not implemented ... > ######### OUTPUT (END) ########## >=20 > Full output: https://gist.github.com/3c83db9c0ba4a662be92fef958170f58 >=20 >=20 > On Sun, 3 Jul 2016 12:24:11 +0000 > Olga Shern wrote: >=20 > > Hello Ruslan, > >=20 > > Can you please send full details of your setup, please also include=20 > > the following info: OS, FW, MLNX_OFED that you are using > >=20 > > The following commands can help to retrieve Mellanox specific info: > > ibv_devinfo > > ofed_info -s > >=20 > > Another q, I have notice you are using --no-huge option, this is not=20 > > the issue here, but I am not sure if this option is working at all. > > And why are you using --proc-type=3Dauto? > >=20 > > Please run as root user without the above flags (--no-huge and > > --proc-type) > >=20 > > Best Regards, > > Olga > >=20 > > -----Original Message----- > > From: users [mailto:users-bounces@dpdk.org] On Behalf Of Ruslan=20 > > Osmanov Sent: Saturday, July 02, 2016 11:18 AM > > To: users@dpdk.org > > Subject: [dpdk-users] testpmd: [mlx4] rxq_add_flow(): flow=20 > > configuration failed, errno=3D38: Function not implemented > >=20 > > Hi, > >=20 > > I need help. DPDK applications fail to start with Mellanox > > ConnectX-3 NIC. All of them complain about 'not implemented' > > function when trying to setup the RX queue: > >=20 > > sudo -E ~/DPDK/x86_64-native-linuxapp-gcc/build/app/test-pmd/testpmd > > \ -c 0x3 --pci-blacklist 0000:00:06.0 \ --no-huge --proc-type=3Dauto \ > > -- -i --total-num-mbufs=3D2048 > >=20 > > ... > >=20 > > rxq_setup(): 0x921a20: disabling scattered packets support (128 WRs) > > mlx4_mp2mr(): mempool 0x7f0c0b1eb000 area start=3D0x7f0c0b36e000 > > end=3D0x7f0c0bb6e000 size=3D8388608 > > mlx4_mp2mr(): mempool 0x7f0c0b1eb000 using start=3D0x7f0c0b36e000 > > end=3D0x7f0c0bb6e000 size=3D8388608 for MR > > rxq_setup(): priv->device_attr.max_qp_wr is 16351 > > rxq_setup(): priv->device_attr.max_sge is 32 > > rxq_add_flow(): 0x7ffd68781e10: adding MAC address 8e:d5:86:2e:a3:02=20 > > index 0 (VLAN index 4294967295) rxq_add_flow(): 0x7ffd68781e10: flow=20 > > configuration failed, errno=3D38: Function not implemented > > rxq_setup(): 0x921a20: QP flow attachment failed: Function not=20 > > implemented ... Fail to configure port 0 rx queues > > EAL: Error - exiting with code: 1 > > Cause: Start ports failed > >=20 > > The whole output is in the attached dpdk-mlx4-testmpd.log file. If=20 > > for some reason the mailing list doesn't support attachments, here=20 > > is an online version: > > https://gist.github.com/7f740489da77ecd23cc162da5e7f864c > >=20 > > DPDK version: 16.04. > > dpdk_proc_info: > > sudo -E > > =20 > > ~/DPDK/x86_64-native-linuxapp-gcc/build/app/proc_info/dpdk_proc_info > > -c 0x3 --no-huge --proc-type=3Dauto --pci-blacklist 0000:00:06.0 --=20 > > -p 0x3 -m --stats --xstats (output is in the attached=20 > > dpdk-mlx4-dpdk_proc_info.log; online > > version: https://gist.github.com/e8a01484a02e147f9539e81638198747) > >=20 > > Please help me to figure out what's wrong with ... what? I even=20 > > don't know. Maybe the mlx4 driver is buggy, maybe dpdk, maybe my=20 > > configuration is wrong. > >=20 > >=20 > > -- > > Ruslan Osmanov >=20 >=20 -- Ruslan Osmanov