From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ot0-f196.google.com (mail-ot0-f196.google.com [74.125.82.196]) by dpdk.org (Postfix) with ESMTP id 4D6AFA48D for ; Sat, 20 Jan 2018 20:10:59 +0100 (CET) Received: by mail-ot0-f196.google.com with SMTP id r4so4232608oti.12 for ; Sat, 20 Jan 2018 11:10:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=JGtraAKYL7Z0EV+7Xgz+YQTutOwPR4Xwa0OoQNo55TQ=; b=NvdNWsG6e02X888PQonOUmNTVPkLPjjqtDJZESCxWMsogUoV1D0JXZHE6ZrB4MCKFB Ka/OlAGQyhAt3m/tkd1VTeEDeRjXUpUtaLojchizHRYACODNYF/nH7fNnk+Sgxfjk1wW TsRwC6KEwtQqFBGvsEg4mzoNsuvxjpvhKQM2AvFg+L/Qqt+NMC02qKZvWazxA3m8/tC/ YR1Xw6jgfSjsvoFdlFmyFbGTrAGpliCKYLgWCncj/C2cVZYGKiYlA2nWcDKYWtPFaUE9 9/FYwRFwRfJpRmFZLH7xjv6mW81YXyoq0YKuMxIJcAnrZSWkpwUtpggkb05zkfHNjN5h hbqQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=JGtraAKYL7Z0EV+7Xgz+YQTutOwPR4Xwa0OoQNo55TQ=; b=rFCrphzz0VDQd6BZIPdP+rV4bfidZUYOWSa/CW792eIudpgR6Ubnie955k9ZyvtUIe UcHje+YdJlpd11jRHmhCBdLjiLAVdcQsKY9nFmODuNPixJTL7WGYIwNxFgKk1YS7yRir 2WWSTPX0W4laDS0Jo3GfeD8/ot2xZM53XylxHW2hpsml2em9lNzcUHs3eW/98nwpxHls 4lbqBElSBYx56iu9cKI9eSHdQjRET7zgCp+PkN7PVMIsgjeRYLvPmKl2uYLo7NU1ohk2 ZGR9jfMA2Mcxto4cJoNTGSKpSBmolSKa9bupiB9mw2iZPsBLKsuAB0hJ4hK04tWXxW/O JjXA== X-Gm-Message-State: AKwxyteFJGA2spvaeYqSRB/6CorWlINOdXDMpjLldeSWymysGNi2K5l+ RhrMtDyRxAcNEDnd0LWm+CvxPwE8UtJUUQAqLc0xqw== X-Google-Smtp-Source: AH8x224M+eW3TNQb81fr+E4n1Ipx8Fvntwh4znO/ivbw+I6OTvi7i2vjseH0EvGRS8mWXO5iCdZ4jpEbmxQNaIgWEpQ= X-Received: by 10.157.42.130 with SMTP id e2mr1400034otb.87.1516475458462; Sat, 20 Jan 2018 11:10:58 -0800 (PST) MIME-Version: 1.0 Received: by 10.74.148.145 with HTTP; Sat, 20 Jan 2018 11:10:58 -0800 (PST) In-Reply-To: References: <20180118084828.GO4256@6wind.com> <20180118150505.GP4256@6wind.com> From: Timur Bogdanov Date: Sat, 20 Jan 2018 22:10:58 +0300 Message-ID: To: Adrien Mazarguil Cc: users@dpdk.org, Olga Shern , Shahaf Shuler , Timothy Redaelli Content-Type: text/plain; charset="UTF-8" X-Mailman-Approved-At: Sun, 21 Jan 2018 18:51:48 +0100 Subject: Re: [dpdk-users] Unable to launch testpmd with Mellanox ConnectX-3 Pro NIC X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 20 Jan 2018 19:10:59 -0000 Finally I managed to run testpmd normally after updating a kernel to 4.14.14 and installing rdma-core_v17 from sources. Tnx for the advice of setting parameter log_num_mgm_entry_size" to "-1" /Regards, Timur On Fri, Jan 19, 2018 at 2:10 PM, Timur Bogdanov wrote: > Server kernel is 4.14.13-1.el7.elrepo.x86_64. > The rdma-core is v16. > Parameter "log_num_mgm_entry_size" is set to "-1" > So I don't know why testpmd still runs with same error: > > PMD: net_mlx4: 0xda13c0: cannot attach flow rules (code 95, "Operation > not supported"), flow error type 2, cause 0x7f2869cdab80, message: > flow rule rejected by device > /Regards, Timur > > > On Thu, Jan 18, 2018 at 6:05 PM, Adrien Mazarguil > wrote: >> On Thu, Jan 18, 2018 at 03:11:16PM +0300, Timur Bogdanov wrote: >>> Yes, the problem was in this parameter and after changing it to "-1" >>> testpmd application has been started successfully. >>> >>> BUT, it started successfully only on server where Mellanox OFED is installed. >>> >>> On another server a rdma-core was installed from sources. (rpm's were >>> built and installed) >>> I also changed the value of log_num_mgm_entry_size parameter to "-1" >>> and restarted a server (since where is no openibd service on this >>> server) and got the same error. >>> Maybe mlx4_core kernel module parameter should be changed in some >>> other config file? >> >> In case MLNX_OFED is *not* installed, do both rdma-core and kernel version >> meet the minimum requirements? >> >> - rdma-core v15 >> - Linux 4.14 >> >> Note while the above versions are fine for mlx5 (ConnectX-4, ConnectX-5), >> they provide reduced performance and RSS capabilities for mlx4 (ConnectX-3), >> for which I recommend to use at least: >> >> - rdma-core v16 >> - Linux 4.15 (not released yet, 4.15-rc8 will do in the meantime) >> >>> Anyway, I can also install and use OFED instead of RDMA but the RDMA >>> is pointed as recommended on instructions page >>> "http://dpdk.org/doc/guides/nics/mlx4.html" and it is interesting to >>> bring it to working state. >>> /Regards, Timur >> >> rdma-core requires an up-to-date kernel. If this can't be satisfied, >> MLNX_OFED is the only alternative (the mlnx-ofa_kernel package). >> >>> On Thu, Jan 18, 2018 at 11:48 AM, Adrien Mazarguil >>> wrote: >>> > On Tue, Jan 16, 2018 at 06:59:31PM +0300, Timur Bogdanov wrote: >>> >> Hi, >>> >> >>> >> I'm trying to use dpdk with Mellanox ConnectX-3 Pro NIC. >>> >> I built PMD for it according to instructions on >>> >> "http://dpdk.org/doc/guides/nics/mlx4.html" and tried to launch >>> >> testpmd app but got following error: >>> > >>> >> PMD: net_mlx4: 0xda13c0: cannot attach flow rules (code 95, "Operation >>> >> not supported"), flow error type 2, cause 0x7f2869cdab80, message: >>> >> flow rule rejected by device >>> >> >>> >> Fail to start port 0 >>> > >>> >> What can be the reason of testpmd does not start correctly? >>> > >>> > Did you provide by any chance -7 instead of -1 as a value for mlx4_core.ko's >>> > log_num_mgm_entry_size parameter (as recommended by the above >>> > documentation)? >>> > >>> > Timothy (CC'ed) reported that -7 does not quite work with the default flow >>> > rules (too many limitations) and results in the above error message. -1 >>> > should be used, -7 is only for specific use cases and should probably not >>> > even be documented in this file. >>> > >>> > -- >>> > Adrien Mazarguil >>> > 6WIND >> >> -- >> Adrien Mazarguil >> 6WIND