From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 1E498A0613 for ; Thu, 26 Sep 2019 21:47:01 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 6625711A2; Thu, 26 Sep 2019 21:47:00 +0200 (CEST) Received: from mail-qt1-f171.google.com (mail-qt1-f171.google.com [209.85.160.171]) by dpdk.org (Postfix) with ESMTP id 17BA61041 for ; Thu, 26 Sep 2019 21:46:59 +0200 (CEST) Received: by mail-qt1-f171.google.com with SMTP id n7so4375818qtb.6 for ; Thu, 26 Sep 2019 12:46:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rockbridgesoftware-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-transfer-encoding:thread-index :content-language; bh=H+b5FnzQXWIczNyKRlIewW9UmhM1hvoRbC+g2rWtQwc=; b=hHRBXtJrVcx6wUlXp2Bwsd97S/38OaHhEWOLLFhyjTvWEL1lNDXddSQuUBh1iWD5oc ELoy6yUuYIbbGwzq938jKDYYA8aIO9g4AYUjaOrfvttw8dEEiL9flFSqsbbEYqYYooaT eXeOQOwu1h+2zu0VL9BOhekeivYdaGaAW2s96LqwhxURQGI2dsCqJH3GcxYl4IjUNDVP DPk4MOnKMQo+DD0963ma68YgK/AjZf5hBK72nxIjp/YRClAPAMSHWgY1D92lMzf3wZ6N pi1RRK4ae+DEWX4O6SSsUFX4xBIdum41JPNgHgX7pLjFVeRxfy7R30K8IwnoniAElaqQ bo3Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:references:in-reply-to:subject:date :message-id:mime-version:content-transfer-encoding:thread-index :content-language; bh=H+b5FnzQXWIczNyKRlIewW9UmhM1hvoRbC+g2rWtQwc=; b=MvUAuogv5wcvDZCog81sp4yETuq/pKVAgKWXiKp5ACMsyOG4+w73g2ZhTcEqZBctza KV/RRuCPp/6IUy/VbpuQ8ZR23ebXO5oDu396qMm+htW3dxybUhbUmyYgBfKZHclIPTmQ 9lpaVixF/f28awJPdykvEpL01n8nkPg7JFJ7/2X7thKbEzpjXsMVkDzcn7C5i8T6wfIR Yv11BrbJdRNd0Yc9svx6OXg7neLVwjCMaaIv2EU9ip/E14lG7Nem3fODK88Y23Wa3+PK /FCed39ffsz3BKvj4tKnLYkfZKL6TSnhDo1ysccSt+8hKrhUv/F8VDiaWjzP57ungG2A TRsQ== X-Gm-Message-State: APjAAAUyGV/Ji3jxUhdhyZ3Nh48HMdf+dzCrG2IZaKui2Gh8k3cZ9hok 3sYyjnvZVa7Zw6JnEIWpOWpbug== X-Google-Smtp-Source: APXvYqzyZa/FUmWf3E/VbMaZRC+J89Kua7omGeUyrHwhRM8DWfZ/UnpM/5Srjwoi53t2V38wDWwcrA== X-Received: by 2002:ac8:1c54:: with SMTP id j20mr559404qtk.302.1569527218325; Thu, 26 Sep 2019 12:46:58 -0700 (PDT) Received: from heisenberg ([45.53.204.57]) by smtp.gmail.com with ESMTPSA id c204sm103612qkb.90.2019.09.26.12.46.56 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Thu, 26 Sep 2019 12:46:57 -0700 (PDT) From: "Jim Vaigl" To: "'Asaf Penso'" , "'Stephen Hemminger'" Cc: , "'Kiran Vedere'" , "'Erez Ferber'" , "'Olga Shern'" References: <004101d572f5$92d479d0$b87d6d70$@com> <20190924101802.273c25d9@hermes.lan> <000001d5730b$bc69ea30$353dbe90$@com> In-Reply-To: Date: Thu, 26 Sep 2019 15:46:52 -0400 Message-ID: <002d01d574a3$25c24e80$7146eb80$@com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AdVy9ZHo1HqoOeJURCCyk0eROU1EBQABnMsAAAPtiAAAU1unIAASMIgQ Content-Language: en-us Subject: Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" > From: Asaf Penso [mailto:asafp@mellanox.com] > Sent: Thursday, September 26, 2019 7:00 AM > To: Jim Vaigl; 'Stephen Hemminger' > Cc: users@dpdk.org; Kiran Vedere; Erez Ferber; Olga Shern > Subject: RE: [dpdk-users] DPDK on Mellanox BlueField Ref Platform > > Hello Jim, > > Thanks for your mail. > In order for us to have a better resolution please send a mail to our support team > - support@mellanox.com > Please provide as much info about the setup, configuration etc as you can. > > In parallel, I added Erez Ferber here to assist. > > Regards, > Asaf Penso Thanks for the kind offer, Asaf. I'll take this debug effort off-line with you and Erez and post back to the list here later with any resolution so everyone can see the result. By the way, the prior suggestion of using v. 25 of rdma-core didn't pan out: the current build script just makes a local build in a subdirectory off the source tree and there's no obvious way to integrate it with the MLNX_OFED environment and the dpdk install. After resolving package dependencies to get rdma-core to build from the GitHub repo, I realized the instructions say this: --- Building This project uses a cmake based build system. Quick start: $ bash build.sh build/bin will contain the sample programs and build/lib will contain the shared libraries. The build is configured to run all the programs 'in-place' and cannot be installed. NOTE: It is not currently easy to run from the build directory, the plugins only load from the system path. --- --Jim >> -----Original Message----- >> From: users On Behalf Of Jim Vaigl >> Sent: Tuesday, September 24, 2019 10:11 PM >> To: 'Stephen Hemminger' >> Cc: users@dpdk.org >> Subject: Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform >> >> On Tue, 24 Sep 2019 12:31:51 -0400 >> "Jim Vaigl" wrote: >> >>>> Since no one has chimed in with any build/install/configure suggestion >> for >> >> the >> >> BlueField, I've spent some time debugging and thought I'd share the >> results. >> >> Building the l3fwd example application and running it as the docs >> suggest, >> >> when >> >> I try to send it UDP packets from another machine, it dumps core. >> >> >> >> Debugging a bit with gdb and printf, I can see that from inside >> >> process_packet() >> >> and processx4_step1() the calls to rte_pktmbuf_mtod() return Nil or >> >> suspicious >> >> pointer values (i.e. 0x80). The sample apps don't guard against NULL >> >> pointers >> >> being returned from this rte call, so that's why it's dumping core. >> >> >> >> I still think the problem is related to the driver config, but thought >> this >> >> might ring a bell for anyone who's had problems like this. >> >> >> >> The thing that still bothers me is that rather than seeing what I was >> >> expecting >> >> at init based on what the documentation shows: >> >> [...] >> >> EAL: probe driver: 15b3:1013 librte_pmd_mlx5 >> >> >> >> ... when rte_eal_init() runs, I'm seeing: >> >> [...] >> >> EAL: Selected IOVA mode 'PA' >> >> EAL: Probing VFIO support... >> >> >> >> This still seems wrong, and I've verified that specifying the BlueField >> >> target ID >> >> string in the make is causing "CONFIG_RTE_LIBRTE_MLX5_PMD=y" to >> appear in >> >> the .config. >> >> >> >> Regards, >> >> --Jim Vaigl >> >> 614 886 5999 >> >> >> >> >> > >> >From: Stephen Hemminger [mailto:stephen@networkplumber.org] >> >Sent: Tuesday, September 24, 2019 1:18 PM >> >To: Jim Vaigl >> >Cc: users@dpdk.org >> > >> >Subject: Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform >> >make sure you have latest version of rdma-core installed (v25). >> >The right version is not in most distros >> >> Great suggestion. I'm using the rdma-core from the MLNX_OFED 4.6-3.5.8.0 >> install. I can't figure out how to tell what version that thing includes, >> even looking at the source, since there's no version information in the >> source files, BUT I went to github and downloaded rdma-core v24 and v25 >> and neither diff cleanly with the source RPM that comes in the OFED >> install. I don't know yet if it's because this is some different version >> or if it's because Mellanox has made their own tweaks. >> >> I would hope that the very latest OFED from Mellanox would include an >> up-to-date and working set of libs/modules, but maybe you're on to >> something. It sounds like a risky move, but maybe I'll try just >> installing rdma-core from github over top of the OFED install. I have a >> fear that I'll end up with inconsistent versions, but it's worth a try. >> >> Thanks, >> --Jim