From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id E6090A0613 for ; Tue, 24 Sep 2019 21:10:40 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 290242BE3; Tue, 24 Sep 2019 21:10:40 +0200 (CEST) Received: from mail-qt1-f171.google.com (mail-qt1-f171.google.com [209.85.160.171]) by dpdk.org (Postfix) with ESMTP id DC19D2BE1 for ; Tue, 24 Sep 2019 21:10:38 +0200 (CEST) Received: by mail-qt1-f171.google.com with SMTP id u22so3480226qtq.13 for ; Tue, 24 Sep 2019 12:10:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rockbridgesoftware-com.20150623.gappssmtp.com; s=20150623; h=from:to:cc:references:in-reply-to:subject:date:message-id :mime-version:content-transfer-encoding:thread-index :content-language; bh=BFjvQmKSYP1R21P+sV+s/gXocb78TegRHtrWsyKIyfI=; b=RPjA4slZ/BilaXD3i2Bs4AdtXtTV1YhL4gkiMPLCKZgaqe9IWv16ZPK0nDZ/MV/t5y CMfn3H5SLA2jlHzW+XXaKSo22qrlkAnLIF4zLcOX1gBFEqMc3viLv596HvXUxzratmr0 FkBr3GcZmmkK2GP5fJ64VlHIU1mep8Kb4A16tStvflclTvLFJdERVfero11/vNjmF0c2 eMZM1/jLkyb7lIwH4Fucguz6amD2omm4xrE3/PIlcXiZHPiUmsAmyYXAz0OJ281pTrQW lejZHW2qTs4/pDCqiBLyDnpDPMAfhFyBf9YG+YZvVFJNwyWyvuyx0ztstQCjB1ymf6DV ehaQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:cc:references:in-reply-to:subject:date :message-id:mime-version:content-transfer-encoding:thread-index :content-language; bh=BFjvQmKSYP1R21P+sV+s/gXocb78TegRHtrWsyKIyfI=; b=lUmqPYXVtfumqhuH/nDxH2z2ibGq3/gqlUS2n8IkQT1+4qFVAJ4P1ffhMuwyyDq+Zs tRnbnvcc0qGi6V5uFJjV1davOtEEux58B9zTjuAUYZLXv1ZzhKi51qC7hkQtJtHORRpq jFq7vtVghIgFeK8jk0BUZRdmmIIZIfFCoeP9K6j93LNGb6i8n3ZfahTYJ0pYPT4r8IzP 41St/kwNtcDNK0ZYXU6zXgUJ55/u1xnnO65QuLQfSu54DkKP5zYs9Htk7ithnwIOTXbP v51K3oySkakbGEbcIhLBZTRnwjG8t5IDAeyrqAVlg0mFXiay1Wa3qcLQOcfaKkiY/sdq /Bqw== X-Gm-Message-State: APjAAAXC6zMUoSL8XaH9jiUsAJfwG8jAvs1+cLrCtkORnPSeCRIyT5U0 YV6FptL2TXnY1M/PLn1npfsxfg== X-Google-Smtp-Source: APXvYqxvo79rQ6Lz/Twftmun2V+QQ3OY8oesKuODESHpl0EERiLcg430wC0o/Qa/e8Mi2P6e3hKEpQ== X-Received: by 2002:a0c:82a2:: with SMTP id i31mr3814671qva.160.1569352238040; Tue, 24 Sep 2019 12:10:38 -0700 (PDT) Received: from heisenberg ([45.53.197.50]) by smtp.gmail.com with ESMTPSA id p77sm1790673qke.6.2019.09.24.12.10.36 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 24 Sep 2019 12:10:37 -0700 (PDT) From: "Jim Vaigl" To: "'Stephen Hemminger'" Cc: References: <004101d572f5$92d479d0$b87d6d70$@com> <20190924101802.273c25d9@hermes.lan> In-Reply-To: <20190924101802.273c25d9@hermes.lan> Date: Tue, 24 Sep 2019 15:10:30 -0400 Message-ID: <000001d5730b$bc69ea30$353dbe90$@com> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AdVy/AlC+9AYJZjGRQOPPb43Q5aHSgADkNBw Content-Language: en-us Subject: Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" On Tue, 24 Sep 2019 12:31:51 -0400 "Jim Vaigl" wrote: >> Since no one has chimed in with any build/install/configure suggestion for >> the >> BlueField, I've spent some time debugging and thought I'd share the results. >> Building the l3fwd example application and running it as the docs suggest, >> when >> I try to send it UDP packets from another machine, it dumps core. >> >> Debugging a bit with gdb and printf, I can see that from inside >> process_packet() >> and processx4_step1() the calls to rte_pktmbuf_mtod() return Nil or >> suspicious >> pointer values (i.e. 0x80). The sample apps don't guard against NULL >> pointers >> being returned from this rte call, so that's why it's dumping core. >> >> I still think the problem is related to the driver config, but thought this >> might ring a bell for anyone who's had problems like this. >> >> The thing that still bothers me is that rather than seeing what I was >> expecting >> at init based on what the documentation shows: >> [...] >> EAL: probe driver: 15b3:1013 librte_pmd_mlx5 >> >> ... when rte_eal_init() runs, I'm seeing: >> [...] >> EAL: Selected IOVA mode 'PA' >> EAL: Probing VFIO support... >> >> This still seems wrong, and I've verified that specifying the BlueField >> target ID >> string in the make is causing "CONFIG_RTE_LIBRTE_MLX5_PMD=y" to appear in >> the .config. >> >> Regards, >> --Jim Vaigl >> 614 886 5999 >> >> > >From: Stephen Hemminger [mailto:stephen@networkplumber.org] >Sent: Tuesday, September 24, 2019 1:18 PM >To: Jim Vaigl >Cc: users@dpdk.org > >Subject: Re: [dpdk-users] DPDK on Mellanox BlueField Ref Platform >make sure you have latest version of rdma-core installed (v25). >The right version is not in most distros Great suggestion. I'm using the rdma-core from the MLNX_OFED 4.6-3.5.8.0 install. I can't figure out how to tell what version that thing includes, even looking at the source, since there's no version information in the source files, BUT I went to github and downloaded rdma-core v24 and v25 and neither diff cleanly with the source RPM that comes in the OFED install. I don't know yet if it's because this is some different version or if it's because Mellanox has made their own tweaks. I would hope that the very latest OFED from Mellanox would include an up-to-date and working set of libs/modules, but maybe you're on to something. It sounds like a risky move, but maybe I'll try just installing rdma-core from github over top of the OFED install. I have a fear that I'll end up with inconsistent versions, but it's worth a try. Thanks, --Jim