From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 9D6A0A0613 for ; Sun, 22 Sep 2019 21:25:59 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id C898A7CCA; Sun, 22 Sep 2019 21:25:55 +0200 (CEST) Received: from mail-io1-f44.google.com (mail-io1-f44.google.com [209.85.166.44]) by dpdk.org (Postfix) with ESMTP id 10CCE1F53C for ; Fri, 20 Sep 2019 21:34:16 +0200 (CEST) Received: by mail-io1-f44.google.com with SMTP id a1so18775751ioc.6 for ; Fri, 20 Sep 2019 12:34:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=rockbridgesoftware-com.20150623.gappssmtp.com; s=20150623; h=from:to:subject:date:message-id:mime-version:thread-index :content-language; bh=a7R4ZeIzcYHi7NyYfWiIgQcIHUM6m8ZxVBpSK2aAF1k=; b=yUKyFGdR/vz+Ks4cEhM49T5NPk8/d7ycnuMrObeS6KGdqpXAbcyyG/LZVQsaTpVp5J LV24XTfVlptINqWZgMtrkK6vfOu03Rgc5fQ7cP0fLjTHAMrLdhAq1M9+AGanFWSeoJmX 38+FRsBZG1RrDymjqR0KJXi6q7vx+Tnvzb2f+i0Si9zYg+s1/nO9XOmg6JuREeEL+jBV iO/B7UjF2NPpwwArDrVnPRckpRY2N9OrHPnpyLZWGPCc9XfcSBAuBVp8YvYncqm26/az xW+xAnHn0fZFu6QC3oofNPaJpxIv4bj8pRlDiPZK0MmwapmE4rJdNU0VYjPkDvxvAmi2 p9wQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:date:message-id:mime-version :thread-index:content-language; bh=a7R4ZeIzcYHi7NyYfWiIgQcIHUM6m8ZxVBpSK2aAF1k=; b=j0kGrLEMXuOA32IIAgxholDTiZGw2A3V/H3OiNOFTGQ8lzS22c3yYqsHltlRcan48b qex95a4T1Uir1Y6rWIqOQQZ5PnWRVf0Dn57SLygXSvExyuQZ6SrLHVfinIUK5W4T7JXy CWWeJxWAJ97agX2QurJtGh5T5fHZ/y9rn0BHTx6u9sOSLSQTeUPxdtF4CcaHjSZzFkUU 6iW5ITE9zWlvdC7qkSkJJkIgAusTNcs07q8CfNLIPeQG3mjUOtqRlsqwMWeUij/c0/xS z6OlxdFs8wvuqqCKXebI/QXHFEKq7tNVTxe9ci1tZ1J2ZO657uX9HbS1JrepzW2jGKEo /C5w== X-Gm-Message-State: APjAAAWbrXQ6E9VrJUbN6pGYWeHwBlBmnM8q4JfL1OhJerCnVDU3dSNB NIu21gQT38iVklpSZECnFeM/994dakM= X-Google-Smtp-Source: APXvYqxCkPvTBr1Fj68c09Rl1h5a2aJixhQlNUUgxa9MRAlYu3McRiix5/4Mejr1ZxwsoJ2cBa760A== X-Received: by 2002:a02:7797:: with SMTP id g145mr21309731jac.60.1569008054777; Fri, 20 Sep 2019 12:34:14 -0700 (PDT) Received: from heisenberg ([45.53.197.50]) by smtp.gmail.com with ESMTPSA id q18sm2849168ion.3.2019.09.20.12.34.12 for (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Fri, 20 Sep 2019 12:34:13 -0700 (PDT) From: "Jim Vaigl" To: Date: Fri, 20 Sep 2019 15:34:06 -0400 Message-ID: <000501d56fea$5ee53e10$1cafba30$@com> MIME-Version: 1.0 X-Mailer: Microsoft Office Outlook 12.0 Thread-Index: AdVv6l3fg2xVBoYWRHeVhXQq/Dwe+Q== Content-Language: en-us X-Mailman-Approved-At: Sun, 22 Sep 2019 21:25:53 +0200 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] DPDK on Mellanox BlueField Ref Platform X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" I'm trying to get DPDK to run on a Mellanox BlueField Reference Platform. For what it's worth, I'm using CentOS 7.4.1708, Kernel 4.14.139 built from source, MLNX_OFED 4.6-3.5.8, and DPDK 19.08. I can get stuff to build and run, but I'm failing to receive packets. Either I get none, or I get core dumps. I've become convinced it's at least partly because the wrong driver is in use in the configuration I've created. In https://doc.dpdk.org/guides/nics/mlx5.html, it says this: User space I/O kernel modules (uio and igb_uio) are not used and do not have to be loaded. And the example output on that page shows: EAL: PCI device 0000:05:00.0 on NUMA socket 0 EAL: probe driver: 15b3:1013 librte_pmd_mlx5 PMD: librte_pmd_mlx5: PCI information matches, using device "mlx5_0" (VF: false) PMD: librte_pmd_mlx5: 1 port(s) detected PMD: librte_pmd_mlx5: port 1 MAC address is e4:1d:2d:e7:0c:fe ...so, it's working and not using VFIO or igb_uio. But in DPDK's usertools/dpdk-setup.sh, I see this: # # Calls dpdk-devbind.py --status to show the devices and what they # are all bound to, in terms of drivers. # show_devices() { if [ -d /sys/module/vfio_pci -o -d /sys/module/igb_uio ]; then ${RTE_SDK}/usertools/dpdk-devbind.py --status else echo "# Please load the 'igb_uio' or 'vfio-pci' kernel module before " echo "# querying or adjusting device bindings" fi } So the setup script bails unless VFIO or igb_uio is loaded, but this doesn't match the output from the testpmd output example above, which shows something else active. I've got a request in to Mellanox, but it's been weeks and the only feedback so far is that 'the DPDK developer brought up DPDK on Bluefield and confirmed operation'. If anyone is aware of a combination of version of CentOS, kernel, OFED, and DPDK that works, and a self-consistent and compatible combination of build/install options, I'd be grateful. I've gone as far as digging through the kernel .config and turning off VFIO and any built-in looking support for mlx5 or dpdk so that I can be sure the support is coming from the dpdk modules, but this feels like guessing. Thanks for any suggestions, --Jim