From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qk1-f175.google.com (mail-qk1-f175.google.com [209.85.222.175]) by dpdk.org (Postfix) with ESMTP id 541402965 for ; Fri, 26 Oct 2018 22:27:46 +0200 (CEST) Received: by mail-qk1-f175.google.com with SMTP id n12so1466781qkh.11 for ; Fri, 26 Oct 2018 13:27:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=g-harvard-edu.20150623.gappssmtp.com; s=20150623; h=from:mime-version:subject:message-id:date:to; bh=V+0B1+7Xt8ULuLN6x/nydHUCuO7OddxfwQNcNCZ/fIY=; b=cHCnSg99PbEXNLaFGm2sTqeHAYUAhAp/hHZHmA9EWWr/kxlppOnuQ1cgXe0cPwN3U/ 4Ez82/VeZY0FiWpdK/PEmtKeUe4Bc0q9qJJ+wtnHGxIcTGXbCQKJbrD1Uy8RoryA3ukp 0wihinj1vgqDGTx0x9UrQ8BrheeHOKxBCQck5FuAZBQazga7kpOQ44N2ZGwEqsa3rP7A DOQWCh1DnQIGtV2j1t8v4Y/m7nK9q3WUWZuL4bDE7wN7KUku5hDzVZnLtpbEOrfUKn0P htZFwJD83yN6vVe3cCjvnRBDn3qexFE9lftf70R01j7Eh5K4BoVCQBMdn5FruB+jsSS6 5WLg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:mime-version:subject:message-id:date:to; bh=V+0B1+7Xt8ULuLN6x/nydHUCuO7OddxfwQNcNCZ/fIY=; b=WDgaVGYvk/XFV2F2ZkwHBdyy5DvNFcRWjCs8TnF/aj1LePgGGEejn0qOO91xblO3Jg vItEVCNID8j6i3gJnKJ0u1bshPrRqXM8fLwFHfiGDLJRZhhYdwynVvu3JkD213N6hJxb s/DqtnBLi9d/S9KLshu/7kP4oVDmeR4vzF+EFIcUbp4S0lkFm2McPqpgVQh2sALQv5BF grsTr6JbGyvTP85HZIU7ngAPQk2RzvK3K+LhV0dHTgE1d4F5kM+3qnSZtV9cki7tdIVn SIAwzazQx22NWcQDaMmJDG2A9XmvZJ+5oFKOzPZabKoAIXjx7W4z4ibabVTNN7yO6rfC ddPQ== X-Gm-Message-State: AGRZ1gIUhtys4eKlj5oVdnuT3z7xYUktBEEb38hg9FuaPz4hCrVXY+rB 1zYL875kKk9g9vwTOZqD3SdBwFVn9dM= X-Google-Smtp-Source: AJdET5eeoecgLM/tPm+Q9cAVQIirP5JNiLlZOmH5E22+52+J8Y9e4wcQyIK+rJBY9Km5U5ZssoGSEQ== X-Received: by 2002:a37:5b83:: with SMTP id p125-v6mr4282061qkb.88.1540585665515; Fri, 26 Oct 2018 13:27:45 -0700 (PDT) Received: from [10.252.205.126] ([65.112.8.201]) by smtp.gmail.com with ESMTPSA id l33-v6sm3732753qte.24.2018.10.26.13.27.44 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 26 Oct 2018 13:27:45 -0700 (PDT) From: Junzhi Gong Mime-Version: 1.0 (Mac OS X Mail 12.0 \(3445.100.39\)) Message-Id: Date: Fri, 26 Oct 2018 16:27:44 -0400 To: users@dpdk.org X-Mailer: Apple Mail (2.3445.100.39) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] Cannot run DPDK applications using Mellanox NIC - "PMD: net_mlx4: 0x55b8d8015b00: cannot attach flow rules (code 12, "Cannot allocate memory"), flow error type 2, cause 0x7f9ee4028200, message: flow rule rejected by device" X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Oct 2018 20:27:46 -0000 Hi everyone, Currently I have some trouble running DPDK applications using Mellanox = NIC. All DPDK applications running with the Mellanox NIC (using SR-IOV = VFs) will crash with the following error message: PMD: net_mlx4: 0x559fa4a25b00: cannot attach flow rules (code 12, = "Cannot allocate memory"), flow error type 2, cause 0x7f0ca7e47a80, = message: flow rule rejected by device EAL: Error - exiting with code: 1 Cause: rte_eth_dev_start:err=3D-12, port=3D0 An example running click has the following error messages: $ click --dpdk -l 1 -n 4 -w 0000:04:00.1 =E2=80=94- xxx.click EAL: Detected 12 lcore(s) EAL: Detected 1 NUMA nodes EAL: Multi-process socket /var/run/dpdk/rte/mp_socket EAL: No free hugepages reported in hugepages-1048576kB EAL: Probing VFIO support... EAL: PCI device 0000:04:00.1 on NUMA socket 0 EAL: probe driver: 15b3:1004 net_mlx4 PMD: net_mlx4: PCI information matches, using device "mlx4_1" (VF: true) PMD: net_mlx4: 1 port(s) detected PMD: net_mlx4: port 1 MAC address is 6a:f5:c3:1e:09:eb Initializing DPDK PMD: net_mlx4: 0x559471c5b700: cannot attach flow rules (code 12, = "Cannot allocate memory"), flow error type 2, cause 0x7f620462c940, = message: flow rule rejected by device mazu-nat.click:68: While initializing =E2=80=98FromDPDKDevice@3 :: = FromDPDKDevice=E2=80=99: Cannot start DPDK port 0: error -12 0000:04:00.1 is the PCI address of the VF of the Mellanox NIC. I have = tried several different DPDK applications (all applications have been = re-compiled using the new configured DPDK), and I have also tried reboot = the OS, but the problem still exists.=20 I am using Mellanox NIC and its SR-IOV functions ('MT27500/MT27520 = Family [ConnectX-3/ConnectX-3 Pro Virtual Function]' in details). The OS = is Ubuntu 18.04. I have installed the Mellanox OFED (version 4.4, only = the newest version is compatible to Ubuntu 18.04) and configure it by = instructions in DPDK doc page = (https://doc.dpdk.org/guides/nics/mlx4.html = ). The DPDK version is = 18.08. I do not bind the Mellanox NIC to DPDK driver because the driver = mlx4_core should be used for Mellanox NICs. Currently I am using 2MB = hugepages (number: 1024). I am very grateful if you can solve my problem. Thank you! Best, Junzhi=