From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f52.google.com (mail-wm0-f52.google.com [74.125.82.52]) by dpdk.org (Postfix) with ESMTP id 7B19A23D for ; Wed, 20 Dec 2017 03:00:05 +0100 (CET) Received: by mail-wm0-f52.google.com with SMTP id t8so7010746wmc.3 for ; Tue, 19 Dec 2017 18:00:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=WkIIDVKUVDXMcFhy4garCZlpEYEstzteIu+WgLuo//U=; b=c10IDveJQihqHvuO1YHgH3qzIQlGMKsI3wLd9rs5vvbj20JO2jXmtQifN97hylmRLE it8IqxZgOyo1dyAo9+FypPCh7EPXV8eloCNdTrraT+ovp1berpVw8N9eo8bZ94EM96j6 V7dkeDHc2xHJPy+vV6N+UKiRfsRtiCp3W6hk2kZegaeMMxealuFmJUyqUvgX/CnyBfA6 cFpI/SUDXp1+RFPMSjMgVzapPJC/tjn2IrNyyn3eP5hvVG10T6JLl4FSNC/vaG7NO2P2 xZ+MCe/IBSN+ZkBUQlHxo/OYKm44fX7eqqn9ada+XHpzDlMKvBUJfE1M5dB5WEIgPB0q m8gw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=WkIIDVKUVDXMcFhy4garCZlpEYEstzteIu+WgLuo//U=; b=atBClnOGioPhJY48a0WFZrGZWFT/fEltRcDrr5Sy3swD8M9Jh6ICaexYvG5ZezsB3G c5JEDG4flvBmVyCi4uX8yDAq0QXUIrVdHjCx4WheOeFbDRVME5/VOLLOty6zkuSWqkRA /r9FC81Xq7VaPxdygKOeA/9/oK0G0hWFi/c/jOdwyfixG8Ywau8TBvVOy1Xqmuy2hAio df5BCWIXM4AVbAjs5niO11rC38IIoVjrG2+fGOzDsbAwXKjULm8NRao/F83jR7EY/wY/ Bz7w9cS57aJkC1PD6fxwN0/SzTFBRz+VaYpCRNyCyOrj0ugMfyDHVh/S3CTvOGRtTFmA WAfg== X-Gm-Message-State: AKGB3mKP0YD5czLq449cSPaMQYNSTCYQG6exvT74nqqDmWYVuaRF0WUK OL/uLuZUvAuQRX2VOXo0O4ejCzH2FXHjUCAIUEw= X-Google-Smtp-Source: ACJfBovOQuSwMznipcztO1zh7g+jBLFhzUGkHTaoepULMUO1GrxP2Pc2HcatQRe2Jmvs8j1yOnUvMWvF2bm7eEwsens= X-Received: by 10.80.149.210 with SMTP id x18mr3035017eda.4.1513735205103; Tue, 19 Dec 2017 18:00:05 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.142.161 with HTTP; Tue, 19 Dec 2017 18:00:04 -0800 (PST) In-Reply-To: References: <2151087.Q62u2efIDs@xps> From: Hui Ling Date: Wed, 20 Dec 2017 10:00:04 +0800 Message-ID: To: Ophir Munk Cc: Thomas Monjalon , "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Dec 2017 02:00:05 -0000 Ophir, Here it is: root@myVM:# ./build/app/testpmd -l 1-2 -n 4 -w 0003:00:02.0 -- -i --port-topology=chained EAL: Detected 4 lcore(s) EAL: 2 hugepages of size 1073741824 reserved, but no mounted hugetlbfs found for that size EAL: Probing VFIO support... EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using unreliable clock cycles ! EAL: PCI device 0003:00:02.0 on NUMA socket 0 EAL: probe driver: 15b3:1004 net_mlx4 PMD: mlx4.c:465: mlx4_pci_probe(): PCI information matches, using device "mlx4_2" (VF: true) PMD: mlx4.c:492: mlx4_pci_probe(): 1 port(s) detected PMD: mlx4.c:586: mlx4_pci_probe(): port 1 MAC address is 00:0d:3a:f9:08:0b Interactive-mode selected USER1: create a new mbuf pool : n=155456, size=2176, socket=0 Configuring Port 0 (socket 0) PMD: mlx4_rxq.c:811: mlx4_rx_queue_setup(): 0xde0740: MR creation failure: Operation not permitted Fail to configure port 0 rx queues EAL: Error - exiting with code: 1 Cause: Start ports failed Same "Operation not permitted" error as before. Do you have a working setup for MLX4 in DPDK 17.11? I can start from scratch to build a new VM. Giving all the information I gathered so far from DPDK, I can't seem to make it work in my VM. This is my VM info in case it is needed. ======================================================================================================= A Standard_DS3_v2 instance from Azure. (one of these models support AN) Kernel 4.11.0-1016-azure, (I think from somewhere I saw that 4.14 kernel is required for the DPDK solution in MS Azure to work. So I tried to update kernel to 4.14, but It didn't seem to help solve the MLX4 driver problem) Distributor ID: Ubuntu Description: Ubuntu 16.04.3 LTS Release: 16.04 Codename: xenial ii ibverbs-providers:amd64 42mlnx2-1.42120 amd64 User space provider drivers for libibverbs ii ibverbs-utils 42mlnx2-1.42120 amd64 Examples for the libibverbs library ii libibverbs-dev:amd64 42mlnx2-1.42120 amd64 Development files for the libibverbs library ii libibverbs1:amd64 42mlnx2-1.42120 amd64 Library for direct userspace use of RDMA (InfiniBand/iWARP) ii librdmacm-dev 42mlnx2-1.42120 amd64 Development files for the librdmacm library ii librdmacm1 42mlnx2-1.42120 amd64 Library for managing RDMA connections ii rdma-core 42mlnx2-1.42120 amd64 RDMA core userspace infrastructure and documentation ii rdmacm-utils 42mlnx2-1.42120 amd64 Examples for the librdmacm library DPDK 17.11 and some mem info: HugePages_Total: 1024 HugePages_Free: 0 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB ========================================================================================================= On Wed, Dec 20, 2017 at 12:29 AM, Ophir Munk wrote: > Hi Hui, > Can you please let know if running testpmd with just one PCI device you are getting the same error? > >> -----Original Message----- >> From: Thomas Monjalon [mailto:thomas@monjalon.net] >> Sent: Tuesday, December 19, 2017 6:22 PM >> To: Hui Ling >> Cc: users@dpdk.org; Ophir Munk >> Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM >> >> 19/12/2017 08:14, Hui Ling: >> > I installed DPDK 17.11 on Ubuntu 16.04. And I downloaded MLNX OFED >> > 4.2-1.2.0.0 and installed up-stream libs with ./mlnxofedinstall >> > --guest --dpdk --upstream-libs >> > >> > MLX4 PMD in DPDK doesn't seem to work with lib from ubuntu repository >> > and install OFED allows me to compile DPDK mlx4 PMD without any >> > compilation problem. >> > >> > Then I tried to see if the mlx4 PMD works or not by running: >> > >> > root@myVM: >> > ./build/app/testpmd -l 1-2 -n 4 -w 0003:00:02.0 -w 0004:00:02.0 -- >> > --rxq=2 --txq=2 -i >> [...] >> > Configuring Port 0 (socket 0) >> > PMD: mlx4_rxq.c:811: mlx4_rx_queue_setup(): 0xde0740: MR creation >> > failure: Operation not permitted >> >> [...] >> > I also tried to run DPDK 17.11 on Ubuntu 17.10. It didn't work either. >> > the testpmd hangs during "configuring Port 0" forever. >> >> So you see 2 different errors on Ubuntu 16.04 and 17.10. >> What are the Linux kernel versions? >> >> > Can someone from MS or Mellanox help me figure out why? and how to >> > make mlx4 PMD work on Azure VM? >> >> Mellanox will support you.