From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-qt0-f175.google.com (mail-qt0-f175.google.com [209.85.216.175]) by dpdk.org (Postfix) with ESMTP id 7C93A1C656 for ; Fri, 13 Apr 2018 16:50:53 +0200 (CEST) Received: by mail-qt0-f175.google.com with SMTP id z23so8296053qti.5 for ; Fri, 13 Apr 2018 07:50:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc:content-transfer-encoding; bh=7FhuKAgQzsqHYrVtPu3kUfJ2WL9E4JZDOmNIvHzT6uo=; b=IoS3ZK4OuU8T2nQdjjnVZL+cXt3YihHkSBpw0bZ1RKfo9805K0Tw0Uz82HnXelHWgW UaDRpfKR5qNFcwwhgQmUZF6e+TOd8iNqVVWYVGNAAg0GY/wnyT3HuoJgIXW7tBP36UJC 6CflCXkE78nsgNmsWxCIvMVFnbd6KDSDXgzeBsLyQpw3eqMUgCZkNZRvdqaDMbKMuZ4m s/teijhuIbUua/iLndMazIQFd2/yJG1n1SQN80zh2lHworu0UtSD+Bc/w4Gxy9Y00pDU YnQ1Ww8G4vuKen7YmXf0aZ3N6L9m8ZzoKUcxT7c29Mi0TjClEucMCVOXzO8TXGKABBL/ TL1w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-transfer-encoding; bh=7FhuKAgQzsqHYrVtPu3kUfJ2WL9E4JZDOmNIvHzT6uo=; b=tzKKz2nWJqTmLTbtNMPVSJ5Ezatpch6QTzpZM6ETN2KbDxPSG8xhP1LNvLDodx3yZ2 Uh8dhGZ8GqpKOizDnyBa7h4R+rYMwKOfge/pFmbYi72bxzAUVlMF+oa7J2PkBf11iraq 5gg2ImLE6hndGqHx91OwhQdmXBqNLrCdxRTJX3Sng6VPLp9O2vS4K1sJFO2z2OHsRG/z e2u1WqjLOAA4xjKYN/dpRcsR9U3C8KJLmpRhEnjc6vh/dL5RZmcZGmSL8hbaj+AP9brT gu72Z/+TC/sfUZauf9P8McdXeTV4pmM7uhKvmFWvPmsZNKlAs7jSkmhy12Hc0Zs12TZ3 cptg== X-Gm-Message-State: ALQs6tBHZVuL0+oDMFtIGefyWqao9LBCjY/nzBDQBHbar5cMPsI0pl41 rL4Wr6YGHaHTKRVc+MXmqqILk5+QD3touvyi/p8= X-Google-Smtp-Source: AIpwx49NS2ejvHhjqjK9KlTbXyOaCPq6dcNW2zLE3e7t5rCBpMoPxdO43buySLtsftCu2213+E0gszArUQ77LWogHaE= X-Received: by 10.200.35.132 with SMTP id q4mr3352498qtq.73.1523631052945; Fri, 13 Apr 2018 07:50:52 -0700 (PDT) MIME-Version: 1.0 Received: by 10.200.66.85 with HTTP; Fri, 13 Apr 2018 07:50:52 -0700 (PDT) In-Reply-To: References: <2151087.Q62u2efIDs@xps> <20180101202732.6423d6b9@xeon-e3> <20180108074228.515774ea@xeon-e3> From: Hui Ling Date: Fri, 13 Apr 2018 22:50:52 +0800 Message-ID: To: Andrew Bainbridge Cc: Stephen Hemminger , "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Apr 2018 14:50:53 -0000 The thing for me is that on my VM, I have always ran into the same error: "MR creation failure: Operation not permitted" till I used the drivers inserted with the specific commands. It could be that the host my VM runs on is only compatible with some specific version of MLNX drivers. And the steps I listed might just happen to work on my VM. So as Andrew suggested, if you can't fix "MR creation failure: Operation not permitted" error, you may want to ask Azure team to check and fix the host your VM runs on first. On Fri, Apr 13, 2018 at 8:47 PM, Andrew Bainbridge wrote: > Hi Hui > > That is very similar to the steps I found I needed to follow. > > Another useful fact: I found that sometimes when testpmd gives the, "MR > creation failure: Operation not permitted" error, stopping the VM (via th= e > Azure portal) and restarting it fixes it. Someone on the Azure team > suggested that this is because of a problem on some VM hosts. Stopping an= d > starting the VM is likely to move it to a new host that might not have th= e > problem. I believe they are working on fixing the bad hosts. > > ________________________________ > From: Hui Ling > Sent: 10 April 2018 09:40 > To: Stephen Hemminger > Cc: Andrew Bainbridge; users@dpdk.org > Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM > > In case anyone else might need. > > I solved this issue by installing the mlx4 related libraries from mlxn > ofed source for azure. > > 1) download source from: > > https://na01.safelinks.protection.outlook.com/?url=3Dhttp%3A%2F%2Fwww.mel= lanox.com%2Fpage%2Ffirmware_table_Microsoft%3Fmtag%3Doem_firmware_download&= data=3D02%7C01%7Candbain%40microsoft.com%7Ca8d12124d8ab49e8bf7508d59ebeacaa= %7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636589464133550197&sdata=3Deg= GzdWoT9wZ13HRxzjdpBUWYXhA2Mm%2FjR4ARuowevUQ%3D&reserved=3D0 > > > Note: download the sources (48M), not the others. For some reason, > only the source package works for me. > > 2) unpack and install > ./install.pl --guest --dpdk --upstream-libs > > 3) after installation completes, run > /etc/init.d/openibd restart > > this will insert mlx4 related module into kernels. > > After that, build dpdk and run testpmd seems working for me > > So not sure what is the deal with the MLNX packages for Azure, but > this seems to be way for me to make it work. > > Hope this may help someone else. > > > > > On Mon, Jan 8, 2018 at 11:42 PM, Stephen Hemminger > wrote: >> On Mon, 8 Jan 2018 11:01:09 +0800 >> Hui Ling wrote: >> >>> Stephen, >>> >>> My last VM (DS3 v2, with 4 cores and 16GB memory) is in Canada East >>> and I got AN enabled on my subscription so AN worked just fine. >>> >>> For DPDK, I saw from your slides in DPDK submit last year saying >>> current DPDK solution in Azure needs: >>> >>> 1) Linux kerlnel 4.14 >> >> You need transparent bonding support which is in kernel netvsc driver. >> It has been backported to Ubuntu Azure (4.13) package, RHEL 7 and SLES. >> >> >> >>> 2) 8 cores >>> >>> I am not sure if these are must. I tried to upgrade my Ubuntu to 4.14, >>> but then I ran into compilation issues with DPDK 17.11 for MLX4 PMD. >>> So I stayed with older version of kernel for Ubuntu 16.04. >>> With my config of VM, however, I could not get the failsafe.sh I got >>> from MS for azure to work. >> >> The number of cores requirement has been dropped, think it is available >> with 4 now.