From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <andbain@microsoft.com>
Received: from EUR01-HE1-obe.outbound.protection.outlook.com
 (mail-he1eur01on0128.outbound.protection.outlook.com [104.47.0.128])
 by dpdk.org (Postfix) with ESMTP id C9D941BB96
 for <users@dpdk.org>; Fri, 13 Apr 2018 14:47:53 +0200 (CEST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version;
 bh=W3RGhJ0qkyhcb7gxytombRfUXkLKZ53KIB2y0Wz19NQ=;
 b=PLGRtfo0tXgulUyMthhCqDZPEMBm5UJ4WfEtSkJtiVtu4A/HhgVcOIjBHBAsSnKEdY4w/KdwNglcXx+fhmgs3EdttZTTmGq77NMm2a5P+7M/hpAn1HLBIqPqs0NiuOaDwZwOmGjlq1xpqqn8HFCG/Vz0e/3z/aaAw8ml3q+jb5M=
Received: from HE1PR83MB0187.EURPRD83.prod.outlook.com (10.160.144.32) by
 HE1PR83MB0057.EURPRD83.prod.outlook.com (129.75.21.152) with Microsoft SMTP
 Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.20.696.7; Fri, 13 Apr 2018 12:47:51 +0000
Received: from HE1PR83MB0187.EURPRD83.prod.outlook.com
 ([fe80::61f3:dd80:1bc7:700c]) by HE1PR83MB0187.EURPRD83.prod.outlook.com
 ([fe80::61f3:dd80:1bc7:700c%5]) with mapi id 15.20.0696.008; Fri, 13 Apr 2018
 12:47:51 +0000
From: Andrew Bainbridge <andbain@microsoft.com>
To: Hui Ling <kelvin.brookletling@gmail.com>, Stephen Hemminger
 <stephen@networkplumber.org>
CC: "users@dpdk.org" <users@dpdk.org>
Thread-Topic: [dpdk-users] DPDK mlx4 PMD on Azure VM
Thread-Index: AQHTeJj7ugaHyRhuP0qcdEHUsgjjpaNK2e6AgAAB7wCAAJ9xAIAAwiZggAEtxACAEqeZAIAFyC4AgAONrICAANS2AICQIH4AgAT5488=
Date: Fri, 13 Apr 2018 12:47:51 +0000
Message-ID: <HE1PR83MB01871F5D3FBB129F1D903701AEB30@HE1PR83MB0187.EURPRD83.prod.outlook.com>
References: <CAPNMKd74hxmeX6dj1bsrUQ4fW4sjDaBTD6MqVTS+U_DLmm2i-g@mail.gmail.com>
 <2151087.Q62u2efIDs@xps>
 <DB5PR05MB12540AF714A07789A32B553CD10F0@DB5PR05MB1254.eurprd05.prod.outlook.com>
 <CAPNMKd6u3nGFWnSAd+5byMqHwQ_VB0jaVDZoN1q=XMrFOs_V_A@mail.gmail.com>
 <DB5PR83MB00374974DBB8D41CBEB22240AE0C0@DB5PR83MB0037.EURPRD83.prod.outlook.com>
 <CAPNMKd5Tkn-kfvYOJ1Q2Pa9hABhuz71Rutwe3jOpCuFqUbLC=g@mail.gmail.com>
 <20180101202732.6423d6b9@xeon-e3>
 <CAOaVG16R8bbuxUxtH9pm3QT2TJoUZbRMYsx1=P_Lm7jPVzBsLA@mail.gmail.com>
 <CAPNMKd4vpeeDbeNs=bWbrf9Hs1P0TaTVCduxscTabptYNQhp8w@mail.gmail.com>
 <20180108074228.515774ea@xeon-e3>,
 <CAPNMKd5ivsBTOYg=4KjdNY4CO7kKZTh81D3e1jO2hGXYVGkXZA@mail.gmail.com>
In-Reply-To: <CAPNMKd5ivsBTOYg=4KjdNY4CO7kKZTh81D3e1jO2hGXYVGkXZA@mail.gmail.com>
Accept-Language: en-GB, en-US
Content-Language: en-GB
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
x-originating-ip: [2a01:110:8012:1012::5cb]
x-ms-publictraffictype: Email
x-microsoft-exchange-diagnostics: 1; HE1PR83MB0057;
 7:5MruvHtNV4bkTrymJrvsQNbKt4nG3bMoOsXGU4f3qrj8UznngEGDAkTD2GgEQDyUX9MAVRfj3vbB+ZOHGvAh7bWENurUEqqr8SWNxfztWf/MzfP86SaVlj95e4YSSUQ9kHWRzZEdfc6LlJ8tL7cvCS0XhG1X4NmxUYfyqaOAokB8HqKL8GyllqfZhu0u5v8AMvTjEWybXZFwNQ7R5j3o8h6ylc6akrz/IN6SNe3WX9oYHXghL1mOyfWeV5iHR1F6;
 20:fk5M//EBuXwRqzzo7f2w9riGy+LFgIfc5bTcd+qXiVFQBOzRDueWlY8O0o7hD6G3oj/yDIncGuVZjljryoycdoqwIZmlLu0oroe0TBwO5GR4g8clE/yjd2uengJXje18/EMAYmd91HC59FXSOLij2jTgBW/PGnROueiRDQo7R44=
x-ms-exchange-antispam-srfa-diagnostics: SOS;
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam: UriScan:; BCL:0; PCL:0;
 RULEID:(7020095)(4652020)(4534165)(4627221)(201703031133081)(201702281549075)(5600026)(48565401081)(2017052603328)(7193020);
 SRVR:HE1PR83MB0057; 
x-ms-traffictypediagnostic: HE1PR83MB0057:
authentication-results: spf=none (sender IP is )
 smtp.mailfrom=andbain@microsoft.com; 
x-o365-sonar-daas-pilot: True
x-microsoft-antispam-prvs: <HE1PR83MB0057B798DDFEC361D8DE5742AEB30@HE1PR83MB0057.EURPRD83.prod.outlook.com>
x-exchange-antispam-report-test: UriScan:(189930954265078)(85827821059158)(219752817060721)(275809806118684); 
x-exchange-antispam-report-cfa-test: BCL:0; PCL:0;
 RULEID:(8211001083)(61425038)(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231232)(944501343)(52105095)(3002001)(10201501046)(6055026)(61426038)(61427038)(6041310)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123560045)(20161123562045)(20161123558120)(20161123564045)(6072148)(201708071742011);
 SRVR:HE1PR83MB0057; BCL:0; PCL:0; RULEID:; SRVR:HE1PR83MB0057; 
x-forefront-prvs: 0641678E68
x-forefront-antispam-report: SFV:NSPM;
 SFS:(10019020)(366004)(39380400002)(376002)(39860400002)(396003)(346002)(189003)(199004)(6436002)(6306002)(25786009)(5250100002)(9686003)(236005)(55016002)(7736002)(53936002)(86612001)(2906002)(54896002)(4326008)(14454004)(6246003)(186003)(102836004)(8990500004)(3280700002)(606006)(229853002)(3660700001)(74316002)(10090500001)(10290500003)(105586002)(105004)(46003)(5660300001)(81156014)(86362001)(19627405001)(81166006)(39060400002)(7696005)(110136005)(478600001)(68736007)(93886005)(22452003)(8676002)(316002)(2900100001)(8936002)(6116002)(76176011)(966005)(59450400001)(476003)(446003)(53546011)(33656002)(11346002)(486006)(99286004)(6506007)(97736004)(106356001);
 DIR:OUT; SFP:1102; SCL:1; SRVR:HE1PR83MB0057;
 H:HE1PR83MB0187.EURPRD83.prod.outlook.com; FPR:; SPF:None; LANG:en;
 PTR:InfoNoRecords; MX:1; A:1; 
received-spf: None (protection.outlook.com: microsoft.com does not designate
 permitted sender hosts)
spamdiagnosticoutput: 1:99
spamdiagnosticmetadata: NSPM
MIME-Version: 1.0
X-MS-Office365-Filtering-Correlation-Id: f3832a61-f661-4f00-6887-08d5a13cc4fa
X-OriginatorOrg: microsoft.com
X-MS-Exchange-CrossTenant-Network-Message-Id: f3832a61-f661-4f00-6887-08d5a13cc4fa
X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Apr 2018 12:47:51.4745 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 72f988bf-86f1-41af-91ab-2d7cd011db47
X-MS-Exchange-Transport-CrossTenantHeadersStamped: HE1PR83MB0057
X-Mailman-Approved-At: Sun, 15 Apr 2018 16:07:29 +0200
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
X-Content-Filtered-By: Mailman/MimeDel 2.1.15
Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM
X-BeenThere: users@dpdk.org
X-Mailman-Version: 2.1.15
Precedence: list
List-Id: DPDK usage discussions <users.dpdk.org>
List-Unsubscribe: <https://dpdk.org/ml/options/users>,
 <mailto:users-request@dpdk.org?subject=unsubscribe>
List-Archive: <http://dpdk.org/ml/archives/users/>
List-Post: <mailto:users@dpdk.org>
List-Help: <mailto:users-request@dpdk.org?subject=help>
List-Subscribe: <https://dpdk.org/ml/listinfo/users>,
 <mailto:users-request@dpdk.org?subject=subscribe>
X-List-Received-Date: Fri, 13 Apr 2018 12:47:54 -0000

Hi Hui

That is very similar to the steps I found I needed to follow.

Another useful fact: I found that sometimes when testpmd gives the, "MR cre=
ation failure: Operation not permitted" error, stopping the VM (via the Azu=
re portal) and restarting it fixes it. Someone on the Azure team suggested =
that this is because of a problem on some VM hosts. Stopping and starting t=
he VM is likely to move it to a new host that might not have the problem. I=
 believe they are working on fixing the bad hosts.

________________________________
From: Hui Ling <kelvin.brookletling@gmail.com>
Sent: 10 April 2018 09:40
To: Stephen Hemminger
Cc: Andrew Bainbridge; users@dpdk.org
Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM

In case anyone else might need.

I solved this issue by installing the mlx4 related libraries from mlxn
ofed source for azure.

1) download source from:

https://na01.safelinks.protection.outlook.com/?url=3Dhttp%3A%2F%2Fwww.mella=
nox.com%2Fpage%2Ffirmware_table_Microsoft%3Fmtag%3Doem_firmware_download&da=
ta=3D02%7C01%7Candbain%40microsoft.com%7Ca8d12124d8ab49e8bf7508d59ebeacaa%7=
C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636589464133550197&sdata=3DegGz=
dWoT9wZ13HRxzjdpBUWYXhA2Mm%2FjR4ARuowevUQ%3D&reserved=3D0

Note: download the sources (48M), not the others. For some reason,
only the source package works for me.

2) unpack and install
./install.pl --guest --dpdk --upstream-libs

3) after installation completes, run
/etc/init.d/openibd restart

this will insert mlx4 related module into kernels.

After that, build dpdk and run testpmd seems working for me

So not sure what is the deal with the MLNX packages for Azure, but
this seems to be way for me to make it work.

Hope this may help someone else.




On Mon, Jan 8, 2018 at 11:42 PM, Stephen Hemminger
<stephen@networkplumber.org> wrote:
> On Mon, 8 Jan 2018 11:01:09 +0800
> Hui Ling <kelvin.brookletling@gmail.com> wrote:
>
>> Stephen,
>>
>> My last VM (DS3 v2, with 4 cores and 16GB memory) is in Canada East
>> and I got AN enabled on my subscription so AN worked just fine.
>>
>> For DPDK, I saw from your slides in DPDK submit last year saying
>> current DPDK solution in Azure needs:
>>
>> 1) Linux kerlnel 4.14
>
> You need transparent bonding support which is in kernel netvsc driver.
> It has been backported to Ubuntu Azure (4.13) package, RHEL 7 and SLES.
>
>
>
>> 2) 8 cores
>>
>> I am not sure if these are must. I tried to upgrade my Ubuntu to 4.14,
>> but then I ran into compilation issues with DPDK 17.11 for MLX4 PMD.
>> So I stayed with older version of kernel for Ubuntu 16.04.
>> With my config of VM, however, I could not get the failsafe.sh I got
>> from MS for azure to work.
>
> The number of cores requirement has been dropped, think it is available
> with 4 now.