From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-wm0-f48.google.com (mail-wm0-f48.google.com [74.125.82.48]) by dpdk.org (Postfix) with ESMTP id 4E98C1B04C for ; Mon, 8 Jan 2018 04:01:10 +0100 (CET) Received: by mail-wm0-f48.google.com with SMTP id g75so11646477wme.0 for ; Sun, 07 Jan 2018 19:01:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:in-reply-to:references:from:date:message-id:subject:to :cc; bh=anq1EeUkP59xIhf4j3wVUEHO1sjpwdneQQGVfks4qFA=; b=nHBAXhUKPoxqkbT+ap4HxrfENC+hBJFOWadm7PwS1AqibgKTECsMVHQJDJkmPMJLRZ KgmfogJByG+FUrsTwgW+rGioVwgGSwPPR5Qj0pIhaOAhFywuUrTDC7MlKG++g5W9F6UD OVh96BNF9i0KyQD99cgplSHf96IFjR6Cf9A1+Lm9o9qISfldQDX6MCZgoJR2qqJ/CODN ZvSPNRNCXX1al7Prp6ibPSr/TJ/YcsGPXjHGKTJ5koUWJUUylSJgZCEi3BPQ8NNVpgiG xElAV/Y+Yieg53cJG6zmbpVk9bEofup3P7z/HO8Leru2tjgoVj6uuIIIDVt2TqoiPPU3 hFhw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc; bh=anq1EeUkP59xIhf4j3wVUEHO1sjpwdneQQGVfks4qFA=; b=KyCF5nuCAMiR5VHyAgCSYw+wGGug0bNmznKBbFrxIHOmF7CAg6VbhNjBDGfesQUyXU 4DpJ1Q3uhPSQ6ClMVmrMtDry8IN23UI3XkBOrCHXFCsFpZj8yFxdkmcdPQ5VmVB0GxN8 qmcFmSlBnCkyeAiVfmXvsMYoQAggK5En3Bh+5CrLgZJVOBfjrAvEN0zM9U0KiNEeomW3 tgCXF93WXN21+dTIbUTpj7Fs60M9bFlXUPo+EOMg4f1Qh4eDo6ajEiI1o4nlNytWGLoz NtafuhyEu2tLUb3Gn+WpFDq/cgLiTosvOMoyCHd6W9yTlwtelZCCej0PHRipMi6gA6wh /TVA== X-Gm-Message-State: AKGB3mJUAwnM1mLWlTXxNTuTyRwrYHKPT0WhuFe8oZIGIeESScI1Q5m1 t+JgDmxFabHdPUnIUnmtZK6UZq/EfCPA0+8OFewUFQ== X-Google-Smtp-Source: ACJfBot6pixZPlz+1OajK3Edviv/BxCiV/0aUZjX1yitSONCovyFJEI+6rgoKNl/E0Ks+1TknRD5j0W9IevaOvjkX30= X-Received: by 10.80.240.213 with SMTP id a21mr14780622edm.252.1515380469950; Sun, 07 Jan 2018 19:01:09 -0800 (PST) MIME-Version: 1.0 Received: by 10.80.142.161 with HTTP; Sun, 7 Jan 2018 19:01:09 -0800 (PST) In-Reply-To: References: <2151087.Q62u2efIDs@xps> <20180101202732.6423d6b9@xeon-e3> From: Hui Ling Date: Mon, 8 Jan 2018 11:01:09 +0800 Message-ID: To: Stephen Hemminger Cc: Andrew Bainbridge , "users@dpdk.org" Content-Type: text/plain; charset="UTF-8" Subject: Re: [dpdk-users] DPDK mlx4 PMD on Azure VM X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Jan 2018 03:01:10 -0000 Stephen, My last VM (DS3 v2, with 4 cores and 16GB memory) is in Canada East and I got AN enabled on my subscription so AN worked just fine. For DPDK, I saw from your slides in DPDK submit last year saying current DPDK solution in Azure needs: 1) Linux kerlnel 4.14 2) 8 cores I am not sure if these are must. I tried to upgrade my Ubuntu to 4.14, but then I ran into compilation issues with DPDK 17.11 for MLX4 PMD. So I stayed with older version of kernel for Ubuntu 16.04. With my config of VM, however, I could not get the failsafe.sh I got from MS for azure to work. So I am not sure if it is my VM setting, or my VM kernel. It will be very helpful if MS has some clear guide on how DPDK works on Azure. Hui On Sat, Jan 6, 2018 at 4:45 AM, Stephen Hemminger wrote: > Accelerated networking is now generally available for Linux (and Windows) in > all regions. > > https://azure.microsoft.com/en-us/blog/maximize-your-vm-s-performance-with-accelerated-networking-now-generally-available-for-both-windows-and-linux/ > > On Mon, Jan 1, 2018 at 8:27 PM, Stephen Hemminger > wrote: >> >> On Thu, 21 Dec 2017 15:35:00 +0800 >> Hui Ling wrote: >> >> > Andy, >> > >> > My last VM is not in "Canada East" center since no AN type of instance >> > was available to me at the time I created my VM. >> > >> > Just tried on a same type VM in Canada East, and it seems that the >> > location does make a difference. >> > >> > This time, I was able to run testpmd without any explicit errors: >> > >> > root@myVM:/home/hling/dpdk-17.11# build/app/testpmd -l 1-2 -n 4 -w >> > 0004:00:02.0 0002:00:02.0 -- --rxq=2 --txq=2 -i >> > EAL: Detected 4 lcore(s) >> > EAL: No free hugepages reported in hugepages-1048576kB >> > EAL: Probing VFIO support... >> > EAL: WARNING: cpu flags constant_tsc=yes nonstop_tsc=no -> using >> > unreliable clock cycles ! >> > EAL: PCI device 0004:00:02.0 on NUMA socket 0 >> > EAL: probe driver: 15b3:1004 net_mlx4 >> > PMD: mlx4.c:465: mlx4_pci_probe(): PCI information matches, using >> > device "mlx4_3" (VF: true) >> > PMD: mlx4.c:492: mlx4_pci_probe(): 1 port(s) detected >> > PMD: mlx4.c:586: mlx4_pci_probe(): port 1 MAC address is >> > 00:0d:3a:f4:49:c4 >> > Interactive-mode selected >> > USER1: create a new mbuf pool : n=155456, >> > size=2176, socket=0 >> > Configuring Port 0 (socket 0) >> > Port 0: 00:0D:3A:F4:49:C4 >> > Checking link statuses... >> > Done >> > >> > testpmd> start tx_first >> > io packet forwarding - ports=1 - cores=1 - streams=2 - NUMA support >> > enabled, MP over anonymous pages disabled >> > Logical Core 2 (socket 0) forwards packets on 2 streams: >> > RX P=0/Q=0 (socket 0) -> TX P=0/Q=0 (socket 0) peer=02:00:00:00:00:00 >> > RX P=0/Q=1 (socket 0) -> TX P=0/Q=1 (socket 0) peer=02:00:00:00:00:00 >> > >> > io packet forwarding - CRC stripping enabled - packets/burst=32 >> > nb forwarding cores=1 - nb forwarding ports=1 >> > RX queues=2 - RX desc=128 - RX free threshold=0 >> > RX threshold registers: pthresh=0 hthresh=0 wthresh=0 >> > TX queues=2 - TX desc=512 - TX free threshold=0 >> > TX threshold registers: pthresh=0 hthresh=0 wthresh=0 >> > TX RS bit threshold=0 - TXQ flags=0x0 >> > testpmd> stop >> > Telling cores to stop... >> > Waiting for lcores to finish... >> > >> > ------- Forward Stats for RX Port= 0/Queue= 0 -> TX Port= 0/Queue= 0 >> > ------- >> > RX-packets: 0 TX-packets: 32 TX-dropped: 0 >> > ------- Forward Stats for RX Port= 0/Queue= 1 -> TX Port= 0/Queue= 1 >> > ------- >> > RX-packets: 0 TX-packets: 32 TX-dropped: 0 >> > ---------------------- Forward statistics for port 0 >> > ---------------------- >> > RX-packets: 0 RX-dropped: 0 RX-total: 0 >> > TX-packets: 64 TX-dropped: 0 TX-total: 64 >> > >> > ---------------------------------------------------------------------------- >> > >> > +++++++++++++++ Accumulated forward statistics for all >> > ports+++++++++++++++ >> > RX-packets: 0 RX-dropped: 0 RX-total: 0 >> > TX-packets: 64 TX-dropped: 0 TX-total: 64 >> > >> > ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ >> > >> > Done. >> > testpmd> >> > >> > >> > >> > Not sure why I don't see any packets transmission, but at least the >> > MLX4 PMD seems to be able to talk to the mlx4_en driver, or is it? >> > >> > Will keep digging. >> > >> > Hui >> > >> > On Wed, Dec 20, 2017 at 9:39 PM, Andrew Bainbridge >> > wrote: >> > > Hi Hui >> > > >> > > Did you create your VM in the "Canada East" data center? This page >> > > suggests that is a requirement: >> > > >> > > https://azure.microsoft.com/en-us/blog/azure-networking-updates-for-fall-2017/ >> > > >> > > Also, I seem to remember reading that the VM must have at least 8 >> > > cores. Sorry, I can't find a reference for that. >> > > >> > > - Andy >> > > >> > > -----Original Message----- >> > > From: Hui Ling >> > > >> > > This is my VM info in case it is needed. >> > > >> > > ======================================================================================================= >> > > A Standard_DS3_v2 instance from Azure. (one of these models support >> > > AN) >> > > >> >> You will need to a couple of things. >> 1. Make sure you have a VM capable of accelerated networking, and that >> your Azure account >> has opt-ed in. Last I checked it was still in preview until RHEL 7 with >> AN support was released. >> >> >> https://docs.microsoft.com/en-us/azure/virtual-network/virtual-network-create-vm-accelerated-networking >> >> There are many different regions, and most have AN by now. Which one are >> you trying? >> >> >> Make sure Linux without DPDK is working with AN first. >> >> 2. DPDK support requires 17.11 or later DPDK and the failsafe and TAP >> PMD's. >> The Mellanox mlx4 on Azure is only used after a flow is established. >> The initial packet (and broadcast/multicast) show up on the >> non-accelerated netvsc device. >> See the DPDK User Summit in Dublin 2017 for more detal. >> >> For later releases if you watch the development mailing list you will see >> the enhancements being done to simplify setup of TAP/failsafe. >> >