From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pf1-f174.google.com (mail-pf1-f174.google.com [209.85.210.174]) by dpdk.org (Postfix) with ESMTP id 2B1E05B32 for ; Thu, 13 Dec 2018 18:47:57 +0100 (CET) Received: by mail-pf1-f174.google.com with SMTP id b85so1466728pfc.3 for ; Thu, 13 Dec 2018 09:47:56 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=networkplumber-org.20150623.gappssmtp.com; s=20150623; h=date:from:to:cc:subject:message-id:in-reply-to:references :mime-version:content-transfer-encoding; bh=YFnhrduMZ+QFxsgKsfS9DFOWDQxZiJE0TzLLqNR6HnM=; b=vsmi8JK5qEDjYi4VFXRjGj0DGulKoeBiMKN43/tQfC3ZkcLTCTQ18FBjki9ZEGbXbV H9XjoWrRz8bZEFaywJ0kF+Nc/VUene4mdG0uHpwA1qCcrZnmQv6XJCOFak3ArBLxSxst RyeJL7j6sxeTxJc6j5NgTwsDxJ6pd3+FUztxDIkOugybX3uayLmX9wyOvZuN+ijyUueQ r1qPtkNPsDiQiM6TjOhe6ipKMv2FL2GnLsbmzIUgzMgCWMLLpz8U4tLqi66hGuqi+EIH NDUQ6YeRoA3xfZ3UFZbP7rT4LsDMAr3oLazbm1FFSDRAtBQKEQBxRzFDPEGO+m0gSnHy pHKw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:date:from:to:cc:subject:message-id:in-reply-to :references:mime-version:content-transfer-encoding; bh=YFnhrduMZ+QFxsgKsfS9DFOWDQxZiJE0TzLLqNR6HnM=; b=hoPff9IZYl5eBiM73CvddgySXEpCwxB8Kpxx+N0ehpQbLqeLv+gElMl/2eS+SPUiB9 Ce16FTYb1nSsNo0xImwkmYrCPbR8hQ3E7YpGKIqKzQMS1bisijraEb9NLGH9ozQIjmVx FJPU5TaFyXEA4lYdmCuy15PcVz9s/67xxnRckKAZGzsV4FZf79VsV7qlnrxBik5TeTj6 yR17f326vI5FnZ+k/vEKr+8Xj5QpFAXXouaNMMninW9SHTnz2LxuiIIEy+d4AFCyMBJw EZi2KGDHXv1jeNK6m3msqVun/PUWmhk55UuG1J4JaHfzHAvx7gH13yaVF0/9udwtolVC 2lUg== X-Gm-Message-State: AA+aEWbELncJjba39Tm9pB8byG9c+Ztp3E1k6Ag/lZUbEMlX/Gbp/CsC vvHrAQz2Iq6ddrAdSP1o3wResA== X-Google-Smtp-Source: AFSGD/XF8sBKDGUc0+fPQSHSSmprKAjy/ogIw3bg7PMEgTRdU8NPkIgfo8/zsaoAI5sQ+lbUx0Jsxw== X-Received: by 2002:a63:9e58:: with SMTP id r24mr4308439pgo.264.1544723275973; Thu, 13 Dec 2018 09:47:55 -0800 (PST) Received: from xeon-e3 (204-195-22-127.wavecable.com. [204.195.22.127]) by smtp.gmail.com with ESMTPSA id h8sm2707938pgv.27.2018.12.13.09.47.55 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 13 Dec 2018 09:47:55 -0800 (PST) Date: Thu, 13 Dec 2018 09:47:51 -0800 From: Stephen Hemminger To: Gareth Bradshaw Cc: "users@dpdk.org" Message-ID: <20181213094751.093f6c53@xeon-e3> In-Reply-To: References: <20181205080351.10936ea4@xeon-e3> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Dec 2018 17:47:57 -0000 On Thu, 13 Dec 2018 16:48:55 +0000 Gareth Bradshaw wrote: > Hi Stephen, > > I wanted to check in to see how the fix is going. I've repro'd the patches yourself and Mohammed Gamal were discussing on the development mailing list and see the same results, i.e. multi-channel works the first time testpmd is launched but subsequent launches result in an error setting up the sub-channels. I'm on the development mailing list so if you'd like to add me to the thread I'll be happy to test the patches. > > Cheers, > Gareth > > > -----Original Message----- > From: Gareth Bradshaw > Sent: Wednesday 5 December 2018 17:10 > To: Stephen Hemminger > Cc: users@dpdk.org > Subject: RE: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 > > Thanks for coming back to me Stephen. I found the thread you mentioned and will keep an eye on it. I'm happy to help out with testing the change. > > Gareth > > > -----Original Message----- > From: Stephen Hemminger > Sent: Wednesday 5 December 2018 16:04 > To: Gareth Bradshaw > Cc: users@dpdk.org > Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 > > On Wed, 5 Dec 2018 11:05:58 +0000 > Gareth Bradshaw wrote: > > > Hi, > > > > I'm developing a DPDK application for Hyper-V and would like to use Kernel v4.20 as it fixes a crash in previous kernels (per this pull request) but multi-queue support seems to have broken in that kernel. It works in kernels 4.17, 4.18 and 4.19. > > > > Using testpmd with parameters "--forward-mode=txonly --nb-cores=3 --txq=3 --rxq=3" I get the following error "vmbus_uio_get_subchan(): invalid subchannel id 0". > > > > Tracing the code a bit I find that it's trying to read /sys/bus/devices//channels/21/subchannel_id but when I try to cat the same file I get the error "Invalid argument". I've compared to previous kernel versions and see the following differences: > > > > * When the VM boots, the device is bound to the kernel driver and there are 4 channels on both kernel versions. It's a 4 core VM. > > * When I bind the device to uio_hv_generic, kernel v.19.5 (and previous) has a single channel and it has a valid subchannel_id. On kernel 4.20 the 4 channel folders remain but they are all invalid. > > * When I start testpmd with 3 queues, on kernel v4.19.5 two additional channels are created, they're valid and testpmd works as expected. On kernel 4.20 the 4 invalid channels remain invalid and testpmd gives the error I mentioned. > > > > Any help getting this working would be greatly appreciated. > > > > Thanks > > Gareth > > > > > > > > > > > > > > There is a race that shows up in sub channel initialization, it is being worked on the development mailing list. No resolution yet. There were two kernel patches: http://driverdev.linuxdriverproject.org/pipermail/driverdev-devel/2018-December/129607.html http://driverdev.linuxdriverproject.org/pipermail/driverdev-devel/2018-December/129656.html After that it works fine.