From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM04-SN1-obe.outbound.protection.outlook.com (mail-eopbgr700125.outbound.protection.outlook.com [40.107.70.125]) by dpdk.org (Postfix) with ESMTP id 6E0B31B56B for ; Thu, 13 Dec 2018 17:48:56 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=VectraNetworks.onmicrosoft.com; s=selector1-vectra-ai; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=aPNnk69RYS0cmU8+mA4dp5A1qIZgeC7NFCeLa6zHPfc=; b=gQmU61vnqVbVIyxXRbdlC6QEAWfZY5D+svr5FbmXYQAXjt1hzfqwlwMTwUR+/xRZdEJs90aYnF82U1Dv6FaefSC6qrRctB4ifZ3Y+CWolhQn62JeFR+QY4rJWvNGtXJouKY6S6Ob43F+m4agrrIRD4Q3grRqJxF/FbQOL/k8u9g= Received: from BYAPR08MB4951.namprd08.prod.outlook.com (20.176.255.148) by BYAPR08MB5848.namprd08.prod.outlook.com (20.179.63.153) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1425.18; Thu, 13 Dec 2018 16:48:55 +0000 Received: from BYAPR08MB4951.namprd08.prod.outlook.com ([fe80::4f9:192c:d449:bde8]) by BYAPR08MB4951.namprd08.prod.outlook.com ([fe80::4f9:192c:d449:bde8%6]) with mapi id 15.20.1404.026; Thu, 13 Dec 2018 16:48:55 +0000 From: Gareth Bradshaw To: Stephen Hemminger CC: "users@dpdk.org" Thread-Topic: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 Thread-Index: AdSMhHQaPwbpxUOEQ+6rhWzaSosawgAL6jyAAAJFZqABkWDRoA== Date: Thu, 13 Dec 2018 16:48:55 +0000 Message-ID: References: <20181205080351.10936ea4@xeon-e3> In-Reply-To: Accept-Language: en-IE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=gareth@vectra.ai; x-originating-ip: [46.7.110.163] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; BYAPR08MB5848; 6:qpc3Ian+8NO0em1sfYZRzKtj39rMqklpewQ6f3diBX9nWfLnMj57UaDF+nngPf9ECYNUbLpH33v82W5fKgJlbUYxRKGuO01BlhgNCbSakfXeQ7vprXeBS9s0gJa9DTYAi54YsfRtxJUnwGRxGZjx7B5Oe5sbzgMGXrXmZvJ9YOaJsFNiG7q+HKlKSBtRAM2UQifk8pMkOzYA/rCAnMMwfOInaCSYTE3HU9HEkuEuKDIiunJrxGbjU0VWJ/QO+KnFMQoP7A+KhDoD7doq9gQadGAj3QLg/kPrM16ObE/KwPY7OZfKiP7xCd8vm3r6QtgVlGr5kNaqFxkpNgkNiRD4XojLoua8Vi68FGtvg0sphl5mw5yMVNSiCo4I47TAaOCe8wuPQ9ycYL7fxuiEvHsfVcWityv36u/uU91L9BMlbo8xTNly1rbG3LO6Is6HFvsMzfE4Gaza562/cYx8jJ1W7g==; 5:X4WTumeXyjjVOK0mj/K+6HiR3DuwO4S+oyJeKfuS3YHGtC8t2pQ/Wh4unTY6x6Fae4u6opql3808hzDbCJp9UxRM8OPqBJcB5dMf1cXTNWLnvpXlBRkV2IxxtABexgkWfSKB7i5gbbMzBpzbVfg4nECCiFetvofThsy7MPD8h8A=; 7:CfVjQzpD4LT9WNJQzv5DREjcjQBM8c5JYcgGtIagj7jGSyXiJNftiP6JmkHujuyKGJwXkkVKuZ0soIBbtbH+pBtHfg/dHpUVWsknSLIchP/IvoYEUqi3ItILDVdoGZHaxxQs5+xuOJSWCpK8wdjjaQ== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: 57f92aa0-2925-484e-2e67-08d6611ade9b x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(7021145)(8989299)(5600074)(711020)(4534185)(7022145)(4603075)(4627221)(201702281549075)(8990200)(7048125)(7024125)(7027125)(7023125)(2017052603328)(7153060)(7193020); SRVR:BYAPR08MB5848; x-ms-traffictypediagnostic: BYAPR08MB5848: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(3230021)(999002)(6040522)(2401047)(8121501046)(5005006)(3231475)(944501520)(52105112)(3002001)(93006095)(93001095)(10201501046)(148016)(149066)(150057)(6041310)(20161123562045)(20161123560045)(20161123564045)(20161123558120)(2016111802025)(6043046)(201708071742011)(7699051)(76991095); SRVR:BYAPR08MB5848; BCL:0; PCL:0; RULEID:; SRVR:BYAPR08MB5848; x-forefront-prvs: 088552DE73 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(396003)(136003)(346002)(376002)(39840400004)(52084003)(13464003)(199004)(189003)(68736007)(76176011)(26005)(7696005)(102836004)(186003)(8936002)(14454004)(81156014)(316002)(2906002)(66066001)(5660300001)(99286004)(81166006)(8676002)(74316002)(6116002)(33656002)(106356001)(6506007)(7736002)(53546011)(3846002)(229853002)(74482002)(305945005)(6436002)(105586002)(6916009)(71190400001)(55016002)(486006)(508600001)(86362001)(476003)(6246003)(11346002)(71200400001)(256004)(25786009)(6306002)(9686003)(446003)(14444005)(97736004)(4326008)(53936002); DIR:OUT; SFP:1102; SCL:1; SRVR:BYAPR08MB5848; H:BYAPR08MB4951.namprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: vectra.ai does not designate permitted sender hosts) x-microsoft-antispam-message-info: frnwxM74ntYDINyDkuKq6kgMdrdF42PbfdtUGhJiRP+5KSqojXi/xTGLge2D0PfN6tseggg2R4jgktNrsQrJKiJ7qF9ZcwmOivHOZ97/zJv62GX4PkgvaR03wEfimzP4Axgy30BRdpXhB6BBhajUIJpW5szC8Wa859PpSk4Pd0tbJU7C8wv9z1Eww7oRDvQl1gPAADrCPlCi/6OXARcGKFR/SJ6SB4y/Pg/EO6FeY0yBGnn56/SJYXGbNlQMInma27V2dIFVKfjzj6EytCd7upKNySq+bI+6r/cKc6ZVAfuiHo8Abvlgo5IuAMhSS0V4 spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: vectra.ai X-MS-Exchange-CrossTenant-Network-Message-Id: 57f92aa0-2925-484e-2e67-08d6611ade9b X-MS-Exchange-CrossTenant-originalarrivaltime: 13 Dec 2018 16:48:55.0199 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a6cc66bc-f419-45c2-a9c2-8ff4ab685f2d X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR08MB5848 Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Dec 2018 16:48:56 -0000 Hi Stephen, I wanted to check in to see how the fix is going. I've repro'd the patches= yourself and Mohammed Gamal were discussing on the development mailing lis= t and see the same results, i.e. multi-channel works the first time testpmd= is launched but subsequent launches result in an error setting up the sub-= channels. I'm on the development mailing list so if you'd like to add me t= o the thread I'll be happy to test the patches. Cheers, Gareth -----Original Message----- From: Gareth Bradshaw=20 Sent: Wednesday 5 December 2018 17:10 To: Stephen Hemminger Cc: users@dpdk.org Subject: RE: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 Thanks for coming back to me Stephen. I found the thread you mentioned and= will keep an eye on it. I'm happy to help out with testing the change. Gareth -----Original Message----- From: Stephen Hemminger =20 Sent: Wednesday 5 December 2018 16:04 To: Gareth Bradshaw Cc: users@dpdk.org Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 On Wed, 5 Dec 2018 11:05:58 +0000 Gareth Bradshaw wrote: > Hi, >=20 > I'm developing a DPDK application for Hyper-V and would like to use Kerne= l v4.20 as it fixes a crash in previous kernels (per this pull request) but multi-queue support seems to have broken in that kernel. It works= in kernels 4.17, 4.18 and 4.19. >=20 > Using testpmd with parameters "--forward-mode=3Dtxonly --nb-cores=3D3 --t= xq=3D3 --rxq=3D3" I get the following error "vmbus_uio_get_subchan(): inval= id subchannel id 0". >=20 > Tracing the code a bit I find that it's trying to read /sys/bus/devices/<= devid>/channels/21/subchannel_id but when I try to cat the same file I get = the error "Invalid argument". I've compared to previous kernel versions an= d see the following differences: >=20 > * When the VM boots, the device is bound to the kernel driver and the= re are 4 channels on both kernel versions. It's a 4 core VM. > * When I bind the device to uio_hv_generic, kernel v.19.5 (and previo= us) has a single channel and it has a valid subchannel_id. On kernel 4.20 = the 4 channel folders remain but they are all invalid. > * When I start testpmd with 3 queues, on kernel v4.19.5 two additiona= l channels are created, they're valid and testpmd works as expected. On ke= rnel 4.20 the 4 invalid channels remain invalid and testpmd gives the error= I mentioned. >=20 > Any help getting this working would be greatly appreciated. >=20 > Thanks > Gareth >=20 >=20 >=20 >=20 >=20 >=20 There is a race that shows up in sub channel initialization, it is being wo= rked on the development mailing list. No resolution yet.