From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM05-CO1-obe.outbound.protection.outlook.com (mail-eopbgr720125.outbound.protection.outlook.com [40.107.72.125]) by dpdk.org (Postfix) with ESMTP id 07F64DE0 for ; Wed, 5 Dec 2018 18:10:17 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=VectraNetworks.onmicrosoft.com; s=selector1-vectra-ai; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=GCrcgTB+a0ZXy8rU3gFgT8kXScdGcASlFpgOhb2tOcE=; b=WuewTjPoXbs4ZtfJkfOBsmsCn2n0gd3E/jHT+vMT+VwmonY/lhvAQ5JaT6RDFCcB06CKLvbKE0PMmv9KOn+ORXzc0E6cV4notuN5OsJuHiKli2aTt+MfFx1l3VvWq7PT5zQqW+1K47rpdKIgsDTlcjP1hg1Flg7eNEQ3tlAaEGs= Received: from BYAPR08MB4951.namprd08.prod.outlook.com (20.176.255.148) by BYAPR08MB4309.namprd08.prod.outlook.com (52.135.205.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1404.19; Wed, 5 Dec 2018 17:10:15 +0000 Received: from BYAPR08MB4951.namprd08.prod.outlook.com ([fe80::4f9:192c:d449:bde8]) by BYAPR08MB4951.namprd08.prod.outlook.com ([fe80::4f9:192c:d449:bde8%5]) with mapi id 15.20.1382.023; Wed, 5 Dec 2018 17:10:15 +0000 From: Gareth Bradshaw To: Stephen Hemminger CC: "users@dpdk.org" Thread-Topic: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 Thread-Index: AdSMhHQaPwbpxUOEQ+6rhWzaSosawgAL6jyAAAJFZqA= Date: Wed, 5 Dec 2018 17:10:15 +0000 Message-ID: References: <20181205080351.10936ea4@xeon-e3> In-Reply-To: <20181205080351.10936ea4@xeon-e3> Accept-Language: en-IE, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=gareth@vectra.ai; x-originating-ip: [46.7.110.163] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; BYAPR08MB4309; 6:rAvyGYg85u8/JyhljlntYXA6e/T/3r4qNCO5HBGxE2NDNL2yFlBmbkRa86uArf6xSC0UbiaFDnr93W/GnDqM8l5SK/w8GvkXFti9vSYYYdzQmhwew8gaHcLO2YXLg++kXi14Rxy/J+rWTVoOi4ExH4Fa7UTPLoZEFg9wl1sEYG7gt5TEFvJJiDwIWQHyI++e6+eY3IPEnLN5kAe3HTdGRpASshLVMyhC5F0gA6iQK9C3M9+jNj/L0PMJLvjS2rD8/aFwlTg/NJVzIf+1gFNO++ajYmFB95cn+hexKPazbM3/gXgHqRqIlYohEd8tNdF6WL6U7wk3XaPBNsE70czyPBRfayOFXz38plltS2RLSNoKf7wK3V6dvkMdkYtMGengXLASnKrhSDWTncBsfrT9xgao91xwGNe93Ls/q5d3H75igBGrP1gma+Zj0AObgdvE+lD4/YShCNMSwJTOnYqtpw==; 5:IRKhs8WM3Y9aFV0zvGbujXgEQ9Oi0gV6DhEiv2bHDeXQJ+pi5HVUPYjGcl3w6eosYpIUwRTbny9dGDiYYGQi8eXkBCGQR1fpWXjXXV39aqnYLnTyVXdEbmtm9oCNhNb0v/DipEZT51XO9QAkkO83y7Crtz0sgrxIK1T+gYnby/o=; 7:AsSTumv+bBJl793H7XUZu30b5yvILiERwvqyF9+AJCMNLgbELvSnXAWjvixncuSFy18lq23xFzd7fQp4uob46M1M4Fy1yQ8NyepDwWet3UHuSGG78CS9TLzEvDkE+d01vv5qkHwqJrgZ1H5/LA3rUg== x-ms-exchange-antispam-srfa-diagnostics: SOS; x-ms-office365-filtering-correlation-id: ba83aa9f-97c7-4bd1-1219-08d65ad4866c x-microsoft-antispam: BCL:0; PCL:0; RULEID:(2390098)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600074)(711020)(2017052603328)(7153060)(7193020); SRVR:BYAPR08MB4309; x-ms-traffictypediagnostic: BYAPR08MB4309: x-microsoft-antispam-prvs: x-ms-exchange-senderadcheck: 1 x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040522)(2401047)(8121501046)(5005006)(93006095)(93001095)(3231455)(999002)(944501520)(52105112)(3002001)(10201501046)(148016)(149066)(150057)(6041310)(20161123564045)(20161123560045)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123562045)(20161123558120)(201708071742011)(7699051)(76991095); SRVR:BYAPR08MB4309; BCL:0; PCL:0; RULEID:; SRVR:BYAPR08MB4309; x-forefront-prvs: 08770259B4 x-forefront-antispam-report: SFV:NSPM; SFS:(10019020)(366004)(346002)(376002)(39840400004)(136003)(396003)(189003)(199004)(52084003)(13464003)(74482002)(6916009)(76176011)(256004)(14444005)(5660300001)(6246003)(71200400001)(305945005)(81166006)(71190400001)(6506007)(81156014)(106356001)(105586002)(7696005)(25786009)(229853002)(7736002)(86362001)(8936002)(4326008)(33656002)(476003)(102836004)(2906002)(66066001)(8676002)(186003)(486006)(68736007)(316002)(55016002)(53936002)(446003)(11346002)(97736004)(478600001)(3846002)(6436002)(6116002)(14454004)(6306002)(99286004)(9686003)(74316002)(26005)(53546011); DIR:OUT; SFP:1102; SCL:1; SRVR:BYAPR08MB4309; H:BYAPR08MB4951.namprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: vectra.ai does not designate permitted sender hosts) x-microsoft-antispam-message-info: BOXlkNAGVN+sHZgh0Y2py0lFpFNOUMPUKbjcBc45VG4fFz40wPrUQGI4k1jwzaMV0VWjpsJB7Vb7/JSLD1jUqhvS8w4L5NX4jiZltBm5L8MtpYGx9qDidTf57ol7nLuHVuARG6U3RY/11JzAF42LFWbHQrNoa5ytL7if3xu3kTxPsjldcRERwVj7hNfNAOuAUWyJG1zMAXud8Nxo4Y/NYFG3AVBW+sJ4XJtUkTolgxDFefOIE29Obd0gpPfWc2uZCto0qSI8UsrGwGA/CfNlsdv6ZvLOx8JxJdRIY6T1U67oWMnn8l/XjuXsUej52BUszYu5Fwu79vkXUSAEBH3rqeSTjtHdN/J5w4SvdXLxhmU= spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: vectra.ai X-MS-Exchange-CrossTenant-Network-Message-Id: ba83aa9f-97c7-4bd1-1219-08d65ad4866c X-MS-Exchange-CrossTenant-originalarrivaltime: 05 Dec 2018 17:10:15.3518 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a6cc66bc-f419-45c2-a9c2-8ff4ab685f2d X-MS-Exchange-Transport-CrossTenantHeadersStamped: BYAPR08MB4309 Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Dec 2018 17:10:18 -0000 Thanks for coming back to me Stephen. I found the thread you mentioned and= will keep an eye on it. I'm happy to help out with testing the change. Gareth -----Original Message----- From: Stephen Hemminger =20 Sent: Wednesday 5 December 2018 16:04 To: Gareth Bradshaw Cc: users@dpdk.org Subject: Re: [dpdk-users] Hyper-V multi-queue not working on Kernel v4.20 On Wed, 5 Dec 2018 11:05:58 +0000 Gareth Bradshaw wrote: > Hi, >=20 > I'm developing a DPDK application for Hyper-V and would like to use Kerne= l v4.20 as it fixes a crash in previous kernels (per this pull request) but multi-queue support seems to have broken in that kernel. It works= in kernels 4.17, 4.18 and 4.19. >=20 > Using testpmd with parameters "--forward-mode=3Dtxonly --nb-cores=3D3 --t= xq=3D3 --rxq=3D3" I get the following error "vmbus_uio_get_subchan(): inval= id subchannel id 0". >=20 > Tracing the code a bit I find that it's trying to read /sys/bus/devices/<= devid>/channels/21/subchannel_id but when I try to cat the same file I get = the error "Invalid argument". I've compared to previous kernel versions an= d see the following differences: >=20 > * When the VM boots, the device is bound to the kernel driver and the= re are 4 channels on both kernel versions. It's a 4 core VM. > * When I bind the device to uio_hv_generic, kernel v.19.5 (and previo= us) has a single channel and it has a valid subchannel_id. On kernel 4.20 = the 4 channel folders remain but they are all invalid. > * When I start testpmd with 3 queues, on kernel v4.19.5 two additiona= l channels are created, they're valid and testpmd works as expected. On ke= rnel 4.20 the 4 invalid channels remain invalid and testpmd gives the error= I mentioned. >=20 > Any help getting this working would be greatly appreciated. >=20 > Thanks > Gareth >=20 >=20 >=20 >=20 >=20 >=20 There is a race that shows up in sub channel initialization, it is being wo= rked on the development mailing list. No resolution yet.