From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by inbox.dpdk.org (Postfix) with ESMTP id 45B0F42F6C for ; Fri, 28 Jul 2023 16:21:28 +0200 (CEST) Received: from mails.dpdk.org (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id C2E0D40685; Fri, 28 Jul 2023 16:21:27 +0200 (CEST) Received: from mgamail.intel.com (unknown [192.55.52.93]) by mails.dpdk.org (Postfix) with ESMTP id 40C0A4021E for ; Fri, 28 Jul 2023 16:21:26 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=intel.com; i=@intel.com; q=dns/txt; s=Intel; t=1690554086; x=1722090086; h=from:to:subject:date:message-id:references:in-reply-to: content-transfer-encoding:mime-version; bh=F1l+cd9mHXNsEGU5IfX4a3D/vwT0k0D+LIs9w0CkuQU=; b=E9e/AjiiMgBhcd+XWzj+zMVt6vLiTgb/jGg2YgytMRS1YPkYiM1UYPa5 hdxbeCEYSCG0R4nKDhVBsgSqvzalf/TmeAgaq8VW+XsPP3o+a/onoXCBf +zj13Q62XRlKB33g13SsStB8/c2UMChy+1+juU706dTE93gvtV8Q6jjGj zt4pneqhwcPOJd1ziQNkLg8ZAVJzhQRuLfXPKuXMBIredDFZDLCm9DedZ Ux4O+hd8zXe8/+g3wPMk742QhCtBGztPDFSxJAnpgd6RdZiIPsJ2L3TIc 5s6PWYYUqvxVHfuEriqYwHG7rn0Ys80Q/ATILCvarIAn23qYfZy9NdzEe w==; X-IronPort-AV: E=McAfee;i="6600,9927,10784"; a="366063777" X-IronPort-AV: E=Sophos;i="6.01,237,1684825200"; d="scan'208";a="366063777" Received: from orsmga004.jf.intel.com ([10.7.209.38]) by fmsmga102.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 28 Jul 2023 07:19:29 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=McAfee;i="6600,9927,10784"; a="851238865" X-IronPort-AV: E=Sophos;i="6.01,237,1684825200"; d="scan'208";a="851238865" Received: from orsmsx601.amr.corp.intel.com ([10.22.229.14]) by orsmga004.jf.intel.com with ESMTP; 28 Jul 2023 07:19:28 -0700 Received: from orsmsx601.amr.corp.intel.com (10.22.229.14) by ORSMSX601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.27; Fri, 28 Jul 2023 07:19:28 -0700 Received: from ORSEDG601.ED.cps.intel.com (10.7.248.6) by orsmsx601.amr.corp.intel.com (10.22.229.14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2507.27 via Frontend Transport; Fri, 28 Jul 2023 07:19:28 -0700 Received: from NAM04-DM6-obe.outbound.protection.outlook.com (104.47.73.40) by edgegateway.intel.com (134.134.137.102) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.2507.27; Fri, 28 Jul 2023 07:19:27 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=SAedQbmUsXpZyngXYW2lmBFOe81OOksbhjdc8oXCcTD/n0mQnq8TCGSYD9H4AYovPV9u3STCzxkbAX9uN5SV4fkIi3jv4YpDxqxheVJzfb6n+p1jZpCmMrng2sMgxJS7AAfQaxGUvY35vttNwTjkX+sYOjUHmYk8lk+5TqQAePCzDM5msHOtibqcIGA0iCGjmBe9mqgCJFvBytCOPfV2I1gHJ1SaUs9EjV4qO0QhJlA6fzFtHtefvapDEKiHktiUE6za4NjqAWmmGpC4EoY74gzVKd5pdwE+r4zKqPg40o6aKJYCV6be+PgivjFYf2c7jLlGo9n+o48slzdWo7yThw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=gfFXbf+/QYbJ5aC2OWaNGOZeFPXezJ0YjLZrDO8Kv/8=; b=Bb6thXhRwH8/mcXNf9WH/moecsm1ZOJ7wji0hpDJ5K6PQi0Jhfn2NYzv1tJv/JDCtKL/1N7hXlTU57xYnKxDuCCIgspdgoAUyLD1mqHdst8P2UPGXIJ4p0aK9r5oIOFn81vfnbYxu7wDQUbATSb0zEtcGTbDU2pJi1FeZq5iy3a48x3nR5qoOmfFbTQpgbZc1lDJCXFk73kybdd3B7fxgpuQ+7/XIfRilJwKuSLfo/LMdJmYhkqd9BAL9Qy5tTLUfdvzs6B2OvFsXi3AGujLKydWlBvZOk0bAiI4oKCEgpb/aLfe1hWjczUUwxXZIiEixMmNekCcvbue9UU+T1XX8g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none Received: from PH8PR11MB6803.namprd11.prod.outlook.com (2603:10b6:510:1cb::12) by SJ0PR11MB4879.namprd11.prod.outlook.com (2603:10b6:a03:2da::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6631.29; Fri, 28 Jul 2023 14:19:25 +0000 Received: from PH8PR11MB6803.namprd11.prod.outlook.com ([fe80::d53d:d7bb:2317:c778]) by PH8PR11MB6803.namprd11.prod.outlook.com ([fe80::d53d:d7bb:2317:c778%5]) with mapi id 15.20.6631.026; Fri, 28 Jul 2023 14:19:25 +0000 From: "Van Haaren, Harry" To: Matheus Stolet , "users@dpdk.org" Subject: RE: Supporting RSS with DPDK in a VM Thread-Topic: Supporting RSS with DPDK in a VM Thread-Index: AQHZwV0xlmMZzOGwNUi4FfKWzMpPBq/POJ5w Date: Fri, 28 Jul 2023 14:19:25 +0000 Message-ID: References: <4c9482cb3259f1e75e19a5724a67ea8d@mpi-sws.org> In-Reply-To: <4c9482cb3259f1e75e19a5724a67ea8d@mpi-sws.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=intel.com; x-ms-publictraffictype: Email x-ms-traffictypediagnostic: PH8PR11MB6803:EE_|SJ0PR11MB4879:EE_ x-ms-office365-filtering-correlation-id: 2ef93424-2858-47f1-19c0-08db8f75a55f x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: SB7yp9F4Al+6eFUesH6xWv7dz12U1A6yReXq7lZnGqHrArkhZwVd3RDq4FGlPyqbODSLmjUDs6z7R/Ud3Q7iu+3zcomQduNdhlsVIDdaDkDm9Pldarq+OjmlKnSlin8oiyDyNxR4sxfBWsgEpdGXQfp0jwDoZ+rQ1BHso1yy18BW1kJjUMoxOLRsGQFK53ReTjJIJZsg95X43vRXfOu9iw9HfvQtXTDgZkliLDvkurlCDP/lnBmuTVdqbWbG8E6+mgp36o8Y4FvgqFq/FT4g6SJ2xvoK5f76Lv8E176Ims7EoSjPaNtw3NxDgSCrJw5xucBTpj8jC3MDMVHotAk98+iwHSeClsPGM0CW2BZ0dvzEGz5jlLiYp6+ty3oZ+1F0PgVn9Hxzzv8m4gB3LLJ1LiCfewN2RvbThX5N73W/0aH3XQOH4rhTzcpzIrJ9Vvq0TF1jBeb8HhTn1b30Ib3AFWqrRr+JsodykYBXCDzJuUNSt2LZRr6f+tBX7hv9J3zph8nAem/zPs8rEF/v42pQ9l9nxSevUetGwMjOB0lDYYnX7+vKVVw/j/+u+TD68speG1tqsDhWISzkWHyu1biY4BXRKDUaKOKHqVE9iOUZR/E= x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:PH8PR11MB6803.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(13230028)(136003)(376002)(396003)(346002)(366004)(39860400002)(451199021)(7696005)(71200400001)(26005)(9686003)(6506007)(478600001)(82960400001)(122000001)(110136005)(53546011)(186003)(83380400001)(38100700002)(66476007)(64756008)(66946007)(66556008)(66446008)(76116006)(5660300002)(52536014)(8676002)(8936002)(38070700005)(33656002)(2906002)(41300700001)(316002)(86362001)(55016003); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?us-ascii?Q?vMDRi7YbefEYJLfCAv9KYH6CjRZMhkm9c2Cym65D+ASrZ4f/AGNA6kvlaDjO?= =?us-ascii?Q?MjP3/Y2cm807Od4uegp6iec/IQBdJyUlqA1VmoaBka1no6dxGYDhyKG7H81D?= =?us-ascii?Q?m0BlO33li7gCUoRAedgQKKvKxYS+EdkTvafnclvKZMZA7BWWRvaPJv7I6Mk0?= =?us-ascii?Q?L3PlOCuG68BBmfaDAwRQCGtE8PuXq+zdkzV7JX4XoiLMXHxflDj4/7L6cYGK?= =?us-ascii?Q?jQKi2Ak03171t5biIv8FMmVU/ZylwCsoLg/JT986DMM3gIyWrM9qZ61H8i4q?= =?us-ascii?Q?Ft69rrL0nuhAXzkeCMLQyWhEScgXhrpNRL/+DLCuRaGhLKkYx4EiXDxdJK8A?= =?us-ascii?Q?T8AnpOn9BBLPCmmOwC4k1FTk+ICDi40jLOjI5e0CifiZx4NxM9CVs8+1KTmQ?= =?us-ascii?Q?zGhznrKS6VRLhJfnZ8efrR1msiNvHE6KD/IWNOv4d11wdG53BffK+muVXj60?= =?us-ascii?Q?21O6x+glDnlfdyaIk/ZAcu7jRpwwb5qCAHfLcV0pJcvJwwLTbmV+hbXtvrIF?= =?us-ascii?Q?+ta3SVxYwh2jAaC769N2k3xVtInfNepYfaw0R85m95fRaTHoFOX6bszHSus/?= =?us-ascii?Q?6Gvs44oPZw6r8hyIWVK7NOe+lIbxzMtAhcP88aqQJ0RRF7iyBXfdAkEwYlRL?= =?us-ascii?Q?SJw8f8Ui9upC/Wnu2MxEiI6+hFEcuBNpLCn/87T9V2+jlnky0hnBUN0NKMV4?= =?us-ascii?Q?5ZhKEAb5yiEjl5VzfTM5I6ZOMIFBmvOsoPmjlGWZhQcmG0gHBYQPehQ+5LKv?= =?us-ascii?Q?C1uLY/CzCpSl/h/V1aB8MS2V2Q433ovqbMqWshhb2gQd/LGK8XVxc+AF/ex3?= =?us-ascii?Q?gRmKxlaxW0hLAisRdbwQBO1LVYmsJ2du08eObbTXFATW5K5QvT092T1wfpdv?= =?us-ascii?Q?LWwDyF2D3CWuoahmpWFigxEmgE3zqDLGCgb+cdqu9LpbcAYQOxB/Jv7FTvfu?= =?us-ascii?Q?H/b4OvVzl5oJp3/CwLpVFoDslHtiQEqKy5hc9sBTkHUgK7Ab+wvdkaxBu26M?= =?us-ascii?Q?VFQ+oE6hAWBlHNVJ5J5V0g5JjNpZuPtvE5S7xMok01Tyzp1OgO3ipmbwqPdR?= =?us-ascii?Q?N55DWcCd15UfmT+L0ItzIPPCA5y7ade9Ytlk3LlaVKsY1aFZsd02NcTTzke9?= =?us-ascii?Q?2IB5+GLkuAv+OQElp3CFG3IloxZ5fnaXRa7msUP1KjZoX8H6EOEtWC9OQAwX?= =?us-ascii?Q?NsxhLldrOdfxQCfIl7XdtULdQ+v6T0bMzLCofhiXSImNymACCe7zttlZzo7l?= =?us-ascii?Q?8nAvhyviIDoBtxb9AvVyYiMG9vSTWQSHQKvfztGrPQYFTvyi4jVjgibmhN8F?= =?us-ascii?Q?MzYhNJ/vnlMS+sOZL/6vzHCF7G3YJhiZ9nkhLyoMSgZ/h9ysMWpbS6ZC46SJ?= =?us-ascii?Q?BPR5tLW01IFrKXdSvt64VQTWuEQbHHPAOYMQaptRhuse4Lo3MNNm5YYKtIEv?= =?us-ascii?Q?5ESuYisyMhb7/gbNsJufIh+SVMnxDgk6WtZRF4P+f0kBxrTifvjFoek2i0vM?= =?us-ascii?Q?EZ5gM/wwB3KN9mmXTbsVabDuM3nFA098eL7JLF8uI1MDhjC1r1cxYeKA/v6v?= =?us-ascii?Q?eMvimsTbcC4OJFb/UFVjusZidsYwbmxx1t9Dmzis9X5eQEyxjjF55b68gz+R?= =?us-ascii?Q?pA=3D=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: PH8PR11MB6803.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2ef93424-2858-47f1-19c0-08db8f75a55f X-MS-Exchange-CrossTenant-originalarrivaltime: 28 Jul 2023 14:19:25.1019 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: anGBYi1k2YoZWqgfvxqhtAhrkP+Q6lLi9sYBkWdW1FA+blU1Fq7rnjqY5uWrKqfXyODONFYGVDVYTY4IZ8bN79TLzPyKlGQLi/EEXqo21Ow= X-MS-Exchange-Transport-CrossTenantHeadersStamped: SJ0PR11MB4879 X-OriginatorOrg: intel.com X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org > -----Original Message----- > From: Matheus Stolet > Sent: Tuesday, July 25, 2023 11:59 PM > To: users@dpdk.org > Subject: Supporting RSS with DPDK in a VM >=20 > Hello, Hi Matheus, > I am trying to run a DPDK application with RSS enabled so that I can > have multiple rx queues. This application is running inside a VM. This > VM is hosted by QEMU using KVM acceleration and OvS with DPDK and > vhost-user are used in the backend. So to clarify things there are two > DPDK portions to this. The first is the DPDK portion used by OvS that > bypasses the host operating system. This is working fine. The other is a > DPDK application inside the virtual machine that will bypass the guest > operating system. This is where I am having trouble with. >=20 > When I set rte_eth_conf.rxmode.mq_mode =3D ETH_MQ_RX_RSS in my applicatio= n > I get the following errors: > Warning: NIC does not support all requested RSS hash functions. > virtio_dev_configure(): RSS support requested but not supported by the > device > Port0 dev_configure =3D -95 When OVS sees multiple queues negotiated on a vhost port, it will transmit = packets to them. Depending on the "pmd thread" count in OVS, the mapping will be diffe= rent, but for best performance it is recommended to match the number of virtq's f= rom the guest to the number of OVS-pmd-threads on the host. > I setup my VM in QEMU to have mq=3Don and queues=3D10. I also set the num= ber > of rx_queues when creating the vhost port using ovs to 10. Before > binding the interface to DPDK, I used ethtool to verify if the network > interface was actually setup to have multiple queues. >=20 > Running the 'ethtool -l enps02' command yields the following output: Once you've bound interfaces to DPDK, ethtool no longer works, and any configuration is reset to when DPDK initializes the port. Ethtool cannot inspect DPDK ports/applications. Although this mailing list will likely have experience, the OVS mailing lis= t is likely a better location to discuss OVS/DPDK/VM performance (I think you've posted there before). Hope that helps, -Harry > Pre-set maximums: > RX: 0 > TX: 0 > Other: 0 > Combined: 10 > Current hardware settings: > RX: 0 > TX: 0 > Other: 0 > Combined: 10 >=20 > From my understanding the combined values indicate that the interface > was properly setup to have multiple queues, so why am I getting the > unsupported RSS error? Are there other configuration steps that I have > to take to get this to work? Is RSS with DPDK not supported at all > inside a VM at the moment? Perhaps the "Port0 dev_configure() =3D -95" > error means something else? Without the receive side scaling turned on > my application is not able to achieve the desired throughput and won't > scale when I assign more cores to the application. >=20 > Versions: > VM > DPDK: 21.11.4 > Kernel: 5.4.0-148-generic > Distribution: Ubuntu 20.04 >=20 > Host > DPDK: 21.11.4 > QEMU: 8.0.90 > OvS: 3.0.5 > Kernel: 5.15.111.1.amd64-smp > Distribution: Debian 11