From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id D6BA2A052B for ; Fri, 31 Jul 2020 10:56:31 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 3BDF4276C; Fri, 31 Jul 2020 10:56:31 +0200 (CEST) Received: from mga14.intel.com (mga14.intel.com [192.55.52.115]) by dpdk.org (Postfix) with ESMTP id 35E523B5 for ; Fri, 31 Jul 2020 10:56:29 +0200 (CEST) IronPort-SDR: 8iQTUHgpvSPa1/LbgXTJq75bbeDLHtvnoHYfaA1kyyTsScv2yg7OoEcZiA0w7TZV2mNLpOZBvJ ZuNNqBIVPC4g== X-IronPort-AV: E=McAfee;i="6000,8403,9698"; a="150946155" X-IronPort-AV: E=Sophos;i="5.75,417,1589266800"; d="scan'208";a="150946155" X-Amp-Result: SKIPPED(no attachment in message) X-Amp-File-Uploaded: False Received: from fmsmga002.fm.intel.com ([10.253.24.26]) by fmsmga103.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 31 Jul 2020 01:56:28 -0700 IronPort-SDR: iZmJ7GLOJYcC+zb4tUbasi2SHHbAjpPgtqtVkYy6oz/HBj7hCRBfKnJwbVH0g84826uee5huBD K8HJ3PFFjR6w== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.75,417,1589266800"; d="scan'208";a="323175496" Received: from orsmsx108.amr.corp.intel.com ([10.22.240.6]) by fmsmga002.fm.intel.com with ESMTP; 31 Jul 2020 01:56:28 -0700 Received: from orsmsx610.amr.corp.intel.com (10.22.229.23) by ORSMSX108.amr.corp.intel.com (10.22.240.6) with Microsoft SMTP Server (TLS) id 14.3.439.0; Fri, 31 Jul 2020 01:56:27 -0700 Received: from orsmsx605.amr.corp.intel.com (10.22.229.18) by ORSMSX610.amr.corp.intel.com (10.22.229.23) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Fri, 31 Jul 2020 01:56:27 -0700 Received: from ORSEDG001.ED.cps.intel.com (10.7.248.4) by orsmsx605.amr.corp.intel.com (10.22.229.18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256) id 15.1.1713.5 via Frontend Transport; Fri, 31 Jul 2020 01:56:27 -0700 Received: from NAM12-DM6-obe.outbound.protection.outlook.com (104.47.59.174) by edgegateway.intel.com (134.134.137.100) with Microsoft SMTP Server (TLS) id 14.3.439.0; Fri, 31 Jul 2020 01:56:24 -0700 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JQZMVDOaRJrdlXNR9HzX30sUXbEzQ/CBfrZJrCk6orW1ui5JraglHIAVVs3ZzEhAGMt/E/L+QTNnxaqNHlU8En4oS5oPaOcpsDFDEbYuvHRcd9cI2iOoxDGni3AZxYAoWdREeaKiDqnX8P/HAz2SwGpZpF4NTdjJ53fsdj1SvaVKb3RjPN+VEMCkUPpzGcwMlBBCOrExLlT1UzrX7bVt8VEISj49nImGv+Wzlq0FBAp3s70jMiVatc5+kwMGZDNx1TBK0EDdPI83pcwMizwOcsnFhCzpqFnb66OuJvyiJk4+/Ihn28R1cGtNuGehVRgSYF6q30DjbpueB2nH3knwPg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eT5vZehjmpln0KTekjyd/e9+oazPhefXWsjMKSgRGkU=; b=Uf1CcvxBQm7tpsJ5QSPehBSvVJ03g4EydFGXvT2kneIc+UO9Yk0JvXt78tQ/ayewsFBV1Tphxgp2e7R6ZbPbDqrIkszoB0pcHMx/pUVLWW1X02ifwrZymud3XGfcT/m/jXcVxxBrB/cWUvq+kX39MpZd4953ihmH4Mrr73Q+4PZYj0pVFt68iv020zGOJ3H+lSw2FOPAFs6CQiXc0i8FuCdZJ5tH2rjajzuu4uc1wXAYX4NPYiAdMo+y3uvySYyboIl/RIEKvJYziOmokk1/Tl5L+1PmnwIBTvoGs0qiATb1TYEqnyzT2DIonuzu9Z9zr4rWqEHuDxh7gKOf/jpJKw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=eT5vZehjmpln0KTekjyd/e9+oazPhefXWsjMKSgRGkU=; b=WJ3mW/FyO9yFl5FmPaEmk6N+AOKpjEJdaT42wYpojBRezyHF/DviVLTtp3uYpu9L9Yj8RiIoQFPS3dekDDhGO4wItjafzBa5sA2PRR7EJzoHTHTiicJFa0LO+X9DBi4meYDi3wmEVu7KAKXhWlljVXZn/SAeLez6WNCv5gtc18c= Received: from BL0PR11MB3137.namprd11.prod.outlook.com (2603:10b6:208:73::20) by BL0PR11MB2964.namprd11.prod.outlook.com (2603:10b6:208:7c::28) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3239.16; Fri, 31 Jul 2020 08:56:23 +0000 Received: from BL0PR11MB3137.namprd11.prod.outlook.com ([fe80::f867:315d:a882:b6ab]) by BL0PR11MB3137.namprd11.prod.outlook.com ([fe80::f867:315d:a882:b6ab%6]) with mapi id 15.20.3239.019; Fri, 31 Jul 2020 08:56:23 +0000 From: "Van Haaren, Harry" To: Zhiyong Huo , "users@dpdk.org" Thread-Topic: dpdk sw schedule issue Thread-Index: AdZmHh1bsOk5Pa4VTvCNpTKMYm7+gAA+Dl4w Date: Fri, 31 Jul 2020 08:56:23 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-product: dlpe-windows dlp-reaction: no-action dlp-version: 11.5.1.3 authentication-results: SonicWall.com; dkim=none (message not signed) header.d=none;SonicWall.com; dmarc=none action=none header.from=intel.com; x-originating-ip: [87.198.126.230] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: b712d849-e1e5-43d7-ce1e-08d8352f99f7 x-ms-traffictypediagnostic: BL0PR11MB2964: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:5516; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: XPVKh4C1biySqQWZ76UVWbY7TESQ57+d75VasXwW8X/EtpVGUkfP+F/BBQxXhBGhwGe0E6U3oppwidIlpzNhDQbJKY8378ZMBn30ur5Imqcr0KfNidX/+ELXEQv71jvzMLSQ921Xzxa+p+mRo/qoS4ynq6rt4lv7l23F1E3mjg+hzPyfSVPJslYccQtS2u5WsFwFVHIlcUHW7R34UU3bjGwvFwnFR+vhrnCJuAC3zAQv7W/MtKYCy1OHNXvQlq/AY59Lrp/FpdoPgmUrjmzHTwLE78fw44VHCYcTYmLcFeb+qxrQed8gekXN+Pi5JZIRF8IRV2kK0uIJAfLU2V/eScXBEtVMX4Cb17S2Yme8xfZUjrNr7T1Ov7mdFXZyf8TlnzM7IiYxr47q7XyHPNCoYw== x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:BL0PR11MB3137.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFTY:; SFS:(4636009)(366004)(396003)(39860400002)(376002)(136003)(346002)(66476007)(478600001)(66446008)(64756008)(66556008)(3480700007)(66946007)(76116006)(83380400001)(966005)(33656002)(8936002)(52536014)(8676002)(9686003)(5660300002)(2906002)(86362001)(55016002)(7696005)(26005)(110136005)(53546011)(6506007)(186003)(71200400001)(316002); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: VOXjHP9/ed6YnA9pc04cxOAqKWrsybm/dVCjxmcQOKDaL2s6PoZggwQ7ATvzl+DjCUnEx6FvPozrlhClfvHiTKT4fIivD42C1IBpOP+V16dJJl3ylvbtYmlrd3KaDgT4gLRa1i1dWQtPdgGaRBiPZz8lI4T0jnBmxqMQF7JT9xGxygOF7vJqoSqKN0Ll3mTHx9Fo+Rf/2JwjmGPn9cpW09d6H/yqyAgN5QP2A4uO4ngbnGTgsGNoR3DH0iLjJhptk51BqRFPP+qvBzz9hUSGep2mwds+yWggTGPuUS1GA3OA5TFek7vZYIFr5GJ49JUie+qbI0vwrq2lP6pMWD3oX3pQZOKJ4MDp+3wj9urezYNetJqnpEw3fTtrNeNL5nHdTsFxVVni3/OB8i9ZAmyL6oCJwPPa6+jE6GPC1beQOIvzBF57Wqdo3Lc+eO8wOu/0NlfuKVbyq3vea71pTjludfJl7UeqWAndxIFcpxMb0791U67IFPcgmKF36LDfaF999Iz2sProw0j/010XS1mEOjUikWMGs5BORS1AtEaXi8mtNQAcHRJFUVdV+7z1Sk8W+lV1/p2SAFhMCOZYknV2e4FlTqgZvIgraOifLgV4NMQtxcohctJOOlf54YJKpC7i0FX1W58RAiJa82usPL0RSQ== x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: BL0PR11MB3137.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: b712d849-e1e5-43d7-ce1e-08d8352f99f7 X-MS-Exchange-CrossTenant-originalarrivaltime: 31 Jul 2020 08:56:23.3685 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: zNfH7OWVU9yjVqu3n3SlZOGxa/8siw8tI7VSG0Kab5i/nywQio6ujiUHoQlZSFOGzWAPpf8SqScI9ugr2U2wm/0ZyRrtyLX0LRFylhI8pcs= X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR11MB2964 X-OriginatorOrg: intel.com Subject: Re: [dpdk-users] dpdk sw schedule issue X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" > -----Original Message----- > From: users On Behalf Of Zhiyong Huo > Sent: Thursday, July 30, 2020 4:05 AM > To: users@dpdk.org > Subject: [dpdk-users] dpdk sw schedule issue >=20 > Hi, Hi Huo, > We used DPDK to do high performance gateway. > And we chose the event_sw scheduler to do the packet scheduler. > However, there were several issues. Would you describe your pipeline? Aka, what Eventdev Queues do you configur= e? (How many, and Atomic or Ordered?) > The gateway was set with 32 cores. > I did several test: >=20 >=20 > 1. One RX polling adapter and one scheduler. No service core, but 32 co= res to > compete the RX adapeter/scheduler adapter. > The performance was too low. You mention not using a service core, does this mean that the scheduler is = being run on a thread that is also doing other work? Best performance is often achiev= ed by giving a dedicated thread for the scheduling work in event_sw. > 2. Set multi RX polling adapeters and multi schedulers. > Get higher performance but not as expect. The results are not as you expect - do you mean that the packet tx order is= not identical to rx? That would be an expected side-effect of using e.g. RSS to spread work to e= .g. 4 NIC rx queues. Please describe what you are trying to achieve, and what was not as expecte= d in more detail. > For the scheduler logic, it seemed that the DPDK has very simple schedule= r logic. > Is there any plan or suggestion about the scheduler logic? The PMD is documented in the DPDK docs here: https://doc.dpdk.org/guides/eventdevs/sw.html The scheduling logic is based around Atomic and Ordered packet scheduling l= ogic. I'm not sure what you mean by very simple scheduler logic. > Thanks Regards, -Harry