From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM02-BL2-obe.outbound.protection.outlook.com (mail-bl2nam02on0082.outbound.protection.outlook.com [104.47.38.82]) by dpdk.org (Postfix) with ESMTP id B072C4A63; Tue, 2 Aug 2016 17:26:08 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=casasystems.onmicrosoft.com; s=selector1-casasystems-com01b; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=x+X3CsRHWErjvlIiE/677hUkAvfuyi3SkbDaeoGkvIY=; b=tlAMmqOjvO7UdUocsEGRdxlZKO9bHBxEBcP9L2O/rT5EZDRKaCENHcreBHD6gPuTxwdJZdskGuwwZ8p7i097+h4jFXLH/2o3n7BoEHICTOE51UWrW3pEHI06V+dIzAsAuAzQKxMf0eGGU+jDjn360I1uIk7I2q4tUMllxsu6MLQ= Received: from BLUPR06MB611.namprd06.prod.outlook.com (10.141.207.25) by BLUPR06MB612.namprd06.prod.outlook.com (10.141.207.26) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.549.15; Tue, 2 Aug 2016 15:26:06 +0000 Received: from BLUPR06MB611.namprd06.prod.outlook.com ([10.141.207.25]) by BLUPR06MB611.namprd06.prod.outlook.com ([10.141.207.25]) with mapi id 15.01.0549.022; Tue, 2 Aug 2016 15:26:06 +0000 From: Yuyong Zhang To: "dev@dpdk.org" , "users@dpdk.org" Thread-Topic: how to design high performance QoS support for a large amount of subscribers Thread-Index: AdHsy9qOZIKKBTHaTcy6xWj03wy3owABeiFA Date: Tue, 2 Aug 2016 15:26:06 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=yuyong.zhang@casa-systems.com; x-originating-ip: [50.252.238.165] x-ms-office365-filtering-correlation-id: a1e822b6-cf90-48a3-c980-08d3bae95295 x-microsoft-exchange-diagnostics: 1; BLUPR06MB612; 6:bl+qicTRNLXbW2Ay7H27821G8YXs6r94aCEibQaP0SNlKWRrWSdATwC1lOaTmyBejunsTy61C6RStxgK+KeA/sNZFcVFVcBS1i2UVkSVFRBVNwV26ZbhJmjTIPRcKp8FvGesNP4ZF0+qcCttMgW8DO5PjPXSRbn/6Hfwn+HzR3UEGbGIjczUCjnvLiBLjChpPXUa+o+pUgyZpunXDc9ehXc6c2MXqmkYRuT2mHGtFDd64cLMB5mSwQg42DVq2vP6KPFKhuxVYAdD0FyO7LT0xY7p7Dig294T+o1BKXt+4ss=; 5:s/PQ+cXEFM9sCbL4ZSBxI6i5O4F5mrFYFWXFyLgsVmmgA2ybOUOQf/3FB38FvREYNmQwWKs0TLixJloI9LFqOoKf23OpwuxjwZ+9wPfX7LKMbMqc1h8oHX4tbSfql28vKnTPlSZgszn9TIuxOcRhYw==; 24:VhQZB6JXsJQBYml+0C3M5RIr2bIzv6nN8NR7erFDQinpLTMHTiUhMDMWEX6967FICQ0627v3fLYv4pgESIO7fgWPZ3by/P13svCzQvWUpCw=; 7:tAir7bJxO8oOzw71IHY6XSsiZV/ea4kezkQUrl/RTQ0Ul3Bbqag+aqKVsZkigDmDYU4NE0y7MaAWZc+qv7fN4g6H2yJ2gmgGhjmovUP1x4fBDtMjWfUtL1ms/rpJcMGLfZ9ughjkWWnENeXIK0HhEhIRXBr1W4N64X6aBtZ93AiUy1vgKxqxsyTqSgdPJvuM85rTSaQePsUh5v0uw8MtGkdTqqoiGKmGpKxOI16WhOqAy4zoguqq7lCRoceLBte0 x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:BLUPR06MB612; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(21748063052155); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(601004)(2401047)(8121501046)(5005006)(3002001)(10201501046); SRVR:BLUPR06MB612; BCL:0; PCL:0; RULEID:; SRVR:BLUPR06MB612; x-forefront-prvs: 0022134A87 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(7916002)(199003)(189002)(101416001)(99286002)(554214002)(19625215002)(66066001)(86362001)(19300405004)(92566002)(50986999)(106356001)(16236675004)(54356999)(33656002)(122556002)(450100001)(76576001)(229853001)(2501003)(11100500001)(81156014)(3280700002)(2900100001)(3660700001)(7696003)(7736002)(8936002)(9326002)(7846002)(107886002)(68736007)(5001770100001)(87936001)(189998001)(105586002)(5002640100001)(77096005)(81166006)(2906002)(74316002)(15975445007)(8676002)(102836003)(790700001)(6116002)(3846002)(586003)(10400500002)(19580395003)(97736004)(9686002); DIR:OUT; SFP:1101; SCL:1; SRVR:BLUPR06MB612; H:BLUPR06MB611.namprd06.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; A:1; MX:1; LANG:en; received-spf: None (protection.outlook.com: casa-systems.com does not designate permitted sender hosts) spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-OriginatorOrg: casa-systems.com X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Aug 2016 15:26:06.2804 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 17b16a32-cb34-482f-946d-8a975023450e X-MS-Exchange-Transport-CrossTenantHeadersStamped: BLUPR06MB612 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] how to design high performance QoS support for a large amount of subscribers X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Aug 2016 15:26:09 -0000 Hi, I am trying to add QoS support for a high performance VNF with large amount= of subscribers (millions). It requires to support guaranteed bit rate for = different service level of subscribers. I.e. four service levels need to be= supported: * Diamond, 500M * Gold, 100M * Silver, 50M * Bronze, 10M Here is the current pipeline design using DPDK: * 4 RX threads, does packet classification and load balancing * 10-20 worker thread, does application subscriber management * 4 TX threads, sends packets to TX NICs. * Ring buffers used among RX threads, Worker threads, and TX thread= s I read DPDK program guide for QoS framework regarding hierarchical schedul= er: Port, sub-port, pipe, TC and queues, I am looking for advice on how to = design QoS scheduler to support millions of subscribers (pipes) which traff= ic are processed in tens of worker threads where subscriber management proc= essing are handled? One design thought is as the following: 8 ports (each one is associated with one physical port), 16-20 sub-ports (e= ach is used by one Worker thread), each sub-port supports 250K pipes for su= bscribers. Each worker thread manages one sub-port and does metering for th= e sub-port to get color, and after identity subscriber flow pick a unused p= ipe, and do sched enqueuer/de-queue and then put into TX rings to TX thread= s, and TX threads send the packets to TX NICs. Are there functional and performance issues with above approach? Any advice and input are appreciated. Regards, Yuyong