From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from wipro-blr-out01.wipro.com (wipro-blr-out01.wipro.com [203.91.198.74]) by dpdk.org (Postfix) with ESMTP id E99F88E65 for ; Fri, 13 May 2016 08:44:14 +0200 (CEST) X-AuditID: cb5bdd57-f79816d000000d73-c2-573577bb9bc9 X-Invalid-Recipients: Received: from BLR-OUT-EDG01.wipro.com ( [203.91.193.61]) by wipro-blr-out01.wipro.com (Symantec Mail Security) with SMTP id EA.B0.03443.BB775375; Fri, 13 May 2016 12:14:12 +0530 (IST) Received: from BLR-EC-MBX3.wipro.com (10.208.51.113) by BLR-OUT-EDG01.wipro.com (203.91.193.31) with Microsoft SMTP Server (TLS) id 14.3.279.2; Fri, 13 May 2016 12:13:56 +0530 Received: from wipro-blr-tls01.wipro.com (203.91.193.64) by BLR-EC-MBX3.wipro.com (10.208.51.113) with Microsoft SMTP Server (TLS) id 14.3.279.2; Fri, 13 May 2016 12:14:00 +0530 Received: from APC01-HK2-obe.outbound.protection.outlook.com (65.55.88.209) by wipro-blr-tls01.wipro.com (203.91.193.64) with Microsoft SMTP Server (TLS) id 14.3.279.2; Fri, 13 May 2016 12:13:55 +0530 Received: from TY1PR0301MB1056.apcprd03.prod.outlook.com (10.164.96.139) by TY1PR0301MB1054.apcprd03.prod.outlook.com (10.164.96.12) with Microsoft SMTP Server (TLS) id 15.1.492.11; Fri, 13 May 2016 06:43:51 +0000 Received: from TY1PR0301MB1056.apcprd03.prod.outlook.com ([10.164.96.139]) by TY1PR0301MB1056.apcprd03.prod.outlook.com ([10.164.96.139]) with mapi id 15.01.0497.014; Fri, 13 May 2016 06:43:51 +0000 From: To: CC: Thread-Topic: [ovs-dev] Traffic scheduling by qos_sched library in DPDK Thread-Index: AdGs4hmnewDtaf61Q/uyh7SFOd6pHQ== Date: Fri, 13 May 2016 06:43:51 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=none action=none header.from=wipro.com; x-originating-ip: [125.22.10.137] x-ms-office365-filtering-correlation-id: eaae8e60-6689-4d03-d13e-08d37af9f22e x-microsoft-exchange-diagnostics: 1; TY1PR0301MB1054; 5:OdURH+UEJMTyaXK3b48QbOxEZB78ooyD2kA+klrykfg9feShl/oUG5giUhCQyoWjvn6QuyQQMRsX2/t9/KEtghhREWkI/LOOlRtxEj+ZRi5t7LuZlA9BxdOdvyioOSABxGrjPribRVn1KKXvzGHVuA==; 24:WTVTBU5CH/BnjhPX7TGrG+0PvLFxub8LceD/ILAS21MzWcZ1Kao6Vk/mp51+U5eNmnUzlu8F0wyUipooYsEufVrELOZbG9cG4iB4cqSPegE=; 7:Xnvsx/ro8IhtfsZU2dLd3Krso6dFKH4JHu3qERKpKjKOOD8crUwxansWiVptQObuflpx+x2xDUL578BAvjLa67T50PoUI3ZrU45+xfSCJl+a/vssi6h2+nD+LQLoj6F8/1pVTpSVzU8CEje9l0H+PesfEHjaNFeSjU0hpYKhlqOulZtWl5T4zKg1fLekBD5x x-microsoft-antispam: UriScan:;BCL:0;PCL:0;RULEID:;SRVR:TY1PR0301MB1054; x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:; x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(61425038)(601004)(2401047)(5005006)(8121501046)(10201501046)(3002001)(6055026)(61426038)(61427038); SRVR:TY1PR0301MB1054; BCL:0; PCL:0; RULEID:; SRVR:TY1PR0301MB1054; x-forefront-prvs: 0941B96580 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(6009001)(24434003)(87936001)(189998001)(110136002)(19300405004)(9686002)(5640700001)(5630700001)(92566002)(2906002)(9326002)(3280700002)(19580405001)(81166006)(2501003)(86362001)(66066001)(19580395003)(4326007)(122556002)(8936002)(11100500001)(1730700003)(16236675004)(5008740100001)(54356999)(50986999)(229853001)(2351001)(5004730100002)(77096005)(15975445007)(10400500002)(2900100001)(8676002)(586003)(102836003)(790700001)(5002640100001)(6116002)(19625215002)(3846002)(5003600100002)(33656002)(3660700001)(74316001)(1220700001)(76576001); DIR:OUT; SFP:1101; SCL:1; SRVR:TY1PR0301MB1054; H:TY1PR0301MB1056.apcprd03.prod.outlook.com; FPR:; SPF:None; MLV:ovrnspm; PTR:InfoNoRecords; LANG:en; spamdiagnosticoutput: 1:23 spamdiagnosticmetadata: NSPM MIME-Version: 1.0 X-MS-Exchange-CrossTenant-originalarrivaltime: 13 May 2016 06:43:51.6721 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 258ac4e4-146a-411e-9dc8-79a9e12fd6da X-MS-Exchange-Transport-CrossTenantHeadersStamped: TY1PR0301MB1054 X-OrganizationHeadersPreserved: TY1PR0301MB1054.apcprd03.prod.outlook.com X-CrossPremisesHeadersPromoted: BLR-HES-EDG03.wipro.com X-CrossPremisesHeadersFiltered: BLR-HES-EDG03.wipro.com X-CFilter-Loop: Reflected Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] [ovs-dev] Traffic scheduling by qos_sched library in DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 May 2016 06:44:15 -0000 Hi Team, I started working on implementing the QoS Shaping in OVS+DPDK by making use= of rte_sched library provided in DPDK. Meanwhile to compare the performan= ce, started performance test with DPDK sample scheduling application. Below= are the configuration details of system which I am using, Server Type : Intel ATOM Huge page configuration: (Each page of 2M size) [root@ATOM qos_sched]# grep -i huge /proc/meminfo AnonHugePages: 90112 kB HugePages_Total: 7168 HugePages_Free: 7168 HugePages_Rsvd: 0 HugePages_Surp: 0 Hugepagesize: 2048 kB Port Capacity : 1G (All four ports) I am able to successfully run the qos_sched with three pfc's as below, ./build/qos_sched -c 0x3e -n 1 --socket-mem 14336 -- --pfc "0,1,2,3" --pfc = "1,0,3,2" --pfc "2,3,4,5" --cfg ./profile.cfg Issue : When I am trying to add one more profile configuration flow(4th one) , I am= getting below error Command : ./build/qos_sched -c 0x3e -n 1 --socket-mem 14336 -- --pfc "0,1,2= ,3" --pfc "1,0,3,2" --pfc "2,3,4,5" --pfc "3,2,5,4" --cfg ./profile.cfg Error: done: Link Up - speed 1000 Mbps - full-duplex SCHED: Low level config for pipe profile 0: Token bucket: period =3D 1, credits per period =3D 1, size =3D 1000= 00 Traffic classes: period =3D 5000000, credits per period =3D [500000= 0, 5000000, 5000000, 5000000] Traffic class 3 oversubscription: weight =3D 0 WRR cost: [1, 1, 1, 1], [1, 1, 1, 1], [1, 1, 1, 1], [1, 1, 1, 1] SCHED: Low level config for subport 0: Token bucket: period =3D 1, credits per period =3D 1, size =3D 1000= 00 Traffic classes: period =3D 1250000, credits per period =3D [125000= 0, 1250000, 1250000, 1250000] Traffic class 3 oversubscription: wm min =3D 0, wm max =3D 0 EAL: Error - exiting with code: 1 Cause: Cannot init mbuf pool for socket 3 Analysis: I have analyzed DPDK source code to find the root cause. I could see that i= n qos_sched, memory allocation while creating each mbug pool (rte_mempool_c= reate) for corresponding RX port is as below, MBUF_SIZE =3D (1528 + sizeof(struct rte_mbuf) + RTE_PKTMBUF_HEADROOM) mp_size =3D 2*1024*1024 >>From above I understood that, for each pfc/ rx port around 4G of huge pages= are consumed. Whereas ATOM is capable of maximum 7168 huge pages of 2M whi= ch is 14336M in total. So I am not able to configure beyond three pfc's. Bu= t I would like to measure the performance with 4 port & 6 port scenario whi= ch requires 4-6 pfc's configured. Is there any other alternative through which I can configure more number of= pfc's with my system configuration provided above. Thanks & Regards, Gayathri The information contained in this electronic message and any attachments to= this message are intended for the exclusive use of the addressee(s) and ma= y contain proprietary, confidential or privileged information. If you are n= ot the intended recipient, you should not disseminate, distribute or copy t= his e-mail. Please notify the sender immediately and destroy all copies of = this message and any attachments. WARNING: Computer viruses can be transmit= ted via email. The recipient should check this email and any attachments fo= r the presence of viruses. The company accepts no liability for any damage = caused by any virus transmitted by this email. www.wipro.com