From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 94017A04B0 for ; Thu, 10 Dec 2020 11:29:46 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 04AB0BC8A; Thu, 10 Dec 2020 11:29:45 +0100 (CET) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by dpdk.org (Postfix) with ESMTP id 97EBABC86 for ; Thu, 10 Dec 2020 11:29:42 +0100 (CET) IronPort-SDR: fxo5oJbazLjO1D90xy4HkM8Kxyy74hLSHrCByGpaplYIt8WNOojIm87cQaJWPo0wtDc3baWPyl Vjgy1cVtNj6w== X-IronPort-AV: E=McAfee;i="6000,8403,9830"; a="174377283" X-IronPort-AV: E=Sophos;i="5.78,408,1599548400"; d="scan'208";a="174377283" Received: from fmsmga001.fm.intel.com ([10.253.24.23]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 10 Dec 2020 02:29:41 -0800 IronPort-SDR: lPBrRc9p6xRwkPOQa64lVH+4OUXoRXeefaihLQgn6tvTTZd3Cux/F5dkN0QTLnxiXN8NGcX1oY h9/VzU6lgMUg== X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.78,408,1599548400"; d="scan'208";a="438286547" Received: from fmsmsx604.amr.corp.intel.com ([10.18.126.84]) by fmsmga001.fm.intel.com with ESMTP; 10 Dec 2020 02:29:40 -0800 Received: from fmsmsx607.amr.corp.intel.com (10.18.126.87) by fmsmsx604.amr.corp.intel.com (10.18.126.84) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Thu, 10 Dec 2020 02:29:39 -0800 Received: from fmsmsx606.amr.corp.intel.com (10.18.126.86) by fmsmsx607.amr.corp.intel.com (10.18.126.87) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5; Thu, 10 Dec 2020 02:29:39 -0800 Received: from fmsedg602.ED.cps.intel.com (10.1.192.136) by fmsmsx606.amr.corp.intel.com (10.18.126.86) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.1713.5 via Frontend Transport; Thu, 10 Dec 2020 02:29:39 -0800 Received: from NAM04-BN8-obe.outbound.protection.outlook.com (104.47.74.49) by edgegateway.intel.com (192.55.55.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.1.1713.5; Thu, 10 Dec 2020 02:29:38 -0800 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=mGbyrq0XmdcSkcSPwicTiy4TL/b7uEXNeRFtcBKyuF2KHRc44659hc9KpCaB/6huAqV/moFf7Yfqh9TjeJeZgg4W0nzx0R9jBaTYw8L411O7V39vH/AuXlM5EMV0d73LLJ09tVm1vhJsvC7w/tCebk5XQfd2slvz3QZphx5dPZHDDgMFG/gf+cthlkaWTO/aybKAwmxZb0XrFH31IZkGgplpPK1xT/uYxs9WtVS89qxfi7oI5jPw4XI8B6ounsSYjRnUFAdc96WSXRARiLF8qdhkq3n+CTNlQiwNq5Ktp/RB1SoIuHYURefaj+l44XqSr5XSFMzFjz5VW9+Ci1+b/g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ysoCDbaPHuiYUzKjTO8Q+3vQZbZ1NUCWN9SXLdsyVfo=; b=Wdd8ldUJ6Uh65P2qgT2NA+KJzzxI+csUTxxqfb7e4/WH3dsvTqCten4vHrKdSgsy+U7xzqFh2OeglxwYl2T4vi5hMbKkbbmo12bRsrY+RqooEXUPcJnczhVfLExoAKVQOhwxujmlTEb4nebA/FhJxz2+1q0M9M5NIMtkXnNILc4r1rz7Mf0mzXUqHcysb3gX0fVnpbhpRuXkdWNcRELbazazU+AkFTljbGgQrOuJE6c6m8p1/AnQs70OQEL6cuHTHAqGHO7y9OAC5Pwripb/FeX44l8ZCk1r8nCfaWUK9A0SXDWFWZkcCtryFH8SIYptDOpLUAH20dAORl2HSQyDoQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=intel.com; dmarc=pass action=none header.from=intel.com; dkim=pass header.d=intel.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=intel.onmicrosoft.com; s=selector2-intel-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=ysoCDbaPHuiYUzKjTO8Q+3vQZbZ1NUCWN9SXLdsyVfo=; b=o7P7R5am+K0kq2EtlGbbea3xE8qdh4CH4v3sBXjwc5W6FtIcDu/F9Onn28NeuUuyWZdw2ol0t9RiI/rVDpRW8p4bHecW9XuGhzcGcaGkMzwwSRA3a8qAxB2jpbTnFbiE7POd9PCWOImdxBxNcpKUhUw1Pt07K+FacgwpPO+JXnY= Received: from CY4PR1101MB2134.namprd11.prod.outlook.com (2603:10b6:910:19::22) by CY4PR11MB1863.namprd11.prod.outlook.com (2603:10b6:903:121::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3632.17; Thu, 10 Dec 2020 10:29:35 +0000 Received: from CY4PR1101MB2134.namprd11.prod.outlook.com ([fe80::381c:9714:7da:2490]) by CY4PR1101MB2134.namprd11.prod.outlook.com ([fe80::381c:9714:7da:2490%4]) with mapi id 15.20.3632.022; Thu, 10 Dec 2020 10:29:33 +0000 From: "Singh, Jasvinder" To: Alex Kiselev CC: "users@dpdk.org" , "Dumitrescu, Cristian" , "Dharmappa, Savinay" Thread-Topic: [dpdk-users] scheduler issue Thread-Index: AQHWwma01f6IUuRnnkCT8HaMzRCz9anY89QAgAL0SYCAD43DcIAAEa4AgAALrQCAAFnsAIAACYtggAAF4oCAAAQe4IAABR4AgAANsQCAAACCgIAABZzogAASWQCAABxVAIAABHvDgADO4gCAACkegIABmHmAgAFcUkA= Date: Thu, 10 Dec 2020 10:29:33 +0000 Message-ID: References: <090256f7b7a6739f80353be3339fd062@therouter.net> <7e314aa3562c380a573781a4c0562b93@therouter.net> <4d1beb6eb85896bef1e5a1b9778006d7@therouter.net> , <49019BC8-DDA6-4B39-B395-2A68E91AB424@intel.com> <226b13286c876e69ad40a65858131b66@therouter.net> <4536a02973015dc8049834635f145a19@therouter.net>, , <4e5bde1cf78b0f77f4a5ec016a7217d6@therouter.net> <5FD54115-155E-4492-B1D6-041C8782BB8E@intel.com> <33e4de48a732dc6d3c8ec24353b03348@therouter.net> In-Reply-To: Accept-Language: en-GB, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: dlp-version: 11.5.1.3 dlp-reaction: no-action dlp-product: dlpe-windows authentication-results: therouter.net; dkim=none (message not signed) header.d=none;therouter.net; dmarc=none action=none header.from=intel.com; x-originating-ip: [109.77.241.46] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 38af42fd-83fc-41c7-4a4c-08d89cf67c7f x-ms-traffictypediagnostic: CY4PR11MB1863: x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:2733; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: ozVcoBwFgy9yz4PScmCZtqwBK6tBGvj6VDbGxmvOsuFjLsfHPkjNc6KF3jYSP9B7mWyjM5Iih564BTVaZamBjpyMAAGX0jRVyLdoLUf8BUOzjXEgROvQ+Yh36g/g0zrzOFh96+XggbuQqgA2WW8iddRY375CkyrSWw+SNnMcUpjfowludbA/0PkyTwxDLPFTDZKTv3W61POD5NuNreEvpo3HMa2c9cXFf0YyOsemGJWhIc87OQ9F9L+kF6jxkD8g6xoHqPvlOk97vud4w2UVTYugNNOTDkTUSCC0wDd18ZvgErmDG5CudULzR6LyMCaH x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:CY4PR1101MB2134.namprd11.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(376002)(346002)(366004)(136003)(107886003)(54906003)(6506007)(186003)(86362001)(2906002)(6916009)(8936002)(53546011)(7696005)(66556008)(8676002)(9686003)(55016002)(508600001)(26005)(4326008)(64756008)(66446008)(71200400001)(66476007)(66946007)(52536014)(33656002)(76116006)(5660300002)(83380400001); DIR:OUT; SFP:1102; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?9r6EwBHt6aGHdp0YhQ0zWKjgqFbRfse918pJXEUeMFDtvQtedAe2wROydUus?= =?us-ascii?Q?09P+yJT18huy8MBs3rZHDputwtD1fqz9CCwnLp3TnWhlBuHp7IPU5LIYj1rE?= =?us-ascii?Q?EpcFG/FT/GW+6L2tuTJFaSEKp2ozjcOG8w1Lxcg99vhzF6MIu0yXVAdZ1NyP?= =?us-ascii?Q?VIA4PpvPtMp9Kc7DJ8Cip+Jju+g1bIIXV8BsXbkl/uTEadgfaiglMcIVbrZH?= =?us-ascii?Q?622evXW1gjHTYgOmWPw0MyGpF2DyNTZwvZhvkY3KeeS6plRWBEpOeIHN1HsQ?= =?us-ascii?Q?HUao2E1PEmwESarMKLkaQKgwWk34dHyhTXmT3d79EASz70GG795EjKmYacZF?= =?us-ascii?Q?O9pBuyMGYbv8s8yFZ2qzAuOMJfDRX/6LTQgP7VJf7pMnr6iKi9HQxsjTrimu?= =?us-ascii?Q?wzzFv08fBktbSxa5CW5DBbXcoslOKNjC5MPPWeTvVr5OVCP4HiexR7yDx237?= =?us-ascii?Q?iOAB+YH0sOmq1hvJak05kV6H3Ci5nDbOOd4kuXnRN9wI4jitTpmKM/L9xoFP?= =?us-ascii?Q?6Ah8DxJCJJzm7yv5oStHrUo+79BvEQPX8FCAfZHqAO8qWE/MEPr514Iu+K38?= =?us-ascii?Q?pafzSDe+UlHNf0IWdKFW7DKOWvz+xMJa73TzA176x/youDy1sTX3djopGaSW?= =?us-ascii?Q?zlx47TYa6ERVUr1vgVwvU2yLCjldfk0Hb5RGlGuZqor+fJ90uQvCWABujLa9?= =?us-ascii?Q?yzkZf0RULXqfhr8lbY3VnI50VSRLUj3Zy3tH2C6JxcuyxoG3aDBI88hlU/qV?= =?us-ascii?Q?QxfI4xjPHxx63eE4tnR+rJxB0syatB3nYfY40YrtU/GtrNfsCfb1ME/Hh87c?= =?us-ascii?Q?JcmvsitzRby6wCPwoQ+NjCeK4jNOiQT2ik/KLeHmFpCifpcTjmRfn2ka39te?= =?us-ascii?Q?ZccbV86tqNkgYv6fTuB1VaqXDMZxLcPzUIknfEqdcNIkw99J4ecV6TB7ZBMY?= =?us-ascii?Q?jxby2lk3akQeiyEprfJPRAgWbQLrnYfyVtkDJuj2++Y=3D?= Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: CY4PR1101MB2134.namprd11.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 38af42fd-83fc-41c7-4a4c-08d89cf67c7f X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Dec 2020 10:29:33.6670 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 46c98d88-e344-4ed4-8496-4ed7712e255d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: hgjICNdcLD/BbX//r4UnM2p4UzR9pXv6DKSIEogdA3+B/OuiczVUg+9/D0xYX8xGPVKSKmG9LYRaBmhZ7Fsn/8HtEW2fr50Ty+EfdGvJAsg= X-MS-Exchange-Transport-CrossTenantHeadersStamped: CY4PR11MB1863 X-OriginatorOrg: intel.com Subject: Re: [dpdk-users] scheduler issue X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: users-bounces@dpdk.org Sender: "users" > -----Original Message----- > From: Alex Kiselev > Sent: Wednesday, December 9, 2020 1:42 PM > To: Singh, Jasvinder > Cc: users@dpdk.org; Dumitrescu, Cristian ; > Dharmappa, Savinay > Subject: Re: [dpdk-users] scheduler issue >=20 > On 2020-12-08 14:24, Singh, Jasvinder wrote: > > > > > >> > [JS] now, returning to 1 mbps pipes situation, try reducing tc > >> > period first at subport and then at pipe level, if that help in > >> > getting even traffic across low bandwidth pipes. > >> > >> reducing subport tc from 10 to 5 period also solved the problem with > >> 1 Mbit/s pipes. > >> > >> so, my second problem has been solved, but the first one with some of > >> low bandwidth pipes stop transmitting still remains. > >> > > > > I see, try removing "pkt_len <=3D pipe_tc_ov_credits" condition in the > > grinder_credits_check() code for oversubscription case, instead use > > this pkt_len <=3D pipe_tc_credits + pipe_tc_ov_credits; >=20 > Does this address my problem with pipes stop transmitting? > Is these already included in the newer scheduler version (19x or 20.x)? No, It is not included in latest version. Try this at your end, if this wor= ks? > > > > > >> > > >> > > >> > > >> >>> rcv 0 rx rate 7324160 nb pkts 5722 > >> >>> rcv 1 rx rate 7281920 nb pkts 5689 > >> >>> rcv 2 rx rate 7226880 nb pkts 5646 > >> >>> rcv 3 rx rate 7124480 nb pkts 5566 > >> >>> rcv 4 rx rate 7324160 nb pkts 5722 > >> >>> rcv 5 rx rate 7271680 nb pkts 5681 > >> >>> rcv 6 rx rate 7188480 nb pkts 5616 > >> >>> rcv 7 rx rate 7150080 nb pkts 5586 > >> >>> rcv 8 rx rate 7328000 nb pkts 5725 > >> >>> rcv 9 rx rate 7249920 nb pkts 5664 > >> >>> rcv 10 rx rate 7188480 nb pkts 5616 rcv 11 rx rate 7179520 nb > >> >>> pkts > >> >>> 5609 rcv 12 rx rate 7324160 nb pkts 5722 rcv 13 rx rate 7208960 > >> >>> nb pkts 5632 rcv 14 rx rate 7152640 nb pkts 5588 rcv 15 rx rate > >> >>> 7127040 nb pkts 5568 rcv 16 rx rate 7303680 nb pkts 5706 .... > >> >>> rcv 587 rx rate 2406400 nb pkts 1880 rcv 588 rx rate 2406400 nb > >> >>> pkts > >> >>> 1880 rcv 589 rx rate 2406400 nb pkts 1880 rcv 590 rx rate 2406400 > >> >>> nb pkts 1880 rcv 591 rx rate 2406400 nb pkts 1880 rcv 592 rx rate > >> >>> 2398720 nb pkts 1874 rcv 593 rx rate 2400000 nb pkts 1875 rcv 594 > >> >>> rx rate 2400000 nb pkts 1875 rcv 595 rx rate 2400000 nb pkts 1875 > >> >>> rcv > >> >>> 596 rx rate 2401280 nb pkts 1876 rcv 597 rx rate 2401280 nb pkts > >> >>> 1876 rcv 598 rx rate 2401280 nb pkts 1876 rcv 599 rx rate 2402560 > >> >>> nb pkts 1877 rx rate sum 3156416000 > >> >> > >> >> > >> >> > >> >>>>> ... despite that there is _NO_ congestion... > >> >>>>> congestion at the subport or pipe. > >> >>>>>> And the subport !! doesn't use about 42 mbit/s of available > >> >>>>>> bandwidth. > >> >>>>>> The only difference is those test configurations is TC of > >> >>>>>> generated traffic. > >> >>>>>> Test 1 uses TC 1 while test 2 uses TC 3 (which is use TC_OV > >> >>>>>> function). > >> >>>>>> So, enabling TC_OV changes the results dramatically. > >> >>>>>> ## > >> >>>>>> ## test1 > >> >>>>>> ## > >> >>>>>> hqos add profile 7 rate 2 M size 1000000 tc period 40 > >> >>>>>> # qos test port > >> >>>>>> hqos add port 1 rate 10 G mtu 1522 frame overhead 24 queue > >> >>>>>> sizes > >> >>>>>> 64 64 64 64 > >> >>>>>> hqos add port 1 subport 0 rate 300 M size 1000000 tc period 10 > >> >>>>>> hqos add port 1 subport 0 pipes 2000 profile 7 hqos add port 1 > >> >>>>>> subport 0 pipes 200 profile 23 hqos set port 1 lcore 3 port 1 > >> >>>>>> subport rate 300 M number of tx flows 300 generator tx rate 1M > >> >>>>>> TC > >> >>>>>> 1 ... > >> >>>>>> rcv 284 rx rate 995840 nb pkts 778 rcv 285 rx rate 995840 nb > >> >>>>>> pkts 778 rcv 286 rx rate 995840 nb pkts 778 rcv 287 rx rate > >> >>>>>> 995840 nb pkts 778 rcv 288 rx rate 995840 nb pkts 778 rcv > >> >>>>>> 289 rx rate 995840 nb pkts 778 rcv 290 rx rate 995840 nb > >> >>>>>> pkts 778 rcv 291 rx rate 995840 nb pkts 778 rcv 292 rx rate > >> >>>>>> 995840 nb pkts 778 rcv 293 rx rate 995840 nb pkts 778 rcv > >> >>>>>> 294 rx rate > >> >>>>>> 995840 nb pkts 778 ... > >> >>>>>> sum pipe's rx rate is 298 494 720 OK. > >> >>>>>> The subport rate is equally distributed to 300 pipes. > >> >>>>>> ## > >> >>>>>> ## test 2 > >> >>>>>> ## > >> >>>>>> hqos add profile 7 rate 2 M size 1000000 tc period 40 > >> >>>>>> # qos test port > >> >>>>>> hqos add port 1 rate 10 G mtu 1522 frame overhead 24 queue > >> >>>>>> sizes > >> >>>>>> 64 64 64 64 > >> >>>>>> hqos add port 1 subport 0 rate 300 M size 1000000 tc period 10 > >> >>>>>> hqos add port 1 subport 0 pipes 2000 profile 7 hqos add port 1 > >> >>>>>> subport 0 pipes 200 profile 23 hqos set port 1 lcore 3 port 1 > >> >>>>>> subport rate 300 M number of tx flows 300 generator tx rate 1M > >> >>>>>> TC > >> >>>>>> 3 > >> >>>>>> h5 ~ # rcli sh qos rcv > >> >>>>>> rcv 0 rx rate 875520 nb pkts 684 > >> >>>>>> rcv 1 rx rate 856320 nb pkts 669 > >> >>>>>> rcv 2 rx rate 849920 nb pkts 664 > >> >>>>>> rcv 3 rx rate 853760 nb pkts 667 > >> >>>>>> rcv 4 rx rate 867840 nb pkts 678 > >> >>>>>> rcv 5 rx rate 844800 nb pkts 660 > >> >>>>>> rcv 6 rx rate 852480 nb pkts 666 > >> >>>>>> rcv 7 rx rate 855040 nb pkts 668 > >> >>>>>> rcv 8 rx rate 865280 nb pkts 676 > >> >>>>>> rcv 9 rx rate 846080 nb pkts 661 > >> >>>>>> rcv 10 rx rate 858880 nb pkts 671 rcv 11 rx rate 870400 nb > >> >>>>>> pkts 680 rcv 12 rx rate 864000 nb pkts 675 rcv 13 rx rate > >> >>>>>> 852480 nb pkts 666 rcv 14 rx rate 855040 nb pkts 668 rcv 15 > >> >>>>>> rx rate 857600 nb pkts 670 rcv 16 rx rate 864000 nb pkts > >> >>>>>> 675 rcv 17 rx rate 866560 nb pkts 677 rcv 18 rx rate 865280 > >> >>>>>> nb pkts 676 rcv 19 rx rate 858880 nb pkts 671 rcv 20 rx > >> >>>>>> rate > >> >>>>>> 856320 nb pkts 669 rcv 21 rx rate 864000 nb pkts 675 rcv 22 > >> >>>>>> rx rate 869120 nb pkts 679 rcv 23 rx rate 856320 nb pkts > >> >>>>>> 669 rcv 24 rx rate 862720 nb pkts 674 rcv 25 rx rate 865280 > >> >>>>>> nb pkts 676 rcv 26 rx rate 867840 nb pkts 678 rcv 27 rx > >> >>>>>> rate > >> >>>>>> 870400 nb pkts 680 rcv 28 rx rate 860160 nb pkts 672 rcv 29 > >> >>>>>> rx rate 870400 nb pkts 680 rcv 30 rx rate 869120 nb pkts > >> >>>>>> 679 rcv 31 rx rate 870400 nb pkts 680 rcv 32 rx rate 858880 > >> >>>>>> nb pkts 671 rcv 33 rx rate 858880 nb pkts 671 rcv 34 rx > >> >>>>>> rate > >> >>>>>> 852480 nb pkts 666 rcv 35 rx rate 874240 nb pkts 683 rcv 36 > >> >>>>>> rx rate 855040 nb pkts 668 rcv 37 rx rate 853760 nb pkts > >> >>>>>> 667 rcv 38 rx rate 869120 nb pkts 679 rcv 39 rx rate 885760 > >> >>>>>> nb pkts 692 rcv 40 rx rate 861440 nb pkts 673 rcv 41 rx > >> >>>>>> rate > >> >>>>>> 852480 nb pkts 666 rcv 42 rx rate 871680 nb pkts 681 ... > >> >>>>>> ... > >> >>>>>> rcv 288 rx rate 766720 nb pkts 599 rcv 289 rx rate 766720 nb > >> >>>>>> pkts 599 rcv 290 rx rate 766720 nb pkts 599 rcv 291 rx rate > >> >>>>>> 766720 nb pkts 599 rcv 292 rx rate 762880 nb pkts 596 rcv > >> >>>>>> 293 rx rate 762880 nb pkts 596 rcv 294 rx rate 762880 nb > >> >>>>>> pkts 596 rcv 295 rx rate 760320 nb pkts 594 rcv 296 rx rate > >> >>>>>> 604160 nb pkts 472 rcv 297 rx rate 604160 nb pkts 472 rcv > >> >>>>>> 298 rx rate > >> >>>>>> 604160 nb pkts 472 rcv 299 rx rate 604160 nb pkts 472 rx > >> >>>>>> rate sum 258839040 FAILED. > >> >>>>>> The subport rate is distributed NOT equally between 300 pipes. > >> >>>>>> Some subport bandwith (about 42) is not being used!