From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-DB5-obe.outbound.protection.outlook.com (mail-eopbgr40089.outbound.protection.outlook.com [40.107.4.89]) by dpdk.org (Postfix) with ESMTP id CC4831B011 for ; Wed, 14 Feb 2018 03:01:58 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=e7qr00vwWJFEl3f5Zu1lrcx7bc3gJKHtDkhHsyETz9Y=; b=D7AJ5XnsAorytjiXHPBZ9ZOBxxBQsTfoLQ/g4iA4QUytt+T2eUeahJ1VX9jPWCrKvGPNFxPrWnqNYueTZjrNH1I5xBY/8wqdHmli2i2UlQm0CjaUMN/kSoXrjTahOau+VpTVhSGgzJfDb+tfY1Tf7gNy96zhWrzABR93p/90NCg= Received: from VI1PR0501MB2045.eurprd05.prod.outlook.com (10.167.195.147) by VI1PR0501MB2557.eurprd05.prod.outlook.com (10.168.136.148) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.20.485.10; Wed, 14 Feb 2018 02:01:56 +0000 Received: from VI1PR0501MB2045.eurprd05.prod.outlook.com ([fe80::5ccf:86b:106c:a93a]) by VI1PR0501MB2045.eurprd05.prod.outlook.com ([fe80::5ccf:86b:106c:a93a%14]) with mapi id 15.20.0485.017; Wed, 14 Feb 2018 02:01:56 +0000 From: Yongseok Koh To: "Burakov, Anatoly" CC: "Walker, Benjamin" , "dev@dpdk.org" , Thomas Monjalon , "andras.kovacs@ericsson.com" , "Wiles, Keith" , "Richardson, Bruce" , =?iso-8859-1?Q?N=E9lio_Laranjeiro?= , "Shahaf Shuler" , "Xueming(Steven) Li" Thread-Topic: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK Thread-Index: AQHTfm3YBB6w6AxuJE+TFa+5PaJlCqORNQ0AgASfQoCADZ5nAA== Date: Wed, 14 Feb 2018 02:01:56 +0000 Message-ID: References: <1513892309.2658.80.camel@intel.com> <1514308764.2658.93.camel@intel.com> <20180202192832.GA42096@yongseok-MBP.local> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: spf=none (sender IP is ) smtp.mailfrom=yskoh@mellanox.com; x-originating-ip: [209.116.155.178] x-ms-publictraffictype: Email x-microsoft-exchange-diagnostics: 1; VI1PR0501MB2557; 7:9VM3851a2+QhNh38EZEuvEnCo1oPAFohzD8HUQqy6GMJAcIpmh3JMjGoF1cdP21eqFEcFMp83JSTUG6f6TcJoJ1fCLuIk/QblfLU5loXto97adW1P4ZSmNg0Vu16wMKZ73bFKKomE9T71y2Vz8P+EEEuZtBjavwB/7pKG/3NIoRNy+X5NGxCI8b8Nyd4+EsM2qV1RRQ61cKucU15G5Uvj/+ptaOZyUm5b1OJwyPjoktpBlz3nwUqGB1wq+rdlMHc x-ms-exchange-antispam-srfa-diagnostics: SSOS; x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 9f57e7f1-28dc-45ae-6204-08d5734eecec x-microsoft-antispam: UriScan:; BCL:0; PCL:0; RULEID:(7020095)(4652020)(48565401081)(5600026)(4604075)(3008032)(4534165)(4627221)(201703031133081)(201702281549075)(2017052603307)(7153060)(7193020); SRVR:VI1PR0501MB2557; x-ms-traffictypediagnostic: VI1PR0501MB2557: x-ld-processed: a652971c-7d2e-4d9b-a6a4-d149256f461b,ExtAddr x-microsoft-antispam-prvs: x-exchange-antispam-report-test: UriScan:(228905959029699); x-exchange-antispam-report-cfa-test: BCL:0; PCL:0; RULEID:(6040501)(2401047)(8121501046)(5005006)(3002001)(3231101)(2400082)(944501161)(10201501046)(93006095)(93001095)(6055026)(6041288)(201703131423095)(201702281528075)(20161123555045)(201703061421075)(201703061406153)(20161123558120)(20161123564045)(20161123562045)(20161123560045)(6072148)(201708071742011); SRVR:VI1PR0501MB2557; BCL:0; PCL:0; RULEID:; SRVR:VI1PR0501MB2557; x-forefront-prvs: 0583A86C08 x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(366004)(376002)(39380400002)(346002)(396003)(39860400002)(189003)(199004)(82746002)(186003)(81156014)(25786009)(5250100002)(6512007)(6506007)(229853002)(102836004)(106356001)(107886003)(53546011)(6116002)(4326008)(14454004)(33656002)(54906003)(316002)(53936002)(93886005)(66066001)(6436002)(68736007)(3846002)(478600001)(5660300001)(36756003)(86362001)(6246003)(3280700002)(99286004)(2950100002)(97736004)(6916009)(83716003)(3660700001)(105586002)(305945005)(26005)(8676002)(81166006)(7736002)(6486002)(76176011)(2900100001)(2906002)(8936002); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR0501MB2557; H:VI1PR0501MB2045.eurprd05.prod.outlook.com; FPR:; SPF:None; PTR:InfoNoRecords; MX:1; A:1; LANG:en; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-microsoft-antispam-message-info: o0j2pIhjA9spypNxldIXd3lWRq5P/xp7QtJe0teRYpnhKxULFtGqVoTwWj/G1IR1N1G3yGBP0NFuAkD88Ksa2w== spamdiagnosticoutput: 1:99 spamdiagnosticmetadata: NSPM Content-Type: text/plain; charset="iso-8859-1" Content-ID: <5151656729FE59438E6F3A65891CD179@eurprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9f57e7f1-28dc-45ae-6204-08d5734eecec X-MS-Exchange-CrossTenant-originalarrivaltime: 14 Feb 2018 02:01:56.0632 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR0501MB2557 Subject: Re: [dpdk-dev] [RFC v2 00/23] Dynamic memory allocation for DPDK X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Feb 2018 02:01:59 -0000 > On Feb 5, 2018, at 2:03 AM, Burakov, Anatoly = wrote: >=20 > Thanks for your feedback, good to hear we're on the right track. I alread= y have a prototype implementation of this working, due for v1 submission :) Anatoly, One more suggestion. Currently, when populating mempool, there's a chance t= o have multiple chunks if system memory is highly fragmented. However, with y= our new design, it is unlikely to happen unless the system is really low on mem= ory. Allocation will be dynamic and page by page. With your v2, you seemed to ma= ke minimal changes on mempool. If allocation fails, it will still try to gathe= r fragments from malloc_heap until it acquires enough objects and the resulta= nt mempool will have multiple chunks. But like I mentioned, it is very unlikel= y and this will only happen when the system is short of memory. Is my understandi= ng correct? If so, how about making a change to drop the case where mempool has multipl= e chunks? Thanks Yongseok