From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-vk0-f49.google.com (mail-vk0-f49.google.com [209.85.213.49]) by dpdk.org (Postfix) with ESMTP id 7EA3E2C67 for ; Fri, 11 Mar 2016 03:46:43 +0100 (CET) Received: by mail-vk0-f49.google.com with SMTP id k1so119583167vkb.0 for ; Thu, 10 Mar 2016 18:46:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to; bh=2p4alN7RpJ4hh6gQc7jQrB6eD3NJUNXglL3x27/tnIg=; b=W8544YrjhuuTgJlbiX4aMq4F9RJANvKrRjalhmeGabcd4BP18UAFN6gTs5fQJ7iuXq yodqaBgSwdoKocugxGAL8bSgWL2+mBWFbcw6343j0ovt3vWwZJADBaOmz+qlilA2+8vc VcMUC7vLDDyF1Vi3PQQoZvzp9eE2cTMR2Jse7UbF8KVBvHnw46q4mI/UFPj8aE2d1X1G EV0oDpaabZXUJKWxyxZthksk4+s3fwSyQCVQoLHmj9wsVUrNzzKY5/Eed8LOdFGMUzBh KvZvPll35gvGLdNbrqU4x/prhp0blLSuu/ovwgVXkTzRSz9C5cGT2MEeWYCTc0w8N9o+ i4uA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to; bh=2p4alN7RpJ4hh6gQc7jQrB6eD3NJUNXglL3x27/tnIg=; b=cpRt1i8O07fJUxEZL1XSYciovPkM7iIOZw2GTfNLIJxWOC/9wUCKYqsBpxS3vgnDzX PzA4BHreib8CSU3J0a3cRZ6MFDcn6va6Wqq9voPvfPNj4bgZnCCSLlRnxo+FHcQ1Gw0M dNItOu4ZDzn2/pQ48QJwJ4zd+qlq4UzF2FO16fXJwsAd/i7CE4ZJOJnjch65FISrfl9A hdtfSIeKV5TQunqlQnPN3FFde1mnri4Ra259Yfc5bpjEHyWYyqlN4r5alKn9ndTAXIdn RtoxwKrmPmkHQYAz/A4g1bKYOd5rCDmnxi3c6kGeqSIFa5S7bJhBh3aTIP4XD3iclJZL xvrA== X-Gm-Message-State: AD7BkJJ5Nd+SaF3MVpHCUV+FoviZEpJ2hlt9HEscC2pa7esBGXgimE//3thQlGSsr+q/s+PgNTx6vyQU4BLmLA== MIME-Version: 1.0 X-Received: by 10.31.140.130 with SMTP id o124mr7085240vkd.145.1457664402869; Thu, 10 Mar 2016 18:46:42 -0800 (PST) Received: by 10.31.64.138 with HTTP; Thu, 10 Mar 2016 18:46:42 -0800 (PST) Date: Thu, 10 Mar 2016 18:46:42 -0800 Message-ID: From: John Wei To: dev@dpdk.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] DPDK library grab all the memory during start up X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: patches and discussions about DPDK List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 11 Mar 2016 02:46:43 -0000 I am setting up open-vswitch with DPDK in container, and running many this OVS/DPDK containers on the same host. OVS in each container will be using differ PCI deviced bound to DPDK. I am using --file-prefix to allow sharing of same /dev/hugepages tlbfs, and using --socket-mem to limit the memory used by each OVS. But, DPDK library first grab all the available memory, pick the best memory, before releasing memory not needed. It seems tat this process is serialized. Each DPDK app will need to wait the previous app to complete that process, before next app can start grabing, picking, and releasing memory. This is taking a long time when you try to start many DPDK app in parallel. I tried to use different tlbfs for each app, and limit each tlbfs with nr_inodes, but that does not work. Any suggestion on addressing this issue? Is there way to tell DPDK library not to grab so much memory? John