From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from NAM01-SN1-obe.outbound.protection.outlook.com (mail-sn1nam01on0060.outbound.protection.outlook.com [104.47.32.60]) by dpdk.org (Postfix) with ESMTP id 06BAC2C8 for ; Thu, 6 Jul 2017 16:13:31 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=CAVIUMNETWORKS.onmicrosoft.com; s=selector1-cavium-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=y6pApvF//4OzeSkEaA3HPRUWmIjX3yiK1zPqaMhuHh4=; b=CecohiitkseMHkUKWifAPGI65UoW0hulnH3XULNoqBQYLUtWYvRbheru4kWJCiNdR78/JJpT0q0Y7yskkYpSkCTJwR129LPwpvmSc2YhzW709wL0/IWmLTNeIEPPJNHe9b8ojIUERzNzAG4l3cz3RkvTKqnfrvTzHJO5aa3vXYg= Authentication-Results: 6wind.com; dkim=none (message not signed) header.d=none;6wind.com; dmarc=none action=none header.from=caviumnetworks.com; Received: from [10.160.0.43] (111.93.218.67) by BN6PR07MB3090.namprd07.prod.outlook.com (10.172.105.8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_CBC_SHA256_P256) id 15.1.1220.11; Thu, 6 Jul 2017 14:13:26 +0000 To: Maxime Coquelin , Jerin Jacob References: <20170608110513.22548-1-santosh.shukla@caviumnetworks.com> <20170608110513.22548-8-santosh.shukla@caviumnetworks.com> <730e333b-a9ab-df8b-cf7a-1e0186c6152d@redhat.com> <20170705154314.GA4635@jerin> <2fe366fb-15fa-f754-458e-3f4e8be18699@redhat.com> <20170706094939.GA1709@jerin> <89425d75-3f79-d3e8-f0b1-330292866bbb@redhat.com> <1e7b7b37-ab0a-e568-c614-7c7ec606fd22@redhat.com> Cc: thomas@monjalon.net, bruce.richardson@intel.com, dev@dpdk.org, hemant.agrawal@nxp.com, shreyansh.jain@nxp.com, gaetan.rivet@6wind.com From: santosh Message-ID: <16fd150a-7663-ef6d-dfa2-c72140a82d4b@caviumnetworks.com> Date: Thu, 6 Jul 2017 19:43:13 +0530 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 In-Reply-To: <1e7b7b37-ab0a-e568-c614-7c7ec606fd22@redhat.com> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Originating-IP: [111.93.218.67] X-ClientProxiedBy: PN1PR01CA0085.INDPRD01.PROD.OUTLOOK.COM (10.174.144.153) To BN6PR07MB3090.namprd07.prod.outlook.com (10.172.105.8) X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 4f709f5e-7107-488f-7b0a-08d4c4792d8f X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(300000503095)(300135400095)(201703131423075)(201703031133081)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:BN6PR07MB3090; X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 3:ktceVtKm2nguTmPrvOztFUBRcZLEstRK02dl0WlbT5Sc42cuGlMGB1NLLuBvV3P3DiujADLjJat98ggesVToubgbnTK/FiuIVww/E4gASRTAfz9J8uvXpCITjaWjtQrMmdStuPmjH1zjSB76rNPdUgN3tjdOjugfH3zwuh3sTLIrUUHyoZSSv8BCH2COt+HnItrCJ9TpE4uvx+ynzZeGeQspBmLj5WFVdvxefVeYOLvGZFmZUYVX7XvulFpP0zSv9X5bUMBOTNPtDzXsVoxczGX9pFQm6hdXNZbRdlufe7FWSuMLDcOr0VhFS6aa3iJa1mAJX/692oMozCeHLKMsWX7U37qmDrUGu1PeWfNBM3AJauK250IFEPr9D6t08qphsUamHdE5U36LMoRYjS98D4LhhWlbIaPtB8fg3iEvIgHvFYgcsV8GRLgf3ohTSVG32xt1yrTyWb3fEEbqiNhbURPK1wjG9p/7WW+U0XidiqcVAWYnBDCxzIIiRCzrhRNZ+g9rvyHjRjEXyuYArTGhXkTzxuBoh1lH4/ew2NnGsCs0/glrccGw94xktepVe3TNtElogAC2H0no2coSAM15P21StoptqC3+q/iVP3COW1p6rwG9LqQBboMp6tz7xKhmdGrS9KJ7CX6cmYhqo8wDBWrTiTkmqIT+P44n7gJhwlAh7AYuOCIwMzO7oa2/fkimmA+0s8CPfNtBSr0dyU41faQOaR6CEXALaqiwPalPWCABZN28/QJOCxpz3c4IE61H X-MS-TrafficTypeDiagnostic: BN6PR07MB3090: X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 25:EY1aJzm1yqsp//VLV29MAGgJOhH/zkqxMQw2xPUr9+a+hJmjdo1AAXoDJgZ2Aqfdy/Twp45Vt0PEcaOfJFbe/KixXft+2mkoDIFWpOTo1BZyCjbR7Z0rK8hgQ10pz1x6qukfkWcpD1caQV0zQhMLcy6rVvTwnzoHMIE6NETRs8isHzL2cdX6BgYD0BrMuTuDMVdPOoatgb1E4g4kth9jcvxvyP+IjWZrCLaiLw3DUNC0KBPAOVzIcXWuCZpfGacvzll86bkLRv2y85tRGR0hqW06rKzkbOsHwL7siTuKgF/sET5Wd6qnG6tqGzfhwsjITw7qrx6Hk2fMMLQWmw1hBvfYpIRuJD6dAJZZa9D6ljJBVF0kCZQODa9Suz9u+okbXlZXWN5UkpEb0Dy1EOW4PO3758GJDoyMLwfeGng3oI8p7S4Uh+3i2m5jX+lq+jTjCls38abTlN6uuzwf/MgqRQbRXlp3A6/BJVPi8Io59fCjdKPLxxKfvEzi6o/M9hsiJdek0eIx21+eq2blfC7382tVkM9HDgAgKynEtg5I9u6NELK8eTjrUnJ40ZGeQPRqPKJbLyX1SLldumBbiSOsGAS0gdmCzFz63CaFX49v/ats9lDOxNX9XuTLnyyPqXDp5ImJpPGbynnU/DHgHjoFRjIyTmTvpz0etiWvlCs6aPTnr8BLXQQF76Y05KnluXfG5d34qFbnDoEFnuJSSU/BkWYJwWibJbo0P2HGNEkqer2Dzll+v4t6nNCF3lDsP5yr3LnfGKw9TpUvMVqsCN1OOBxCXHnKo9lDnqGYM/C/q/zXuHSZvSPNT9El/7miHVGgvfujp+HDGnd4bJH5EI0+A5AmCRZ5DPgDX4eCUp0B5IibcK/stNLD5+QW6tL4BlYqxG/nnZ4eSuWZ7LZ35Qf2QG8UGHWKBkRJVoZgrAp1sBQ= X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 31:NYLgmfWQ81J37v9ic0uCZ+x3c4SoFD1vvFDsFGMsrHYJBUuTfpfRx/2birkBK840ytXvMct0TL2kn5NVeoxsXlOyemvKDFTX1H4vYAYEP3C0Xe7SMzqsd12SPhURgJbUfmZP+IxlrrS8aae1O3pyMJ/j/v8g/yqo002Zuy7nb5Le4/nlJLldF6rsW/tmlCNEvgBLgFsG7yfuzC6uxQALYUpBuskyT0vFrnQXbkm62eVDByYKMhPszZYCMOlbWdciidK82kPiEQnoCsikRABBqbJlS9RJHRdgBcyulpFRGHjS4Hy6P165J6Rz6H8o+jGZR6XOBKYtOvKsWlO8Vm4rZaqu/2nj6yfNdD9IeNugPmVgBBOw16iAq0rZgR5RdYiLy2SoEmDkTn2UZ/j9WEHyXSEIrJlEeWTd6MqaY+sfY7AVrbl6nQux3nzWIx3ooTUYU3geT1Za0t1pGbdlIEBigxpl5uutLJbAouIQC5UizvT4wNaKqu06chqOW6Kz/OATLc3dtGttbB2U5gmlgYScALQUzkZ5mV1sBlGiB1zswEqt1+jVIO0xH7IDC9NW+lZgAsgjVgdtJsos62uLAsWJPpMHRY3qQ9/ON3tm09In2dMByhwMUJHfKyyuxpOIl0F7XVBF8M7ZunC6G4kxQDH48cf1XlBU4lOKLhNUHJW893k= X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 20:tSmDCn75vSgNi335F6G3ihs0Jc22N9VpUkmPqXzSkBZhh6MitSgXUPKRH84lrtuH2FeA5BudqXMV0izNgGMHJdMdEd87R9rG1UnS+duaDiljMqotdzGKDZtNIOfExlwBDU7aPxN8sLWpcMLx+UgVdqBFgjhEMlfBFif5tPIdndVFuWDLNHwFzAgwO9tqFM1BsYzllcwynQanuy1jALwauirGUWFzGjiyTYn7exj7j9Ei44OBSFUQ8yzsy18ir+MW16dQ5HK/asKyA7haTxlheFKdTaiNINFDCWMpQCaRB2PzDxmVdlmwT4WVHDc1p6nHc49k9T8psHqXULqZRBEkHLFuPy3pbcb27NzXmfZBBEmzWAp1E3GYGd5oIckjRTtuLbmS0cIDPYXfeDXrp2adI1zz+hGvaKPdcbb3Gkkh00zc5WsUlnqlIxTehsMsWTUw6CnTBwMmebb96GS6hqV/YP+M2nfvg3hSnKsuW89KwJ+IGM7+9lmupY+dy1v6J6CqQOH0ZkFvbPRyXdlkk14B1pernbKWIvhBYoKnai9vLpuD3jW72JzPZn8pvIRYKiskdA8jnEi4D/gJ0c1Wb3ywpgODfNwQ4oi4Ka/waIVryyQ= X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-Test: UriScan:(125551606395959)(236129657087228)(185117386973197)(278021516957215)(167848164394848)(228905959029699); X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(93006095)(10201501046)(100000703101)(100105400095)(3002001)(6041248)(20161123560025)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123562025)(20161123564025)(20161123558100)(20161123555025)(6072148)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:BN6PR07MB3090; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:BN6PR07MB3090; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjA3TUIzMDkwOzQ6c2J5UFo3MXZBNXJiN0F3b1RSTE9mVjBlL0s5?= =?utf-8?B?Mk1MRXZTWmswNWFlWHVuYW8vN2pxNEs0NFg2NlNlRDFKMHM1YlJqY3NrWEp1?= =?utf-8?B?bVArcnBLc011WTRPTmxLM3BydmZsWlJMWWlrMmZhZmJaY3NlT01vbW5nc3g0?= =?utf-8?B?b3ZSRnUvOE1zaVArMzJXZ1pwdzdteG92SjVYK2JIRlVJTCtQalFlYVR5aXl4?= =?utf-8?B?cmYvR00zRE9NdWtaYzhWajVWVDJMd09zZE9kSW92Y1FxVDVZTHhydXpmMjNz?= =?utf-8?B?TjJKYVBUaVlxRGxUbWExMm9iNnZOZHd4d1N1YzF0RUM2ZE5HQU45VVZWa0w1?= =?utf-8?B?RFJjM3lsWVZFazgrWTQxNHZQcThwd0NWdlJBM3crSkhzNzFLM0RTWjR2LzJC?= =?utf-8?B?elNQbWdaQXBtOG1rV2gyQTRzZGFxcnRlU2s0WjFRajg1OUI2YTlLZnZReHZI?= =?utf-8?B?Qk5rYTYxd3dRcHFYL2gyNUw5VTY3eGFJVGh3QUxxNGc5TXNSMjZVVUpDd1RZ?= =?utf-8?B?czMrek1NRjRGeWZZUnhZblVqOVA0L2RaeWlzK09xb0IyTW5tQ1NoZmdZSUp3?= =?utf-8?B?ZDNmVERyR2pvNmlUb3ZEQ0N5M29qWU9KTmRUbnpWRldFR1BGR002bVI1YWFJ?= =?utf-8?B?dWYzY1RCR0ZpUkhYYkpSS014eFFqVmdra1RGdWlJQnVsK3NjQlhYWnlCVGZx?= =?utf-8?B?cGdvWWhBOVJGeHIvallBTysyT095Qi9qOWR1UWZEVHhWak92cDdYenJsN1l1?= =?utf-8?B?SzVBVFRLRVpPbGx1dENZcWhOdWhmZDNsZlFlaExDY01JZzk3eWdMWndXVzZR?= =?utf-8?B?Q1BUbC8zZFE4c2htMi8vTG1HeFpiTmJpZGFmcDUxbVZCM29yUjlSK2FXSEY3?= =?utf-8?B?ZStzamNVbVp5SnQ5VUNQOGg4MmxSQW9EMWJaVnQwemYwRUF0N1VoSTBURFgr?= =?utf-8?B?Zy9zUEpaUTZVdVNTOHFHL3E5NTdsbXpCazcyQ1NpZHFBT3locjNxNjA2TGRN?= =?utf-8?B?QlNjKzVqVHplaEQxNEt3dzRYeEhHYktKbEc1MmdQTUtyT2pWQ0JzVS9qcjJY?= =?utf-8?B?YnlIL3RiL2hiR1E3Vk9oYVltOWFXT2toUzYvd2w1bTZvQXpBczFSVUJZZE1U?= =?utf-8?B?djRTZEd3V1NkZjFsYjhGa0NQaDNwUVZVcy9kVitPSHlORWp3SllWWE1OUVN6?= =?utf-8?B?T3NFcmNLRkxBWkYzcERrcVZSV0hneWhVeTVEL3h2dmQ1K0RDOWpCZ2cySktK?= =?utf-8?B?b2hVbHZLUktjcDI3djErbElMM0kwUW1GUnRNYmNoUzN4STJ5d0NkTFFoeE4z?= =?utf-8?B?Vnp5Z2dIWUNwSXVBQ2dmZStQZ1IwUXROdzJRcU5QSWdNeDUrMHJzb3VmUEZB?= =?utf-8?B?WjN5dDJsS08yQjJrSzlxVG9Ia2J2M2tIdkcybU5INk56ZnRWY2pnYkJTWWhY?= =?utf-8?B?bStLSFdWaWlwMGRtc2treU5jTWx0c2ZENnp0bkoxUGFzeC9JbjBLL1NnYmR5?= =?utf-8?B?alhuZG1jZ0NIWmlLc3BOc21EZVgvc1BIVXYrRkJ4cUFRVkhMVlpDMU1lMXN2?= =?utf-8?B?UzJRRWM1WEpiV29jTXYzbVhrTTV6MUMxTWdWSFE1UDdzTFhEUGdCeUdJcXJG?= =?utf-8?B?dG10Z290dTRpZCtZQWQyT2FSa3pVM3QyRlREZFh0ZFFRUzZIN0ZOUGJyUm4v?= =?utf-8?B?RjdxbWZkdEFwREFtWjF0TmdHcGZGMzZCeDYzY3J0YmRLSC9pMTl3ODBXdi80?= =?utf-8?B?VGdmSHZxdkFLSlZjQjJMTmNPUDQ1Ym0vTDc1dHFTWnVmWkVkVFFWMFdYZUFX?= =?utf-8?Q?LU+jxbabEcsq?= X-Forefront-PRVS: 03607C04F0 X-Forefront-Antispam-Report: SFV:NSPM; SFS:(10009020)(4630300001)(6049001)(6009001)(39840400002)(39410400002)(39400400002)(39850400002)(39450400003)(24454002)(51914003)(377454003)(229853002)(4326008)(50466002)(81166006)(83506001)(86152003)(31686004)(6636002)(93886004)(6666003)(966005)(66066001)(6116002)(478600001)(42882006)(2950100002)(65956001)(42186005)(6306002)(65806001)(5009440100003)(551934003)(5890100001)(23676002)(8676002)(36756003)(305945005)(8656002)(2906002)(53546010)(3846002)(53376002)(6246003)(25786009)(230700001)(189998001)(47776003)(4001350100001)(77096006)(33646002)(65826007)(38730400002)(7736002)(54356999)(90366009)(6486002)(76176999)(50986999)(31696002)(72206003)(53936002)(5660300001); DIR:OUT; SFP:1101; SCL:1; SRVR:BN6PR07MB3090; H:[10.160.0.43]; FPR:; SPF:None; MLV:sfv; LANG:en; X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjA3TUIzMDkwOzIzOkI4RVNyTHJwS2c5U0xqbkZaS0tsYk5XL0Nj?= =?utf-8?B?WGdiZFNxQUZIT3BSbWMzYm5HRXA2MmRiNTRSWjI5cWhLdjN6RW9YSC9LRU9P?= =?utf-8?B?OGRJaDVpNm9FMGtMVXB4YWUyTUlJYkxPODhoTElocCszV2RPdlFLRHZaTy9F?= =?utf-8?B?SnRSZWxmdjhVeHJHTnZDZjR0U3FPMnNhZDlhTmZSaHNDMEcxVFEwKy9QWHNT?= =?utf-8?B?ZHJ4VmMyNEVoRXQ1WVpkeGthTG5wTkFsUXBaRVBybko0K242UFpTdFAza1pI?= =?utf-8?B?dDgvMTczM3AxZTRWNUpUb2VjTzVMb2lrOHJ3S0NkTUJBRHIwYmxWV3dLc2NJ?= =?utf-8?B?NUpRbitvdVc0T3ZuSEJIZUJkSXMyL3VONnBuWlRvS3J6SVFBSlBtMXpWcDcx?= =?utf-8?B?Ny9Md3lJS0VNTWRwbkpNZFNadi9pYWIvcTJxVStYOC92Nkp1NCszM3I5Zmp4?= =?utf-8?B?V2FBR1FUcjNYUGZvaDJrTkhRR2RHY2ZsNTA3MU8xdHp1TVdTdEkyUFloNGw3?= =?utf-8?B?M2JyemZBOHArcXA2WGJlNDYwWVo2L3BYRWlKdE04Qyt3UFAybnoxNGhMSGMr?= =?utf-8?B?a1h3RUMxeFhLZkQ5eTRLSEZUaitpb0RWTGtwUXhVZnNBbG1uL1pyL1JNR1NG?= =?utf-8?B?Tm5hS1BoWitPTDJzOGE4YU9sVVo3d0pEakM5ZGxQTzhra0xnWlEvOWU5ZXFM?= =?utf-8?B?eUpEZjdHNWlZMnUrSW44aENTU2xhaTd2YU9CYmJyTGZsT0l3VFRoWVVXVXBN?= =?utf-8?B?UGZJOWtNRHRJeVNteW5Jd1dRQkpFSVZubXpnSlpsVmdzNVJ2UjlDR0ZFMThs?= =?utf-8?B?cHFDaGgrWlJ2RXdCczdkSlB4TFV5MmdHYzd6NmJKTSt2cUEvSHo1VURYUFlO?= =?utf-8?B?b1JtL29FZ1NzTloyVkMvcUx1TGQwNWwxRktLMUMxaDRMME1YREpwV3o5Um15?= =?utf-8?B?U1lEYlVkbk95TC9lOXBJMFg0cHRTMUFFMVdQWGwrYXVCSS9McjZMeUNJMUUz?= =?utf-8?B?UWtCZXNWMTFPL3F1RWI5WDlsQ1J0WTc3VmFBWndadEFCREJkRnAwazB2ZVFU?= =?utf-8?B?RUxocllYbVROdUFOK0U1cmR2VkZpYWRwS3ZKWGRNU1R6Z2ZaTU5BUjMyZ0N6?= =?utf-8?B?U1VFUndFeE02ZTd0SEpldklUQm1GZG4zbDYyaGZaV2xHT2tSWlNob29KaUhq?= =?utf-8?B?THgzanlNSXpGN2N3RUlMRzE1dUxXZkxKaC92REI4SUVpSDh0dW9QeUw1cEl4?= =?utf-8?B?YlhUVXRPUzhOMWpJNmFvWFhjR3Nla25jaG4yRDFuaW5kUUVOdHdsWjJZK3JQ?= =?utf-8?B?QUo0Rnl6eDFGZWFrSHdHcDExWi9NNVRYRlRKQ05xSXExQ0NaQ29YeHdDSlc4?= =?utf-8?B?RG1KR24rTEMyZldnOUM1bmF1OEhFRjZEYmdERDIrbTJvZys5b0xGOU9YT3lJ?= =?utf-8?B?cU9HYll3a01UelBsc2p6b3BRNUQ5SmkyQjVaa203SUdnQTlhbks2SnR6QVNC?= =?utf-8?B?UXN4Q0NHSngzRElGMFhwMGhkTHBzWnJaVnBBUmVRdGhUNWhyS3pCQm90Zmlk?= =?utf-8?B?M3loeEVwbXJkNkNYMGpiLzFwSHAxdGxYaTNFeGs2djVCUk1aNC9WSWdyYUlQ?= =?utf-8?B?U3JSSnE0TmExbDZwUXZ6UC9UbXVudTdtck5pdi9BR09kelJuMTdhdXlMSUw1?= =?utf-8?B?SUNrSmdvcmdwNnQ2T2ZRRExXMFlFNFRNdkxraDBsajl1WHRDWDNqQ1NQMEZp?= =?utf-8?B?Nk9KblNKbE90eitTWFE2K2VlYjlSVDczMkdZUWtlTWszZ2M0UWRhV1o5bGxW?= =?utf-8?B?dG5hUFJMMnpWRmhscTFNYWhJQmlGVkNVa2RoTEIrc1ZmMGtyeDBoemxJaU8x?= =?utf-8?B?a2RzSmpKMUxIYUVsc0xTOFVRL1BFRTVkNC8zaTR1eUdEc1dJWW1DL2h3ek9w?= =?utf-8?B?QldXaVo4M1FtUERHNXNwUkVXR2diVW81ZVlWRTdRZW93bHRXWlE4RVpsVVdT?= =?utf-8?B?WmxaS1hTeHRTYzhBSGs0T1JweTU2M3h6N3planhERzlKc1N1aUtETEZHNGZa?= =?utf-8?Q?uZvF7CMWBqYVRP4q+kFNTPwm/?= X-Microsoft-Exchange-Diagnostics: =?utf-8?B?MTtCTjZQUjA3TUIzMDkwOzY6TFVOd3FPTHlFaHcxaURNOE8xK3dtbHF4Tkh5?= =?utf-8?B?bkFIZDlURGplYWlVbE1UZmdncDVWSUk3MWM2RnlLZzdubGkvdllQRURBWTRQ?= =?utf-8?B?c1JicG4vTU9WNnA2aWtnNU5XZ2Q4dGZHQnRHeUt2UkZqQU8xaGsxbjhVTGxZ?= =?utf-8?B?RkVUVmlENGJSYU96YjAxYVdXa0hVclZEMVhOTWxqNDF2ZlQyVlBmc3g3WjVo?= =?utf-8?B?ZUw4cEw0aTdaY0dQdFV1MlQ5S21Gb3F2WFYySkh0WjlQYnZ6OVptQUlOamEy?= =?utf-8?B?MmVmMnV3Y09JWjRTMTE1SVBaKzk4TEJJUU05VEhjMElyazNybnZBNzBTUXBy?= =?utf-8?B?SUJoZWdFY3R4WDYxQUFUdU5yaHNiak8yNUdvM2RPTlN2RnhNZjVUTU1wak1o?= =?utf-8?B?UDhkNkJwU3dPVVBNTFZDT3FCZFgwZHVqWGNpNGdrWDNCWjdkS2dtNStkUzRw?= =?utf-8?B?ZzEzejgxa1JMMXdmaEx5Tzl5NmNBeVE0b3ZtNkVPWlQ4UHpJUjFBNTRxNXIv?= =?utf-8?B?SFpMN1JOcEVlSExwMlRnbGJMcHRyUzl2czFXZEJqdXFycGVIUiszMTdjR0dM?= =?utf-8?B?OC9yKzk1R0tJRmhuQlZ4NEJpZUtxTjNiY01JWGhQclhEbzhQWDJVUnUzTjdO?= =?utf-8?B?eDBQQlROcC9RaU9HNUl5c2FIbFhBd3JjakNjb1JpU0I1RXp2VHZsRTRmaTZG?= =?utf-8?B?dnV1cUJkVGZIdllpU1lYWWxoSlBzYlgvSVdkTmZsMFhpb2kvNVN4MmN4anBa?= =?utf-8?B?QjRzZzI1T0p3Tjl2ZkhoSGlOZ0svdWg4bXlqWVFMYTB1TVNneEJ5NTl2d3o2?= =?utf-8?B?QVpCUkVMb1NEM09SanpMY2xlZStyNldmbS9lL21BMFRYYzBKTFNrWmZOUlNx?= =?utf-8?B?dkJiR0JkaitySDNNVkhNdGM5YUxzbWZPMUlnRW84YnJpR2tkTVZ3ZW9JU1dV?= =?utf-8?B?V3dpdlJQcUpQWEt0Q3FZYUJ4TjcwOVkrSWIzTzE1MGFWVWdDZGtIc0VieGto?= =?utf-8?B?K2lESDdtRzZMREZBWjg1RXA5c2ZMT2l6Q205TEJMNURLRzErZzVFVnhQczZh?= =?utf-8?B?MXF6MFFTNjZrRXVXYjh3RnZuamlBb09hR1hFTC9UMWVFazNTTDl1ZWcyODBI?= =?utf-8?B?M3pxWEcxUUN2OUNEc0FhZGROekxOVmFiaEFuc3dPN3ZUWllFSS9qRFpEaWs4?= =?utf-8?B?endXZm9iNFRUWW1UZVZGdnZVWThrYktrOStma0htWGFZblFidDJPNEF5V3V6?= =?utf-8?B?djdiWlEwTTlEc21kWDg1aHhGSG9lb2ZZWnM2VG5PeUswWFNjOEVrWVVyLzNH?= =?utf-8?Q?i9t3p0jZs54tMF925yknKoIBm/kKsJI=3D?= X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 5:1AvZobUilowhtDNcZ4j38RGr+pjcB0MqYTOuhYULWrxmCfs7qHFX9BASxB/yk8PxY6S2fifotjbmwzNVVuzcecD2tuVKjhw30zoqJBArKmkXmEYCOslTFRqZXq1v/iyk3NbkskmZRoY2sP/OVyKrdR5gNX7Sz7bXv1rbkNPkpzgPPtVxHgjdHDogVqhg85XCewSLFKcmdaXjEOl8/Fd3eVgTtukeX5vWZAogyQSBJAOT/UubZ5Ue5+8aeOrRraBPid9DLHEHrbZIp+OZsdld7OJyV5KQoXhBkQKj3301AjZEansJ1SEZjgKNSBJlDBdpqwrLB7xFoh7hwdGTs2345Arpm0LunHicHJsWe+73OMC3zx9B0s9hb7PFUIBXJnlUGmsCgA9VWqoqukURYO5J4lq6X5SVeaa2FSFKCoGX1cRRKYcp+rZAKe4YX8HTQ7Kc0rsp3+q5QF8glKbin+JrlY6gFRp/VrUuxylHmCMkGDBHSloTMzpzOU39S8WNhWRR; 24:Vd/7iISHjnggyBCdDrj0o+gCzE2H8o1/toBqmIsFbKgpu45qwN3L3KXxxk7gUMZWqKI5FG7/XSBWpeTHsqyozZroiC8SuF1S/Aw3KtzlGLg= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-Microsoft-Exchange-Diagnostics: 1; BN6PR07MB3090; 7:46GmFjQs/L1+iIljeUp5vUw2DPGfvhpgljV/7Bw2vQevP4/krsy1s3Ct83NhXrK/IDHfPAJfgG2Z2GMvUYFtnvklJBjkLrYUmkFsGDcLTphVlbXLwHqW/GCcFy5kzhz+/r/Jmme1YBYDWpbaPPhr5y6vmY/K6mKZ0Idi1PMUBB5yIq+tV+B5Keal9pO/ar3efvKB1GRobE7Xp/l8xec7Uf/S7gqMIiDsOc8WPPa4hKeN8aM1t0eNb7r5FhnEYEy6iHiNcLmsPsz/GdreeiwoLFtZTWWsaR6lPzDtZSLEt3ipB0sc0oORYh5XcHIcKHGkgSMy16m3Y55wcPGSqSMndmiItAC3xuqCqPb88YkGfuCWsdVnGNigvM2twFZsWzxuqLgtiI9/U9aTNPP9LSjGXb1NXRpYsBerzqhLMgxSxePOw4ZAi6nwzc58Wue5qWWsYTRnc180peu6h7UbSqMdtmKQ2EKUNadk+QZS5hFQEoJ8dtyjPeWpMgaUVdXbG1NOnMNbgv5XUFSRgkBIpuKSwTBHW/JwqL+m1OwKqDyxTJcXO5kZ9cAHZ1F6kYaEnr/d6/cw+mnBv4tgGAUjMIza70VbxX2r8CdYOtA/EV6fb5He7W9SN7CdtlT0EQz3P+HnShJCX5gXc4NOfVCRMhWz0C3oyeV3V6AljMS9H7h186zx2CzU9UNZuk0EOr6Uus/+GxDh0oM26RbtRPsUj24z4s2ekqqlUfra/KgV533gTLkr6DIa+WWTXqenVgZCLnGYF61J0cKN2LoOz83hMGp4N4rE9SIoj58uAo4RoYjKwQE= X-OriginatorOrg: caviumnetworks.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 06 Jul 2017 14:13:26.8515 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-Transport-CrossTenantHeadersStamped: BN6PR07MB3090 Subject: Re: [dpdk-dev] [PATCH 07/10] linuxapp/eal_vfio: honor iova mode before mapping X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 Jul 2017 14:13:31 -0000 On Thursday 06 July 2017 06:41 PM, Maxime Coquelin wrote: > > On 07/06/2017 03:08 PM, Maxime Coquelin wrote: >> >> >> On 07/06/2017 01:19 PM, santosh wrote: >>> On Thursday 06 July 2017 04:29 PM, Maxime Coquelin wrote: >>> >>>> >>>> On 07/06/2017 11:49 AM, Jerin Jacob wrote: >>>>> -----Original Message----- >>>>>> Date: Thu, 6 Jul 2017 09:58:41 +0200 >>>>>> From: Maxime Coquelin >>>>>> To: Jerin Jacob >>>>>> CC: Santosh Shukla , >>>>>> thomas@monjalon.net, bruce.richardson@intel.com, dev@dpdk.org, >>>>>> hemant.agrawal@nxp.com, shreyansh.jain@nxp.com, gaetan.rivet@6wind.com >>>>>> Subject: Re: [dpdk-dev] [PATCH 07/10] linuxapp/eal_vfio: honor iova mode >>>>>> before mapping >>>>>> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 >>>>>> Thunderbird/52.1.0 >>>>>> >>>>>> >>>>>> >>>>>> On 07/05/2017 05:43 PM, Jerin Jacob wrote: >>>>>>> -----Original Message----- >>>>>>>> Date: Wed, 5 Jul 2017 11:14:01 +0200 >>>>>>>> From: Maxime Coquelin >>>>>>>> To: Santosh Shukla , >>>>>>>> thomas@monjalon.net, bruce.richardson@intel.com, dev@dpdk.org >>>>>>>> CC: jerin.jacob@caviumnetworks.com, hemant.agrawal@nxp.com, >>>>>>>> shreyansh.jain@nxp.com, gaetan.rivet@6wind.com >>>>>>>> Subject: Re: [dpdk-dev] [PATCH 07/10] linuxapp/eal_vfio: honor iova mode >>>>>>>> before mapping >>>>>>>> User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 >>>>>>>> Thunderbird/52.1.0 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On 06/08/2017 01:05 PM, Santosh Shukla wrote: >>>>>>>>> Check iova mode and accordingly map iova to pa or va. >>>>>>>>> >>>>>>>>> Signed-off-by: Santosh Shukla >>>>>>>>> Signed-off-by: Jerin Jacob >>>>>>>>> --- >>>>>>>>> lib/librte_eal/linuxapp/eal/eal_vfio.c | 10 ++++++++-- >>>>>>>>> 1 file changed, 8 insertions(+), 2 deletions(-) >>>>>>>>> >>>>>>>>> diff --git a/lib/librte_eal/linuxapp/eal/eal_vfio.c b/lib/librte_eal/linuxapp/eal/eal_vfio.c >>>>>>>>> index 04914406f..348b7a7f4 100644 >>>>>>>>> --- a/lib/librte_eal/linuxapp/eal/eal_vfio.c >>>>>>>>> +++ b/lib/librte_eal/linuxapp/eal/eal_vfio.c >>>>>>>>> @@ -706,7 +706,10 @@ vfio_type1_dma_map(int vfio_container_fd) >>>>>>>>> dma_map.argsz = sizeof(struct vfio_iommu_type1_dma_map); >>>>>>>>> dma_map.vaddr = ms[i].addr_64; >>>>>>>>> dma_map.size = ms[i].len; >>>>>>>>> - dma_map.iova = ms[i].phys_addr; >>>>>>>>> + if (rte_eal_iova_mode() == RTE_IOVA_VA) >>>>>>>>> + dma_map.iova = dma_map.vaddr; >>>>>>>>> + else >>>>>>>>> + dma_map.iova = ms[i].phys_addr; >>>>>>>>> dma_map.flags = VFIO_DMA_MAP_FLAG_READ | VFIO_DMA_MAP_FLAG_WRITE; >>>>>>>> >>>>>>>> IIUC, it is changing default behavior for VFIO devices. >>>>>>>> >>>>>>>> I see a possible problem, but I'm not sure the case is valid. >>>>>>>> >>>>>>>> Imagine you have two devices in the iommu group, and the two devices are >>>>>>>> used in separate processes. Each process could try two different >>>>>>>> physical addresses at the same virtual address, and so the second map >>>>>>>> would fail. >>>>>>> >>>>>>> IMO, Doesn't look like a problem. Here is the data flow >>>>>>> >>>>>>> 1) The vfio DMA map function(vfio_type1_dma_map()) will be called only >>>>>>> on primary process >>>>>>> http://dpdk.org/browse/dpdk/tree/lib/librte_eal/linuxapp/eal/eal_vfio.c#n359 >>>>>>> >>>>>>> 2) On secondary process, DPDK rte_eal_huge_page_attach() will make sure >>>>>>> that, the Secondary process has the _same_ virtual address as primary or >>>>>>> exit from on attach. >>>>>>> http://dpdk.org/browse/dpdk/tree/lib/librte_eal/linuxapp/eal/eal_memory.c#n1452 >>>>>>> >>>>>>> 3) Since secondary process adds the mapped the virtual address in step (2). >>>>>>> in the page table in OS. On SMMU entry miss(When device >>>>>>> request from I/O transaction), OS will load the mapping and update the SMMU >>>>>>> "context" with page tables from MMU. >>>>>> >>>>>> Ok thanks for the detailed info, but what about the case where the same >>>>>> iommu group is used by two primary processes? >>>>> >>>>> Does that case exist with DPDK? We always need to blacklist same BDF in >>>>> the secondary process to make things work with existing DPDK setup. Which >>>>> make sense as well. Only primary process configures the HW blocks. >>>> >>>> I meant the case when two BDF are in the same IOMMU group (if ACS is not >>>> supported at some point in the hierarchy). And I meant two primary >>>> processes running, like for example two containers running each a DPDK >>>> application. >>>> >>>> Maybe this is not a valid use-case (it is not secure, as it would break >>>> isolation between the two containers), but it seems that it is something >>>> DPDK allows today, if I'm not mistaken. >>>> >>> I'm not sure how two primary process could run, as because latter primary process >>> would try accessing /var/run/.rte_config and would fail at this [1] point. >>> >>> It's not valid use-case for dpdk (imo). >>> [1] http://dpdk.org/browse/dpdk/tree/lib/librte_eal/linuxapp/eal/eal.c#n204 >> >> Yes this is possible. I had never used it before, but Thomas told me it >> is supported by setting--file-prefix option. I had a trial, and I >> confirm it works: >> session 1> ./install/bin/testpmd -l 0,2 --socket-mem=1024 -w 0000:05:00.0 --proc-type=primary --file-prefix=app1 -- --disable-hw-vlan -i --rxq=1 --txq=1 --nb-cores=1 --forward-mode=io >> session 2> ./install/bin/testpmd -l 0,3 --socket-mem=1024 -w 0000:05:00.1 --proc-type=primary --file-prefix=app2 -- --disable-hw-vlan -i --rxq=1 --txq=1 --nb-cores=1 --forward-mode=io >> >> In the above example, two ports of the same card is used by two >> processes. Note that in this case, ACS is supproted and both ports have >> their own iommu group. > > # ls -al /var/run/.app* > -rw-r-----. 1 root root 208420 Jul 6 09:08 /var/run/.app1_config > -rw-r--r--. 1 root root 49728 Jul 6 09:08 /var/run/.app1_hugepage_info > srwxr-xr-x. 1 root root 0 Jul 6 09:08 /var/run/.app1_mp_socket > -rw-r-----. 1 root root 208420 Jul 6 09:08 /var/run/.app2_config > -rw-r--r--. 1 root root 45584 Jul 6 09:08 /var/run/.app2_hugepage_info > srwxr-xr-x. 1 root root 0 Jul 6 09:08 /var/run/.app2_mp_socket > Yes, You're right, you can start two primary process, I missed that point. Use-case which you mentioned is ok, because they are under two different iommu group so proposed scheme will work. It may not work for the case when ACS not present, so its bypass mode which falls under vfio-noiommu category. Having said that: Per discussion on [1]. The proposed scheme where bus makes decision based on pci_id and/or pci_drv will be a full proof solution, and that way other types of devices will not be impacted. Right? [1] https://www.mail-archive.com/dev@dpdk.org/msg70283.html