From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50047.outbound.protection.outlook.com [40.107.5.47]) by dpdk.org (Postfix) with ESMTP id 74B967D8A for ; Sat, 19 Aug 2017 10:45:19 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=verint.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version; bh=fDFwC6z3BR9YWm4OqKE5QgPQm4DOjoAyr0hGbCIFbMo=; b=jA8CAdGaDDjOf5oGSVFvVs2+lDg3GhQ+f/xVuoxTXjnaX0x8ouVTLR+n5eb1GP1NTPZF1s8rH4x41tcZFV+GRb2Zzjg7ma6NG9W1+nVZtUH/mUtKb1SYL2bSCBsCUFwNw1EZmHamXNxqEs81JlBPLx0niHtM62jMazv63h96a30= Received: from VI1PR0102CA0005.eurprd01.prod.exchangelabs.com (2603:10a6:802::18) by AM5PR01MB2945.eurprd01.prod.exchangelabs.com (2603:10a6:206:9::11) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.1.1341.21; Sat, 19 Aug 2017 08:45:18 +0000 Received: from VE1EUR01FT046.eop-EUR01.prod.protection.outlook.com (2a01:111:f400:7e01::209) by VI1PR0102CA0005.outlook.office365.com (2603:10a6:802::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P256) id 15.1.1362.18 via Frontend Transport; Sat, 19 Aug 2017 08:45:18 +0000 Authentication-Results: spf=pass (sender IP is 193.27.93.18) smtp.mailfrom=verint.com; dpdk.org; dkim=none (message not signed) header.d=none;dpdk.org; dmarc=bestguesspass action=none header.from=verint.com; Received-SPF: Pass (protection.outlook.com: domain of verint.com designates 193.27.93.18 as permitted sender) receiver=protection.outlook.com; client-ip=193.27.93.18; helo=mail.verint.com; Received: from mail.verint.com (193.27.93.18) by VE1EUR01FT046.mail.protection.outlook.com (10.152.3.92) with Microsoft SMTP Server (version=TLS1_0, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA_P384) id 15.1.1341.15 via Frontend Transport; Sat, 19 Aug 2017 08:45:17 +0000 Received: from TLVMBX1.Verint.Corp.Verintsystems.com ([169.254.2.245]) by TLVCAS2.verint.corp.verintsystems.com ([::1]) with mapi id 14.03.0319.002; Sat, 19 Aug 2017 11:45:16 +0300 From: "Dorsett, Michal" To: "users@dpdk.org" Thread-Topic: movzbl in rte_eth_rx_burst Thread-Index: AdMYx3nw4VyD6+q6SRiynfm/Vj3ugw== Date: Sat, 19 Aug 2017 08:45:15 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.61.241.157] MIME-Version: 1.0 X-EOPAttributedMessage: 0 X-MS-Office365-Filtering-HT: Tenant X-Forefront-Antispam-Report: CIP:193.27.93.18; IPV:CAL; SCL:-1; CTRY:IL; EFV:NLI; SFV:NSPM; SFS:(10009020)(39860400002)(2980300002)(438002)(199003)(189002)(584324002)(2906002)(356003)(189998001)(512954002)(33656002)(26826003)(69596002)(626005)(7116003)(7736002)(110136004)(15974865002)(606006)(5660300001)(104016004)(2501003)(55846006)(84326002)(790700001)(8676002)(102836003)(8936002)(50986999)(81156014)(81166006)(86362001)(1730700003)(54356999)(72206003)(9686003)(2920100001)(2900100001)(3846002)(7696004)(260700001)(6116002)(9326002)(6916009)(106466001)(2351001)(478600001)(54896002)(6306002)(5640700003)(236005); DIR:OUT; SFP:1101; SCL:1; SRVR:AM5PR01MB2945; H:mail.verint.com; FPR:; SPF:Pass; PTR:bzq-193.27.93-18.bgp.bezeqint.net; A:1; MX:1; LANG:en; X-Microsoft-Exchange-Diagnostics: 1; VE1EUR01FT046; 1:cSNQzXGRCFqJ9EtCdVTPpn3wT7FE+Z3cKDYh1yvhl3R+oP18hEeO+U/nx4JogO1gL5Z4JeASSK5Ii4nadOgqVU1viVRDpbKsZIPd7ElpNnG8UunRw1hxsVH28d0piI9L X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e3843f5b-3ce0-41a1-ddb7-08d4e6de9e3e X-Microsoft-Antispam: UriScan:; BCL:0; PCL:0; RULEID:(300000500095)(300135000095)(300000501095)(300135300095)(22001)(300000502095)(300135100095)(2017030254152)(8251501002)(300000503095)(300135400095)(2017052603031)(201703131423075)(201703031133081)(201702281549075)(300000504095)(300135200095)(300000505095)(300135600095)(300000506095)(300135500095); SRVR:AM5PR01MB2945; X-Microsoft-Exchange-Diagnostics: 1; AM5PR01MB2945; 3:656GhLogdYFBvJfE0m3+VOO/fTVHVWf068TaXuF6tEwl6a2hMu8BDDJIMrUc6r/0AojvjEGYbQgW92ewtbgnKwHg3P8/4JjT3FUrAiqnKvfPjP9ZDuugJmublD/AllRMNxaaKHbtNjUQcdo8HkzdMKlQJxVNJfxL4Pm7ubhAjJHjPvArIg/0r6NNf+Rcv6selqGljXGg/n2vgQWmjk/WFaZlN1+/bUHSgQ/bGaDEvHylkxLmNJEjXXsDhuf42qovyDleW6sXuKbnDGiXUGw4o4zFg56ZJSuQbuv3bdf087xP16hFV8L4OKeh3xkoSq/hH8sjNBL0Ba7Qnn/8kAfdqw==; 25:Chfj6Z4FZpIs5TaofuM6/HAY4CuuDjGZgo+koKeewlq+I1sY32u9A7oNcKuolg99le6kcuOXN0yILXLO9sEkxv54NQIXNeNeFJDAZHb979JCiOu2h0dWOHTfmPTL1V8xph+NYRhF6N4dKsuzDF38hzip8Ow9BwmOdTBKklyO13I9X8cutAEl9xA9F0OqAKIUX58GllD8bRKFTTY+Umn9e6M9+mq/WqQ4/zUEhROc2tIZvFyZj/68zLuLCNQY/ybgqiUVOZQLjl7SqfbkcojlrMoxGBPNlsKeRxboZhOOtv5b401mMPcsJtRS2vG2SEdt5DvbsYr5NOR0pYSAW9KMvg==; 31:+COQKXFtdIkiHgAIAPv8Zpih0HBdKEN8UH9TLhZD86c1FM5BIIJvPUySP42GmkCQLbcxp6psOcqiYgVaQHtX9dd4uWxGE7TtGQ2Bi50OirHtFAbp2hUriS7vG5QcRlpJtR0UPACH8ktiTFN+gSk1lnf7/WT4sv22eJCX5b7lkiddMHQTetRM4MPHB9XYMuAOztgNmV11VXp9N4QijcZwNnUehdHNl4lDXU8vTwiQdQg= X-MS-TrafficTypeDiagnostic: AM5PR01MB2945: X-Microsoft-Exchange-Diagnostics: 1; AM5PR01MB2945; 20:gO3mUiYLlkLt66I5fIHdOXG/JVLrxdj4I6s8ReD6YqM9r6AI6A22OmDYRFC70r+3XAsK78F+99tt7MVbAc46HL3toOOcWZhXdT3lI5dikFZnf6cRcBosEa/uz5KC/89AEqSOQU0eR1OMF5tS+Q0HpMHOvwT8c9VnJg6xWr0Xv4toHJ+Ojo2igyJhzjgCGIFrUNwjLbA7LRUgPNS2lu1vJgYPM2zgtVlf5FeW0b+Z7xg2Dt28YnNuKlz6sAlH8M9P5sGAj1yzfaRqy11HItEwOs5DxWQZlCG4irx61WCiFXMUDXfCd/qWyMr0OI4FwZeczV9qEWketGWX4CP+sd95lF1O/m1zUKbKwawZykCZpyQXQBE1zTW/f+xu9o1/RUYvBIUhqZQEQMZyWHhfQOYMPQKf9e6HSUXA39lUUphN8VorDBeVwmSbqSqRJHCxLP7cUsaz3otG4y/IYdJlqU2loaOjDlalO99pyQ1XN7Fe4UDyc6ko7ayd37VTEYga4b3E; 4:BNQar1VGq/UCQ1fjl6rfj/wIGQswpLDZlQC4a0aL0ll6UX6Eph56HxM/gtBHQVQAegluG4zU12OqyBuDmFqcvNrY3Muz+7gFa3VPUmKcf2gTieE0ZNVYtXCGOFW2fQiOfAjHTYkSdJ+VSyNi7hHClmcbPfrQkOze2u9ONy17bnyuKZWxtojduqXf4sABWentQso2LDkreBaXOUkYJSA1XsjGYrHUySsTA7D1u9Vn5FoRHzPcz4sXxwimMLl/50bFUgLVRAeqvoW+ZCy3SwJH1jabdcTgf9EI11CW772g8DKG4LKtCHMYmRD5dJjWBFHHLr2V3SjeX5JRzLZiFIzgj9teUS8dWPwPUYySPpcpZoB3Y2VylxrKE8wXp1aJIqgZ X-Exchange-Antispam-Report-Test: UriScan:(59506183516421)(176510541525296)(21748063052155); X-Microsoft-Antispam-PRVS: X-Exchange-Antispam-Report-CFA-Test: BCL:0; PCL:0; RULEID:(100000700101)(100105000095)(100000701101)(100105300095)(100000702101)(100105100095)(6040450)(601004)(2401047)(8121501046)(5005006)(13013025)(13021025)(3002001)(93006095)(93004095)(100000703101)(100105400095)(10201501046)(6055026)(6041248)(201703131423075)(201702281528075)(201703061421075)(201703061406153)(20161123555025)(20161123562025)(20161123558100)(20161123560025)(20161123564025)(6072148)(201708071742011)(100000704101)(100105200095)(100000705101)(100105500095); SRVR:AM5PR01MB2945; BCL:0; PCL:0; RULEID:(100000800101)(100110000095)(100000801101)(100110300095)(100000802101)(100110100095)(100000803101)(100110400095)(100000804101)(100110200095)(100000805101)(100110500095); SRVR:AM5PR01MB2945; X-Forefront-PRVS: 04041A2886 X-Microsoft-Exchange-Diagnostics: =?us-ascii?Q?1; AM5PR01MB2945; 23:zIA+mAFmt5rRge4WogYPO0qRk43+eZcR31ieSCISe?= =?us-ascii?Q?6AlUnbU/GgB/9k+VCDY43RsgP3UAv/N1Yj7rxhpMiwFRZZJhCHbAJgkoFmd9?= =?us-ascii?Q?RquywWRCJE8pRlcxK4xra2wUnYn3r0EHb9c5NAnooXPL3YdkYaxLpIjXDbdW?= =?us-ascii?Q?tgw0ngDoda1HM6AW/l7vUDai9KWc0HC1gcPDjYCu2XIASxhkUyPaW3GF4yHc?= =?us-ascii?Q?OvRLsdFugwMld2PPAQLt8xmlI6UJXCPKMWjWHT1rh07fI0T2g+JAkQszvaLg?= =?us-ascii?Q?NYL8O24apHsSzy0U1RQPD6D1le73JD6Du6Ajes3VPSyzWwEdEck6+rT0afm8?= =?us-ascii?Q?BX0MRl4KamfXtMbVi3GFlN7H7evUU03xXUAA7XKXH0eRl2gVtqP3wNZa921n?= =?us-ascii?Q?+5o/BMUUZLZ5Aohk9Ho8+f++FKOCj0Sf0BBHN5bpqDVmaJOAgOXTO0pOL5s5?= =?us-ascii?Q?jJk21WsteFrmcVox3UtGz01TfcYkkiu3xA7pE7MjeYfUhA6R2e9BnwETahsV?= =?us-ascii?Q?fGqI6u6UcNU1H44ayUHCAbJhZOG0ojXs+J6cgScauG+DaXJRCfL0sbsfEHgC?= =?us-ascii?Q?iSrX/hVaX7xkUZb6VmP2a0TYUKrGn2JL3KgNts3uqyQOIGwKnM31Mc+oPVqn?= =?us-ascii?Q?pNTDCXeElrZTPa+9vUM9uhmusXZbrLeIN4HsXYXN8E2GzcnJe0fwr17YkEgu?= =?us-ascii?Q?tOC6l4w8iu0XCZSVuuG4xQ+DRV4+i2DMvygKVeGgJ7ovLdyeJjeUlVbJk1nt?= =?us-ascii?Q?OcZrcN1Po+qWG9O7KNkega/nZHBXxEMPBdqZ6ou1qSQlFC9SqdxU/kNc4C9r?= =?us-ascii?Q?FsE5s6UoNW+nhVXLC2fi0JDaWBotoV+spndFyLP6YlZ2S1JJRTnWCQI7WzbT?= =?us-ascii?Q?FxTGEaf48IzXmuYTXfMhDbudzhTfNpTiYogfDAYsEhFztbDZNimW2aSuTeVu?= =?us-ascii?Q?DQBIZeZRNZUje7Zl/tuxgsku2Jc5Ct6xHQ7l/ZxzwpSA33ZFb5FjBDL1BZcq?= =?us-ascii?Q?HvzpLnMUr/JUPLSm60hCA+HxnfD/Y2VAMsx1eRxcT90MhvHFAswG2hepBhHL?= =?us-ascii?Q?AXl08pMhMInGv5mcDBb403zcbBsCKeqTnvbv2ZON4KIKl22Jj7h+w3427bEM?= =?us-ascii?Q?MXkofhcz6PKDr6z4R/GhrNfQoqYyiV2abcKL1zXd0pBwmyUjVMhgCQN+zASc?= =?us-ascii?Q?j243pvZIQy5fONK8Z9HcvQ+2qCvYNphYLwi?= X-Microsoft-Exchange-Diagnostics: 1; AM5PR01MB2945; 6:lQ4qF9F8AtrktuMSaz9o7o7QRfm6TVxrWxLtLAdB5VMf2uj/QLceDk27oUqjJv407deQGhZg2jt1+upI2GXv8RNrCG79zlkNwaOfFcX6LL1GkN6uonzZVwkbcHWGwvETtJjRQporME2NP8PZSD0XA9J/TdmkgbP4TMaGAmxofNpMxpLrqgnqD8DQzbOtfEWZ2h0JC/jPrUtgf2v0YLIbavFNL08v+QDoKzR7EnssXjxfS/UddQh1R8Ap1C77t86Pzfz1vwMLSlYcSvYVZ5WcVyKeAh2wpHvp/kBNfmUSOB+jNuOXHb/I9jk70FL9InP8srmwjprpEf5RTbR4xmSa6A==; 5:+LqCDTIhhf7020NecZz6oeZboMrTJ0PMG+H/R9ott85o9ktgWxQPiYOen4bacH1MLfX0YDCCXoKzHekPdhyNkBPtPjkuEEQXrIWb2vXT5jadgylCdpliDebqQh5YpIrbWjZZl4T10F0GVPpJGq6mqg==; 24:wmQLPcRrJoomLUs69ThwxYddMvmYP3orxO5/0t7DuxmM4Qu0I8y9bjoFON3vTY8jHIbLlp3bW+4C4GgAXVpbywDZeyxU03rS6D+cp5pJK/g=; 7:I6/aTd5LQgloVTFhAqnMex5pqZIOMGUT43D8aADC94suoaDPk7cVR2tpgNR0ioZebq0McLqGMQvCg+bthciuJ63jvWZfjGh9NK8jJ09/ej7CsflZ0Zo+1TilgYVkHpSd+aeV+j17GdwCG8BXaUlAGWAX8xr2oYsd3SbWlQoeWSs4q86zf7CzsCEAgdLAc8sNQcebaPEWJTJMsI3XQ/GKjk4cat++cWehkV1j/HuQMbQ= SpamDiagnosticOutput: 1:99 SpamDiagnosticMetadata: NSPM X-OriginatorOrg: verint.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 19 Aug 2017 08:45:17.4224 (UTC) X-MS-Exchange-CrossTenant-Id: bb2ed304-4099-49cf-b081-cbb7a3a580ca X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=bb2ed304-4099-49cf-b081-cbb7a3a580ca; Ip=[193.27.93.18]; Helo=[mail.verint.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR01MB2945 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-users] movzbl in rte_eth_rx_burst X-BeenThere: users@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK usage discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 19 Aug 2017 08:45:19 -0000 Hi, We are running dpdk 16.07. Below is a snippet from a perf annotate report o= f a CPU running a thread that constantly reads packets. As you can see, the hottest instructruction is movzbl 0x10(%rcx),%r15d which, I believe, is referring to struct rte_eth_dev *dev =3D &rte_eth_devices[port_id]; Can someone explain why this instruction is so costly, and how I can remedy= this? 0.66 x lea 0xc8(%rsp),%rax x _ZN8LBThread7executeEv(): x { x u32RetPkt =3D vecRXQ->at(u32Index)->receiveRawPac= kets(xPktArr, BURST_SIZE); x movq $0x0,0x50(%rsp) x _ZNSt6vectorIP18ReceivePacketQueueSaIS1_EE2atEm(): x movq $0x0,0x48(%rsp) x __mempool_generic_put(): 0.09 x mov %rax,0x88(%rsp) 0.42 x mov 0x60(%rsp),%rax x add $0x18,%rax 0.05 x mov %rax,0x40(%rsp) 0.14 x mov 0x50(%rsp),%rax x _ZN8LBThread7executeEv(): 0.71 x 370: mov (%rdx,%rax,8),%rax 0.57 x mov %rax,%rcx 1.23 x mov %rax,0x80(%rsp) x rte_rdtsc(): x } x #endif x x asm volatile("rdtsc" : x "=3Da" (tsc.lo_32), x "=3Dd" (tsc.hi_32)); 0.47 x rdtsc x rte_eth_rx_burst(): x */ x static inline uint16_t x rte_eth_rx_burst(uint8_t port_id, uint16_t queue_id, x struct rte_mbuf **rx_pkts, const uint16_t nb= _pkts) x { x struct rte_eth_dev *dev =3D &rte_eth_devices[port_id]= ; 24.74 x movzbl 0x10(%rcx),%r15d x rte_rdtsc(): 0.09 x mov %eax,%r13d x _ZN18ReceivePacketQueue17receiveRawPacketsEP6Packetj(): x uint64_t u64StartTick =3D CPUCycles::getTSCCycles(); x uint32_t u32PtksReceived; x int32_t refcnt; x int retCode; x x u32PtksReceived =3D rte_eth_rx_burst(m_u8PortId, m_u16Que= ueIndexForNICPort, m_pArrPktsBurst, u32NumOfPkts); 2.60 x movzwl 0xe(%rcx),%r14d x rte_rdtsc(): x shl $0x20,%rdx x _ZN18ReceivePacketQueue17receiveRawPacketsEP6Packetj(): x lea 0x18(%rcx),%r12 x rte_rdtsc(): 0.05 x or %rdx,%r13 x rte_eth_rx_burst(): x RTE_PMD_DEBUG_TRACE("Invalid RX queue_id=3D%d= \n", queue_id); x return 0; x } x #endif x int16_t nb_rx =3D (*dev->rx_pkt_burst)(dev->data->rx_= queues[queue_id], Thanks, Michal Dorsett Developer, Strategic IP Group Desk: +972 962 4350 Mobile: +972 50 771 6689 Verint Cyber Intelligence www.verint.com This electronic message may contain proprietary and confidential informatio= n of Verint Systems Inc., its affiliates and/or subsidiaries. The informati= on is intended to be for the use of the individual(s) or entity(ies) named = above. If you are not the intended recipient (or authorized to receive this= e-mail for the intended recipient), you may not use, copy, disclose or dis= tribute to anyone this message or any information contained in this message= . If you have received this electronic message in error, please notify us b= y replying to this e-mail.