From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 12D0FA04DB; Thu, 15 Oct 2020 18:00:56 +0200 (CEST) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id A63861EB06; Thu, 15 Oct 2020 18:00:53 +0200 (CEST) Received: from nat-hk.nvidia.com (nat-hk.nvidia.com [203.18.50.4]) by dpdk.org (Postfix) with ESMTP id E708B1EB01 for ; Thu, 15 Oct 2020 18:00:51 +0200 (CEST) Received: from HKMAIL104.nvidia.com (Not Verified[10.18.92.100]) by nat-hk.nvidia.com (using TLS: TLSv1.2, AES256-SHA) id ; Fri, 16 Oct 2020 00:00:49 +0800 Received: from HKMAIL101.nvidia.com (10.18.16.10) by HKMAIL104.nvidia.com (10.18.16.13) with Microsoft SMTP Server (TLS) id 15.0.1473.3; Thu, 15 Oct 2020 16:00:48 +0000 Received: from NAM11-BN8-obe.outbound.protection.outlook.com (104.47.58.168) by HKMAIL101.nvidia.com (10.18.16.10) with Microsoft SMTP Server (TLS) id 15.0.1473.3 via Frontend Transport; Thu, 15 Oct 2020 16:00:47 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=liX747/BHX+pA1NjB6JPmLIQblLjRzL0VZRrMhoRaSUEEmyq4npTIvfozOcc4IvSJQtKyMSGM29AUwrVbeA/ddIM9gk3R7n2EYWU8p1bMpUKrJQWQ5g1P6Kqfx/LF/WD6B/u8JBlEYyorsz8HkJjgzHKA0nIuwnVHIRSHnry9eMdtzOrcgk3l9kyuhol8NJ5sPKudQHA6giTQrOVKupY4dQcltLZfJ+X0T786esTx0UhnLniBDw7eBqhERVWo89Pnx3+DQrnMRT64Ai4HnHr0U4Gd+8CxcGJGXhzwgYj1aDq7XjXgkNDxjJO3WpaYYJybXapi8zH5q6T4SEcl8+CfQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=U65b3Xo71NzQ/g1LTLpN3tfQ189p4iN6qpzsoWifCO8=; b=oQ6jP/TK+CWfiMnI892CgqDzM+m+qjLuMLtq1trY/chVxl2Oth263NsgZJrgXlt4g3ivUwLcndXr+BreGPlIqHRRrq7vBqWxxGR1E05HayL5RUMxcEZ2dObAnYckq+Gw0LR8T6p7JUATZEIatpPBr4ir7MkXrTZMItj9xea5MopcfheQdMzI6qtmHzXJPjzlgp5S2YzOrJcuVV016Rwao6XiFe2U5TtH/y0ORUYaWN1jtdQVcizTbdKhTSjFLVrT0V+WlDoJ5t6hjYFF+GQIFR0VBgRS5KbzIv6j38K53qk/EBIOGQB1NuSoaV+bJIXclQX7gSt/RtTsYJYepR0RUQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=nvidia.com; dmarc=pass action=none header.from=nvidia.com; dkim=pass header.d=nvidia.com; arc=none Received: from DM6PR12MB4618.namprd12.prod.outlook.com (2603:10b6:5:78::20) by DM6PR12MB4636.namprd12.prod.outlook.com (2603:10b6:5:161::32) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3477.23; Thu, 15 Oct 2020 16:00:44 +0000 Received: from DM6PR12MB4618.namprd12.prod.outlook.com ([fe80::b5e2:e8fc:9e81:6c09]) by DM6PR12MB4618.namprd12.prod.outlook.com ([fe80::b5e2:e8fc:9e81:6c09%6]) with mapi id 15.20.3455.031; Thu, 15 Oct 2020 16:00:44 +0000 From: Ali Alnubani To: Bruce Richardson CC: "dev@dpdk.org" , NBU-Contact-Thomas Monjalon , Asaf Penso Thread-Topic: performance degradation with fpic Thread-Index: Adaiuk86MZR9/51zQW6gCxEe6g0Pvw== Date: Thu, 15 Oct 2020 16:00:44 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: authentication-results: intel.com; dkim=none (message not signed) header.d=none;intel.com; dmarc=none action=none header.from=nvidia.com; x-originating-ip: [178.130.167.221] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 6e3aa5d5-7e24-4793-9813-08d871237968 x-ms-traffictypediagnostic: DM6PR12MB4636: x-ld-processed: 43083d15-7273-40c1-b7db-39efd9ccc17a,ExtAddr x-ms-exchange-transport-forked: True x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8882; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: qQMuj/jZPmXpXaBFabPwajTYZ/O9eWCZTULeJqraABEP3ElowUEVDxTutgH/ddifhN2GMfBEla9JTpVW/R+iEP6BULGQP2ukoao4LJtKO/rKOzdP7K8jZiF1ERIySybUmKaSyZ/y0ZKD+7CX+1O3CKlZWQqrpsG8SIvLcP4GbgVItLJsiWLiUTPCTTHxa4QP01E8cJetlI34Y4dkM+fxKm3i+Y9VjlHxDf++/KwkBaI4i0Oufrd6Z71+dXkgZjcgTSSYBBS+g+0eJwsBDkVbmbWGHd3tG9TM5sYlk5WINDqHfI742nDBzbQFP1PVQN82 x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:DM6PR12MB4618.namprd12.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(346002)(376002)(39860400002)(136003)(366004)(396003)(6506007)(7696005)(6916009)(52536014)(26005)(478600001)(2906002)(4326008)(71200400001)(66556008)(64756008)(66446008)(66476007)(66946007)(76116006)(86362001)(33656002)(5660300002)(9686003)(107886003)(9326002)(8676002)(8936002)(3480700007)(54906003)(55016002)(316002)(186003); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: hpdtU+FwycEYiwwZU/bwYrd95SmN4+wFO/LZHj0A/mKAOaCcCIHZg8GigVYNs5Fnz1v/zaLbPAC+gumrkyo6EG80FM7cgMWdN3CLfjCNTluSJ57KpgAKBmhhCRwZUUgaqBYJEghzxkbmszTc/cj1S9eCAyAxsa72JZBXZOii2tfD9swX959f9GXsLDJDPDHmuGtEDtSPHrf/Cek+lUEjvLAv5CzmwdY7yR3vEbRM67meWtxLyl6bHt8DvC/mmoI2zk/YiHBRRiZM5p516oCzeE/V2X5qGo53mJ/JSmiLtFJCQLG6edYC0c4tQdbPFnB/k9ECzsxcmMNKG5P+cCwUkMvO/f/tJWZVCRp2tZkzLO1108MRMkH9wfw0L5fNFyCHMUZGSTF9mx/MOerCWuEFZia4ERITtrxBRK1M3/vyJZiTzxAVFk16xJwtIPRNLpqB9RZeUnThm9ucNEwKNUdmNzgzoP7XjKisfM4b/g3D+2BtVhybPQzmY8MA1H/T74aUt4ou7OT7Cy1eItT+nRabgw8/wvQAJqrer63wfSUy/3v6B/XGuZ2KM9u1rErhqED3oaQ8+WwkG8RCV5AsoGvSlB7DHTYq37NMwOWAOTxmGBC7chY6FP2TXSMLvGpA93m/bmAG30lUi519PgtOwJqCkQ== MIME-Version: 1.0 X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DM6PR12MB4618.namprd12.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 6e3aa5d5-7e24-4793-9813-08d871237968 X-MS-Exchange-CrossTenant-originalarrivaltime: 15 Oct 2020 16:00:44.5848 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 43083d15-7273-40c1-b7db-39efd9ccc17a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: aPtVUH6ALNxpOV5Onkcsbhk6XQ+qx3Tctv0qJwfI5xdTMz/37UVM91wOCGgwTsyy8x7ZZcGQF1+aqTldjwklHw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DM6PR12MB4636 X-OriginatorOrg: Nvidia.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nvidia.com; s=n1; t=1602777649; bh=U65b3Xo71NzQ/g1LTLpN3tfQ189p4iN6qpzsoWifCO8=; h=ARC-Seal:ARC-Message-Signature:ARC-Authentication-Results:From:To: CC:Subject:Thread-Topic:Thread-Index:Date:Message-ID: Accept-Language:Content-Language:X-MS-Has-Attach: X-MS-TNEF-Correlator:authentication-results:x-originating-ip: x-ms-publictraffictype:x-ms-office365-filtering-correlation-id: x-ms-traffictypediagnostic:x-ld-processed: x-ms-exchange-transport-forked:x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers:x-ms-exchange-senderadcheck: x-microsoft-antispam:x-microsoft-antispam-message-info: x-forefront-antispam-report:x-ms-exchange-antispam-messagedata: Content-Type:MIME-Version:X-MS-Exchange-CrossTenant-AuthAs: X-MS-Exchange-CrossTenant-AuthSource: X-MS-Exchange-CrossTenant-Network-Message-Id: X-MS-Exchange-CrossTenant-originalarrivaltime: X-MS-Exchange-CrossTenant-fromentityheader: X-MS-Exchange-CrossTenant-id:X-MS-Exchange-CrossTenant-mailboxtype: X-MS-Exchange-CrossTenant-userprincipalname: X-MS-Exchange-Transport-CrossTenantHeadersStamped:X-OriginatorOrg; b=gH4Taea6vPANZrQtpGDsWD8dXOPmWC4HvAvcKkV5xV/C+af9SU40duWm/HMQchaso 39zZdu7g9mc0jQltDtQDD/bZVepbalFcNsmdTFUT2Ic1OXhY4vgZgMZBpIDE+6mB4Z Fc4vpJoZa1XUnCMiMkWudk5GdYKXXa5uJHq1OBWcZRk3xZqPhb5WvOubB7w6Pa3a11 Jfi+U8F5zZSvgUUNxMoKA+KGm0xATf1RNZmgvv/czl05Vdp4rrDwW/vHXuBuG0yScR s++7O6TmRSd3uvLjz9xV1VHvndKLr1YYfmjfCgSn/s7HoLnaQyghVa6tlIqDXgX3ZW tuk+hXKipd/sg== Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.15 Subject: [dpdk-dev] performance degradation with fpic X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" Hi Bruce, We have been seeing in some cases that the DPDK forwarding performance is u= p to 9% lower when DPDK is built as static with meson compared to a build w= ith makefiles. The same degradation can be reproduced with makefiles on older DPDK release= s when building with EXTAR_CFLAGS set to "-fPIC", it can also be resolved i= n meson when passing "pic: false" to meson's static_library call (more twea= king needs to be done to prevent building shared libraries because this cha= nge breaks them). I can reproduce this drop with the following cases: * Baremetal / NIC: ConnectX-4 Lx / OS: RHEL7.4 / CPU: Intel(R) Xeon(R) = Gold 6154. Testpmd command: testpmd -c 0x7ffc0000 -n 4 -w d8:00.1 -w d8:00.0 --socket-mem=3D2048,2048 -= - --port-numa-config=3D0,1,1,1 --socket-num=3D1 --burst=3D64 --txd=3D512 --= rxd=3D512 --mbcache=3D512 --rxq=3D2 --txq=3D2 --nb-cores=3D1 --no-lsc-inter= rupt -i -a --rss-udp * KVM guest with SR-IOV passthrough / OS: RHEL7.4 / NIC: ConnectX-5 / H= ost's CPU: Intel(R) Xeon(R) Gold 6154. Testpmd command: testpmd --master-lcore=3D0 -c 0x1ffff -n 4 -w 00:05.0,mprq_en=3D1,mprq_log_= stride_num=3D6 --socket-mem=3D2048,0 -- --port-numa-config=3D0,0 --socket-n= um=3D0 --burst=3D64 --txd=3D1024 --rxd=3D1024 --mbcache=3D512 --rxq=3D16 --= txq=3D16 --nb-cores=3D8 --port-topology=3Dchained --forward-mode=3Dmacswap = --no-lsc-interrupt -i -a --rss-udp * Baremetal / OS: Ubuntu 18.04 / NIC: ConnectX-5 / CPU: Intel(R) Xeon(R= ) CPU E5-2697A v4. Testpmd command: testpmd -n 4 -w 0000:82:00.0,rxqs_min_mprq=3D8,mprq_en=3D1 -w 0000:82:00.= 1,rxqs_min_mprq=3D8,mprq_en=3D1 -c 0xff80 -- --burst=3D64 --mbcache=3D512 = -i --nb-cores=3D8 --rxq=3D8 --txq=3D8 --txd=3D1024 --rxd=3D1024 --rss-udp= --auto-start The packets being received and forwarded by testpmd are of IPv4/UDP type an= d 64B size. Should we disable PIC in static builds? Regards, Ali