From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from dpdk.org (dpdk.org [92.243.14.124]) by inbox.dpdk.org (Postfix) with ESMTP id 3B64DA051C; Sat, 18 Jan 2020 16:01:38 +0100 (CET) Received: from [92.243.14.124] (localhost [127.0.0.1]) by dpdk.org (Postfix) with ESMTP id 611F01BE8A; Sat, 18 Jan 2020 16:01:37 +0100 (CET) Received: from EUR04-DB3-obe.outbound.protection.outlook.com (mail-eopbgr60064.outbound.protection.outlook.com [40.107.6.64]) by dpdk.org (Postfix) with ESMTP id EC8CA1BE81 for ; Sat, 18 Jan 2020 16:01:35 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=b6BSWh5SrKhO811LYA5ni5WQLUVp+TvxZ/x8hh/WNbM=; b=+Ny+Oar5skn353iOJe/tmNeCY54LPvVFZZ9srlqBw91aQwP6QvTRydaAdrt0TSVVXwgtTKll7xfZXHnCUBflURbtCndKC+kM+WMQC34IIKksmpIVy3Fj8mBR6Dy/m6mpVKM9M6qmbHNDfSx9FbLt6Ki406TxFAB2/CPn7jQUBcs= Received: from VI1PR08CA0146.eurprd08.prod.outlook.com (2603:10a6:800:d5::24) by AM6PR08MB3093.eurprd08.prod.outlook.com (2603:10a6:209:41::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2644.19; Sat, 18 Jan 2020 15:01:33 +0000 Received: from AM5EUR03FT008.eop-EUR03.prod.protection.outlook.com (2a01:111:f400:7e08::203) by VI1PR08CA0146.outlook.office365.com (2603:10a6:800:d5::24) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2644.19 via Frontend Transport; Sat, 18 Jan 2020 15:01:33 +0000 Authentication-Results: spf=pass (sender IP is 63.35.35.123) smtp.mailfrom=arm.com; dpdk.org; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com;dpdk.org; dmarc=bestguesspass action=none header.from=arm.com; Received-SPF: Pass (protection.outlook.com: domain of arm.com designates 63.35.35.123 as permitted sender) receiver=protection.outlook.com; client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com; Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by AM5EUR03FT008.mail.protection.outlook.com (10.152.16.123) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2602.11 via Frontend Transport; Sat, 18 Jan 2020 15:01:33 +0000 Received: ("Tessian outbound 4f3bc9719026:v40"); Sat, 18 Jan 2020 15:01:33 +0000 X-CR-MTA-TID: 64aa7808 Received: from 185489473739.2 by 64aa7808-outbound-1.mta.getcheckrecipient.com id BED78B36-D628-4170-BC38-8824AE4902B3.1; Sat, 18 Jan 2020 15:01:28 +0000 Received: from EUR01-HE1-obe.outbound.protection.outlook.com by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 185489473739.2 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384); Sat, 18 Jan 2020 15:01:28 +0000 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Mr0GC4r1u+GKlJ3I5D+WpzKKb/aw4pZpVx1J5WGIQ0kMaYoXcLXkU/DPk2T77di3eYzvuUAWKkJQA2XfrHPNFKAH3Bngy5FGnpcA+l6x5SOe2uEM3llp6vGwCmcDZrBfp8Bn2Cldw5cXtr40hU8TAgRug6h2K8+IpA3zF22blgD2ed+8aUe/2b7NaHokoY/O1u4m84T6Vs8yoVLFwz6R9GxqlgQmjm4y8nBnQKEX5vCktLIUb5qltcRYa9OOiDjDLIKD+tGILJ0qtq8I9e/JsF21rv6m/wC/Cdn9wtGh4j3n8NZqHYB1hLCypRCBCi8bBqdpQLl1cqXtD0pGJCy7Mw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=b6BSWh5SrKhO811LYA5ni5WQLUVp+TvxZ/x8hh/WNbM=; b=TqnO9jOzfFsc4wnD9P0OLaRtv9vznKKV7WAooJwy2YjB231j9Nc67c40P425kOPanC/pWLfQ5QSLoWoNA2zgTZDr+VFu24SY3aHgX8iujDBq522GrojpoUYyJ8hmNJC9mlvQZKZn6GRxmAtcO9qT/lRDPSd8iicxz+gVM6XQGpg2hO22ekgz9zQgME5uXXUf2wCjCGJ1vaMBdaSniLJf3SW5YhtEj3qWjZkN2shP2vm4BVt80TwzP83eQKsmbqBUhlSu3WpJR6WSmC6sI0AVuUY17K31NUqDMGdX9HtXEaSKYW7X6sAXg0nOHQ1f4/dMFimHuO4I3MnIzXKfdjLtug== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com; s=selector2-armh-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=b6BSWh5SrKhO811LYA5ni5WQLUVp+TvxZ/x8hh/WNbM=; b=+Ny+Oar5skn353iOJe/tmNeCY54LPvVFZZ9srlqBw91aQwP6QvTRydaAdrt0TSVVXwgtTKll7xfZXHnCUBflURbtCndKC+kM+WMQC34IIKksmpIVy3Fj8mBR6Dy/m6mpVKM9M6qmbHNDfSx9FbLt6Ki406TxFAB2/CPn7jQUBcs= Received: from VE1PR08MB5149.eurprd08.prod.outlook.com (20.179.30.27) by VE1PR08MB4702.eurprd08.prod.outlook.com (10.255.114.146) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2644.19; Sat, 18 Jan 2020 15:01:20 +0000 Received: from VE1PR08MB5149.eurprd08.prod.outlook.com ([fe80::29eb:a1be:8f8f:fae2]) by VE1PR08MB5149.eurprd08.prod.outlook.com ([fe80::29eb:a1be:8f8f:fae2%7]) with mapi id 15.20.2644.024; Sat, 18 Jan 2020 15:01:20 +0000 From: Honnappa Nagarahalli To: "Ananyev, Konstantin" , Olivier Matz CC: "sthemmin@microsoft.com" , "jerinj@marvell.com" , "Richardson, Bruce" , "david.marchand@redhat.com" , "pbhagavatula@marvell.com" , "Wang, Yipeng1" , "dev@dpdk.org" , Dharmik Thakkar , Ruifeng Wang , Gavin Hu , nd , David Christensen , Honnappa Nagarahalli , nd Thread-Topic: [PATCH v9 2/6] lib/ring: apis to support configurable element size Thread-Index: AQHVzVP5v7UUz/cGRk6KVJewCaHTXafvDZhwgAFOaoCAACa6kA== Date: Sat, 18 Jan 2020 15:01:19 +0000 Message-ID: References: <20190906190510.11146-1-honnappa.nagarahalli@arm.com> <20200116052511.8557-1-honnappa.nagarahalli@arm.com> <20200116052511.8557-3-honnappa.nagarahalli@arm.com> <20200117163417.GY22738@platinum> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ts-tracking-id: aab51b01-63e4-4071-9dc2-edb6fe5f3a18.0 x-checkrecipientchecked: true Authentication-Results-Original: spf=none (sender IP is ) smtp.mailfrom=Honnappa.Nagarahalli@arm.com; x-originating-ip: [217.140.111.135] x-ms-publictraffictype: Email X-MS-Office365-Filtering-HT: Tenant X-MS-Office365-Filtering-Correlation-Id: f8ef74dc-0c8d-4b69-422b-08d79c274eaf X-MS-TrafficTypeDiagnostic: VE1PR08MB4702:|VE1PR08MB4702:|AM6PR08MB3093: x-ld-processed: f34e5979-57d9-4aaa-ad4d-b122a662184d,ExtAddr x-ms-exchange-transport-forked: True X-Microsoft-Antispam-PRVS: x-checkrecipientrouted: true nodisclaimer: True x-ms-oob-tlc-oobclassifiers: OLM:8273;OLM:8273; x-forefront-prvs: 0286D7B531 X-Forefront-Antispam-Report-Untrusted: SFV:NSPM; SFS:(10009020)(4636009)(39860400002)(366004)(376002)(136003)(396003)(346002)(189003)(199004)(66946007)(64756008)(76116006)(66476007)(66556008)(7696005)(66446008)(86362001)(33656002)(52536014)(5660300002)(6506007)(2906002)(8676002)(81166006)(186003)(81156014)(54906003)(110136005)(8936002)(55016002)(478600001)(4326008)(9686003)(71200400001)(26005)(7416002)(316002); DIR:OUT; SFP:1101; SCL:1; SRVR:VE1PR08MB4702; H:VE1PR08MB5149.eurprd08.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: arm.com does not designate permitted sender hosts) X-MS-Exchange-SenderADCheck: 1 X-Microsoft-Antispam-Untrusted: BCL:0; X-Microsoft-Antispam-Message-Info-Original: tUrYyfZIEZGGUg//gf9iwXA8YnhwjZXyXn2aNyTRBKk5r9w2miC1mG/lgziDUWF4w9Q9w49wQMLTBnx4B1VhwaVPgCQnS6KBWZgi3c0o/VDUrZ70yeZLPtb/tFaGZMONanoSEdzbWsSBhXnhbPxrkjIpRlg2/OjqvYn2TWsJK6+ulgJqIiqiFx+VmFcHjBc0m/A9djWv1Hc8tWwba/+ks4McLf0VFf5w5OeAMdqx/ECsFEMaM4Cbw8R7YJwjn69RgjLcHoj3AMlZ+wlHJdVG7+Q3Ev631difeKtXObrtJ/8GvNmv8WsWoSca2Y/qB7Wgql5TxMssTbZUHfkIhwael5Stinm8UZb2V6+3etd0xNptf7BUo9v1HSJ9On84w48ZKh12TmOqpO0i+dvqhiIvb6jfGf7VafmSg/2ZRrlRrQXXDIaPzrbDW94eV8Goy31/ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-MS-Exchange-Transport-CrossTenantHeadersStamped: VE1PR08MB4702 Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=Honnappa.Nagarahalli@arm.com; X-EOPAttributedMessage: 0 X-MS-Exchange-Transport-CrossTenantHeadersStripped: AM5EUR03FT008.eop-EUR03.prod.protection.outlook.com X-Forefront-Antispam-Report: CIP:63.35.35.123; IPV:CAL; SCL:-1; CTRY:IE; EFV:NLI; SFV:NSPM; SFS:(10009020)(4636009)(376002)(346002)(39860400002)(396003)(136003)(189003)(199004)(52536014)(316002)(110136005)(54906003)(8676002)(36906005)(4326008)(2906002)(478600001)(33656002)(5660300002)(26826003)(356004)(81166006)(81156014)(86362001)(8936002)(70206006)(336012)(26005)(6506007)(9686003)(55016002)(70586007)(7696005)(186003); DIR:OUT; SFP:1101; SCL:1; SRVR:AM6PR08MB3093; H:64aa7808-outbound-1.mta.getcheckrecipient.com; FPR:; SPF:Pass; LANG:en; PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com; MX:1; A:1; X-MS-Office365-Filtering-Correlation-Id-Prvs: d5c9c695-9122-4d31-4ffe-08d79c2746c2 X-Forefront-PRVS: 0286D7B531 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: UGj/B8BHrNBbi8iKb8msLm6YzkgTqQ8NF5abJ7nlbC5H+Y6CZf9xThJLDQWS/LP5FlZnVQCVjJoLjcUXdspxJFCVWBLHXQg2wqcVnCZGE5i8Pjt02PM5Ax6uia7p2wvV0CYPfYud5mlQxZ6gSylxo0PAt936X0VXef8r66XazAv6QuIeqMpWhv2NcSELLgAAip5W7s1QRTUoCC/atVAHHQPwvt/3+CqogtY60/IesoElpoHlWdszveghLcNSoKBAysgHVMd2yUH5pZaQ/3IpCXglbjNirydkTXO0EAHxqYoP9Jy4t40NYEKccLH5qY3guWRaROOK6WLoquVvau1BW3neu1YVItUUzwpu/ZwoYyz6xrcsGDkVL4eRosItz4io/lrfu+6yjl1/YBoDJw+3h1o6o1RuJeCl7k3qam/rPVE8V4BdAQ6uy2PmM6DUqU+O X-OriginatorOrg: arm.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Jan 2020 15:01:33.3350 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: f8ef74dc-0c8d-4b69-422b-08d79c274eaf X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d; Ip=[63.35.35.123]; Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com] X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR08MB3093 Subject: Re: [dpdk-dev] [PATCH v9 2/6] lib/ring: apis to support configurable element size X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" >=20 > > > On Wed, Jan 15, 2020 at 11:25:07PM -0600, Honnappa Nagarahalli wrote: > > > > Current APIs assume ring elements to be pointers. However, in many > > > > use cases, the size can be different. Add new APIs to support > > > > configurable ring element sizes. > > > > > > > > Signed-off-by: Honnappa Nagarahalli > > > > Reviewed-by: Dharmik Thakkar > > > > Reviewed-by: Gavin Hu > > > > Reviewed-by: Ruifeng Wang > > > > --- > > > > lib/librte_ring/Makefile | 3 +- > > > > lib/librte_ring/meson.build | 4 + > > > > lib/librte_ring/rte_ring.c | 41 +- > > > > lib/librte_ring/rte_ring.h | 1 + > > > > lib/librte_ring/rte_ring_elem.h | 1003 > ++++++++++++++++++++++++++ > > > > lib/librte_ring/rte_ring_version.map | 2 + > > > > 6 files changed, 1045 insertions(+), 9 deletions(-) create mode > > > > 100644 lib/librte_ring/rte_ring_elem.h > > > > > > > > > > [...] > > > > > > > +static __rte_always_inline void > > > > +enqueue_elems_32(struct rte_ring *r, const uint32_t size, uint32_t= idx, > > > > + const void *obj_table, uint32_t n) { > > > > + unsigned int i; > > > > + uint32_t *ring =3D (uint32_t *)&r[1]; > > > > + const uint32_t *obj =3D (const uint32_t *)obj_table; > > > > + if (likely(idx + n < size)) { > > > > + for (i =3D 0; i < (n & ~0x7); i +=3D 8, idx +=3D 8) { > > > > + ring[idx] =3D obj[i]; > > > > + ring[idx + 1] =3D obj[i + 1]; > > > > + ring[idx + 2] =3D obj[i + 2]; > > > > + ring[idx + 3] =3D obj[i + 3]; > > > > + ring[idx + 4] =3D obj[i + 4]; > > > > + ring[idx + 5] =3D obj[i + 5]; > > > > + ring[idx + 6] =3D obj[i + 6]; > > > > + ring[idx + 7] =3D obj[i + 7]; > > > > + } > > > > + switch (n & 0x7) { > > > > + case 7: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 6: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 5: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 4: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 3: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 2: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 1: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + } > > > > + } else { > > > > + for (i =3D 0; idx < size; i++, idx++) > > > > + ring[idx] =3D obj[i]; > > > > + /* Start at the beginning */ > > > > + for (idx =3D 0; i < n; i++, idx++) > > > > + ring[idx] =3D obj[i]; > > > > + } > > > > +} > > > > + > > > > +static __rte_always_inline void > > > > +enqueue_elems_64(struct rte_ring *r, uint32_t prod_head, > > > > + const void *obj_table, uint32_t n) { > > > > + unsigned int i; > > > > + const uint32_t size =3D r->size; > > > > + uint32_t idx =3D prod_head & r->mask; > > > > + uint64_t *ring =3D (uint64_t *)&r[1]; > > > > + const uint64_t *obj =3D (const uint64_t *)obj_table; > > > > + if (likely(idx + n < size)) { > > > > + for (i =3D 0; i < (n & ~0x3); i +=3D 4, idx +=3D 4) { > > > > + ring[idx] =3D obj[i]; > > > > + ring[idx + 1] =3D obj[i + 1]; > > > > + ring[idx + 2] =3D obj[i + 2]; > > > > + ring[idx + 3] =3D obj[i + 3]; > > > > + } > > > > + switch (n & 0x3) { > > > > + case 3: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 2: > > > > + ring[idx++] =3D obj[i++]; /* fallthrough */ > > > > + case 1: > > > > + ring[idx++] =3D obj[i++]; > > > > + } > > > > + } else { > > > > + for (i =3D 0; idx < size; i++, idx++) > > > > + ring[idx] =3D obj[i]; > > > > + /* Start at the beginning */ > > > > + for (idx =3D 0; i < n; i++, idx++) > > > > + ring[idx] =3D obj[i]; > > > > + } > > > > +} > > > > + > > > > +static __rte_always_inline void > > > > +enqueue_elems_128(struct rte_ring *r, uint32_t prod_head, > > > > + const void *obj_table, uint32_t n) { > > > > + unsigned int i; > > > > + const uint32_t size =3D r->size; > > > > + uint32_t idx =3D prod_head & r->mask; > > > > + rte_int128_t *ring =3D (rte_int128_t *)&r[1]; > > > > + const rte_int128_t *obj =3D (const rte_int128_t *)obj_table; > > > > + if (likely(idx + n < size)) { > > > > + for (i =3D 0; i < (n & ~0x1); i +=3D 2, idx +=3D 2) > > > > + memcpy((void *)(ring + idx), > > > > + (const void *)(obj + i), 32); > > > > + switch (n & 0x1) { > > > > + case 1: > > > > + memcpy((void *)(ring + idx), > > > > + (const void *)(obj + i), 16); > > > > + } > > > > + } else { > > > > + for (i =3D 0; idx < size; i++, idx++) > > > > + memcpy((void *)(ring + idx), > > > > + (const void *)(obj + i), 16); > > > > + /* Start at the beginning */ > > > > + for (idx =3D 0; i < n; i++, idx++) > > > > + memcpy((void *)(ring + idx), > > > > + (const void *)(obj + i), 16); > > > > + } > > > > +} > > > > + > > > > +/* the actual enqueue of elements on the ring. > > > > + * Placed here since identical code needed in both > > > > + * single and multi producer enqueue functions. > > > > + */ > > > > +static __rte_always_inline void > > > > +enqueue_elems(struct rte_ring *r, uint32_t prod_head, const void > > > *obj_table, > > > > + uint32_t esize, uint32_t num) > > > > +{ > > > > + /* 8B and 16B copies implemented individually to retain > > > > + * the current performance. > > > > + */ > > > > + if (esize =3D=3D 8) > > > > + enqueue_elems_64(r, prod_head, obj_table, num); > > > > + else if (esize =3D=3D 16) > > > > + enqueue_elems_128(r, prod_head, obj_table, num); > > > > + else { > > > > + uint32_t idx, scale, nr_idx, nr_num, nr_size; > > > > + > > > > + /* Normalize to uint32_t */ > > > > + scale =3D esize / sizeof(uint32_t); > > > > + nr_num =3D num * scale; > > > > + idx =3D prod_head & r->mask; > > > > + nr_idx =3D idx * scale; > > > > + nr_size =3D r->size * scale; > > > > + enqueue_elems_32(r, nr_size, nr_idx, obj_table, nr_num); > > > > + } > > > > +} > > > > > > Following Konstatin's comment on v7, enqueue_elems_128() was > > > modified to ensure it won't crash if the object is unaligned. Are we > > > sure that this same problem cannot also occurs with 64b copies on > > > all supported architectures? (I mean 64b access that is only aligned > > > on 32b) > > Konstantin mentioned that the 64b load/store instructions on x86 can > handle unaligned access. >=20 > Yep, I think we are ok here for IA and IA-32. >=20 > > On aarch64, the load/store (non-atomic, which will be used in this > > case) can handle unaligned access. > > > > + David Christensen to comment for PPC >=20 > If we are in doubt here, probably worth to add a new test-case(s) for UT? I will modify one of the functional tests to use unaligned address. >=20 > > > > > > > > Out of curiosity, would it make a big perf difference to only use > > > enqueue_elems_32()? > > Yes, this was having a significant impact on 128b elements. I did not t= ry on > 64b elements. > > I will run the perf test with 32b copy for 64b element size and get bac= k. Following is the data. Mostly, the 64b element copy performs better. 8B with 64b element copy = 8B with 32b element copy RTE>>ring_perf_autotest = RTE>>ring_perf_autotest =09 ### Testing single element enq/deq ### = ### Testing single element enq/deq ### elem APIs: element size 8B: SP/SC: single: 10.02 = elem APIs: element size 8B: SP/SC: single: 11.21 elem APIs: element size 8B: MP/MC: single: 51.21 = elem APIs: element size 8B: MP/MC: single: 46.22 =09 ### Testing burst enq/deq ### = ### Testing burst enq/deq ### elem APIs: element size 8B: SP/SC: burst (size: 8): 39.30 = elem APIs: element size 8B: SP/SC: burst (size: 8): 62.= 01 elem APIs: element size 8B: SP/SC: burst (size: 32): 92.73 = elem APIs: element size 8B: SP/SC: burst (size: 32): 189.= 15 elem APIs: element size 8B: MP/MC: burst (size: 8): 76.92 = elem APIs: element size 8B: MP/MC: burst (size: 8): 109.28 elem APIs: element size 8B: MP/MC: burst (size: 32): 134.84 = elem APIs: element size 8B: MP/MC: burst (size: 32): 229.98 =09 ### Testing bulk enq/deq ### = ### Testing bulk enq/deq ### elem APIs: element size 8B: SP/SC: bulk (size: 8): 32.56 = elem APIs: element size 8B: SP/SC: bulk (size: 8): 62.0= 1 elem APIs: element size 8B: SP/SC: bulk (size: 32): 93.53 = elem APIs: element size 8B: SP/SC: bulk (size: 32): 189.= 78 elem APIs: element size 8B: MP/MC: bulk (size: 8): 76.76 = elem APIs: element size 8B: MP/MC: bulk (size: 8): 109.16 elem APIs: element size 8B: MP/MC: bulk (size: 32): 134.74 = elem APIs: element size 8B: MP/MC: bulk (size: 32): 229.87 ### Testing empty bulk deq ### = ### Testing empty bulk deq ### elem APIs: element size 8B: SP/SC: bulk (size: 8): 5.00 = elem APIs: element size 8B: SP/SC: bulk (size: 8): 3.0= 0 elem APIs: element size 8B: MP/MC: bulk (size: 8): 6.00 = elem APIs: element size 8B: MP/MC: bulk (size: 8): 6.00 ### Testing using two physical cores ### = ### Testing using two physical cores ### elem APIs: element size 8B: SP/SC: bulk (size: 8): 26.33 = elem APIs: element size 8B: SP/SC: bulk (size: 8): 47.03 elem APIs: element size 8B: MP/MC: bulk (size: 8): 83.22 = elem APIs: element size 8B: MP/MC: bulk (size: 8): 83.12 elem APIs: element size 8B: SP/SC: bulk (size: 32): 12.48 = elem APIs: element size 8B: SP/SC: bulk (size: 32): 20.73 elem APIs: element size 8B: MP/MC: bulk (size: 32): 24.53 = elem APIs: element size 8B: MP/MC: bulk (size: 32): 23.18 ### Testing using two NUMA nodes ### = ### Testing using two NUMA nodes ### elem APIs: element size 8B: SP/SC: bulk (size: 8): 54.35 = elem APIs: element size 8B: SP/SC: bulk (size: 8): 92.40 elem APIs: element size 8B: MP/MC: bulk (size: 8): 197.59 = elem APIs: element size 8B: MP/MC: bulk (size: 8): 198.98 elem APIs: element size 8B: SP/SC: bulk (size: 32): 36.54 = elem APIs: element size 8B: SP/SC: bulk (size: 32): 57.22 elem APIs: element size 8B: MP/MC: bulk (size: 32): 72.57 = elem APIs: element size 8B: MP/MC: bulk (size: 32): 65.65